Jul 20 13:01:50.157259 ip-10-0-134-121 systemd[1]: Starting Kubernetes Kubelet...
Jul 20 13:01:50.658134 ip-10-0-134-121 kubenswrapper[2584]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 20 13:01:50.658134 ip-10-0-134-121 kubenswrapper[2584]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 20 13:01:50.658134 ip-10-0-134-121 kubenswrapper[2584]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 20 13:01:50.658134 ip-10-0-134-121 kubenswrapper[2584]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 20 13:01:50.658134 ip-10-0-134-121 kubenswrapper[2584]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 20 13:01:50.658134 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:50.656067    2584 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 20 13:01:50.747578 ip-10-0-134-121 systemd[1]: Started Kubernetes Kubelet.
Jul 20 13:01:50.777748 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.663323    2584 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 20 13:01:50.777748 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.663337    2584 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 20 13:01:50.777748 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.663340    2584 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 20 13:01:50.777748 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.663344    2584 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 20 13:01:50.777748 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.663346    2584 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 20 13:01:50.777748 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.663349    2584 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 20 13:01:50.777748 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.663353    2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 20 13:01:50.777748 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.663356    2584 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 20 13:01:50.777748 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.663358    2584 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 20 13:01:50.777748 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.663362    2584 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 20 13:01:50.777748 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.663365    2584 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 20 13:01:50.777748 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.663367    2584 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 20 13:01:50.777748 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.663370    2584 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 20 13:01:50.777748 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.663373    2584 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 20 13:01:50.777748 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.663376    2584 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 20 13:01:50.777748 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.663378    2584 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 20 13:01:50.777748 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.663381    2584 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 20 13:01:50.777748 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.663383    2584 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 20 13:01:50.777748 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.663386    2584 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 20 13:01:50.777748 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.663389    2584 feature_gate.go:328] unrecognized feature gate: Example
Jul 20 13:01:50.779783 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.663392    2584 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 20 13:01:50.779783 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.663395    2584 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 20 13:01:50.779783 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.663397    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 20 13:01:50.779783 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.663401    2584 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 20 13:01:50.779783 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.663404    2584 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 20 13:01:50.779783 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.663407    2584 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 20 13:01:50.779783 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.663409    2584 feature_gate.go:328] unrecognized feature gate: Example2
Jul 20 13:01:50.779783 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.663411    2584 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 20 13:01:50.779783 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.663414    2584 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 20 13:01:50.779783 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.663416    2584 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 20 13:01:50.779783 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.663420    2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 20 13:01:50.779783 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.663423    2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 20 13:01:50.779783 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.663426    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 20 13:01:50.779783 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.663428    2584 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 20 13:01:50.779783 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.663431    2584 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 20 13:01:50.779783 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.663433    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 20 13:01:50.779783 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.663436    2584 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 20 13:01:50.779783 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.663438    2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 20 13:01:50.779783 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.663441    2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 20 13:01:50.779783 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.663444    2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 20 13:01:50.781205 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.663446    2584 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 20 13:01:50.781205 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.663449    2584 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 20 13:01:50.781205 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.663453    2584 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 20 13:01:50.781205 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.663457    2584 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 20 13:01:50.781205 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.663460    2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 20 13:01:50.781205 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.663462    2584 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 20 13:01:50.781205 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.663465    2584 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 20 13:01:50.781205 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.663467    2584 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 20 13:01:50.781205 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.663470    2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 20 13:01:50.781205 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.663472    2584 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 20 13:01:50.781205 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.663475    2584 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 20 13:01:50.781205 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.663478    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 20 13:01:50.781205 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.663480    2584 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 20 13:01:50.781205 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.663483    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 20 13:01:50.781205 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.663486    2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 20 13:01:50.781205 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.663488    2584 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 20 13:01:50.781205 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.663491    2584 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 20 13:01:50.781205 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.663493    2584 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 20 13:01:50.781205 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.663496    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 20 13:01:50.781205 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.663498    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 20 13:01:50.785086 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.663502    2584 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 20 13:01:50.785086 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.663504    2584 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 20 13:01:50.785086 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.663508    2584 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 20 13:01:50.785086 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.663511    2584 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 20 13:01:50.785086 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.663513    2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 20 13:01:50.785086 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.663516    2584 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 20 13:01:50.785086 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.663518    2584 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 20 13:01:50.785086 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.663521    2584 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 20 13:01:50.785086 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.663524    2584 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 20 13:01:50.785086 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.663528    2584 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 20 13:01:50.785086 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.663532    2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 20 13:01:50.785086 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.663535    2584 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 20 13:01:50.785086 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.663538    2584 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 20 13:01:50.785086 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.663541    2584 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 20 13:01:50.785086 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.663543    2584 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 20 13:01:50.785086 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.663546    2584 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 20 13:01:50.785086 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.663549    2584 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 20 13:01:50.785086 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.663552    2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 20 13:01:50.785086 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.663554    2584 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 20 13:01:50.785998 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.663556    2584 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 20 13:01:50.785998 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.663559    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 20 13:01:50.785998 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.663566    2584 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 20 13:01:50.785998 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.663569    2584 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 20 13:01:50.785998 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.663572    2584 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 20 13:01:50.785998 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.663574    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 20 13:01:50.785998 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.663577    2584 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 20 13:01:50.785998 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.663579    2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 20 13:01:50.785998 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.663582    2584 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 20 13:01:50.785998 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.663585    2584 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 20 13:01:50.785998 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.663589    2584 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 20 13:01:50.785998 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.663593    2584 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 20 13:01:50.785998 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.663595    2584 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 20 13:01:50.785998 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.663599    2584 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 20 13:01:50.785998 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.663601    2584 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 20 13:01:50.785998 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.663604    2584 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 20 13:01:50.785998 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.663607    2584 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 20 13:01:50.785998 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.663609    2584 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 20 13:01:50.785998 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.663612    2584 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 20 13:01:50.793211 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.663615    2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 20 13:01:50.793211 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.664391    2584 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 20 13:01:50.793211 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.664402    2584 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 20 13:01:50.793211 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.664407    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 20 13:01:50.793211 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.664413    2584 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 20 13:01:50.793211 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.664417    2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 20 13:01:50.793211 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.664421    2584 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 20 13:01:50.793211 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.664425    2584 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 20 13:01:50.793211 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.664429    2584 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 20 13:01:50.793211 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.664433    2584 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 20 13:01:50.793211 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.664438    2584 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 20 13:01:50.793211 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.664443    2584 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 20 13:01:50.793211 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.664446    2584 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 20 13:01:50.793211 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.664450    2584 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 20 13:01:50.793211 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.664454    2584 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 20 13:01:50.793211 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.664459    2584 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 20 13:01:50.793211 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.664462    2584 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 20 13:01:50.793211 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.664467    2584 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 20 13:01:50.793211 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.664471    2584 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 20 13:01:50.793211 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.664474    2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 20 13:01:50.793960 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.664479    2584 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 20 13:01:50.793960 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.664483    2584 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 20 13:01:50.793960 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.664486    2584 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 20 13:01:50.793960 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.664490    2584 feature_gate.go:328] unrecognized feature gate: Example
Jul 20 13:01:50.793960 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.664494    2584 feature_gate.go:328] unrecognized feature gate: Example2
Jul 20 13:01:50.793960 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.664498    2584 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 20 13:01:50.793960 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.664502    2584 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 20 13:01:50.793960 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.664506    2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 20 13:01:50.793960 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.664510    2584 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 20 13:01:50.793960 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.664514    2584 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 20 13:01:50.793960 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.664518    2584 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 20 13:01:50.793960 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.664521    2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 20 13:01:50.793960 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.664525    2584 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 20 13:01:50.793960 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.664531    2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 20 13:01:50.793960 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.664535    2584 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 20 13:01:50.793960 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.664539    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 20 13:01:50.793960 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.664542    2584 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 20 13:01:50.793960 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.664546    2584 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 20 13:01:50.793960 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.664550    2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 20 13:01:50.793960 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.664553    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 20 13:01:50.794890 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.664557    2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 20 13:01:50.794890 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.664561    2584 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 20 13:01:50.794890 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.664565    2584 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 20 13:01:50.794890 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.664569    2584 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 20 13:01:50.794890 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.664573    2584 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 20 13:01:50.794890 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.664577    2584 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 20 13:01:50.794890 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.664580    2584 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 20 13:01:50.794890 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.664584    2584 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 20 13:01:50.794890 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.664588    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 20 13:01:50.794890 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.664591    2584 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 20 13:01:50.794890 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.664596    2584 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 20 13:01:50.794890 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.664600    2584 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 20 13:01:50.794890 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.664603    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 20 13:01:50.794890 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.664607    2584 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 20 13:01:50.794890 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.664613    2584 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 20 13:01:50.794890 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.664618    2584 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 20 13:01:50.794890 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.664623    2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 20 13:01:50.794890 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.664626    2584 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 20 13:01:50.794890 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.664629    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 20 13:01:50.795771 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.664633    2584 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 20 13:01:50.795771 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.664637    2584 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 20 13:01:50.795771 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.664641    2584 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 20 13:01:50.795771 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.664645    2584 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 20 13:01:50.795771 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.664650    2584 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 20 13:01:50.795771 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.664655    2584 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 20 13:01:50.795771 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.664662    2584 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 20 13:01:50.795771 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.664667    2584 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 20 13:01:50.795771 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.664672    2584 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 20 13:01:50.795771 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.664675    2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 20 13:01:50.795771 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.664679    2584 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 20 13:01:50.795771 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.664683    2584 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 20 13:01:50.795771 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.664687    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 20 13:01:50.795771 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.664691    2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 20 13:01:50.795771 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.664694    2584 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 20 13:01:50.795771 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.664698    2584 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 20 13:01:50.795771 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.664701    2584 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 20 13:01:50.795771 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.664706    2584 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 20 13:01:50.796391 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.664710    2584 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 20 13:01:50.796391 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.664714    2584 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 20 13:01:50.796391 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.664718    2584 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 20 13:01:50.796391 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.664721    2584 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 20 13:01:50.796391 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.664724    2584 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 20 13:01:50.796391 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.664729    2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 20 13:01:50.796391 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.664733    2584 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 20 13:01:50.796391 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.664737    2584 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 20 13:01:50.796391 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.664741    2584 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 20 13:01:50.796391 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.664745    2584 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 20 13:01:50.796391 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.664748    2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 20 13:01:50.796391 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.664752    2584 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 20 13:01:50.796391 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.664756    2584 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 20 13:01:50.796391 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.664760    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 20 13:01:50.796391 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.664764    2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 20 13:01:50.796391 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.664768    2584 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 20 13:01:50.796391 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.664772    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 20 13:01:50.796391 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.664775    2584 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 20 13:01:50.796391 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.664779    2584 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 20 13:01:50.796391 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.664782    2584 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 20 13:01:50.797222 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.664786    2584 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 20 13:01:50.797222 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.664791    2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 20 13:01:50.797222 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.664794    2584 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 20 13:01:50.797222 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.665361    2584 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 20 13:01:50.797222 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.665369    2584 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 20 13:01:50.797222 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.665373    2584 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 20 13:01:50.797222 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.665377    2584 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 20 13:01:50.797222 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.665381    2584 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 20 13:01:50.797222 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.665385    2584 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 20 13:01:50.797222 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.665388    2584 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 20 13:01:50.797222 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.665393    2584 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 20 13:01:50.797222 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.665398    2584 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 20 13:01:50.797222 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.665402    2584 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 20 13:01:50.797222 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.665405    2584 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 20 13:01:50.797222 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.665409    2584 feature_gate.go:328] unrecognized feature gate: Example2
Jul 20 13:01:50.797222 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.665413    2584 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 20 13:01:50.797222 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.665417    2584 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 20 13:01:50.797222 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.665422    2584 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 20 13:01:50.797222 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.665425    2584 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 20 13:01:50.797222 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.665431    2584 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 20 13:01:50.798160 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.665436    2584 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 20 13:01:50.798160 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.665441    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 20 13:01:50.798160 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.665447    2584 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 20 13:01:50.798160 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.665451    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 20 13:01:50.798160 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.665455    2584 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 20 13:01:50.798160 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.665459    2584 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 20 13:01:50.798160 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.665463    2584 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 20 13:01:50.798160 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.665466    2584 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 20 13:01:50.798160 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.665469    2584 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 20 13:01:50.798160 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.665472    2584 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 20 13:01:50.798160 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.665476    2584 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 20 13:01:50.798160 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.665480    2584 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 20 13:01:50.798160 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.665484    2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 20 13:01:50.798160 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.665488    2584 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 20 13:01:50.798160 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.665492    2584 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 20 13:01:50.798160 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.665496    2584 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 20 13:01:50.798160 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.665499    2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 20 13:01:50.798160 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.665503    2584 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 20 13:01:50.798160 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.665507    2584 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 20 13:01:50.798160 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.665511    2584 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 20 13:01:50.799240 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.665516    2584 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 20 13:01:50.799240 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.665519    2584 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 20 13:01:50.799240 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.665523    2584 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 20 13:01:50.799240 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.665526    2584 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 20 13:01:50.799240 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.665531    2584 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 20 13:01:50.799240 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.665535    2584 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 20 13:01:50.799240 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.665538    2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 20 13:01:50.799240 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.665542    2584 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 20 13:01:50.799240 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.665546    2584 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 20 13:01:50.799240 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.665550    2584 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 20 13:01:50.799240 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.665553    2584 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 20 13:01:50.799240 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.665557    2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 20 13:01:50.799240 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.665561    2584 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 20 13:01:50.799240 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.665565    2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 20 13:01:50.799240 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.665568    2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 20 13:01:50.799240 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.665572    2584 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 20 13:01:50.799240 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.665576    2584 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 20 13:01:50.799240 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.665580    2584 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 20 13:01:50.799240 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.665583    2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 20 13:01:50.799240 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.665587    2584 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 20 13:01:50.800244 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.665591    2584 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 20 13:01:50.800244 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.665594    2584 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 20 13:01:50.800244 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.665598    2584 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 20 13:01:50.800244 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.665603    2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 20 13:01:50.800244 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.665607    2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 20 13:01:50.800244 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.665612    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 20 13:01:50.800244 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.665616    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 20 13:01:50.800244 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.665619    2584 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 20 13:01:50.800244 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.665623    2584 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 20 13:01:50.800244 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.665626    2584 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 20 13:01:50.800244 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.665630    2584 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 20 13:01:50.800244 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.665634    2584 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 20 13:01:50.800244 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.665638    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 20 13:01:50.800244 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.665641    2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 20 13:01:50.800244 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.665645    2584 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 20 13:01:50.800244 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.665649    2584 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 20 13:01:50.800244 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.665653    2584 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 20 13:01:50.800244 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.665665    2584 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 20 13:01:50.800244 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.665669    2584 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 20 13:01:50.909392 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.665674    2584 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 20 13:01:50.909392 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.665677    2584 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 20 13:01:50.909392 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.665681    2584 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 20 13:01:50.909392 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.665685    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 20 13:01:50.909392 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.665689    2584 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 20 13:01:50.909392 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.665693    2584 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 20 13:01:50.909392 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.665697    2584 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 20 13:01:50.909392 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.665702    2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 20 13:01:50.909392 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.665708    2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 20 13:01:50.909392 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.665711    2584 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 20 13:01:50.909392 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.665715    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 20 13:01:50.909392 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.665723    2584 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 20 13:01:50.909392 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.665727    2584 feature_gate.go:328] unrecognized feature gate: Example
Jul 20 13:01:50.909392 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.665731    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 20 13:01:50.909392 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.665734    2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 20 13:01:50.909392 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.665738    2584 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 20 13:01:50.909392 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.665742    2584 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 20 13:01:50.909392 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.665746    2584 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 20 13:01:50.909392 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.665750    2584 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 20 13:01:50.910258 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.665754    2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 20 13:01:50.910258 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.665757    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 20 13:01:50.910258 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.665761    2584 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 20 13:01:50.910258 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.665766    2584 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 20 13:01:50.910258 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:50.665866    2584 flags.go:64] FLAG: --address="0.0.0.0"
Jul 20 13:01:50.910258 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:50.665880    2584 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 20 13:01:50.910258 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:50.665888    2584 flags.go:64] FLAG: --anonymous-auth="true"
Jul 20 13:01:50.910258 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:50.665895    2584 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 20 13:01:50.910258 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:50.665900    2584 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 20 13:01:50.910258 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:50.665905    2584 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 20 13:01:50.910258 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:50.665911    2584 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 20 13:01:50.910258 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:50.665917    2584 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 20 13:01:50.910258 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:50.665924    2584 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 20 13:01:50.910258 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:50.665928    2584 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 20 13:01:50.910258 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:50.665934    2584 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 20 13:01:50.910258 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:50.665939    2584 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 20 13:01:50.910258 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:50.665943    2584 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 20 13:01:50.910258 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:50.665948    2584 flags.go:64] FLAG: --cgroup-root=""
Jul 20 13:01:50.910258 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:50.665952    2584 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 20 13:01:50.910258 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:50.665956    2584 flags.go:64] FLAG: --client-ca-file=""
Jul 20 13:01:50.910258 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:50.665960    2584 flags.go:64] FLAG: --cloud-provider="external"
Jul 20 13:01:50.910258 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:50.665979    2584 flags.go:64] FLAG: --cluster-dns="[]"
Jul 20 13:01:50.910258 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:50.665986    2584 flags.go:64] FLAG: --cluster-domain=""
Jul 20 13:01:50.911364 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:50.665991    2584 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 20 13:01:50.911364 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:50.665997    2584 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 20 13:01:50.911364 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:50.666002    2584 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 20 13:01:50.911364 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:50.666007    2584 flags.go:64] FLAG: --container-log-max-files="5"
Jul 20 13:01:50.911364 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:50.666012    2584 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 20 13:01:50.911364 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:50.666017    2584 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 20 13:01:50.911364 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:50.666021    2584 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 20 13:01:50.911364 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:50.666027    2584 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 20 13:01:50.911364 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:50.666031    2584 flags.go:64] FLAG: --contention-profiling="false"
Jul 20 13:01:50.911364 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:50.666036    2584 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 20 13:01:50.911364 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:50.666040    2584 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 20 13:01:50.911364 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:50.666045    2584 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 20 13:01:50.911364 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:50.666049    2584 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 20 13:01:50.911364 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:50.666054    2584 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 20 13:01:50.911364 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:50.666059    2584 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 20 13:01:50.911364 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:50.666063    2584 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 20 13:01:50.911364 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:50.666067    2584 flags.go:64] FLAG: --enable-load-reader="false"
Jul 20 13:01:50.911364 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:50.666073    2584 flags.go:64] FLAG: --enable-server="true"
Jul 20 13:01:50.911364 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:50.666076    2584 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 20 13:01:50.911364 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:50.666479    2584 flags.go:64] FLAG: --event-burst="100"
Jul 20 13:01:50.911364 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:50.666482    2584 flags.go:64] FLAG: --event-qps="50"
Jul 20 13:01:50.911364 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:50.666486    2584 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 20 13:01:50.911364 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:50.666490    2584 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 20 13:01:50.911364 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:50.666493    2584 flags.go:64] FLAG: --eviction-hard=""
Jul 20 13:01:50.912124 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:50.666498    2584 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 20 13:01:50.912124 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:50.666501    2584 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 20 13:01:50.912124 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:50.666504    2584 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 20 13:01:50.912124 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:50.666509    2584 flags.go:64] FLAG: --eviction-soft=""
Jul 20 13:01:50.912124 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:50.666512    2584 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 20 13:01:50.912124 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:50.666515    2584 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 20 13:01:50.912124 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:50.666518    2584 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 20 13:01:50.912124 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:50.666521    2584 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 20 13:01:50.912124 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:50.666524    2584 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 20 13:01:50.912124 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:50.666528    2584 flags.go:64] FLAG: --fail-swap-on="true"
Jul 20 13:01:50.912124 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:50.666531    2584 flags.go:64] FLAG: --feature-gates=""
Jul 20 13:01:50.912124 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:50.666534    2584 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 20 13:01:50.912124 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:50.666537    2584 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 20 13:01:50.912124 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:50.666541    2584 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 20 13:01:50.912124 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:50.666544    2584 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 20 13:01:50.912124 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:50.666547    2584 flags.go:64] FLAG: --healthz-port="10248"
Jul 20 13:01:50.912124 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:50.666550    2584 flags.go:64] FLAG: --help="false"
Jul 20 13:01:50.912124 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:50.666553    2584 flags.go:64] FLAG: --hostname-override="ip-10-0-134-121.ec2.internal"
Jul 20 13:01:50.912124 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:50.666557    2584 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 20 13:01:50.912124 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:50.666560    2584 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 20 13:01:50.912124 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:50.666564    2584 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 20 13:01:50.912124 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:50.666567    2584 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 20 13:01:50.912124 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:50.666570    2584 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 20 13:01:50.912850 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:50.666573    2584 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 20 13:01:50.912850 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:50.666576    2584 flags.go:64] FLAG: --image-service-endpoint=""
Jul 20 13:01:50.912850 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:50.666579    2584 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 20 13:01:50.912850 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:50.666583    2584 flags.go:64] FLAG: --kube-api-burst="100"
Jul 20 13:01:50.912850 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:50.666586    2584 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 20 13:01:50.912850 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:50.666589    2584 flags.go:64] FLAG: --kube-api-qps="50"
Jul 20 13:01:50.912850 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:50.666592    2584 flags.go:64] FLAG: --kube-reserved=""
Jul 20 13:01:50.912850 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:50.666595    2584 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 20 13:01:50.912850 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:50.666599    2584 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 20 13:01:50.912850 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:50.666602    2584 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 20 13:01:50.912850 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:50.666605    2584 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 20 13:01:50.912850 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:50.666608    2584 flags.go:64] FLAG: --lock-file=""
Jul 20 13:01:50.912850 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:50.666612    2584 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 20 13:01:50.912850 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:50.666615    2584 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 20 13:01:50.912850 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:50.666618    2584 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 20 13:01:50.912850 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:50.666624    2584 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 20 13:01:50.912850 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:50.666627    2584 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 20 13:01:50.912850 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:50.666630    2584 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 20 13:01:50.912850 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:50.666634    2584 flags.go:64] FLAG: --logging-format="text"
Jul 20 13:01:50.912850 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:50.666637    2584 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 20 13:01:50.912850 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:50.666640    2584 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 20 13:01:50.912850 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:50.666644    2584 flags.go:64] FLAG: --manifest-url=""
Jul 20 13:01:50.912850 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:50.666647    2584 flags.go:64] FLAG: --manifest-url-header=""
Jul 20 13:01:50.912850 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:50.666651    2584 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 20 13:01:50.912850 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:50.666655    2584 flags.go:64] FLAG: --max-open-files="1000000"
Jul 20 13:01:50.913580 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:50.666659    2584 flags.go:64] FLAG: --max-pods="110"
Jul 20 13:01:50.913580 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:50.666662    2584 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 20 13:01:50.913580 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:50.666665    2584 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 20 13:01:50.913580 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:50.666668    2584 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 20 13:01:50.913580 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:50.666671    2584 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 20 13:01:50.913580 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:50.666674    2584 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 20 13:01:50.913580 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:50.666677    2584 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 20 13:01:50.913580 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:50.666680    2584 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 20 13:01:50.913580 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:50.666688    2584 flags.go:64] FLAG: --node-status-max-images="50"
Jul 20 13:01:50.913580 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:50.666691    2584 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 20 13:01:50.913580 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:50.666694    2584 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 20 13:01:50.913580 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:50.666697    2584 flags.go:64] FLAG: --pod-cidr=""
Jul 20 13:01:50.913580 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:50.666700    2584 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4017e99d76d7b91598d3a3430cd0eba6eda8b33653addd3838fdfe3cca69c5a0"
Jul 20 13:01:50.913580 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:50.666705    2584 flags.go:64] FLAG: --pod-manifest-path=""
Jul 20 13:01:50.913580 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:50.666708    2584 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 20 13:01:50.913580 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:50.666711    2584 flags.go:64] FLAG: --pods-per-core="0"
Jul 20 13:01:50.913580 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:50.666715    2584 flags.go:64] FLAG: --port="10250"
Jul 20 13:01:50.913580 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:50.666718    2584 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 20 13:01:50.913580 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:50.666721    2584 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-075ab87198d809680"
Jul 20 13:01:50.913580 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:50.666725    2584 flags.go:64] FLAG: --qos-reserved=""
Jul 20 13:01:50.913580 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:50.666728    2584 flags.go:64] FLAG: --read-only-port="10255"
Jul 20 13:01:50.913580 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:50.666731    2584 flags.go:64] FLAG: --register-node="true"
Jul 20 13:01:50.913580 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:50.666734    2584 flags.go:64] FLAG: --register-with-taints=""
Jul 20 13:01:50.913580 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:50.666738    2584 flags.go:64] FLAG: --registry-burst="10"
Jul 20 13:01:50.914374 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:50.666741    2584 flags.go:64] FLAG: --registry-qps="5"
Jul 20 13:01:50.914374 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:50.666744    2584 flags.go:64] FLAG: --reserved-cpus=""
Jul 20 13:01:50.914374 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:50.666748    2584 flags.go:64] FLAG: --reserved-memory=""
Jul 20 13:01:50.914374 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:50.666753    2584 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 20 13:01:50.914374 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:50.666756    2584 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 20 13:01:50.914374 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:50.666758    2584 flags.go:64] FLAG: --rotate-certificates="false"
Jul 20 13:01:50.914374 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:50.666761    2584 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 20 13:01:50.914374 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:50.666764    2584 flags.go:64] FLAG: --runonce="false"
Jul 20 13:01:50.914374 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:50.666768    2584 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 20 13:01:50.914374 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:50.666771    2584 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 20 13:01:50.914374 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:50.666774    2584 flags.go:64] FLAG: --seccomp-default="false"
Jul 20 13:01:50.914374 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:50.666777    2584 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 20 13:01:50.914374 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:50.666779    2584 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 20 13:01:50.914374 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:50.666783    2584 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 20 13:01:50.914374 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:50.666786    2584 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 20 13:01:50.914374 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:50.666789    2584 flags.go:64] FLAG: --storage-driver-password="root"
Jul 20 13:01:50.914374 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:50.666792    2584 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 20 13:01:50.914374 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:50.666794    2584 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 20 13:01:50.914374 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:50.666797    2584 flags.go:64] FLAG: --storage-driver-user="root"
Jul 20 13:01:50.914374 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:50.666800    2584 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 20 13:01:50.914374 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:50.666803    2584 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 20 13:01:50.914374 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:50.666806    2584 flags.go:64] FLAG: --system-cgroups=""
Jul 20 13:01:50.914374 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:50.666808    2584 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 20 13:01:50.914374 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:50.666814    2584 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 20 13:01:50.914374 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:50.666817    2584 flags.go:64] FLAG: --tls-cert-file=""
Jul 20 13:01:50.915088 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:50.666820    2584 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 20 13:01:50.915088 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:50.666825    2584 flags.go:64] FLAG: --tls-min-version=""
Jul 20 13:01:50.915088 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:50.666830    2584 flags.go:64] FLAG: --tls-private-key-file=""
Jul 20 13:01:50.915088 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:50.666833    2584 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 20 13:01:50.915088 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:50.666836    2584 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 20 13:01:50.915088 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:50.666839    2584 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 20 13:01:50.915088 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:50.666842    2584 flags.go:64] FLAG: --v="2"
Jul 20 13:01:50.915088 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:50.666846    2584 flags.go:64] FLAG: --version="false"
Jul 20 13:01:50.915088 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:50.666850    2584 flags.go:64] FLAG: --vmodule=""
Jul 20 13:01:50.915088 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:50.666855    2584 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 20 13:01:50.915088 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:50.666858    2584 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 20 13:01:50.915088 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.666989    2584 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 20 13:01:50.915088 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.666994    2584 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 20 13:01:50.915088 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.666998    2584 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 20 13:01:50.915088 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.667001    2584 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 20 13:01:50.915088 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.667004    2584 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 20 13:01:50.915088 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.667007    2584 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 20 13:01:50.915088 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.667010    2584 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 20 13:01:50.915088 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.667013    2584 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 20 13:01:50.915088 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.667016    2584 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 20 13:01:50.915088 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.667018    2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 20 13:01:50.915088 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.667021    2584 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 20 13:01:50.915768 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.667024    2584 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 20 13:01:50.915768 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.667027    2584 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 20 13:01:50.915768 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.667029    2584 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 20 13:01:50.915768 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.667032    2584 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 20 13:01:50.915768 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.667035    2584 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 20 13:01:50.915768 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.667038    2584 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 20 13:01:50.915768 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.667040    2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 20 13:01:50.915768 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.667043    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 20 13:01:50.915768 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.667045    2584 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 20 13:01:50.915768 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.667048    2584 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 20 13:01:50.915768 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.667051    2584 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 20 13:01:50.915768 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.667054    2584 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 20 13:01:50.915768 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.667058    2584 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 20 13:01:50.915768 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.667061    2584 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 20 13:01:50.915768 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.667063    2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 20 13:01:50.915768 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.667066    2584 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 20 13:01:50.915768 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.667068    2584 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 20 13:01:50.915768 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.667071    2584 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 20 13:01:50.915768 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.667074    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 20 13:01:50.915768 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.667078    2584 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 20 13:01:50.916367 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.667081    2584 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 20 13:01:50.916367 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.667083    2584 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 20 13:01:50.916367 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.667086    2584 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 20 13:01:50.916367 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.667088    2584 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 20 13:01:50.916367 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.667091    2584 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 20 13:01:50.916367 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.667093    2584 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 20 13:01:50.916367 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.667096    2584 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 20 13:01:50.916367 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.667098    2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 20 13:01:50.916367 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.667101    2584 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 20 13:01:50.916367 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.667104    2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 20 13:01:50.916367 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.667106    2584 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 20 13:01:50.916367 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.667109    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 20 13:01:50.916367 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.667112    2584 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 20 13:01:50.916367 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.667114    2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 20 13:01:50.916367 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.667117    2584 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 20 13:01:50.916367 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.667119    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 20 13:01:50.916367 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.667122    2584 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 20 13:01:50.916367 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.667124    2584 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 20 13:01:50.916367 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.667127    2584 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 20 13:01:50.916367 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.667130    2584 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 20 13:01:50.919181 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.667132    2584 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 20 13:01:50.919181 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.667135    2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 20 13:01:50.919181 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.667137    2584 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 20 13:01:50.919181 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.667140    2584 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 20 13:01:50.919181 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.667144    2584 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 20 13:01:50.919181 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.667146    2584 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 20 13:01:50.919181 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.667150    2584 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 20 13:01:50.919181 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.667153    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 20 13:01:50.919181 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.667156    2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 20 13:01:50.919181 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.667159    2584 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 20 13:01:50.919181 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.667161    2584 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 20 13:01:50.919181 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.667165    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 20 13:01:50.919181 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.667168    2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 20 13:01:50.919181 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.667170    2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 20 13:01:50.919181 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.667173    2584 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 20 13:01:50.919181 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.667176    2584 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 20 13:01:50.919181 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.667178    2584 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 20 13:01:50.919181 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.667181    2584 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 20 13:01:50.919181 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.667183    2584 feature_gate.go:328] unrecognized feature gate: Example
Jul 20 13:01:50.941780 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.667186    2584 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 20 13:01:50.941780 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.667189    2584 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 20 13:01:50.941780 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.667191    2584 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 20 13:01:50.941780 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.667194    2584 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 20 13:01:50.941780 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.667197    2584 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 20 13:01:50.941780 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.667200    2584 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 20 13:01:50.941780 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.667203    2584 feature_gate.go:328] unrecognized feature gate: Example2
Jul 20 13:01:50.941780 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.667205    2584 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 20 13:01:50.941780 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.667208    2584 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 20 13:01:50.941780 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.667210    2584 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 20 13:01:50.941780 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.667213    2584 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 20 13:01:50.941780 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.667215    2584 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 20 13:01:50.941780 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.667218    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 20 13:01:50.941780 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.667222    2584 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 20 13:01:50.941780 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.667226    2584 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 20 13:01:50.941780 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.667229    2584 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 20 13:01:50.941780 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.667231    2584 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 20 13:01:50.941780 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.667236    2584 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 20 13:01:50.941780 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.667239    2584 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 20 13:01:50.942740 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.667242    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 20 13:01:50.942740 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.667245    2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 20 13:01:50.942740 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.667247    2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 20 13:01:50.942740 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.667249    2584 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 20 13:01:50.942740 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.667252    2584 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 20 13:01:50.942740 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.667256    2584 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 20 13:01:50.942740 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.667258    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 20 13:01:50.942740 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.667261    2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 20 13:01:50.942740 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.667264    2584 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 20 13:01:50.942740 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.667268    2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 20 13:01:50.942740 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:50.667932    2584 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 20 13:01:50.942740 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:50.676311    2584 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 20 13:01:50.942740 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:50.676327    2584 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 20 13:01:50.942740 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:50.677257    2584 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 20 13:01:50.943941 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:50.677266    2584 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 20 13:01:50.943941 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.677340    2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 20 13:01:50.943941 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.677346    2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 20 13:01:50.943941 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.677349    2584 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 20 13:01:50.943941 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.677352    2584 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 20 13:01:50.943941 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.677356    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 20 13:01:50.943941 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.677359    2584 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 20 13:01:50.943941 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.677362    2584 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 20 13:01:50.943941 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.677365    2584 feature_gate.go:328] unrecognized feature gate: Example
Jul 20 13:01:50.943941 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.677369    2584 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 20 13:01:50.943941 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.677373    2584 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 20 13:01:50.943941 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.677376    2584 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 20 13:01:50.943941 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.677379    2584 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 20 13:01:50.943941 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.677382    2584 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 20 13:01:50.943941 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.677385    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 20 13:01:50.943941 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.677387    2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 20 13:01:50.943941 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.677390    2584 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 20 13:01:50.943941 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.677393    2584 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 20 13:01:50.943941 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.677396    2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 20 13:01:50.944935 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.677398    2584 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 20 13:01:50.944935 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.677401    2584 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 20 13:01:50.944935 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.677404    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 20 13:01:50.944935 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.677407    2584 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 20 13:01:50.944935 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.677410    2584 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 20 13:01:50.944935 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.677412    2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 20 13:01:50.944935 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.677416    2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 20 13:01:50.944935 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.677418    2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 20 13:01:50.944935 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.677421    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 20 13:01:50.944935 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.677424    2584 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 20 13:01:50.944935 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.677426    2584 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 20 13:01:50.944935 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.677430    2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 20 13:01:50.944935 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.677432    2584 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 20 13:01:50.944935 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.677435    2584 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 20 13:01:50.944935 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.677438    2584 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 20 13:01:50.944935 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.677440    2584 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 20 13:01:50.944935 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.677443    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 20 13:01:50.944935 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.677445    2584 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 20 13:01:50.944935 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.677448    2584 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 20 13:01:50.944935 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.677451    2584 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 20 13:01:50.946359 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.677454    2584 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 20 13:01:50.946359 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.677456    2584 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 20 13:01:50.946359 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.677459    2584 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 20 13:01:50.946359 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.677461    2584 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 20 13:01:50.946359 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.677464    2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 20 13:01:50.946359 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.677466    2584 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 20 13:01:50.946359 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.677469    2584 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 20 13:01:50.946359 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.677473    2584 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 20 13:01:50.946359 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.677476    2584 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 20 13:01:50.946359 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.677479    2584 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 20 13:01:50.946359 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.677482    2584 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 20 13:01:50.946359 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.677485    2584 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 20 13:01:50.946359 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.677488    2584 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 20 13:01:50.946359 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.677490    2584 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 20 13:01:50.946359 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.677496    2584 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 20 13:01:50.946359 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.677499    2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 20 13:01:50.946359 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.677501    2584 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 20 13:01:50.946359 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.677504    2584 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 20 13:01:50.946359 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.677507    2584 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 20 13:01:50.947349 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.677509    2584 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 20 13:01:50.947349 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.677512    2584 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 20 13:01:50.947349 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.677515    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 20 13:01:50.947349 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.677518    2584 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 20 13:01:50.947349 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.677520    2584 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 20 13:01:50.947349 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.677524    2584 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 20 13:01:50.947349 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.677526    2584 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 20 13:01:50.947349 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.677529    2584 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 20 13:01:50.947349 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.677531    2584 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 20 13:01:50.947349 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.677534    2584 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 20 13:01:50.947349 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.677537    2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 20 13:01:50.947349 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.677540    2584 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 20 13:01:50.947349 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.677543    2584 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 20 13:01:50.947349 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.677546    2584 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 20 13:01:50.947349 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.677549    2584 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 20 13:01:50.947349 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.677552    2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 20 13:01:50.947349 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.677554    2584 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 20 13:01:50.947349 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.677556    2584 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 20 13:01:50.947349 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.677559    2584 feature_gate.go:328] unrecognized feature gate: Example2
Jul 20 13:01:50.947349 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.677562    2584 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 20 13:01:50.952336 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.677564    2584 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 20 13:01:50.952336 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.677566    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 20 13:01:50.952336 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.677569    2584 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 20 13:01:50.952336 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.677571    2584 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 20 13:01:50.952336 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.677574    2584 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 20 13:01:50.952336 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.677576    2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 20 13:01:50.952336 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.677579    2584 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 20 13:01:50.952336 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.677584    2584 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 20 13:01:50.952336 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.677587    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 20 13:01:50.952336 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.677590    2584 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 20 13:01:50.952336 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.677592    2584 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 20 13:01:50.952336 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.677595    2584 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 20 13:01:50.952336 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.677598    2584 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 20 13:01:50.952336 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.677600    2584 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 20 13:01:50.952336 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.677603    2584 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 20 13:01:50.952336 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.677606    2584 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 20 13:01:50.952336 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.677608    2584 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 20 13:01:50.952336 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.677611    2584 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 20 13:01:50.952336 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.677614    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 20 13:01:50.952336 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.677616    2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 20 13:01:50.953295 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.677619    2584 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 20 13:01:50.953295 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.677621    2584 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 20 13:01:50.953295 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:50.677626    2584 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 20 13:01:50.953295 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.677755    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 20 13:01:50.953295 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.677760    2584 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 20 13:01:50.953295 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.677763    2584 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 20 13:01:50.953295 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.677766    2584 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 20 13:01:50.953295 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.677769    2584 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 20 13:01:50.953295 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.677772    2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 20 13:01:50.953295 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.677774    2584 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 20 13:01:50.953295 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.677777    2584 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 20 13:01:50.953295 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.677779    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 20 13:01:50.953295 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.677782    2584 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 20 13:01:50.953295 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.677785    2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 20 13:01:50.954952 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.677787    2584 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 20 13:01:50.954952 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.677790    2584 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 20 13:01:50.954952 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.677792    2584 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 20 13:01:50.954952 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.677795    2584 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 20 13:01:50.954952 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.677797    2584 feature_gate.go:328] unrecognized feature gate: Example2
Jul 20 13:01:50.954952 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.677801    2584 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 20 13:01:50.954952 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.677806    2584 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 20 13:01:50.954952 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.677809    2584 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 20 13:01:50.954952 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.677812    2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 20 13:01:50.954952 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.677815    2584 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 20 13:01:50.954952 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.677817    2584 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 20 13:01:50.954952 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.677820    2584 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 20 13:01:50.954952 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.677823    2584 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 20 13:01:50.954952 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.677825    2584 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 20 13:01:50.954952 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.677827    2584 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 20 13:01:50.954952 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.677830    2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 20 13:01:50.954952 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.677833    2584 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 20 13:01:50.954952 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.677837    2584 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 20 13:01:50.954952 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.677840    2584 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 20 13:01:50.955944 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.677844    2584 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 20 13:01:50.955944 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.677847    2584 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 20 13:01:50.955944 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.677849    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 20 13:01:50.955944 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.677852    2584 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 20 13:01:50.955944 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.677855    2584 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 20 13:01:50.955944 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.677858    2584 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 20 13:01:50.955944 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.677861    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 20 13:01:50.955944 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.677863    2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 20 13:01:50.955944 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.677866    2584 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 20 13:01:50.955944 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.677868    2584 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 20 13:01:50.955944 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.677871    2584 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 20 13:01:50.955944 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.677875    2584 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 20 13:01:50.955944 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.677878    2584 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 20 13:01:50.955944 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.677882    2584 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 20 13:01:50.955944 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.677884    2584 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 20 13:01:50.955944 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.677887    2584 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 20 13:01:50.955944 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.677891    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 20 13:01:50.955944 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.677893    2584 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 20 13:01:50.955944 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.677898    2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 20 13:01:50.957385 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.677902    2584 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 20 13:01:50.957385 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.677904    2584 feature_gate.go:328] unrecognized feature gate: Example
Jul 20 13:01:50.957385 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.677907    2584 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 20 13:01:50.957385 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.677909    2584 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 20 13:01:50.957385 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.677912    2584 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 20 13:01:50.957385 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.677915    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 20 13:01:50.957385 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.677917    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 20 13:01:50.957385 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.677920    2584 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 20 13:01:50.957385 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.677922    2584 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 20 13:01:50.957385 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.677925    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 20 13:01:50.957385 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.677928    2584 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 20 13:01:50.957385 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.677930    2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 20 13:01:50.957385 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.677933    2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 20 13:01:50.957385 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.677936    2584 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 20 13:01:50.957385 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.677938    2584 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 20 13:01:50.957385 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.677941    2584 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 20 13:01:50.957385 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.677944    2584 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 20 13:01:50.957385 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.677946    2584 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 20 13:01:50.957385 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.677949    2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 20 13:01:50.957385 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.677951    2584 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 20 13:01:51.063622 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.677954    2584 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 20 13:01:51.063622 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.677957    2584 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 20 13:01:51.063622 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.677961    2584 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 20 13:01:51.063622 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.677977    2584 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 20 13:01:51.063622 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.677980    2584 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 20 13:01:51.063622 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.677983    2584 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 20 13:01:51.063622 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.677985    2584 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 20 13:01:51.063622 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.677988    2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 20 13:01:51.063622 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.677990    2584 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 20 13:01:51.063622 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.677993    2584 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 20 13:01:51.063622 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.677996    2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 20 13:01:51.063622 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.678001    2584 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 20 13:01:51.063622 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.678005    2584 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 20 13:01:51.063622 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.678008    2584 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 20 13:01:51.063622 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.678010    2584 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 20 13:01:51.063622 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.678013    2584 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 20 13:01:51.063622 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.678016    2584 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 20 13:01:51.063622 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.678018    2584 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 20 13:01:51.063622 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.678021    2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 20 13:01:51.063622 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.678023    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 20 13:01:51.064875 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.678026    2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 20 13:01:51.064875 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.678028    2584 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 20 13:01:51.064875 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.678031    2584 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 20 13:01:51.064875 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.678034    2584 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 20 13:01:51.064875 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.678036    2584 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 20 13:01:51.064875 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.678039    2584 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 20 13:01:51.064875 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.678042    2584 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 20 13:01:51.064875 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.678045    2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 20 13:01:51.064875 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.678047    2584 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 20 13:01:51.064875 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:50.678050    2584 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 20 13:01:51.064875 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:50.678055    2584 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 20 13:01:51.064875 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:50.678162    2584 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 20 13:01:51.064875 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:50.683074    2584 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 20 13:01:51.064875 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:50.684624    2584 server.go:1019] "Starting client certificate rotation"
Jul 20 13:01:51.065853 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:50.684722    2584 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 20 13:01:51.065853 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:50.684759    2584 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 20 13:01:51.065853 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:50.687859    2584 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 20 13:01:51.065853 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:50.691996    2584 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 20 13:01:51.065853 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:50.706235    2584 log.go:25] "Validated CRI v1 runtime API"
Jul 20 13:01:51.065853 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:50.708668    2584 log.go:25] "Validated CRI v1 image API"
Jul 20 13:01:51.065853 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:50.709604    2584 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 20 13:01:51.065853 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:50.712285    2584 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 83631160-4529-4c64-8f66-7adc2e9852e7:/dev/nvme0n1p3 b02621d8-5781-4a42-87b1-7c2df8f0f69d:/dev/nvme0n1p4]
Jul 20 13:01:51.065853 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:50.712302    2584 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 20 13:01:51.067718 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:50.718338    2584 manager.go:216] Machine: {Timestamp:2026-07-20 13:01:50.71684945 +0000 UTC m=+0.433396856 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099632 MemoryCapacity:33164492800 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec275081930ec5b3ed43d578f95173e5 SystemUUID:ec275081-930e-c5b3-ed43-d578f95173e5 BootID:7c165aa4-c7f5-4c2e-982c-4695b2a3e3ce Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:e2:58:5d:c5:9d Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:e2:58:5d:c5:9d Speed:0 Mtu:9001} {Name:ovs-system MacAddress:46:c8:8b:df:3e:a6 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164492800 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 20 13:01:51.067718 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:50.718460    2584 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 20 13:01:51.067718 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:50.718546    2584 manager.go:232] Version: {KernelVersion:5.14.0-570.128.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260715-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 20 13:01:51.067718 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:50.721573    2584 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 20 13:01:51.067718 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:50.721943    2584 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 20 13:01:51.067718 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:50.721978    2584 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-134-121.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 20 13:01:51.067718 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:50.723367    2584 topology_manager.go:138] "Creating topology manager with none policy"
Jul 20 13:01:51.067718 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:50.723377    2584 container_manager_linux.go:309] "Creating device plugin manager"
Jul 20 13:01:51.067718 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:50.723385    2584 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 20 13:01:51.067718 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:50.724074    2584 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 20 13:01:51.067718 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:50.725453    2584 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 20 13:01:51.067718 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:50.728541    2584 state_mem.go:36] "Initialized new in-memory state store"
Jul 20 13:01:51.067718 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:50.728664    2584 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 20 13:01:51.067718 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:50.728703    2584 kubelet.go:486] "Attempting to sync node with API server"
Jul 20 13:01:51.067718 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:50.728723    2584 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 20 13:01:51.067718 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:50.728741    2584 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 20 13:01:51.067718 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:50.728751    2584 kubelet.go:398] "Adding apiserver pod source"
Jul 20 13:01:51.068696 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:50.728764    2584 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 20 13:01:51.068696 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:50.729167    2584 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 20 13:01:51.068696 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:50.729184    2584 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 20 13:01:51.068696 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:50.731694    2584 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 20 13:01:51.068696 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:50.737537    2584 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 20 13:01:51.068696 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:50.737567    2584 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 20 13:01:51.068696 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:50.738916    2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 20 13:01:51.068696 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:50.738941    2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 20 13:01:51.068696 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:50.738960    2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 20 13:01:51.068696 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:50.738969    2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 20 13:01:51.068696 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:50.738983    2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 20 13:01:51.068696 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:50.738993    2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 20 13:01:51.068696 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:50.739009    2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 20 13:01:51.068696 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:50.739019    2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 20 13:01:51.068696 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:50.739060    2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 20 13:01:51.068696 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:50.739068    2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 20 13:01:51.068696 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:50.739082    2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 20 13:01:51.068696 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:50.739089    2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 20 13:01:51.068696 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:50.740764    2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 20 13:01:51.068696 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:50.740772    2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 20 13:01:51.068696 ip-10-0-134-121 kubenswrapper[2584]: E0720 13:01:50.742396    2584 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 20 13:01:51.068696 ip-10-0-134-121 kubenswrapper[2584]: E0720 13:01:50.742396    2584 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-134-121.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 20 13:01:51.068696 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:50.744555    2584 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-134-121.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 20 13:01:51.068696 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:50.746514    2584 server.go:1268] "Started kubelet"
Jul 20 13:01:51.068696 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:50.746602    2584 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 20 13:01:51.068696 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:50.746658    2584 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 20 13:01:51.068696 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:50.746731    2584 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 20 13:01:51.068696 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:50.748920    2584 server.go:310] "Adding debug handlers to kubelet server"
Jul 20 13:01:51.068696 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:50.753694    2584 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-pqqqf"
Jul 20 13:01:51.068696 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:50.754237    2584 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 20 13:01:51.068696 ip-10-0-134-121 kubenswrapper[2584]: E0720 13:01:50.755496    2584 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-121.ec2.internal.18c4010db612dbe3  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-121.ec2.internal,UID:ip-10-0-134-121.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-134-121.ec2.internal,},FirstTimestamp:2026-07-20 13:01:50.746450915 +0000 UTC m=+0.462998320,LastTimestamp:2026-07-20 13:01:50.746450915 +0000 UTC m=+0.462998320,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-121.ec2.internal,}"
Jul 20 13:01:51.068696 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:50.759251    2584 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-pqqqf"
Jul 20 13:01:51.068696 ip-10-0-134-121 kubenswrapper[2584]: E0720 13:01:50.765514    2584 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 20 13:01:51.068696 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:50.770421    2584 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 20 13:01:51.068696 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:50.770432    2584 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 20 13:01:51.068696 ip-10-0-134-121 kubenswrapper[2584]: E0720 13:01:50.770544    2584 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-121.ec2.internal\" not found"
Jul 20 13:01:51.068696 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:50.771243    2584 factory.go:55] Registering systemd factory
Jul 20 13:01:51.068696 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:50.771268    2584 factory.go:223] Registration of the systemd container factory successfully
Jul 20 13:01:51.068696 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:50.771511    2584 factory.go:153] Registering CRI-O factory
Jul 20 13:01:51.068696 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:50.771525    2584 factory.go:223] Registration of the crio container factory successfully
Jul 20 13:01:51.072005 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:50.771536    2584 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 20 13:01:51.072005 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:50.771553    2584 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 20 13:01:51.072005 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:50.771540    2584 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 20 13:01:51.072005 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:50.771589    2584 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 20 13:01:51.072005 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:50.771614    2584 factory.go:103] Registering Raw factory
Jul 20 13:01:51.072005 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:50.771650    2584 manager.go:1196] Started watching for new ooms in manager
Jul 20 13:01:51.072005 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:50.771684    2584 reconstruct.go:97] "Volume reconstruction finished"
Jul 20 13:01:51.072005 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:50.771691    2584 reconciler.go:29] "Reconciler: start to sync state"
Jul 20 13:01:51.072005 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:50.772100    2584 manager.go:349] Starting recovery of all containers
Jul 20 13:01:51.072005 ip-10-0-134-121 kubenswrapper[2584]: E0720 13:01:50.772738    2584 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-134-121.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 20 13:01:51.072005 ip-10-0-134-121 kubenswrapper[2584]: E0720 13:01:50.772906    2584 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 20 13:01:51.072005 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:50.802237    2584 manager.go:354] Recovery completed
Jul 20 13:01:51.072005 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:50.811615    2584 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 20 13:01:51.072005 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:50.813774    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-121.ec2.internal" event="NodeHasSufficientMemory"
Jul 20 13:01:51.072005 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:50.813805    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-121.ec2.internal" event="NodeHasNoDiskPressure"
Jul 20 13:01:51.072005 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:50.813815    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-121.ec2.internal" event="NodeHasSufficientPID"
Jul 20 13:01:51.072005 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:50.829106    2584 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 20 13:01:51.072005 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:50.829120    2584 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 20 13:01:51.072005 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:50.829132    2584 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 20 13:01:51.072005 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:50.829141    2584 state_mem.go:36] "Initialized new in-memory state store"
Jul 20 13:01:51.072005 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:50.829979    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-121.ec2.internal" event="NodeHasSufficientMemory"
Jul 20 13:01:51.072005 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:50.830023    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-121.ec2.internal" event="NodeHasNoDiskPressure"
Jul 20 13:01:51.072005 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:50.830035    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-121.ec2.internal" event="NodeHasSufficientPID"
Jul 20 13:01:51.072005 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:50.830450    2584 policy_none.go:49] "None policy: Start"
Jul 20 13:01:51.072005 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:50.830464    2584 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 20 13:01:51.072005 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:50.830475    2584 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 20 13:01:51.072005 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:50.831581    2584 policy_none.go:47] "Start"
Jul 20 13:01:51.072005 ip-10-0-134-121 kubenswrapper[2584]: E0720 13:01:50.871255    2584 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-121.ec2.internal\" not found"
Jul 20 13:01:51.072005 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:50.879769    2584 manager.go:337] "Starting Device Plugin manager"
Jul 20 13:01:51.072005 ip-10-0-134-121 kubenswrapper[2584]: E0720 13:01:50.879799    2584 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 20 13:01:51.072005 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:50.879808    2584 server.go:87] "Starting device plugin registration server"
Jul 20 13:01:51.072005 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:50.880106    2584 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 20 13:01:51.072005 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:50.880118    2584 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 20 13:01:51.072005 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:50.880218    2584 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 20 13:01:51.072005 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:50.880306    2584 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 20 13:01:51.072005 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:50.880315    2584 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 20 13:01:51.072005 ip-10-0-134-121 kubenswrapper[2584]: E0720 13:01:50.881027    2584 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 20 13:01:51.072005 ip-10-0-134-121 kubenswrapper[2584]: E0720 13:01:50.881074    2584 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-134-121.ec2.internal\" not found"
Jul 20 13:01:51.072005 ip-10-0-134-121 kubenswrapper[2584]: E0720 13:01:50.979573    2584 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-134-121.ec2.internal\" not found" node="ip-10-0-134-121.ec2.internal"
Jul 20 13:01:51.072005 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:50.980649    2584 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 20 13:01:51.072005 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:50.981967    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-121.ec2.internal" event="NodeHasSufficientMemory"
Jul 20 13:01:51.072005 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:50.982004    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-121.ec2.internal" event="NodeHasNoDiskPressure"
Jul 20 13:01:51.072005 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:50.982015    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-121.ec2.internal" event="NodeHasSufficientPID"
Jul 20 13:01:51.072005 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:50.982061    2584 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-134-121.ec2.internal"
Jul 20 13:01:51.072005 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:51.002994    2584 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-134-121.ec2.internal"
Jul 20 13:01:51.074368 ip-10-0-134-121 kubenswrapper[2584]: E0720 13:01:51.003030    2584 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-134-121.ec2.internal\": node \"ip-10-0-134-121.ec2.internal\" not found"
Jul 20 13:01:51.074368 ip-10-0-134-121 kubenswrapper[2584]: E0720 13:01:51.042349    2584 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-121.ec2.internal\" not found"
Jul 20 13:01:51.280357 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:51.087197    2584 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 20 13:01:51.280357 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:51.088613    2584 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 20 13:01:51.280357 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:51.088667    2584 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 20 13:01:51.280357 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:51.088696    2584 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 20 13:01:51.280357 ip-10-0-134-121 kubenswrapper[2584]: E0720 13:01:51.088736    2584 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 20 13:01:51.280357 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:51.090959    2584 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 20 13:01:51.280357 ip-10-0-134-121 kubenswrapper[2584]: E0720 13:01:51.145223    2584 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-121.ec2.internal\" not found"
Jul 20 13:01:51.280357 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:51.188899    2584 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-121.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-134-121.ec2.internal"]
Jul 20 13:01:51.280357 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:51.189002    2584 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 20 13:01:51.280357 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:51.190097    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-121.ec2.internal" event="NodeHasSufficientMemory"
Jul 20 13:01:51.280357 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:51.190132    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-121.ec2.internal" event="NodeHasNoDiskPressure"
Jul 20 13:01:51.280357 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:51.190161    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-121.ec2.internal" event="NodeHasSufficientPID"
Jul 20 13:01:51.280357 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:51.192684    2584 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 20 13:01:51.280357 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:51.192807    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-121.ec2.internal"
Jul 20 13:01:51.280357 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:51.192845    2584 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 20 13:01:51.280357 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:51.198876    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-121.ec2.internal" event="NodeHasSufficientMemory"
Jul 20 13:01:51.280357 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:51.198883    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-121.ec2.internal" event="NodeHasSufficientMemory"
Jul 20 13:01:51.280357 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:51.198904    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-121.ec2.internal" event="NodeHasNoDiskPressure"
Jul 20 13:01:51.280357 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:51.198908    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-121.ec2.internal" event="NodeHasNoDiskPressure"
Jul 20 13:01:51.280357 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:51.198922    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-121.ec2.internal" event="NodeHasSufficientPID"
Jul 20 13:01:51.280357 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:51.198926    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-121.ec2.internal" event="NodeHasSufficientPID"
Jul 20 13:01:51.280357 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:51.201229    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-121.ec2.internal"
Jul 20 13:01:51.280357 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:51.201252    2584 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 20 13:01:51.280357 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:51.202024    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-121.ec2.internal" event="NodeHasSufficientMemory"
Jul 20 13:01:51.280357 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:51.202080    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-121.ec2.internal" event="NodeHasNoDiskPressure"
Jul 20 13:01:51.280357 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:51.202099    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-121.ec2.internal" event="NodeHasSufficientPID"
Jul 20 13:01:51.280357 ip-10-0-134-121 kubenswrapper[2584]: E0720 13:01:51.234746    2584 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-134-121.ec2.internal\" not found" node="ip-10-0-134-121.ec2.internal"
Jul 20 13:01:51.280357 ip-10-0-134-121 kubenswrapper[2584]: E0720 13:01:51.239424    2584 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-134-121.ec2.internal\" not found" node="ip-10-0-134-121.ec2.internal"
Jul 20 13:01:51.280357 ip-10-0-134-121 kubenswrapper[2584]: E0720 13:01:51.245515    2584 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-121.ec2.internal\" not found"
Jul 20 13:01:51.280357 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:51.274271    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/e39b9f23455a45c102012bdb6cd46aeb-config\") pod \"kube-apiserver-proxy-ip-10-0-134-121.ec2.internal\" (UID: \"e39b9f23455a45c102012bdb6cd46aeb\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-121.ec2.internal"
Jul 20 13:01:51.280357 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:51.274309    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/6cfba4c61799a6b7e50aa7b14dc6a91c-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-121.ec2.internal\" (UID: \"6cfba4c61799a6b7e50aa7b14dc6a91c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-121.ec2.internal"
Jul 20 13:01:51.280357 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:51.274330    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6cfba4c61799a6b7e50aa7b14dc6a91c-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-121.ec2.internal\" (UID: \"6cfba4c61799a6b7e50aa7b14dc6a91c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-121.ec2.internal"
Jul 20 13:01:51.445653 ip-10-0-134-121 kubenswrapper[2584]: E0720 13:01:51.347293    2584 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-121.ec2.internal\" not found"
Jul 20 13:01:51.445653 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:51.374716    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/e39b9f23455a45c102012bdb6cd46aeb-config\") pod \"kube-apiserver-proxy-ip-10-0-134-121.ec2.internal\" (UID: \"e39b9f23455a45c102012bdb6cd46aeb\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-121.ec2.internal"
Jul 20 13:01:51.445653 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:51.374747    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/6cfba4c61799a6b7e50aa7b14dc6a91c-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-121.ec2.internal\" (UID: \"6cfba4c61799a6b7e50aa7b14dc6a91c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-121.ec2.internal"
Jul 20 13:01:51.445653 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:51.374770    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6cfba4c61799a6b7e50aa7b14dc6a91c-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-121.ec2.internal\" (UID: \"6cfba4c61799a6b7e50aa7b14dc6a91c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-121.ec2.internal"
Jul 20 13:01:51.445653 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:51.374824    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/6cfba4c61799a6b7e50aa7b14dc6a91c-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-121.ec2.internal\" (UID: \"6cfba4c61799a6b7e50aa7b14dc6a91c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-121.ec2.internal"
Jul 20 13:01:51.445653 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:51.374825    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/e39b9f23455a45c102012bdb6cd46aeb-config\") pod \"kube-apiserver-proxy-ip-10-0-134-121.ec2.internal\" (UID: \"e39b9f23455a45c102012bdb6cd46aeb\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-121.ec2.internal"
Jul 20 13:01:51.445653 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:51.374861    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6cfba4c61799a6b7e50aa7b14dc6a91c-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-121.ec2.internal\" (UID: \"6cfba4c61799a6b7e50aa7b14dc6a91c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-121.ec2.internal"
Jul 20 13:01:51.626510 ip-10-0-134-121 kubenswrapper[2584]: E0720 13:01:51.450149    2584 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-121.ec2.internal\" not found"
Jul 20 13:01:51.626510 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:51.542116    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-121.ec2.internal"
Jul 20 13:01:51.626510 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:51.547417    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-121.ec2.internal"
Jul 20 13:01:51.626510 ip-10-0-134-121 kubenswrapper[2584]: E0720 13:01:51.550796    2584 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-121.ec2.internal\" not found"
Jul 20 13:01:51.775709 ip-10-0-134-121 kubenswrapper[2584]: E0720 13:01:51.651417    2584 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-121.ec2.internal\" not found"
Jul 20 13:01:51.775709 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:51.660004    2584 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 20 13:01:51.775709 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:51.670708    2584 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-121.ec2.internal"
Jul 20 13:01:51.775709 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:51.683603    2584 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 20 13:01:51.775709 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:51.683758    2584 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 20 13:01:51.775709 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:51.683806    2584 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 20 13:01:51.775709 ip-10-0-134-121 kubenswrapper[2584]: E0720 13:01:51.683836    2584 kubelet.go:3250] "Failed creating a mirror pod" err="Post \"https://a53d07f54f6bf4054b58988aef99d3ce-b5057a553a335b4f.elb.us-east-1.amazonaws.com:6443/api/v1/namespaces/openshift-machine-config-operator/pods\": read tcp 10.0.134.121:36458->54.157.197.144:6443: use of closed network connection" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-121.ec2.internal"
Jul 20 13:01:51.775709 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:51.683863    2584 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-121.ec2.internal"
Jul 20 13:01:51.775709 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:51.701254    2584 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 20 13:01:51.775709 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:51.730018    2584 apiserver.go:52] "Watching apiserver"
Jul 20 13:01:51.775709 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:51.737269    2584 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 20 13:01:51.775709 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:51.739646    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/node-resolver-hgvl2","openshift-image-registry/node-ca-hsm2t","openshift-multus/multus-9l8sl","openshift-multus/network-metrics-daemon-9zclf","openshift-network-operator/iptables-alerter-bb5cg","openshift-ovn-kubernetes/ovnkube-node-mltmb","kube-system/global-pull-secret-syncer-4wwrh","kube-system/konnectivity-agent-ntcf5","kube-system/kube-apiserver-proxy-ip-10-0-134-121.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-46jkq","openshift-cluster-node-tuning-operator/tuned-tnlm9","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-121.ec2.internal","openshift-multus/multus-additional-cni-plugins-szpnb","openshift-network-diagnostics/network-check-target-ck7q6"]
Jul 20 13:01:51.775709 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:51.742570    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4wwrh"
Jul 20 13:01:51.775709 ip-10-0-134-121 kubenswrapper[2584]: E0720 13:01:51.742653    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4wwrh" podUID="f8c70e98-14ec-48d9-8c30-2d63fa95c04e"
Jul 20 13:01:51.775709 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:51.745380    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-szpnb"
Jul 20 13:01:51.775709 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:51.747448    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 20 13:01:51.775709 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:51.747461    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 20 13:01:51.775709 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:51.747488    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-cc5jg\""
Jul 20 13:01:51.775709 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:51.747526    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 20 13:01:51.775709 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:51.747699    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 20 13:01:51.775709 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:51.747730    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 20 13:01:51.775709 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:51.752009    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-9l8sl"
Jul 20 13:01:51.775709 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:51.753981    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-7qrsr\""
Jul 20 13:01:51.775709 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:51.754249    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9zclf"
Jul 20 13:01:51.775709 ip-10-0-134-121 kubenswrapper[2584]: E0720 13:01:51.754343    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9zclf" podUID="84c98b82-b626-42a7-bce8-281d439e1772"
Jul 20 13:01:51.775709 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:51.754558    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 20 13:01:51.775709 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:51.756461    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-bb5cg"
Jul 20 13:01:51.775709 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:51.758429    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-s54h4\""
Jul 20 13:01:51.777451 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:51.758771    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 20 13:01:51.777451 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:51.758789    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 20 13:01:51.777451 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:51.758857    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-mltmb"
Jul 20 13:01:51.777451 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:51.758985    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 20 13:01:51.777451 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:51.760652    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 20 13:01:51.777451 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:51.760677    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-xxmq2\""
Jul 20 13:01:51.777451 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:51.761288    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ck7q6"
Jul 20 13:01:51.777451 ip-10-0-134-121 kubenswrapper[2584]: E0720 13:01:51.761363    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ck7q6" podUID="6a903657-acf4-4846-a7bd-b45e286216c1"
Jul 20 13:01:51.777451 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:51.763326    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 20 13:01:51.777451 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:51.763498    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 20 13:01:51.777451 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:51.763516    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 20 13:01:51.777451 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:51.763819    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 20 13:01:51.777451 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:51.764013    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 20 13:01:51.777451 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:51.764801    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-hgvl2"
Jul 20 13:01:51.777451 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:51.767286    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-hsm2t"
Jul 20 13:01:51.777451 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:51.767900    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 20 13:01:51.777451 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:51.768044    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-mp8gl\""
Jul 20 13:01:51.777451 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:51.768178    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 20 13:01:51.777451 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:51.768950    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 20 13:01:51.777451 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:51.769289    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-46jkq"
Jul 20 13:01:51.777451 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:51.770216    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 20 13:01:51.777451 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:51.770245    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-dmqz2\""
Jul 20 13:01:51.777451 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:51.770738    2584 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 20 13:01:51.777451 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:51.770806    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 20 13:01:51.777451 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:51.771486    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-tnlm9"
Jul 20 13:01:51.777451 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:51.770266    2584 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-19 12:56:51 +0000 UTC" deadline="2028-01-24 03:44:21.039480155 +0000 UTC"
Jul 20 13:01:51.777451 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:51.776344    2584 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13262h42m29.263140312s"
Jul 20 13:01:51.777451 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:51.776770    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 20 13:01:51.777451 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:51.776813    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 20 13:01:51.777451 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:51.776830    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-572bd\""
Jul 20 13:01:51.777451 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:51.776839    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 20 13:01:51.777451 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:51.777118    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 20 13:01:51.777451 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:51.777145    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b5a49b2c-c21c-4600-adf6-dc15dda1ff06-host-var-lib-cni-bin\") pod \"multus-9l8sl\" (UID: \"b5a49b2c-c21c-4600-adf6-dc15dda1ff06\") " pod="openshift-multus/multus-9l8sl"
Jul 20 13:01:51.777451 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:51.777169    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 20 13:01:51.779126 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:51.777176    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/dc1eda22-b2e1-4381-b12f-3af236b2de4e-run-openvswitch\") pod \"ovnkube-node-mltmb\" (UID: \"dc1eda22-b2e1-4381-b12f-3af236b2de4e\") " pod="openshift-ovn-kubernetes/ovnkube-node-mltmb"
Jul 20 13:01:51.779126 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:51.777203    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b5a49b2c-c21c-4600-adf6-dc15dda1ff06-cni-binary-copy\") pod \"multus-9l8sl\" (UID: \"b5a49b2c-c21c-4600-adf6-dc15dda1ff06\") " pod="openshift-multus/multus-9l8sl"
Jul 20 13:01:51.779126 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:51.777337    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b5a49b2c-c21c-4600-adf6-dc15dda1ff06-etc-kubernetes\") pod \"multus-9l8sl\" (UID: \"b5a49b2c-c21c-4600-adf6-dc15dda1ff06\") " pod="openshift-multus/multus-9l8sl"
Jul 20 13:01:51.779126 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:51.777376    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/48cff737-3690-4df6-8e01-3b06c888f58f-serviceca\") pod \"node-ca-hsm2t\" (UID: \"48cff737-3690-4df6-8e01-3b06c888f58f\") " pod="openshift-image-registry/node-ca-hsm2t"
Jul 20 13:01:51.779126 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:51.777403    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1c610d05-f1c0-474a-a1b9-5ad71f8ba52e-etc-kubernetes\") pod \"tuned-tnlm9\" (UID: \"1c610d05-f1c0-474a-a1b9-5ad71f8ba52e\") " pod="openshift-cluster-node-tuning-operator/tuned-tnlm9"
Jul 20 13:01:51.779126 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:51.777426    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-26w7l\" (UniqueName: \"kubernetes.io/projected/d5e256e3-6d71-4bc3-b539-c12fadc540ad-kube-api-access-26w7l\") pod \"iptables-alerter-bb5cg\" (UID: \"d5e256e3-6d71-4bc3-b539-c12fadc540ad\") " pod="openshift-network-operator/iptables-alerter-bb5cg"
Jul 20 13:01:51.779126 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:51.777448    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/dc1eda22-b2e1-4381-b12f-3af236b2de4e-systemd-units\") pod \"ovnkube-node-mltmb\" (UID: \"dc1eda22-b2e1-4381-b12f-3af236b2de4e\") " pod="openshift-ovn-kubernetes/ovnkube-node-mltmb"
Jul 20 13:01:51.779126 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:51.777458    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-gtcxh\""
Jul 20 13:01:51.779126 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:51.777480    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/dc1eda22-b2e1-4381-b12f-3af236b2de4e-ovnkube-config\") pod \"ovnkube-node-mltmb\" (UID: \"dc1eda22-b2e1-4381-b12f-3af236b2de4e\") " pod="openshift-ovn-kubernetes/ovnkube-node-mltmb"
Jul 20 13:01:51.779126 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:51.777506    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v7jkx\" (UniqueName: \"kubernetes.io/projected/48cff737-3690-4df6-8e01-3b06c888f58f-kube-api-access-v7jkx\") pod \"node-ca-hsm2t\" (UID: \"48cff737-3690-4df6-8e01-3b06c888f58f\") " pod="openshift-image-registry/node-ca-hsm2t"
Jul 20 13:01:51.779126 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:51.777531    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/1c610d05-f1c0-474a-a1b9-5ad71f8ba52e-etc-modprobe-d\") pod \"tuned-tnlm9\" (UID: \"1c610d05-f1c0-474a-a1b9-5ad71f8ba52e\") " pod="openshift-cluster-node-tuning-operator/tuned-tnlm9"
Jul 20 13:01:51.779126 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:51.777559    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/dc1eda22-b2e1-4381-b12f-3af236b2de4e-host-kubelet\") pod \"ovnkube-node-mltmb\" (UID: \"dc1eda22-b2e1-4381-b12f-3af236b2de4e\") " pod="openshift-ovn-kubernetes/ovnkube-node-mltmb"
Jul 20 13:01:51.779126 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:51.777593    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/dc1eda22-b2e1-4381-b12f-3af236b2de4e-host-run-ovn-kubernetes\") pod \"ovnkube-node-mltmb\" (UID: \"dc1eda22-b2e1-4381-b12f-3af236b2de4e\") " pod="openshift-ovn-kubernetes/ovnkube-node-mltmb"
Jul 20 13:01:51.779126 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:51.777623    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/dc1eda22-b2e1-4381-b12f-3af236b2de4e-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-mltmb\" (UID: \"dc1eda22-b2e1-4381-b12f-3af236b2de4e\") " pod="openshift-ovn-kubernetes/ovnkube-node-mltmb"
Jul 20 13:01:51.779126 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:51.777653    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gw5h5\" (UniqueName: \"kubernetes.io/projected/548d5005-1a66-4385-9ebc-6844b175673d-kube-api-access-gw5h5\") pod \"node-resolver-hgvl2\" (UID: \"548d5005-1a66-4385-9ebc-6844b175673d\") " pod="openshift-dns/node-resolver-hgvl2"
Jul 20 13:01:51.779126 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:51.777678    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/dc1eda22-b2e1-4381-b12f-3af236b2de4e-run-ovn\") pod \"ovnkube-node-mltmb\" (UID: \"dc1eda22-b2e1-4381-b12f-3af236b2de4e\") " pod="openshift-ovn-kubernetes/ovnkube-node-mltmb"
Jul 20 13:01:51.779126 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:51.777699    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-czs6d\" (UniqueName: \"kubernetes.io/projected/b5a49b2c-c21c-4600-adf6-dc15dda1ff06-kube-api-access-czs6d\") pod \"multus-9l8sl\" (UID: \"b5a49b2c-c21c-4600-adf6-dc15dda1ff06\") " pod="openshift-multus/multus-9l8sl"
Jul 20 13:01:51.780058 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:51.777721    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b5a49b2c-c21c-4600-adf6-dc15dda1ff06-os-release\") pod \"multus-9l8sl\" (UID: \"b5a49b2c-c21c-4600-adf6-dc15dda1ff06\") " pod="openshift-multus/multus-9l8sl"
Jul 20 13:01:51.780058 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:51.777814    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/b5a49b2c-c21c-4600-adf6-dc15dda1ff06-hostroot\") pod \"multus-9l8sl\" (UID: \"b5a49b2c-c21c-4600-adf6-dc15dda1ff06\") " pod="openshift-multus/multus-9l8sl"
Jul 20 13:01:51.780058 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:51.778048    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/dc1eda22-b2e1-4381-b12f-3af236b2de4e-etc-openvswitch\") pod \"ovnkube-node-mltmb\" (UID: \"dc1eda22-b2e1-4381-b12f-3af236b2de4e\") " pod="openshift-ovn-kubernetes/ovnkube-node-mltmb"
Jul 20 13:01:51.780058 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:51.778088    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/f8c70e98-14ec-48d9-8c30-2d63fa95c04e-dbus\") pod \"global-pull-secret-syncer-4wwrh\" (UID: \"f8c70e98-14ec-48d9-8c30-2d63fa95c04e\") " pod="kube-system/global-pull-secret-syncer-4wwrh"
Jul 20 13:01:51.780058 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:51.778123    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/b5a49b2c-c21c-4600-adf6-dc15dda1ff06-multus-socket-dir-parent\") pod \"multus-9l8sl\" (UID: \"b5a49b2c-c21c-4600-adf6-dc15dda1ff06\") " pod="openshift-multus/multus-9l8sl"
Jul 20 13:01:51.780058 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:51.778199    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/b5a49b2c-c21c-4600-adf6-dc15dda1ff06-host-var-lib-cni-multus\") pod \"multus-9l8sl\" (UID: \"b5a49b2c-c21c-4600-adf6-dc15dda1ff06\") " pod="openshift-multus/multus-9l8sl"
Jul 20 13:01:51.780058 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:51.778257    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/dc1eda22-b2e1-4381-b12f-3af236b2de4e-host-run-netns\") pod \"ovnkube-node-mltmb\" (UID: \"dc1eda22-b2e1-4381-b12f-3af236b2de4e\") " pod="openshift-ovn-kubernetes/ovnkube-node-mltmb"
Jul 20 13:01:51.780058 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:51.778298    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b5a49b2c-c21c-4600-adf6-dc15dda1ff06-multus-cni-dir\") pod \"multus-9l8sl\" (UID: \"b5a49b2c-c21c-4600-adf6-dc15dda1ff06\") " pod="openshift-multus/multus-9l8sl"
Jul 20 13:01:51.780058 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:51.778337    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/dc1eda22-b2e1-4381-b12f-3af236b2de4e-host-slash\") pod \"ovnkube-node-mltmb\" (UID: \"dc1eda22-b2e1-4381-b12f-3af236b2de4e\") " pod="openshift-ovn-kubernetes/ovnkube-node-mltmb"
Jul 20 13:01:51.780058 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:51.778366    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9nmqn\" (UniqueName: \"kubernetes.io/projected/dc1eda22-b2e1-4381-b12f-3af236b2de4e-kube-api-access-9nmqn\") pod \"ovnkube-node-mltmb\" (UID: \"dc1eda22-b2e1-4381-b12f-3af236b2de4e\") " pod="openshift-ovn-kubernetes/ovnkube-node-mltmb"
Jul 20 13:01:51.780058 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:51.778404    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/48cff737-3690-4df6-8e01-3b06c888f58f-host\") pod \"node-ca-hsm2t\" (UID: \"48cff737-3690-4df6-8e01-3b06c888f58f\") " pod="openshift-image-registry/node-ca-hsm2t"
Jul 20 13:01:51.780058 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:51.778468    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1c610d05-f1c0-474a-a1b9-5ad71f8ba52e-lib-modules\") pod \"tuned-tnlm9\" (UID: \"1c610d05-f1c0-474a-a1b9-5ad71f8ba52e\") " pod="openshift-cluster-node-tuning-operator/tuned-tnlm9"
Jul 20 13:01:51.780058 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:51.778523    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1c610d05-f1c0-474a-a1b9-5ad71f8ba52e-tmp\") pod \"tuned-tnlm9\" (UID: \"1c610d05-f1c0-474a-a1b9-5ad71f8ba52e\") " pod="openshift-cluster-node-tuning-operator/tuned-tnlm9"
Jul 20 13:01:51.780058 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:51.778559    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/dc1eda22-b2e1-4381-b12f-3af236b2de4e-node-log\") pod \"ovnkube-node-mltmb\" (UID: \"dc1eda22-b2e1-4381-b12f-3af236b2de4e\") " pod="openshift-ovn-kubernetes/ovnkube-node-mltmb"
Jul 20 13:01:51.780058 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:51.778584    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1c610d05-f1c0-474a-a1b9-5ad71f8ba52e-host\") pod \"tuned-tnlm9\" (UID: \"1c610d05-f1c0-474a-a1b9-5ad71f8ba52e\") " pod="openshift-cluster-node-tuning-operator/tuned-tnlm9"
Jul 20 13:01:51.780058 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:51.778628    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/1c610d05-f1c0-474a-a1b9-5ad71f8ba52e-etc-tuned\") pod \"tuned-tnlm9\" (UID: \"1c610d05-f1c0-474a-a1b9-5ad71f8ba52e\") " pod="openshift-cluster-node-tuning-operator/tuned-tnlm9"
Jul 20 13:01:51.780058 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:51.778661    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f8c70e98-14ec-48d9-8c30-2d63fa95c04e-original-pull-secret\") pod \"global-pull-secret-syncer-4wwrh\" (UID: \"f8c70e98-14ec-48d9-8c30-2d63fa95c04e\") " pod="kube-system/global-pull-secret-syncer-4wwrh"
Jul 20 13:01:51.781104 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:51.778745    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b5a49b2c-c21c-4600-adf6-dc15dda1ff06-system-cni-dir\") pod \"multus-9l8sl\" (UID: \"b5a49b2c-c21c-4600-adf6-dc15dda1ff06\") " pod="openshift-multus/multus-9l8sl"
Jul 20 13:01:51.781104 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:51.778778    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d5e256e3-6d71-4bc3-b539-c12fadc540ad-host-slash\") pod \"iptables-alerter-bb5cg\" (UID: \"d5e256e3-6d71-4bc3-b539-c12fadc540ad\") " pod="openshift-network-operator/iptables-alerter-bb5cg"
Jul 20 13:01:51.781104 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:51.778836    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/dc1eda22-b2e1-4381-b12f-3af236b2de4e-log-socket\") pod \"ovnkube-node-mltmb\" (UID: \"dc1eda22-b2e1-4381-b12f-3af236b2de4e\") " pod="openshift-ovn-kubernetes/ovnkube-node-mltmb"
Jul 20 13:01:51.781104 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:51.778880    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1c610d05-f1c0-474a-a1b9-5ad71f8ba52e-var-lib-kubelet\") pod \"tuned-tnlm9\" (UID: \"1c610d05-f1c0-474a-a1b9-5ad71f8ba52e\") " pod="openshift-cluster-node-tuning-operator/tuned-tnlm9"
Jul 20 13:01:51.781104 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:51.779002    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b5a49b2c-c21c-4600-adf6-dc15dda1ff06-cnibin\") pod \"multus-9l8sl\" (UID: \"b5a49b2c-c21c-4600-adf6-dc15dda1ff06\") " pod="openshift-multus/multus-9l8sl"
Jul 20 13:01:51.781104 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:51.779069    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/1c610d05-f1c0-474a-a1b9-5ad71f8ba52e-etc-systemd\") pod \"tuned-tnlm9\" (UID: \"1c610d05-f1c0-474a-a1b9-5ad71f8ba52e\") " pod="openshift-cluster-node-tuning-operator/tuned-tnlm9"
Jul 20 13:01:51.781104 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:51.779108    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/f8c70e98-14ec-48d9-8c30-2d63fa95c04e-kubelet-config\") pod \"global-pull-secret-syncer-4wwrh\" (UID: \"f8c70e98-14ec-48d9-8c30-2d63fa95c04e\") " pod="kube-system/global-pull-secret-syncer-4wwrh"
Jul 20 13:01:51.781104 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:51.779135    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-ntcf5"
Jul 20 13:01:51.781104 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:51.779162    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/1c610d05-f1c0-474a-a1b9-5ad71f8ba52e-etc-sysctl-d\") pod \"tuned-tnlm9\" (UID: \"1c610d05-f1c0-474a-a1b9-5ad71f8ba52e\") " pod="openshift-cluster-node-tuning-operator/tuned-tnlm9"
Jul 20 13:01:51.781104 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:51.779196    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/1c610d05-f1c0-474a-a1b9-5ad71f8ba52e-etc-sysctl-conf\") pod \"tuned-tnlm9\" (UID: \"1c610d05-f1c0-474a-a1b9-5ad71f8ba52e\") " pod="openshift-cluster-node-tuning-operator/tuned-tnlm9"
Jul 20 13:01:51.781104 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:51.779229    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b5a49b2c-c21c-4600-adf6-dc15dda1ff06-multus-conf-dir\") pod \"multus-9l8sl\" (UID: \"b5a49b2c-c21c-4600-adf6-dc15dda1ff06\") " pod="openshift-multus/multus-9l8sl"
Jul 20 13:01:51.781104 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:51.779259    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/d5e256e3-6d71-4bc3-b539-c12fadc540ad-iptables-alerter-script\") pod \"iptables-alerter-bb5cg\" (UID: \"d5e256e3-6d71-4bc3-b539-c12fadc540ad\") " pod="openshift-network-operator/iptables-alerter-bb5cg"
Jul 20 13:01:51.781104 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:51.779311    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/dc1eda22-b2e1-4381-b12f-3af236b2de4e-env-overrides\") pod \"ovnkube-node-mltmb\" (UID: \"dc1eda22-b2e1-4381-b12f-3af236b2de4e\") " pod="openshift-ovn-kubernetes/ovnkube-node-mltmb"
Jul 20 13:01:51.781104 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:51.779351    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/dc1eda22-b2e1-4381-b12f-3af236b2de4e-ovnkube-script-lib\") pod \"ovnkube-node-mltmb\" (UID: \"dc1eda22-b2e1-4381-b12f-3af236b2de4e\") " pod="openshift-ovn-kubernetes/ovnkube-node-mltmb"
Jul 20 13:01:51.781104 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:51.779383    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1c610d05-f1c0-474a-a1b9-5ad71f8ba52e-sys\") pod \"tuned-tnlm9\" (UID: \"1c610d05-f1c0-474a-a1b9-5ad71f8ba52e\") " pod="openshift-cluster-node-tuning-operator/tuned-tnlm9"
Jul 20 13:01:51.781104 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:51.779409    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/dc1eda22-b2e1-4381-b12f-3af236b2de4e-host-cni-bin\") pod \"ovnkube-node-mltmb\" (UID: \"dc1eda22-b2e1-4381-b12f-3af236b2de4e\") " pod="openshift-ovn-kubernetes/ovnkube-node-mltmb"
Jul 20 13:01:51.781104 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:51.779444    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/dc1eda22-b2e1-4381-b12f-3af236b2de4e-ovn-node-metrics-cert\") pod \"ovnkube-node-mltmb\" (UID: \"dc1eda22-b2e1-4381-b12f-3af236b2de4e\") " pod="openshift-ovn-kubernetes/ovnkube-node-mltmb"
Jul 20 13:01:51.781980 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:51.779474    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/548d5005-1a66-4385-9ebc-6844b175673d-hosts-file\") pod \"node-resolver-hgvl2\" (UID: \"548d5005-1a66-4385-9ebc-6844b175673d\") " pod="openshift-dns/node-resolver-hgvl2"
Jul 20 13:01:51.781980 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:51.779531    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b5a49b2c-c21c-4600-adf6-dc15dda1ff06-host-run-netns\") pod \"multus-9l8sl\" (UID: \"b5a49b2c-c21c-4600-adf6-dc15dda1ff06\") " pod="openshift-multus/multus-9l8sl"
Jul 20 13:01:51.781980 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:51.779565    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b5a49b2c-c21c-4600-adf6-dc15dda1ff06-host-var-lib-kubelet\") pod \"multus-9l8sl\" (UID: \"b5a49b2c-c21c-4600-adf6-dc15dda1ff06\") " pod="openshift-multus/multus-9l8sl"
Jul 20 13:01:51.781980 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:51.779599    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/b5a49b2c-c21c-4600-adf6-dc15dda1ff06-multus-daemon-config\") pod \"multus-9l8sl\" (UID: \"b5a49b2c-c21c-4600-adf6-dc15dda1ff06\") " pod="openshift-multus/multus-9l8sl"
Jul 20 13:01:51.781980 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:51.779668    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zg57j\" (UniqueName: \"kubernetes.io/projected/1c610d05-f1c0-474a-a1b9-5ad71f8ba52e-kube-api-access-zg57j\") pod \"tuned-tnlm9\" (UID: \"1c610d05-f1c0-474a-a1b9-5ad71f8ba52e\") " pod="openshift-cluster-node-tuning-operator/tuned-tnlm9"
Jul 20 13:01:51.781980 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:51.779722    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/1c610d05-f1c0-474a-a1b9-5ad71f8ba52e-run\") pod \"tuned-tnlm9\" (UID: \"1c610d05-f1c0-474a-a1b9-5ad71f8ba52e\") " pod="openshift-cluster-node-tuning-operator/tuned-tnlm9"
Jul 20 13:01:51.781980 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:51.779769    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/dc1eda22-b2e1-4381-b12f-3af236b2de4e-host-cni-netd\") pod \"ovnkube-node-mltmb\" (UID: \"dc1eda22-b2e1-4381-b12f-3af236b2de4e\") " pod="openshift-ovn-kubernetes/ovnkube-node-mltmb"
Jul 20 13:01:51.781980 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:51.779811    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/1c610d05-f1c0-474a-a1b9-5ad71f8ba52e-etc-sysconfig\") pod \"tuned-tnlm9\" (UID: \"1c610d05-f1c0-474a-a1b9-5ad71f8ba52e\") " pod="openshift-cluster-node-tuning-operator/tuned-tnlm9"
Jul 20 13:01:51.781980 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:51.779842    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/dc1eda22-b2e1-4381-b12f-3af236b2de4e-run-systemd\") pod \"ovnkube-node-mltmb\" (UID: \"dc1eda22-b2e1-4381-b12f-3af236b2de4e\") " pod="openshift-ovn-kubernetes/ovnkube-node-mltmb"
Jul 20 13:01:51.781980 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:51.779883    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/dc1eda22-b2e1-4381-b12f-3af236b2de4e-var-lib-openvswitch\") pod \"ovnkube-node-mltmb\" (UID: \"dc1eda22-b2e1-4381-b12f-3af236b2de4e\") " pod="openshift-ovn-kubernetes/ovnkube-node-mltmb"
Jul 20 13:01:51.781980 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:51.779931    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/548d5005-1a66-4385-9ebc-6844b175673d-tmp-dir\") pod \"node-resolver-hgvl2\" (UID: \"548d5005-1a66-4385-9ebc-6844b175673d\") " pod="openshift-dns/node-resolver-hgvl2"
Jul 20 13:01:51.781980 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:51.779961    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/b5a49b2c-c21c-4600-adf6-dc15dda1ff06-host-run-multus-certs\") pod \"multus-9l8sl\" (UID: \"b5a49b2c-c21c-4600-adf6-dc15dda1ff06\") " pod="openshift-multus/multus-9l8sl"
Jul 20 13:01:51.781980 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:51.780016    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/b5a49b2c-c21c-4600-adf6-dc15dda1ff06-host-run-k8s-cni-cncf-io\") pod \"multus-9l8sl\" (UID: \"b5a49b2c-c21c-4600-adf6-dc15dda1ff06\") " pod="openshift-multus/multus-9l8sl"
Jul 20 13:01:51.781980 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:51.781323    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 20 13:01:51.781980 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:51.781334    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 20 13:01:51.781980 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:51.781831    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-ms8mh\""
Jul 20 13:01:51.943404 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:51.784335    2584 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 20 13:01:51.943404 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:51.805243    2584 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-6kh9t"
Jul 20 13:01:51.943404 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:51.814635    2584 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-6kh9t"
Jul 20 13:01:51.943404 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:51.872150    2584 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 20 13:01:51.943404 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:51.880634    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/dc1eda22-b2e1-4381-b12f-3af236b2de4e-host-run-netns\") pod \"ovnkube-node-mltmb\" (UID: \"dc1eda22-b2e1-4381-b12f-3af236b2de4e\") " pod="openshift-ovn-kubernetes/ovnkube-node-mltmb"
Jul 20 13:01:51.943404 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:51.880661    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lsp8d\" (UniqueName: \"kubernetes.io/projected/58994b72-6cbb-452f-a68e-62b088c3cfbf-kube-api-access-lsp8d\") pod \"aws-ebs-csi-driver-node-46jkq\" (UID: \"58994b72-6cbb-452f-a68e-62b088c3cfbf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-46jkq"
Jul 20 13:01:51.943404 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:51.880681    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b5a49b2c-c21c-4600-adf6-dc15dda1ff06-multus-cni-dir\") pod \"multus-9l8sl\" (UID: \"b5a49b2c-c21c-4600-adf6-dc15dda1ff06\") " pod="openshift-multus/multus-9l8sl"
Jul 20 13:01:51.943404 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:51.880699    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/dc1eda22-b2e1-4381-b12f-3af236b2de4e-host-slash\") pod \"ovnkube-node-mltmb\" (UID: \"dc1eda22-b2e1-4381-b12f-3af236b2de4e\") " pod="openshift-ovn-kubernetes/ovnkube-node-mltmb"
Jul 20 13:01:51.943404 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:51.880718    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9nmqn\" (UniqueName: \"kubernetes.io/projected/dc1eda22-b2e1-4381-b12f-3af236b2de4e-kube-api-access-9nmqn\") pod \"ovnkube-node-mltmb\" (UID: \"dc1eda22-b2e1-4381-b12f-3af236b2de4e\") " pod="openshift-ovn-kubernetes/ovnkube-node-mltmb"
Jul 20 13:01:51.943404 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:51.880740    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/48cff737-3690-4df6-8e01-3b06c888f58f-host\") pod \"node-ca-hsm2t\" (UID: \"48cff737-3690-4df6-8e01-3b06c888f58f\") " pod="openshift-image-registry/node-ca-hsm2t"
Jul 20 13:01:51.943404 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:51.880740    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/dc1eda22-b2e1-4381-b12f-3af236b2de4e-host-run-netns\") pod \"ovnkube-node-mltmb\" (UID: \"dc1eda22-b2e1-4381-b12f-3af236b2de4e\") " pod="openshift-ovn-kubernetes/ovnkube-node-mltmb"
Jul 20 13:01:51.943404 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:51.880755    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1c610d05-f1c0-474a-a1b9-5ad71f8ba52e-lib-modules\") pod \"tuned-tnlm9\" (UID: \"1c610d05-f1c0-474a-a1b9-5ad71f8ba52e\") " pod="openshift-cluster-node-tuning-operator/tuned-tnlm9"
Jul 20 13:01:51.943404 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:51.880761    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/dc1eda22-b2e1-4381-b12f-3af236b2de4e-host-slash\") pod \"ovnkube-node-mltmb\" (UID: \"dc1eda22-b2e1-4381-b12f-3af236b2de4e\") " pod="openshift-ovn-kubernetes/ovnkube-node-mltmb"
Jul 20 13:01:51.943404 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:51.880770    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1c610d05-f1c0-474a-a1b9-5ad71f8ba52e-tmp\") pod \"tuned-tnlm9\" (UID: \"1c610d05-f1c0-474a-a1b9-5ad71f8ba52e\") " pod="openshift-cluster-node-tuning-operator/tuned-tnlm9"
Jul 20 13:01:51.943404 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:51.880795    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/48cff737-3690-4df6-8e01-3b06c888f58f-host\") pod \"node-ca-hsm2t\" (UID: \"48cff737-3690-4df6-8e01-3b06c888f58f\") " pod="openshift-image-registry/node-ca-hsm2t"
Jul 20 13:01:51.943404 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:51.880814    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/dc1eda22-b2e1-4381-b12f-3af236b2de4e-node-log\") pod \"ovnkube-node-mltmb\" (UID: \"dc1eda22-b2e1-4381-b12f-3af236b2de4e\") " pod="openshift-ovn-kubernetes/ovnkube-node-mltmb"
Jul 20 13:01:51.943404 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:51.880842    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1c610d05-f1c0-474a-a1b9-5ad71f8ba52e-host\") pod \"tuned-tnlm9\" (UID: \"1c610d05-f1c0-474a-a1b9-5ad71f8ba52e\") " pod="openshift-cluster-node-tuning-operator/tuned-tnlm9"
Jul 20 13:01:51.943404 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:51.880859    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b5a49b2c-c21c-4600-adf6-dc15dda1ff06-multus-cni-dir\") pod \"multus-9l8sl\" (UID: \"b5a49b2c-c21c-4600-adf6-dc15dda1ff06\") " pod="openshift-multus/multus-9l8sl"
Jul 20 13:01:51.943404 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:51.880867    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/1c610d05-f1c0-474a-a1b9-5ad71f8ba52e-etc-tuned\") pod \"tuned-tnlm9\" (UID: \"1c610d05-f1c0-474a-a1b9-5ad71f8ba52e\") " pod="openshift-cluster-node-tuning-operator/tuned-tnlm9"
Jul 20 13:01:51.943404 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:51.880885    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1c610d05-f1c0-474a-a1b9-5ad71f8ba52e-lib-modules\") pod \"tuned-tnlm9\" (UID: \"1c610d05-f1c0-474a-a1b9-5ad71f8ba52e\") " pod="openshift-cluster-node-tuning-operator/tuned-tnlm9"
Jul 20 13:01:51.944865 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:51.880899    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/dc1eda22-b2e1-4381-b12f-3af236b2de4e-node-log\") pod \"ovnkube-node-mltmb\" (UID: \"dc1eda22-b2e1-4381-b12f-3af236b2de4e\") " pod="openshift-ovn-kubernetes/ovnkube-node-mltmb"
Jul 20 13:01:51.944865 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:51.880908    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f8c70e98-14ec-48d9-8c30-2d63fa95c04e-original-pull-secret\") pod \"global-pull-secret-syncer-4wwrh\" (UID: \"f8c70e98-14ec-48d9-8c30-2d63fa95c04e\") " pod="kube-system/global-pull-secret-syncer-4wwrh"
Jul 20 13:01:51.944865 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:51.880938    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1c610d05-f1c0-474a-a1b9-5ad71f8ba52e-host\") pod \"tuned-tnlm9\" (UID: \"1c610d05-f1c0-474a-a1b9-5ad71f8ba52e\") " pod="openshift-cluster-node-tuning-operator/tuned-tnlm9"
Jul 20 13:01:51.944865 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:51.880950    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/95e88ecd-0ff4-4a0b-b8ef-b395ee2a78db-cnibin\") pod \"multus-additional-cni-plugins-szpnb\" (UID: \"95e88ecd-0ff4-4a0b-b8ef-b395ee2a78db\") " pod="openshift-multus/multus-additional-cni-plugins-szpnb"
Jul 20 13:01:51.944865 ip-10-0-134-121 kubenswrapper[2584]: E0720 13:01:51.880992    2584 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 20 13:01:51.944865 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:51.880997    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/58994b72-6cbb-452f-a68e-62b088c3cfbf-kubelet-dir\") pod \"aws-ebs-csi-driver-node-46jkq\" (UID: \"58994b72-6cbb-452f-a68e-62b088c3cfbf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-46jkq"
Jul 20 13:01:51.944865 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:51.881025    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/95e88ecd-0ff4-4a0b-b8ef-b395ee2a78db-os-release\") pod \"multus-additional-cni-plugins-szpnb\" (UID: \"95e88ecd-0ff4-4a0b-b8ef-b395ee2a78db\") " pod="openshift-multus/multus-additional-cni-plugins-szpnb"
Jul 20 13:01:51.944865 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:51.881055    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sgz85\" (UniqueName: \"kubernetes.io/projected/6a903657-acf4-4846-a7bd-b45e286216c1-kube-api-access-sgz85\") pod \"network-check-target-ck7q6\" (UID: \"6a903657-acf4-4846-a7bd-b45e286216c1\") " pod="openshift-network-diagnostics/network-check-target-ck7q6"
Jul 20 13:01:51.944865 ip-10-0-134-121 kubenswrapper[2584]: E0720 13:01:51.881075    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f8c70e98-14ec-48d9-8c30-2d63fa95c04e-original-pull-secret podName:f8c70e98-14ec-48d9-8c30-2d63fa95c04e nodeName:}" failed. No retries permitted until 2026-07-20 13:01:52.381053186 +0000 UTC m=+2.097600609 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f8c70e98-14ec-48d9-8c30-2d63fa95c04e-original-pull-secret") pod "global-pull-secret-syncer-4wwrh" (UID: "f8c70e98-14ec-48d9-8c30-2d63fa95c04e") : object "kube-system"/"original-pull-secret" not registered
Jul 20 13:01:51.944865 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:51.881120    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/58994b72-6cbb-452f-a68e-62b088c3cfbf-registration-dir\") pod \"aws-ebs-csi-driver-node-46jkq\" (UID: \"58994b72-6cbb-452f-a68e-62b088c3cfbf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-46jkq"
Jul 20 13:01:51.944865 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:51.881129    2584 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 20 13:01:51.944865 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:51.881152    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b5a49b2c-c21c-4600-adf6-dc15dda1ff06-system-cni-dir\") pod \"multus-9l8sl\" (UID: \"b5a49b2c-c21c-4600-adf6-dc15dda1ff06\") " pod="openshift-multus/multus-9l8sl"
Jul 20 13:01:51.944865 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:51.881178    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d5e256e3-6d71-4bc3-b539-c12fadc540ad-host-slash\") pod \"iptables-alerter-bb5cg\" (UID: \"d5e256e3-6d71-4bc3-b539-c12fadc540ad\") " pod="openshift-network-operator/iptables-alerter-bb5cg"
Jul 20 13:01:51.944865 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:51.881204    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/dc1eda22-b2e1-4381-b12f-3af236b2de4e-log-socket\") pod \"ovnkube-node-mltmb\" (UID: \"dc1eda22-b2e1-4381-b12f-3af236b2de4e\") " pod="openshift-ovn-kubernetes/ovnkube-node-mltmb"
Jul 20 13:01:51.944865 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:51.881228    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1c610d05-f1c0-474a-a1b9-5ad71f8ba52e-var-lib-kubelet\") pod \"tuned-tnlm9\" (UID: \"1c610d05-f1c0-474a-a1b9-5ad71f8ba52e\") " pod="openshift-cluster-node-tuning-operator/tuned-tnlm9"
Jul 20 13:01:51.944865 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:51.881252    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b5a49b2c-c21c-4600-adf6-dc15dda1ff06-cnibin\") pod \"multus-9l8sl\" (UID: \"b5a49b2c-c21c-4600-adf6-dc15dda1ff06\") " pod="openshift-multus/multus-9l8sl"
Jul 20 13:01:51.944865 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:51.881266    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d5e256e3-6d71-4bc3-b539-c12fadc540ad-host-slash\") pod \"iptables-alerter-bb5cg\" (UID: \"d5e256e3-6d71-4bc3-b539-c12fadc540ad\") " pod="openshift-network-operator/iptables-alerter-bb5cg"
Jul 20 13:01:51.947513 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:51.881274    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/dc1eda22-b2e1-4381-b12f-3af236b2de4e-log-socket\") pod \"ovnkube-node-mltmb\" (UID: \"dc1eda22-b2e1-4381-b12f-3af236b2de4e\") " pod="openshift-ovn-kubernetes/ovnkube-node-mltmb"
Jul 20 13:01:51.947513 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:51.881291    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/1c610d05-f1c0-474a-a1b9-5ad71f8ba52e-etc-systemd\") pod \"tuned-tnlm9\" (UID: \"1c610d05-f1c0-474a-a1b9-5ad71f8ba52e\") " pod="openshift-cluster-node-tuning-operator/tuned-tnlm9"
Jul 20 13:01:51.947513 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:51.881328    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b5a49b2c-c21c-4600-adf6-dc15dda1ff06-cnibin\") pod \"multus-9l8sl\" (UID: \"b5a49b2c-c21c-4600-adf6-dc15dda1ff06\") " pod="openshift-multus/multus-9l8sl"
Jul 20 13:01:51.947513 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:51.881330    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1c610d05-f1c0-474a-a1b9-5ad71f8ba52e-var-lib-kubelet\") pod \"tuned-tnlm9\" (UID: \"1c610d05-f1c0-474a-a1b9-5ad71f8ba52e\") " pod="openshift-cluster-node-tuning-operator/tuned-tnlm9"
Jul 20 13:01:51.947513 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:51.881329    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/f8c70e98-14ec-48d9-8c30-2d63fa95c04e-kubelet-config\") pod \"global-pull-secret-syncer-4wwrh\" (UID: \"f8c70e98-14ec-48d9-8c30-2d63fa95c04e\") " pod="kube-system/global-pull-secret-syncer-4wwrh"
Jul 20 13:01:51.947513 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:51.881374    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/f8c70e98-14ec-48d9-8c30-2d63fa95c04e-kubelet-config\") pod \"global-pull-secret-syncer-4wwrh\" (UID: \"f8c70e98-14ec-48d9-8c30-2d63fa95c04e\") " pod="kube-system/global-pull-secret-syncer-4wwrh"
Jul 20 13:01:51.947513 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:51.881376    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rhmct\" (UniqueName: \"kubernetes.io/projected/84c98b82-b626-42a7-bce8-281d439e1772-kube-api-access-rhmct\") pod \"network-metrics-daemon-9zclf\" (UID: \"84c98b82-b626-42a7-bce8-281d439e1772\") " pod="openshift-multus/network-metrics-daemon-9zclf"
Jul 20 13:01:51.947513 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:51.881378    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/1c610d05-f1c0-474a-a1b9-5ad71f8ba52e-etc-systemd\") pod \"tuned-tnlm9\" (UID: \"1c610d05-f1c0-474a-a1b9-5ad71f8ba52e\") " pod="openshift-cluster-node-tuning-operator/tuned-tnlm9"
Jul 20 13:01:51.947513 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:51.881327    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b5a49b2c-c21c-4600-adf6-dc15dda1ff06-system-cni-dir\") pod \"multus-9l8sl\" (UID: \"b5a49b2c-c21c-4600-adf6-dc15dda1ff06\") " pod="openshift-multus/multus-9l8sl"
Jul 20 13:01:51.947513 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:51.881402    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/1c610d05-f1c0-474a-a1b9-5ad71f8ba52e-etc-sysctl-d\") pod \"tuned-tnlm9\" (UID: \"1c610d05-f1c0-474a-a1b9-5ad71f8ba52e\") " pod="openshift-cluster-node-tuning-operator/tuned-tnlm9"
Jul 20 13:01:51.947513 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:51.881423    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/1c610d05-f1c0-474a-a1b9-5ad71f8ba52e-etc-sysctl-conf\") pod \"tuned-tnlm9\" (UID: \"1c610d05-f1c0-474a-a1b9-5ad71f8ba52e\") " pod="openshift-cluster-node-tuning-operator/tuned-tnlm9"
Jul 20 13:01:51.947513 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:51.881439    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b5a49b2c-c21c-4600-adf6-dc15dda1ff06-multus-conf-dir\") pod \"multus-9l8sl\" (UID: \"b5a49b2c-c21c-4600-adf6-dc15dda1ff06\") " pod="openshift-multus/multus-9l8sl"
Jul 20 13:01:51.947513 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:51.881456    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/d5e256e3-6d71-4bc3-b539-c12fadc540ad-iptables-alerter-script\") pod \"iptables-alerter-bb5cg\" (UID: \"d5e256e3-6d71-4bc3-b539-c12fadc540ad\") " pod="openshift-network-operator/iptables-alerter-bb5cg"
Jul 20 13:01:51.947513 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:51.881477    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/dc1eda22-b2e1-4381-b12f-3af236b2de4e-env-overrides\") pod \"ovnkube-node-mltmb\" (UID: \"dc1eda22-b2e1-4381-b12f-3af236b2de4e\") " pod="openshift-ovn-kubernetes/ovnkube-node-mltmb"
Jul 20 13:01:51.947513 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:51.881498    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/1c610d05-f1c0-474a-a1b9-5ad71f8ba52e-etc-sysctl-d\") pod \"tuned-tnlm9\" (UID: \"1c610d05-f1c0-474a-a1b9-5ad71f8ba52e\") " pod="openshift-cluster-node-tuning-operator/tuned-tnlm9"
Jul 20 13:01:51.947513 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:51.881502    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/dc1eda22-b2e1-4381-b12f-3af236b2de4e-ovnkube-script-lib\") pod \"ovnkube-node-mltmb\" (UID: \"dc1eda22-b2e1-4381-b12f-3af236b2de4e\") " pod="openshift-ovn-kubernetes/ovnkube-node-mltmb"
Jul 20 13:01:51.947513 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:51.881506    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b5a49b2c-c21c-4600-adf6-dc15dda1ff06-multus-conf-dir\") pod \"multus-9l8sl\" (UID: \"b5a49b2c-c21c-4600-adf6-dc15dda1ff06\") " pod="openshift-multus/multus-9l8sl"
Jul 20 13:01:51.947513 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:51.881527    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1c610d05-f1c0-474a-a1b9-5ad71f8ba52e-sys\") pod \"tuned-tnlm9\" (UID: \"1c610d05-f1c0-474a-a1b9-5ad71f8ba52e\") " pod="openshift-cluster-node-tuning-operator/tuned-tnlm9"
Jul 20 13:01:51.948263 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:51.881579    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/dc1eda22-b2e1-4381-b12f-3af236b2de4e-host-cni-bin\") pod \"ovnkube-node-mltmb\" (UID: \"dc1eda22-b2e1-4381-b12f-3af236b2de4e\") " pod="openshift-ovn-kubernetes/ovnkube-node-mltmb"
Jul 20 13:01:51.948263 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:51.881612    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/dc1eda22-b2e1-4381-b12f-3af236b2de4e-ovn-node-metrics-cert\") pod \"ovnkube-node-mltmb\" (UID: \"dc1eda22-b2e1-4381-b12f-3af236b2de4e\") " pod="openshift-ovn-kubernetes/ovnkube-node-mltmb"
Jul 20 13:01:51.948263 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:51.881624    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/1c610d05-f1c0-474a-a1b9-5ad71f8ba52e-etc-sysctl-conf\") pod \"tuned-tnlm9\" (UID: \"1c610d05-f1c0-474a-a1b9-5ad71f8ba52e\") " pod="openshift-cluster-node-tuning-operator/tuned-tnlm9"
Jul 20 13:01:51.948263 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:51.881636    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/548d5005-1a66-4385-9ebc-6844b175673d-hosts-file\") pod \"node-resolver-hgvl2\" (UID: \"548d5005-1a66-4385-9ebc-6844b175673d\") " pod="openshift-dns/node-resolver-hgvl2"
Jul 20 13:01:51.948263 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:51.881664    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b5a49b2c-c21c-4600-adf6-dc15dda1ff06-host-run-netns\") pod \"multus-9l8sl\" (UID: \"b5a49b2c-c21c-4600-adf6-dc15dda1ff06\") " pod="openshift-multus/multus-9l8sl"
Jul 20 13:01:51.948263 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:51.881674    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/dc1eda22-b2e1-4381-b12f-3af236b2de4e-host-cni-bin\") pod \"ovnkube-node-mltmb\" (UID: \"dc1eda22-b2e1-4381-b12f-3af236b2de4e\") " pod="openshift-ovn-kubernetes/ovnkube-node-mltmb"
Jul 20 13:01:51.948263 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:51.881686    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b5a49b2c-c21c-4600-adf6-dc15dda1ff06-host-var-lib-kubelet\") pod \"multus-9l8sl\" (UID: \"b5a49b2c-c21c-4600-adf6-dc15dda1ff06\") " pod="openshift-multus/multus-9l8sl"
Jul 20 13:01:51.948263 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:51.881728    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1c610d05-f1c0-474a-a1b9-5ad71f8ba52e-sys\") pod \"tuned-tnlm9\" (UID: \"1c610d05-f1c0-474a-a1b9-5ad71f8ba52e\") " pod="openshift-cluster-node-tuning-operator/tuned-tnlm9"
Jul 20 13:01:51.948263 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:51.881728    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b5a49b2c-c21c-4600-adf6-dc15dda1ff06-host-var-lib-kubelet\") pod \"multus-9l8sl\" (UID: \"b5a49b2c-c21c-4600-adf6-dc15dda1ff06\") " pod="openshift-multus/multus-9l8sl"
Jul 20 13:01:51.948263 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:51.881758    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/b5a49b2c-c21c-4600-adf6-dc15dda1ff06-multus-daemon-config\") pod \"multus-9l8sl\" (UID: \"b5a49b2c-c21c-4600-adf6-dc15dda1ff06\") " pod="openshift-multus/multus-9l8sl"
Jul 20 13:01:51.948263 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:51.882106    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/dc1eda22-b2e1-4381-b12f-3af236b2de4e-env-overrides\") pod \"ovnkube-node-mltmb\" (UID: \"dc1eda22-b2e1-4381-b12f-3af236b2de4e\") " pod="openshift-ovn-kubernetes/ovnkube-node-mltmb"
Jul 20 13:01:51.948263 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:51.882151    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/d5e256e3-6d71-4bc3-b539-c12fadc540ad-iptables-alerter-script\") pod \"iptables-alerter-bb5cg\" (UID: \"d5e256e3-6d71-4bc3-b539-c12fadc540ad\") " pod="openshift-network-operator/iptables-alerter-bb5cg"
Jul 20 13:01:51.948263 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:51.882207    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/548d5005-1a66-4385-9ebc-6844b175673d-hosts-file\") pod \"node-resolver-hgvl2\" (UID: \"548d5005-1a66-4385-9ebc-6844b175673d\") " pod="openshift-dns/node-resolver-hgvl2"
Jul 20 13:01:51.948263 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:51.882217    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b5a49b2c-c21c-4600-adf6-dc15dda1ff06-host-run-netns\") pod \"multus-9l8sl\" (UID: \"b5a49b2c-c21c-4600-adf6-dc15dda1ff06\") " pod="openshift-multus/multus-9l8sl"
Jul 20 13:01:51.948263 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:51.882246    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zg57j\" (UniqueName: \"kubernetes.io/projected/1c610d05-f1c0-474a-a1b9-5ad71f8ba52e-kube-api-access-zg57j\") pod \"tuned-tnlm9\" (UID: \"1c610d05-f1c0-474a-a1b9-5ad71f8ba52e\") " pod="openshift-cluster-node-tuning-operator/tuned-tnlm9"
Jul 20 13:01:51.948263 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:51.882325    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/dc1eda22-b2e1-4381-b12f-3af236b2de4e-ovnkube-script-lib\") pod \"ovnkube-node-mltmb\" (UID: \"dc1eda22-b2e1-4381-b12f-3af236b2de4e\") " pod="openshift-ovn-kubernetes/ovnkube-node-mltmb"
Jul 20 13:01:51.948263 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:51.882358    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/1c610d05-f1c0-474a-a1b9-5ad71f8ba52e-run\") pod \"tuned-tnlm9\" (UID: \"1c610d05-f1c0-474a-a1b9-5ad71f8ba52e\") " pod="openshift-cluster-node-tuning-operator/tuned-tnlm9"
Jul 20 13:01:51.948263 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:51.882392    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/95e88ecd-0ff4-4a0b-b8ef-b395ee2a78db-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-szpnb\" (UID: \"95e88ecd-0ff4-4a0b-b8ef-b395ee2a78db\") " pod="openshift-multus/multus-additional-cni-plugins-szpnb"
Jul 20 13:01:51.949151 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:51.882439    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/dc1eda22-b2e1-4381-b12f-3af236b2de4e-host-cni-netd\") pod \"ovnkube-node-mltmb\" (UID: \"dc1eda22-b2e1-4381-b12f-3af236b2de4e\") " pod="openshift-ovn-kubernetes/ovnkube-node-mltmb"
Jul 20 13:01:51.949151 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:51.882396    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/b5a49b2c-c21c-4600-adf6-dc15dda1ff06-multus-daemon-config\") pod \"multus-9l8sl\" (UID: \"b5a49b2c-c21c-4600-adf6-dc15dda1ff06\") " pod="openshift-multus/multus-9l8sl"
Jul 20 13:01:51.949151 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:51.882454    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/1c610d05-f1c0-474a-a1b9-5ad71f8ba52e-run\") pod \"tuned-tnlm9\" (UID: \"1c610d05-f1c0-474a-a1b9-5ad71f8ba52e\") " pod="openshift-cluster-node-tuning-operator/tuned-tnlm9"
Jul 20 13:01:51.949151 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:51.882467    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/1c610d05-f1c0-474a-a1b9-5ad71f8ba52e-etc-sysconfig\") pod \"tuned-tnlm9\" (UID: \"1c610d05-f1c0-474a-a1b9-5ad71f8ba52e\") " pod="openshift-cluster-node-tuning-operator/tuned-tnlm9"
Jul 20 13:01:51.949151 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:51.882500    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/dc1eda22-b2e1-4381-b12f-3af236b2de4e-host-cni-netd\") pod \"ovnkube-node-mltmb\" (UID: \"dc1eda22-b2e1-4381-b12f-3af236b2de4e\") " pod="openshift-ovn-kubernetes/ovnkube-node-mltmb"
Jul 20 13:01:51.949151 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:51.882493    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f4lbf\" (UniqueName: \"kubernetes.io/projected/95e88ecd-0ff4-4a0b-b8ef-b395ee2a78db-kube-api-access-f4lbf\") pod \"multus-additional-cni-plugins-szpnb\" (UID: \"95e88ecd-0ff4-4a0b-b8ef-b395ee2a78db\") " pod="openshift-multus/multus-additional-cni-plugins-szpnb"
Jul 20 13:01:51.949151 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:51.882545    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/58994b72-6cbb-452f-a68e-62b088c3cfbf-socket-dir\") pod \"aws-ebs-csi-driver-node-46jkq\" (UID: \"58994b72-6cbb-452f-a68e-62b088c3cfbf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-46jkq"
Jul 20 13:01:51.949151 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:51.882585    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/1c610d05-f1c0-474a-a1b9-5ad71f8ba52e-etc-sysconfig\") pod \"tuned-tnlm9\" (UID: \"1c610d05-f1c0-474a-a1b9-5ad71f8ba52e\") " pod="openshift-cluster-node-tuning-operator/tuned-tnlm9"
Jul 20 13:01:51.949151 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:51.882626    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/dc1eda22-b2e1-4381-b12f-3af236b2de4e-run-systemd\") pod \"ovnkube-node-mltmb\" (UID: \"dc1eda22-b2e1-4381-b12f-3af236b2de4e\") " pod="openshift-ovn-kubernetes/ovnkube-node-mltmb"
Jul 20 13:01:51.949151 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:51.882654    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/dc1eda22-b2e1-4381-b12f-3af236b2de4e-run-systemd\") pod \"ovnkube-node-mltmb\" (UID: \"dc1eda22-b2e1-4381-b12f-3af236b2de4e\") " pod="openshift-ovn-kubernetes/ovnkube-node-mltmb"
Jul 20 13:01:51.949151 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:51.882705    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/dc1eda22-b2e1-4381-b12f-3af236b2de4e-var-lib-openvswitch\") pod \"ovnkube-node-mltmb\" (UID: \"dc1eda22-b2e1-4381-b12f-3af236b2de4e\") " pod="openshift-ovn-kubernetes/ovnkube-node-mltmb"
Jul 20 13:01:51.949151 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:51.882733    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/dc1eda22-b2e1-4381-b12f-3af236b2de4e-var-lib-openvswitch\") pod \"ovnkube-node-mltmb\" (UID: \"dc1eda22-b2e1-4381-b12f-3af236b2de4e\") " pod="openshift-ovn-kubernetes/ovnkube-node-mltmb"
Jul 20 13:01:51.949151 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:51.882742    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/548d5005-1a66-4385-9ebc-6844b175673d-tmp-dir\") pod \"node-resolver-hgvl2\" (UID: \"548d5005-1a66-4385-9ebc-6844b175673d\") " pod="openshift-dns/node-resolver-hgvl2"
Jul 20 13:01:51.949151 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:51.882767    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/b5a49b2c-c21c-4600-adf6-dc15dda1ff06-host-run-multus-certs\") pod \"multus-9l8sl\" (UID: \"b5a49b2c-c21c-4600-adf6-dc15dda1ff06\") " pod="openshift-multus/multus-9l8sl"
Jul 20 13:01:51.949151 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:51.882784    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/b5a49b2c-c21c-4600-adf6-dc15dda1ff06-host-run-k8s-cni-cncf-io\") pod \"multus-9l8sl\" (UID: \"b5a49b2c-c21c-4600-adf6-dc15dda1ff06\") " pod="openshift-multus/multus-9l8sl"
Jul 20 13:01:51.949151 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:51.882799    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b5a49b2c-c21c-4600-adf6-dc15dda1ff06-host-var-lib-cni-bin\") pod \"multus-9l8sl\" (UID: \"b5a49b2c-c21c-4600-adf6-dc15dda1ff06\") " pod="openshift-multus/multus-9l8sl"
Jul 20 13:01:51.949151 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:51.882835    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/dc1eda22-b2e1-4381-b12f-3af236b2de4e-run-openvswitch\") pod \"ovnkube-node-mltmb\" (UID: \"dc1eda22-b2e1-4381-b12f-3af236b2de4e\") " pod="openshift-ovn-kubernetes/ovnkube-node-mltmb"
Jul 20 13:01:51.949796 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:51.882856    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/678728d9-5d5d-4550-b8e4-4d88906baa98-agent-certs\") pod \"konnectivity-agent-ntcf5\" (UID: \"678728d9-5d5d-4550-b8e4-4d88906baa98\") " pod="kube-system/konnectivity-agent-ntcf5"
Jul 20 13:01:51.949796 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:51.882872    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b5a49b2c-c21c-4600-adf6-dc15dda1ff06-cni-binary-copy\") pod \"multus-9l8sl\" (UID: \"b5a49b2c-c21c-4600-adf6-dc15dda1ff06\") " pod="openshift-multus/multus-9l8sl"
Jul 20 13:01:51.949796 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:51.882877    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/b5a49b2c-c21c-4600-adf6-dc15dda1ff06-host-run-k8s-cni-cncf-io\") pod \"multus-9l8sl\" (UID: \"b5a49b2c-c21c-4600-adf6-dc15dda1ff06\") " pod="openshift-multus/multus-9l8sl"
Jul 20 13:01:51.949796 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:51.882895    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b5a49b2c-c21c-4600-adf6-dc15dda1ff06-etc-kubernetes\") pod \"multus-9l8sl\" (UID: \"b5a49b2c-c21c-4600-adf6-dc15dda1ff06\") " pod="openshift-multus/multus-9l8sl"
Jul 20 13:01:51.949796 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:51.882922    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/48cff737-3690-4df6-8e01-3b06c888f58f-serviceca\") pod \"node-ca-hsm2t\" (UID: \"48cff737-3690-4df6-8e01-3b06c888f58f\") " pod="openshift-image-registry/node-ca-hsm2t"
Jul 20 13:01:51.949796 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:51.882930    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b5a49b2c-c21c-4600-adf6-dc15dda1ff06-host-var-lib-cni-bin\") pod \"multus-9l8sl\" (UID: \"b5a49b2c-c21c-4600-adf6-dc15dda1ff06\") " pod="openshift-multus/multus-9l8sl"
Jul 20 13:01:51.949796 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:51.882950    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1c610d05-f1c0-474a-a1b9-5ad71f8ba52e-etc-kubernetes\") pod \"tuned-tnlm9\" (UID: \"1c610d05-f1c0-474a-a1b9-5ad71f8ba52e\") " pod="openshift-cluster-node-tuning-operator/tuned-tnlm9"
Jul 20 13:01:51.949796 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:51.882977    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/95e88ecd-0ff4-4a0b-b8ef-b395ee2a78db-cni-binary-copy\") pod \"multus-additional-cni-plugins-szpnb\" (UID: \"95e88ecd-0ff4-4a0b-b8ef-b395ee2a78db\") " pod="openshift-multus/multus-additional-cni-plugins-szpnb"
Jul 20 13:01:51.949796 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:51.882996    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b5a49b2c-c21c-4600-adf6-dc15dda1ff06-etc-kubernetes\") pod \"multus-9l8sl\" (UID: \"b5a49b2c-c21c-4600-adf6-dc15dda1ff06\") " pod="openshift-multus/multus-9l8sl"
Jul 20 13:01:51.949796 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:51.883021    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/84c98b82-b626-42a7-bce8-281d439e1772-metrics-certs\") pod \"network-metrics-daemon-9zclf\" (UID: \"84c98b82-b626-42a7-bce8-281d439e1772\") " pod="openshift-multus/network-metrics-daemon-9zclf"
Jul 20 13:01:51.949796 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:51.883047    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/678728d9-5d5d-4550-b8e4-4d88906baa98-konnectivity-ca\") pod \"konnectivity-agent-ntcf5\" (UID: \"678728d9-5d5d-4550-b8e4-4d88906baa98\") " pod="kube-system/konnectivity-agent-ntcf5"
Jul 20 13:01:51.949796 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:51.883072    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1c610d05-f1c0-474a-a1b9-5ad71f8ba52e-etc-kubernetes\") pod \"tuned-tnlm9\" (UID: \"1c610d05-f1c0-474a-a1b9-5ad71f8ba52e\") " pod="openshift-cluster-node-tuning-operator/tuned-tnlm9"
Jul 20 13:01:51.949796 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:51.883076    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-26w7l\" (UniqueName: \"kubernetes.io/projected/d5e256e3-6d71-4bc3-b539-c12fadc540ad-kube-api-access-26w7l\") pod \"iptables-alerter-bb5cg\" (UID: \"d5e256e3-6d71-4bc3-b539-c12fadc540ad\") " pod="openshift-network-operator/iptables-alerter-bb5cg"
Jul 20 13:01:51.949796 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:51.883114    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/dc1eda22-b2e1-4381-b12f-3af236b2de4e-systemd-units\") pod \"ovnkube-node-mltmb\" (UID: \"dc1eda22-b2e1-4381-b12f-3af236b2de4e\") " pod="openshift-ovn-kubernetes/ovnkube-node-mltmb"
Jul 20 13:01:51.949796 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:51.883118    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/548d5005-1a66-4385-9ebc-6844b175673d-tmp-dir\") pod \"node-resolver-hgvl2\" (UID: \"548d5005-1a66-4385-9ebc-6844b175673d\") " pod="openshift-dns/node-resolver-hgvl2"
Jul 20 13:01:51.949796 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:51.883145    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/dc1eda22-b2e1-4381-b12f-3af236b2de4e-ovnkube-config\") pod \"ovnkube-node-mltmb\" (UID: \"dc1eda22-b2e1-4381-b12f-3af236b2de4e\") " pod="openshift-ovn-kubernetes/ovnkube-node-mltmb"
Jul 20 13:01:51.949796 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:51.883173    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v7jkx\" (UniqueName: \"kubernetes.io/projected/48cff737-3690-4df6-8e01-3b06c888f58f-kube-api-access-v7jkx\") pod \"node-ca-hsm2t\" (UID: \"48cff737-3690-4df6-8e01-3b06c888f58f\") " pod="openshift-image-registry/node-ca-hsm2t"
Jul 20 13:01:51.950749 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:51.883185    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/b5a49b2c-c21c-4600-adf6-dc15dda1ff06-host-run-multus-certs\") pod \"multus-9l8sl\" (UID: \"b5a49b2c-c21c-4600-adf6-dc15dda1ff06\") " pod="openshift-multus/multus-9l8sl"
Jul 20 13:01:51.950749 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:51.883216    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/95e88ecd-0ff4-4a0b-b8ef-b395ee2a78db-tuning-conf-dir\") pod \"multus-additional-cni-plugins-szpnb\" (UID: \"95e88ecd-0ff4-4a0b-b8ef-b395ee2a78db\") " pod="openshift-multus/multus-additional-cni-plugins-szpnb"
Jul 20 13:01:51.950749 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:51.883249    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/95e88ecd-0ff4-4a0b-b8ef-b395ee2a78db-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-szpnb\" (UID: \"95e88ecd-0ff4-4a0b-b8ef-b395ee2a78db\") " pod="openshift-multus/multus-additional-cni-plugins-szpnb"
Jul 20 13:01:51.950749 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:51.883266    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/58994b72-6cbb-452f-a68e-62b088c3cfbf-etc-selinux\") pod \"aws-ebs-csi-driver-node-46jkq\" (UID: \"58994b72-6cbb-452f-a68e-62b088c3cfbf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-46jkq"
Jul 20 13:01:51.950749 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:51.883282    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/58994b72-6cbb-452f-a68e-62b088c3cfbf-sys-fs\") pod \"aws-ebs-csi-driver-node-46jkq\" (UID: \"58994b72-6cbb-452f-a68e-62b088c3cfbf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-46jkq"
Jul 20 13:01:51.950749 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:51.883314    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/1c610d05-f1c0-474a-a1b9-5ad71f8ba52e-etc-modprobe-d\") pod \"tuned-tnlm9\" (UID: \"1c610d05-f1c0-474a-a1b9-5ad71f8ba52e\") " pod="openshift-cluster-node-tuning-operator/tuned-tnlm9"
Jul 20 13:01:51.950749 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:51.882922    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/dc1eda22-b2e1-4381-b12f-3af236b2de4e-run-openvswitch\") pod \"ovnkube-node-mltmb\" (UID: \"dc1eda22-b2e1-4381-b12f-3af236b2de4e\") " pod="openshift-ovn-kubernetes/ovnkube-node-mltmb"
Jul 20 13:01:51.950749 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:51.883332    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/dc1eda22-b2e1-4381-b12f-3af236b2de4e-host-kubelet\") pod \"ovnkube-node-mltmb\" (UID: \"dc1eda22-b2e1-4381-b12f-3af236b2de4e\") " pod="openshift-ovn-kubernetes/ovnkube-node-mltmb"
Jul 20 13:01:51.950749 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:51.883349    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/dc1eda22-b2e1-4381-b12f-3af236b2de4e-host-run-ovn-kubernetes\") pod \"ovnkube-node-mltmb\" (UID: \"dc1eda22-b2e1-4381-b12f-3af236b2de4e\") " pod="openshift-ovn-kubernetes/ovnkube-node-mltmb"
Jul 20 13:01:51.950749 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:51.883366    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/dc1eda22-b2e1-4381-b12f-3af236b2de4e-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-mltmb\" (UID: \"dc1eda22-b2e1-4381-b12f-3af236b2de4e\") " pod="openshift-ovn-kubernetes/ovnkube-node-mltmb"
Jul 20 13:01:51.950749 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:51.883368    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/dc1eda22-b2e1-4381-b12f-3af236b2de4e-systemd-units\") pod \"ovnkube-node-mltmb\" (UID: \"dc1eda22-b2e1-4381-b12f-3af236b2de4e\") " pod="openshift-ovn-kubernetes/ovnkube-node-mltmb"
Jul 20 13:01:51.950749 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:51.883384    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gw5h5\" (UniqueName: \"kubernetes.io/projected/548d5005-1a66-4385-9ebc-6844b175673d-kube-api-access-gw5h5\") pod \"node-resolver-hgvl2\" (UID: \"548d5005-1a66-4385-9ebc-6844b175673d\") " pod="openshift-dns/node-resolver-hgvl2"
Jul 20 13:01:51.950749 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:51.883400    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/dc1eda22-b2e1-4381-b12f-3af236b2de4e-run-ovn\") pod \"ovnkube-node-mltmb\" (UID: \"dc1eda22-b2e1-4381-b12f-3af236b2de4e\") " pod="openshift-ovn-kubernetes/ovnkube-node-mltmb"
Jul 20 13:01:51.950749 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:51.883417    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-czs6d\" (UniqueName: \"kubernetes.io/projected/b5a49b2c-c21c-4600-adf6-dc15dda1ff06-kube-api-access-czs6d\") pod \"multus-9l8sl\" (UID: \"b5a49b2c-c21c-4600-adf6-dc15dda1ff06\") " pod="openshift-multus/multus-9l8sl"
Jul 20 13:01:51.950749 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:51.883420    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b5a49b2c-c21c-4600-adf6-dc15dda1ff06-cni-binary-copy\") pod \"multus-9l8sl\" (UID: \"b5a49b2c-c21c-4600-adf6-dc15dda1ff06\") " pod="openshift-multus/multus-9l8sl"
Jul 20 13:01:51.950749 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:51.883504    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/1c610d05-f1c0-474a-a1b9-5ad71f8ba52e-etc-modprobe-d\") pod \"tuned-tnlm9\" (UID: \"1c610d05-f1c0-474a-a1b9-5ad71f8ba52e\") " pod="openshift-cluster-node-tuning-operator/tuned-tnlm9"
Jul 20 13:01:51.950749 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:51.883548    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/dc1eda22-b2e1-4381-b12f-3af236b2de4e-host-kubelet\") pod \"ovnkube-node-mltmb\" (UID: \"dc1eda22-b2e1-4381-b12f-3af236b2de4e\") " pod="openshift-ovn-kubernetes/ovnkube-node-mltmb"
Jul 20 13:01:51.951398 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:51.883615    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/dc1eda22-b2e1-4381-b12f-3af236b2de4e-run-ovn\") pod \"ovnkube-node-mltmb\" (UID: \"dc1eda22-b2e1-4381-b12f-3af236b2de4e\") " pod="openshift-ovn-kubernetes/ovnkube-node-mltmb"
Jul 20 13:01:51.951398 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:51.883687    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b5a49b2c-c21c-4600-adf6-dc15dda1ff06-os-release\") pod \"multus-9l8sl\" (UID: \"b5a49b2c-c21c-4600-adf6-dc15dda1ff06\") " pod="openshift-multus/multus-9l8sl"
Jul 20 13:01:51.951398 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:51.883715    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/b5a49b2c-c21c-4600-adf6-dc15dda1ff06-hostroot\") pod \"multus-9l8sl\" (UID: \"b5a49b2c-c21c-4600-adf6-dc15dda1ff06\") " pod="openshift-multus/multus-9l8sl"
Jul 20 13:01:51.951398 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:51.883741    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/dc1eda22-b2e1-4381-b12f-3af236b2de4e-etc-openvswitch\") pod \"ovnkube-node-mltmb\" (UID: \"dc1eda22-b2e1-4381-b12f-3af236b2de4e\") " pod="openshift-ovn-kubernetes/ovnkube-node-mltmb"
Jul 20 13:01:51.951398 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:51.883804    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/dc1eda22-b2e1-4381-b12f-3af236b2de4e-etc-openvswitch\") pod \"ovnkube-node-mltmb\" (UID: \"dc1eda22-b2e1-4381-b12f-3af236b2de4e\") " pod="openshift-ovn-kubernetes/ovnkube-node-mltmb"
Jul 20 13:01:51.951398 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:51.883807    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/b5a49b2c-c21c-4600-adf6-dc15dda1ff06-hostroot\") pod \"multus-9l8sl\" (UID: \"b5a49b2c-c21c-4600-adf6-dc15dda1ff06\") " pod="openshift-multus/multus-9l8sl"
Jul 20 13:01:51.951398 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:51.883833    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/f8c70e98-14ec-48d9-8c30-2d63fa95c04e-dbus\") pod \"global-pull-secret-syncer-4wwrh\" (UID: \"f8c70e98-14ec-48d9-8c30-2d63fa95c04e\") " pod="kube-system/global-pull-secret-syncer-4wwrh"
Jul 20 13:01:51.951398 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:51.883842    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/dc1eda22-b2e1-4381-b12f-3af236b2de4e-ovnkube-config\") pod \"ovnkube-node-mltmb\" (UID: \"dc1eda22-b2e1-4381-b12f-3af236b2de4e\") " pod="openshift-ovn-kubernetes/ovnkube-node-mltmb"
Jul 20 13:01:51.951398 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:51.883867    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/95e88ecd-0ff4-4a0b-b8ef-b395ee2a78db-system-cni-dir\") pod \"multus-additional-cni-plugins-szpnb\" (UID: \"95e88ecd-0ff4-4a0b-b8ef-b395ee2a78db\") " pod="openshift-multus/multus-additional-cni-plugins-szpnb"
Jul 20 13:01:51.951398 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:51.883872    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b5a49b2c-c21c-4600-adf6-dc15dda1ff06-os-release\") pod \"multus-9l8sl\" (UID: \"b5a49b2c-c21c-4600-adf6-dc15dda1ff06\") " pod="openshift-multus/multus-9l8sl"
Jul 20 13:01:51.951398 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:51.883895    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/58994b72-6cbb-452f-a68e-62b088c3cfbf-device-dir\") pod \"aws-ebs-csi-driver-node-46jkq\" (UID: \"58994b72-6cbb-452f-a68e-62b088c3cfbf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-46jkq"
Jul 20 13:01:51.951398 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:51.883915    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/dc1eda22-b2e1-4381-b12f-3af236b2de4e-host-run-ovn-kubernetes\") pod \"ovnkube-node-mltmb\" (UID: \"dc1eda22-b2e1-4381-b12f-3af236b2de4e\") " pod="openshift-ovn-kubernetes/ovnkube-node-mltmb"
Jul 20 13:01:51.951398 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:51.883921    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/48cff737-3690-4df6-8e01-3b06c888f58f-serviceca\") pod \"node-ca-hsm2t\" (UID: \"48cff737-3690-4df6-8e01-3b06c888f58f\") " pod="openshift-image-registry/node-ca-hsm2t"
Jul 20 13:01:51.951398 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:51.883923    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/b5a49b2c-c21c-4600-adf6-dc15dda1ff06-multus-socket-dir-parent\") pod \"multus-9l8sl\" (UID: \"b5a49b2c-c21c-4600-adf6-dc15dda1ff06\") " pod="openshift-multus/multus-9l8sl"
Jul 20 13:01:51.951398 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:51.883967    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/b5a49b2c-c21c-4600-adf6-dc15dda1ff06-multus-socket-dir-parent\") pod \"multus-9l8sl\" (UID: \"b5a49b2c-c21c-4600-adf6-dc15dda1ff06\") " pod="openshift-multus/multus-9l8sl"
Jul 20 13:01:51.951398 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:51.883975    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/f8c70e98-14ec-48d9-8c30-2d63fa95c04e-dbus\") pod \"global-pull-secret-syncer-4wwrh\" (UID: \"f8c70e98-14ec-48d9-8c30-2d63fa95c04e\") " pod="kube-system/global-pull-secret-syncer-4wwrh"
Jul 20 13:01:51.951398 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:51.884006    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/b5a49b2c-c21c-4600-adf6-dc15dda1ff06-host-var-lib-cni-multus\") pod \"multus-9l8sl\" (UID: \"b5a49b2c-c21c-4600-adf6-dc15dda1ff06\") " pod="openshift-multus/multus-9l8sl"
Jul 20 13:01:51.951398 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:51.884040    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/b5a49b2c-c21c-4600-adf6-dc15dda1ff06-host-var-lib-cni-multus\") pod \"multus-9l8sl\" (UID: \"b5a49b2c-c21c-4600-adf6-dc15dda1ff06\") " pod="openshift-multus/multus-9l8sl"
Jul 20 13:01:51.955744 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:51.884005    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/dc1eda22-b2e1-4381-b12f-3af236b2de4e-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-mltmb\" (UID: \"dc1eda22-b2e1-4381-b12f-3af236b2de4e\") " pod="openshift-ovn-kubernetes/ovnkube-node-mltmb"
Jul 20 13:01:51.955744 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:51.885255    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1c610d05-f1c0-474a-a1b9-5ad71f8ba52e-tmp\") pod \"tuned-tnlm9\" (UID: \"1c610d05-f1c0-474a-a1b9-5ad71f8ba52e\") " pod="openshift-cluster-node-tuning-operator/tuned-tnlm9"
Jul 20 13:01:51.955744 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:51.885285    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/1c610d05-f1c0-474a-a1b9-5ad71f8ba52e-etc-tuned\") pod \"tuned-tnlm9\" (UID: \"1c610d05-f1c0-474a-a1b9-5ad71f8ba52e\") " pod="openshift-cluster-node-tuning-operator/tuned-tnlm9"
Jul 20 13:01:51.955744 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:51.885334    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/dc1eda22-b2e1-4381-b12f-3af236b2de4e-ovn-node-metrics-cert\") pod \"ovnkube-node-mltmb\" (UID: \"dc1eda22-b2e1-4381-b12f-3af236b2de4e\") " pod="openshift-ovn-kubernetes/ovnkube-node-mltmb"
Jul 20 13:01:51.955744 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:51.894364    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-czs6d\" (UniqueName: \"kubernetes.io/projected/b5a49b2c-c21c-4600-adf6-dc15dda1ff06-kube-api-access-czs6d\") pod \"multus-9l8sl\" (UID: \"b5a49b2c-c21c-4600-adf6-dc15dda1ff06\") " pod="openshift-multus/multus-9l8sl"
Jul 20 13:01:51.955744 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:51.895356    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gw5h5\" (UniqueName: \"kubernetes.io/projected/548d5005-1a66-4385-9ebc-6844b175673d-kube-api-access-gw5h5\") pod \"node-resolver-hgvl2\" (UID: \"548d5005-1a66-4385-9ebc-6844b175673d\") " pod="openshift-dns/node-resolver-hgvl2"
Jul 20 13:01:51.955744 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:51.895431    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zg57j\" (UniqueName: \"kubernetes.io/projected/1c610d05-f1c0-474a-a1b9-5ad71f8ba52e-kube-api-access-zg57j\") pod \"tuned-tnlm9\" (UID: \"1c610d05-f1c0-474a-a1b9-5ad71f8ba52e\") " pod="openshift-cluster-node-tuning-operator/tuned-tnlm9"
Jul 20 13:01:51.955744 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:51.895846    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-26w7l\" (UniqueName: \"kubernetes.io/projected/d5e256e3-6d71-4bc3-b539-c12fadc540ad-kube-api-access-26w7l\") pod \"iptables-alerter-bb5cg\" (UID: \"d5e256e3-6d71-4bc3-b539-c12fadc540ad\") " pod="openshift-network-operator/iptables-alerter-bb5cg"
Jul 20 13:01:51.955744 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:51.899544    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9nmqn\" (UniqueName: \"kubernetes.io/projected/dc1eda22-b2e1-4381-b12f-3af236b2de4e-kube-api-access-9nmqn\") pod \"ovnkube-node-mltmb\" (UID: \"dc1eda22-b2e1-4381-b12f-3af236b2de4e\") " pod="openshift-ovn-kubernetes/ovnkube-node-mltmb"
Jul 20 13:01:51.955744 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:51.905764    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v7jkx\" (UniqueName: \"kubernetes.io/projected/48cff737-3690-4df6-8e01-3b06c888f58f-kube-api-access-v7jkx\") pod \"node-ca-hsm2t\" (UID: \"48cff737-3690-4df6-8e01-3b06c888f58f\") " pod="openshift-image-registry/node-ca-hsm2t"
Jul 20 13:01:51.955744 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:51.916241    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-tnlm9"
Jul 20 13:01:52.133116 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:51.984903    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/95e88ecd-0ff4-4a0b-b8ef-b395ee2a78db-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-szpnb\" (UID: \"95e88ecd-0ff4-4a0b-b8ef-b395ee2a78db\") " pod="openshift-multus/multus-additional-cni-plugins-szpnb"
Jul 20 13:01:52.133116 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:51.984939    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f4lbf\" (UniqueName: \"kubernetes.io/projected/95e88ecd-0ff4-4a0b-b8ef-b395ee2a78db-kube-api-access-f4lbf\") pod \"multus-additional-cni-plugins-szpnb\" (UID: \"95e88ecd-0ff4-4a0b-b8ef-b395ee2a78db\") " pod="openshift-multus/multus-additional-cni-plugins-szpnb"
Jul 20 13:01:52.133116 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:51.984961    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/58994b72-6cbb-452f-a68e-62b088c3cfbf-socket-dir\") pod \"aws-ebs-csi-driver-node-46jkq\" (UID: \"58994b72-6cbb-452f-a68e-62b088c3cfbf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-46jkq"
Jul 20 13:01:52.133116 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:51.984982    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/678728d9-5d5d-4550-b8e4-4d88906baa98-agent-certs\") pod \"konnectivity-agent-ntcf5\" (UID: \"678728d9-5d5d-4550-b8e4-4d88906baa98\") " pod="kube-system/konnectivity-agent-ntcf5"
Jul 20 13:01:52.133116 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:51.985036    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/95e88ecd-0ff4-4a0b-b8ef-b395ee2a78db-cni-binary-copy\") pod \"multus-additional-cni-plugins-szpnb\" (UID: \"95e88ecd-0ff4-4a0b-b8ef-b395ee2a78db\") " pod="openshift-multus/multus-additional-cni-plugins-szpnb"
Jul 20 13:01:52.133116 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:51.985053    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/84c98b82-b626-42a7-bce8-281d439e1772-metrics-certs\") pod \"network-metrics-daemon-9zclf\" (UID: \"84c98b82-b626-42a7-bce8-281d439e1772\") " pod="openshift-multus/network-metrics-daemon-9zclf"
Jul 20 13:01:52.133116 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:51.985071    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/678728d9-5d5d-4550-b8e4-4d88906baa98-konnectivity-ca\") pod \"konnectivity-agent-ntcf5\" (UID: \"678728d9-5d5d-4550-b8e4-4d88906baa98\") " pod="kube-system/konnectivity-agent-ntcf5"
Jul 20 13:01:52.133116 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:51.985169    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/58994b72-6cbb-452f-a68e-62b088c3cfbf-socket-dir\") pod \"aws-ebs-csi-driver-node-46jkq\" (UID: \"58994b72-6cbb-452f-a68e-62b088c3cfbf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-46jkq"
Jul 20 13:01:52.133116 ip-10-0-134-121 kubenswrapper[2584]: E0720 13:01:51.985268    2584 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 20 13:01:52.133116 ip-10-0-134-121 kubenswrapper[2584]: E0720 13:01:51.985331    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/84c98b82-b626-42a7-bce8-281d439e1772-metrics-certs podName:84c98b82-b626-42a7-bce8-281d439e1772 nodeName:}" failed. No retries permitted until 2026-07-20 13:01:52.485311096 +0000 UTC m=+2.201858501 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/84c98b82-b626-42a7-bce8-281d439e1772-metrics-certs") pod "network-metrics-daemon-9zclf" (UID: "84c98b82-b626-42a7-bce8-281d439e1772") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 20 13:01:52.133116 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:51.985350    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/95e88ecd-0ff4-4a0b-b8ef-b395ee2a78db-tuning-conf-dir\") pod \"multus-additional-cni-plugins-szpnb\" (UID: \"95e88ecd-0ff4-4a0b-b8ef-b395ee2a78db\") " pod="openshift-multus/multus-additional-cni-plugins-szpnb"
Jul 20 13:01:52.133116 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:51.985382    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/95e88ecd-0ff4-4a0b-b8ef-b395ee2a78db-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-szpnb\" (UID: \"95e88ecd-0ff4-4a0b-b8ef-b395ee2a78db\") " pod="openshift-multus/multus-additional-cni-plugins-szpnb"
Jul 20 13:01:52.133116 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:51.985403    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/58994b72-6cbb-452f-a68e-62b088c3cfbf-etc-selinux\") pod \"aws-ebs-csi-driver-node-46jkq\" (UID: \"58994b72-6cbb-452f-a68e-62b088c3cfbf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-46jkq"
Jul 20 13:01:52.133116 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:51.985419    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/58994b72-6cbb-452f-a68e-62b088c3cfbf-sys-fs\") pod \"aws-ebs-csi-driver-node-46jkq\" (UID: \"58994b72-6cbb-452f-a68e-62b088c3cfbf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-46jkq"
Jul 20 13:01:52.133116 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:51.985445    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/95e88ecd-0ff4-4a0b-b8ef-b395ee2a78db-system-cni-dir\") pod \"multus-additional-cni-plugins-szpnb\" (UID: \"95e88ecd-0ff4-4a0b-b8ef-b395ee2a78db\") " pod="openshift-multus/multus-additional-cni-plugins-szpnb"
Jul 20 13:01:52.133116 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:51.985469    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/58994b72-6cbb-452f-a68e-62b088c3cfbf-device-dir\") pod \"aws-ebs-csi-driver-node-46jkq\" (UID: \"58994b72-6cbb-452f-a68e-62b088c3cfbf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-46jkq"
Jul 20 13:01:52.134071 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:51.985492    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lsp8d\" (UniqueName: \"kubernetes.io/projected/58994b72-6cbb-452f-a68e-62b088c3cfbf-kube-api-access-lsp8d\") pod \"aws-ebs-csi-driver-node-46jkq\" (UID: \"58994b72-6cbb-452f-a68e-62b088c3cfbf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-46jkq"
Jul 20 13:01:52.134071 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:51.985527    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/95e88ecd-0ff4-4a0b-b8ef-b395ee2a78db-cnibin\") pod \"multus-additional-cni-plugins-szpnb\" (UID: \"95e88ecd-0ff4-4a0b-b8ef-b395ee2a78db\") " pod="openshift-multus/multus-additional-cni-plugins-szpnb"
Jul 20 13:01:52.134071 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:51.985545    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/58994b72-6cbb-452f-a68e-62b088c3cfbf-kubelet-dir\") pod \"aws-ebs-csi-driver-node-46jkq\" (UID: \"58994b72-6cbb-452f-a68e-62b088c3cfbf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-46jkq"
Jul 20 13:01:52.134071 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:51.985567    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/95e88ecd-0ff4-4a0b-b8ef-b395ee2a78db-os-release\") pod \"multus-additional-cni-plugins-szpnb\" (UID: \"95e88ecd-0ff4-4a0b-b8ef-b395ee2a78db\") " pod="openshift-multus/multus-additional-cni-plugins-szpnb"
Jul 20 13:01:52.134071 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:51.985571    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/95e88ecd-0ff4-4a0b-b8ef-b395ee2a78db-tuning-conf-dir\") pod \"multus-additional-cni-plugins-szpnb\" (UID: \"95e88ecd-0ff4-4a0b-b8ef-b395ee2a78db\") " pod="openshift-multus/multus-additional-cni-plugins-szpnb"
Jul 20 13:01:52.134071 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:51.985584    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sgz85\" (UniqueName: \"kubernetes.io/projected/6a903657-acf4-4846-a7bd-b45e286216c1-kube-api-access-sgz85\") pod \"network-check-target-ck7q6\" (UID: \"6a903657-acf4-4846-a7bd-b45e286216c1\") " pod="openshift-network-diagnostics/network-check-target-ck7q6"
Jul 20 13:01:52.134071 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:51.985620    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/58994b72-6cbb-452f-a68e-62b088c3cfbf-registration-dir\") pod \"aws-ebs-csi-driver-node-46jkq\" (UID: \"58994b72-6cbb-452f-a68e-62b088c3cfbf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-46jkq"
Jul 20 13:01:52.134071 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:51.985662    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rhmct\" (UniqueName: \"kubernetes.io/projected/84c98b82-b626-42a7-bce8-281d439e1772-kube-api-access-rhmct\") pod \"network-metrics-daemon-9zclf\" (UID: \"84c98b82-b626-42a7-bce8-281d439e1772\") " pod="openshift-multus/network-metrics-daemon-9zclf"
Jul 20 13:01:52.134071 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:51.985737    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/58994b72-6cbb-452f-a68e-62b088c3cfbf-device-dir\") pod \"aws-ebs-csi-driver-node-46jkq\" (UID: \"58994b72-6cbb-452f-a68e-62b088c3cfbf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-46jkq"
Jul 20 13:01:52.134071 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:51.985854    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/95e88ecd-0ff4-4a0b-b8ef-b395ee2a78db-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-szpnb\" (UID: \"95e88ecd-0ff4-4a0b-b8ef-b395ee2a78db\") " pod="openshift-multus/multus-additional-cni-plugins-szpnb"
Jul 20 13:01:52.134071 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:51.985886    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/95e88ecd-0ff4-4a0b-b8ef-b395ee2a78db-cnibin\") pod \"multus-additional-cni-plugins-szpnb\" (UID: \"95e88ecd-0ff4-4a0b-b8ef-b395ee2a78db\") " pod="openshift-multus/multus-additional-cni-plugins-szpnb"
Jul 20 13:01:52.134071 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:51.985942    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/58994b72-6cbb-452f-a68e-62b088c3cfbf-kubelet-dir\") pod \"aws-ebs-csi-driver-node-46jkq\" (UID: \"58994b72-6cbb-452f-a68e-62b088c3cfbf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-46jkq"
Jul 20 13:01:52.134071 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:51.985961    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/95e88ecd-0ff4-4a0b-b8ef-b395ee2a78db-os-release\") pod \"multus-additional-cni-plugins-szpnb\" (UID: \"95e88ecd-0ff4-4a0b-b8ef-b395ee2a78db\") " pod="openshift-multus/multus-additional-cni-plugins-szpnb"
Jul 20 13:01:52.134071 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:51.985955    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/678728d9-5d5d-4550-b8e4-4d88906baa98-konnectivity-ca\") pod \"konnectivity-agent-ntcf5\" (UID: \"678728d9-5d5d-4550-b8e4-4d88906baa98\") " pod="kube-system/konnectivity-agent-ntcf5"
Jul 20 13:01:52.134071 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:51.986012    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/58994b72-6cbb-452f-a68e-62b088c3cfbf-registration-dir\") pod \"aws-ebs-csi-driver-node-46jkq\" (UID: \"58994b72-6cbb-452f-a68e-62b088c3cfbf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-46jkq"
Jul 20 13:01:52.134071 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:51.986099    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/58994b72-6cbb-452f-a68e-62b088c3cfbf-sys-fs\") pod \"aws-ebs-csi-driver-node-46jkq\" (UID: \"58994b72-6cbb-452f-a68e-62b088c3cfbf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-46jkq"
Jul 20 13:01:52.135194 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:51.986129    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/95e88ecd-0ff4-4a0b-b8ef-b395ee2a78db-system-cni-dir\") pod \"multus-additional-cni-plugins-szpnb\" (UID: \"95e88ecd-0ff4-4a0b-b8ef-b395ee2a78db\") " pod="openshift-multus/multus-additional-cni-plugins-szpnb"
Jul 20 13:01:52.135194 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:51.986149    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/58994b72-6cbb-452f-a68e-62b088c3cfbf-etc-selinux\") pod \"aws-ebs-csi-driver-node-46jkq\" (UID: \"58994b72-6cbb-452f-a68e-62b088c3cfbf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-46jkq"
Jul 20 13:01:52.135194 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:51.986283    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/95e88ecd-0ff4-4a0b-b8ef-b395ee2a78db-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-szpnb\" (UID: \"95e88ecd-0ff4-4a0b-b8ef-b395ee2a78db\") " pod="openshift-multus/multus-additional-cni-plugins-szpnb"
Jul 20 13:01:52.135194 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:51.986476    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/95e88ecd-0ff4-4a0b-b8ef-b395ee2a78db-cni-binary-copy\") pod \"multus-additional-cni-plugins-szpnb\" (UID: \"95e88ecd-0ff4-4a0b-b8ef-b395ee2a78db\") " pod="openshift-multus/multus-additional-cni-plugins-szpnb"
Jul 20 13:01:52.135194 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:51.988124    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/678728d9-5d5d-4550-b8e4-4d88906baa98-agent-certs\") pod \"konnectivity-agent-ntcf5\" (UID: \"678728d9-5d5d-4550-b8e4-4d88906baa98\") " pod="kube-system/konnectivity-agent-ntcf5"
Jul 20 13:01:52.135194 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:51.996597    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f4lbf\" (UniqueName: \"kubernetes.io/projected/95e88ecd-0ff4-4a0b-b8ef-b395ee2a78db-kube-api-access-f4lbf\") pod \"multus-additional-cni-plugins-szpnb\" (UID: \"95e88ecd-0ff4-4a0b-b8ef-b395ee2a78db\") " pod="openshift-multus/multus-additional-cni-plugins-szpnb"
Jul 20 13:01:52.135194 ip-10-0-134-121 kubenswrapper[2584]: E0720 13:01:51.998809    2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 20 13:01:52.135194 ip-10-0-134-121 kubenswrapper[2584]: E0720 13:01:51.998837    2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 20 13:01:52.135194 ip-10-0-134-121 kubenswrapper[2584]: E0720 13:01:51.998852    2584 projected.go:196] Error preparing data for projected volume kube-api-access-sgz85 for pod openshift-network-diagnostics/network-check-target-ck7q6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 20 13:01:52.135194 ip-10-0-134-121 kubenswrapper[2584]: E0720 13:01:51.998941    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6a903657-acf4-4846-a7bd-b45e286216c1-kube-api-access-sgz85 podName:6a903657-acf4-4846-a7bd-b45e286216c1 nodeName:}" failed. No retries permitted until 2026-07-20 13:01:52.498925105 +0000 UTC m=+2.215472500 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-sgz85" (UniqueName: "kubernetes.io/projected/6a903657-acf4-4846-a7bd-b45e286216c1-kube-api-access-sgz85") pod "network-check-target-ck7q6" (UID: "6a903657-acf4-4846-a7bd-b45e286216c1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 20 13:01:52.135194 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:52.000354    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rhmct\" (UniqueName: \"kubernetes.io/projected/84c98b82-b626-42a7-bce8-281d439e1772-kube-api-access-rhmct\") pod \"network-metrics-daemon-9zclf\" (UID: \"84c98b82-b626-42a7-bce8-281d439e1772\") " pod="openshift-multus/network-metrics-daemon-9zclf"
Jul 20 13:01:52.135194 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:52.001351    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lsp8d\" (UniqueName: \"kubernetes.io/projected/58994b72-6cbb-452f-a68e-62b088c3cfbf-kube-api-access-lsp8d\") pod \"aws-ebs-csi-driver-node-46jkq\" (UID: \"58994b72-6cbb-452f-a68e-62b088c3cfbf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-46jkq"
Jul 20 13:01:52.135194 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:52.031573    2584 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 20 13:01:52.135194 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:52.079079    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-szpnb"
Jul 20 13:01:52.135194 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:52.079509    2584 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 20 13:01:52.135194 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:52.103938    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-9l8sl"
Jul 20 13:01:52.135194 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:52.120391    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-bb5cg"
Jul 20 13:01:52.259253 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:52.138872    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-mltmb"
Jul 20 13:01:52.259253 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:52.157272    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-hgvl2"
Jul 20 13:01:52.259253 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:52.173192    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-hsm2t"
Jul 20 13:01:52.259253 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:52.182916    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-46jkq"
Jul 20 13:01:52.259253 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:52.225436    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-ntcf5"
Jul 20 13:01:52.259253 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:52.251418    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode39b9f23455a45c102012bdb6cd46aeb.slice/crio-6b107e5ea64e89739f25a28f3bb898e25b2b2f3ebdcce324feaacb40fb174471 WatchSource:0}: Error finding container 6b107e5ea64e89739f25a28f3bb898e25b2b2f3ebdcce324feaacb40fb174471: Status 404 returned error can't find the container with id 6b107e5ea64e89739f25a28f3bb898e25b2b2f3ebdcce324feaacb40fb174471
Jul 20 13:01:52.259253 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:52.251672    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod678728d9_5d5d_4550_b8e4_4d88906baa98.slice/crio-71fbbc93d745732c98d049b1d6027e50caf23ce0081a6d2a0681dd2e4729de00 WatchSource:0}: Error finding container 71fbbc93d745732c98d049b1d6027e50caf23ce0081a6d2a0681dd2e4729de00: Status 404 returned error can't find the container with id 71fbbc93d745732c98d049b1d6027e50caf23ce0081a6d2a0681dd2e4729de00
Jul 20 13:01:52.445624 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:52.269534    2584 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 20 13:01:52.445624 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:52.279877    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6cfba4c61799a6b7e50aa7b14dc6a91c.slice/crio-edab6c51d3593e2e9845dfd2b90a2b615d3dbac7e43154400ba8c7a8c887f695 WatchSource:0}: Error finding container edab6c51d3593e2e9845dfd2b90a2b615d3dbac7e43154400ba8c7a8c887f695: Status 404 returned error can't find the container with id edab6c51d3593e2e9845dfd2b90a2b615d3dbac7e43154400ba8c7a8c887f695
Jul 20 13:01:52.445624 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:52.364685    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1c610d05_f1c0_474a_a1b9_5ad71f8ba52e.slice/crio-9633bc1678e02141657b44bd7f02a28922a0c5b151976ff3b7e1df9aa74151f0 WatchSource:0}: Error finding container 9633bc1678e02141657b44bd7f02a28922a0c5b151976ff3b7e1df9aa74151f0: Status 404 returned error can't find the container with id 9633bc1678e02141657b44bd7f02a28922a0c5b151976ff3b7e1df9aa74151f0
Jul 20 13:01:52.445624 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:52.388563    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f8c70e98-14ec-48d9-8c30-2d63fa95c04e-original-pull-secret\") pod \"global-pull-secret-syncer-4wwrh\" (UID: \"f8c70e98-14ec-48d9-8c30-2d63fa95c04e\") " pod="kube-system/global-pull-secret-syncer-4wwrh"
Jul 20 13:01:52.445624 ip-10-0-134-121 kubenswrapper[2584]: E0720 13:01:52.388728    2584 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 20 13:01:52.445624 ip-10-0-134-121 kubenswrapper[2584]: E0720 13:01:52.388794    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f8c70e98-14ec-48d9-8c30-2d63fa95c04e-original-pull-secret podName:f8c70e98-14ec-48d9-8c30-2d63fa95c04e nodeName:}" failed. No retries permitted until 2026-07-20 13:01:53.388777432 +0000 UTC m=+3.105324822 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f8c70e98-14ec-48d9-8c30-2d63fa95c04e-original-pull-secret") pod "global-pull-secret-syncer-4wwrh" (UID: "f8c70e98-14ec-48d9-8c30-2d63fa95c04e") : object "kube-system"/"original-pull-secret" not registered
Jul 20 13:01:52.489871 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:52.489837    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/84c98b82-b626-42a7-bce8-281d439e1772-metrics-certs\") pod \"network-metrics-daemon-9zclf\" (UID: \"84c98b82-b626-42a7-bce8-281d439e1772\") " pod="openshift-multus/network-metrics-daemon-9zclf"
Jul 20 13:01:52.490031 ip-10-0-134-121 kubenswrapper[2584]: E0720 13:01:52.490004    2584 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 20 13:01:52.490124 ip-10-0-134-121 kubenswrapper[2584]: E0720 13:01:52.490071    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/84c98b82-b626-42a7-bce8-281d439e1772-metrics-certs podName:84c98b82-b626-42a7-bce8-281d439e1772 nodeName:}" failed. No retries permitted until 2026-07-20 13:01:53.490054952 +0000 UTC m=+3.206602343 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/84c98b82-b626-42a7-bce8-281d439e1772-metrics-certs") pod "network-metrics-daemon-9zclf" (UID: "84c98b82-b626-42a7-bce8-281d439e1772") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 20 13:01:52.499186 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:52.499157    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd5e256e3_6d71_4bc3_b539_c12fadc540ad.slice/crio-4647918c200f86134a3ce53102b5c9398f6aa47013891fa070e80049274748ff WatchSource:0}: Error finding container 4647918c200f86134a3ce53102b5c9398f6aa47013891fa070e80049274748ff: Status 404 returned error can't find the container with id 4647918c200f86134a3ce53102b5c9398f6aa47013891fa070e80049274748ff
Jul 20 13:01:52.573042 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:52.573010    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb5a49b2c_c21c_4600_adf6_dc15dda1ff06.slice/crio-457621911cc84897b8ee1ca15a4c5a1037652101ae980a9961978de61a32d00b WatchSource:0}: Error finding container 457621911cc84897b8ee1ca15a4c5a1037652101ae980a9961978de61a32d00b: Status 404 returned error can't find the container with id 457621911cc84897b8ee1ca15a4c5a1037652101ae980a9961978de61a32d00b
Jul 20 13:01:52.583022 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:52.582992    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod48cff737_3690_4df6_8e01_3b06c888f58f.slice/crio-a753070cae02aa8925a5d1057e22175cd2e30790518d46f772ce2dab06d73a8f WatchSource:0}: Error finding container a753070cae02aa8925a5d1057e22175cd2e30790518d46f772ce2dab06d73a8f: Status 404 returned error can't find the container with id a753070cae02aa8925a5d1057e22175cd2e30790518d46f772ce2dab06d73a8f
Jul 20 13:01:52.590307 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:52.590283    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sgz85\" (UniqueName: \"kubernetes.io/projected/6a903657-acf4-4846-a7bd-b45e286216c1-kube-api-access-sgz85\") pod \"network-check-target-ck7q6\" (UID: \"6a903657-acf4-4846-a7bd-b45e286216c1\") " pod="openshift-network-diagnostics/network-check-target-ck7q6"
Jul 20 13:01:52.590452 ip-10-0-134-121 kubenswrapper[2584]: E0720 13:01:52.590434    2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 20 13:01:52.590515 ip-10-0-134-121 kubenswrapper[2584]: E0720 13:01:52.590457    2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 20 13:01:52.590515 ip-10-0-134-121 kubenswrapper[2584]: E0720 13:01:52.590468    2584 projected.go:196] Error preparing data for projected volume kube-api-access-sgz85 for pod openshift-network-diagnostics/network-check-target-ck7q6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 20 13:01:52.590607 ip-10-0-134-121 kubenswrapper[2584]: E0720 13:01:52.590516    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6a903657-acf4-4846-a7bd-b45e286216c1-kube-api-access-sgz85 podName:6a903657-acf4-4846-a7bd-b45e286216c1 nodeName:}" failed. No retries permitted until 2026-07-20 13:01:53.590500866 +0000 UTC m=+3.307048256 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-sgz85" (UniqueName: "kubernetes.io/projected/6a903657-acf4-4846-a7bd-b45e286216c1-kube-api-access-sgz85") pod "network-check-target-ck7q6" (UID: "6a903657-acf4-4846-a7bd-b45e286216c1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 20 13:01:52.817662 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:52.817580    2584 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-19 12:56:52 +0000 UTC" deadline="2028-03-19 23:31:30.885920494 +0000 UTC"
Jul 20 13:01:52.817662 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:52.817663    2584 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14602h29m38.068269692s"
Jul 20 13:01:52.828603 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:52.828563    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod58994b72_6cbb_452f_a68e_62b088c3cfbf.slice/crio-16593407ebe0a95771d798948827213819dd2be07b45dff7579b83ee10f9db8a WatchSource:0}: Error finding container 16593407ebe0a95771d798948827213819dd2be07b45dff7579b83ee10f9db8a: Status 404 returned error can't find the container with id 16593407ebe0a95771d798948827213819dd2be07b45dff7579b83ee10f9db8a
Jul 20 13:01:52.872772 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:01:52.872737    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod548d5005_1a66_4385_9ebc_6844b175673d.slice/crio-6b93eace7838a5e093ba1a1535dee8175e9ee76f6fd700cf278c2940cc9381e6 WatchSource:0}: Error finding container 6b93eace7838a5e093ba1a1535dee8175e9ee76f6fd700cf278c2940cc9381e6: Status 404 returned error can't find the container with id 6b93eace7838a5e093ba1a1535dee8175e9ee76f6fd700cf278c2940cc9381e6
Jul 20 13:01:53.090930 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:53.090152    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9zclf"
Jul 20 13:01:53.090930 ip-10-0-134-121 kubenswrapper[2584]: E0720 13:01:53.090304    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9zclf" podUID="84c98b82-b626-42a7-bce8-281d439e1772"
Jul 20 13:01:53.090930 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:53.090722    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4wwrh"
Jul 20 13:01:53.090930 ip-10-0-134-121 kubenswrapper[2584]: E0720 13:01:53.090857    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4wwrh" podUID="f8c70e98-14ec-48d9-8c30-2d63fa95c04e"
Jul 20 13:01:53.098837 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:53.098779    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-9l8sl" event={"ID":"b5a49b2c-c21c-4600-adf6-dc15dda1ff06","Type":"ContainerStarted","Data":"457621911cc84897b8ee1ca15a4c5a1037652101ae980a9961978de61a32d00b"}
Jul 20 13:01:53.100683 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:53.100648    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-121.ec2.internal" event={"ID":"6cfba4c61799a6b7e50aa7b14dc6a91c","Type":"ContainerStarted","Data":"edab6c51d3593e2e9845dfd2b90a2b615d3dbac7e43154400ba8c7a8c887f695"}
Jul 20 13:01:53.102571 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:53.102506    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-ntcf5" event={"ID":"678728d9-5d5d-4550-b8e4-4d88906baa98","Type":"ContainerStarted","Data":"71fbbc93d745732c98d049b1d6027e50caf23ce0081a6d2a0681dd2e4729de00"}
Jul 20 13:01:53.104095 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:53.104068    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-121.ec2.internal" event={"ID":"e39b9f23455a45c102012bdb6cd46aeb","Type":"ContainerStarted","Data":"6b107e5ea64e89739f25a28f3bb898e25b2b2f3ebdcce324feaacb40fb174471"}
Jul 20 13:01:53.106480 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:53.106454    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-hgvl2" event={"ID":"548d5005-1a66-4385-9ebc-6844b175673d","Type":"ContainerStarted","Data":"6b93eace7838a5e093ba1a1535dee8175e9ee76f6fd700cf278c2940cc9381e6"}
Jul 20 13:01:53.108029 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:53.108004    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-bb5cg" event={"ID":"d5e256e3-6d71-4bc3-b539-c12fadc540ad","Type":"ContainerStarted","Data":"4647918c200f86134a3ce53102b5c9398f6aa47013891fa070e80049274748ff"}
Jul 20 13:01:53.109966 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:53.109941    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-tnlm9" event={"ID":"1c610d05-f1c0-474a-a1b9-5ad71f8ba52e","Type":"ContainerStarted","Data":"9633bc1678e02141657b44bd7f02a28922a0c5b151976ff3b7e1df9aa74151f0"}
Jul 20 13:01:53.114740 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:53.114708    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-46jkq" event={"ID":"58994b72-6cbb-452f-a68e-62b088c3cfbf","Type":"ContainerStarted","Data":"16593407ebe0a95771d798948827213819dd2be07b45dff7579b83ee10f9db8a"}
Jul 20 13:01:53.117918 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:53.117828    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-szpnb" event={"ID":"95e88ecd-0ff4-4a0b-b8ef-b395ee2a78db","Type":"ContainerStarted","Data":"abb900db28adb8ee0a3281f956d5a8e108632f793e95233f8715bc1e780f753d"}
Jul 20 13:01:53.119846 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:53.119819    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-hsm2t" event={"ID":"48cff737-3690-4df6-8e01-3b06c888f58f","Type":"ContainerStarted","Data":"a753070cae02aa8925a5d1057e22175cd2e30790518d46f772ce2dab06d73a8f"}
Jul 20 13:01:53.200293 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:53.200259    2584 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 20 13:01:53.397345 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:53.397255    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f8c70e98-14ec-48d9-8c30-2d63fa95c04e-original-pull-secret\") pod \"global-pull-secret-syncer-4wwrh\" (UID: \"f8c70e98-14ec-48d9-8c30-2d63fa95c04e\") " pod="kube-system/global-pull-secret-syncer-4wwrh"
Jul 20 13:01:53.397508 ip-10-0-134-121 kubenswrapper[2584]: E0720 13:01:53.397424    2584 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 20 13:01:53.397508 ip-10-0-134-121 kubenswrapper[2584]: E0720 13:01:53.397489    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f8c70e98-14ec-48d9-8c30-2d63fa95c04e-original-pull-secret podName:f8c70e98-14ec-48d9-8c30-2d63fa95c04e nodeName:}" failed. No retries permitted until 2026-07-20 13:01:55.397467209 +0000 UTC m=+5.114014603 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f8c70e98-14ec-48d9-8c30-2d63fa95c04e-original-pull-secret") pod "global-pull-secret-syncer-4wwrh" (UID: "f8c70e98-14ec-48d9-8c30-2d63fa95c04e") : object "kube-system"/"original-pull-secret" not registered
Jul 20 13:01:53.497746 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:53.497708    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/84c98b82-b626-42a7-bce8-281d439e1772-metrics-certs\") pod \"network-metrics-daemon-9zclf\" (UID: \"84c98b82-b626-42a7-bce8-281d439e1772\") " pod="openshift-multus/network-metrics-daemon-9zclf"
Jul 20 13:01:53.497961 ip-10-0-134-121 kubenswrapper[2584]: E0720 13:01:53.497927    2584 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 20 13:01:53.498027 ip-10-0-134-121 kubenswrapper[2584]: E0720 13:01:53.497995    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/84c98b82-b626-42a7-bce8-281d439e1772-metrics-certs podName:84c98b82-b626-42a7-bce8-281d439e1772 nodeName:}" failed. No retries permitted until 2026-07-20 13:01:55.497974605 +0000 UTC m=+5.214522011 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/84c98b82-b626-42a7-bce8-281d439e1772-metrics-certs") pod "network-metrics-daemon-9zclf" (UID: "84c98b82-b626-42a7-bce8-281d439e1772") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 20 13:01:53.598775 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:53.598732    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sgz85\" (UniqueName: \"kubernetes.io/projected/6a903657-acf4-4846-a7bd-b45e286216c1-kube-api-access-sgz85\") pod \"network-check-target-ck7q6\" (UID: \"6a903657-acf4-4846-a7bd-b45e286216c1\") " pod="openshift-network-diagnostics/network-check-target-ck7q6"
Jul 20 13:01:53.598987 ip-10-0-134-121 kubenswrapper[2584]: E0720 13:01:53.598973    2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 20 13:01:53.599079 ip-10-0-134-121 kubenswrapper[2584]: E0720 13:01:53.598999    2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 20 13:01:53.599079 ip-10-0-134-121 kubenswrapper[2584]: E0720 13:01:53.599028    2584 projected.go:196] Error preparing data for projected volume kube-api-access-sgz85 for pod openshift-network-diagnostics/network-check-target-ck7q6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 20 13:01:53.599194 ip-10-0-134-121 kubenswrapper[2584]: E0720 13:01:53.599096    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6a903657-acf4-4846-a7bd-b45e286216c1-kube-api-access-sgz85 podName:6a903657-acf4-4846-a7bd-b45e286216c1 nodeName:}" failed. No retries permitted until 2026-07-20 13:01:55.599072923 +0000 UTC m=+5.315620332 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-sgz85" (UniqueName: "kubernetes.io/projected/6a903657-acf4-4846-a7bd-b45e286216c1-kube-api-access-sgz85") pod "network-check-target-ck7q6" (UID: "6a903657-acf4-4846-a7bd-b45e286216c1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 20 13:01:53.818366 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:53.818296    2584 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-19 12:56:52 +0000 UTC" deadline="2028-03-30 03:27:58.064520284 +0000 UTC"
Jul 20 13:01:53.818366 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:53.818363    2584 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14846h26m4.246162213s"
Jul 20 13:01:54.090112 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:54.090007    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ck7q6"
Jul 20 13:01:54.090303 ip-10-0-134-121 kubenswrapper[2584]: E0720 13:01:54.090166    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ck7q6" podUID="6a903657-acf4-4846-a7bd-b45e286216c1"
Jul 20 13:01:54.412612 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:54.412527    2584 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 20 13:01:55.089628 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:55.089587    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4wwrh"
Jul 20 13:01:55.090288 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:55.089587    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9zclf"
Jul 20 13:01:55.090288 ip-10-0-134-121 kubenswrapper[2584]: E0720 13:01:55.089741    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4wwrh" podUID="f8c70e98-14ec-48d9-8c30-2d63fa95c04e"
Jul 20 13:01:55.090288 ip-10-0-134-121 kubenswrapper[2584]: E0720 13:01:55.089814    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9zclf" podUID="84c98b82-b626-42a7-bce8-281d439e1772"
Jul 20 13:01:55.417749 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:55.417657    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f8c70e98-14ec-48d9-8c30-2d63fa95c04e-original-pull-secret\") pod \"global-pull-secret-syncer-4wwrh\" (UID: \"f8c70e98-14ec-48d9-8c30-2d63fa95c04e\") " pod="kube-system/global-pull-secret-syncer-4wwrh"
Jul 20 13:01:55.417968 ip-10-0-134-121 kubenswrapper[2584]: E0720 13:01:55.417845    2584 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 20 13:01:55.417968 ip-10-0-134-121 kubenswrapper[2584]: E0720 13:01:55.417927    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f8c70e98-14ec-48d9-8c30-2d63fa95c04e-original-pull-secret podName:f8c70e98-14ec-48d9-8c30-2d63fa95c04e nodeName:}" failed. No retries permitted until 2026-07-20 13:01:59.417905336 +0000 UTC m=+9.134452736 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f8c70e98-14ec-48d9-8c30-2d63fa95c04e-original-pull-secret") pod "global-pull-secret-syncer-4wwrh" (UID: "f8c70e98-14ec-48d9-8c30-2d63fa95c04e") : object "kube-system"/"original-pull-secret" not registered
Jul 20 13:01:55.518850 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:55.518805    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/84c98b82-b626-42a7-bce8-281d439e1772-metrics-certs\") pod \"network-metrics-daemon-9zclf\" (UID: \"84c98b82-b626-42a7-bce8-281d439e1772\") " pod="openshift-multus/network-metrics-daemon-9zclf"
Jul 20 13:01:55.519081 ip-10-0-134-121 kubenswrapper[2584]: E0720 13:01:55.519025    2584 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 20 13:01:55.519155 ip-10-0-134-121 kubenswrapper[2584]: E0720 13:01:55.519117    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/84c98b82-b626-42a7-bce8-281d439e1772-metrics-certs podName:84c98b82-b626-42a7-bce8-281d439e1772 nodeName:}" failed. No retries permitted until 2026-07-20 13:01:59.519089893 +0000 UTC m=+9.235637285 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/84c98b82-b626-42a7-bce8-281d439e1772-metrics-certs") pod "network-metrics-daemon-9zclf" (UID: "84c98b82-b626-42a7-bce8-281d439e1772") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 20 13:01:55.619642 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:55.619594    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sgz85\" (UniqueName: \"kubernetes.io/projected/6a903657-acf4-4846-a7bd-b45e286216c1-kube-api-access-sgz85\") pod \"network-check-target-ck7q6\" (UID: \"6a903657-acf4-4846-a7bd-b45e286216c1\") " pod="openshift-network-diagnostics/network-check-target-ck7q6"
Jul 20 13:01:55.619855 ip-10-0-134-121 kubenswrapper[2584]: E0720 13:01:55.619767    2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 20 13:01:55.619855 ip-10-0-134-121 kubenswrapper[2584]: E0720 13:01:55.619794    2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 20 13:01:55.619855 ip-10-0-134-121 kubenswrapper[2584]: E0720 13:01:55.619809    2584 projected.go:196] Error preparing data for projected volume kube-api-access-sgz85 for pod openshift-network-diagnostics/network-check-target-ck7q6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 20 13:01:55.620049 ip-10-0-134-121 kubenswrapper[2584]: E0720 13:01:55.619884    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6a903657-acf4-4846-a7bd-b45e286216c1-kube-api-access-sgz85 podName:6a903657-acf4-4846-a7bd-b45e286216c1 nodeName:}" failed. No retries permitted until 2026-07-20 13:01:59.619860877 +0000 UTC m=+9.336408290 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-sgz85" (UniqueName: "kubernetes.io/projected/6a903657-acf4-4846-a7bd-b45e286216c1-kube-api-access-sgz85") pod "network-check-target-ck7q6" (UID: "6a903657-acf4-4846-a7bd-b45e286216c1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 20 13:01:56.089857 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:56.089821    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ck7q6"
Jul 20 13:01:56.090339 ip-10-0-134-121 kubenswrapper[2584]: E0720 13:01:56.089980    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ck7q6" podUID="6a903657-acf4-4846-a7bd-b45e286216c1"
Jul 20 13:01:57.089430 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:57.089400    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4wwrh"
Jul 20 13:01:57.089430 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:57.089417    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9zclf"
Jul 20 13:01:57.089696 ip-10-0-134-121 kubenswrapper[2584]: E0720 13:01:57.089540    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4wwrh" podUID="f8c70e98-14ec-48d9-8c30-2d63fa95c04e"
Jul 20 13:01:57.089761 ip-10-0-134-121 kubenswrapper[2584]: E0720 13:01:57.089707    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9zclf" podUID="84c98b82-b626-42a7-bce8-281d439e1772"
Jul 20 13:01:58.089646 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:58.089602    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ck7q6"
Jul 20 13:01:58.090218 ip-10-0-134-121 kubenswrapper[2584]: E0720 13:01:58.089843    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ck7q6" podUID="6a903657-acf4-4846-a7bd-b45e286216c1"
Jul 20 13:01:59.089008 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:59.088960    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4wwrh"
Jul 20 13:01:59.089178 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:59.088977    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9zclf"
Jul 20 13:01:59.089178 ip-10-0-134-121 kubenswrapper[2584]: E0720 13:01:59.089117    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4wwrh" podUID="f8c70e98-14ec-48d9-8c30-2d63fa95c04e"
Jul 20 13:01:59.089352 ip-10-0-134-121 kubenswrapper[2584]: E0720 13:01:59.089210    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9zclf" podUID="84c98b82-b626-42a7-bce8-281d439e1772"
Jul 20 13:01:59.454799 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:59.454753    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f8c70e98-14ec-48d9-8c30-2d63fa95c04e-original-pull-secret\") pod \"global-pull-secret-syncer-4wwrh\" (UID: \"f8c70e98-14ec-48d9-8c30-2d63fa95c04e\") " pod="kube-system/global-pull-secret-syncer-4wwrh"
Jul 20 13:01:59.455491 ip-10-0-134-121 kubenswrapper[2584]: E0720 13:01:59.454912    2584 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 20 13:01:59.455491 ip-10-0-134-121 kubenswrapper[2584]: E0720 13:01:59.455007    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f8c70e98-14ec-48d9-8c30-2d63fa95c04e-original-pull-secret podName:f8c70e98-14ec-48d9-8c30-2d63fa95c04e nodeName:}" failed. No retries permitted until 2026-07-20 13:02:07.454983596 +0000 UTC m=+17.171530999 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f8c70e98-14ec-48d9-8c30-2d63fa95c04e-original-pull-secret") pod "global-pull-secret-syncer-4wwrh" (UID: "f8c70e98-14ec-48d9-8c30-2d63fa95c04e") : object "kube-system"/"original-pull-secret" not registered
Jul 20 13:01:59.555578 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:59.555534    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/84c98b82-b626-42a7-bce8-281d439e1772-metrics-certs\") pod \"network-metrics-daemon-9zclf\" (UID: \"84c98b82-b626-42a7-bce8-281d439e1772\") " pod="openshift-multus/network-metrics-daemon-9zclf"
Jul 20 13:01:59.555782 ip-10-0-134-121 kubenswrapper[2584]: E0720 13:01:59.555723    2584 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 20 13:01:59.555850 ip-10-0-134-121 kubenswrapper[2584]: E0720 13:01:59.555806    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/84c98b82-b626-42a7-bce8-281d439e1772-metrics-certs podName:84c98b82-b626-42a7-bce8-281d439e1772 nodeName:}" failed. No retries permitted until 2026-07-20 13:02:07.555784789 +0000 UTC m=+17.272332273 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/84c98b82-b626-42a7-bce8-281d439e1772-metrics-certs") pod "network-metrics-daemon-9zclf" (UID: "84c98b82-b626-42a7-bce8-281d439e1772") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 20 13:01:59.656813 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:01:59.656568    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sgz85\" (UniqueName: \"kubernetes.io/projected/6a903657-acf4-4846-a7bd-b45e286216c1-kube-api-access-sgz85\") pod \"network-check-target-ck7q6\" (UID: \"6a903657-acf4-4846-a7bd-b45e286216c1\") " pod="openshift-network-diagnostics/network-check-target-ck7q6"
Jul 20 13:01:59.656813 ip-10-0-134-121 kubenswrapper[2584]: E0720 13:01:59.656739    2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 20 13:01:59.656813 ip-10-0-134-121 kubenswrapper[2584]: E0720 13:01:59.656760    2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 20 13:01:59.656813 ip-10-0-134-121 kubenswrapper[2584]: E0720 13:01:59.656772    2584 projected.go:196] Error preparing data for projected volume kube-api-access-sgz85 for pod openshift-network-diagnostics/network-check-target-ck7q6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 20 13:01:59.657148 ip-10-0-134-121 kubenswrapper[2584]: E0720 13:01:59.656836    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6a903657-acf4-4846-a7bd-b45e286216c1-kube-api-access-sgz85 podName:6a903657-acf4-4846-a7bd-b45e286216c1 nodeName:}" failed. No retries permitted until 2026-07-20 13:02:07.656816431 +0000 UTC m=+17.373363821 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-sgz85" (UniqueName: "kubernetes.io/projected/6a903657-acf4-4846-a7bd-b45e286216c1-kube-api-access-sgz85") pod "network-check-target-ck7q6" (UID: "6a903657-acf4-4846-a7bd-b45e286216c1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 20 13:02:00.090537 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:00.090502    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ck7q6"
Jul 20 13:02:00.090724 ip-10-0-134-121 kubenswrapper[2584]: E0720 13:02:00.090608    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ck7q6" podUID="6a903657-acf4-4846-a7bd-b45e286216c1"
Jul 20 13:02:00.140560 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:00.140448    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mltmb" event={"ID":"dc1eda22-b2e1-4381-b12f-3af236b2de4e","Type":"ContainerStarted","Data":"46e96e12b0bc208c3d96dab9e9ebf29ffd18c89f3f4c5fbafe9319f3f4407a4b"}
Jul 20 13:02:00.148199 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:00.148162    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-46jkq" event={"ID":"58994b72-6cbb-452f-a68e-62b088c3cfbf","Type":"ContainerStarted","Data":"681600340c332e78761bce13708e6d22b71ab1eec83c6c03bf6d11feab9250c0"}
Jul 20 13:02:00.154804 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:00.154769    2584 generic.go:356] "Generic (PLEG): container finished" podID="95e88ecd-0ff4-4a0b-b8ef-b395ee2a78db" containerID="af7e50ab664d95ccdcc65bb61e0bf675de94125d04906eb3adf87d1a47410b5f" exitCode=0
Jul 20 13:02:00.154955 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:00.154866    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-szpnb" event={"ID":"95e88ecd-0ff4-4a0b-b8ef-b395ee2a78db","Type":"ContainerDied","Data":"af7e50ab664d95ccdcc65bb61e0bf675de94125d04906eb3adf87d1a47410b5f"}
Jul 20 13:02:00.161766 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:00.161737    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-hsm2t" event={"ID":"48cff737-3690-4df6-8e01-3b06c888f58f","Type":"ContainerStarted","Data":"fe2adfca390617094d03d1978d38ec2b892a58b0ba718b56c8f4449700b5c5db"}
Jul 20 13:02:00.168706 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:00.168676    2584 generic.go:356] "Generic (PLEG): container finished" podID="6cfba4c61799a6b7e50aa7b14dc6a91c" containerID="9c0e885b18c1ac192c1d5fb8f62dfd9407d3f35d75c39d9a983744ed32cdfd14" exitCode=0
Jul 20 13:02:00.168801 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:00.168762    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-121.ec2.internal" event={"ID":"6cfba4c61799a6b7e50aa7b14dc6a91c","Type":"ContainerDied","Data":"9c0e885b18c1ac192c1d5fb8f62dfd9407d3f35d75c39d9a983744ed32cdfd14"}
Jul 20 13:02:00.173578 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:00.172957    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-ntcf5" event={"ID":"678728d9-5d5d-4550-b8e4-4d88906baa98","Type":"ContainerStarted","Data":"a37deb372928cef75b85969fe33850e73dd90303b74d43a4d37664ee7f770884"}
Jul 20 13:02:00.176596 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:00.176574    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-121.ec2.internal" event={"ID":"e39b9f23455a45c102012bdb6cd46aeb","Type":"ContainerStarted","Data":"0c2f92044b9fa68690b11a7a9747e9770f0f76dd2b0ae9f435bbb745efacbe0f"}
Jul 20 13:02:00.186525 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:00.184841    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-hgvl2" event={"ID":"548d5005-1a66-4385-9ebc-6844b175673d","Type":"ContainerStarted","Data":"f553a712f582e708b9170ece305ba39b3bfa8a2a72c4d19160f5ac0f5a47774a"}
Jul 20 13:02:00.215036 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:00.214905    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-ntcf5" podStartSLOduration=2.8356250259999998 podStartE2EDuration="9.21488487s" totalImagesPullingTime="6.379259844s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 13:01:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 13:02:00.200385155 +0000 UTC m=+9.916932566" watchObservedRunningTime="2026-07-20 13:02:00.21488487 +0000 UTC m=+9.931432282"
Jul 20 13:02:00.229520 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:00.229465    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-hsm2t" podStartSLOduration=3.165423424 podStartE2EDuration="9.229450427s" totalImagesPullingTime="6.064027003s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 13:01:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 13:02:00.229159426 +0000 UTC m=+9.945706837" watchObservedRunningTime="2026-07-20 13:02:00.229450427 +0000 UTC m=+9.945997839"
Jul 20 13:02:00.243803 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:00.243742    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-121.ec2.internal" podStartSLOduration=8.243721339 podStartE2EDuration="8.243721339s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 13:01:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 13:02:00.243629668 +0000 UTC m=+9.960177083" watchObservedRunningTime="2026-07-20 13:02:00.243721339 +0000 UTC m=+9.960268752"
Jul 20 13:02:01.089932 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:01.089895    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4wwrh"
Jul 20 13:02:01.090431 ip-10-0-134-121 kubenswrapper[2584]: E0720 13:02:01.090032    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4wwrh" podUID="f8c70e98-14ec-48d9-8c30-2d63fa95c04e"
Jul 20 13:02:01.090554 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:01.090529    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9zclf"
Jul 20 13:02:01.090683 ip-10-0-134-121 kubenswrapper[2584]: E0720 13:02:01.090657    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9zclf" podUID="84c98b82-b626-42a7-bce8-281d439e1772"
Jul 20 13:02:01.119592 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:01.119509    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-ntcf5"
Jul 20 13:02:01.120472 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:01.120447    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-ntcf5"
Jul 20 13:02:01.141462 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:01.140650    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-hgvl2" podStartSLOduration=4.358773574 podStartE2EDuration="10.140627493s" totalImagesPullingTime="5.781853919s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 13:01:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 13:02:00.261252341 +0000 UTC m=+9.977799752" watchObservedRunningTime="2026-07-20 13:02:01.140627493 +0000 UTC m=+10.857174907"
Jul 20 13:02:01.189999 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:01.189836    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-121.ec2.internal" event={"ID":"6cfba4c61799a6b7e50aa7b14dc6a91c","Type":"ContainerStarted","Data":"e4a6406f664a731c67751c6d31c0de688c16c93a40fd88e0901187984350820c"}
Jul 20 13:02:01.192533 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:01.192495    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-bb5cg" event={"ID":"d5e256e3-6d71-4bc3-b539-c12fadc540ad","Type":"ContainerStarted","Data":"8bd370c1c6207bc72135aeaae5e1025612a89d4a91d466ef175c565e68258d48"}
Jul 20 13:02:01.225423 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:01.225363    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-121.ec2.internal" podStartSLOduration=9.225341987 podStartE2EDuration="9.225341987s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 13:01:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 13:02:01.205008324 +0000 UTC m=+10.921555741" watchObservedRunningTime="2026-07-20 13:02:01.225341987 +0000 UTC m=+10.941889395"
Jul 20 13:02:02.089704 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:02.089673    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ck7q6"
Jul 20 13:02:02.089892 ip-10-0-134-121 kubenswrapper[2584]: E0720 13:02:02.089796    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ck7q6" podUID="6a903657-acf4-4846-a7bd-b45e286216c1"
Jul 20 13:02:02.196631 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:02.195823    2584 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jul 20 13:02:03.089777 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:03.089677    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4wwrh"
Jul 20 13:02:03.089777 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:03.089726    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9zclf"
Jul 20 13:02:03.090054 ip-10-0-134-121 kubenswrapper[2584]: E0720 13:02:03.089819    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4wwrh" podUID="f8c70e98-14ec-48d9-8c30-2d63fa95c04e"
Jul 20 13:02:03.090054 ip-10-0-134-121 kubenswrapper[2584]: E0720 13:02:03.089943    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9zclf" podUID="84c98b82-b626-42a7-bce8-281d439e1772"
Jul 20 13:02:04.089178 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:04.089144    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ck7q6"
Jul 20 13:02:04.089601 ip-10-0-134-121 kubenswrapper[2584]: E0720 13:02:04.089261    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ck7q6" podUID="6a903657-acf4-4846-a7bd-b45e286216c1"
Jul 20 13:02:05.089398 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:05.089176    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4wwrh"
Jul 20 13:02:05.089898 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:05.089295    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9zclf"
Jul 20 13:02:05.089898 ip-10-0-134-121 kubenswrapper[2584]: E0720 13:02:05.089513    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4wwrh" podUID="f8c70e98-14ec-48d9-8c30-2d63fa95c04e"
Jul 20 13:02:05.089898 ip-10-0-134-121 kubenswrapper[2584]: E0720 13:02:05.089615    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9zclf" podUID="84c98b82-b626-42a7-bce8-281d439e1772"
Jul 20 13:02:06.089869 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:06.089830    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ck7q6"
Jul 20 13:02:06.090328 ip-10-0-134-121 kubenswrapper[2584]: E0720 13:02:06.090023    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ck7q6" podUID="6a903657-acf4-4846-a7bd-b45e286216c1"
Jul 20 13:02:07.089076 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:07.089041    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4wwrh"
Jul 20 13:02:07.089279 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:07.089054    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9zclf"
Jul 20 13:02:07.089279 ip-10-0-134-121 kubenswrapper[2584]: E0720 13:02:07.089177    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4wwrh" podUID="f8c70e98-14ec-48d9-8c30-2d63fa95c04e"
Jul 20 13:02:07.089279 ip-10-0-134-121 kubenswrapper[2584]: E0720 13:02:07.089247    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9zclf" podUID="84c98b82-b626-42a7-bce8-281d439e1772"
Jul 20 13:02:07.519721 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:07.519685    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f8c70e98-14ec-48d9-8c30-2d63fa95c04e-original-pull-secret\") pod \"global-pull-secret-syncer-4wwrh\" (UID: \"f8c70e98-14ec-48d9-8c30-2d63fa95c04e\") " pod="kube-system/global-pull-secret-syncer-4wwrh"
Jul 20 13:02:07.520152 ip-10-0-134-121 kubenswrapper[2584]: E0720 13:02:07.519851    2584 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 20 13:02:07.520152 ip-10-0-134-121 kubenswrapper[2584]: E0720 13:02:07.519934    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f8c70e98-14ec-48d9-8c30-2d63fa95c04e-original-pull-secret podName:f8c70e98-14ec-48d9-8c30-2d63fa95c04e nodeName:}" failed. No retries permitted until 2026-07-20 13:02:23.519912737 +0000 UTC m=+33.236460132 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f8c70e98-14ec-48d9-8c30-2d63fa95c04e-original-pull-secret") pod "global-pull-secret-syncer-4wwrh" (UID: "f8c70e98-14ec-48d9-8c30-2d63fa95c04e") : object "kube-system"/"original-pull-secret" not registered
Jul 20 13:02:07.620577 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:07.620540    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/84c98b82-b626-42a7-bce8-281d439e1772-metrics-certs\") pod \"network-metrics-daemon-9zclf\" (UID: \"84c98b82-b626-42a7-bce8-281d439e1772\") " pod="openshift-multus/network-metrics-daemon-9zclf"
Jul 20 13:02:07.620741 ip-10-0-134-121 kubenswrapper[2584]: E0720 13:02:07.620684    2584 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 20 13:02:07.620792 ip-10-0-134-121 kubenswrapper[2584]: E0720 13:02:07.620746    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/84c98b82-b626-42a7-bce8-281d439e1772-metrics-certs podName:84c98b82-b626-42a7-bce8-281d439e1772 nodeName:}" failed. No retries permitted until 2026-07-20 13:02:23.620726989 +0000 UTC m=+33.337274378 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/84c98b82-b626-42a7-bce8-281d439e1772-metrics-certs") pod "network-metrics-daemon-9zclf" (UID: "84c98b82-b626-42a7-bce8-281d439e1772") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 20 13:02:07.721033 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:07.721001    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sgz85\" (UniqueName: \"kubernetes.io/projected/6a903657-acf4-4846-a7bd-b45e286216c1-kube-api-access-sgz85\") pod \"network-check-target-ck7q6\" (UID: \"6a903657-acf4-4846-a7bd-b45e286216c1\") " pod="openshift-network-diagnostics/network-check-target-ck7q6"
Jul 20 13:02:07.721218 ip-10-0-134-121 kubenswrapper[2584]: E0720 13:02:07.721156    2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 20 13:02:07.721218 ip-10-0-134-121 kubenswrapper[2584]: E0720 13:02:07.721172    2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 20 13:02:07.721218 ip-10-0-134-121 kubenswrapper[2584]: E0720 13:02:07.721181    2584 projected.go:196] Error preparing data for projected volume kube-api-access-sgz85 for pod openshift-network-diagnostics/network-check-target-ck7q6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 20 13:02:07.721360 ip-10-0-134-121 kubenswrapper[2584]: E0720 13:02:07.721230    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6a903657-acf4-4846-a7bd-b45e286216c1-kube-api-access-sgz85 podName:6a903657-acf4-4846-a7bd-b45e286216c1 nodeName:}" failed. No retries permitted until 2026-07-20 13:02:23.721217479 +0000 UTC m=+33.437764868 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-sgz85" (UniqueName: "kubernetes.io/projected/6a903657-acf4-4846-a7bd-b45e286216c1-kube-api-access-sgz85") pod "network-check-target-ck7q6" (UID: "6a903657-acf4-4846-a7bd-b45e286216c1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 20 13:02:08.088898 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:08.088870    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ck7q6"
Jul 20 13:02:08.089102 ip-10-0-134-121 kubenswrapper[2584]: E0720 13:02:08.089010    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ck7q6" podUID="6a903657-acf4-4846-a7bd-b45e286216c1"
Jul 20 13:02:09.089534 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:09.089496    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4wwrh"
Jul 20 13:02:09.090025 ip-10-0-134-121 kubenswrapper[2584]: E0720 13:02:09.089619    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4wwrh" podUID="f8c70e98-14ec-48d9-8c30-2d63fa95c04e"
Jul 20 13:02:09.090025 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:09.089688    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9zclf"
Jul 20 13:02:09.090025 ip-10-0-134-121 kubenswrapper[2584]: E0720 13:02:09.089811    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9zclf" podUID="84c98b82-b626-42a7-bce8-281d439e1772"
Jul 20 13:02:10.088938 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:10.088894    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ck7q6"
Jul 20 13:02:10.089185 ip-10-0-134-121 kubenswrapper[2584]: E0720 13:02:10.089058    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ck7q6" podUID="6a903657-acf4-4846-a7bd-b45e286216c1"
Jul 20 13:02:11.092003 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:11.091497    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9zclf"
Jul 20 13:02:11.092003 ip-10-0-134-121 kubenswrapper[2584]: E0720 13:02:11.091684    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9zclf" podUID="84c98b82-b626-42a7-bce8-281d439e1772"
Jul 20 13:02:11.092500 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:11.092156    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4wwrh"
Jul 20 13:02:11.092500 ip-10-0-134-121 kubenswrapper[2584]: E0720 13:02:11.092288    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4wwrh" podUID="f8c70e98-14ec-48d9-8c30-2d63fa95c04e"
Jul 20 13:02:12.089580 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:12.089545    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ck7q6"
Jul 20 13:02:12.089747 ip-10-0-134-121 kubenswrapper[2584]: E0720 13:02:12.089663    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ck7q6" podUID="6a903657-acf4-4846-a7bd-b45e286216c1"
Jul 20 13:02:13.089642 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:13.089607    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9zclf"
Jul 20 13:02:13.090177 ip-10-0-134-121 kubenswrapper[2584]: E0720 13:02:13.089767    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9zclf" podUID="84c98b82-b626-42a7-bce8-281d439e1772"
Jul 20 13:02:13.090177 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:13.089820    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4wwrh"
Jul 20 13:02:13.090177 ip-10-0-134-121 kubenswrapper[2584]: E0720 13:02:13.089909    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4wwrh" podUID="f8c70e98-14ec-48d9-8c30-2d63fa95c04e"
Jul 20 13:02:14.089423 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:14.089385    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ck7q6"
Jul 20 13:02:14.089790 ip-10-0-134-121 kubenswrapper[2584]: E0720 13:02:14.089538    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ck7q6" podUID="6a903657-acf4-4846-a7bd-b45e286216c1"
Jul 20 13:02:14.794669 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:14.794626    2584 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 20 13:02:14.893080 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:14.892989    2584 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-20T13:02:14.79465331Z","UUID":"ce13270c-a89b-405d-bd29-6ee751c7d4c0","Handler":null,"Name":"","Endpoint":""}
Jul 20 13:02:14.897161 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:14.897137    2584 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 20 13:02:14.897280 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:14.897179    2584 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 20 13:02:15.089214 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:15.089190    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4wwrh"
Jul 20 13:02:15.089317 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:15.089194    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9zclf"
Jul 20 13:02:15.089358 ip-10-0-134-121 kubenswrapper[2584]: E0720 13:02:15.089310    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4wwrh" podUID="f8c70e98-14ec-48d9-8c30-2d63fa95c04e"
Jul 20 13:02:15.089406 ip-10-0-134-121 kubenswrapper[2584]: E0720 13:02:15.089367    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9zclf" podUID="84c98b82-b626-42a7-bce8-281d439e1772"
Jul 20 13:02:15.225371 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:15.225338    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-9l8sl" event={"ID":"b5a49b2c-c21c-4600-adf6-dc15dda1ff06","Type":"ContainerStarted","Data":"70802d9b263447d80a83c2c4e005e51ec05aef94748d76d87b75b8968a8a29c6"}
Jul 20 13:02:15.226793 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:15.226767    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-tnlm9" event={"ID":"1c610d05-f1c0-474a-a1b9-5ad71f8ba52e","Type":"ContainerStarted","Data":"75d445b32d82bbec92c0e1e89af7acf368ed4375e1bc442a8487a06d532cfe19"}
Jul 20 13:02:15.229610 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:15.229588    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mltmb" event={"ID":"dc1eda22-b2e1-4381-b12f-3af236b2de4e","Type":"ContainerStarted","Data":"06d85c538918d5261df0d7ff30b46104c91b78bb76cd5077db62f008fbb66ff5"}
Jul 20 13:02:15.229722 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:15.229667    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mltmb" event={"ID":"dc1eda22-b2e1-4381-b12f-3af236b2de4e","Type":"ContainerStarted","Data":"f1336310bc322aef1124fcc28456f70b98316d869371a8b7801a763e7472a503"}
Jul 20 13:02:15.229722 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:15.229710    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mltmb" event={"ID":"dc1eda22-b2e1-4381-b12f-3af236b2de4e","Type":"ContainerStarted","Data":"12586146273faf19bf1f21e44e53ffce885ef40c9546e3926552de581ff80666"}
Jul 20 13:02:15.229821 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:15.229747    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mltmb" event={"ID":"dc1eda22-b2e1-4381-b12f-3af236b2de4e","Type":"ContainerStarted","Data":"b3ad94cda4ec04a966f00056458927846cfac739129199e155e4df5a040d79ba"}
Jul 20 13:02:15.229821 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:15.229795    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mltmb" event={"ID":"dc1eda22-b2e1-4381-b12f-3af236b2de4e","Type":"ContainerStarted","Data":"d74883a4c067842fd4253a1d2f135937832fbd0b16d3bfef4dee2a2d7521ecb4"}
Jul 20 13:02:15.231244 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:15.231225    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-46jkq" event={"ID":"58994b72-6cbb-452f-a68e-62b088c3cfbf","Type":"ContainerStarted","Data":"9e2e5e0edc5b916b1322848354357da6bedafd207732b58487fcfe2d2e0fe32c"}
Jul 20 13:02:15.232885 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:15.232859    2584 generic.go:356] "Generic (PLEG): container finished" podID="95e88ecd-0ff4-4a0b-b8ef-b395ee2a78db" containerID="987ec4a2fc644c8ff2f4ccbd3f7417a7e9c0c879f1949caf60228cea1ce3fa9a" exitCode=0
Jul 20 13:02:15.232990 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:15.232897    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-szpnb" event={"ID":"95e88ecd-0ff4-4a0b-b8ef-b395ee2a78db","Type":"ContainerDied","Data":"987ec4a2fc644c8ff2f4ccbd3f7417a7e9c0c879f1949caf60228cea1ce3fa9a"}
Jul 20 13:02:15.244151 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:15.244109    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-9l8sl" podStartSLOduration=2.159298363 podStartE2EDuration="24.244097219s" totalImagesPullingTime="22.084798856s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 13:01:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 13:02:15.243640252 +0000 UTC m=+24.960187662" watchObservedRunningTime="2026-07-20 13:02:15.244097219 +0000 UTC m=+24.960644631"
Jul 20 13:02:15.244252 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:15.244235    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-bb5cg" podStartSLOduration=17.584772438999998 podStartE2EDuration="24.244229145s" totalImagesPullingTime="6.659456706s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 13:01:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 13:02:01.226502326 +0000 UTC m=+10.943049736" watchObservedRunningTime="2026-07-20 13:02:15.244229145 +0000 UTC m=+24.960776556"
Jul 20 13:02:16.089952 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:16.089764    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ck7q6"
Jul 20 13:02:16.090180 ip-10-0-134-121 kubenswrapper[2584]: E0720 13:02:16.090049    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ck7q6" podUID="6a903657-acf4-4846-a7bd-b45e286216c1"
Jul 20 13:02:16.238324 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:16.238244    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mltmb" event={"ID":"dc1eda22-b2e1-4381-b12f-3af236b2de4e","Type":"ContainerStarted","Data":"513b323b852492f0d6afcea04b8c8ddbc041758983c113ff29592b2954eab893"}
Jul 20 13:02:16.240049 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:16.239992    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-46jkq" event={"ID":"58994b72-6cbb-452f-a68e-62b088c3cfbf","Type":"ContainerStarted","Data":"cf5c23790625bb3ecb608303680d5d667c6043be5195dd3f3976da92c00fb0b3"}
Jul 20 13:02:16.260465 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:16.260418    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-46jkq" podStartSLOduration=3.097532962 podStartE2EDuration="25.260403815s" totalImagesPullingTime="22.162870853s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 13:01:51 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 13:02:16.260276276 +0000 UTC m=+25.976823687" watchObservedRunningTime="2026-07-20 13:02:16.260403815 +0000 UTC m=+25.976951225"
Jul 20 13:02:16.260618 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:16.260515    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-tnlm9" podStartSLOduration=2.9652340820000003 podStartE2EDuration="25.260508905s" totalImagesPullingTime="22.295274823s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 13:01:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 13:02:15.277735395 +0000 UTC m=+24.994282806" watchObservedRunningTime="2026-07-20 13:02:16.260508905 +0000 UTC m=+25.977056316"
Jul 20 13:02:17.088945 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:17.088909    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4wwrh"
Jul 20 13:02:17.089142 ip-10-0-134-121 kubenswrapper[2584]: E0720 13:02:17.089041    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4wwrh" podUID="f8c70e98-14ec-48d9-8c30-2d63fa95c04e"
Jul 20 13:02:17.089142 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:17.089075    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9zclf"
Jul 20 13:02:17.089142 ip-10-0-134-121 kubenswrapper[2584]: E0720 13:02:17.089133    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9zclf" podUID="84c98b82-b626-42a7-bce8-281d439e1772"
Jul 20 13:02:17.243781 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:17.243741    2584 generic.go:356] "Generic (PLEG): container finished" podID="95e88ecd-0ff4-4a0b-b8ef-b395ee2a78db" containerID="c637bfe219cab40009ac00c61280e219e87fd08e66922501d887b8cb10f6b48d" exitCode=0
Jul 20 13:02:17.244187 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:17.243834    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-szpnb" event={"ID":"95e88ecd-0ff4-4a0b-b8ef-b395ee2a78db","Type":"ContainerDied","Data":"c637bfe219cab40009ac00c61280e219e87fd08e66922501d887b8cb10f6b48d"}
Jul 20 13:02:18.089339 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:18.089250    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ck7q6"
Jul 20 13:02:18.089495 ip-10-0-134-121 kubenswrapper[2584]: E0720 13:02:18.089352    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ck7q6" podUID="6a903657-acf4-4846-a7bd-b45e286216c1"
Jul 20 13:02:18.202886 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:18.202857    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-hgvl2_548d5005-1a66-4385-9ebc-6844b175673d/dns-node-resolver/0.log"
Jul 20 13:02:18.249035 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:18.249001    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mltmb" event={"ID":"dc1eda22-b2e1-4381-b12f-3af236b2de4e","Type":"ContainerStarted","Data":"1f2603e8af40047b28f6f40e7637dda9b8eee205ead36c187ffafa2035f81ef1"}
Jul 20 13:02:18.251335 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:18.251303    2584 generic.go:356] "Generic (PLEG): container finished" podID="95e88ecd-0ff4-4a0b-b8ef-b395ee2a78db" containerID="c7d20d38c30f12675d550d2bc737cb2f7f75c6d6bfb822ebd36a4dc877790d6b" exitCode=0
Jul 20 13:02:18.251484 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:18.251359    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-szpnb" event={"ID":"95e88ecd-0ff4-4a0b-b8ef-b395ee2a78db","Type":"ContainerDied","Data":"c7d20d38c30f12675d550d2bc737cb2f7f75c6d6bfb822ebd36a4dc877790d6b"}
Jul 20 13:02:19.089594 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:19.089556    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4wwrh"
Jul 20 13:02:19.089789 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:19.089568    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9zclf"
Jul 20 13:02:19.089789 ip-10-0-134-121 kubenswrapper[2584]: E0720 13:02:19.089680    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4wwrh" podUID="f8c70e98-14ec-48d9-8c30-2d63fa95c04e"
Jul 20 13:02:19.089895 ip-10-0-134-121 kubenswrapper[2584]: E0720 13:02:19.089789    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9zclf" podUID="84c98b82-b626-42a7-bce8-281d439e1772"
Jul 20 13:02:19.384990 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:19.384888    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-hsm2t_48cff737-3690-4df6-8e01-3b06c888f58f/node-ca/0.log"
Jul 20 13:02:19.934436 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:19.934212    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-ntcf5"
Jul 20 13:02:19.934630 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:19.934614    2584 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jul 20 13:02:19.935158 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:19.935134    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-ntcf5"
Jul 20 13:02:20.089838 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:20.089808    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ck7q6"
Jul 20 13:02:20.090052 ip-10-0-134-121 kubenswrapper[2584]: E0720 13:02:20.089931    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ck7q6" podUID="6a903657-acf4-4846-a7bd-b45e286216c1"
Jul 20 13:02:20.260549 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:20.260512    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mltmb" event={"ID":"dc1eda22-b2e1-4381-b12f-3af236b2de4e","Type":"ContainerStarted","Data":"0bbea04fa1f7ba315cbccdfeba3d3b7557cc8ceafe9292885e7f624f275234f9"}
Jul 20 13:02:20.260873 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:20.260849    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-mltmb"
Jul 20 13:02:20.280644 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:20.280612    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-mltmb"
Jul 20 13:02:20.318761 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:20.318706    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-mltmb" podStartSLOduration=13.762955162 podStartE2EDuration="29.318690894s" totalImagesPullingTime="15.555735732s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 13:01:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 13:02:20.289109068 +0000 UTC m=+30.005656480" watchObservedRunningTime="2026-07-20 13:02:20.318690894 +0000 UTC m=+30.035238304"
Jul 20 13:02:21.091370 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:21.090548    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4wwrh"
Jul 20 13:02:21.091370 ip-10-0-134-121 kubenswrapper[2584]: E0720 13:02:21.090667    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4wwrh" podUID="f8c70e98-14ec-48d9-8c30-2d63fa95c04e"
Jul 20 13:02:21.091370 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:21.090716    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9zclf"
Jul 20 13:02:21.091370 ip-10-0-134-121 kubenswrapper[2584]: E0720 13:02:21.090863    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9zclf" podUID="84c98b82-b626-42a7-bce8-281d439e1772"
Jul 20 13:02:21.264100 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:21.264069    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-mltmb"
Jul 20 13:02:21.264292 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:21.264145    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-mltmb"
Jul 20 13:02:21.282214 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:21.282181    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-mltmb"
Jul 20 13:02:21.734171 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:21.734130    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-9zclf"]
Jul 20 13:02:21.734349 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:21.734296    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9zclf"
Jul 20 13:02:21.734419 ip-10-0-134-121 kubenswrapper[2584]: E0720 13:02:21.734395    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9zclf" podUID="84c98b82-b626-42a7-bce8-281d439e1772"
Jul 20 13:02:21.737337 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:21.737311    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-4wwrh"]
Jul 20 13:02:21.737458 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:21.737413    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4wwrh"
Jul 20 13:02:21.737515 ip-10-0-134-121 kubenswrapper[2584]: E0720 13:02:21.737495    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4wwrh" podUID="f8c70e98-14ec-48d9-8c30-2d63fa95c04e"
Jul 20 13:02:21.738149 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:21.738125    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-ck7q6"]
Jul 20 13:02:21.738242 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:21.738234    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ck7q6"
Jul 20 13:02:21.738354 ip-10-0-134-121 kubenswrapper[2584]: E0720 13:02:21.738333    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ck7q6" podUID="6a903657-acf4-4846-a7bd-b45e286216c1"
Jul 20 13:02:23.089145 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:23.089114    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4wwrh"
Jul 20 13:02:23.089517 ip-10-0-134-121 kubenswrapper[2584]: E0720 13:02:23.089273    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4wwrh" podUID="f8c70e98-14ec-48d9-8c30-2d63fa95c04e"
Jul 20 13:02:23.271816 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:23.271786    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-szpnb" event={"ID":"95e88ecd-0ff4-4a0b-b8ef-b395ee2a78db","Type":"ContainerStarted","Data":"2b93beeaf428d0f0989064effb93332688904c2d5c061727c8d09fa17480251b"}
Jul 20 13:02:23.536643 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:23.536609    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f8c70e98-14ec-48d9-8c30-2d63fa95c04e-original-pull-secret\") pod \"global-pull-secret-syncer-4wwrh\" (UID: \"f8c70e98-14ec-48d9-8c30-2d63fa95c04e\") " pod="kube-system/global-pull-secret-syncer-4wwrh"
Jul 20 13:02:23.536803 ip-10-0-134-121 kubenswrapper[2584]: E0720 13:02:23.536726    2584 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 20 13:02:23.536803 ip-10-0-134-121 kubenswrapper[2584]: E0720 13:02:23.536778    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f8c70e98-14ec-48d9-8c30-2d63fa95c04e-original-pull-secret podName:f8c70e98-14ec-48d9-8c30-2d63fa95c04e nodeName:}" failed. No retries permitted until 2026-07-20 13:02:55.536764807 +0000 UTC m=+65.253312197 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f8c70e98-14ec-48d9-8c30-2d63fa95c04e-original-pull-secret") pod "global-pull-secret-syncer-4wwrh" (UID: "f8c70e98-14ec-48d9-8c30-2d63fa95c04e") : object "kube-system"/"original-pull-secret" not registered
Jul 20 13:02:23.637301 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:23.637268    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/84c98b82-b626-42a7-bce8-281d439e1772-metrics-certs\") pod \"network-metrics-daemon-9zclf\" (UID: \"84c98b82-b626-42a7-bce8-281d439e1772\") " pod="openshift-multus/network-metrics-daemon-9zclf"
Jul 20 13:02:23.637458 ip-10-0-134-121 kubenswrapper[2584]: E0720 13:02:23.637433    2584 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 20 13:02:23.637518 ip-10-0-134-121 kubenswrapper[2584]: E0720 13:02:23.637508    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/84c98b82-b626-42a7-bce8-281d439e1772-metrics-certs podName:84c98b82-b626-42a7-bce8-281d439e1772 nodeName:}" failed. No retries permitted until 2026-07-20 13:02:55.637491788 +0000 UTC m=+65.354039178 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/84c98b82-b626-42a7-bce8-281d439e1772-metrics-certs") pod "network-metrics-daemon-9zclf" (UID: "84c98b82-b626-42a7-bce8-281d439e1772") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 20 13:02:23.738290 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:23.738248    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sgz85\" (UniqueName: \"kubernetes.io/projected/6a903657-acf4-4846-a7bd-b45e286216c1-kube-api-access-sgz85\") pod \"network-check-target-ck7q6\" (UID: \"6a903657-acf4-4846-a7bd-b45e286216c1\") " pod="openshift-network-diagnostics/network-check-target-ck7q6"
Jul 20 13:02:23.738445 ip-10-0-134-121 kubenswrapper[2584]: E0720 13:02:23.738428    2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 20 13:02:23.738480 ip-10-0-134-121 kubenswrapper[2584]: E0720 13:02:23.738451    2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 20 13:02:23.738480 ip-10-0-134-121 kubenswrapper[2584]: E0720 13:02:23.738461    2584 projected.go:196] Error preparing data for projected volume kube-api-access-sgz85 for pod openshift-network-diagnostics/network-check-target-ck7q6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 20 13:02:23.738579 ip-10-0-134-121 kubenswrapper[2584]: E0720 13:02:23.738511    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6a903657-acf4-4846-a7bd-b45e286216c1-kube-api-access-sgz85 podName:6a903657-acf4-4846-a7bd-b45e286216c1 nodeName:}" failed. No retries permitted until 2026-07-20 13:02:55.738498231 +0000 UTC m=+65.455045620 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-sgz85" (UniqueName: "kubernetes.io/projected/6a903657-acf4-4846-a7bd-b45e286216c1-kube-api-access-sgz85") pod "network-check-target-ck7q6" (UID: "6a903657-acf4-4846-a7bd-b45e286216c1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 20 13:02:24.089621 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:24.089592    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9zclf"
Jul 20 13:02:24.089981 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:24.089651    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ck7q6"
Jul 20 13:02:24.089981 ip-10-0-134-121 kubenswrapper[2584]: E0720 13:02:24.089739    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ck7q6" podUID="6a903657-acf4-4846-a7bd-b45e286216c1"
Jul 20 13:02:24.089981 ip-10-0-134-121 kubenswrapper[2584]: E0720 13:02:24.089830    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9zclf" podUID="84c98b82-b626-42a7-bce8-281d439e1772"
Jul 20 13:02:24.276953 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:24.276921    2584 generic.go:356] "Generic (PLEG): container finished" podID="95e88ecd-0ff4-4a0b-b8ef-b395ee2a78db" containerID="2b93beeaf428d0f0989064effb93332688904c2d5c061727c8d09fa17480251b" exitCode=0
Jul 20 13:02:24.277101 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:24.276983    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-szpnb" event={"ID":"95e88ecd-0ff4-4a0b-b8ef-b395ee2a78db","Type":"ContainerDied","Data":"2b93beeaf428d0f0989064effb93332688904c2d5c061727c8d09fa17480251b"}
Jul 20 13:02:25.092032 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:25.092002    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4wwrh"
Jul 20 13:02:25.092450 ip-10-0-134-121 kubenswrapper[2584]: E0720 13:02:25.092097    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4wwrh" podUID="f8c70e98-14ec-48d9-8c30-2d63fa95c04e"
Jul 20 13:02:25.282463 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:25.282423    2584 generic.go:356] "Generic (PLEG): container finished" podID="95e88ecd-0ff4-4a0b-b8ef-b395ee2a78db" containerID="0149d7e607d01512e477d745e163833b0f93917e003193e4cb1487b7b9f33838" exitCode=0
Jul 20 13:02:25.282639 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:25.282474    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-szpnb" event={"ID":"95e88ecd-0ff4-4a0b-b8ef-b395ee2a78db","Type":"ContainerDied","Data":"0149d7e607d01512e477d745e163833b0f93917e003193e4cb1487b7b9f33838"}
Jul 20 13:02:26.089556 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:26.089530    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9zclf"
Jul 20 13:02:26.089735 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:26.089530    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ck7q6"
Jul 20 13:02:26.089735 ip-10-0-134-121 kubenswrapper[2584]: E0720 13:02:26.089669    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9zclf" podUID="84c98b82-b626-42a7-bce8-281d439e1772"
Jul 20 13:02:26.089735 ip-10-0-134-121 kubenswrapper[2584]: E0720 13:02:26.089702    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ck7q6" podUID="6a903657-acf4-4846-a7bd-b45e286216c1"
Jul 20 13:02:26.287932 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:26.287891    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-szpnb" event={"ID":"95e88ecd-0ff4-4a0b-b8ef-b395ee2a78db","Type":"ContainerStarted","Data":"ae551b32ace491e3f599ed570d3a9614906db5c0c3d76aba36e5c3a7f89b0026"}
Jul 20 13:02:26.311166 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:26.311122    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-szpnb" podStartSLOduration=8.163067209 podStartE2EDuration="35.311107398s" totalImagesPullingTime="27.148040189s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 13:01:51 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 13:02:26.310505459 +0000 UTC m=+36.027052869" watchObservedRunningTime="2026-07-20 13:02:26.311107398 +0000 UTC m=+36.027654822"
Jul 20 13:02:27.089269 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:27.089219    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4wwrh"
Jul 20 13:02:27.089519 ip-10-0-134-121 kubenswrapper[2584]: E0720 13:02:27.089378    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4wwrh" podUID="f8c70e98-14ec-48d9-8c30-2d63fa95c04e"
Jul 20 13:02:28.089008 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:28.088952    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ck7q6"
Jul 20 13:02:28.089384 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:28.088954    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9zclf"
Jul 20 13:02:28.089384 ip-10-0-134-121 kubenswrapper[2584]: E0720 13:02:28.089073    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ck7q6" podUID="6a903657-acf4-4846-a7bd-b45e286216c1"
Jul 20 13:02:28.089384 ip-10-0-134-121 kubenswrapper[2584]: E0720 13:02:28.089145    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9zclf" podUID="84c98b82-b626-42a7-bce8-281d439e1772"
Jul 20 13:02:29.089415 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:29.089384    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4wwrh"
Jul 20 13:02:29.089804 ip-10-0-134-121 kubenswrapper[2584]: E0720 13:02:29.089499    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4wwrh" podUID="f8c70e98-14ec-48d9-8c30-2d63fa95c04e"
Jul 20 13:02:30.089120 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:30.089083    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ck7q6"
Jul 20 13:02:30.089300 ip-10-0-134-121 kubenswrapper[2584]: E0720 13:02:30.089193    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ck7q6" podUID="6a903657-acf4-4846-a7bd-b45e286216c1"
Jul 20 13:02:30.089300 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:30.089242    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9zclf"
Jul 20 13:02:30.089382 ip-10-0-134-121 kubenswrapper[2584]: E0720 13:02:30.089333    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9zclf" podUID="84c98b82-b626-42a7-bce8-281d439e1772"
Jul 20 13:02:31.089701 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:31.089664    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4wwrh"
Jul 20 13:02:31.090258 ip-10-0-134-121 kubenswrapper[2584]: E0720 13:02:31.089755    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4wwrh" podUID="f8c70e98-14ec-48d9-8c30-2d63fa95c04e"
Jul 20 13:02:32.089772 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:32.089740    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9zclf"
Jul 20 13:02:32.090221 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:32.089746    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ck7q6"
Jul 20 13:02:32.090221 ip-10-0-134-121 kubenswrapper[2584]: E0720 13:02:32.089842    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9zclf" podUID="84c98b82-b626-42a7-bce8-281d439e1772"
Jul 20 13:02:32.090221 ip-10-0-134-121 kubenswrapper[2584]: E0720 13:02:32.089912    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ck7q6" podUID="6a903657-acf4-4846-a7bd-b45e286216c1"
Jul 20 13:02:33.089560 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:33.089526    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4wwrh"
Jul 20 13:02:33.089746 ip-10-0-134-121 kubenswrapper[2584]: E0720 13:02:33.089646    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4wwrh" podUID="f8c70e98-14ec-48d9-8c30-2d63fa95c04e"
Jul 20 13:02:34.089388 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:34.089349    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ck7q6"
Jul 20 13:02:34.089872 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:34.089354    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9zclf"
Jul 20 13:02:34.089872 ip-10-0-134-121 kubenswrapper[2584]: E0720 13:02:34.089483    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ck7q6" podUID="6a903657-acf4-4846-a7bd-b45e286216c1"
Jul 20 13:02:34.089872 ip-10-0-134-121 kubenswrapper[2584]: E0720 13:02:34.089540    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9zclf" podUID="84c98b82-b626-42a7-bce8-281d439e1772"
Jul 20 13:02:35.089188 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:35.089148    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4wwrh"
Jul 20 13:02:35.089377 ip-10-0-134-121 kubenswrapper[2584]: E0720 13:02:35.089317    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4wwrh" podUID="f8c70e98-14ec-48d9-8c30-2d63fa95c04e"
Jul 20 13:02:36.088930 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:36.088892    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9zclf"
Jul 20 13:02:36.089350 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:36.088892    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ck7q6"
Jul 20 13:02:36.089350 ip-10-0-134-121 kubenswrapper[2584]: E0720 13:02:36.089036    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9zclf" podUID="84c98b82-b626-42a7-bce8-281d439e1772"
Jul 20 13:02:36.089350 ip-10-0-134-121 kubenswrapper[2584]: E0720 13:02:36.089137    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ck7q6" podUID="6a903657-acf4-4846-a7bd-b45e286216c1"
Jul 20 13:02:37.089528 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:37.089491    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4wwrh"
Jul 20 13:02:37.090064 ip-10-0-134-121 kubenswrapper[2584]: E0720 13:02:37.089595    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4wwrh" podUID="f8c70e98-14ec-48d9-8c30-2d63fa95c04e"
Jul 20 13:02:38.089657 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:38.089615    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9zclf"
Jul 20 13:02:38.089657 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:38.089647    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ck7q6"
Jul 20 13:02:38.090171 ip-10-0-134-121 kubenswrapper[2584]: E0720 13:02:38.089737    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9zclf" podUID="84c98b82-b626-42a7-bce8-281d439e1772"
Jul 20 13:02:38.090171 ip-10-0-134-121 kubenswrapper[2584]: E0720 13:02:38.089839    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ck7q6" podUID="6a903657-acf4-4846-a7bd-b45e286216c1"
Jul 20 13:02:39.089499 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:39.089471    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4wwrh"
Jul 20 13:02:39.089673 ip-10-0-134-121 kubenswrapper[2584]: E0720 13:02:39.089572    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4wwrh" podUID="f8c70e98-14ec-48d9-8c30-2d63fa95c04e"
Jul 20 13:02:40.089426 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:40.089381    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ck7q6"
Jul 20 13:02:40.090264 ip-10-0-134-121 kubenswrapper[2584]: E0720 13:02:40.089927    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ck7q6" podUID="6a903657-acf4-4846-a7bd-b45e286216c1"
Jul 20 13:02:40.092503 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:40.090426    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9zclf"
Jul 20 13:02:40.092503 ip-10-0-134-121 kubenswrapper[2584]: E0720 13:02:40.090626    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9zclf" podUID="84c98b82-b626-42a7-bce8-281d439e1772"
Jul 20 13:02:40.603423 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:40.603393    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-121.ec2.internal" event="NodeReady"
Jul 20 13:02:40.603594 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:40.603516    2584 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 20 13:02:40.653219 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:40.653185    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-b4v89"]
Jul 20 13:02:40.655004 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:40.654987    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-b4v89"
Jul 20 13:02:40.662802 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:40.662773    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 20 13:02:40.663104 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:40.663079    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 20 13:02:40.663226 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:40.663113    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-hjf8r\""
Jul 20 13:02:40.663791 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:40.663770    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-47dgd"]
Jul 20 13:02:40.665584 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:40.665570    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-47dgd"
Jul 20 13:02:40.667743 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:40.667722    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 20 13:02:40.668199 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:40.668183    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-rdx8c\""
Jul 20 13:02:40.668271 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:40.668185    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 20 13:02:40.668725 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:40.668712    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 20 13:02:40.669345 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:40.669332    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 20 13:02:40.675646 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:40.675626    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-b4v89"]
Jul 20 13:02:40.686206 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:40.686185    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-47dgd"]
Jul 20 13:02:40.753303 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:40.753272    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-l7t7v"]
Jul 20 13:02:40.755164 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:40.755148    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-l7t7v"
Jul 20 13:02:40.757413 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:40.757383    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-6btvh\""
Jul 20 13:02:40.757527 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:40.757417    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 20 13:02:40.757527 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:40.757438    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 20 13:02:40.757527 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:40.757479    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 20 13:02:40.763062 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:40.763037    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-l7t7v"]
Jul 20 13:02:40.763266 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:40.763248    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/665de046-e6ce-435b-acf0-64c86a9585f9-tmp-dir\") pod \"dns-default-b4v89\" (UID: \"665de046-e6ce-435b-acf0-64c86a9585f9\") " pod="openshift-dns/dns-default-b4v89"
Jul 20 13:02:40.763329 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:40.763277    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n95kd\" (UniqueName: \"kubernetes.io/projected/665de046-e6ce-435b-acf0-64c86a9585f9-kube-api-access-n95kd\") pod \"dns-default-b4v89\" (UID: \"665de046-e6ce-435b-acf0-64c86a9585f9\") " pod="openshift-dns/dns-default-b4v89"
Jul 20 13:02:40.763329 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:40.763310    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/665de046-e6ce-435b-acf0-64c86a9585f9-config-volume\") pod \"dns-default-b4v89\" (UID: \"665de046-e6ce-435b-acf0-64c86a9585f9\") " pod="openshift-dns/dns-default-b4v89"
Jul 20 13:02:40.763415 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:40.763333    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/d968a7e1-9b1f-4a71-ac30-3ddf7f7907bf-data-volume\") pod \"insights-runtime-extractor-47dgd\" (UID: \"d968a7e1-9b1f-4a71-ac30-3ddf7f7907bf\") " pod="openshift-insights/insights-runtime-extractor-47dgd"
Jul 20 13:02:40.763468 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:40.763425    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d968a7e1-9b1f-4a71-ac30-3ddf7f7907bf-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-47dgd\" (UID: \"d968a7e1-9b1f-4a71-ac30-3ddf7f7907bf\") " pod="openshift-insights/insights-runtime-extractor-47dgd"
Jul 20 13:02:40.763518 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:40.763470    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-grpt8\" (UniqueName: \"kubernetes.io/projected/d968a7e1-9b1f-4a71-ac30-3ddf7f7907bf-kube-api-access-grpt8\") pod \"insights-runtime-extractor-47dgd\" (UID: \"d968a7e1-9b1f-4a71-ac30-3ddf7f7907bf\") " pod="openshift-insights/insights-runtime-extractor-47dgd"
Jul 20 13:02:40.763518 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:40.763500    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d968a7e1-9b1f-4a71-ac30-3ddf7f7907bf-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-47dgd\" (UID: \"d968a7e1-9b1f-4a71-ac30-3ddf7f7907bf\") " pod="openshift-insights/insights-runtime-extractor-47dgd"
Jul 20 13:02:40.763589 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:40.763549    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/d968a7e1-9b1f-4a71-ac30-3ddf7f7907bf-crio-socket\") pod \"insights-runtime-extractor-47dgd\" (UID: \"d968a7e1-9b1f-4a71-ac30-3ddf7f7907bf\") " pod="openshift-insights/insights-runtime-extractor-47dgd"
Jul 20 13:02:40.763630 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:40.763596    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/665de046-e6ce-435b-acf0-64c86a9585f9-metrics-tls\") pod \"dns-default-b4v89\" (UID: \"665de046-e6ce-435b-acf0-64c86a9585f9\") " pod="openshift-dns/dns-default-b4v89"
Jul 20 13:02:40.864507 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:40.864412    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c57ss\" (UniqueName: \"kubernetes.io/projected/4335d45c-7a98-4335-b4e6-1ca7356b69bf-kube-api-access-c57ss\") pod \"ingress-canary-l7t7v\" (UID: \"4335d45c-7a98-4335-b4e6-1ca7356b69bf\") " pod="openshift-ingress-canary/ingress-canary-l7t7v"
Jul 20 13:02:40.864507 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:40.864483    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d968a7e1-9b1f-4a71-ac30-3ddf7f7907bf-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-47dgd\" (UID: \"d968a7e1-9b1f-4a71-ac30-3ddf7f7907bf\") " pod="openshift-insights/insights-runtime-extractor-47dgd"
Jul 20 13:02:40.864507 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:40.864509    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-grpt8\" (UniqueName: \"kubernetes.io/projected/d968a7e1-9b1f-4a71-ac30-3ddf7f7907bf-kube-api-access-grpt8\") pod \"insights-runtime-extractor-47dgd\" (UID: \"d968a7e1-9b1f-4a71-ac30-3ddf7f7907bf\") " pod="openshift-insights/insights-runtime-extractor-47dgd"
Jul 20 13:02:40.864763 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:40.864530    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d968a7e1-9b1f-4a71-ac30-3ddf7f7907bf-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-47dgd\" (UID: \"d968a7e1-9b1f-4a71-ac30-3ddf7f7907bf\") " pod="openshift-insights/insights-runtime-extractor-47dgd"
Jul 20 13:02:40.864763 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:40.864569    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/d968a7e1-9b1f-4a71-ac30-3ddf7f7907bf-crio-socket\") pod \"insights-runtime-extractor-47dgd\" (UID: \"d968a7e1-9b1f-4a71-ac30-3ddf7f7907bf\") " pod="openshift-insights/insights-runtime-extractor-47dgd"
Jul 20 13:02:40.864763 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:40.864591    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/665de046-e6ce-435b-acf0-64c86a9585f9-metrics-tls\") pod \"dns-default-b4v89\" (UID: \"665de046-e6ce-435b-acf0-64c86a9585f9\") " pod="openshift-dns/dns-default-b4v89"
Jul 20 13:02:40.864763 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:40.864607    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/665de046-e6ce-435b-acf0-64c86a9585f9-tmp-dir\") pod \"dns-default-b4v89\" (UID: \"665de046-e6ce-435b-acf0-64c86a9585f9\") " pod="openshift-dns/dns-default-b4v89"
Jul 20 13:02:40.864763 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:40.864623    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n95kd\" (UniqueName: \"kubernetes.io/projected/665de046-e6ce-435b-acf0-64c86a9585f9-kube-api-access-n95kd\") pod \"dns-default-b4v89\" (UID: \"665de046-e6ce-435b-acf0-64c86a9585f9\") " pod="openshift-dns/dns-default-b4v89"
Jul 20 13:02:40.864763 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:40.864649    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4335d45c-7a98-4335-b4e6-1ca7356b69bf-cert\") pod \"ingress-canary-l7t7v\" (UID: \"4335d45c-7a98-4335-b4e6-1ca7356b69bf\") " pod="openshift-ingress-canary/ingress-canary-l7t7v"
Jul 20 13:02:40.864763 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:40.864722    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/665de046-e6ce-435b-acf0-64c86a9585f9-config-volume\") pod \"dns-default-b4v89\" (UID: \"665de046-e6ce-435b-acf0-64c86a9585f9\") " pod="openshift-dns/dns-default-b4v89"
Jul 20 13:02:40.865139 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:40.864764    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/d968a7e1-9b1f-4a71-ac30-3ddf7f7907bf-data-volume\") pod \"insights-runtime-extractor-47dgd\" (UID: \"d968a7e1-9b1f-4a71-ac30-3ddf7f7907bf\") " pod="openshift-insights/insights-runtime-extractor-47dgd"
Jul 20 13:02:40.865139 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:40.864987    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/d968a7e1-9b1f-4a71-ac30-3ddf7f7907bf-crio-socket\") pod \"insights-runtime-extractor-47dgd\" (UID: \"d968a7e1-9b1f-4a71-ac30-3ddf7f7907bf\") " pod="openshift-insights/insights-runtime-extractor-47dgd"
Jul 20 13:02:40.865139 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:40.865119    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/d968a7e1-9b1f-4a71-ac30-3ddf7f7907bf-data-volume\") pod \"insights-runtime-extractor-47dgd\" (UID: \"d968a7e1-9b1f-4a71-ac30-3ddf7f7907bf\") " pod="openshift-insights/insights-runtime-extractor-47dgd"
Jul 20 13:02:40.865254 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:40.865145    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/665de046-e6ce-435b-acf0-64c86a9585f9-tmp-dir\") pod \"dns-default-b4v89\" (UID: \"665de046-e6ce-435b-acf0-64c86a9585f9\") " pod="openshift-dns/dns-default-b4v89"
Jul 20 13:02:40.865254 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:40.865226    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d968a7e1-9b1f-4a71-ac30-3ddf7f7907bf-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-47dgd\" (UID: \"d968a7e1-9b1f-4a71-ac30-3ddf7f7907bf\") " pod="openshift-insights/insights-runtime-extractor-47dgd"
Jul 20 13:02:40.865368 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:40.865351    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/665de046-e6ce-435b-acf0-64c86a9585f9-config-volume\") pod \"dns-default-b4v89\" (UID: \"665de046-e6ce-435b-acf0-64c86a9585f9\") " pod="openshift-dns/dns-default-b4v89"
Jul 20 13:02:40.868629 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:40.868611    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d968a7e1-9b1f-4a71-ac30-3ddf7f7907bf-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-47dgd\" (UID: \"d968a7e1-9b1f-4a71-ac30-3ddf7f7907bf\") " pod="openshift-insights/insights-runtime-extractor-47dgd"
Jul 20 13:02:40.868688 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:40.868614    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/665de046-e6ce-435b-acf0-64c86a9585f9-metrics-tls\") pod \"dns-default-b4v89\" (UID: \"665de046-e6ce-435b-acf0-64c86a9585f9\") " pod="openshift-dns/dns-default-b4v89"
Jul 20 13:02:40.874020 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:40.873999    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n95kd\" (UniqueName: \"kubernetes.io/projected/665de046-e6ce-435b-acf0-64c86a9585f9-kube-api-access-n95kd\") pod \"dns-default-b4v89\" (UID: \"665de046-e6ce-435b-acf0-64c86a9585f9\") " pod="openshift-dns/dns-default-b4v89"
Jul 20 13:02:40.874133 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:40.874084    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-grpt8\" (UniqueName: \"kubernetes.io/projected/d968a7e1-9b1f-4a71-ac30-3ddf7f7907bf-kube-api-access-grpt8\") pod \"insights-runtime-extractor-47dgd\" (UID: \"d968a7e1-9b1f-4a71-ac30-3ddf7f7907bf\") " pod="openshift-insights/insights-runtime-extractor-47dgd"
Jul 20 13:02:40.963917 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:40.963878    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-b4v89"
Jul 20 13:02:40.965093 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:40.965068    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4335d45c-7a98-4335-b4e6-1ca7356b69bf-cert\") pod \"ingress-canary-l7t7v\" (UID: \"4335d45c-7a98-4335-b4e6-1ca7356b69bf\") " pod="openshift-ingress-canary/ingress-canary-l7t7v"
Jul 20 13:02:40.965190 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:40.965106    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c57ss\" (UniqueName: \"kubernetes.io/projected/4335d45c-7a98-4335-b4e6-1ca7356b69bf-kube-api-access-c57ss\") pod \"ingress-canary-l7t7v\" (UID: \"4335d45c-7a98-4335-b4e6-1ca7356b69bf\") " pod="openshift-ingress-canary/ingress-canary-l7t7v"
Jul 20 13:02:40.969313 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:40.968018    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4335d45c-7a98-4335-b4e6-1ca7356b69bf-cert\") pod \"ingress-canary-l7t7v\" (UID: \"4335d45c-7a98-4335-b4e6-1ca7356b69bf\") " pod="openshift-ingress-canary/ingress-canary-l7t7v"
Jul 20 13:02:40.973087 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:40.973063    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-47dgd"
Jul 20 13:02:40.973504 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:40.973484    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c57ss\" (UniqueName: \"kubernetes.io/projected/4335d45c-7a98-4335-b4e6-1ca7356b69bf-kube-api-access-c57ss\") pod \"ingress-canary-l7t7v\" (UID: \"4335d45c-7a98-4335-b4e6-1ca7356b69bf\") " pod="openshift-ingress-canary/ingress-canary-l7t7v"
Jul 20 13:02:41.064838 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:41.064722    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-l7t7v"
Jul 20 13:02:41.092085 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:41.091942    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4wwrh"
Jul 20 13:02:41.094541 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:41.094397    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 20 13:02:41.113776 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:41.113749    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-b4v89"]
Jul 20 13:02:41.118653 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:02:41.118619    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod665de046_e6ce_435b_acf0_64c86a9585f9.slice/crio-f03dc12c9841c87cd71efed14c889821714a4a9e11c5f26df672fb72a67a2b2e WatchSource:0}: Error finding container f03dc12c9841c87cd71efed14c889821714a4a9e11c5f26df672fb72a67a2b2e: Status 404 returned error can't find the container with id f03dc12c9841c87cd71efed14c889821714a4a9e11c5f26df672fb72a67a2b2e
Jul 20 13:02:41.129798 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:41.129770    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-47dgd"]
Jul 20 13:02:41.132793 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:02:41.132769    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd968a7e1_9b1f_4a71_ac30_3ddf7f7907bf.slice/crio-7d86d3a3913a559685bd0611f6ec1cad19efef7fcc9473bdd4ad54fc7773e6c0 WatchSource:0}: Error finding container 7d86d3a3913a559685bd0611f6ec1cad19efef7fcc9473bdd4ad54fc7773e6c0: Status 404 returned error can't find the container with id 7d86d3a3913a559685bd0611f6ec1cad19efef7fcc9473bdd4ad54fc7773e6c0
Jul 20 13:02:41.197315 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:41.197283    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-l7t7v"]
Jul 20 13:02:41.200530 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:02:41.200505    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4335d45c_7a98_4335_b4e6_1ca7356b69bf.slice/crio-bdd3f3d57403d5cdb8da45b89b0fa1c852696f11d9867794cf29ba531325ee7d WatchSource:0}: Error finding container bdd3f3d57403d5cdb8da45b89b0fa1c852696f11d9867794cf29ba531325ee7d: Status 404 returned error can't find the container with id bdd3f3d57403d5cdb8da45b89b0fa1c852696f11d9867794cf29ba531325ee7d
Jul 20 13:02:41.321975 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:41.321921    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-47dgd" event={"ID":"d968a7e1-9b1f-4a71-ac30-3ddf7f7907bf","Type":"ContainerStarted","Data":"7d86d3a3913a559685bd0611f6ec1cad19efef7fcc9473bdd4ad54fc7773e6c0"}
Jul 20 13:02:41.323101 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:41.323073    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-l7t7v" event={"ID":"4335d45c-7a98-4335-b4e6-1ca7356b69bf","Type":"ContainerStarted","Data":"bdd3f3d57403d5cdb8da45b89b0fa1c852696f11d9867794cf29ba531325ee7d"}
Jul 20 13:02:41.324134 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:41.324114    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-b4v89" event={"ID":"665de046-e6ce-435b-acf0-64c86a9585f9","Type":"ContainerStarted","Data":"f03dc12c9841c87cd71efed14c889821714a4a9e11c5f26df672fb72a67a2b2e"}
Jul 20 13:02:42.090957 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:42.089737    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ck7q6"
Jul 20 13:02:42.090957 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:42.090237    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9zclf"
Jul 20 13:02:42.093149 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:42.093124    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 20 13:02:42.093533 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:42.093406    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 20 13:02:42.094569 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:42.093622    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 20 13:02:42.094569 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:42.093819    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-m99kw\""
Jul 20 13:02:42.094569 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:42.094044    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-dbwl5\""
Jul 20 13:02:43.340329 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:43.340243    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-b4v89" event={"ID":"665de046-e6ce-435b-acf0-64c86a9585f9","Type":"ContainerStarted","Data":"bae9045de7670aae4e8f1b42d77dba34b20dbbfdbe61b7b0478314ca13de94ec"}
Jul 20 13:02:43.697497 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:43.697455    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-87b8c76b7-t69n9"]
Jul 20 13:02:43.704285 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:43.704256    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-87b8c76b7-t69n9"
Jul 20 13:02:43.707851 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:43.707823    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 20 13:02:43.708017 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:43.707875    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 20 13:02:43.708742 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:43.708184    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 20 13:02:43.708742 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:43.708298    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-wvqlb\""
Jul 20 13:02:43.708742 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:43.708555    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 20 13:02:43.709053 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:43.708799    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 20 13:02:43.709110 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:43.709054    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 20 13:02:43.709300 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:43.709282    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 20 13:02:43.711277 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:43.710916    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-87b8c76b7-t69n9"]
Jul 20 13:02:43.789164 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:43.789123    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2385a61c-ccd5-4f17-9bc2-2bbed7ac7031-service-ca\") pod \"console-87b8c76b7-t69n9\" (UID: \"2385a61c-ccd5-4f17-9bc2-2bbed7ac7031\") " pod="openshift-console/console-87b8c76b7-t69n9"
Jul 20 13:02:43.789330 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:43.789178    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2385a61c-ccd5-4f17-9bc2-2bbed7ac7031-oauth-serving-cert\") pod \"console-87b8c76b7-t69n9\" (UID: \"2385a61c-ccd5-4f17-9bc2-2bbed7ac7031\") " pod="openshift-console/console-87b8c76b7-t69n9"
Jul 20 13:02:43.789330 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:43.789204    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7zj2m\" (UniqueName: \"kubernetes.io/projected/2385a61c-ccd5-4f17-9bc2-2bbed7ac7031-kube-api-access-7zj2m\") pod \"console-87b8c76b7-t69n9\" (UID: \"2385a61c-ccd5-4f17-9bc2-2bbed7ac7031\") " pod="openshift-console/console-87b8c76b7-t69n9"
Jul 20 13:02:43.789429 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:43.789350    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2385a61c-ccd5-4f17-9bc2-2bbed7ac7031-console-config\") pod \"console-87b8c76b7-t69n9\" (UID: \"2385a61c-ccd5-4f17-9bc2-2bbed7ac7031\") " pod="openshift-console/console-87b8c76b7-t69n9"
Jul 20 13:02:43.789489 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:43.789428    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2385a61c-ccd5-4f17-9bc2-2bbed7ac7031-console-serving-cert\") pod \"console-87b8c76b7-t69n9\" (UID: \"2385a61c-ccd5-4f17-9bc2-2bbed7ac7031\") " pod="openshift-console/console-87b8c76b7-t69n9"
Jul 20 13:02:43.789489 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:43.789447    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2385a61c-ccd5-4f17-9bc2-2bbed7ac7031-console-oauth-config\") pod \"console-87b8c76b7-t69n9\" (UID: \"2385a61c-ccd5-4f17-9bc2-2bbed7ac7031\") " pod="openshift-console/console-87b8c76b7-t69n9"
Jul 20 13:02:43.890571 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:43.890530    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2385a61c-ccd5-4f17-9bc2-2bbed7ac7031-console-serving-cert\") pod \"console-87b8c76b7-t69n9\" (UID: \"2385a61c-ccd5-4f17-9bc2-2bbed7ac7031\") " pod="openshift-console/console-87b8c76b7-t69n9"
Jul 20 13:02:43.890571 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:43.890574    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2385a61c-ccd5-4f17-9bc2-2bbed7ac7031-console-oauth-config\") pod \"console-87b8c76b7-t69n9\" (UID: \"2385a61c-ccd5-4f17-9bc2-2bbed7ac7031\") " pod="openshift-console/console-87b8c76b7-t69n9"
Jul 20 13:02:43.890802 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:43.890707    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2385a61c-ccd5-4f17-9bc2-2bbed7ac7031-service-ca\") pod \"console-87b8c76b7-t69n9\" (UID: \"2385a61c-ccd5-4f17-9bc2-2bbed7ac7031\") " pod="openshift-console/console-87b8c76b7-t69n9"
Jul 20 13:02:43.890802 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:43.890766    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2385a61c-ccd5-4f17-9bc2-2bbed7ac7031-oauth-serving-cert\") pod \"console-87b8c76b7-t69n9\" (UID: \"2385a61c-ccd5-4f17-9bc2-2bbed7ac7031\") " pod="openshift-console/console-87b8c76b7-t69n9"
Jul 20 13:02:43.890802 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:43.890793    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7zj2m\" (UniqueName: \"kubernetes.io/projected/2385a61c-ccd5-4f17-9bc2-2bbed7ac7031-kube-api-access-7zj2m\") pod \"console-87b8c76b7-t69n9\" (UID: \"2385a61c-ccd5-4f17-9bc2-2bbed7ac7031\") " pod="openshift-console/console-87b8c76b7-t69n9"
Jul 20 13:02:43.890991 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:43.890858    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2385a61c-ccd5-4f17-9bc2-2bbed7ac7031-console-config\") pod \"console-87b8c76b7-t69n9\" (UID: \"2385a61c-ccd5-4f17-9bc2-2bbed7ac7031\") " pod="openshift-console/console-87b8c76b7-t69n9"
Jul 20 13:02:43.891452 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:43.891426    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2385a61c-ccd5-4f17-9bc2-2bbed7ac7031-service-ca\") pod \"console-87b8c76b7-t69n9\" (UID: \"2385a61c-ccd5-4f17-9bc2-2bbed7ac7031\") " pod="openshift-console/console-87b8c76b7-t69n9"
Jul 20 13:02:43.891584 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:43.891536    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2385a61c-ccd5-4f17-9bc2-2bbed7ac7031-oauth-serving-cert\") pod \"console-87b8c76b7-t69n9\" (UID: \"2385a61c-ccd5-4f17-9bc2-2bbed7ac7031\") " pod="openshift-console/console-87b8c76b7-t69n9"
Jul 20 13:02:43.891584 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:43.891553    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2385a61c-ccd5-4f17-9bc2-2bbed7ac7031-console-config\") pod \"console-87b8c76b7-t69n9\" (UID: \"2385a61c-ccd5-4f17-9bc2-2bbed7ac7031\") " pod="openshift-console/console-87b8c76b7-t69n9"
Jul 20 13:02:43.893638 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:43.893604    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2385a61c-ccd5-4f17-9bc2-2bbed7ac7031-console-serving-cert\") pod \"console-87b8c76b7-t69n9\" (UID: \"2385a61c-ccd5-4f17-9bc2-2bbed7ac7031\") " pod="openshift-console/console-87b8c76b7-t69n9"
Jul 20 13:02:43.893752 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:43.893736    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2385a61c-ccd5-4f17-9bc2-2bbed7ac7031-console-oauth-config\") pod \"console-87b8c76b7-t69n9\" (UID: \"2385a61c-ccd5-4f17-9bc2-2bbed7ac7031\") " pod="openshift-console/console-87b8c76b7-t69n9"
Jul 20 13:02:43.899682 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:43.899645    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7zj2m\" (UniqueName: \"kubernetes.io/projected/2385a61c-ccd5-4f17-9bc2-2bbed7ac7031-kube-api-access-7zj2m\") pod \"console-87b8c76b7-t69n9\" (UID: \"2385a61c-ccd5-4f17-9bc2-2bbed7ac7031\") " pod="openshift-console/console-87b8c76b7-t69n9"
Jul 20 13:02:44.018249 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:44.018199    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-87b8c76b7-t69n9"
Jul 20 13:02:44.346022 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:44.345919    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-b4v89" event={"ID":"665de046-e6ce-435b-acf0-64c86a9585f9","Type":"ContainerStarted","Data":"a3c84050ec5e9e82ae82e232465ec4ee43967d63f680c50bf8434a5aada09aa9"}
Jul 20 13:02:44.362036 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:44.361983    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-b4v89" podStartSLOduration=2.273362358 podStartE2EDuration="4.36194664s" totalImagesPullingTime="2.088584282s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 13:02:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 13:02:44.361863313 +0000 UTC m=+54.078410727" watchObservedRunningTime="2026-07-20 13:02:44.36194664 +0000 UTC m=+54.078494052"
Jul 20 13:02:45.350588 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:45.350551    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-b4v89"
Jul 20 13:02:47.507281 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:47.507250    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-87b8c76b7-t69n9"]
Jul 20 13:02:47.513072 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:02:47.513015    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2385a61c_ccd5_4f17_9bc2_2bbed7ac7031.slice/crio-7014e613adcee9015522e2a30cde2aa69bb7850f49b381f838ddc8dd32cb01cd WatchSource:0}: Error finding container 7014e613adcee9015522e2a30cde2aa69bb7850f49b381f838ddc8dd32cb01cd: Status 404 returned error can't find the container with id 7014e613adcee9015522e2a30cde2aa69bb7850f49b381f838ddc8dd32cb01cd
Jul 20 13:02:47.544855 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:47.544826    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-fk6vk"]
Jul 20 13:02:47.546844 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:47.546829    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-fk6vk"
Jul 20 13:02:47.548656 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:47.548628    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
Jul 20 13:02:47.548656 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:47.548649    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-qk5jm\""
Jul 20 13:02:47.558017 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:47.557986    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-fk6vk"]
Jul 20 13:02:47.627151 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:47.627054    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/f1a9360a-4165-4808-b9e2-3f92bff6d588-tls-certificates\") pod \"prometheus-operator-admission-webhook-85574b5f49-fk6vk\" (UID: \"f1a9360a-4165-4808-b9e2-3f92bff6d588\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-fk6vk"
Jul 20 13:02:47.727677 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:47.727634    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/f1a9360a-4165-4808-b9e2-3f92bff6d588-tls-certificates\") pod \"prometheus-operator-admission-webhook-85574b5f49-fk6vk\" (UID: \"f1a9360a-4165-4808-b9e2-3f92bff6d588\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-fk6vk"
Jul 20 13:02:47.730101 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:47.730067    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/f1a9360a-4165-4808-b9e2-3f92bff6d588-tls-certificates\") pod \"prometheus-operator-admission-webhook-85574b5f49-fk6vk\" (UID: \"f1a9360a-4165-4808-b9e2-3f92bff6d588\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-fk6vk"
Jul 20 13:02:47.855607 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:47.855568    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-fk6vk"
Jul 20 13:02:48.004751 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:48.004652    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-fk6vk"]
Jul 20 13:02:48.009376 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:02:48.009342    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf1a9360a_4165_4808_b9e2_3f92bff6d588.slice/crio-a1b01322cb2c8111c8b8454fd2bd95eb02eaaebbdacc234ce31311699efd874c WatchSource:0}: Error finding container a1b01322cb2c8111c8b8454fd2bd95eb02eaaebbdacc234ce31311699efd874c: Status 404 returned error can't find the container with id a1b01322cb2c8111c8b8454fd2bd95eb02eaaebbdacc234ce31311699efd874c
Jul 20 13:02:48.361775 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:48.361726    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-fk6vk" event={"ID":"f1a9360a-4165-4808-b9e2-3f92bff6d588","Type":"ContainerStarted","Data":"a1b01322cb2c8111c8b8454fd2bd95eb02eaaebbdacc234ce31311699efd874c"}
Jul 20 13:02:48.363860 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:48.363822    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-47dgd" event={"ID":"d968a7e1-9b1f-4a71-ac30-3ddf7f7907bf","Type":"ContainerStarted","Data":"a11edadee9e2b828735df7a4358253d8a6323b5042006478ead97949a7c706cd"}
Jul 20 13:02:48.368379 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:48.368306    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-87b8c76b7-t69n9" event={"ID":"2385a61c-ccd5-4f17-9bc2-2bbed7ac7031","Type":"ContainerStarted","Data":"7014e613adcee9015522e2a30cde2aa69bb7850f49b381f838ddc8dd32cb01cd"}
Jul 20 13:02:48.371106 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:48.371081    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-l7t7v" event={"ID":"4335d45c-7a98-4335-b4e6-1ca7356b69bf","Type":"ContainerStarted","Data":"4f3e2742b437c64af43f970307a61eef9229be25cda4621516f8170630a7d15b"}
Jul 20 13:02:52.084813 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:52.084753    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-l7t7v" podStartSLOduration=5.933158613 podStartE2EDuration="12.084728805s" totalImagesPullingTime="6.151570192s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 13:02:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 13:02:48.390342127 +0000 UTC m=+58.106889541" watchObservedRunningTime="2026-07-20 13:02:52.084728805 +0000 UTC m=+61.801276217"
Jul 20 13:02:52.085289 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:52.085176    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-f455799dc-b75cl"]
Jul 20 13:02:52.094274 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:52.094251    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-f455799dc-b75cl"
Jul 20 13:02:52.097573 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:52.097446    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-f455799dc-b75cl"]
Jul 20 13:02:52.102581 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:52.102528    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 20 13:02:52.167197 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:52.167157    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3389ffbc-668f-4aaa-9abb-051c12da9e4b-console-serving-cert\") pod \"console-f455799dc-b75cl\" (UID: \"3389ffbc-668f-4aaa-9abb-051c12da9e4b\") " pod="openshift-console/console-f455799dc-b75cl"
Jul 20 13:02:52.167197 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:52.167196    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3389ffbc-668f-4aaa-9abb-051c12da9e4b-console-oauth-config\") pod \"console-f455799dc-b75cl\" (UID: \"3389ffbc-668f-4aaa-9abb-051c12da9e4b\") " pod="openshift-console/console-f455799dc-b75cl"
Jul 20 13:02:52.167452 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:52.167215    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3389ffbc-668f-4aaa-9abb-051c12da9e4b-oauth-serving-cert\") pod \"console-f455799dc-b75cl\" (UID: \"3389ffbc-668f-4aaa-9abb-051c12da9e4b\") " pod="openshift-console/console-f455799dc-b75cl"
Jul 20 13:02:52.167452 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:52.167279    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3389ffbc-668f-4aaa-9abb-051c12da9e4b-trusted-ca-bundle\") pod \"console-f455799dc-b75cl\" (UID: \"3389ffbc-668f-4aaa-9abb-051c12da9e4b\") " pod="openshift-console/console-f455799dc-b75cl"
Jul 20 13:02:52.167452 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:52.167342    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3389ffbc-668f-4aaa-9abb-051c12da9e4b-console-config\") pod \"console-f455799dc-b75cl\" (UID: \"3389ffbc-668f-4aaa-9abb-051c12da9e4b\") " pod="openshift-console/console-f455799dc-b75cl"
Jul 20 13:02:52.167452 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:52.167375    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b99hp\" (UniqueName: \"kubernetes.io/projected/3389ffbc-668f-4aaa-9abb-051c12da9e4b-kube-api-access-b99hp\") pod \"console-f455799dc-b75cl\" (UID: \"3389ffbc-668f-4aaa-9abb-051c12da9e4b\") " pod="openshift-console/console-f455799dc-b75cl"
Jul 20 13:02:52.167452 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:52.167414    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3389ffbc-668f-4aaa-9abb-051c12da9e4b-service-ca\") pod \"console-f455799dc-b75cl\" (UID: \"3389ffbc-668f-4aaa-9abb-051c12da9e4b\") " pod="openshift-console/console-f455799dc-b75cl"
Jul 20 13:02:52.268094 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:52.268065    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3389ffbc-668f-4aaa-9abb-051c12da9e4b-console-config\") pod \"console-f455799dc-b75cl\" (UID: \"3389ffbc-668f-4aaa-9abb-051c12da9e4b\") " pod="openshift-console/console-f455799dc-b75cl"
Jul 20 13:02:52.268234 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:52.268107    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b99hp\" (UniqueName: \"kubernetes.io/projected/3389ffbc-668f-4aaa-9abb-051c12da9e4b-kube-api-access-b99hp\") pod \"console-f455799dc-b75cl\" (UID: \"3389ffbc-668f-4aaa-9abb-051c12da9e4b\") " pod="openshift-console/console-f455799dc-b75cl"
Jul 20 13:02:52.268234 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:52.268151    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3389ffbc-668f-4aaa-9abb-051c12da9e4b-service-ca\") pod \"console-f455799dc-b75cl\" (UID: \"3389ffbc-668f-4aaa-9abb-051c12da9e4b\") " pod="openshift-console/console-f455799dc-b75cl"
Jul 20 13:02:52.268234 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:52.268187    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3389ffbc-668f-4aaa-9abb-051c12da9e4b-console-serving-cert\") pod \"console-f455799dc-b75cl\" (UID: \"3389ffbc-668f-4aaa-9abb-051c12da9e4b\") " pod="openshift-console/console-f455799dc-b75cl"
Jul 20 13:02:52.268234 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:52.268209    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3389ffbc-668f-4aaa-9abb-051c12da9e4b-console-oauth-config\") pod \"console-f455799dc-b75cl\" (UID: \"3389ffbc-668f-4aaa-9abb-051c12da9e4b\") " pod="openshift-console/console-f455799dc-b75cl"
Jul 20 13:02:52.268446 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:52.268235    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3389ffbc-668f-4aaa-9abb-051c12da9e4b-oauth-serving-cert\") pod \"console-f455799dc-b75cl\" (UID: \"3389ffbc-668f-4aaa-9abb-051c12da9e4b\") " pod="openshift-console/console-f455799dc-b75cl"
Jul 20 13:02:52.268446 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:52.268302    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3389ffbc-668f-4aaa-9abb-051c12da9e4b-trusted-ca-bundle\") pod \"console-f455799dc-b75cl\" (UID: \"3389ffbc-668f-4aaa-9abb-051c12da9e4b\") " pod="openshift-console/console-f455799dc-b75cl"
Jul 20 13:02:52.268891 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:52.268861    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3389ffbc-668f-4aaa-9abb-051c12da9e4b-service-ca\") pod \"console-f455799dc-b75cl\" (UID: \"3389ffbc-668f-4aaa-9abb-051c12da9e4b\") " pod="openshift-console/console-f455799dc-b75cl"
Jul 20 13:02:52.269070 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:52.268870    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3389ffbc-668f-4aaa-9abb-051c12da9e4b-console-config\") pod \"console-f455799dc-b75cl\" (UID: \"3389ffbc-668f-4aaa-9abb-051c12da9e4b\") " pod="openshift-console/console-f455799dc-b75cl"
Jul 20 13:02:52.269147 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:52.269122    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3389ffbc-668f-4aaa-9abb-051c12da9e4b-oauth-serving-cert\") pod \"console-f455799dc-b75cl\" (UID: \"3389ffbc-668f-4aaa-9abb-051c12da9e4b\") " pod="openshift-console/console-f455799dc-b75cl"
Jul 20 13:02:52.269201 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:52.269171    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3389ffbc-668f-4aaa-9abb-051c12da9e4b-trusted-ca-bundle\") pod \"console-f455799dc-b75cl\" (UID: \"3389ffbc-668f-4aaa-9abb-051c12da9e4b\") " pod="openshift-console/console-f455799dc-b75cl"
Jul 20 13:02:52.270811 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:52.270784    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3389ffbc-668f-4aaa-9abb-051c12da9e4b-console-oauth-config\") pod \"console-f455799dc-b75cl\" (UID: \"3389ffbc-668f-4aaa-9abb-051c12da9e4b\") " pod="openshift-console/console-f455799dc-b75cl"
Jul 20 13:02:52.271125 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:52.271106    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3389ffbc-668f-4aaa-9abb-051c12da9e4b-console-serving-cert\") pod \"console-f455799dc-b75cl\" (UID: \"3389ffbc-668f-4aaa-9abb-051c12da9e4b\") " pod="openshift-console/console-f455799dc-b75cl"
Jul 20 13:02:52.275720 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:52.275675    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b99hp\" (UniqueName: \"kubernetes.io/projected/3389ffbc-668f-4aaa-9abb-051c12da9e4b-kube-api-access-b99hp\") pod \"console-f455799dc-b75cl\" (UID: \"3389ffbc-668f-4aaa-9abb-051c12da9e4b\") " pod="openshift-console/console-f455799dc-b75cl"
Jul 20 13:02:52.388530 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:52.388450    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-fk6vk" event={"ID":"f1a9360a-4165-4808-b9e2-3f92bff6d588","Type":"ContainerStarted","Data":"1a2378531ae7a1214a829afb9450b2a717b1695eef54fc95c8334693f6faa623"}
Jul 20 13:02:52.388805 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:52.388770    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-fk6vk"
Jul 20 13:02:52.390185 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:52.390159    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-87b8c76b7-t69n9" event={"ID":"2385a61c-ccd5-4f17-9bc2-2bbed7ac7031","Type":"ContainerStarted","Data":"baa45acfefeb3393a2361faa5f3b0fc44bcfe6f90cf12510fb19b575143cb734"}
Jul 20 13:02:52.394244 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:52.394224    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-fk6vk"
Jul 20 13:02:52.402869 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:52.402813    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-fk6vk" podStartSLOduration=1.149055844 podStartE2EDuration="5.402796655s" totalImagesPullingTime="4.253740811s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 13:02:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 13:02:52.402495845 +0000 UTC m=+62.119043258" watchObservedRunningTime="2026-07-20 13:02:52.402796655 +0000 UTC m=+62.119344070"
Jul 20 13:02:52.407024 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:52.407007    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-f455799dc-b75cl"
Jul 20 13:02:52.433773 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:52.433730    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-87b8c76b7-t69n9" podStartSLOduration=4.683333784 podStartE2EDuration="9.433715664s" totalImagesPullingTime="4.75038188s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 13:02:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 13:02:52.420322463 +0000 UTC m=+62.136869873" watchObservedRunningTime="2026-07-20 13:02:52.433715664 +0000 UTC m=+62.150263141"
Jul 20 13:02:52.554642 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:52.554612    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-f455799dc-b75cl"]
Jul 20 13:02:52.557694 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:02:52.557667    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3389ffbc_668f_4aaa_9abb_051c12da9e4b.slice/crio-c1d83b1848a2918a4da5c7e5fb22c0deb300a21262b944be21a2eb8a2a17799f WatchSource:0}: Error finding container c1d83b1848a2918a4da5c7e5fb22c0deb300a21262b944be21a2eb8a2a17799f: Status 404 returned error can't find the container with id c1d83b1848a2918a4da5c7e5fb22c0deb300a21262b944be21a2eb8a2a17799f
Jul 20 13:02:52.615480 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:52.615452    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-5945b5cfd-p6cmm"]
Jul 20 13:02:52.621502 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:52.621480    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-5945b5cfd-p6cmm"
Jul 20 13:02:52.623515 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:52.623494    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Jul 20 13:02:52.624148 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:52.624061    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 20 13:02:52.624148 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:52.624112    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 20 13:02:52.624349 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:52.624217    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 20 13:02:52.624349 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:52.624250    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-b6lzg\""
Jul 20 13:02:52.624443 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:52.624358    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Jul 20 13:02:52.629020 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:52.628999    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-5945b5cfd-p6cmm"]
Jul 20 13:02:52.673782 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:52.673693    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0b8795ff-8508-4d6d-a37a-e4cd0512990e-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-5945b5cfd-p6cmm\" (UID: \"0b8795ff-8508-4d6d-a37a-e4cd0512990e\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-p6cmm"
Jul 20 13:02:52.673935 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:52.673781    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9rqx7\" (UniqueName: \"kubernetes.io/projected/0b8795ff-8508-4d6d-a37a-e4cd0512990e-kube-api-access-9rqx7\") pod \"prometheus-operator-5945b5cfd-p6cmm\" (UID: \"0b8795ff-8508-4d6d-a37a-e4cd0512990e\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-p6cmm"
Jul 20 13:02:52.673935 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:52.673830    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/0b8795ff-8508-4d6d-a37a-e4cd0512990e-prometheus-operator-tls\") pod \"prometheus-operator-5945b5cfd-p6cmm\" (UID: \"0b8795ff-8508-4d6d-a37a-e4cd0512990e\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-p6cmm"
Jul 20 13:02:52.673935 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:52.673852    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0b8795ff-8508-4d6d-a37a-e4cd0512990e-metrics-client-ca\") pod \"prometheus-operator-5945b5cfd-p6cmm\" (UID: \"0b8795ff-8508-4d6d-a37a-e4cd0512990e\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-p6cmm"
Jul 20 13:02:52.774604 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:52.774565    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9rqx7\" (UniqueName: \"kubernetes.io/projected/0b8795ff-8508-4d6d-a37a-e4cd0512990e-kube-api-access-9rqx7\") pod \"prometheus-operator-5945b5cfd-p6cmm\" (UID: \"0b8795ff-8508-4d6d-a37a-e4cd0512990e\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-p6cmm"
Jul 20 13:02:52.774803 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:52.774618    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/0b8795ff-8508-4d6d-a37a-e4cd0512990e-prometheus-operator-tls\") pod \"prometheus-operator-5945b5cfd-p6cmm\" (UID: \"0b8795ff-8508-4d6d-a37a-e4cd0512990e\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-p6cmm"
Jul 20 13:02:52.774803 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:52.774634    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0b8795ff-8508-4d6d-a37a-e4cd0512990e-metrics-client-ca\") pod \"prometheus-operator-5945b5cfd-p6cmm\" (UID: \"0b8795ff-8508-4d6d-a37a-e4cd0512990e\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-p6cmm"
Jul 20 13:02:52.774803 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:52.774688    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0b8795ff-8508-4d6d-a37a-e4cd0512990e-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-5945b5cfd-p6cmm\" (UID: \"0b8795ff-8508-4d6d-a37a-e4cd0512990e\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-p6cmm"
Jul 20 13:02:52.775010 ip-10-0-134-121 kubenswrapper[2584]: E0720 13:02:52.774840    2584 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found
Jul 20 13:02:52.775010 ip-10-0-134-121 kubenswrapper[2584]: E0720 13:02:52.774930    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0b8795ff-8508-4d6d-a37a-e4cd0512990e-prometheus-operator-tls podName:0b8795ff-8508-4d6d-a37a-e4cd0512990e nodeName:}" failed. No retries permitted until 2026-07-20 13:02:53.274891396 +0000 UTC m=+62.991438802 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/0b8795ff-8508-4d6d-a37a-e4cd0512990e-prometheus-operator-tls") pod "prometheus-operator-5945b5cfd-p6cmm" (UID: "0b8795ff-8508-4d6d-a37a-e4cd0512990e") : secret "prometheus-operator-tls" not found
Jul 20 13:02:52.775537 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:52.775514    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0b8795ff-8508-4d6d-a37a-e4cd0512990e-metrics-client-ca\") pod \"prometheus-operator-5945b5cfd-p6cmm\" (UID: \"0b8795ff-8508-4d6d-a37a-e4cd0512990e\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-p6cmm"
Jul 20 13:02:52.777194 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:52.777173    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0b8795ff-8508-4d6d-a37a-e4cd0512990e-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-5945b5cfd-p6cmm\" (UID: \"0b8795ff-8508-4d6d-a37a-e4cd0512990e\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-p6cmm"
Jul 20 13:02:52.784978 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:52.784952    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9rqx7\" (UniqueName: \"kubernetes.io/projected/0b8795ff-8508-4d6d-a37a-e4cd0512990e-kube-api-access-9rqx7\") pod \"prometheus-operator-5945b5cfd-p6cmm\" (UID: \"0b8795ff-8508-4d6d-a37a-e4cd0512990e\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-p6cmm"
Jul 20 13:02:53.278315 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:53.278282    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/0b8795ff-8508-4d6d-a37a-e4cd0512990e-prometheus-operator-tls\") pod \"prometheus-operator-5945b5cfd-p6cmm\" (UID: \"0b8795ff-8508-4d6d-a37a-e4cd0512990e\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-p6cmm"
Jul 20 13:02:53.281248 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:53.281216    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/0b8795ff-8508-4d6d-a37a-e4cd0512990e-prometheus-operator-tls\") pod \"prometheus-operator-5945b5cfd-p6cmm\" (UID: \"0b8795ff-8508-4d6d-a37a-e4cd0512990e\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-p6cmm"
Jul 20 13:02:53.290086 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:53.290054    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-mltmb"
Jul 20 13:02:53.396096 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:53.395955    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-47dgd" event={"ID":"d968a7e1-9b1f-4a71-ac30-3ddf7f7907bf","Type":"ContainerStarted","Data":"6ffe824fcb60615e62ca54fc7b5e0ebea800eb29064827095a045b93d4ef9cde"}
Jul 20 13:02:53.397637 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:53.397608    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-f455799dc-b75cl" event={"ID":"3389ffbc-668f-4aaa-9abb-051c12da9e4b","Type":"ContainerStarted","Data":"c3f9157db22ff98f714b83b8daa826452bad66ddbd39969f367bb67e359946a7"}
Jul 20 13:02:53.397784 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:53.397666    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-f455799dc-b75cl" event={"ID":"3389ffbc-668f-4aaa-9abb-051c12da9e4b","Type":"ContainerStarted","Data":"c1d83b1848a2918a4da5c7e5fb22c0deb300a21262b944be21a2eb8a2a17799f"}
Jul 20 13:02:53.417395 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:53.417344    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-f455799dc-b75cl" podStartSLOduration=1.417329257 podStartE2EDuration="1.417329257s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 13:02:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 13:02:53.415772386 +0000 UTC m=+63.132319797" watchObservedRunningTime="2026-07-20 13:02:53.417329257 +0000 UTC m=+63.133876667"
Jul 20 13:02:53.532223 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:53.532133    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-5945b5cfd-p6cmm"
Jul 20 13:02:53.690820 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:53.690786    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-5945b5cfd-p6cmm"]
Jul 20 13:02:53.694214 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:02:53.694179    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0b8795ff_8508_4d6d_a37a_e4cd0512990e.slice/crio-0dc8248cb5bb37ff3c7b4fe9a4c13df9a4eb8377219c12475d230a2fa3815617 WatchSource:0}: Error finding container 0dc8248cb5bb37ff3c7b4fe9a4c13df9a4eb8377219c12475d230a2fa3815617: Status 404 returned error can't find the container with id 0dc8248cb5bb37ff3c7b4fe9a4c13df9a4eb8377219c12475d230a2fa3815617
Jul 20 13:02:54.019104 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:54.019065    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-87b8c76b7-t69n9"
Jul 20 13:02:54.019285 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:54.019131    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-87b8c76b7-t69n9"
Jul 20 13:02:54.020629 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:54.020597    2584 patch_prober.go:28] interesting pod/console-87b8c76b7-t69n9 container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.134.0.9:8443/health\": dial tcp 10.134.0.9:8443: connect: connection refused" start-of-body=
Jul 20 13:02:54.020772 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:54.020658    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-87b8c76b7-t69n9" podUID="2385a61c-ccd5-4f17-9bc2-2bbed7ac7031" containerName="console" probeResult="failure" output="Get \"https://10.134.0.9:8443/health\": dial tcp 10.134.0.9:8443: connect: connection refused"
Jul 20 13:02:54.403798 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:54.403705    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-5945b5cfd-p6cmm" event={"ID":"0b8795ff-8508-4d6d-a37a-e4cd0512990e","Type":"ContainerStarted","Data":"0dc8248cb5bb37ff3c7b4fe9a4c13df9a4eb8377219c12475d230a2fa3815617"}
Jul 20 13:02:55.355728 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:55.355700    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-b4v89"
Jul 20 13:02:55.598747 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:55.598632    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f8c70e98-14ec-48d9-8c30-2d63fa95c04e-original-pull-secret\") pod \"global-pull-secret-syncer-4wwrh\" (UID: \"f8c70e98-14ec-48d9-8c30-2d63fa95c04e\") " pod="kube-system/global-pull-secret-syncer-4wwrh"
Jul 20 13:02:55.600772 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:55.600735    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 20 13:02:55.612180 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:55.612111    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f8c70e98-14ec-48d9-8c30-2d63fa95c04e-original-pull-secret\") pod \"global-pull-secret-syncer-4wwrh\" (UID: \"f8c70e98-14ec-48d9-8c30-2d63fa95c04e\") " pod="kube-system/global-pull-secret-syncer-4wwrh"
Jul 20 13:02:55.699340 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:55.699297    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/84c98b82-b626-42a7-bce8-281d439e1772-metrics-certs\") pod \"network-metrics-daemon-9zclf\" (UID: \"84c98b82-b626-42a7-bce8-281d439e1772\") " pod="openshift-multus/network-metrics-daemon-9zclf"
Jul 20 13:02:55.701739 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:55.701715    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 20 13:02:55.712895 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:55.712866    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/84c98b82-b626-42a7-bce8-281d439e1772-metrics-certs\") pod \"network-metrics-daemon-9zclf\" (UID: \"84c98b82-b626-42a7-bce8-281d439e1772\") " pod="openshift-multus/network-metrics-daemon-9zclf"
Jul 20 13:02:55.799710 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:55.799666    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sgz85\" (UniqueName: \"kubernetes.io/projected/6a903657-acf4-4846-a7bd-b45e286216c1-kube-api-access-sgz85\") pod \"network-check-target-ck7q6\" (UID: \"6a903657-acf4-4846-a7bd-b45e286216c1\") " pod="openshift-network-diagnostics/network-check-target-ck7q6"
Jul 20 13:02:55.801847 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:55.801820    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 20 13:02:55.802923 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:55.802867    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4wwrh"
Jul 20 13:02:55.812397 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:55.812367    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 20 13:02:55.824393 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:55.824365    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sgz85\" (UniqueName: \"kubernetes.io/projected/6a903657-acf4-4846-a7bd-b45e286216c1-kube-api-access-sgz85\") pod \"network-check-target-ck7q6\" (UID: \"6a903657-acf4-4846-a7bd-b45e286216c1\") " pod="openshift-network-diagnostics/network-check-target-ck7q6"
Jul 20 13:02:55.908508 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:55.908434    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-m99kw\""
Jul 20 13:02:55.915900 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:55.915872    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-dbwl5\""
Jul 20 13:02:55.916896 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:55.916875    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ck7q6"
Jul 20 13:02:55.925089 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:55.925064    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9zclf"
Jul 20 13:02:56.501175 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:56.501147    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-9zclf"]
Jul 20 13:02:56.511580 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:02:56.511548    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod84c98b82_b626_42a7_bce8_281d439e1772.slice/crio-c769d45c7fd3199f9563971b027c40ff14f4087ac3a87f7805f0139bc164c868 WatchSource:0}: Error finding container c769d45c7fd3199f9563971b027c40ff14f4087ac3a87f7805f0139bc164c868: Status 404 returned error can't find the container with id c769d45c7fd3199f9563971b027c40ff14f4087ac3a87f7805f0139bc164c868
Jul 20 13:02:56.523748 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:56.523362    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-4wwrh"]
Jul 20 13:02:56.531624 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:02:56.531533    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf8c70e98_14ec_48d9_8c30_2d63fa95c04e.slice/crio-2715d29451fa5dac7fcbb557bbd5c6838dc45b4fb5f4bcc3012e1898fac0ca0a WatchSource:0}: Error finding container 2715d29451fa5dac7fcbb557bbd5c6838dc45b4fb5f4bcc3012e1898fac0ca0a: Status 404 returned error can't find the container with id 2715d29451fa5dac7fcbb557bbd5c6838dc45b4fb5f4bcc3012e1898fac0ca0a
Jul 20 13:02:56.544008 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:56.543960    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-ck7q6"]
Jul 20 13:02:56.547837 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:02:56.547809    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6a903657_acf4_4846_a7bd_b45e286216c1.slice/crio-a3ca806cbfbb3a28b4a65dc5f3500eba535db8c4c71cd6d7304fd840f3513e56 WatchSource:0}: Error finding container a3ca806cbfbb3a28b4a65dc5f3500eba535db8c4c71cd6d7304fd840f3513e56: Status 404 returned error can't find the container with id a3ca806cbfbb3a28b4a65dc5f3500eba535db8c4c71cd6d7304fd840f3513e56
Jul 20 13:02:57.420344 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:57.420301    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-9zclf" event={"ID":"84c98b82-b626-42a7-bce8-281d439e1772","Type":"ContainerStarted","Data":"c769d45c7fd3199f9563971b027c40ff14f4087ac3a87f7805f0139bc164c868"}
Jul 20 13:02:57.421600 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:57.421568    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-ck7q6" event={"ID":"6a903657-acf4-4846-a7bd-b45e286216c1","Type":"ContainerStarted","Data":"a3ca806cbfbb3a28b4a65dc5f3500eba535db8c4c71cd6d7304fd840f3513e56"}
Jul 20 13:02:57.423775 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:57.423748    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-5945b5cfd-p6cmm" event={"ID":"0b8795ff-8508-4d6d-a37a-e4cd0512990e","Type":"ContainerStarted","Data":"d3a6c038dab53e4e40099603d13e61a245588b76e31b325806e1536ae33c664d"}
Jul 20 13:02:57.423903 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:57.423805    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-5945b5cfd-p6cmm" event={"ID":"0b8795ff-8508-4d6d-a37a-e4cd0512990e","Type":"ContainerStarted","Data":"5df73b60a0678889d975fe6e29600763111ac5decb9d0c2288cd173fb5dd35f9"}
Jul 20 13:02:57.426139 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:57.426117    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-47dgd" event={"ID":"d968a7e1-9b1f-4a71-ac30-3ddf7f7907bf","Type":"ContainerStarted","Data":"a45f26554753a2e180bb4967c8d987960dc4c2f9552c50bb890c9b692acc9483"}
Jul 20 13:02:57.427433 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:57.427410    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-4wwrh" event={"ID":"f8c70e98-14ec-48d9-8c30-2d63fa95c04e","Type":"ContainerStarted","Data":"2715d29451fa5dac7fcbb557bbd5c6838dc45b4fb5f4bcc3012e1898fac0ca0a"}
Jul 20 13:02:57.462193 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:57.462139    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-5945b5cfd-p6cmm" podStartSLOduration=2.804151239 podStartE2EDuration="5.462117859s" totalImagesPullingTime="2.65796662s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 13:02:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 13:02:57.460541063 +0000 UTC m=+67.177088474" watchObservedRunningTime="2026-07-20 13:02:57.462117859 +0000 UTC m=+67.178665269"
Jul 20 13:02:57.489934 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:57.489880    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-47dgd" podStartSLOduration=2.411630949 podStartE2EDuration="17.489863806s" totalImagesPullingTime="15.078232857s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 13:02:40 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 13:02:57.488612889 +0000 UTC m=+67.205160299" watchObservedRunningTime="2026-07-20 13:02:57.489863806 +0000 UTC m=+67.206411211"
Jul 20 13:02:58.951889 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:58.951854    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-79f6958cdf-z7vtq"]
Jul 20 13:02:58.955326 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:58.955298    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-z7vtq"
Jul 20 13:02:58.957424 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:58.957398    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
Jul 20 13:02:58.957574 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:58.957546    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
Jul 20 13:02:58.957645 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:58.957551    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-sqc57\""
Jul 20 13:02:58.964829 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:58.964803    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-79f6958cdf-z7vtq"]
Jul 20 13:02:58.970928 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:58.970897    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-56c5594674-snpfl"]
Jul 20 13:02:58.973167 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:58.973148    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-56c5594674-snpfl"
Jul 20 13:02:58.974899 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:58.974876    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-c5r46\""
Jul 20 13:02:58.975340 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:58.975317    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
Jul 20 13:02:58.975631 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:58.975555    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
Jul 20 13:02:58.975737 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:58.975663    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
Jul 20 13:02:58.980013 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:58.979991    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-8v7s6"]
Jul 20 13:02:58.982200 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:58.982179    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-8v7s6"
Jul 20 13:02:58.984333 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:58.984142    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 20 13:02:58.984333 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:58.984319    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 20 13:02:58.984504 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:58.984369    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-6kdv7\""
Jul 20 13:02:58.984504 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:58.984398    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 20 13:02:58.990173 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:58.989721    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-56c5594674-snpfl"]
Jul 20 13:02:59.024937 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:59.024909    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ghj6w\" (UniqueName: \"kubernetes.io/projected/f7bb3088-03fd-4efb-996d-f52f6faad0bf-kube-api-access-ghj6w\") pod \"node-exporter-8v7s6\" (UID: \"f7bb3088-03fd-4efb-996d-f52f6faad0bf\") " pod="openshift-monitoring/node-exporter-8v7s6"
Jul 20 13:02:59.024937 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:59.024939    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7eb8230a-fac0-4584-95ea-5c10947196da-metrics-client-ca\") pod \"openshift-state-metrics-79f6958cdf-z7vtq\" (UID: \"7eb8230a-fac0-4584-95ea-5c10947196da\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-z7vtq"
Jul 20 13:02:59.025184 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:59.024981    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/02263690-62a5-457b-8b95-99d5500d9bad-kube-state-metrics-tls\") pod \"kube-state-metrics-56c5594674-snpfl\" (UID: \"02263690-62a5-457b-8b95-99d5500d9bad\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-snpfl"
Jul 20 13:02:59.025184 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:59.025034    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f7bb3088-03fd-4efb-996d-f52f6faad0bf-sys\") pod \"node-exporter-8v7s6\" (UID: \"f7bb3088-03fd-4efb-996d-f52f6faad0bf\") " pod="openshift-monitoring/node-exporter-8v7s6"
Jul 20 13:02:59.025184 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:59.025090    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f7bb3088-03fd-4efb-996d-f52f6faad0bf-metrics-client-ca\") pod \"node-exporter-8v7s6\" (UID: \"f7bb3088-03fd-4efb-996d-f52f6faad0bf\") " pod="openshift-monitoring/node-exporter-8v7s6"
Jul 20 13:02:59.025184 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:59.025154    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/f7bb3088-03fd-4efb-996d-f52f6faad0bf-node-exporter-wtmp\") pod \"node-exporter-8v7s6\" (UID: \"f7bb3088-03fd-4efb-996d-f52f6faad0bf\") " pod="openshift-monitoring/node-exporter-8v7s6"
Jul 20 13:02:59.025446 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:59.025193    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7eb8230a-fac0-4584-95ea-5c10947196da-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-79f6958cdf-z7vtq\" (UID: \"7eb8230a-fac0-4584-95ea-5c10947196da\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-z7vtq"
Jul 20 13:02:59.025446 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:59.025232    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/f7bb3088-03fd-4efb-996d-f52f6faad0bf-node-exporter-accelerators-collector-config\") pod \"node-exporter-8v7s6\" (UID: \"f7bb3088-03fd-4efb-996d-f52f6faad0bf\") " pod="openshift-monitoring/node-exporter-8v7s6"
Jul 20 13:02:59.025446 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:59.025275    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/f7bb3088-03fd-4efb-996d-f52f6faad0bf-node-exporter-tls\") pod \"node-exporter-8v7s6\" (UID: \"f7bb3088-03fd-4efb-996d-f52f6faad0bf\") " pod="openshift-monitoring/node-exporter-8v7s6"
Jul 20 13:02:59.025446 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:59.025332    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/f7bb3088-03fd-4efb-996d-f52f6faad0bf-node-exporter-textfile\") pod \"node-exporter-8v7s6\" (UID: \"f7bb3088-03fd-4efb-996d-f52f6faad0bf\") " pod="openshift-monitoring/node-exporter-8v7s6"
Jul 20 13:02:59.025446 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:59.025373    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/02263690-62a5-457b-8b95-99d5500d9bad-volume-directive-shadow\") pod \"kube-state-metrics-56c5594674-snpfl\" (UID: \"02263690-62a5-457b-8b95-99d5500d9bad\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-snpfl"
Jul 20 13:02:59.025446 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:59.025401    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/7eb8230a-fac0-4584-95ea-5c10947196da-openshift-state-metrics-tls\") pod \"openshift-state-metrics-79f6958cdf-z7vtq\" (UID: \"7eb8230a-fac0-4584-95ea-5c10947196da\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-z7vtq"
Jul 20 13:02:59.025446 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:59.025429    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nx4c8\" (UniqueName: \"kubernetes.io/projected/02263690-62a5-457b-8b95-99d5500d9bad-kube-api-access-nx4c8\") pod \"kube-state-metrics-56c5594674-snpfl\" (UID: \"02263690-62a5-457b-8b95-99d5500d9bad\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-snpfl"
Jul 20 13:02:59.025803 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:59.025465    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/f7bb3088-03fd-4efb-996d-f52f6faad0bf-root\") pod \"node-exporter-8v7s6\" (UID: \"f7bb3088-03fd-4efb-996d-f52f6faad0bf\") " pod="openshift-monitoring/node-exporter-8v7s6"
Jul 20 13:02:59.025803 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:59.025511    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/02263690-62a5-457b-8b95-99d5500d9bad-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56c5594674-snpfl\" (UID: \"02263690-62a5-457b-8b95-99d5500d9bad\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-snpfl"
Jul 20 13:02:59.025803 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:59.025585    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/02263690-62a5-457b-8b95-99d5500d9bad-metrics-client-ca\") pod \"kube-state-metrics-56c5594674-snpfl\" (UID: \"02263690-62a5-457b-8b95-99d5500d9bad\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-snpfl"
Jul 20 13:02:59.025803 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:59.025613    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/02263690-62a5-457b-8b95-99d5500d9bad-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56c5594674-snpfl\" (UID: \"02263690-62a5-457b-8b95-99d5500d9bad\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-snpfl"
Jul 20 13:02:59.025803 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:59.025631    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f7bb3088-03fd-4efb-996d-f52f6faad0bf-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-8v7s6\" (UID: \"f7bb3088-03fd-4efb-996d-f52f6faad0bf\") " pod="openshift-monitoring/node-exporter-8v7s6"
Jul 20 13:02:59.025803 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:59.025667    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4sv54\" (UniqueName: \"kubernetes.io/projected/7eb8230a-fac0-4584-95ea-5c10947196da-kube-api-access-4sv54\") pod \"openshift-state-metrics-79f6958cdf-z7vtq\" (UID: \"7eb8230a-fac0-4584-95ea-5c10947196da\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-z7vtq"
Jul 20 13:02:59.126859 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:59.126817    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f7bb3088-03fd-4efb-996d-f52f6faad0bf-metrics-client-ca\") pod \"node-exporter-8v7s6\" (UID: \"f7bb3088-03fd-4efb-996d-f52f6faad0bf\") " pod="openshift-monitoring/node-exporter-8v7s6"
Jul 20 13:02:59.127075 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:59.126872    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/f7bb3088-03fd-4efb-996d-f52f6faad0bf-node-exporter-wtmp\") pod \"node-exporter-8v7s6\" (UID: \"f7bb3088-03fd-4efb-996d-f52f6faad0bf\") " pod="openshift-monitoring/node-exporter-8v7s6"
Jul 20 13:02:59.127075 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:59.126938    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7eb8230a-fac0-4584-95ea-5c10947196da-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-79f6958cdf-z7vtq\" (UID: \"7eb8230a-fac0-4584-95ea-5c10947196da\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-z7vtq"
Jul 20 13:02:59.127075 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:59.126999    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/f7bb3088-03fd-4efb-996d-f52f6faad0bf-node-exporter-accelerators-collector-config\") pod \"node-exporter-8v7s6\" (UID: \"f7bb3088-03fd-4efb-996d-f52f6faad0bf\") " pod="openshift-monitoring/node-exporter-8v7s6"
Jul 20 13:02:59.127075 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:59.127035    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/f7bb3088-03fd-4efb-996d-f52f6faad0bf-node-exporter-tls\") pod \"node-exporter-8v7s6\" (UID: \"f7bb3088-03fd-4efb-996d-f52f6faad0bf\") " pod="openshift-monitoring/node-exporter-8v7s6"
Jul 20 13:02:59.127295 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:59.127075    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/f7bb3088-03fd-4efb-996d-f52f6faad0bf-node-exporter-textfile\") pod \"node-exporter-8v7s6\" (UID: \"f7bb3088-03fd-4efb-996d-f52f6faad0bf\") " pod="openshift-monitoring/node-exporter-8v7s6"
Jul 20 13:02:59.127295 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:59.127086    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/f7bb3088-03fd-4efb-996d-f52f6faad0bf-node-exporter-wtmp\") pod \"node-exporter-8v7s6\" (UID: \"f7bb3088-03fd-4efb-996d-f52f6faad0bf\") " pod="openshift-monitoring/node-exporter-8v7s6"
Jul 20 13:02:59.127295 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:59.127131    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/02263690-62a5-457b-8b95-99d5500d9bad-volume-directive-shadow\") pod \"kube-state-metrics-56c5594674-snpfl\" (UID: \"02263690-62a5-457b-8b95-99d5500d9bad\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-snpfl"
Jul 20 13:02:59.127642 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:59.127605    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/7eb8230a-fac0-4584-95ea-5c10947196da-openshift-state-metrics-tls\") pod \"openshift-state-metrics-79f6958cdf-z7vtq\" (UID: \"7eb8230a-fac0-4584-95ea-5c10947196da\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-z7vtq"
Jul 20 13:02:59.127794 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:59.127660    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nx4c8\" (UniqueName: \"kubernetes.io/projected/02263690-62a5-457b-8b95-99d5500d9bad-kube-api-access-nx4c8\") pod \"kube-state-metrics-56c5594674-snpfl\" (UID: \"02263690-62a5-457b-8b95-99d5500d9bad\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-snpfl"
Jul 20 13:02:59.127794 ip-10-0-134-121 kubenswrapper[2584]: E0720 13:02:59.127743    2584 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Jul 20 13:02:59.127794 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:59.127788    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/f7bb3088-03fd-4efb-996d-f52f6faad0bf-root\") pod \"node-exporter-8v7s6\" (UID: \"f7bb3088-03fd-4efb-996d-f52f6faad0bf\") " pod="openshift-monitoring/node-exporter-8v7s6"
Jul 20 13:02:59.127979 ip-10-0-134-121 kubenswrapper[2584]: E0720 13:02:59.127826    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f7bb3088-03fd-4efb-996d-f52f6faad0bf-node-exporter-tls podName:f7bb3088-03fd-4efb-996d-f52f6faad0bf nodeName:}" failed. No retries permitted until 2026-07-20 13:02:59.62780445 +0000 UTC m=+69.344351854 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/f7bb3088-03fd-4efb-996d-f52f6faad0bf-node-exporter-tls") pod "node-exporter-8v7s6" (UID: "f7bb3088-03fd-4efb-996d-f52f6faad0bf") : secret "node-exporter-tls" not found
Jul 20 13:02:59.127979 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:59.127848    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/02263690-62a5-457b-8b95-99d5500d9bad-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56c5594674-snpfl\" (UID: \"02263690-62a5-457b-8b95-99d5500d9bad\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-snpfl"
Jul 20 13:02:59.127979 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:59.127858    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/f7bb3088-03fd-4efb-996d-f52f6faad0bf-root\") pod \"node-exporter-8v7s6\" (UID: \"f7bb3088-03fd-4efb-996d-f52f6faad0bf\") " pod="openshift-monitoring/node-exporter-8v7s6"
Jul 20 13:02:59.127979 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:59.127895    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/02263690-62a5-457b-8b95-99d5500d9bad-metrics-client-ca\") pod \"kube-state-metrics-56c5594674-snpfl\" (UID: \"02263690-62a5-457b-8b95-99d5500d9bad\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-snpfl"
Jul 20 13:02:59.127979 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:59.127931    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/02263690-62a5-457b-8b95-99d5500d9bad-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56c5594674-snpfl\" (UID: \"02263690-62a5-457b-8b95-99d5500d9bad\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-snpfl"
Jul 20 13:02:59.129056 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:59.129008    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/02263690-62a5-457b-8b95-99d5500d9bad-volume-directive-shadow\") pod \"kube-state-metrics-56c5594674-snpfl\" (UID: \"02263690-62a5-457b-8b95-99d5500d9bad\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-snpfl"
Jul 20 13:02:59.129194 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:59.129174    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f7bb3088-03fd-4efb-996d-f52f6faad0bf-metrics-client-ca\") pod \"node-exporter-8v7s6\" (UID: \"f7bb3088-03fd-4efb-996d-f52f6faad0bf\") " pod="openshift-monitoring/node-exporter-8v7s6"
Jul 20 13:02:59.129835 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:59.129682    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/f7bb3088-03fd-4efb-996d-f52f6faad0bf-node-exporter-textfile\") pod \"node-exporter-8v7s6\" (UID: \"f7bb3088-03fd-4efb-996d-f52f6faad0bf\") " pod="openshift-monitoring/node-exporter-8v7s6"
Jul 20 13:02:59.130144 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:59.130119    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/f7bb3088-03fd-4efb-996d-f52f6faad0bf-node-exporter-accelerators-collector-config\") pod \"node-exporter-8v7s6\" (UID: \"f7bb3088-03fd-4efb-996d-f52f6faad0bf\") " pod="openshift-monitoring/node-exporter-8v7s6"
Jul 20 13:02:59.130221 ip-10-0-134-121 kubenswrapper[2584]: E0720 13:02:59.130200    2584 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found
Jul 20 13:02:59.130333 ip-10-0-134-121 kubenswrapper[2584]: E0720 13:02:59.130303    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7eb8230a-fac0-4584-95ea-5c10947196da-openshift-state-metrics-tls podName:7eb8230a-fac0-4584-95ea-5c10947196da nodeName:}" failed. No retries permitted until 2026-07-20 13:02:59.630243247 +0000 UTC m=+69.346790658 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/7eb8230a-fac0-4584-95ea-5c10947196da-openshift-state-metrics-tls") pod "openshift-state-metrics-79f6958cdf-z7vtq" (UID: "7eb8230a-fac0-4584-95ea-5c10947196da") : secret "openshift-state-metrics-tls" not found
Jul 20 13:02:59.130474 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:59.127994    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f7bb3088-03fd-4efb-996d-f52f6faad0bf-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-8v7s6\" (UID: \"f7bb3088-03fd-4efb-996d-f52f6faad0bf\") " pod="openshift-monitoring/node-exporter-8v7s6"
Jul 20 13:02:59.130945 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:59.130893    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/02263690-62a5-457b-8b95-99d5500d9bad-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56c5594674-snpfl\" (UID: \"02263690-62a5-457b-8b95-99d5500d9bad\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-snpfl"
Jul 20 13:02:59.132014 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:59.131114    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4sv54\" (UniqueName: \"kubernetes.io/projected/7eb8230a-fac0-4584-95ea-5c10947196da-kube-api-access-4sv54\") pod \"openshift-state-metrics-79f6958cdf-z7vtq\" (UID: \"7eb8230a-fac0-4584-95ea-5c10947196da\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-z7vtq"
Jul 20 13:02:59.132014 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:59.131179    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ghj6w\" (UniqueName: \"kubernetes.io/projected/f7bb3088-03fd-4efb-996d-f52f6faad0bf-kube-api-access-ghj6w\") pod \"node-exporter-8v7s6\" (UID: \"f7bb3088-03fd-4efb-996d-f52f6faad0bf\") " pod="openshift-monitoring/node-exporter-8v7s6"
Jul 20 13:02:59.132014 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:59.131197    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/02263690-62a5-457b-8b95-99d5500d9bad-metrics-client-ca\") pod \"kube-state-metrics-56c5594674-snpfl\" (UID: \"02263690-62a5-457b-8b95-99d5500d9bad\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-snpfl"
Jul 20 13:02:59.132014 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:59.131211    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7eb8230a-fac0-4584-95ea-5c10947196da-metrics-client-ca\") pod \"openshift-state-metrics-79f6958cdf-z7vtq\" (UID: \"7eb8230a-fac0-4584-95ea-5c10947196da\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-z7vtq"
Jul 20 13:02:59.132014 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:59.131378    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/02263690-62a5-457b-8b95-99d5500d9bad-kube-state-metrics-tls\") pod \"kube-state-metrics-56c5594674-snpfl\" (UID: \"02263690-62a5-457b-8b95-99d5500d9bad\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-snpfl"
Jul 20 13:02:59.132014 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:59.131385    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f7bb3088-03fd-4efb-996d-f52f6faad0bf-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-8v7s6\" (UID: \"f7bb3088-03fd-4efb-996d-f52f6faad0bf\") " pod="openshift-monitoring/node-exporter-8v7s6"
Jul 20 13:02:59.132014 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:59.131460    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f7bb3088-03fd-4efb-996d-f52f6faad0bf-sys\") pod \"node-exporter-8v7s6\" (UID: \"f7bb3088-03fd-4efb-996d-f52f6faad0bf\") " pod="openshift-monitoring/node-exporter-8v7s6"
Jul 20 13:02:59.132014 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:59.131583    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7eb8230a-fac0-4584-95ea-5c10947196da-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-79f6958cdf-z7vtq\" (UID: \"7eb8230a-fac0-4584-95ea-5c10947196da\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-z7vtq"
Jul 20 13:02:59.132014 ip-10-0-134-121 kubenswrapper[2584]: E0720 13:02:59.131641    2584 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found
Jul 20 13:02:59.132014 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:59.131929    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f7bb3088-03fd-4efb-996d-f52f6faad0bf-sys\") pod \"node-exporter-8v7s6\" (UID: \"f7bb3088-03fd-4efb-996d-f52f6faad0bf\") " pod="openshift-monitoring/node-exporter-8v7s6"
Jul 20 13:02:59.132014 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:59.131948    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7eb8230a-fac0-4584-95ea-5c10947196da-metrics-client-ca\") pod \"openshift-state-metrics-79f6958cdf-z7vtq\" (UID: \"7eb8230a-fac0-4584-95ea-5c10947196da\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-z7vtq"
Jul 20 13:02:59.134329 ip-10-0-134-121 kubenswrapper[2584]: E0720 13:02:59.132856    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/02263690-62a5-457b-8b95-99d5500d9bad-kube-state-metrics-tls podName:02263690-62a5-457b-8b95-99d5500d9bad nodeName:}" failed. No retries permitted until 2026-07-20 13:02:59.632809221 +0000 UTC m=+69.349356627 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/02263690-62a5-457b-8b95-99d5500d9bad-kube-state-metrics-tls") pod "kube-state-metrics-56c5594674-snpfl" (UID: "02263690-62a5-457b-8b95-99d5500d9bad") : secret "kube-state-metrics-tls" not found
Jul 20 13:02:59.134329 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:59.133231    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/02263690-62a5-457b-8b95-99d5500d9bad-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56c5594674-snpfl\" (UID: \"02263690-62a5-457b-8b95-99d5500d9bad\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-snpfl"
Jul 20 13:02:59.136598 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:59.136573    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nx4c8\" (UniqueName: \"kubernetes.io/projected/02263690-62a5-457b-8b95-99d5500d9bad-kube-api-access-nx4c8\") pod \"kube-state-metrics-56c5594674-snpfl\" (UID: \"02263690-62a5-457b-8b95-99d5500d9bad\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-snpfl"
Jul 20 13:02:59.139669 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:59.139635    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ghj6w\" (UniqueName: \"kubernetes.io/projected/f7bb3088-03fd-4efb-996d-f52f6faad0bf-kube-api-access-ghj6w\") pod \"node-exporter-8v7s6\" (UID: \"f7bb3088-03fd-4efb-996d-f52f6faad0bf\") " pod="openshift-monitoring/node-exporter-8v7s6"
Jul 20 13:02:59.140096 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:59.140074    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4sv54\" (UniqueName: \"kubernetes.io/projected/7eb8230a-fac0-4584-95ea-5c10947196da-kube-api-access-4sv54\") pod \"openshift-state-metrics-79f6958cdf-z7vtq\" (UID: \"7eb8230a-fac0-4584-95ea-5c10947196da\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-z7vtq"
Jul 20 13:02:59.636862 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:59.636817    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/02263690-62a5-457b-8b95-99d5500d9bad-kube-state-metrics-tls\") pod \"kube-state-metrics-56c5594674-snpfl\" (UID: \"02263690-62a5-457b-8b95-99d5500d9bad\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-snpfl"
Jul 20 13:02:59.637064 ip-10-0-134-121 kubenswrapper[2584]: E0720 13:02:59.637033    2584 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found
Jul 20 13:02:59.637140 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:59.637036    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/f7bb3088-03fd-4efb-996d-f52f6faad0bf-node-exporter-tls\") pod \"node-exporter-8v7s6\" (UID: \"f7bb3088-03fd-4efb-996d-f52f6faad0bf\") " pod="openshift-monitoring/node-exporter-8v7s6"
Jul 20 13:02:59.637140 ip-10-0-134-121 kubenswrapper[2584]: E0720 13:02:59.637113    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/02263690-62a5-457b-8b95-99d5500d9bad-kube-state-metrics-tls podName:02263690-62a5-457b-8b95-99d5500d9bad nodeName:}" failed. No retries permitted until 2026-07-20 13:03:00.637091591 +0000 UTC m=+70.353638987 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/02263690-62a5-457b-8b95-99d5500d9bad-kube-state-metrics-tls") pod "kube-state-metrics-56c5594674-snpfl" (UID: "02263690-62a5-457b-8b95-99d5500d9bad") : secret "kube-state-metrics-tls" not found
Jul 20 13:02:59.637260 ip-10-0-134-121 kubenswrapper[2584]: E0720 13:02:59.637141    2584 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Jul 20 13:02:59.637260 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:02:59.637178    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/7eb8230a-fac0-4584-95ea-5c10947196da-openshift-state-metrics-tls\") pod \"openshift-state-metrics-79f6958cdf-z7vtq\" (UID: \"7eb8230a-fac0-4584-95ea-5c10947196da\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-z7vtq"
Jul 20 13:02:59.637260 ip-10-0-134-121 kubenswrapper[2584]: E0720 13:02:59.637192    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f7bb3088-03fd-4efb-996d-f52f6faad0bf-node-exporter-tls podName:f7bb3088-03fd-4efb-996d-f52f6faad0bf nodeName:}" failed. No retries permitted until 2026-07-20 13:03:00.637175995 +0000 UTC m=+70.353723384 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/f7bb3088-03fd-4efb-996d-f52f6faad0bf-node-exporter-tls") pod "node-exporter-8v7s6" (UID: "f7bb3088-03fd-4efb-996d-f52f6faad0bf") : secret "node-exporter-tls" not found
Jul 20 13:02:59.637260 ip-10-0-134-121 kubenswrapper[2584]: E0720 13:02:59.637244    2584 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found
Jul 20 13:02:59.637465 ip-10-0-134-121 kubenswrapper[2584]: E0720 13:02:59.637284    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7eb8230a-fac0-4584-95ea-5c10947196da-openshift-state-metrics-tls podName:7eb8230a-fac0-4584-95ea-5c10947196da nodeName:}" failed. No retries permitted until 2026-07-20 13:03:00.637272481 +0000 UTC m=+70.353819871 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/7eb8230a-fac0-4584-95ea-5c10947196da-openshift-state-metrics-tls") pod "openshift-state-metrics-79f6958cdf-z7vtq" (UID: "7eb8230a-fac0-4584-95ea-5c10947196da") : secret "openshift-state-metrics-tls" not found
Jul 20 13:03:00.043774 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:03:00.043737    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 20 13:03:00.047662 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:03:00.047639    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 20 13:03:00.051336 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:03:00.050277    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jul 20 13:03:00.051336 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:03:00.050571    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-ph6sk\""
Jul 20 13:03:00.051336 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:03:00.050771    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jul 20 13:03:00.051336 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:03:00.050952    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jul 20 13:03:00.051624 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:03:00.051379    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jul 20 13:03:00.051624 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:03:00.051571    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jul 20 13:03:00.052272 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:03:00.051757    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jul 20 13:03:00.052272 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:03:00.051948    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jul 20 13:03:00.052272 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:03:00.052187    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jul 20 13:03:00.052493 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:03:00.052387    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jul 20 13:03:00.061491 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:03:00.061458    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 20 13:03:00.142559 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:03:00.142518    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d63e2b67-c210-4dd5-b7a4-38d325a1ad31-web-config\") pod \"alertmanager-main-0\" (UID: \"d63e2b67-c210-4dd5-b7a4-38d325a1ad31\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 13:03:00.142728 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:03:00.142630    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d63e2b67-c210-4dd5-b7a4-38d325a1ad31-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"d63e2b67-c210-4dd5-b7a4-38d325a1ad31\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 13:03:00.142728 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:03:00.142664    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/d63e2b67-c210-4dd5-b7a4-38d325a1ad31-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"d63e2b67-c210-4dd5-b7a4-38d325a1ad31\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 13:03:00.142728 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:03:00.142683    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/d63e2b67-c210-4dd5-b7a4-38d325a1ad31-config-volume\") pod \"alertmanager-main-0\" (UID: \"d63e2b67-c210-4dd5-b7a4-38d325a1ad31\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 13:03:00.142728 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:03:00.142722    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d63e2b67-c210-4dd5-b7a4-38d325a1ad31-tls-assets\") pod \"alertmanager-main-0\" (UID: \"d63e2b67-c210-4dd5-b7a4-38d325a1ad31\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 13:03:00.142930 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:03:00.142740    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d63e2b67-c210-4dd5-b7a4-38d325a1ad31-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"d63e2b67-c210-4dd5-b7a4-38d325a1ad31\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 13:03:00.142930 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:03:00.142779    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/d63e2b67-c210-4dd5-b7a4-38d325a1ad31-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"d63e2b67-c210-4dd5-b7a4-38d325a1ad31\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 13:03:00.142930 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:03:00.142835    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pq922\" (UniqueName: \"kubernetes.io/projected/d63e2b67-c210-4dd5-b7a4-38d325a1ad31-kube-api-access-pq922\") pod \"alertmanager-main-0\" (UID: \"d63e2b67-c210-4dd5-b7a4-38d325a1ad31\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 13:03:00.142930 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:03:00.142900    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d63e2b67-c210-4dd5-b7a4-38d325a1ad31-config-out\") pod \"alertmanager-main-0\" (UID: \"d63e2b67-c210-4dd5-b7a4-38d325a1ad31\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 13:03:00.143169 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:03:00.142947    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/d63e2b67-c210-4dd5-b7a4-38d325a1ad31-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"d63e2b67-c210-4dd5-b7a4-38d325a1ad31\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 13:03:00.143169 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:03:00.143012    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d63e2b67-c210-4dd5-b7a4-38d325a1ad31-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"d63e2b67-c210-4dd5-b7a4-38d325a1ad31\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 13:03:00.143169 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:03:00.143110    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/d63e2b67-c210-4dd5-b7a4-38d325a1ad31-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"d63e2b67-c210-4dd5-b7a4-38d325a1ad31\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 13:03:00.143169 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:03:00.143158    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d63e2b67-c210-4dd5-b7a4-38d325a1ad31-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"d63e2b67-c210-4dd5-b7a4-38d325a1ad31\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 13:03:00.244981 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:03:00.244925    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d63e2b67-c210-4dd5-b7a4-38d325a1ad31-tls-assets\") pod \"alertmanager-main-0\" (UID: \"d63e2b67-c210-4dd5-b7a4-38d325a1ad31\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 13:03:00.245134 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:03:00.244990    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d63e2b67-c210-4dd5-b7a4-38d325a1ad31-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"d63e2b67-c210-4dd5-b7a4-38d325a1ad31\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 13:03:00.245134 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:03:00.245019    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/d63e2b67-c210-4dd5-b7a4-38d325a1ad31-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"d63e2b67-c210-4dd5-b7a4-38d325a1ad31\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 13:03:00.245134 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:03:00.245048    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pq922\" (UniqueName: \"kubernetes.io/projected/d63e2b67-c210-4dd5-b7a4-38d325a1ad31-kube-api-access-pq922\") pod \"alertmanager-main-0\" (UID: \"d63e2b67-c210-4dd5-b7a4-38d325a1ad31\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 13:03:00.245134 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:03:00.245077    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d63e2b67-c210-4dd5-b7a4-38d325a1ad31-config-out\") pod \"alertmanager-main-0\" (UID: \"d63e2b67-c210-4dd5-b7a4-38d325a1ad31\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 13:03:00.245134 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:03:00.245107    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/d63e2b67-c210-4dd5-b7a4-38d325a1ad31-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"d63e2b67-c210-4dd5-b7a4-38d325a1ad31\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 13:03:00.245367 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:03:00.245141    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d63e2b67-c210-4dd5-b7a4-38d325a1ad31-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"d63e2b67-c210-4dd5-b7a4-38d325a1ad31\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 13:03:00.245367 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:03:00.245221    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/d63e2b67-c210-4dd5-b7a4-38d325a1ad31-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"d63e2b67-c210-4dd5-b7a4-38d325a1ad31\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 13:03:00.245367 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:03:00.245275    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d63e2b67-c210-4dd5-b7a4-38d325a1ad31-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"d63e2b67-c210-4dd5-b7a4-38d325a1ad31\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 13:03:00.245367 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:03:00.245320    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d63e2b67-c210-4dd5-b7a4-38d325a1ad31-web-config\") pod \"alertmanager-main-0\" (UID: \"d63e2b67-c210-4dd5-b7a4-38d325a1ad31\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 13:03:00.245556 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:03:00.245378    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d63e2b67-c210-4dd5-b7a4-38d325a1ad31-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"d63e2b67-c210-4dd5-b7a4-38d325a1ad31\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 13:03:00.245556 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:03:00.245402    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/d63e2b67-c210-4dd5-b7a4-38d325a1ad31-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"d63e2b67-c210-4dd5-b7a4-38d325a1ad31\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 13:03:00.245556 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:03:00.245421    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/d63e2b67-c210-4dd5-b7a4-38d325a1ad31-config-volume\") pod \"alertmanager-main-0\" (UID: \"d63e2b67-c210-4dd5-b7a4-38d325a1ad31\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 13:03:00.246230 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:03:00.245840    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d63e2b67-c210-4dd5-b7a4-38d325a1ad31-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"d63e2b67-c210-4dd5-b7a4-38d325a1ad31\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 13:03:00.246342 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:03:00.246274    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d63e2b67-c210-4dd5-b7a4-38d325a1ad31-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"d63e2b67-c210-4dd5-b7a4-38d325a1ad31\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 13:03:00.246403 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:03:00.246359    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/d63e2b67-c210-4dd5-b7a4-38d325a1ad31-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"d63e2b67-c210-4dd5-b7a4-38d325a1ad31\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 13:03:00.248596 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:03:00.248537    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/d63e2b67-c210-4dd5-b7a4-38d325a1ad31-config-volume\") pod \"alertmanager-main-0\" (UID: \"d63e2b67-c210-4dd5-b7a4-38d325a1ad31\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 13:03:00.250325 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:03:00.249259    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/d63e2b67-c210-4dd5-b7a4-38d325a1ad31-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"d63e2b67-c210-4dd5-b7a4-38d325a1ad31\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 13:03:00.250325 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:03:00.249723    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d63e2b67-c210-4dd5-b7a4-38d325a1ad31-tls-assets\") pod \"alertmanager-main-0\" (UID: \"d63e2b67-c210-4dd5-b7a4-38d325a1ad31\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 13:03:00.250325 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:03:00.250283    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/d63e2b67-c210-4dd5-b7a4-38d325a1ad31-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"d63e2b67-c210-4dd5-b7a4-38d325a1ad31\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 13:03:00.250325 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:03:00.250094    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d63e2b67-c210-4dd5-b7a4-38d325a1ad31-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"d63e2b67-c210-4dd5-b7a4-38d325a1ad31\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 13:03:00.250325 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:03:00.250217    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d63e2b67-c210-4dd5-b7a4-38d325a1ad31-config-out\") pod \"alertmanager-main-0\" (UID: \"d63e2b67-c210-4dd5-b7a4-38d325a1ad31\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 13:03:00.250635 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:03:00.250359    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d63e2b67-c210-4dd5-b7a4-38d325a1ad31-web-config\") pod \"alertmanager-main-0\" (UID: \"d63e2b67-c210-4dd5-b7a4-38d325a1ad31\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 13:03:00.251125 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:03:00.250877    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d63e2b67-c210-4dd5-b7a4-38d325a1ad31-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"d63e2b67-c210-4dd5-b7a4-38d325a1ad31\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 13:03:00.251125 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:03:00.251087    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/d63e2b67-c210-4dd5-b7a4-38d325a1ad31-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"d63e2b67-c210-4dd5-b7a4-38d325a1ad31\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 13:03:00.253415 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:03:00.253369    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pq922\" (UniqueName: \"kubernetes.io/projected/d63e2b67-c210-4dd5-b7a4-38d325a1ad31-kube-api-access-pq922\") pod \"alertmanager-main-0\" (UID: \"d63e2b67-c210-4dd5-b7a4-38d325a1ad31\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 13:03:00.364906 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:03:00.364873    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 20 13:03:00.441805 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:03:00.441746    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-9zclf" event={"ID":"84c98b82-b626-42a7-bce8-281d439e1772","Type":"ContainerStarted","Data":"4a4fcbd5aa8292c88424ee5fa7837e09f869499f2335af290171dbeb866c3641"}
Jul 20 13:03:00.442206 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:03:00.441820    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-9zclf" event={"ID":"84c98b82-b626-42a7-bce8-281d439e1772","Type":"ContainerStarted","Data":"d4e6213e5caf3494e955f4e57f9181ce508cc53e0c19b26f15875a2d83ba14e1"}
Jul 20 13:03:00.443957 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:03:00.443916    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-ck7q6" event={"ID":"6a903657-acf4-4846-a7bd-b45e286216c1","Type":"ContainerStarted","Data":"6170e21e0dad2abb37c7a84d23c085b9c199ac0f84844beb9b5a031adcd2d9a9"}
Jul 20 13:03:00.444124 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:03:00.444086    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-ck7q6"
Jul 20 13:03:00.457152 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:03:00.457100    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-9zclf" podStartSLOduration=65.80272687 podStartE2EDuration="1m9.457083487s" totalImagesPullingTime="3.654356617s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 13:01:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 13:03:00.45634323 +0000 UTC m=+70.172890642" watchObservedRunningTime="2026-07-20 13:03:00.457083487 +0000 UTC m=+70.173630897"
Jul 20 13:03:00.472517 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:03:00.472452    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-ck7q6" podStartSLOduration=66.525677414 podStartE2EDuration="1m9.472429727s" totalImagesPullingTime="2.946752313s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 13:01:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 13:03:00.470741826 +0000 UTC m=+70.187289237" watchObservedRunningTime="2026-07-20 13:03:00.472429727 +0000 UTC m=+70.188977342"
Jul 20 13:03:00.520851 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:03:00.520815    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 20 13:03:00.524508 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:03:00.524478    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd63e2b67_c210_4dd5_b7a4_38d325a1ad31.slice/crio-7a67c46251d9f065ec96f5401e0ec9793be35e59faaebd21f487213eef637f0f WatchSource:0}: Error finding container 7a67c46251d9f065ec96f5401e0ec9793be35e59faaebd21f487213eef637f0f: Status 404 returned error can't find the container with id 7a67c46251d9f065ec96f5401e0ec9793be35e59faaebd21f487213eef637f0f
Jul 20 13:03:00.651569 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:03:00.651478    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/7eb8230a-fac0-4584-95ea-5c10947196da-openshift-state-metrics-tls\") pod \"openshift-state-metrics-79f6958cdf-z7vtq\" (UID: \"7eb8230a-fac0-4584-95ea-5c10947196da\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-z7vtq"
Jul 20 13:03:00.651569 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:03:00.651539    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/02263690-62a5-457b-8b95-99d5500d9bad-kube-state-metrics-tls\") pod \"kube-state-metrics-56c5594674-snpfl\" (UID: \"02263690-62a5-457b-8b95-99d5500d9bad\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-snpfl"
Jul 20 13:03:00.651782 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:03:00.651618    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/f7bb3088-03fd-4efb-996d-f52f6faad0bf-node-exporter-tls\") pod \"node-exporter-8v7s6\" (UID: \"f7bb3088-03fd-4efb-996d-f52f6faad0bf\") " pod="openshift-monitoring/node-exporter-8v7s6"
Jul 20 13:03:00.654329 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:03:00.654287    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/02263690-62a5-457b-8b95-99d5500d9bad-kube-state-metrics-tls\") pod \"kube-state-metrics-56c5594674-snpfl\" (UID: \"02263690-62a5-457b-8b95-99d5500d9bad\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-snpfl"
Jul 20 13:03:00.654438 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:03:00.654302    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/f7bb3088-03fd-4efb-996d-f52f6faad0bf-node-exporter-tls\") pod \"node-exporter-8v7s6\" (UID: \"f7bb3088-03fd-4efb-996d-f52f6faad0bf\") " pod="openshift-monitoring/node-exporter-8v7s6"
Jul 20 13:03:00.654529 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:03:00.654510    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/7eb8230a-fac0-4584-95ea-5c10947196da-openshift-state-metrics-tls\") pod \"openshift-state-metrics-79f6958cdf-z7vtq\" (UID: \"7eb8230a-fac0-4584-95ea-5c10947196da\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-z7vtq"
Jul 20 13:03:00.767778 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:03:00.767736    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-z7vtq"
Jul 20 13:03:00.784864 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:03:00.784821    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-56c5594674-snpfl"
Jul 20 13:03:00.793033 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:03:00.792938    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-8v7s6"
Jul 20 13:03:00.803301 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:03:00.803270    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf7bb3088_03fd_4efb_996d_f52f6faad0bf.slice/crio-4ecc5426bfd7bee64b81b37717f7762f17df93185a4dec12f003b66c45e67d8c WatchSource:0}: Error finding container 4ecc5426bfd7bee64b81b37717f7762f17df93185a4dec12f003b66c45e67d8c: Status 404 returned error can't find the container with id 4ecc5426bfd7bee64b81b37717f7762f17df93185a4dec12f003b66c45e67d8c
Jul 20 13:03:00.927779 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:03:00.927700    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-79f6958cdf-z7vtq"]
Jul 20 13:03:00.931961 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:03:00.931923    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7eb8230a_fac0_4584_95ea_5c10947196da.slice/crio-2240630f1ac9f36ffc650753598b2531fc4f8de572772a5b1b7bad34a27bd662 WatchSource:0}: Error finding container 2240630f1ac9f36ffc650753598b2531fc4f8de572772a5b1b7bad34a27bd662: Status 404 returned error can't find the container with id 2240630f1ac9f36ffc650753598b2531fc4f8de572772a5b1b7bad34a27bd662
Jul 20 13:03:00.940597 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:03:00.940427    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-6c54f98c5d-9mmxz"]
Jul 20 13:03:00.943703 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:03:00.943683    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-6c54f98c5d-9mmxz"
Jul 20 13:03:00.945780 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:03:00.945759    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Jul 20 13:03:00.946071 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:03:00.946048    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-3rt3470u660lc\""
Jul 20 13:03:00.946229 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:03:00.946175    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-rcxmc\""
Jul 20 13:03:00.946295 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:03:00.946282    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Jul 20 13:03:00.946852 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:03:00.946606    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Jul 20 13:03:00.947214 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:03:00.947193    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Jul 20 13:03:00.947320 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:03:00.947301    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Jul 20 13:03:00.954411 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:03:00.954290    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-6c54f98c5d-9mmxz"]
Jul 20 13:03:00.956818 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:03:00.956796    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-56c5594674-snpfl"]
Jul 20 13:03:00.970135 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:03:00.970095    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod02263690_62a5_457b_8b95_99d5500d9bad.slice/crio-c59a7547a2f83ec635b14eec6ab79ddd1a79f08e5ce0e7d0eb4ecda2adb89217 WatchSource:0}: Error finding container c59a7547a2f83ec635b14eec6ab79ddd1a79f08e5ce0e7d0eb4ecda2adb89217: Status 404 returned error can't find the container with id c59a7547a2f83ec635b14eec6ab79ddd1a79f08e5ce0e7d0eb4ecda2adb89217
Jul 20 13:03:01.056655 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:03:01.056623    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/7182f153-b087-40d6-9fe5-5f6262e5b8d5-secret-grpc-tls\") pod \"thanos-querier-6c54f98c5d-9mmxz\" (UID: \"7182f153-b087-40d6-9fe5-5f6262e5b8d5\") " pod="openshift-monitoring/thanos-querier-6c54f98c5d-9mmxz"
Jul 20 13:03:01.057073 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:03:01.056674    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/7182f153-b087-40d6-9fe5-5f6262e5b8d5-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6c54f98c5d-9mmxz\" (UID: \"7182f153-b087-40d6-9fe5-5f6262e5b8d5\") " pod="openshift-monitoring/thanos-querier-6c54f98c5d-9mmxz"
Jul 20 13:03:01.057073 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:03:01.056705    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/7182f153-b087-40d6-9fe5-5f6262e5b8d5-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6c54f98c5d-9mmxz\" (UID: \"7182f153-b087-40d6-9fe5-5f6262e5b8d5\") " pod="openshift-monitoring/thanos-querier-6c54f98c5d-9mmxz"
Jul 20 13:03:01.057073 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:03:01.056729    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/7182f153-b087-40d6-9fe5-5f6262e5b8d5-secret-thanos-querier-tls\") pod \"thanos-querier-6c54f98c5d-9mmxz\" (UID: \"7182f153-b087-40d6-9fe5-5f6262e5b8d5\") " pod="openshift-monitoring/thanos-querier-6c54f98c5d-9mmxz"
Jul 20 13:03:01.057073 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:03:01.056776    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7182f153-b087-40d6-9fe5-5f6262e5b8d5-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6c54f98c5d-9mmxz\" (UID: \"7182f153-b087-40d6-9fe5-5f6262e5b8d5\") " pod="openshift-monitoring/thanos-querier-6c54f98c5d-9mmxz"
Jul 20 13:03:01.057073 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:03:01.056797    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7182f153-b087-40d6-9fe5-5f6262e5b8d5-metrics-client-ca\") pod \"thanos-querier-6c54f98c5d-9mmxz\" (UID: \"7182f153-b087-40d6-9fe5-5f6262e5b8d5\") " pod="openshift-monitoring/thanos-querier-6c54f98c5d-9mmxz"
Jul 20 13:03:01.057073 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:03:01.056822    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sqx9t\" (UniqueName: \"kubernetes.io/projected/7182f153-b087-40d6-9fe5-5f6262e5b8d5-kube-api-access-sqx9t\") pod \"thanos-querier-6c54f98c5d-9mmxz\" (UID: \"7182f153-b087-40d6-9fe5-5f6262e5b8d5\") " pod="openshift-monitoring/thanos-querier-6c54f98c5d-9mmxz"
Jul 20 13:03:01.057073 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:03:01.056925    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7182f153-b087-40d6-9fe5-5f6262e5b8d5-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6c54f98c5d-9mmxz\" (UID: \"7182f153-b087-40d6-9fe5-5f6262e5b8d5\") " pod="openshift-monitoring/thanos-querier-6c54f98c5d-9mmxz"
Jul 20 13:03:01.158250 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:03:01.158207    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/7182f153-b087-40d6-9fe5-5f6262e5b8d5-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6c54f98c5d-9mmxz\" (UID: \"7182f153-b087-40d6-9fe5-5f6262e5b8d5\") " pod="openshift-monitoring/thanos-querier-6c54f98c5d-9mmxz"
Jul 20 13:03:01.158422 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:03:01.158260    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/7182f153-b087-40d6-9fe5-5f6262e5b8d5-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6c54f98c5d-9mmxz\" (UID: \"7182f153-b087-40d6-9fe5-5f6262e5b8d5\") " pod="openshift-monitoring/thanos-querier-6c54f98c5d-9mmxz"
Jul 20 13:03:01.158422 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:03:01.158301    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/7182f153-b087-40d6-9fe5-5f6262e5b8d5-secret-thanos-querier-tls\") pod \"thanos-querier-6c54f98c5d-9mmxz\" (UID: \"7182f153-b087-40d6-9fe5-5f6262e5b8d5\") " pod="openshift-monitoring/thanos-querier-6c54f98c5d-9mmxz"
Jul 20 13:03:01.158422 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:03:01.158356    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7182f153-b087-40d6-9fe5-5f6262e5b8d5-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6c54f98c5d-9mmxz\" (UID: \"7182f153-b087-40d6-9fe5-5f6262e5b8d5\") " pod="openshift-monitoring/thanos-querier-6c54f98c5d-9mmxz"
Jul 20 13:03:01.158597 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:03:01.158527    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7182f153-b087-40d6-9fe5-5f6262e5b8d5-metrics-client-ca\") pod \"thanos-querier-6c54f98c5d-9mmxz\" (UID: \"7182f153-b087-40d6-9fe5-5f6262e5b8d5\") " pod="openshift-monitoring/thanos-querier-6c54f98c5d-9mmxz"
Jul 20 13:03:01.158648 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:03:01.158592    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sqx9t\" (UniqueName: \"kubernetes.io/projected/7182f153-b087-40d6-9fe5-5f6262e5b8d5-kube-api-access-sqx9t\") pod \"thanos-querier-6c54f98c5d-9mmxz\" (UID: \"7182f153-b087-40d6-9fe5-5f6262e5b8d5\") " pod="openshift-monitoring/thanos-querier-6c54f98c5d-9mmxz"
Jul 20 13:03:01.158695 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:03:01.158666    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7182f153-b087-40d6-9fe5-5f6262e5b8d5-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6c54f98c5d-9mmxz\" (UID: \"7182f153-b087-40d6-9fe5-5f6262e5b8d5\") " pod="openshift-monitoring/thanos-querier-6c54f98c5d-9mmxz"
Jul 20 13:03:01.158756 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:03:01.158736    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/7182f153-b087-40d6-9fe5-5f6262e5b8d5-secret-grpc-tls\") pod \"thanos-querier-6c54f98c5d-9mmxz\" (UID: \"7182f153-b087-40d6-9fe5-5f6262e5b8d5\") " pod="openshift-monitoring/thanos-querier-6c54f98c5d-9mmxz"
Jul 20 13:03:01.159374 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:03:01.159310    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7182f153-b087-40d6-9fe5-5f6262e5b8d5-metrics-client-ca\") pod \"thanos-querier-6c54f98c5d-9mmxz\" (UID: \"7182f153-b087-40d6-9fe5-5f6262e5b8d5\") " pod="openshift-monitoring/thanos-querier-6c54f98c5d-9mmxz"
Jul 20 13:03:01.162232 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:03:01.161983    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7182f153-b087-40d6-9fe5-5f6262e5b8d5-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6c54f98c5d-9mmxz\" (UID: \"7182f153-b087-40d6-9fe5-5f6262e5b8d5\") " pod="openshift-monitoring/thanos-querier-6c54f98c5d-9mmxz"
Jul 20 13:03:01.162232 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:03:01.162171    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/7182f153-b087-40d6-9fe5-5f6262e5b8d5-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6c54f98c5d-9mmxz\" (UID: \"7182f153-b087-40d6-9fe5-5f6262e5b8d5\") " pod="openshift-monitoring/thanos-querier-6c54f98c5d-9mmxz"
Jul 20 13:03:01.162678 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:03:01.162648    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/7182f153-b087-40d6-9fe5-5f6262e5b8d5-secret-thanos-querier-tls\") pod \"thanos-querier-6c54f98c5d-9mmxz\" (UID: \"7182f153-b087-40d6-9fe5-5f6262e5b8d5\") " pod="openshift-monitoring/thanos-querier-6c54f98c5d-9mmxz"
Jul 20 13:03:01.163066 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:03:01.163037    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7182f153-b087-40d6-9fe5-5f6262e5b8d5-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6c54f98c5d-9mmxz\" (UID: \"7182f153-b087-40d6-9fe5-5f6262e5b8d5\") " pod="openshift-monitoring/thanos-querier-6c54f98c5d-9mmxz"
Jul 20 13:03:01.163529 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:03:01.163504    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/7182f153-b087-40d6-9fe5-5f6262e5b8d5-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6c54f98c5d-9mmxz\" (UID: \"7182f153-b087-40d6-9fe5-5f6262e5b8d5\") " pod="openshift-monitoring/thanos-querier-6c54f98c5d-9mmxz"
Jul 20 13:03:01.163847 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:03:01.163814    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/7182f153-b087-40d6-9fe5-5f6262e5b8d5-secret-grpc-tls\") pod \"thanos-querier-6c54f98c5d-9mmxz\" (UID: \"7182f153-b087-40d6-9fe5-5f6262e5b8d5\") " pod="openshift-monitoring/thanos-querier-6c54f98c5d-9mmxz"
Jul 20 13:03:01.166178 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:03:01.166150    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sqx9t\" (UniqueName: \"kubernetes.io/projected/7182f153-b087-40d6-9fe5-5f6262e5b8d5-kube-api-access-sqx9t\") pod \"thanos-querier-6c54f98c5d-9mmxz\" (UID: \"7182f153-b087-40d6-9fe5-5f6262e5b8d5\") " pod="openshift-monitoring/thanos-querier-6c54f98c5d-9mmxz"
Jul 20 13:03:01.259380 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:03:01.259342    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-6c54f98c5d-9mmxz"
Jul 20 13:03:01.453347 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:03:01.453305    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-6c54f98c5d-9mmxz"]
Jul 20 13:03:01.454001 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:03:01.453790    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56c5594674-snpfl" event={"ID":"02263690-62a5-457b-8b95-99d5500d9bad","Type":"ContainerStarted","Data":"c59a7547a2f83ec635b14eec6ab79ddd1a79f08e5ce0e7d0eb4ecda2adb89217"}
Jul 20 13:03:01.456374 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:03:01.456332    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-8v7s6" event={"ID":"f7bb3088-03fd-4efb-996d-f52f6faad0bf","Type":"ContainerStarted","Data":"4ecc5426bfd7bee64b81b37717f7762f17df93185a4dec12f003b66c45e67d8c"}
Jul 20 13:03:01.457899 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:03:01.457872    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7182f153_b087_40d6_9fe5_5f6262e5b8d5.slice/crio-d043e8750fc68035d703deda2066abb2f9c7b66fa541d07e3967eb11e6435e24 WatchSource:0}: Error finding container d043e8750fc68035d703deda2066abb2f9c7b66fa541d07e3967eb11e6435e24: Status 404 returned error can't find the container with id d043e8750fc68035d703deda2066abb2f9c7b66fa541d07e3967eb11e6435e24
Jul 20 13:03:01.459243 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:03:01.459103    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-z7vtq" event={"ID":"7eb8230a-fac0-4584-95ea-5c10947196da","Type":"ContainerStarted","Data":"a0a596a54164371f2a381252e378b017c52a9af18214b781e65d9f67cffefe13"}
Jul 20 13:03:01.459243 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:03:01.459163    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-z7vtq" event={"ID":"7eb8230a-fac0-4584-95ea-5c10947196da","Type":"ContainerStarted","Data":"919ed160b136548a0cbb9e778cb4745f019b41ff7304295362627cdc60cb4d21"}
Jul 20 13:03:01.459243 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:03:01.459190    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-z7vtq" event={"ID":"7eb8230a-fac0-4584-95ea-5c10947196da","Type":"ContainerStarted","Data":"2240630f1ac9f36ffc650753598b2531fc4f8de572772a5b1b7bad34a27bd662"}
Jul 20 13:03:01.461002 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:03:01.460752    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d63e2b67-c210-4dd5-b7a4-38d325a1ad31","Type":"ContainerStarted","Data":"7a67c46251d9f065ec96f5401e0ec9793be35e59faaebd21f487213eef637f0f"}
Jul 20 13:03:02.407956 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:03:02.407923    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-f455799dc-b75cl"
Jul 20 13:03:02.408402 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:03:02.408000    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-f455799dc-b75cl"
Jul 20 13:03:02.413090 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:03:02.413065    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-f455799dc-b75cl"
Jul 20 13:03:02.466012 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:03:02.465952    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6c54f98c5d-9mmxz" event={"ID":"7182f153-b087-40d6-9fe5-5f6262e5b8d5","Type":"ContainerStarted","Data":"d043e8750fc68035d703deda2066abb2f9c7b66fa541d07e3967eb11e6435e24"}
Jul 20 13:03:02.471895 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:03:02.471870    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-f455799dc-b75cl"
Jul 20 13:03:02.514422 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:03:02.514384    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-87b8c76b7-t69n9"]
Jul 20 13:03:03.257940 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:03:03.257899    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-99f7c65fb-drlms"]
Jul 20 13:03:03.261157 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:03:03.261133    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-99f7c65fb-drlms"
Jul 20 13:03:03.264926 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:03:03.264826    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-7rf7kr8pio591\""
Jul 20 13:03:03.264926 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:03:03.264857    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
Jul 20 13:03:03.265133 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:03:03.265016    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
Jul 20 13:03:03.265133 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:03:03.265084    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-lpnkf\""
Jul 20 13:03:03.265133 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:03:03.265120    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
Jul 20 13:03:03.265276 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:03:03.265203    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 20 13:03:03.270926 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:03:03.270902    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-99f7c65fb-drlms"]
Jul 20 13:03:03.380268 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:03:03.380226    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/8d8b5614-e433-4ea8-a62d-df0cce8ef3b5-secret-metrics-server-tls\") pod \"metrics-server-99f7c65fb-drlms\" (UID: \"8d8b5614-e433-4ea8-a62d-df0cce8ef3b5\") " pod="openshift-monitoring/metrics-server-99f7c65fb-drlms"
Jul 20 13:03:03.380475 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:03:03.380273    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8d8b5614-e433-4ea8-a62d-df0cce8ef3b5-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-99f7c65fb-drlms\" (UID: \"8d8b5614-e433-4ea8-a62d-df0cce8ef3b5\") " pod="openshift-monitoring/metrics-server-99f7c65fb-drlms"
Jul 20 13:03:03.380475 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:03:03.380386    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/8d8b5614-e433-4ea8-a62d-df0cce8ef3b5-audit-log\") pod \"metrics-server-99f7c65fb-drlms\" (UID: \"8d8b5614-e433-4ea8-a62d-df0cce8ef3b5\") " pod="openshift-monitoring/metrics-server-99f7c65fb-drlms"
Jul 20 13:03:03.380475 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:03:03.380435    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pj8l4\" (UniqueName: \"kubernetes.io/projected/8d8b5614-e433-4ea8-a62d-df0cce8ef3b5-kube-api-access-pj8l4\") pod \"metrics-server-99f7c65fb-drlms\" (UID: \"8d8b5614-e433-4ea8-a62d-df0cce8ef3b5\") " pod="openshift-monitoring/metrics-server-99f7c65fb-drlms"
Jul 20 13:03:03.380632 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:03:03.380499    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/8d8b5614-e433-4ea8-a62d-df0cce8ef3b5-secret-metrics-server-client-certs\") pod \"metrics-server-99f7c65fb-drlms\" (UID: \"8d8b5614-e433-4ea8-a62d-df0cce8ef3b5\") " pod="openshift-monitoring/metrics-server-99f7c65fb-drlms"
Jul 20 13:03:03.380632 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:03:03.380542    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8d8b5614-e433-4ea8-a62d-df0cce8ef3b5-client-ca-bundle\") pod \"metrics-server-99f7c65fb-drlms\" (UID: \"8d8b5614-e433-4ea8-a62d-df0cce8ef3b5\") " pod="openshift-monitoring/metrics-server-99f7c65fb-drlms"
Jul 20 13:03:03.380632 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:03:03.380568    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/8d8b5614-e433-4ea8-a62d-df0cce8ef3b5-metrics-server-audit-profiles\") pod \"metrics-server-99f7c65fb-drlms\" (UID: \"8d8b5614-e433-4ea8-a62d-df0cce8ef3b5\") " pod="openshift-monitoring/metrics-server-99f7c65fb-drlms"
Jul 20 13:03:03.482074 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:03:03.482033    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pj8l4\" (UniqueName: \"kubernetes.io/projected/8d8b5614-e433-4ea8-a62d-df0cce8ef3b5-kube-api-access-pj8l4\") pod \"metrics-server-99f7c65fb-drlms\" (UID: \"8d8b5614-e433-4ea8-a62d-df0cce8ef3b5\") " pod="openshift-monitoring/metrics-server-99f7c65fb-drlms"
Jul 20 13:03:03.482543 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:03:03.482107    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/8d8b5614-e433-4ea8-a62d-df0cce8ef3b5-secret-metrics-server-client-certs\") pod \"metrics-server-99f7c65fb-drlms\" (UID: \"8d8b5614-e433-4ea8-a62d-df0cce8ef3b5\") " pod="openshift-monitoring/metrics-server-99f7c65fb-drlms"
Jul 20 13:03:03.482543 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:03:03.482154    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8d8b5614-e433-4ea8-a62d-df0cce8ef3b5-client-ca-bundle\") pod \"metrics-server-99f7c65fb-drlms\" (UID: \"8d8b5614-e433-4ea8-a62d-df0cce8ef3b5\") " pod="openshift-monitoring/metrics-server-99f7c65fb-drlms"
Jul 20 13:03:03.482543 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:03:03.482180    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/8d8b5614-e433-4ea8-a62d-df0cce8ef3b5-metrics-server-audit-profiles\") pod \"metrics-server-99f7c65fb-drlms\" (UID: \"8d8b5614-e433-4ea8-a62d-df0cce8ef3b5\") " pod="openshift-monitoring/metrics-server-99f7c65fb-drlms"
Jul 20 13:03:03.482543 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:03:03.482242    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/8d8b5614-e433-4ea8-a62d-df0cce8ef3b5-secret-metrics-server-tls\") pod \"metrics-server-99f7c65fb-drlms\" (UID: \"8d8b5614-e433-4ea8-a62d-df0cce8ef3b5\") " pod="openshift-monitoring/metrics-server-99f7c65fb-drlms"
Jul 20 13:03:03.482543 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:03:03.482277    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8d8b5614-e433-4ea8-a62d-df0cce8ef3b5-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-99f7c65fb-drlms\" (UID: \"8d8b5614-e433-4ea8-a62d-df0cce8ef3b5\") " pod="openshift-monitoring/metrics-server-99f7c65fb-drlms"
Jul 20 13:03:03.482543 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:03:03.482315    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/8d8b5614-e433-4ea8-a62d-df0cce8ef3b5-audit-log\") pod \"metrics-server-99f7c65fb-drlms\" (UID: \"8d8b5614-e433-4ea8-a62d-df0cce8ef3b5\") " pod="openshift-monitoring/metrics-server-99f7c65fb-drlms"
Jul 20 13:03:03.482851 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:03:03.482792    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/8d8b5614-e433-4ea8-a62d-df0cce8ef3b5-audit-log\") pod \"metrics-server-99f7c65fb-drlms\" (UID: \"8d8b5614-e433-4ea8-a62d-df0cce8ef3b5\") " pod="openshift-monitoring/metrics-server-99f7c65fb-drlms"
Jul 20 13:03:03.483103 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:03:03.483078    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8d8b5614-e433-4ea8-a62d-df0cce8ef3b5-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-99f7c65fb-drlms\" (UID: \"8d8b5614-e433-4ea8-a62d-df0cce8ef3b5\") " pod="openshift-monitoring/metrics-server-99f7c65fb-drlms"
Jul 20 13:03:03.483289 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:03:03.483271    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/8d8b5614-e433-4ea8-a62d-df0cce8ef3b5-metrics-server-audit-profiles\") pod \"metrics-server-99f7c65fb-drlms\" (UID: \"8d8b5614-e433-4ea8-a62d-df0cce8ef3b5\") " pod="openshift-monitoring/metrics-server-99f7c65fb-drlms"
Jul 20 13:03:03.485092 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:03:03.485066    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8d8b5614-e433-4ea8-a62d-df0cce8ef3b5-client-ca-bundle\") pod \"metrics-server-99f7c65fb-drlms\" (UID: \"8d8b5614-e433-4ea8-a62d-df0cce8ef3b5\") " pod="openshift-monitoring/metrics-server-99f7c65fb-drlms"
Jul 20 13:03:03.485197 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:03:03.485173    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/8d8b5614-e433-4ea8-a62d-df0cce8ef3b5-secret-metrics-server-client-certs\") pod \"metrics-server-99f7c65fb-drlms\" (UID: \"8d8b5614-e433-4ea8-a62d-df0cce8ef3b5\") " pod="openshift-monitoring/metrics-server-99f7c65fb-drlms"
Jul 20 13:03:03.485291 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:03:03.485269    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/8d8b5614-e433-4ea8-a62d-df0cce8ef3b5-secret-metrics-server-tls\") pod \"metrics-server-99f7c65fb-drlms\" (UID: \"8d8b5614-e433-4ea8-a62d-df0cce8ef3b5\") " pod="openshift-monitoring/metrics-server-99f7c65fb-drlms"
Jul 20 13:03:03.490202 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:03:03.490168    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pj8l4\" (UniqueName: \"kubernetes.io/projected/8d8b5614-e433-4ea8-a62d-df0cce8ef3b5-kube-api-access-pj8l4\") pod \"metrics-server-99f7c65fb-drlms\" (UID: \"8d8b5614-e433-4ea8-a62d-df0cce8ef3b5\") " pod="openshift-monitoring/metrics-server-99f7c65fb-drlms"
Jul 20 13:03:03.574013 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:03:03.573911    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-99f7c65fb-drlms"
Jul 20 13:03:03.755109 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:03:03.755068    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-7b7b7bc8bf-g5s74"]
Jul 20 13:03:03.757636 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:03:03.757611    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-g5s74"
Jul 20 13:03:03.759628 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:03:03.759544    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-tk979\""
Jul 20 13:03:03.759783 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:03:03.759671    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Jul 20 13:03:03.770419 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:03:03.770366    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-7b7b7bc8bf-g5s74"]
Jul 20 13:03:03.885795 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:03:03.885705    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/4b2de50d-d756-4967-97f4-c470056f4e1a-monitoring-plugin-cert\") pod \"monitoring-plugin-7b7b7bc8bf-g5s74\" (UID: \"4b2de50d-d756-4967-97f4-c470056f4e1a\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-g5s74"
Jul 20 13:03:03.885795 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:03:03.885792    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ftzpl\" (UniqueName: \"kubernetes.io/projected/4b2de50d-d756-4967-97f4-c470056f4e1a-kube-api-access-ftzpl\") pod \"monitoring-plugin-7b7b7bc8bf-g5s74\" (UID: \"4b2de50d-d756-4967-97f4-c470056f4e1a\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-g5s74"
Jul 20 13:03:03.987097 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:03:03.987056    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/4b2de50d-d756-4967-97f4-c470056f4e1a-monitoring-plugin-cert\") pod \"monitoring-plugin-7b7b7bc8bf-g5s74\" (UID: \"4b2de50d-d756-4967-97f4-c470056f4e1a\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-g5s74"
Jul 20 13:03:03.987282 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:03:03.987172    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ftzpl\" (UniqueName: \"kubernetes.io/projected/4b2de50d-d756-4967-97f4-c470056f4e1a-kube-api-access-ftzpl\") pod \"monitoring-plugin-7b7b7bc8bf-g5s74\" (UID: \"4b2de50d-d756-4967-97f4-c470056f4e1a\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-g5s74"
Jul 20 13:03:03.990190 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:03:03.990164    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/4b2de50d-d756-4967-97f4-c470056f4e1a-monitoring-plugin-cert\") pod \"monitoring-plugin-7b7b7bc8bf-g5s74\" (UID: \"4b2de50d-d756-4967-97f4-c470056f4e1a\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-g5s74"
Jul 20 13:03:03.995150 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:03:03.995122    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ftzpl\" (UniqueName: \"kubernetes.io/projected/4b2de50d-d756-4967-97f4-c470056f4e1a-kube-api-access-ftzpl\") pod \"monitoring-plugin-7b7b7bc8bf-g5s74\" (UID: \"4b2de50d-d756-4967-97f4-c470056f4e1a\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-g5s74"
Jul 20 13:03:04.068827 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:03:04.068788    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-g5s74"
Jul 20 13:03:04.946530 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:03:04.945986    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-7b7b7bc8bf-g5s74"]
Jul 20 13:03:04.967595 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:03:04.967535    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4b2de50d_d756_4967_97f4_c470056f4e1a.slice/crio-4f2461c4e11b32cbc034026c748a7573a823599f17c434b61b183ce14302904e WatchSource:0}: Error finding container 4f2461c4e11b32cbc034026c748a7573a823599f17c434b61b183ce14302904e: Status 404 returned error can't find the container with id 4f2461c4e11b32cbc034026c748a7573a823599f17c434b61b183ce14302904e
Jul 20 13:03:04.991455 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:03:04.991133    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-99f7c65fb-drlms"]
Jul 20 13:03:05.293370 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:03:05.292928    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 20 13:03:05.297239 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:03:05.297214    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 13:03:05.300069 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:03:05.300042    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 20 13:03:05.300181 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:03:05.300111    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 20 13:03:05.300361 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:03:05.300344    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-4z5n8\""
Jul 20 13:03:05.300443 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:03:05.300378    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 20 13:03:05.300722 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:03:05.300701    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 20 13:03:05.300835 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:03:05.300818    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 20 13:03:05.300917 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:03:05.300900    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 20 13:03:05.301101 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:03:05.301086    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 20 13:03:05.301194 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:03:05.301182    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 20 13:03:05.301301 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:03:05.301285    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-735b6hp2i0lti\""
Jul 20 13:03:05.301499 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:03:05.301484    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 20 13:03:05.301694 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:03:05.301667    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 20 13:03:05.301883 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:03:05.301864    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 20 13:03:05.302101 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:03:05.301888    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 20 13:03:05.304181 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:03:05.304156    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 20 13:03:05.307751 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:03:05.307020    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 20 13:03:05.312518 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:03:05.312488    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 20 13:03:05.401371 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:03:05.401339    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/724334da-f6a6-44fd-a04b-971fffbb3149-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"724334da-f6a6-44fd-a04b-971fffbb3149\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 13:03:05.401371 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:03:05.401375    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/724334da-f6a6-44fd-a04b-971fffbb3149-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"724334da-f6a6-44fd-a04b-971fffbb3149\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 13:03:05.401590 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:03:05.401393    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c5jjk\" (UniqueName: \"kubernetes.io/projected/724334da-f6a6-44fd-a04b-971fffbb3149-kube-api-access-c5jjk\") pod \"prometheus-k8s-0\" (UID: \"724334da-f6a6-44fd-a04b-971fffbb3149\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 13:03:05.401590 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:03:05.401417    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/724334da-f6a6-44fd-a04b-971fffbb3149-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"724334da-f6a6-44fd-a04b-971fffbb3149\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 13:03:05.401590 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:03:05.401436    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/724334da-f6a6-44fd-a04b-971fffbb3149-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"724334da-f6a6-44fd-a04b-971fffbb3149\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 13:03:05.401590 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:03:05.401460    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/724334da-f6a6-44fd-a04b-971fffbb3149-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"724334da-f6a6-44fd-a04b-971fffbb3149\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 13:03:05.401590 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:03:05.401510    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/724334da-f6a6-44fd-a04b-971fffbb3149-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"724334da-f6a6-44fd-a04b-971fffbb3149\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 13:03:05.401590 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:03:05.401582    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/724334da-f6a6-44fd-a04b-971fffbb3149-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"724334da-f6a6-44fd-a04b-971fffbb3149\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 13:03:05.401797 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:03:05.401622    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/724334da-f6a6-44fd-a04b-971fffbb3149-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"724334da-f6a6-44fd-a04b-971fffbb3149\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 13:03:05.401797 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:03:05.401668    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/724334da-f6a6-44fd-a04b-971fffbb3149-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"724334da-f6a6-44fd-a04b-971fffbb3149\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 13:03:05.401797 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:03:05.401706    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/724334da-f6a6-44fd-a04b-971fffbb3149-config-out\") pod \"prometheus-k8s-0\" (UID: \"724334da-f6a6-44fd-a04b-971fffbb3149\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 13:03:05.401797 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:03:05.401732    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/724334da-f6a6-44fd-a04b-971fffbb3149-web-config\") pod \"prometheus-k8s-0\" (UID: \"724334da-f6a6-44fd-a04b-971fffbb3149\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 13:03:05.401951 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:03:05.401817    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/724334da-f6a6-44fd-a04b-971fffbb3149-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"724334da-f6a6-44fd-a04b-971fffbb3149\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 13:03:05.401951 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:03:05.401843    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/724334da-f6a6-44fd-a04b-971fffbb3149-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"724334da-f6a6-44fd-a04b-971fffbb3149\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 13:03:05.401951 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:03:05.401875    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/724334da-f6a6-44fd-a04b-971fffbb3149-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"724334da-f6a6-44fd-a04b-971fffbb3149\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 13:03:05.401951 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:03:05.401899    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/724334da-f6a6-44fd-a04b-971fffbb3149-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"724334da-f6a6-44fd-a04b-971fffbb3149\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 13:03:05.402165 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:03:05.401983    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/724334da-f6a6-44fd-a04b-971fffbb3149-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"724334da-f6a6-44fd-a04b-971fffbb3149\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 13:03:05.402165 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:03:05.402021    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/724334da-f6a6-44fd-a04b-971fffbb3149-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"724334da-f6a6-44fd-a04b-971fffbb3149\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 13:03:05.402165 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:03:05.402057    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/724334da-f6a6-44fd-a04b-971fffbb3149-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"724334da-f6a6-44fd-a04b-971fffbb3149\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 13:03:05.402165 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:03:05.402099    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/724334da-f6a6-44fd-a04b-971fffbb3149-config\") pod \"prometheus-k8s-0\" (UID: \"724334da-f6a6-44fd-a04b-971fffbb3149\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 13:03:05.481265 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:03:05.481222    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-99f7c65fb-drlms" event={"ID":"8d8b5614-e433-4ea8-a62d-df0cce8ef3b5","Type":"ContainerStarted","Data":"225c1b1734632b24c30890f4e298dd15580c9d96be34b224740fbe478cbf86a4"}
Jul 20 13:03:05.482818 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:03:05.482783    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-4wwrh" event={"ID":"f8c70e98-14ec-48d9-8c30-2d63fa95c04e","Type":"ContainerStarted","Data":"5dce58cc1f33874fbd9c88a63a475cc22c09ec6c9aaeb306b6fa559ce7518dda"}
Jul 20 13:03:05.484826 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:03:05.484782    2584 generic.go:356] "Generic (PLEG): container finished" podID="f7bb3088-03fd-4efb-996d-f52f6faad0bf" containerID="37f0b43f64499ca13d55a829c782ad223bd7d5601ae739435dac5c5cf8263bad" exitCode=0
Jul 20 13:03:05.484995 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:03:05.484880    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-8v7s6" event={"ID":"f7bb3088-03fd-4efb-996d-f52f6faad0bf","Type":"ContainerDied","Data":"37f0b43f64499ca13d55a829c782ad223bd7d5601ae739435dac5c5cf8263bad"}
Jul 20 13:03:05.487787 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:03:05.487758    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-z7vtq" event={"ID":"7eb8230a-fac0-4584-95ea-5c10947196da","Type":"ContainerStarted","Data":"566259d3c26572f0aae2aff7ed396f557f767bde98fa859c9313c5f4e3a49625"}
Jul 20 13:03:05.489540 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:03:05.489509    2584 generic.go:356] "Generic (PLEG): container finished" podID="d63e2b67-c210-4dd5-b7a4-38d325a1ad31" containerID="832ebe9e64e005e35347849a399b4303df258784adec4a84d92f19aa6aa2ca39" exitCode=0
Jul 20 13:03:05.489628 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:03:05.489578    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d63e2b67-c210-4dd5-b7a4-38d325a1ad31","Type":"ContainerDied","Data":"832ebe9e64e005e35347849a399b4303df258784adec4a84d92f19aa6aa2ca39"}
Jul 20 13:03:05.491366 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:03:05.491227    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-g5s74" event={"ID":"4b2de50d-d756-4967-97f4-c470056f4e1a","Type":"ContainerStarted","Data":"4f2461c4e11b32cbc034026c748a7573a823599f17c434b61b183ce14302904e"}
Jul 20 13:03:05.495102 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:03:05.495080    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56c5594674-snpfl" event={"ID":"02263690-62a5-457b-8b95-99d5500d9bad","Type":"ContainerStarted","Data":"799db191437cba761958bcc22558013dcd521c17b0c26985be7229c4d7d831de"}
Jul 20 13:03:05.495220 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:03:05.495133    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56c5594674-snpfl" event={"ID":"02263690-62a5-457b-8b95-99d5500d9bad","Type":"ContainerStarted","Data":"b2e220910fb4716a09b92218ca2672ea7436e4e965f969ae33e1277493c41381"}
Jul 20 13:03:05.495220 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:03:05.495162    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56c5594674-snpfl" event={"ID":"02263690-62a5-457b-8b95-99d5500d9bad","Type":"ContainerStarted","Data":"78a21cc002fabdf83ab3e7decb0d8f8dd5b97f8c32f482afea7c90bfe9ce1983"}
Jul 20 13:03:05.497454 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:03:05.497430    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6c54f98c5d-9mmxz" event={"ID":"7182f153-b087-40d6-9fe5-5f6262e5b8d5","Type":"ContainerStarted","Data":"39bb8d0dd02576f68589dd4706b68f26d61a5203df18bf5e4b3f88d6735f577d"}
Jul 20 13:03:05.497549 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:03:05.497489    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6c54f98c5d-9mmxz" event={"ID":"7182f153-b087-40d6-9fe5-5f6262e5b8d5","Type":"ContainerStarted","Data":"9d8537f1637858efac8bb64137c69b9d8a6bbd0455f4a9d45fa027a54f1c0db3"}
Jul 20 13:03:05.497549 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:03:05.497518    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6c54f98c5d-9mmxz" event={"ID":"7182f153-b087-40d6-9fe5-5f6262e5b8d5","Type":"ContainerStarted","Data":"085739a164165e7efb2a14e1d8f1aa1c644adb7f4eac6d7f2f6a90bcceb08268"}
Jul 20 13:03:05.505660 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:03:05.504142    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/724334da-f6a6-44fd-a04b-971fffbb3149-config\") pod \"prometheus-k8s-0\" (UID: \"724334da-f6a6-44fd-a04b-971fffbb3149\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 13:03:05.505660 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:03:05.504202    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/724334da-f6a6-44fd-a04b-971fffbb3149-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"724334da-f6a6-44fd-a04b-971fffbb3149\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 13:03:05.505660 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:03:05.504227    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/724334da-f6a6-44fd-a04b-971fffbb3149-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"724334da-f6a6-44fd-a04b-971fffbb3149\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 13:03:05.505660 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:03:05.504252    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c5jjk\" (UniqueName: \"kubernetes.io/projected/724334da-f6a6-44fd-a04b-971fffbb3149-kube-api-access-c5jjk\") pod \"prometheus-k8s-0\" (UID: \"724334da-f6a6-44fd-a04b-971fffbb3149\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 13:03:05.505660 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:03:05.504282    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/724334da-f6a6-44fd-a04b-971fffbb3149-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"724334da-f6a6-44fd-a04b-971fffbb3149\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 13:03:05.505660 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:03:05.504309    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/724334da-f6a6-44fd-a04b-971fffbb3149-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"724334da-f6a6-44fd-a04b-971fffbb3149\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 13:03:05.505660 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:03:05.504329    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/724334da-f6a6-44fd-a04b-971fffbb3149-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"724334da-f6a6-44fd-a04b-971fffbb3149\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 13:03:05.505660 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:03:05.504352    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/724334da-f6a6-44fd-a04b-971fffbb3149-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"724334da-f6a6-44fd-a04b-971fffbb3149\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 13:03:05.505660 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:03:05.504379    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/724334da-f6a6-44fd-a04b-971fffbb3149-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"724334da-f6a6-44fd-a04b-971fffbb3149\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 13:03:05.505660 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:03:05.504411    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/724334da-f6a6-44fd-a04b-971fffbb3149-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"724334da-f6a6-44fd-a04b-971fffbb3149\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 13:03:05.505660 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:03:05.504450    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/724334da-f6a6-44fd-a04b-971fffbb3149-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"724334da-f6a6-44fd-a04b-971fffbb3149\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 13:03:05.505660 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:03:05.504478    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/724334da-f6a6-44fd-a04b-971fffbb3149-config-out\") pod \"prometheus-k8s-0\" (UID: \"724334da-f6a6-44fd-a04b-971fffbb3149\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 13:03:05.505660 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:03:05.504505    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/724334da-f6a6-44fd-a04b-971fffbb3149-web-config\") pod \"prometheus-k8s-0\" (UID: \"724334da-f6a6-44fd-a04b-971fffbb3149\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 13:03:05.505660 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:03:05.504669    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/724334da-f6a6-44fd-a04b-971fffbb3149-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"724334da-f6a6-44fd-a04b-971fffbb3149\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 13:03:05.505660 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:03:05.504699    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/724334da-f6a6-44fd-a04b-971fffbb3149-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"724334da-f6a6-44fd-a04b-971fffbb3149\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 13:03:05.505660 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:03:05.504731    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/724334da-f6a6-44fd-a04b-971fffbb3149-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"724334da-f6a6-44fd-a04b-971fffbb3149\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 13:03:05.505660 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:03:05.504755    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/724334da-f6a6-44fd-a04b-971fffbb3149-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"724334da-f6a6-44fd-a04b-971fffbb3149\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 13:03:05.511771 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:03:05.504784    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/724334da-f6a6-44fd-a04b-971fffbb3149-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"724334da-f6a6-44fd-a04b-971fffbb3149\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 13:03:05.511771 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:03:05.504812    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/724334da-f6a6-44fd-a04b-971fffbb3149-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"724334da-f6a6-44fd-a04b-971fffbb3149\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 13:03:05.511771 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:03:05.504843    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/724334da-f6a6-44fd-a04b-971fffbb3149-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"724334da-f6a6-44fd-a04b-971fffbb3149\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 13:03:05.511771 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:03:05.506338    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/724334da-f6a6-44fd-a04b-971fffbb3149-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"724334da-f6a6-44fd-a04b-971fffbb3149\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 13:03:05.511771 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:03:05.507086    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/724334da-f6a6-44fd-a04b-971fffbb3149-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"724334da-f6a6-44fd-a04b-971fffbb3149\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 13:03:05.511771 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:03:05.509090    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/724334da-f6a6-44fd-a04b-971fffbb3149-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"724334da-f6a6-44fd-a04b-971fffbb3149\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 13:03:05.511771 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:03:05.509646    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/724334da-f6a6-44fd-a04b-971fffbb3149-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"724334da-f6a6-44fd-a04b-971fffbb3149\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 13:03:05.511771 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:03:05.510402    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/724334da-f6a6-44fd-a04b-971fffbb3149-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"724334da-f6a6-44fd-a04b-971fffbb3149\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 13:03:05.511771 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:03:05.511356    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/724334da-f6a6-44fd-a04b-971fffbb3149-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"724334da-f6a6-44fd-a04b-971fffbb3149\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 13:03:05.511771 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:03:05.511753    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/724334da-f6a6-44fd-a04b-971fffbb3149-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"724334da-f6a6-44fd-a04b-971fffbb3149\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 13:03:05.513385 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:03:05.513359    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/724334da-f6a6-44fd-a04b-971fffbb3149-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"724334da-f6a6-44fd-a04b-971fffbb3149\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 13:03:05.515729 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:03:05.515417    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/724334da-f6a6-44fd-a04b-971fffbb3149-config\") pod \"prometheus-k8s-0\" (UID: \"724334da-f6a6-44fd-a04b-971fffbb3149\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 13:03:05.516122 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:03:05.516091    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/724334da-f6a6-44fd-a04b-971fffbb3149-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"724334da-f6a6-44fd-a04b-971fffbb3149\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 13:03:05.518054 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:03:05.518012    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/724334da-f6a6-44fd-a04b-971fffbb3149-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"724334da-f6a6-44fd-a04b-971fffbb3149\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 13:03:05.518680 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:03:05.518620    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/724334da-f6a6-44fd-a04b-971fffbb3149-config-out\") pod \"prometheus-k8s-0\" (UID: \"724334da-f6a6-44fd-a04b-971fffbb3149\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 13:03:05.518783 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:03:05.518686    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/724334da-f6a6-44fd-a04b-971fffbb3149-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"724334da-f6a6-44fd-a04b-971fffbb3149\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 13:03:05.518942 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:03:05.518900    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/724334da-f6a6-44fd-a04b-971fffbb3149-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"724334da-f6a6-44fd-a04b-971fffbb3149\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 13:03:05.519722 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:03:05.519641    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/724334da-f6a6-44fd-a04b-971fffbb3149-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"724334da-f6a6-44fd-a04b-971fffbb3149\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 13:03:05.520023 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:03:05.519981    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/724334da-f6a6-44fd-a04b-971fffbb3149-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"724334da-f6a6-44fd-a04b-971fffbb3149\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 13:03:05.520505 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:03:05.520465    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/724334da-f6a6-44fd-a04b-971fffbb3149-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"724334da-f6a6-44fd-a04b-971fffbb3149\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 13:03:05.520867 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:03:05.520844    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/724334da-f6a6-44fd-a04b-971fffbb3149-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"724334da-f6a6-44fd-a04b-971fffbb3149\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 13:03:05.523458 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:03:05.523429    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/724334da-f6a6-44fd-a04b-971fffbb3149-web-config\") pod \"prometheus-k8s-0\" (UID: \"724334da-f6a6-44fd-a04b-971fffbb3149\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 13:03:05.527543 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:03:05.527255    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-56c5594674-snpfl" podStartSLOduration=3.740746819 podStartE2EDuration="7.527238376s" totalImagesPullingTime="3.786491557s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 13:02:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 13:03:05.52651411 +0000 UTC m=+75.243061535" watchObservedRunningTime="2026-07-20 13:03:05.527238376 +0000 UTC m=+75.243785797"
Jul 20 13:03:05.527917 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:03:05.527882    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-4wwrh" podStartSLOduration=66.303032934 podStartE2EDuration="1m14.527871601s" totalImagesPullingTime="8.224838667s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 13:01:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 13:03:05.503978933 +0000 UTC m=+75.220526339" watchObservedRunningTime="2026-07-20 13:03:05.527871601 +0000 UTC m=+75.244419012"
Jul 20 13:03:05.534756 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:03:05.534567    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c5jjk\" (UniqueName: \"kubernetes.io/projected/724334da-f6a6-44fd-a04b-971fffbb3149-kube-api-access-c5jjk\") pod \"prometheus-k8s-0\" (UID: \"724334da-f6a6-44fd-a04b-971fffbb3149\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 13:03:05.610861 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:03:05.610830    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 13:03:05.788928 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:03:05.787814    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-z7vtq" podStartSLOduration=4.097072893 podStartE2EDuration="7.787790365s" totalImagesPullingTime="3.690717472s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 13:02:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 13:03:05.591153304 +0000 UTC m=+75.307700718" watchObservedRunningTime="2026-07-20 13:03:05.787790365 +0000 UTC m=+75.504337777"
Jul 20 13:03:05.788928 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:03:05.788292    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 20 13:03:05.794615 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:03:05.794581    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod724334da_f6a6_44fd_a04b_971fffbb3149.slice/crio-7d4223b37f8849ecf2d12d9d6e3a72e1ab0494000089358d85229988120f3492 WatchSource:0}: Error finding container 7d4223b37f8849ecf2d12d9d6e3a72e1ab0494000089358d85229988120f3492: Status 404 returned error can't find the container with id 7d4223b37f8849ecf2d12d9d6e3a72e1ab0494000089358d85229988120f3492
Jul 20 13:03:06.507027 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:03:06.506614    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-8v7s6" event={"ID":"f7bb3088-03fd-4efb-996d-f52f6faad0bf","Type":"ContainerStarted","Data":"86fd615e124e4dac3e37e31e9eb404c931b7ff31bf4aa94de222d4d0c7e9027e"}
Jul 20 13:03:06.507027 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:03:06.506682    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-8v7s6" event={"ID":"f7bb3088-03fd-4efb-996d-f52f6faad0bf","Type":"ContainerStarted","Data":"1d8bf95fb9d257541ef51c2f63470db20be1ff3575a3fdc14b1211c1d7863858"}
Jul 20 13:03:06.512193 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:03:06.512157    2584 generic.go:356] "Generic (PLEG): container finished" podID="724334da-f6a6-44fd-a04b-971fffbb3149" containerID="115d8d30b0d32cf0f1bca6ab9fdaea3fc7e12bcb121de809e87da3a8531adef0" exitCode=0
Jul 20 13:03:06.512344 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:03:06.512262    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"724334da-f6a6-44fd-a04b-971fffbb3149","Type":"ContainerDied","Data":"115d8d30b0d32cf0f1bca6ab9fdaea3fc7e12bcb121de809e87da3a8531adef0"}
Jul 20 13:03:06.512408 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:03:06.512342    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"724334da-f6a6-44fd-a04b-971fffbb3149","Type":"ContainerStarted","Data":"7d4223b37f8849ecf2d12d9d6e3a72e1ab0494000089358d85229988120f3492"}
Jul 20 13:03:06.526174 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:03:06.526127    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-8v7s6" podStartSLOduration=4.415988772 podStartE2EDuration="8.526108337s" totalImagesPullingTime="3.953416765s" totalInitContainerRuntime="156.7028ms" isStatefulPod=true podCreationTimestamp="2026-07-20 13:02:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 13:03:06.525856445 +0000 UTC m=+76.242403857" watchObservedRunningTime="2026-07-20 13:03:06.526108337 +0000 UTC m=+76.242655749"
Jul 20 13:03:07.521404 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:03:07.521347    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6c54f98c5d-9mmxz" event={"ID":"7182f153-b087-40d6-9fe5-5f6262e5b8d5","Type":"ContainerStarted","Data":"54ffeb96473454d9d9d0e94fdf963b427cac45a2553d27bf2559ff6d8afb92ce"}
Jul 20 13:03:07.521856 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:03:07.521449    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6c54f98c5d-9mmxz" event={"ID":"7182f153-b087-40d6-9fe5-5f6262e5b8d5","Type":"ContainerStarted","Data":"04b262c8ba1588b8e6725290b6785dbb48749d7986836f0f724b3a3da7573f72"}
Jul 20 13:03:07.521856 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:03:07.521492    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6c54f98c5d-9mmxz" event={"ID":"7182f153-b087-40d6-9fe5-5f6262e5b8d5","Type":"ContainerStarted","Data":"e15a5f4271712596c49c18e354c898064aec5db8972f689edaf389efb26cb89e"}
Jul 20 13:03:07.521856 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:03:07.521776    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-6c54f98c5d-9mmxz"
Jul 20 13:03:07.523498 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:03:07.523443    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-99f7c65fb-drlms" event={"ID":"8d8b5614-e433-4ea8-a62d-df0cce8ef3b5","Type":"ContainerStarted","Data":"172d6bba88a0c5c4ad43b3181f84324dcf1b00cb2be470071aa40846d8aa68e9"}
Jul 20 13:03:07.532333 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:03:07.532303    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d63e2b67-c210-4dd5-b7a4-38d325a1ad31","Type":"ContainerStarted","Data":"8842b75037af125703386af51b1b3bd768d2648d2bcb6cd38a137132623698fe"}
Jul 20 13:03:07.532461 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:03:07.532376    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d63e2b67-c210-4dd5-b7a4-38d325a1ad31","Type":"ContainerStarted","Data":"480129d3fadcf031872451f452ae4a8a486ff682e7aca17aec9a61231e261c72"}
Jul 20 13:03:07.532461 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:03:07.532419    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d63e2b67-c210-4dd5-b7a4-38d325a1ad31","Type":"ContainerStarted","Data":"4d500db6efe3bc79b879f500fdb745847b0d8bfdb01ead5a24fc04105f373ada"}
Jul 20 13:03:07.532539 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:03:07.532468    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d63e2b67-c210-4dd5-b7a4-38d325a1ad31","Type":"ContainerStarted","Data":"54f5064f70adabea8ee2802c61d9519da9b1a8a396185f93b7a5655c897756cb"}
Jul 20 13:03:07.532539 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:03:07.532508    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d63e2b67-c210-4dd5-b7a4-38d325a1ad31","Type":"ContainerStarted","Data":"50cfc045b90c982c02b4e679e343c09d17faf1d78c6a3ff0656c734523ad7a01"}
Jul 20 13:03:07.532593 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:03:07.532549    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d63e2b67-c210-4dd5-b7a4-38d325a1ad31","Type":"ContainerStarted","Data":"392ba83e02579ab351312ecb0cff712446e8b7567cdb6e7170e0839dc92d642e"}
Jul 20 13:03:07.550350 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:03:07.550245    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-6c54f98c5d-9mmxz" podStartSLOduration=3.27400642 podStartE2EDuration="7.550221017s" totalImagesPullingTime="4.276214597s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 13:03:00 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 13:03:07.549415135 +0000 UTC m=+77.265962550" watchObservedRunningTime="2026-07-20 13:03:07.550221017 +0000 UTC m=+77.266768430"
Jul 20 13:03:07.577038 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:03:07.576941    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=1.776092373 podStartE2EDuration="7.576923231s" totalImagesPullingTime="5.776428932s" totalInitContainerRuntime="24.401926ms" isStatefulPod=false podCreationTimestamp="2026-07-20 13:03:00 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 13:03:07.576737488 +0000 UTC m=+77.293284900" watchObservedRunningTime="2026-07-20 13:03:07.576923231 +0000 UTC m=+77.293470643"
Jul 20 13:03:07.597656 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:03:07.597563    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-99f7c65fb-drlms" podStartSLOduration=2.966518011 podStartE2EDuration="4.597536863s" totalImagesPullingTime="1.631018852s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 13:03:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 13:03:07.59709527 +0000 UTC m=+77.313642682" watchObservedRunningTime="2026-07-20 13:03:07.597536863 +0000 UTC m=+77.314084275"
Jul 20 13:03:09.544987 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:03:09.544930    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-g5s74" event={"ID":"4b2de50d-d756-4967-97f4-c470056f4e1a","Type":"ContainerStarted","Data":"223e62b23cb3d4ce6dc87d532689aaf2eee685f91360ffd5c3880c08405858ba"}
Jul 20 13:03:09.545450 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:03:09.545195    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-g5s74"
Jul 20 13:03:09.550988 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:03:09.550939    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-g5s74"
Jul 20 13:03:09.561317 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:03:09.561261    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-g5s74" podStartSLOduration=2.877160609 podStartE2EDuration="6.561241645s" totalImagesPullingTime="3.684081036s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 13:03:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 13:03:09.559604461 +0000 UTC m=+79.276151874" watchObservedRunningTime="2026-07-20 13:03:09.561241645 +0000 UTC m=+79.277789056"
Jul 20 13:03:10.553421 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:03:10.553384    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"724334da-f6a6-44fd-a04b-971fffbb3149","Type":"ContainerStarted","Data":"507f0678586b9c6bd37c62b5c52b647901647a0812bcbad67cabb3fac727db5a"}
Jul 20 13:03:10.553813 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:03:10.553453    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"724334da-f6a6-44fd-a04b-971fffbb3149","Type":"ContainerStarted","Data":"7d2512d7d9ec3b4de69f754a8e5e3539392c291155533c63ac362bbfe3a25996"}
Jul 20 13:03:10.553813 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:03:10.553483    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"724334da-f6a6-44fd-a04b-971fffbb3149","Type":"ContainerStarted","Data":"83da4e7a251e153a4c30fad8fe0171c5277936cd9c49c1e5972a534eb04bea20"}
Jul 20 13:03:10.553813 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:03:10.553511    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"724334da-f6a6-44fd-a04b-971fffbb3149","Type":"ContainerStarted","Data":"0948be12d42f8dda388f84acf8928ff5f2becd50baba88e908aab28cdb4b1f68"}
Jul 20 13:03:10.553813 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:03:10.553559    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"724334da-f6a6-44fd-a04b-971fffbb3149","Type":"ContainerStarted","Data":"c3a994ffd28696b77aef4a63835ca653b08675f06e82857e9917dc894f2217fd"}
Jul 20 13:03:10.553813 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:03:10.553584    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"724334da-f6a6-44fd-a04b-971fffbb3149","Type":"ContainerStarted","Data":"0bb4cee8391f2ca1de67a308cb3b1e0db4f25e733f29e3e8eb870a679dd4ab4c"}
Jul 20 13:03:10.583721 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:03:10.583610    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.133653785 podStartE2EDuration="5.583530339s" totalImagesPullingTime="3.426551959s" totalInitContainerRuntime="23.324595ms" isStatefulPod=false podCreationTimestamp="2026-07-20 13:03:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 13:03:10.582178233 +0000 UTC m=+80.298725648" watchObservedRunningTime="2026-07-20 13:03:10.583530339 +0000 UTC m=+80.300077751"
Jul 20 13:03:10.611406 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:03:10.611368    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 13:03:13.543918 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:03:13.543810    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-6c54f98c5d-9mmxz"
Jul 20 13:03:16.700527 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:03:16.700489    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-f455799dc-b75cl"]
Jul 20 13:03:23.574418 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:03:23.574385    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-99f7c65fb-drlms"
Jul 20 13:03:23.574832 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:03:23.574468    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-99f7c65fb-drlms"
Jul 20 13:03:27.543473 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:03:27.543403    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-87b8c76b7-t69n9" podUID="2385a61c-ccd5-4f17-9bc2-2bbed7ac7031" containerName="console" containerID="cri-o://baa45acfefeb3393a2361faa5f3b0fc44bcfe6f90cf12510fb19b575143cb734" gracePeriod=15
Jul 20 13:03:28.314122 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:03:28.314094    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-87b8c76b7-t69n9"
Jul 20 13:03:28.427154 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:03:28.427050    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2385a61c-ccd5-4f17-9bc2-2bbed7ac7031-service-ca\") pod \"2385a61c-ccd5-4f17-9bc2-2bbed7ac7031\" (UID: \"2385a61c-ccd5-4f17-9bc2-2bbed7ac7031\") "
Jul 20 13:03:28.427154 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:03:28.427139    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2385a61c-ccd5-4f17-9bc2-2bbed7ac7031-oauth-serving-cert\") pod \"2385a61c-ccd5-4f17-9bc2-2bbed7ac7031\" (UID: \"2385a61c-ccd5-4f17-9bc2-2bbed7ac7031\") "
Jul 20 13:03:28.427387 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:03:28.427201    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2385a61c-ccd5-4f17-9bc2-2bbed7ac7031-console-config\") pod \"2385a61c-ccd5-4f17-9bc2-2bbed7ac7031\" (UID: \"2385a61c-ccd5-4f17-9bc2-2bbed7ac7031\") "
Jul 20 13:03:28.427387 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:03:28.427250    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2385a61c-ccd5-4f17-9bc2-2bbed7ac7031-console-oauth-config\") pod \"2385a61c-ccd5-4f17-9bc2-2bbed7ac7031\" (UID: \"2385a61c-ccd5-4f17-9bc2-2bbed7ac7031\") "
Jul 20 13:03:28.427387 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:03:28.427294    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2385a61c-ccd5-4f17-9bc2-2bbed7ac7031-console-serving-cert\") pod \"2385a61c-ccd5-4f17-9bc2-2bbed7ac7031\" (UID: \"2385a61c-ccd5-4f17-9bc2-2bbed7ac7031\") "
Jul 20 13:03:28.427387 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:03:28.427358    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7zj2m\" (UniqueName: \"kubernetes.io/projected/2385a61c-ccd5-4f17-9bc2-2bbed7ac7031-kube-api-access-7zj2m\") pod \"2385a61c-ccd5-4f17-9bc2-2bbed7ac7031\" (UID: \"2385a61c-ccd5-4f17-9bc2-2bbed7ac7031\") "
Jul 20 13:03:28.430931 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:03:28.430888    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2385a61c-ccd5-4f17-9bc2-2bbed7ac7031-console-config" (OuterVolumeSpecName: "console-config") pod "2385a61c-ccd5-4f17-9bc2-2bbed7ac7031" (UID: "2385a61c-ccd5-4f17-9bc2-2bbed7ac7031"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 13:03:28.431311 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:03:28.431289    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2385a61c-ccd5-4f17-9bc2-2bbed7ac7031-service-ca" (OuterVolumeSpecName: "service-ca") pod "2385a61c-ccd5-4f17-9bc2-2bbed7ac7031" (UID: "2385a61c-ccd5-4f17-9bc2-2bbed7ac7031"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 13:03:28.431744 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:03:28.431716    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2385a61c-ccd5-4f17-9bc2-2bbed7ac7031-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "2385a61c-ccd5-4f17-9bc2-2bbed7ac7031" (UID: "2385a61c-ccd5-4f17-9bc2-2bbed7ac7031"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 13:03:28.432101 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:03:28.432074    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2385a61c-ccd5-4f17-9bc2-2bbed7ac7031-kube-api-access-7zj2m" (OuterVolumeSpecName: "kube-api-access-7zj2m") pod "2385a61c-ccd5-4f17-9bc2-2bbed7ac7031" (UID: "2385a61c-ccd5-4f17-9bc2-2bbed7ac7031"). InnerVolumeSpecName "kube-api-access-7zj2m". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 13:03:28.433688 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:03:28.433664    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2385a61c-ccd5-4f17-9bc2-2bbed7ac7031-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "2385a61c-ccd5-4f17-9bc2-2bbed7ac7031" (UID: "2385a61c-ccd5-4f17-9bc2-2bbed7ac7031"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 13:03:28.433831 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:03:28.433809    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2385a61c-ccd5-4f17-9bc2-2bbed7ac7031-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "2385a61c-ccd5-4f17-9bc2-2bbed7ac7031" (UID: "2385a61c-ccd5-4f17-9bc2-2bbed7ac7031"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 13:03:28.529022 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:03:28.528987    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7zj2m\" (UniqueName: \"kubernetes.io/projected/2385a61c-ccd5-4f17-9bc2-2bbed7ac7031-kube-api-access-7zj2m\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 20 13:03:28.529022 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:03:28.529020    2584 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2385a61c-ccd5-4f17-9bc2-2bbed7ac7031-service-ca\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 20 13:03:28.529022 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:03:28.529029    2584 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2385a61c-ccd5-4f17-9bc2-2bbed7ac7031-oauth-serving-cert\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 20 13:03:28.529257 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:03:28.529039    2584 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2385a61c-ccd5-4f17-9bc2-2bbed7ac7031-console-config\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 20 13:03:28.529257 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:03:28.529048    2584 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2385a61c-ccd5-4f17-9bc2-2bbed7ac7031-console-oauth-config\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 20 13:03:28.529257 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:03:28.529056    2584 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2385a61c-ccd5-4f17-9bc2-2bbed7ac7031-console-serving-cert\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 20 13:03:28.635129 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:03:28.635082    2584 generic.go:356] "Generic (PLEG): container finished" podID="2385a61c-ccd5-4f17-9bc2-2bbed7ac7031" containerID="baa45acfefeb3393a2361faa5f3b0fc44bcfe6f90cf12510fb19b575143cb734" exitCode=0
Jul 20 13:03:28.635129 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:03:28.635134    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-87b8c76b7-t69n9"
Jul 20 13:03:28.635573 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:03:28.635151    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-87b8c76b7-t69n9" event={"ID":"2385a61c-ccd5-4f17-9bc2-2bbed7ac7031","Type":"ContainerDied","Data":"baa45acfefeb3393a2361faa5f3b0fc44bcfe6f90cf12510fb19b575143cb734"}
Jul 20 13:03:28.635573 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:03:28.635232    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-87b8c76b7-t69n9" event={"ID":"2385a61c-ccd5-4f17-9bc2-2bbed7ac7031","Type":"ContainerDied","Data":"7014e613adcee9015522e2a30cde2aa69bb7850f49b381f838ddc8dd32cb01cd"}
Jul 20 13:03:28.635573 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:03:28.635264    2584 scope.go:117] "RemoveContainer" containerID="baa45acfefeb3393a2361faa5f3b0fc44bcfe6f90cf12510fb19b575143cb734"
Jul 20 13:03:28.644399 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:03:28.644379    2584 scope.go:117] "RemoveContainer" containerID="baa45acfefeb3393a2361faa5f3b0fc44bcfe6f90cf12510fb19b575143cb734"
Jul 20 13:03:28.644677 ip-10-0-134-121 kubenswrapper[2584]: E0720 13:03:28.644658    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"baa45acfefeb3393a2361faa5f3b0fc44bcfe6f90cf12510fb19b575143cb734\": container with ID starting with baa45acfefeb3393a2361faa5f3b0fc44bcfe6f90cf12510fb19b575143cb734 not found: ID does not exist" containerID="baa45acfefeb3393a2361faa5f3b0fc44bcfe6f90cf12510fb19b575143cb734"
Jul 20 13:03:28.644731 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:03:28.644686    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"baa45acfefeb3393a2361faa5f3b0fc44bcfe6f90cf12510fb19b575143cb734"} err="failed to get container status \"baa45acfefeb3393a2361faa5f3b0fc44bcfe6f90cf12510fb19b575143cb734\": rpc error: code = NotFound desc = could not find container \"baa45acfefeb3393a2361faa5f3b0fc44bcfe6f90cf12510fb19b575143cb734\": container with ID starting with baa45acfefeb3393a2361faa5f3b0fc44bcfe6f90cf12510fb19b575143cb734 not found: ID does not exist"
Jul 20 13:03:28.655758 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:03:28.655734    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-87b8c76b7-t69n9"]
Jul 20 13:03:28.661432 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:03:28.661407    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-87b8c76b7-t69n9"]
Jul 20 13:03:29.094217 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:03:29.094181    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2385a61c-ccd5-4f17-9bc2-2bbed7ac7031" path="/var/lib/kubelet/pods/2385a61c-ccd5-4f17-9bc2-2bbed7ac7031/volumes"
Jul 20 13:03:31.463491 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:03:31.463410    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-ck7q6"
Jul 20 13:03:41.724788 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:03:41.724726    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-f455799dc-b75cl" podUID="3389ffbc-668f-4aaa-9abb-051c12da9e4b" containerName="console" containerID="cri-o://c3f9157db22ff98f714b83b8daa826452bad66ddbd39969f367bb67e359946a7" gracePeriod=15
Jul 20 13:03:41.965052 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:03:41.965029    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-f455799dc-b75cl"
Jul 20 13:03:42.051474 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:03:42.051441    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3389ffbc-668f-4aaa-9abb-051c12da9e4b-service-ca\") pod \"3389ffbc-668f-4aaa-9abb-051c12da9e4b\" (UID: \"3389ffbc-668f-4aaa-9abb-051c12da9e4b\") "
Jul 20 13:03:42.051474 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:03:42.051480    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3389ffbc-668f-4aaa-9abb-051c12da9e4b-console-serving-cert\") pod \"3389ffbc-668f-4aaa-9abb-051c12da9e4b\" (UID: \"3389ffbc-668f-4aaa-9abb-051c12da9e4b\") "
Jul 20 13:03:42.051677 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:03:42.051508    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3389ffbc-668f-4aaa-9abb-051c12da9e4b-oauth-serving-cert\") pod \"3389ffbc-668f-4aaa-9abb-051c12da9e4b\" (UID: \"3389ffbc-668f-4aaa-9abb-051c12da9e4b\") "
Jul 20 13:03:42.051677 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:03:42.051530    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3389ffbc-668f-4aaa-9abb-051c12da9e4b-trusted-ca-bundle\") pod \"3389ffbc-668f-4aaa-9abb-051c12da9e4b\" (UID: \"3389ffbc-668f-4aaa-9abb-051c12da9e4b\") "
Jul 20 13:03:42.051677 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:03:42.051614    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3389ffbc-668f-4aaa-9abb-051c12da9e4b-console-oauth-config\") pod \"3389ffbc-668f-4aaa-9abb-051c12da9e4b\" (UID: \"3389ffbc-668f-4aaa-9abb-051c12da9e4b\") "
Jul 20 13:03:42.051677 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:03:42.051649    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b99hp\" (UniqueName: \"kubernetes.io/projected/3389ffbc-668f-4aaa-9abb-051c12da9e4b-kube-api-access-b99hp\") pod \"3389ffbc-668f-4aaa-9abb-051c12da9e4b\" (UID: \"3389ffbc-668f-4aaa-9abb-051c12da9e4b\") "
Jul 20 13:03:42.051839 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:03:42.051678    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3389ffbc-668f-4aaa-9abb-051c12da9e4b-console-config\") pod \"3389ffbc-668f-4aaa-9abb-051c12da9e4b\" (UID: \"3389ffbc-668f-4aaa-9abb-051c12da9e4b\") "
Jul 20 13:03:42.051920 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:03:42.051888    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3389ffbc-668f-4aaa-9abb-051c12da9e4b-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "3389ffbc-668f-4aaa-9abb-051c12da9e4b" (UID: "3389ffbc-668f-4aaa-9abb-051c12da9e4b"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 13:03:42.052009 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:03:42.051915    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3389ffbc-668f-4aaa-9abb-051c12da9e4b-service-ca" (OuterVolumeSpecName: "service-ca") pod "3389ffbc-668f-4aaa-9abb-051c12da9e4b" (UID: "3389ffbc-668f-4aaa-9abb-051c12da9e4b"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 13:03:42.052114 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:03:42.052087    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3389ffbc-668f-4aaa-9abb-051c12da9e4b-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "3389ffbc-668f-4aaa-9abb-051c12da9e4b" (UID: "3389ffbc-668f-4aaa-9abb-051c12da9e4b"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 13:03:42.052114 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:03:42.052106    2584 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3389ffbc-668f-4aaa-9abb-051c12da9e4b-service-ca\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 20 13:03:42.052222 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:03:42.052126    2584 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3389ffbc-668f-4aaa-9abb-051c12da9e4b-oauth-serving-cert\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 20 13:03:42.052222 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:03:42.052180    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3389ffbc-668f-4aaa-9abb-051c12da9e4b-console-config" (OuterVolumeSpecName: "console-config") pod "3389ffbc-668f-4aaa-9abb-051c12da9e4b" (UID: "3389ffbc-668f-4aaa-9abb-051c12da9e4b"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 13:03:42.053889 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:03:42.053854    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3389ffbc-668f-4aaa-9abb-051c12da9e4b-kube-api-access-b99hp" (OuterVolumeSpecName: "kube-api-access-b99hp") pod "3389ffbc-668f-4aaa-9abb-051c12da9e4b" (UID: "3389ffbc-668f-4aaa-9abb-051c12da9e4b"). InnerVolumeSpecName "kube-api-access-b99hp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 13:03:42.053889 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:03:42.053859    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3389ffbc-668f-4aaa-9abb-051c12da9e4b-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "3389ffbc-668f-4aaa-9abb-051c12da9e4b" (UID: "3389ffbc-668f-4aaa-9abb-051c12da9e4b"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 13:03:42.054057 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:03:42.053927    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3389ffbc-668f-4aaa-9abb-051c12da9e4b-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "3389ffbc-668f-4aaa-9abb-051c12da9e4b" (UID: "3389ffbc-668f-4aaa-9abb-051c12da9e4b"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 13:03:42.153485 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:03:42.153445    2584 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3389ffbc-668f-4aaa-9abb-051c12da9e4b-console-serving-cert\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 20 13:03:42.153485 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:03:42.153477    2584 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3389ffbc-668f-4aaa-9abb-051c12da9e4b-trusted-ca-bundle\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 20 13:03:42.153485 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:03:42.153487    2584 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3389ffbc-668f-4aaa-9abb-051c12da9e4b-console-oauth-config\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 20 13:03:42.153485 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:03:42.153497    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b99hp\" (UniqueName: \"kubernetes.io/projected/3389ffbc-668f-4aaa-9abb-051c12da9e4b-kube-api-access-b99hp\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 20 13:03:42.153800 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:03:42.153507    2584 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3389ffbc-668f-4aaa-9abb-051c12da9e4b-console-config\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 20 13:03:42.697370 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:03:42.697334    2584 generic.go:356] "Generic (PLEG): container finished" podID="3389ffbc-668f-4aaa-9abb-051c12da9e4b" containerID="c3f9157db22ff98f714b83b8daa826452bad66ddbd39969f367bb67e359946a7" exitCode=0
Jul 20 13:03:42.697588 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:03:42.697389    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-f455799dc-b75cl" event={"ID":"3389ffbc-668f-4aaa-9abb-051c12da9e4b","Type":"ContainerDied","Data":"c3f9157db22ff98f714b83b8daa826452bad66ddbd39969f367bb67e359946a7"}
Jul 20 13:03:42.697588 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:03:42.697404    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-f455799dc-b75cl"
Jul 20 13:03:42.697588 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:03:42.697462    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-f455799dc-b75cl" event={"ID":"3389ffbc-668f-4aaa-9abb-051c12da9e4b","Type":"ContainerDied","Data":"c1d83b1848a2918a4da5c7e5fb22c0deb300a21262b944be21a2eb8a2a17799f"}
Jul 20 13:03:42.697588 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:03:42.697483    2584 scope.go:117] "RemoveContainer" containerID="c3f9157db22ff98f714b83b8daa826452bad66ddbd39969f367bb67e359946a7"
Jul 20 13:03:42.707220 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:03:42.707198    2584 scope.go:117] "RemoveContainer" containerID="c3f9157db22ff98f714b83b8daa826452bad66ddbd39969f367bb67e359946a7"
Jul 20 13:03:42.707490 ip-10-0-134-121 kubenswrapper[2584]: E0720 13:03:42.707472    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c3f9157db22ff98f714b83b8daa826452bad66ddbd39969f367bb67e359946a7\": container with ID starting with c3f9157db22ff98f714b83b8daa826452bad66ddbd39969f367bb67e359946a7 not found: ID does not exist" containerID="c3f9157db22ff98f714b83b8daa826452bad66ddbd39969f367bb67e359946a7"
Jul 20 13:03:42.707531 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:03:42.707498    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c3f9157db22ff98f714b83b8daa826452bad66ddbd39969f367bb67e359946a7"} err="failed to get container status \"c3f9157db22ff98f714b83b8daa826452bad66ddbd39969f367bb67e359946a7\": rpc error: code = NotFound desc = could not find container \"c3f9157db22ff98f714b83b8daa826452bad66ddbd39969f367bb67e359946a7\": container with ID starting with c3f9157db22ff98f714b83b8daa826452bad66ddbd39969f367bb67e359946a7 not found: ID does not exist"
Jul 20 13:03:42.719734 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:03:42.719705    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-f455799dc-b75cl"]
Jul 20 13:03:42.728730 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:03:42.728700    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-f455799dc-b75cl"]
Jul 20 13:03:43.094434 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:03:43.094398    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3389ffbc-668f-4aaa-9abb-051c12da9e4b" path="/var/lib/kubelet/pods/3389ffbc-668f-4aaa-9abb-051c12da9e4b/volumes"
Jul 20 13:03:43.580453 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:03:43.580421    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-99f7c65fb-drlms"
Jul 20 13:03:43.584521 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:03:43.584491    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-99f7c65fb-drlms"
Jul 20 13:04:05.611325 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:04:05.611269    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 13:04:05.631003 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:04:05.630954    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 13:04:05.830835 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:04:05.830803    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 13:04:23.290793 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:04:23.290759    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-59488c66fc-577f4"]
Jul 20 13:04:23.291330 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:04:23.291309    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3389ffbc-668f-4aaa-9abb-051c12da9e4b" containerName="console"
Jul 20 13:04:23.291393 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:04:23.291335    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="3389ffbc-668f-4aaa-9abb-051c12da9e4b" containerName="console"
Jul 20 13:04:23.291393 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:04:23.291358    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2385a61c-ccd5-4f17-9bc2-2bbed7ac7031" containerName="console"
Jul 20 13:04:23.291393 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:04:23.291366    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="2385a61c-ccd5-4f17-9bc2-2bbed7ac7031" containerName="console"
Jul 20 13:04:23.291506 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:04:23.291438    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="3389ffbc-668f-4aaa-9abb-051c12da9e4b" containerName="console"
Jul 20 13:04:23.291506 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:04:23.291455    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="2385a61c-ccd5-4f17-9bc2-2bbed7ac7031" containerName="console"
Jul 20 13:04:23.293641 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:04:23.293613    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-59488c66fc-577f4"
Jul 20 13:04:23.295801 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:04:23.295775    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-6f7lx\""
Jul 20 13:04:23.295941 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:04:23.295780    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
Jul 20 13:04:23.295941 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:04:23.295927    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
Jul 20 13:04:23.295941 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:04:23.295783    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
Jul 20 13:04:23.296138 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:04:23.296031    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
Jul 20 13:04:23.296138 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:04:23.296108    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
Jul 20 13:04:23.301656 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:04:23.301627    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\""
Jul 20 13:04:23.306663 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:04:23.306638    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-59488c66fc-577f4"]
Jul 20 13:04:23.409182 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:04:23.409143    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1967b977-cf31-433a-b44d-b2ab3cda8912-telemeter-trusted-ca-bundle\") pod \"telemeter-client-59488c66fc-577f4\" (UID: \"1967b977-cf31-433a-b44d-b2ab3cda8912\") " pod="openshift-monitoring/telemeter-client-59488c66fc-577f4"
Jul 20 13:04:23.409349 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:04:23.409191    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/1967b977-cf31-433a-b44d-b2ab3cda8912-secret-telemeter-client\") pod \"telemeter-client-59488c66fc-577f4\" (UID: \"1967b977-cf31-433a-b44d-b2ab3cda8912\") " pod="openshift-monitoring/telemeter-client-59488c66fc-577f4"
Jul 20 13:04:23.409349 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:04:23.409219    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/1967b977-cf31-433a-b44d-b2ab3cda8912-telemeter-client-tls\") pod \"telemeter-client-59488c66fc-577f4\" (UID: \"1967b977-cf31-433a-b44d-b2ab3cda8912\") " pod="openshift-monitoring/telemeter-client-59488c66fc-577f4"
Jul 20 13:04:23.409349 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:04:23.409303    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1967b977-cf31-433a-b44d-b2ab3cda8912-serving-certs-ca-bundle\") pod \"telemeter-client-59488c66fc-577f4\" (UID: \"1967b977-cf31-433a-b44d-b2ab3cda8912\") " pod="openshift-monitoring/telemeter-client-59488c66fc-577f4"
Jul 20 13:04:23.409349 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:04:23.409331    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/1967b977-cf31-433a-b44d-b2ab3cda8912-federate-client-tls\") pod \"telemeter-client-59488c66fc-577f4\" (UID: \"1967b977-cf31-433a-b44d-b2ab3cda8912\") " pod="openshift-monitoring/telemeter-client-59488c66fc-577f4"
Jul 20 13:04:23.409493 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:04:23.409356    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1967b977-cf31-433a-b44d-b2ab3cda8912-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-59488c66fc-577f4\" (UID: \"1967b977-cf31-433a-b44d-b2ab3cda8912\") " pod="openshift-monitoring/telemeter-client-59488c66fc-577f4"
Jul 20 13:04:23.409493 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:04:23.409431    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1967b977-cf31-433a-b44d-b2ab3cda8912-metrics-client-ca\") pod \"telemeter-client-59488c66fc-577f4\" (UID: \"1967b977-cf31-433a-b44d-b2ab3cda8912\") " pod="openshift-monitoring/telemeter-client-59488c66fc-577f4"
Jul 20 13:04:23.409493 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:04:23.409447    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dnxsb\" (UniqueName: \"kubernetes.io/projected/1967b977-cf31-433a-b44d-b2ab3cda8912-kube-api-access-dnxsb\") pod \"telemeter-client-59488c66fc-577f4\" (UID: \"1967b977-cf31-433a-b44d-b2ab3cda8912\") " pod="openshift-monitoring/telemeter-client-59488c66fc-577f4"
Jul 20 13:04:23.510465 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:04:23.510410    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1967b977-cf31-433a-b44d-b2ab3cda8912-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-59488c66fc-577f4\" (UID: \"1967b977-cf31-433a-b44d-b2ab3cda8912\") " pod="openshift-monitoring/telemeter-client-59488c66fc-577f4"
Jul 20 13:04:23.510647 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:04:23.510492    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1967b977-cf31-433a-b44d-b2ab3cda8912-metrics-client-ca\") pod \"telemeter-client-59488c66fc-577f4\" (UID: \"1967b977-cf31-433a-b44d-b2ab3cda8912\") " pod="openshift-monitoring/telemeter-client-59488c66fc-577f4"
Jul 20 13:04:23.510647 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:04:23.510520    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dnxsb\" (UniqueName: \"kubernetes.io/projected/1967b977-cf31-433a-b44d-b2ab3cda8912-kube-api-access-dnxsb\") pod \"telemeter-client-59488c66fc-577f4\" (UID: \"1967b977-cf31-433a-b44d-b2ab3cda8912\") " pod="openshift-monitoring/telemeter-client-59488c66fc-577f4"
Jul 20 13:04:23.510647 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:04:23.510586    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1967b977-cf31-433a-b44d-b2ab3cda8912-telemeter-trusted-ca-bundle\") pod \"telemeter-client-59488c66fc-577f4\" (UID: \"1967b977-cf31-433a-b44d-b2ab3cda8912\") " pod="openshift-monitoring/telemeter-client-59488c66fc-577f4"
Jul 20 13:04:23.510647 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:04:23.510625    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/1967b977-cf31-433a-b44d-b2ab3cda8912-secret-telemeter-client\") pod \"telemeter-client-59488c66fc-577f4\" (UID: \"1967b977-cf31-433a-b44d-b2ab3cda8912\") " pod="openshift-monitoring/telemeter-client-59488c66fc-577f4"
Jul 20 13:04:23.510818 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:04:23.510647    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/1967b977-cf31-433a-b44d-b2ab3cda8912-telemeter-client-tls\") pod \"telemeter-client-59488c66fc-577f4\" (UID: \"1967b977-cf31-433a-b44d-b2ab3cda8912\") " pod="openshift-monitoring/telemeter-client-59488c66fc-577f4"
Jul 20 13:04:23.510818 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:04:23.510705    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1967b977-cf31-433a-b44d-b2ab3cda8912-serving-certs-ca-bundle\") pod \"telemeter-client-59488c66fc-577f4\" (UID: \"1967b977-cf31-433a-b44d-b2ab3cda8912\") " pod="openshift-monitoring/telemeter-client-59488c66fc-577f4"
Jul 20 13:04:23.510818 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:04:23.510735    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/1967b977-cf31-433a-b44d-b2ab3cda8912-federate-client-tls\") pod \"telemeter-client-59488c66fc-577f4\" (UID: \"1967b977-cf31-433a-b44d-b2ab3cda8912\") " pod="openshift-monitoring/telemeter-client-59488c66fc-577f4"
Jul 20 13:04:23.511443 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:04:23.511407    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1967b977-cf31-433a-b44d-b2ab3cda8912-metrics-client-ca\") pod \"telemeter-client-59488c66fc-577f4\" (UID: \"1967b977-cf31-433a-b44d-b2ab3cda8912\") " pod="openshift-monitoring/telemeter-client-59488c66fc-577f4"
Jul 20 13:04:23.511591 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:04:23.511443    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1967b977-cf31-433a-b44d-b2ab3cda8912-serving-certs-ca-bundle\") pod \"telemeter-client-59488c66fc-577f4\" (UID: \"1967b977-cf31-433a-b44d-b2ab3cda8912\") " pod="openshift-monitoring/telemeter-client-59488c66fc-577f4"
Jul 20 13:04:23.511661 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:04:23.511632    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1967b977-cf31-433a-b44d-b2ab3cda8912-telemeter-trusted-ca-bundle\") pod \"telemeter-client-59488c66fc-577f4\" (UID: \"1967b977-cf31-433a-b44d-b2ab3cda8912\") " pod="openshift-monitoring/telemeter-client-59488c66fc-577f4"
Jul 20 13:04:23.513145 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:04:23.513121    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1967b977-cf31-433a-b44d-b2ab3cda8912-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-59488c66fc-577f4\" (UID: \"1967b977-cf31-433a-b44d-b2ab3cda8912\") " pod="openshift-monitoring/telemeter-client-59488c66fc-577f4"
Jul 20 13:04:23.513321 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:04:23.513298    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/1967b977-cf31-433a-b44d-b2ab3cda8912-telemeter-client-tls\") pod \"telemeter-client-59488c66fc-577f4\" (UID: \"1967b977-cf31-433a-b44d-b2ab3cda8912\") " pod="openshift-monitoring/telemeter-client-59488c66fc-577f4"
Jul 20 13:04:23.513569 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:04:23.513550    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/1967b977-cf31-433a-b44d-b2ab3cda8912-federate-client-tls\") pod \"telemeter-client-59488c66fc-577f4\" (UID: \"1967b977-cf31-433a-b44d-b2ab3cda8912\") " pod="openshift-monitoring/telemeter-client-59488c66fc-577f4"
Jul 20 13:04:23.513607 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:04:23.513550    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/1967b977-cf31-433a-b44d-b2ab3cda8912-secret-telemeter-client\") pod \"telemeter-client-59488c66fc-577f4\" (UID: \"1967b977-cf31-433a-b44d-b2ab3cda8912\") " pod="openshift-monitoring/telemeter-client-59488c66fc-577f4"
Jul 20 13:04:23.518896 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:04:23.518879    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dnxsb\" (UniqueName: \"kubernetes.io/projected/1967b977-cf31-433a-b44d-b2ab3cda8912-kube-api-access-dnxsb\") pod \"telemeter-client-59488c66fc-577f4\" (UID: \"1967b977-cf31-433a-b44d-b2ab3cda8912\") " pod="openshift-monitoring/telemeter-client-59488c66fc-577f4"
Jul 20 13:04:23.606767 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:04:23.606694    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-59488c66fc-577f4"
Jul 20 13:04:23.744525 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:04:23.744496    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-59488c66fc-577f4"]
Jul 20 13:04:23.746266 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:04:23.746237    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1967b977_cf31_433a_b44d_b2ab3cda8912.slice/crio-36a22a44e7b82a3af305c0e093fdf2bd971a5eb35ee637706ba97f2a94c468f8 WatchSource:0}: Error finding container 36a22a44e7b82a3af305c0e093fdf2bd971a5eb35ee637706ba97f2a94c468f8: Status 404 returned error can't find the container with id 36a22a44e7b82a3af305c0e093fdf2bd971a5eb35ee637706ba97f2a94c468f8
Jul 20 13:04:23.871376 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:04:23.871291    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-59488c66fc-577f4" event={"ID":"1967b977-cf31-433a-b44d-b2ab3cda8912","Type":"ContainerStarted","Data":"36a22a44e7b82a3af305c0e093fdf2bd971a5eb35ee637706ba97f2a94c468f8"}
Jul 20 13:04:25.885982 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:04:25.885865    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-59488c66fc-577f4" event={"ID":"1967b977-cf31-433a-b44d-b2ab3cda8912","Type":"ContainerStarted","Data":"d73641a40b7cb7add664a5f2e63c45e91412468da4c380c45b18f442d09d6576"}
Jul 20 13:04:25.885982 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:04:25.885958    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-59488c66fc-577f4" event={"ID":"1967b977-cf31-433a-b44d-b2ab3cda8912","Type":"ContainerStarted","Data":"4914ee7e5c695422ec11adc1910049888ba7f5c644fd4ad6df3f6dfd31c0ed1e"}
Jul 20 13:04:25.886445 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:04:25.885994    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-59488c66fc-577f4" event={"ID":"1967b977-cf31-433a-b44d-b2ab3cda8912","Type":"ContainerStarted","Data":"d4f50ad323c8c47ebe150282e4ba08858fe3e8bafa06dedb753c47ae2451e190"}
Jul 20 13:04:25.906329 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:04:25.906264    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-59488c66fc-577f4" podStartSLOduration=1.144739633 podStartE2EDuration="2.90624522s" totalImagesPullingTime="1.761505587s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 13:04:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 13:04:25.905089169 +0000 UTC m=+155.621636580" watchObservedRunningTime="2026-07-20 13:04:25.90624522 +0000 UTC m=+155.622792642"
Jul 20 13:06:41.614896 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:06:41.614861    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-tgpg4"]
Jul 20 13:06:41.618081 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:06:41.618062    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-tgpg4"
Jul 20 13:06:41.621203 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:06:41.621177    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-s2clm\""
Jul 20 13:06:41.621339 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:06:41.621226    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 20 13:06:41.621707 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:06:41.621692    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 20 13:06:41.631321 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:06:41.631296    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-tgpg4"]
Jul 20 13:06:41.758661 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:06:41.758619    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5gwpw\" (UniqueName: \"kubernetes.io/projected/23c78a42-aaa7-49fc-a1a2-676b24f64ccb-kube-api-access-5gwpw\") pod \"cert-manager-cainjector-559cdd8c87-tgpg4\" (UID: \"23c78a42-aaa7-49fc-a1a2-676b24f64ccb\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-tgpg4"
Jul 20 13:06:41.758843 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:06:41.758731    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/23c78a42-aaa7-49fc-a1a2-676b24f64ccb-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-tgpg4\" (UID: \"23c78a42-aaa7-49fc-a1a2-676b24f64ccb\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-tgpg4"
Jul 20 13:06:41.859446 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:06:41.859408    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/23c78a42-aaa7-49fc-a1a2-676b24f64ccb-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-tgpg4\" (UID: \"23c78a42-aaa7-49fc-a1a2-676b24f64ccb\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-tgpg4"
Jul 20 13:06:41.859627 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:06:41.859468    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5gwpw\" (UniqueName: \"kubernetes.io/projected/23c78a42-aaa7-49fc-a1a2-676b24f64ccb-kube-api-access-5gwpw\") pod \"cert-manager-cainjector-559cdd8c87-tgpg4\" (UID: \"23c78a42-aaa7-49fc-a1a2-676b24f64ccb\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-tgpg4"
Jul 20 13:06:41.892961 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:06:41.892883    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/23c78a42-aaa7-49fc-a1a2-676b24f64ccb-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-tgpg4\" (UID: \"23c78a42-aaa7-49fc-a1a2-676b24f64ccb\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-tgpg4"
Jul 20 13:06:41.906248 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:06:41.906218    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5gwpw\" (UniqueName: \"kubernetes.io/projected/23c78a42-aaa7-49fc-a1a2-676b24f64ccb-kube-api-access-5gwpw\") pod \"cert-manager-cainjector-559cdd8c87-tgpg4\" (UID: \"23c78a42-aaa7-49fc-a1a2-676b24f64ccb\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-tgpg4"
Jul 20 13:06:41.935687 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:06:41.935654    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-tgpg4"
Jul 20 13:06:42.081075 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:06:42.080900    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-tgpg4"]
Jul 20 13:06:42.083327 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:06:42.083296    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod23c78a42_aaa7_49fc_a1a2_676b24f64ccb.slice/crio-2fd3e43aea3771d48fe928f199b5536a6b629b6d30f12f25b7d2935c7e0069fb WatchSource:0}: Error finding container 2fd3e43aea3771d48fe928f199b5536a6b629b6d30f12f25b7d2935c7e0069fb: Status 404 returned error can't find the container with id 2fd3e43aea3771d48fe928f199b5536a6b629b6d30f12f25b7d2935c7e0069fb
Jul 20 13:06:42.434110 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:06:42.434077    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-tgpg4" event={"ID":"23c78a42-aaa7-49fc-a1a2-676b24f64ccb","Type":"ContainerStarted","Data":"2fd3e43aea3771d48fe928f199b5536a6b629b6d30f12f25b7d2935c7e0069fb"}
Jul 20 13:06:45.451119 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:06:45.451082    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-tgpg4" event={"ID":"23c78a42-aaa7-49fc-a1a2-676b24f64ccb","Type":"ContainerStarted","Data":"e6aa201c189085f7a255736ea2d446b1020ddf293ef18dacf86bf2da9066fbf8"}
Jul 20 13:06:45.469266 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:06:45.469211    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-tgpg4" podStartSLOduration=1.262053313 podStartE2EDuration="4.469193114s" totalImagesPullingTime="3.207139801s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 13:06:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 13:06:45.467267494 +0000 UTC m=+295.183814907" watchObservedRunningTime="2026-07-20 13:06:45.469193114 +0000 UTC m=+295.185740524"
Jul 20 13:06:47.096536 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:06:47.096503    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-zxpjl"]
Jul 20 13:06:47.100050 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:06:47.100027    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-zxpjl"
Jul 20 13:06:47.103378 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:06:47.103358    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-vntvf\""
Jul 20 13:06:47.107256 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:06:47.107231    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h9dkk\" (UniqueName: \"kubernetes.io/projected/afad05e3-489f-417f-a3ca-c820701d3208-kube-api-access-h9dkk\") pod \"cert-manager-webhook-6486ffd997-zxpjl\" (UID: \"afad05e3-489f-417f-a3ca-c820701d3208\") " pod="cert-manager/cert-manager-webhook-6486ffd997-zxpjl"
Jul 20 13:06:47.107357 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:06:47.107293    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/afad05e3-489f-417f-a3ca-c820701d3208-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-zxpjl\" (UID: \"afad05e3-489f-417f-a3ca-c820701d3208\") " pod="cert-manager/cert-manager-webhook-6486ffd997-zxpjl"
Jul 20 13:06:47.143293 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:06:47.143248    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-zxpjl"]
Jul 20 13:06:47.207760 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:06:47.207718    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/afad05e3-489f-417f-a3ca-c820701d3208-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-zxpjl\" (UID: \"afad05e3-489f-417f-a3ca-c820701d3208\") " pod="cert-manager/cert-manager-webhook-6486ffd997-zxpjl"
Jul 20 13:06:47.207951 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:06:47.207779    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h9dkk\" (UniqueName: \"kubernetes.io/projected/afad05e3-489f-417f-a3ca-c820701d3208-kube-api-access-h9dkk\") pod \"cert-manager-webhook-6486ffd997-zxpjl\" (UID: \"afad05e3-489f-417f-a3ca-c820701d3208\") " pod="cert-manager/cert-manager-webhook-6486ffd997-zxpjl"
Jul 20 13:06:47.225160 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:06:47.225137    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/afad05e3-489f-417f-a3ca-c820701d3208-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-zxpjl\" (UID: \"afad05e3-489f-417f-a3ca-c820701d3208\") " pod="cert-manager/cert-manager-webhook-6486ffd997-zxpjl"
Jul 20 13:06:47.228158 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:06:47.228135    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h9dkk\" (UniqueName: \"kubernetes.io/projected/afad05e3-489f-417f-a3ca-c820701d3208-kube-api-access-h9dkk\") pod \"cert-manager-webhook-6486ffd997-zxpjl\" (UID: \"afad05e3-489f-417f-a3ca-c820701d3208\") " pod="cert-manager/cert-manager-webhook-6486ffd997-zxpjl"
Jul 20 13:06:47.409021 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:06:47.408892    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-zxpjl"
Jul 20 13:06:47.553246 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:06:47.553215    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-zxpjl"]
Jul 20 13:06:47.556257 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:06:47.556231    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podafad05e3_489f_417f_a3ca_c820701d3208.slice/crio-f7a0355237b877ee3994d9129570ed2920db7f9f5bde5cd6ad88a9cb6fe7bc3f WatchSource:0}: Error finding container f7a0355237b877ee3994d9129570ed2920db7f9f5bde5cd6ad88a9cb6fe7bc3f: Status 404 returned error can't find the container with id f7a0355237b877ee3994d9129570ed2920db7f9f5bde5cd6ad88a9cb6fe7bc3f
Jul 20 13:06:48.467345 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:06:48.467308    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-zxpjl" event={"ID":"afad05e3-489f-417f-a3ca-c820701d3208","Type":"ContainerStarted","Data":"edacd49b32dc1aab9cfca32d1a60082020bbc410a12f131b5a747eb95ae497c6"}
Jul 20 13:06:48.467345 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:06:48.467352    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-zxpjl" event={"ID":"afad05e3-489f-417f-a3ca-c820701d3208","Type":"ContainerStarted","Data":"f7a0355237b877ee3994d9129570ed2920db7f9f5bde5cd6ad88a9cb6fe7bc3f"}
Jul 20 13:06:48.467765 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:06:48.467390    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-zxpjl"
Jul 20 13:06:48.492427 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:06:48.488819    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-zxpjl" podStartSLOduration=1.488798624 podStartE2EDuration="1.488798624s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 13:06:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 13:06:48.486910981 +0000 UTC m=+298.203458423" watchObservedRunningTime="2026-07-20 13:06:48.488798624 +0000 UTC m=+298.205346040"
Jul 20 13:06:50.796329 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:06:50.796299    2584 kubelet.go:1648] "Image garbage collection succeeded"
Jul 20 13:06:54.473514 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:06:54.473471    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-zxpjl"
Jul 20 13:07:22.436235 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:07:22.436198    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-85766d874c-vmwmg"]
Jul 20 13:07:22.440894 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:07:22.440877    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-85766d874c-vmwmg"
Jul 20 13:07:22.442935 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:07:22.442898    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 20 13:07:22.442935 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:07:22.442929    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 20 13:07:22.443157 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:07:22.442902    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 20 13:07:22.443302 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:07:22.443289    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 20 13:07:22.443348 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:07:22.443290    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-s8pp8\""
Jul 20 13:07:22.454565 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:07:22.454526    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-85766d874c-vmwmg"]
Jul 20 13:07:22.525588 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:07:22.525548    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/00f64fd0-e3e5-4da2-bf17-497e7521a6b6-manifests\") pod \"opendatahub-operator-controller-manager-85766d874c-vmwmg\" (UID: \"00f64fd0-e3e5-4da2-bf17-497e7521a6b6\") " pod="opendatahub/opendatahub-operator-controller-manager-85766d874c-vmwmg"
Jul 20 13:07:22.525764 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:07:22.525607    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-trzr9\" (UniqueName: \"kubernetes.io/projected/00f64fd0-e3e5-4da2-bf17-497e7521a6b6-kube-api-access-trzr9\") pod \"opendatahub-operator-controller-manager-85766d874c-vmwmg\" (UID: \"00f64fd0-e3e5-4da2-bf17-497e7521a6b6\") " pod="opendatahub/opendatahub-operator-controller-manager-85766d874c-vmwmg"
Jul 20 13:07:22.525764 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:07:22.525664    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/00f64fd0-e3e5-4da2-bf17-497e7521a6b6-tmp\") pod \"opendatahub-operator-controller-manager-85766d874c-vmwmg\" (UID: \"00f64fd0-e3e5-4da2-bf17-497e7521a6b6\") " pod="opendatahub/opendatahub-operator-controller-manager-85766d874c-vmwmg"
Jul 20 13:07:22.525764 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:07:22.525724    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/00f64fd0-e3e5-4da2-bf17-497e7521a6b6-apiservice-cert\") pod \"opendatahub-operator-controller-manager-85766d874c-vmwmg\" (UID: \"00f64fd0-e3e5-4da2-bf17-497e7521a6b6\") " pod="opendatahub/opendatahub-operator-controller-manager-85766d874c-vmwmg"
Jul 20 13:07:22.525764 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:07:22.525761    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/00f64fd0-e3e5-4da2-bf17-497e7521a6b6-webhook-cert\") pod \"opendatahub-operator-controller-manager-85766d874c-vmwmg\" (UID: \"00f64fd0-e3e5-4da2-bf17-497e7521a6b6\") " pod="opendatahub/opendatahub-operator-controller-manager-85766d874c-vmwmg"
Jul 20 13:07:22.626563 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:07:22.626528    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/00f64fd0-e3e5-4da2-bf17-497e7521a6b6-manifests\") pod \"opendatahub-operator-controller-manager-85766d874c-vmwmg\" (UID: \"00f64fd0-e3e5-4da2-bf17-497e7521a6b6\") " pod="opendatahub/opendatahub-operator-controller-manager-85766d874c-vmwmg"
Jul 20 13:07:22.626769 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:07:22.626581    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-trzr9\" (UniqueName: \"kubernetes.io/projected/00f64fd0-e3e5-4da2-bf17-497e7521a6b6-kube-api-access-trzr9\") pod \"opendatahub-operator-controller-manager-85766d874c-vmwmg\" (UID: \"00f64fd0-e3e5-4da2-bf17-497e7521a6b6\") " pod="opendatahub/opendatahub-operator-controller-manager-85766d874c-vmwmg"
Jul 20 13:07:22.626769 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:07:22.626603    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/00f64fd0-e3e5-4da2-bf17-497e7521a6b6-tmp\") pod \"opendatahub-operator-controller-manager-85766d874c-vmwmg\" (UID: \"00f64fd0-e3e5-4da2-bf17-497e7521a6b6\") " pod="opendatahub/opendatahub-operator-controller-manager-85766d874c-vmwmg"
Jul 20 13:07:22.626769 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:07:22.626635    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/00f64fd0-e3e5-4da2-bf17-497e7521a6b6-apiservice-cert\") pod \"opendatahub-operator-controller-manager-85766d874c-vmwmg\" (UID: \"00f64fd0-e3e5-4da2-bf17-497e7521a6b6\") " pod="opendatahub/opendatahub-operator-controller-manager-85766d874c-vmwmg"
Jul 20 13:07:22.626769 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:07:22.626662    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/00f64fd0-e3e5-4da2-bf17-497e7521a6b6-webhook-cert\") pod \"opendatahub-operator-controller-manager-85766d874c-vmwmg\" (UID: \"00f64fd0-e3e5-4da2-bf17-497e7521a6b6\") " pod="opendatahub/opendatahub-operator-controller-manager-85766d874c-vmwmg"
Jul 20 13:07:22.627059 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:07:22.627038    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/00f64fd0-e3e5-4da2-bf17-497e7521a6b6-manifests\") pod \"opendatahub-operator-controller-manager-85766d874c-vmwmg\" (UID: \"00f64fd0-e3e5-4da2-bf17-497e7521a6b6\") " pod="opendatahub/opendatahub-operator-controller-manager-85766d874c-vmwmg"
Jul 20 13:07:22.629007 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:07:22.628948    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/00f64fd0-e3e5-4da2-bf17-497e7521a6b6-tmp\") pod \"opendatahub-operator-controller-manager-85766d874c-vmwmg\" (UID: \"00f64fd0-e3e5-4da2-bf17-497e7521a6b6\") " pod="opendatahub/opendatahub-operator-controller-manager-85766d874c-vmwmg"
Jul 20 13:07:22.629135 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:07:22.629037    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/00f64fd0-e3e5-4da2-bf17-497e7521a6b6-webhook-cert\") pod \"opendatahub-operator-controller-manager-85766d874c-vmwmg\" (UID: \"00f64fd0-e3e5-4da2-bf17-497e7521a6b6\") " pod="opendatahub/opendatahub-operator-controller-manager-85766d874c-vmwmg"
Jul 20 13:07:22.629135 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:07:22.629106    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/00f64fd0-e3e5-4da2-bf17-497e7521a6b6-apiservice-cert\") pod \"opendatahub-operator-controller-manager-85766d874c-vmwmg\" (UID: \"00f64fd0-e3e5-4da2-bf17-497e7521a6b6\") " pod="opendatahub/opendatahub-operator-controller-manager-85766d874c-vmwmg"
Jul 20 13:07:22.635439 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:07:22.635418    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-trzr9\" (UniqueName: \"kubernetes.io/projected/00f64fd0-e3e5-4da2-bf17-497e7521a6b6-kube-api-access-trzr9\") pod \"opendatahub-operator-controller-manager-85766d874c-vmwmg\" (UID: \"00f64fd0-e3e5-4da2-bf17-497e7521a6b6\") " pod="opendatahub/opendatahub-operator-controller-manager-85766d874c-vmwmg"
Jul 20 13:07:22.754829 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:07:22.754791    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-85766d874c-vmwmg"
Jul 20 13:07:22.919009 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:07:22.918927    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-85766d874c-vmwmg"]
Jul 20 13:07:22.921699 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:07:22.921662    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod00f64fd0_e3e5_4da2_bf17_497e7521a6b6.slice/crio-fab4e5b978b4e3c005a6352318ca32718986ead5f9127bd2220baae265117572 WatchSource:0}: Error finding container fab4e5b978b4e3c005a6352318ca32718986ead5f9127bd2220baae265117572: Status 404 returned error can't find the container with id fab4e5b978b4e3c005a6352318ca32718986ead5f9127bd2220baae265117572
Jul 20 13:07:22.923523 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:07:22.923506    2584 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 20 13:07:23.620589 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:07:23.620546    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-85766d874c-vmwmg" event={"ID":"00f64fd0-e3e5-4da2-bf17-497e7521a6b6","Type":"ContainerStarted","Data":"fab4e5b978b4e3c005a6352318ca32718986ead5f9127bd2220baae265117572"}
Jul 20 13:07:26.637200 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:07:26.637164    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-85766d874c-vmwmg" event={"ID":"00f64fd0-e3e5-4da2-bf17-497e7521a6b6","Type":"ContainerStarted","Data":"b9deb976873b19a4b31ee8febb2a8b6ebd63ae9b3e338048a4a9f888dba32c1d"}
Jul 20 13:07:27.643514 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:07:27.643479    2584 generic.go:356] "Generic (PLEG): container finished" podID="00f64fd0-e3e5-4da2-bf17-497e7521a6b6" containerID="b9deb976873b19a4b31ee8febb2a8b6ebd63ae9b3e338048a4a9f888dba32c1d" exitCode=0
Jul 20 13:07:27.643988 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:07:27.643572    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-85766d874c-vmwmg" event={"ID":"00f64fd0-e3e5-4da2-bf17-497e7521a6b6","Type":"ContainerDied","Data":"b9deb976873b19a4b31ee8febb2a8b6ebd63ae9b3e338048a4a9f888dba32c1d"}
Jul 20 13:07:29.655201 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:07:29.655155    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-85766d874c-vmwmg" event={"ID":"00f64fd0-e3e5-4da2-bf17-497e7521a6b6","Type":"ContainerStarted","Data":"f244e933450f1defee8afe3a176aa77a35acc8bb6ecba2cbabc39dc6f9b22d96"}
Jul 20 13:07:29.655656 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:07:29.655293    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-85766d874c-vmwmg"
Jul 20 13:07:29.680105 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:07:29.680052    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-85766d874c-vmwmg" podStartSLOduration=2.038342766 podStartE2EDuration="7.680032885s" totalImagesPullingTime="4.577784613s" totalInitContainerRuntime="1.063905506s" isStatefulPod=false podCreationTimestamp="2026-07-20 13:07:22 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 13:07:29.678105868 +0000 UTC m=+339.394653279" watchObservedRunningTime="2026-07-20 13:07:29.680032885 +0000 UTC m=+339.396580297"
Jul 20 13:07:40.662445 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:07:40.662418    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-85766d874c-vmwmg"
Jul 20 13:07:50.137911 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:07:50.137840    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-8sjg4"]
Jul 20 13:07:50.142468 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:07:50.142449    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-8sjg4"
Jul 20 13:07:50.145656 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:07:50.145634    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 20 13:07:50.145920 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:07:50.145903    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-q8gpx\""
Jul 20 13:07:50.146098 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:07:50.146074    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 20 13:07:50.146438 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:07:50.146425    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 20 13:07:50.167489 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:07:50.167469    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-8sjg4"]
Jul 20 13:07:50.250861 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:07:50.250826    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c1d28b63-2d7a-410d-a4ae-8a23df5a6c3c-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-8sjg4\" (UID: \"c1d28b63-2d7a-410d-a4ae-8a23df5a6c3c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-8sjg4"
Jul 20 13:07:50.250861 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:07:50.250859    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c1d28b63-2d7a-410d-a4ae-8a23df5a6c3c-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-8sjg4\" (UID: \"c1d28b63-2d7a-410d-a4ae-8a23df5a6c3c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-8sjg4"
Jul 20 13:07:50.251136 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:07:50.250901    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c1d28b63-2d7a-410d-a4ae-8a23df5a6c3c-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-8sjg4\" (UID: \"c1d28b63-2d7a-410d-a4ae-8a23df5a6c3c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-8sjg4"
Jul 20 13:07:50.251136 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:07:50.250994    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c1d28b63-2d7a-410d-a4ae-8a23df5a6c3c-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-8sjg4\" (UID: \"c1d28b63-2d7a-410d-a4ae-8a23df5a6c3c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-8sjg4"
Jul 20 13:07:50.251136 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:07:50.251022    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c1d28b63-2d7a-410d-a4ae-8a23df5a6c3c-istio-data\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-8sjg4\" (UID: \"c1d28b63-2d7a-410d-a4ae-8a23df5a6c3c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-8sjg4"
Jul 20 13:07:50.251136 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:07:50.251057    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wlzxz\" (UniqueName: \"kubernetes.io/projected/c1d28b63-2d7a-410d-a4ae-8a23df5a6c3c-kube-api-access-wlzxz\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-8sjg4\" (UID: \"c1d28b63-2d7a-410d-a4ae-8a23df5a6c3c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-8sjg4"
Jul 20 13:07:50.251280 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:07:50.251136    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c1d28b63-2d7a-410d-a4ae-8a23df5a6c3c-istio-token\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-8sjg4\" (UID: \"c1d28b63-2d7a-410d-a4ae-8a23df5a6c3c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-8sjg4"
Jul 20 13:07:50.251280 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:07:50.251193    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c1d28b63-2d7a-410d-a4ae-8a23df5a6c3c-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-8sjg4\" (UID: \"c1d28b63-2d7a-410d-a4ae-8a23df5a6c3c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-8sjg4"
Jul 20 13:07:50.251280 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:07:50.251228    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c1d28b63-2d7a-410d-a4ae-8a23df5a6c3c-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-8sjg4\" (UID: \"c1d28b63-2d7a-410d-a4ae-8a23df5a6c3c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-8sjg4"
Jul 20 13:07:50.325146 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:07:50.325117    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xkqwv"]
Jul 20 13:07:50.328873 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:07:50.328852    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xkqwv"
Jul 20 13:07:50.341902 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:07:50.341879    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xkqwv"]
Jul 20 13:07:50.352145 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:07:50.352123    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c1d28b63-2d7a-410d-a4ae-8a23df5a6c3c-istio-token\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-8sjg4\" (UID: \"c1d28b63-2d7a-410d-a4ae-8a23df5a6c3c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-8sjg4"
Jul 20 13:07:50.352246 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:07:50.352154    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n6vqd\" (UniqueName: \"kubernetes.io/projected/0d945cc6-346b-4037-a971-2afe9b904532-kube-api-access-n6vqd\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4xkqwv\" (UID: \"0d945cc6-346b-4037-a971-2afe9b904532\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xkqwv"
Jul 20 13:07:50.352246 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:07:50.352176    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0d945cc6-346b-4037-a971-2afe9b904532-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4xkqwv\" (UID: \"0d945cc6-346b-4037-a971-2afe9b904532\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xkqwv"
Jul 20 13:07:50.352246 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:07:50.352202    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c1d28b63-2d7a-410d-a4ae-8a23df5a6c3c-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-8sjg4\" (UID: \"c1d28b63-2d7a-410d-a4ae-8a23df5a6c3c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-8sjg4"
Jul 20 13:07:50.352246 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:07:50.352236    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c1d28b63-2d7a-410d-a4ae-8a23df5a6c3c-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-8sjg4\" (UID: \"c1d28b63-2d7a-410d-a4ae-8a23df5a6c3c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-8sjg4"
Jul 20 13:07:50.352414 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:07:50.352256    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0d945cc6-346b-4037-a971-2afe9b904532-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4xkqwv\" (UID: \"0d945cc6-346b-4037-a971-2afe9b904532\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xkqwv"
Jul 20 13:07:50.352414 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:07:50.352302    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c1d28b63-2d7a-410d-a4ae-8a23df5a6c3c-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-8sjg4\" (UID: \"c1d28b63-2d7a-410d-a4ae-8a23df5a6c3c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-8sjg4"
Jul 20 13:07:50.352414 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:07:50.352328    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c1d28b63-2d7a-410d-a4ae-8a23df5a6c3c-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-8sjg4\" (UID: \"c1d28b63-2d7a-410d-a4ae-8a23df5a6c3c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-8sjg4"
Jul 20 13:07:50.352414 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:07:50.352361    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0d945cc6-346b-4037-a971-2afe9b904532-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4xkqwv\" (UID: \"0d945cc6-346b-4037-a971-2afe9b904532\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xkqwv"
Jul 20 13:07:50.352414 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:07:50.352387    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0d945cc6-346b-4037-a971-2afe9b904532-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4xkqwv\" (UID: \"0d945cc6-346b-4037-a971-2afe9b904532\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xkqwv"
Jul 20 13:07:50.352670 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:07:50.352434    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c1d28b63-2d7a-410d-a4ae-8a23df5a6c3c-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-8sjg4\" (UID: \"c1d28b63-2d7a-410d-a4ae-8a23df5a6c3c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-8sjg4"
Jul 20 13:07:50.352670 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:07:50.352495    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c1d28b63-2d7a-410d-a4ae-8a23df5a6c3c-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-8sjg4\" (UID: \"c1d28b63-2d7a-410d-a4ae-8a23df5a6c3c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-8sjg4"
Jul 20 13:07:50.352670 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:07:50.352521    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c1d28b63-2d7a-410d-a4ae-8a23df5a6c3c-istio-data\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-8sjg4\" (UID: \"c1d28b63-2d7a-410d-a4ae-8a23df5a6c3c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-8sjg4"
Jul 20 13:07:50.352670 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:07:50.352530    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c1d28b63-2d7a-410d-a4ae-8a23df5a6c3c-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-8sjg4\" (UID: \"c1d28b63-2d7a-410d-a4ae-8a23df5a6c3c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-8sjg4"
Jul 20 13:07:50.352670 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:07:50.352548    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0d945cc6-346b-4037-a971-2afe9b904532-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4xkqwv\" (UID: \"0d945cc6-346b-4037-a971-2afe9b904532\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xkqwv"
Jul 20 13:07:50.352670 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:07:50.352573    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0d945cc6-346b-4037-a971-2afe9b904532-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4xkqwv\" (UID: \"0d945cc6-346b-4037-a971-2afe9b904532\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xkqwv"
Jul 20 13:07:50.352670 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:07:50.352595    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0d945cc6-346b-4037-a971-2afe9b904532-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4xkqwv\" (UID: \"0d945cc6-346b-4037-a971-2afe9b904532\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xkqwv"
Jul 20 13:07:50.352670 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:07:50.352636    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wlzxz\" (UniqueName: \"kubernetes.io/projected/c1d28b63-2d7a-410d-a4ae-8a23df5a6c3c-kube-api-access-wlzxz\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-8sjg4\" (UID: \"c1d28b63-2d7a-410d-a4ae-8a23df5a6c3c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-8sjg4"
Jul 20 13:07:50.352670 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:07:50.352665    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0d945cc6-346b-4037-a971-2afe9b904532-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4xkqwv\" (UID: \"0d945cc6-346b-4037-a971-2afe9b904532\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xkqwv"
Jul 20 13:07:50.353152 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:07:50.352703    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c1d28b63-2d7a-410d-a4ae-8a23df5a6c3c-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-8sjg4\" (UID: \"c1d28b63-2d7a-410d-a4ae-8a23df5a6c3c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-8sjg4"
Jul 20 13:07:50.353152 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:07:50.352797    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c1d28b63-2d7a-410d-a4ae-8a23df5a6c3c-istio-data\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-8sjg4\" (UID: \"c1d28b63-2d7a-410d-a4ae-8a23df5a6c3c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-8sjg4"
Jul 20 13:07:50.353152 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:07:50.352851    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c1d28b63-2d7a-410d-a4ae-8a23df5a6c3c-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-8sjg4\" (UID: \"c1d28b63-2d7a-410d-a4ae-8a23df5a6c3c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-8sjg4"
Jul 20 13:07:50.353436 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:07:50.353416    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c1d28b63-2d7a-410d-a4ae-8a23df5a6c3c-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-8sjg4\" (UID: \"c1d28b63-2d7a-410d-a4ae-8a23df5a6c3c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-8sjg4"
Jul 20 13:07:50.354452 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:07:50.354425    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c1d28b63-2d7a-410d-a4ae-8a23df5a6c3c-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-8sjg4\" (UID: \"c1d28b63-2d7a-410d-a4ae-8a23df5a6c3c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-8sjg4"
Jul 20 13:07:50.355186 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:07:50.355167    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c1d28b63-2d7a-410d-a4ae-8a23df5a6c3c-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-8sjg4\" (UID: \"c1d28b63-2d7a-410d-a4ae-8a23df5a6c3c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-8sjg4"
Jul 20 13:07:50.362844 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:07:50.362271    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c1d28b63-2d7a-410d-a4ae-8a23df5a6c3c-istio-token\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-8sjg4\" (UID: \"c1d28b63-2d7a-410d-a4ae-8a23df5a6c3c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-8sjg4"
Jul 20 13:07:50.368436 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:07:50.368403    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wlzxz\" (UniqueName: \"kubernetes.io/projected/c1d28b63-2d7a-410d-a4ae-8a23df5a6c3c-kube-api-access-wlzxz\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-8sjg4\" (UID: \"c1d28b63-2d7a-410d-a4ae-8a23df5a6c3c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-8sjg4"
Jul 20 13:07:50.453154 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:07:50.453098    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-8sjg4"
Jul 20 13:07:50.453297 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:07:50.453276    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0d945cc6-346b-4037-a971-2afe9b904532-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4xkqwv\" (UID: \"0d945cc6-346b-4037-a971-2afe9b904532\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xkqwv"
Jul 20 13:07:50.453345 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:07:50.453314    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n6vqd\" (UniqueName: \"kubernetes.io/projected/0d945cc6-346b-4037-a971-2afe9b904532-kube-api-access-n6vqd\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4xkqwv\" (UID: \"0d945cc6-346b-4037-a971-2afe9b904532\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xkqwv"
Jul 20 13:07:50.453398 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:07:50.453342    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0d945cc6-346b-4037-a971-2afe9b904532-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4xkqwv\" (UID: \"0d945cc6-346b-4037-a971-2afe9b904532\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xkqwv"
Jul 20 13:07:50.453398 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:07:50.453378    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0d945cc6-346b-4037-a971-2afe9b904532-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4xkqwv\" (UID: \"0d945cc6-346b-4037-a971-2afe9b904532\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xkqwv"
Jul 20 13:07:50.453487 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:07:50.453430    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0d945cc6-346b-4037-a971-2afe9b904532-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4xkqwv\" (UID: \"0d945cc6-346b-4037-a971-2afe9b904532\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xkqwv"
Jul 20 13:07:50.453487 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:07:50.453455    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0d945cc6-346b-4037-a971-2afe9b904532-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4xkqwv\" (UID: \"0d945cc6-346b-4037-a971-2afe9b904532\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xkqwv"
Jul 20 13:07:50.453593 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:07:50.453549    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0d945cc6-346b-4037-a971-2afe9b904532-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4xkqwv\" (UID: \"0d945cc6-346b-4037-a971-2afe9b904532\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xkqwv"
Jul 20 13:07:50.453593 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:07:50.453576    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0d945cc6-346b-4037-a971-2afe9b904532-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4xkqwv\" (UID: \"0d945cc6-346b-4037-a971-2afe9b904532\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xkqwv"
Jul 20 13:07:50.453694 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:07:50.453599    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0d945cc6-346b-4037-a971-2afe9b904532-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4xkqwv\" (UID: \"0d945cc6-346b-4037-a971-2afe9b904532\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xkqwv"
Jul 20 13:07:50.453785 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:07:50.453760    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0d945cc6-346b-4037-a971-2afe9b904532-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4xkqwv\" (UID: \"0d945cc6-346b-4037-a971-2afe9b904532\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xkqwv"
Jul 20 13:07:50.453943 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:07:50.453922    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0d945cc6-346b-4037-a971-2afe9b904532-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4xkqwv\" (UID: \"0d945cc6-346b-4037-a971-2afe9b904532\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xkqwv"
Jul 20 13:07:50.454154 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:07:50.453857    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0d945cc6-346b-4037-a971-2afe9b904532-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4xkqwv\" (UID: \"0d945cc6-346b-4037-a971-2afe9b904532\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xkqwv"
Jul 20 13:07:50.454154 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:07:50.454025    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0d945cc6-346b-4037-a971-2afe9b904532-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4xkqwv\" (UID: \"0d945cc6-346b-4037-a971-2afe9b904532\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xkqwv"
Jul 20 13:07:50.454300 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:07:50.454220    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0d945cc6-346b-4037-a971-2afe9b904532-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4xkqwv\" (UID: \"0d945cc6-346b-4037-a971-2afe9b904532\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xkqwv"
Jul 20 13:07:50.455934 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:07:50.455911    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0d945cc6-346b-4037-a971-2afe9b904532-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4xkqwv\" (UID: \"0d945cc6-346b-4037-a971-2afe9b904532\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xkqwv"
Jul 20 13:07:50.456023 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:07:50.455947    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0d945cc6-346b-4037-a971-2afe9b904532-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4xkqwv\" (UID: \"0d945cc6-346b-4037-a971-2afe9b904532\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xkqwv"
Jul 20 13:07:50.460525 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:07:50.460501    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0d945cc6-346b-4037-a971-2afe9b904532-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4xkqwv\" (UID: \"0d945cc6-346b-4037-a971-2afe9b904532\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xkqwv"
Jul 20 13:07:50.461566 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:07:50.461534    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n6vqd\" (UniqueName: \"kubernetes.io/projected/0d945cc6-346b-4037-a971-2afe9b904532-kube-api-access-n6vqd\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4xkqwv\" (UID: \"0d945cc6-346b-4037-a971-2afe9b904532\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xkqwv"
Jul 20 13:07:50.598092 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:07:50.598068    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-8sjg4"]
Jul 20 13:07:50.600002 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:07:50.599940    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc1d28b63_2d7a_410d_a4ae_8a23df5a6c3c.slice/crio-3a07d033b048c7f8b852396e989994ef5048458d4d2efb9dbde0da8cc7b7feda WatchSource:0}: Error finding container 3a07d033b048c7f8b852396e989994ef5048458d4d2efb9dbde0da8cc7b7feda: Status 404 returned error can't find the container with id 3a07d033b048c7f8b852396e989994ef5048458d4d2efb9dbde0da8cc7b7feda
Jul 20 13:07:50.638282 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:07:50.638248    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xkqwv"
Jul 20 13:07:50.751833 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:07:50.751765    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-8sjg4" event={"ID":"c1d28b63-2d7a-410d-a4ae-8a23df5a6c3c","Type":"ContainerStarted","Data":"3a07d033b048c7f8b852396e989994ef5048458d4d2efb9dbde0da8cc7b7feda"}
Jul 20 13:07:50.800233 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:07:50.800207    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xkqwv"]
Jul 20 13:07:50.801807 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:07:50.801778    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0d945cc6_346b_4037_a971_2afe9b904532.slice/crio-876fa74ebbf11590e373b1cbe2bf9c9830f247cf7bc70ca6fdfb79c6e36ce9f5 WatchSource:0}: Error finding container 876fa74ebbf11590e373b1cbe2bf9c9830f247cf7bc70ca6fdfb79c6e36ce9f5: Status 404 returned error can't find the container with id 876fa74ebbf11590e373b1cbe2bf9c9830f247cf7bc70ca6fdfb79c6e36ce9f5
Jul 20 13:07:51.010026 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:07:51.010000    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-84676b455f-t69fl"]
Jul 20 13:07:51.014892 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:07:51.014871    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-84676b455f-t69fl"
Jul 20 13:07:51.017092 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:07:51.017059    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 20 13:07:51.017196 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:07:51.017109    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 20 13:07:51.017256 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:07:51.017243    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 20 13:07:51.017319 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:07:51.017258    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 20 13:07:51.017319 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:07:51.017260    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 20 13:07:51.017423 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:07:51.017279    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-g6p65\""
Jul 20 13:07:51.022628 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:07:51.022607    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-84676b455f-t69fl"]
Jul 20 13:07:51.059061 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:07:51.059026    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9c64x\" (UniqueName: \"kubernetes.io/projected/6f891740-e814-48ff-8796-372afc6f1c2d-kube-api-access-9c64x\") pod \"lws-controller-manager-84676b455f-t69fl\" (UID: \"6f891740-e814-48ff-8796-372afc6f1c2d\") " pod="openshift-lws-operator/lws-controller-manager-84676b455f-t69fl"
Jul 20 13:07:51.059193 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:07:51.059125    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/6f891740-e814-48ff-8796-372afc6f1c2d-manager-config\") pod \"lws-controller-manager-84676b455f-t69fl\" (UID: \"6f891740-e814-48ff-8796-372afc6f1c2d\") " pod="openshift-lws-operator/lws-controller-manager-84676b455f-t69fl"
Jul 20 13:07:51.059258 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:07:51.059201    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/6f891740-e814-48ff-8796-372afc6f1c2d-metrics-cert\") pod \"lws-controller-manager-84676b455f-t69fl\" (UID: \"6f891740-e814-48ff-8796-372afc6f1c2d\") " pod="openshift-lws-operator/lws-controller-manager-84676b455f-t69fl"
Jul 20 13:07:51.059313 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:07:51.059264    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6f891740-e814-48ff-8796-372afc6f1c2d-cert\") pod \"lws-controller-manager-84676b455f-t69fl\" (UID: \"6f891740-e814-48ff-8796-372afc6f1c2d\") " pod="openshift-lws-operator/lws-controller-manager-84676b455f-t69fl"
Jul 20 13:07:51.160610 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:07:51.160569    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9c64x\" (UniqueName: \"kubernetes.io/projected/6f891740-e814-48ff-8796-372afc6f1c2d-kube-api-access-9c64x\") pod \"lws-controller-manager-84676b455f-t69fl\" (UID: \"6f891740-e814-48ff-8796-372afc6f1c2d\") " pod="openshift-lws-operator/lws-controller-manager-84676b455f-t69fl"
Jul 20 13:07:51.161063 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:07:51.160627    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/6f891740-e814-48ff-8796-372afc6f1c2d-manager-config\") pod \"lws-controller-manager-84676b455f-t69fl\" (UID: \"6f891740-e814-48ff-8796-372afc6f1c2d\") " pod="openshift-lws-operator/lws-controller-manager-84676b455f-t69fl"
Jul 20 13:07:51.161063 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:07:51.160676    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/6f891740-e814-48ff-8796-372afc6f1c2d-metrics-cert\") pod \"lws-controller-manager-84676b455f-t69fl\" (UID: \"6f891740-e814-48ff-8796-372afc6f1c2d\") " pod="openshift-lws-operator/lws-controller-manager-84676b455f-t69fl"
Jul 20 13:07:51.161063 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:07:51.160713    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6f891740-e814-48ff-8796-372afc6f1c2d-cert\") pod \"lws-controller-manager-84676b455f-t69fl\" (UID: \"6f891740-e814-48ff-8796-372afc6f1c2d\") " pod="openshift-lws-operator/lws-controller-manager-84676b455f-t69fl"
Jul 20 13:07:51.161459 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:07:51.161434    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/6f891740-e814-48ff-8796-372afc6f1c2d-manager-config\") pod \"lws-controller-manager-84676b455f-t69fl\" (UID: \"6f891740-e814-48ff-8796-372afc6f1c2d\") " pod="openshift-lws-operator/lws-controller-manager-84676b455f-t69fl"
Jul 20 13:07:51.163478 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:07:51.163453    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6f891740-e814-48ff-8796-372afc6f1c2d-cert\") pod \"lws-controller-manager-84676b455f-t69fl\" (UID: \"6f891740-e814-48ff-8796-372afc6f1c2d\") " pod="openshift-lws-operator/lws-controller-manager-84676b455f-t69fl"
Jul 20 13:07:51.163615 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:07:51.163598    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/6f891740-e814-48ff-8796-372afc6f1c2d-metrics-cert\") pod \"lws-controller-manager-84676b455f-t69fl\" (UID: \"6f891740-e814-48ff-8796-372afc6f1c2d\") " pod="openshift-lws-operator/lws-controller-manager-84676b455f-t69fl"
Jul 20 13:07:51.168146 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:07:51.168127    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9c64x\" (UniqueName: \"kubernetes.io/projected/6f891740-e814-48ff-8796-372afc6f1c2d-kube-api-access-9c64x\") pod \"lws-controller-manager-84676b455f-t69fl\" (UID: \"6f891740-e814-48ff-8796-372afc6f1c2d\") " pod="openshift-lws-operator/lws-controller-manager-84676b455f-t69fl"
Jul 20 13:07:51.325636 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:07:51.325518    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-84676b455f-t69fl"
Jul 20 13:07:51.551010 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:07:51.548118    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-84676b455f-t69fl"]
Jul 20 13:07:51.641269 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:07:51.641180    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6f891740_e814_48ff_8796_372afc6f1c2d.slice/crio-9b9c1ef5e1fd45b09b85ed65860e8f2d4be5d78fdabfb1b35ee8b9e53d3f6ab6 WatchSource:0}: Error finding container 9b9c1ef5e1fd45b09b85ed65860e8f2d4be5d78fdabfb1b35ee8b9e53d3f6ab6: Status 404 returned error can't find the container with id 9b9c1ef5e1fd45b09b85ed65860e8f2d4be5d78fdabfb1b35ee8b9e53d3f6ab6
Jul 20 13:07:51.758902 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:07:51.758834    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-84676b455f-t69fl" event={"ID":"6f891740-e814-48ff-8796-372afc6f1c2d","Type":"ContainerStarted","Data":"9b9c1ef5e1fd45b09b85ed65860e8f2d4be5d78fdabfb1b35ee8b9e53d3f6ab6"}
Jul 20 13:07:51.760193 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:07:51.760163    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xkqwv" event={"ID":"0d945cc6-346b-4037-a971-2afe9b904532","Type":"ContainerStarted","Data":"876fa74ebbf11590e373b1cbe2bf9c9830f247cf7bc70ca6fdfb79c6e36ce9f5"}
Jul 20 13:07:53.062228 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:07:53.060437    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-bgjjs"]
Jul 20 13:07:53.064496 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:07:53.064463    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-bgjjs"
Jul 20 13:07:53.069926 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:07:53.067290    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-x5kjz\""
Jul 20 13:07:53.069926 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:07:53.068129    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
Jul 20 13:07:53.075356 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:07:53.074912    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-bgjjs"]
Jul 20 13:07:53.183919 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:07:53.183880    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3b6eeb61-e4af-47fa-8851-ee5f5dc9c802-cert\") pod \"kserve-controller-manager-d6f4b65b8-bgjjs\" (UID: \"3b6eeb61-e4af-47fa-8851-ee5f5dc9c802\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-bgjjs"
Jul 20 13:07:53.184166 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:07:53.183941    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8p6l7\" (UniqueName: \"kubernetes.io/projected/3b6eeb61-e4af-47fa-8851-ee5f5dc9c802-kube-api-access-8p6l7\") pod \"kserve-controller-manager-d6f4b65b8-bgjjs\" (UID: \"3b6eeb61-e4af-47fa-8851-ee5f5dc9c802\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-bgjjs"
Jul 20 13:07:53.285453 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:07:53.285373    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3b6eeb61-e4af-47fa-8851-ee5f5dc9c802-cert\") pod \"kserve-controller-manager-d6f4b65b8-bgjjs\" (UID: \"3b6eeb61-e4af-47fa-8851-ee5f5dc9c802\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-bgjjs"
Jul 20 13:07:53.285453 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:07:53.285418    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8p6l7\" (UniqueName: \"kubernetes.io/projected/3b6eeb61-e4af-47fa-8851-ee5f5dc9c802-kube-api-access-8p6l7\") pod \"kserve-controller-manager-d6f4b65b8-bgjjs\" (UID: \"3b6eeb61-e4af-47fa-8851-ee5f5dc9c802\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-bgjjs"
Jul 20 13:07:53.285664 ip-10-0-134-121 kubenswrapper[2584]: E0720 13:07:53.285560    2584 secret.go:189] Couldn't get secret opendatahub/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found
Jul 20 13:07:53.285664 ip-10-0-134-121 kubenswrapper[2584]: E0720 13:07:53.285650    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3b6eeb61-e4af-47fa-8851-ee5f5dc9c802-cert podName:3b6eeb61-e4af-47fa-8851-ee5f5dc9c802 nodeName:}" failed. No retries permitted until 2026-07-20 13:07:53.785628267 +0000 UTC m=+363.502175672 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/3b6eeb61-e4af-47fa-8851-ee5f5dc9c802-cert") pod "kserve-controller-manager-d6f4b65b8-bgjjs" (UID: "3b6eeb61-e4af-47fa-8851-ee5f5dc9c802") : secret "kserve-webhook-server-cert" not found
Jul 20 13:07:53.300431 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:07:53.300400    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8p6l7\" (UniqueName: \"kubernetes.io/projected/3b6eeb61-e4af-47fa-8851-ee5f5dc9c802-kube-api-access-8p6l7\") pod \"kserve-controller-manager-d6f4b65b8-bgjjs\" (UID: \"3b6eeb61-e4af-47fa-8851-ee5f5dc9c802\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-bgjjs"
Jul 20 13:07:53.790185 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:07:53.790151    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3b6eeb61-e4af-47fa-8851-ee5f5dc9c802-cert\") pod \"kserve-controller-manager-d6f4b65b8-bgjjs\" (UID: \"3b6eeb61-e4af-47fa-8851-ee5f5dc9c802\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-bgjjs"
Jul 20 13:07:53.792945 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:07:53.792912    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3b6eeb61-e4af-47fa-8851-ee5f5dc9c802-cert\") pod \"kserve-controller-manager-d6f4b65b8-bgjjs\" (UID: \"3b6eeb61-e4af-47fa-8851-ee5f5dc9c802\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-bgjjs"
Jul 20 13:07:53.992807 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:07:53.992770    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-bgjjs"
Jul 20 13:07:54.700190 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:07:54.700119    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-bgjjs"]
Jul 20 13:07:55.662683 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:07:55.662653    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3b6eeb61_e4af_47fa_8851_ee5f5dc9c802.slice/crio-8e6e2dbc175a49767e27065f07c34ca11df9a8ff59dd31d1ac5971cc59577b4a WatchSource:0}: Error finding container 8e6e2dbc175a49767e27065f07c34ca11df9a8ff59dd31d1ac5971cc59577b4a: Status 404 returned error can't find the container with id 8e6e2dbc175a49767e27065f07c34ca11df9a8ff59dd31d1ac5971cc59577b4a
Jul 20 13:07:55.721553 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:07:55.721508    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 20 13:07:55.721829 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:07:55.721590    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 20 13:07:55.721829 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:07:55.721620    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 20 13:07:55.784172 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:07:55.784145    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-bgjjs" event={"ID":"3b6eeb61-e4af-47fa-8851-ee5f5dc9c802","Type":"ContainerStarted","Data":"8e6e2dbc175a49767e27065f07c34ca11df9a8ff59dd31d1ac5971cc59577b4a"}
Jul 20 13:07:56.793527 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:07:56.793420    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-8sjg4" event={"ID":"c1d28b63-2d7a-410d-a4ae-8a23df5a6c3c","Type":"ContainerStarted","Data":"df357a4309d28db21f97d6491b302389b176708405e0ac4bbabe941f9a544c91"}
Jul 20 13:07:56.819066 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:07:56.819010    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-8sjg4" podStartSLOduration=1.699597781 podStartE2EDuration="6.81898911s" totalImagesPullingTime="5.119391329s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 13:07:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 13:07:56.817095028 +0000 UTC m=+366.533642439" watchObservedRunningTime="2026-07-20 13:07:56.81898911 +0000 UTC m=+366.535536521"
Jul 20 13:07:56.894898 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:07:56.894866    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 20 13:07:56.895014 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:07:56.894953    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 20 13:07:56.895095 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:07:56.895013    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 20 13:07:57.454042 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:07:57.454005    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-8sjg4"
Jul 20 13:07:57.455246 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:07:57.455215    2584 patch_prober.go:28] interesting pod/data-science-gateway-data-science-gateway-class-84cc848bd-8sjg4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.24:15021/healthz/ready\": dial tcp 10.134.0.24:15021: connect: connection refused" start-of-body=
Jul 20 13:07:57.455388 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:07:57.455272    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-8sjg4" podUID="c1d28b63-2d7a-410d-a4ae-8a23df5a6c3c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.24:15021/healthz/ready\": dial tcp 10.134.0.24:15021: connect: connection refused"
Jul 20 13:07:57.801530 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:07:57.801492    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-84676b455f-t69fl" event={"ID":"6f891740-e814-48ff-8796-372afc6f1c2d","Type":"ContainerStarted","Data":"00ec797838c14ea8f3da6fc2376972b7b391bef0ad061c25480f3bb684849ce9"}
Jul 20 13:07:57.801951 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:07:57.801602    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-84676b455f-t69fl"
Jul 20 13:07:57.803400 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:07:57.803373    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xkqwv" event={"ID":"0d945cc6-346b-4037-a971-2afe9b904532","Type":"ContainerStarted","Data":"3d0650140532045513ca838844c19fcd0d6056ee32d2e19fe4104331c7981856"}
Jul 20 13:07:57.819412 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:07:57.819364    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-84676b455f-t69fl" podStartSLOduration=2.5750644620000003 podStartE2EDuration="7.819350493s" totalImagesPullingTime="5.244286031s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 13:07:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 13:07:57.816823423 +0000 UTC m=+367.533370835" watchObservedRunningTime="2026-07-20 13:07:57.819350493 +0000 UTC m=+367.535897903"
Jul 20 13:07:57.838317 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:07:57.838251    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xkqwv" podStartSLOduration=1.747307958 podStartE2EDuration="7.838228621s" totalImagesPullingTime="6.090920663s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 13:07:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 13:07:57.836275074 +0000 UTC m=+367.552822485" watchObservedRunningTime="2026-07-20 13:07:57.838228621 +0000 UTC m=+367.554776033"
Jul 20 13:07:58.453813 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:07:58.453725    2584 patch_prober.go:28] interesting pod/data-science-gateway-data-science-gateway-class-84cc848bd-8sjg4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.24:15021/healthz/ready\": dial tcp 10.134.0.24:15021: connect: connection refused" start-of-body=
Jul 20 13:07:58.453813 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:07:58.453782    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-8sjg4" podUID="c1d28b63-2d7a-410d-a4ae-8a23df5a6c3c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.24:15021/healthz/ready\": dial tcp 10.134.0.24:15021: connect: connection refused"
Jul 20 13:07:58.639222 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:07:58.639189    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xkqwv"
Jul 20 13:07:58.644905 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:07:58.644880    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xkqwv"
Jul 20 13:07:58.814772 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:07:58.814726    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-bgjjs" event={"ID":"3b6eeb61-e4af-47fa-8851-ee5f5dc9c802","Type":"ContainerStarted","Data":"01df32d040947e9e9937342a2139468acbe9d9c11cd78fbe499aab5a956c0fcb"}
Jul 20 13:07:58.815279 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:07:58.814861    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-bgjjs"
Jul 20 13:07:58.815279 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:07:58.815130    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xkqwv"
Jul 20 13:07:58.815941 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:07:58.815922    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xkqwv"
Jul 20 13:07:58.831652 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:07:58.831612    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-bgjjs" podStartSLOduration=3.302760155 podStartE2EDuration="5.831596288s" totalImagesPullingTime="2.528836133s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 13:07:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 13:07:58.830186234 +0000 UTC m=+368.546733645" watchObservedRunningTime="2026-07-20 13:07:58.831596288 +0000 UTC m=+368.548143700"
Jul 20 13:07:58.877447 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:07:58.877411    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-8sjg4"]
Jul 20 13:07:59.453896 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:07:59.453854    2584 patch_prober.go:28] interesting pod/data-science-gateway-data-science-gateway-class-84cc848bd-8sjg4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.24:15021/healthz/ready\": dial tcp 10.134.0.24:15021: connect: connection refused" start-of-body=
Jul 20 13:07:59.454080 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:07:59.453930    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-8sjg4" podUID="c1d28b63-2d7a-410d-a4ae-8a23df5a6c3c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.24:15021/healthz/ready\": dial tcp 10.134.0.24:15021: connect: connection refused"
Jul 20 13:07:59.818932 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:07:59.818890    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-8sjg4" podUID="c1d28b63-2d7a-410d-a4ae-8a23df5a6c3c" containerName="istio-proxy" containerID="cri-o://df357a4309d28db21f97d6491b302389b176708405e0ac4bbabe941f9a544c91" gracePeriod=30
Jul 20 13:08:05.074288 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:08:05.074256    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-8sjg4"
Jul 20 13:08:05.203191 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:08:05.203099    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c1d28b63-2d7a-410d-a4ae-8a23df5a6c3c-istio-token\") pod \"c1d28b63-2d7a-410d-a4ae-8a23df5a6c3c\" (UID: \"c1d28b63-2d7a-410d-a4ae-8a23df5a6c3c\") "
Jul 20 13:08:05.203191 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:08:05.203146    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c1d28b63-2d7a-410d-a4ae-8a23df5a6c3c-istio-data\") pod \"c1d28b63-2d7a-410d-a4ae-8a23df5a6c3c\" (UID: \"c1d28b63-2d7a-410d-a4ae-8a23df5a6c3c\") "
Jul 20 13:08:05.203191 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:08:05.203176    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wlzxz\" (UniqueName: \"kubernetes.io/projected/c1d28b63-2d7a-410d-a4ae-8a23df5a6c3c-kube-api-access-wlzxz\") pod \"c1d28b63-2d7a-410d-a4ae-8a23df5a6c3c\" (UID: \"c1d28b63-2d7a-410d-a4ae-8a23df5a6c3c\") "
Jul 20 13:08:05.203441 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:08:05.203300    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c1d28b63-2d7a-410d-a4ae-8a23df5a6c3c-workload-socket\") pod \"c1d28b63-2d7a-410d-a4ae-8a23df5a6c3c\" (UID: \"c1d28b63-2d7a-410d-a4ae-8a23df5a6c3c\") "
Jul 20 13:08:05.203441 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:08:05.203393    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c1d28b63-2d7a-410d-a4ae-8a23df5a6c3c-workload-certs\") pod \"c1d28b63-2d7a-410d-a4ae-8a23df5a6c3c\" (UID: \"c1d28b63-2d7a-410d-a4ae-8a23df5a6c3c\") "
Jul 20 13:08:05.203441 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:08:05.203428    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c1d28b63-2d7a-410d-a4ae-8a23df5a6c3c-credential-socket\") pod \"c1d28b63-2d7a-410d-a4ae-8a23df5a6c3c\" (UID: \"c1d28b63-2d7a-410d-a4ae-8a23df5a6c3c\") "
Jul 20 13:08:05.203604 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:08:05.203440    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c1d28b63-2d7a-410d-a4ae-8a23df5a6c3c-istio-data" (OuterVolumeSpecName: "istio-data") pod "c1d28b63-2d7a-410d-a4ae-8a23df5a6c3c" (UID: "c1d28b63-2d7a-410d-a4ae-8a23df5a6c3c"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 13:08:05.203604 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:08:05.203465    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c1d28b63-2d7a-410d-a4ae-8a23df5a6c3c-istiod-ca-cert\") pod \"c1d28b63-2d7a-410d-a4ae-8a23df5a6c3c\" (UID: \"c1d28b63-2d7a-410d-a4ae-8a23df5a6c3c\") "
Jul 20 13:08:05.203604 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:08:05.203505    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c1d28b63-2d7a-410d-a4ae-8a23df5a6c3c-istio-envoy\") pod \"c1d28b63-2d7a-410d-a4ae-8a23df5a6c3c\" (UID: \"c1d28b63-2d7a-410d-a4ae-8a23df5a6c3c\") "
Jul 20 13:08:05.203604 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:08:05.203551    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c1d28b63-2d7a-410d-a4ae-8a23df5a6c3c-istio-podinfo\") pod \"c1d28b63-2d7a-410d-a4ae-8a23df5a6c3c\" (UID: \"c1d28b63-2d7a-410d-a4ae-8a23df5a6c3c\") "
Jul 20 13:08:05.203604 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:08:05.203582    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c1d28b63-2d7a-410d-a4ae-8a23df5a6c3c-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "c1d28b63-2d7a-410d-a4ae-8a23df5a6c3c" (UID: "c1d28b63-2d7a-410d-a4ae-8a23df5a6c3c"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 13:08:05.203820 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:08:05.203615    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c1d28b63-2d7a-410d-a4ae-8a23df5a6c3c-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "c1d28b63-2d7a-410d-a4ae-8a23df5a6c3c" (UID: "c1d28b63-2d7a-410d-a4ae-8a23df5a6c3c"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 13:08:05.203820 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:08:05.203676    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c1d28b63-2d7a-410d-a4ae-8a23df5a6c3c-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "c1d28b63-2d7a-410d-a4ae-8a23df5a6c3c" (UID: "c1d28b63-2d7a-410d-a4ae-8a23df5a6c3c"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 13:08:05.204020 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:08:05.203940    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c1d28b63-2d7a-410d-a4ae-8a23df5a6c3c-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "c1d28b63-2d7a-410d-a4ae-8a23df5a6c3c" (UID: "c1d28b63-2d7a-410d-a4ae-8a23df5a6c3c"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 13:08:05.204365 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:08:05.204242    2584 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c1d28b63-2d7a-410d-a4ae-8a23df5a6c3c-istiod-ca-cert\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 20 13:08:05.204365 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:08:05.204266    2584 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c1d28b63-2d7a-410d-a4ae-8a23df5a6c3c-istio-data\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 20 13:08:05.204365 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:08:05.204300    2584 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c1d28b63-2d7a-410d-a4ae-8a23df5a6c3c-workload-socket\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 20 13:08:05.204365 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:08:05.204319    2584 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c1d28b63-2d7a-410d-a4ae-8a23df5a6c3c-workload-certs\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 20 13:08:05.204365 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:08:05.204333    2584 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c1d28b63-2d7a-410d-a4ae-8a23df5a6c3c-credential-socket\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 20 13:08:05.206082 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:08:05.206044    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c1d28b63-2d7a-410d-a4ae-8a23df5a6c3c-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "c1d28b63-2d7a-410d-a4ae-8a23df5a6c3c" (UID: "c1d28b63-2d7a-410d-a4ae-8a23df5a6c3c"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 13:08:05.206183 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:08:05.206161    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c1d28b63-2d7a-410d-a4ae-8a23df5a6c3c-istio-token" (OuterVolumeSpecName: "istio-token") pod "c1d28b63-2d7a-410d-a4ae-8a23df5a6c3c" (UID: "c1d28b63-2d7a-410d-a4ae-8a23df5a6c3c"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 13:08:05.206240 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:08:05.206166    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c1d28b63-2d7a-410d-a4ae-8a23df5a6c3c-kube-api-access-wlzxz" (OuterVolumeSpecName: "kube-api-access-wlzxz") pod "c1d28b63-2d7a-410d-a4ae-8a23df5a6c3c" (UID: "c1d28b63-2d7a-410d-a4ae-8a23df5a6c3c"). InnerVolumeSpecName "kube-api-access-wlzxz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 13:08:05.206280 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:08:05.206241    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/c1d28b63-2d7a-410d-a4ae-8a23df5a6c3c-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "c1d28b63-2d7a-410d-a4ae-8a23df5a6c3c" (UID: "c1d28b63-2d7a-410d-a4ae-8a23df5a6c3c"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 20 13:08:05.304827 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:08:05.304774    2584 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c1d28b63-2d7a-410d-a4ae-8a23df5a6c3c-istio-envoy\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 20 13:08:05.304827 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:08:05.304819    2584 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c1d28b63-2d7a-410d-a4ae-8a23df5a6c3c-istio-podinfo\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 20 13:08:05.304827 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:08:05.304830    2584 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c1d28b63-2d7a-410d-a4ae-8a23df5a6c3c-istio-token\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 20 13:08:05.304827 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:08:05.304841    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wlzxz\" (UniqueName: \"kubernetes.io/projected/c1d28b63-2d7a-410d-a4ae-8a23df5a6c3c-kube-api-access-wlzxz\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 20 13:08:05.848732 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:08:05.848695    2584 generic.go:356] "Generic (PLEG): container finished" podID="c1d28b63-2d7a-410d-a4ae-8a23df5a6c3c" containerID="df357a4309d28db21f97d6491b302389b176708405e0ac4bbabe941f9a544c91" exitCode=0
Jul 20 13:08:05.848914 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:08:05.848742    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-8sjg4"
Jul 20 13:08:05.848914 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:08:05.848780    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-8sjg4" event={"ID":"c1d28b63-2d7a-410d-a4ae-8a23df5a6c3c","Type":"ContainerDied","Data":"df357a4309d28db21f97d6491b302389b176708405e0ac4bbabe941f9a544c91"}
Jul 20 13:08:05.848914 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:08:05.848833    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-8sjg4" event={"ID":"c1d28b63-2d7a-410d-a4ae-8a23df5a6c3c","Type":"ContainerDied","Data":"3a07d033b048c7f8b852396e989994ef5048458d4d2efb9dbde0da8cc7b7feda"}
Jul 20 13:08:05.848914 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:08:05.848856    2584 scope.go:117] "RemoveContainer" containerID="df357a4309d28db21f97d6491b302389b176708405e0ac4bbabe941f9a544c91"
Jul 20 13:08:05.858146 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:08:05.858130    2584 scope.go:117] "RemoveContainer" containerID="df357a4309d28db21f97d6491b302389b176708405e0ac4bbabe941f9a544c91"
Jul 20 13:08:05.858392 ip-10-0-134-121 kubenswrapper[2584]: E0720 13:08:05.858373    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"df357a4309d28db21f97d6491b302389b176708405e0ac4bbabe941f9a544c91\": container with ID starting with df357a4309d28db21f97d6491b302389b176708405e0ac4bbabe941f9a544c91 not found: ID does not exist" containerID="df357a4309d28db21f97d6491b302389b176708405e0ac4bbabe941f9a544c91"
Jul 20 13:08:05.858437 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:08:05.858402    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"df357a4309d28db21f97d6491b302389b176708405e0ac4bbabe941f9a544c91"} err="failed to get container status \"df357a4309d28db21f97d6491b302389b176708405e0ac4bbabe941f9a544c91\": rpc error: code = NotFound desc = could not find container \"df357a4309d28db21f97d6491b302389b176708405e0ac4bbabe941f9a544c91\": container with ID starting with df357a4309d28db21f97d6491b302389b176708405e0ac4bbabe941f9a544c91 not found: ID does not exist"
Jul 20 13:08:05.869530 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:08:05.869502    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-8sjg4"]
Jul 20 13:08:05.873000 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:08:05.872979    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-8sjg4"]
Jul 20 13:08:07.095652 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:08:07.095604    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c1d28b63-2d7a-410d-a4ae-8a23df5a6c3c" path="/var/lib/kubelet/pods/c1d28b63-2d7a-410d-a4ae-8a23df5a6c3c/volumes"
Jul 20 13:08:08.817588 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:08:08.817543    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-84676b455f-t69fl"
Jul 20 13:08:29.823862 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:08:29.823825    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-bgjjs"
Jul 20 13:08:43.947985 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:08:43.947930    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-mcmgr"]
Jul 20 13:08:43.948372 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:08:43.948323    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c1d28b63-2d7a-410d-a4ae-8a23df5a6c3c" containerName="istio-proxy"
Jul 20 13:08:43.948372 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:08:43.948335    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="c1d28b63-2d7a-410d-a4ae-8a23df5a6c3c" containerName="istio-proxy"
Jul 20 13:08:43.948449 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:08:43.948406    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="c1d28b63-2d7a-410d-a4ae-8a23df5a6c3c" containerName="istio-proxy"
Jul 20 13:08:43.950586 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:08:43.950566    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-mcmgr"
Jul 20 13:08:43.952629 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:08:43.952605    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 20 13:08:43.953078 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:08:43.953054    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 20 13:08:43.953188 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:08:43.953102    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-fnprn\""
Jul 20 13:08:43.959397 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:08:43.959373    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-mcmgr"]
Jul 20 13:08:44.060503 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:08:44.060466    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bxpn4\" (UniqueName: \"kubernetes.io/projected/b74dedfa-3cfc-40aa-92ae-f310d20f21ee-kube-api-access-bxpn4\") pod \"kuadrant-operator-catalog-mcmgr\" (UID: \"b74dedfa-3cfc-40aa-92ae-f310d20f21ee\") " pod="kuadrant-system/kuadrant-operator-catalog-mcmgr"
Jul 20 13:08:44.161157 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:08:44.161114    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bxpn4\" (UniqueName: \"kubernetes.io/projected/b74dedfa-3cfc-40aa-92ae-f310d20f21ee-kube-api-access-bxpn4\") pod \"kuadrant-operator-catalog-mcmgr\" (UID: \"b74dedfa-3cfc-40aa-92ae-f310d20f21ee\") " pod="kuadrant-system/kuadrant-operator-catalog-mcmgr"
Jul 20 13:08:44.168446 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:08:44.168413    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bxpn4\" (UniqueName: \"kubernetes.io/projected/b74dedfa-3cfc-40aa-92ae-f310d20f21ee-kube-api-access-bxpn4\") pod \"kuadrant-operator-catalog-mcmgr\" (UID: \"b74dedfa-3cfc-40aa-92ae-f310d20f21ee\") " pod="kuadrant-system/kuadrant-operator-catalog-mcmgr"
Jul 20 13:08:44.261806 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:08:44.261768    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-mcmgr"
Jul 20 13:08:44.321893 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:08:44.321863    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-mcmgr"]
Jul 20 13:08:44.404483 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:08:44.404458    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-mcmgr"]
Jul 20 13:08:44.407297 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:08:44.407265    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb74dedfa_3cfc_40aa_92ae_f310d20f21ee.slice/crio-631e6edde3fafee1874365f03604bc953edfaed4fcefd11b3e4f266a78677392 WatchSource:0}: Error finding container 631e6edde3fafee1874365f03604bc953edfaed4fcefd11b3e4f266a78677392: Status 404 returned error can't find the container with id 631e6edde3fafee1874365f03604bc953edfaed4fcefd11b3e4f266a78677392
Jul 20 13:08:44.532938 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:08:44.532854    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-w2q5n"]
Jul 20 13:08:44.535757 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:08:44.535739    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-w2q5n"
Jul 20 13:08:44.543576 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:08:44.543548    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-w2q5n"]
Jul 20 13:08:44.666931 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:08:44.666895    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-99vnn\" (UniqueName: \"kubernetes.io/projected/fdc3275b-0cbd-4433-8dce-1bfd7378e27b-kube-api-access-99vnn\") pod \"kuadrant-operator-catalog-w2q5n\" (UID: \"fdc3275b-0cbd-4433-8dce-1bfd7378e27b\") " pod="kuadrant-system/kuadrant-operator-catalog-w2q5n"
Jul 20 13:08:44.768309 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:08:44.768265    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-99vnn\" (UniqueName: \"kubernetes.io/projected/fdc3275b-0cbd-4433-8dce-1bfd7378e27b-kube-api-access-99vnn\") pod \"kuadrant-operator-catalog-w2q5n\" (UID: \"fdc3275b-0cbd-4433-8dce-1bfd7378e27b\") " pod="kuadrant-system/kuadrant-operator-catalog-w2q5n"
Jul 20 13:08:44.776705 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:08:44.776679    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-99vnn\" (UniqueName: \"kubernetes.io/projected/fdc3275b-0cbd-4433-8dce-1bfd7378e27b-kube-api-access-99vnn\") pod \"kuadrant-operator-catalog-w2q5n\" (UID: \"fdc3275b-0cbd-4433-8dce-1bfd7378e27b\") " pod="kuadrant-system/kuadrant-operator-catalog-w2q5n"
Jul 20 13:08:44.846284 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:08:44.846199    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-w2q5n"
Jul 20 13:08:44.992443 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:08:44.992355    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-w2q5n"]
Jul 20 13:08:44.994877 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:08:44.994842    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfdc3275b_0cbd_4433_8dce_1bfd7378e27b.slice/crio-397890e68726d5be318f9ba8d1aeb9d371c67aa1140930f6ff3f13d50a63c2b8 WatchSource:0}: Error finding container 397890e68726d5be318f9ba8d1aeb9d371c67aa1140930f6ff3f13d50a63c2b8: Status 404 returned error can't find the container with id 397890e68726d5be318f9ba8d1aeb9d371c67aa1140930f6ff3f13d50a63c2b8
Jul 20 13:08:45.027115 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:08:45.027089    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-w2q5n" event={"ID":"fdc3275b-0cbd-4433-8dce-1bfd7378e27b","Type":"ContainerStarted","Data":"397890e68726d5be318f9ba8d1aeb9d371c67aa1140930f6ff3f13d50a63c2b8"}
Jul 20 13:08:45.028240 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:08:45.028217    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-mcmgr" event={"ID":"b74dedfa-3cfc-40aa-92ae-f310d20f21ee","Type":"ContainerStarted","Data":"631e6edde3fafee1874365f03604bc953edfaed4fcefd11b3e4f266a78677392"}
Jul 20 13:08:47.044721 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:08:47.044629    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-w2q5n" event={"ID":"fdc3275b-0cbd-4433-8dce-1bfd7378e27b","Type":"ContainerStarted","Data":"63eb0f560875c3bd8e139b76278a816210aabbf13a0e8a8a63ae75a9c98b00b7"}
Jul 20 13:08:47.046246 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:08:47.046218    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-mcmgr" event={"ID":"b74dedfa-3cfc-40aa-92ae-f310d20f21ee","Type":"ContainerStarted","Data":"b6b4c399ff52f0299ef33f8e0c29ca5395edd32b3fc0a78142a245a54f6c2dc6"}
Jul 20 13:08:47.046359 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:08:47.046253    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-mcmgr" podUID="b74dedfa-3cfc-40aa-92ae-f310d20f21ee" containerName="registry-server" containerID="cri-o://b6b4c399ff52f0299ef33f8e0c29ca5395edd32b3fc0a78142a245a54f6c2dc6" gracePeriod=2
Jul 20 13:08:47.064453 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:08:47.064408    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-w2q5n" podStartSLOduration=1.282385571 podStartE2EDuration="3.064393041s" totalImagesPullingTime="1.78200747s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 13:08:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 13:08:47.061830803 +0000 UTC m=+416.778378244" watchObservedRunningTime="2026-07-20 13:08:47.064393041 +0000 UTC m=+416.780940453"
Jul 20 13:08:47.081289 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:08:47.081239    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-mcmgr" podStartSLOduration=1.71548772 podStartE2EDuration="4.08122237s" totalImagesPullingTime="2.36573465s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 13:08:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 13:08:47.079435077 +0000 UTC m=+416.795982487" watchObservedRunningTime="2026-07-20 13:08:47.08122237 +0000 UTC m=+416.797769782"
Jul 20 13:08:47.300559 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:08:47.300497    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-mcmgr"
Jul 20 13:08:47.394044 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:08:47.394002    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bxpn4\" (UniqueName: \"kubernetes.io/projected/b74dedfa-3cfc-40aa-92ae-f310d20f21ee-kube-api-access-bxpn4\") pod \"b74dedfa-3cfc-40aa-92ae-f310d20f21ee\" (UID: \"b74dedfa-3cfc-40aa-92ae-f310d20f21ee\") "
Jul 20 13:08:47.396286 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:08:47.396255    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b74dedfa-3cfc-40aa-92ae-f310d20f21ee-kube-api-access-bxpn4" (OuterVolumeSpecName: "kube-api-access-bxpn4") pod "b74dedfa-3cfc-40aa-92ae-f310d20f21ee" (UID: "b74dedfa-3cfc-40aa-92ae-f310d20f21ee"). InnerVolumeSpecName "kube-api-access-bxpn4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 13:08:47.494884 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:08:47.494847    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bxpn4\" (UniqueName: \"kubernetes.io/projected/b74dedfa-3cfc-40aa-92ae-f310d20f21ee-kube-api-access-bxpn4\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 20 13:08:48.052075 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:08:48.051961    2584 generic.go:356] "Generic (PLEG): container finished" podID="b74dedfa-3cfc-40aa-92ae-f310d20f21ee" containerID="b6b4c399ff52f0299ef33f8e0c29ca5395edd32b3fc0a78142a245a54f6c2dc6" exitCode=0
Jul 20 13:08:48.052075 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:08:48.052035    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-mcmgr"
Jul 20 13:08:48.052075 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:08:48.052060    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-mcmgr" event={"ID":"b74dedfa-3cfc-40aa-92ae-f310d20f21ee","Type":"ContainerDied","Data":"b6b4c399ff52f0299ef33f8e0c29ca5395edd32b3fc0a78142a245a54f6c2dc6"}
Jul 20 13:08:48.052648 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:08:48.052113    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-mcmgr" event={"ID":"b74dedfa-3cfc-40aa-92ae-f310d20f21ee","Type":"ContainerDied","Data":"631e6edde3fafee1874365f03604bc953edfaed4fcefd11b3e4f266a78677392"}
Jul 20 13:08:48.052648 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:08:48.052134    2584 scope.go:117] "RemoveContainer" containerID="b6b4c399ff52f0299ef33f8e0c29ca5395edd32b3fc0a78142a245a54f6c2dc6"
Jul 20 13:08:48.061383 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:08:48.061363    2584 scope.go:117] "RemoveContainer" containerID="b6b4c399ff52f0299ef33f8e0c29ca5395edd32b3fc0a78142a245a54f6c2dc6"
Jul 20 13:08:48.061649 ip-10-0-134-121 kubenswrapper[2584]: E0720 13:08:48.061631    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b6b4c399ff52f0299ef33f8e0c29ca5395edd32b3fc0a78142a245a54f6c2dc6\": container with ID starting with b6b4c399ff52f0299ef33f8e0c29ca5395edd32b3fc0a78142a245a54f6c2dc6 not found: ID does not exist" containerID="b6b4c399ff52f0299ef33f8e0c29ca5395edd32b3fc0a78142a245a54f6c2dc6"
Jul 20 13:08:48.061711 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:08:48.061664    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b6b4c399ff52f0299ef33f8e0c29ca5395edd32b3fc0a78142a245a54f6c2dc6"} err="failed to get container status \"b6b4c399ff52f0299ef33f8e0c29ca5395edd32b3fc0a78142a245a54f6c2dc6\": rpc error: code = NotFound desc = could not find container \"b6b4c399ff52f0299ef33f8e0c29ca5395edd32b3fc0a78142a245a54f6c2dc6\": container with ID starting with b6b4c399ff52f0299ef33f8e0c29ca5395edd32b3fc0a78142a245a54f6c2dc6 not found: ID does not exist"
Jul 20 13:08:48.073133 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:08:48.073102    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-mcmgr"]
Jul 20 13:08:48.076326 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:08:48.076303    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-mcmgr"]
Jul 20 13:08:49.094839 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:08:49.094801    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b74dedfa-3cfc-40aa-92ae-f310d20f21ee" path="/var/lib/kubelet/pods/b74dedfa-3cfc-40aa-92ae-f310d20f21ee/volumes"
Jul 20 13:08:54.846345 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:08:54.846304    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-w2q5n"
Jul 20 13:08:54.846783 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:08:54.846375    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-w2q5n"
Jul 20 13:08:54.869530 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:08:54.869501    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-w2q5n"
Jul 20 13:08:55.109023 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:08:55.108934    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-w2q5n"
Jul 20 13:09:23.456083 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:09:23.456000    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-zpbpp"]
Jul 20 13:09:23.456576 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:09:23.456450    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b74dedfa-3cfc-40aa-92ae-f310d20f21ee" containerName="registry-server"
Jul 20 13:09:23.456576 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:09:23.456469    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="b74dedfa-3cfc-40aa-92ae-f310d20f21ee" containerName="registry-server"
Jul 20 13:09:23.456576 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:09:23.456542    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="b74dedfa-3cfc-40aa-92ae-f310d20f21ee" containerName="registry-server"
Jul 20 13:09:23.460368 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:09:23.460352    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-zpbpp"
Jul 20 13:09:23.462613 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:09:23.462592    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-fh2xz\""
Jul 20 13:09:23.476491 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:09:23.476465    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-zpbpp"]
Jul 20 13:09:23.526150 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:09:23.526116    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-php6g\" (UniqueName: \"kubernetes.io/projected/c71d47d7-dd2b-4439-9a99-5edf9b7a05cc-kube-api-access-php6g\") pod \"authorino-operator-75cc8d5cb7-zpbpp\" (UID: \"c71d47d7-dd2b-4439-9a99-5edf9b7a05cc\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-zpbpp"
Jul 20 13:09:23.626673 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:09:23.626646    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-php6g\" (UniqueName: \"kubernetes.io/projected/c71d47d7-dd2b-4439-9a99-5edf9b7a05cc-kube-api-access-php6g\") pod \"authorino-operator-75cc8d5cb7-zpbpp\" (UID: \"c71d47d7-dd2b-4439-9a99-5edf9b7a05cc\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-zpbpp"
Jul 20 13:09:23.640441 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:09:23.640420    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-php6g\" (UniqueName: \"kubernetes.io/projected/c71d47d7-dd2b-4439-9a99-5edf9b7a05cc-kube-api-access-php6g\") pod \"authorino-operator-75cc8d5cb7-zpbpp\" (UID: \"c71d47d7-dd2b-4439-9a99-5edf9b7a05cc\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-zpbpp"
Jul 20 13:09:23.770020 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:09:23.769985    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-zpbpp"
Jul 20 13:09:23.904518 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:09:23.904493    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-zpbpp"]
Jul 20 13:09:23.906263 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:09:23.906239    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc71d47d7_dd2b_4439_9a99_5edf9b7a05cc.slice/crio-17a7a1bada4514113e436d92214f3c749414446f1ed6949b9fa77191137f23f4 WatchSource:0}: Error finding container 17a7a1bada4514113e436d92214f3c749414446f1ed6949b9fa77191137f23f4: Status 404 returned error can't find the container with id 17a7a1bada4514113e436d92214f3c749414446f1ed6949b9fa77191137f23f4
Jul 20 13:09:24.228310 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:09:24.228224    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-zpbpp" event={"ID":"c71d47d7-dd2b-4439-9a99-5edf9b7a05cc","Type":"ContainerStarted","Data":"17a7a1bada4514113e436d92214f3c749414446f1ed6949b9fa77191137f23f4"}
Jul 20 13:09:27.247847 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:09:27.247809    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-zpbpp" event={"ID":"c71d47d7-dd2b-4439-9a99-5edf9b7a05cc","Type":"ContainerStarted","Data":"24353a4eaac61ff2dca2c4631ae1e0e865af7092f241901ce8258c94c8725bd2"}
Jul 20 13:09:27.248218 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:09:27.247924    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-zpbpp"
Jul 20 13:09:27.263793 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:09:27.263753    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-zpbpp" podStartSLOduration=1.9204713020000002 podStartE2EDuration="4.263741098s" totalImagesPullingTime="2.343269796s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 13:09:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 13:09:27.263102722 +0000 UTC m=+456.979650156" watchObservedRunningTime="2026-07-20 13:09:27.263741098 +0000 UTC m=+456.980288507"
Jul 20 13:09:35.897530 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:09:35.897497    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8mfg6"]
Jul 20 13:09:35.901084 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:09:35.901065    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8mfg6"
Jul 20 13:09:35.903185 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:09:35.903164    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-swm8s\""
Jul 20 13:09:35.914180 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:09:35.914161    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8mfg6"]
Jul 20 13:09:36.039364 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:09:36.039330    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b0766cad-d4d5-4a6c-83f0-0cf22645d569-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-8mfg6\" (UID: \"b0766cad-d4d5-4a6c-83f0-0cf22645d569\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8mfg6"
Jul 20 13:09:36.039508 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:09:36.039404    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dktsw\" (UniqueName: \"kubernetes.io/projected/b0766cad-d4d5-4a6c-83f0-0cf22645d569-kube-api-access-dktsw\") pod \"kuadrant-operator-controller-manager-8684c9ff49-8mfg6\" (UID: \"b0766cad-d4d5-4a6c-83f0-0cf22645d569\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8mfg6"
Jul 20 13:09:36.140396 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:09:36.140363    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dktsw\" (UniqueName: \"kubernetes.io/projected/b0766cad-d4d5-4a6c-83f0-0cf22645d569-kube-api-access-dktsw\") pod \"kuadrant-operator-controller-manager-8684c9ff49-8mfg6\" (UID: \"b0766cad-d4d5-4a6c-83f0-0cf22645d569\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8mfg6"
Jul 20 13:09:36.140528 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:09:36.140433    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b0766cad-d4d5-4a6c-83f0-0cf22645d569-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-8mfg6\" (UID: \"b0766cad-d4d5-4a6c-83f0-0cf22645d569\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8mfg6"
Jul 20 13:09:36.140737 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:09:36.140720    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b0766cad-d4d5-4a6c-83f0-0cf22645d569-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-8mfg6\" (UID: \"b0766cad-d4d5-4a6c-83f0-0cf22645d569\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8mfg6"
Jul 20 13:09:36.160394 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:09:36.160346    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dktsw\" (UniqueName: \"kubernetes.io/projected/b0766cad-d4d5-4a6c-83f0-0cf22645d569-kube-api-access-dktsw\") pod \"kuadrant-operator-controller-manager-8684c9ff49-8mfg6\" (UID: \"b0766cad-d4d5-4a6c-83f0-0cf22645d569\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8mfg6"
Jul 20 13:09:36.210579 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:09:36.210545    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8mfg6"
Jul 20 13:09:36.354125 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:09:36.354105    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8mfg6"]
Jul 20 13:09:36.356749 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:09:36.356721    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb0766cad_d4d5_4a6c_83f0_0cf22645d569.slice/crio-18d03cd373cf9aedc13bc4a792b0f3e7eee8f8ff497460743888dac6207bde9d WatchSource:0}: Error finding container 18d03cd373cf9aedc13bc4a792b0f3e7eee8f8ff497460743888dac6207bde9d: Status 404 returned error can't find the container with id 18d03cd373cf9aedc13bc4a792b0f3e7eee8f8ff497460743888dac6207bde9d
Jul 20 13:09:37.296011 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:09:37.295956    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8mfg6" event={"ID":"b0766cad-d4d5-4a6c-83f0-0cf22645d569","Type":"ContainerStarted","Data":"18d03cd373cf9aedc13bc4a792b0f3e7eee8f8ff497460743888dac6207bde9d"}
Jul 20 13:09:38.255616 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:09:38.255584    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-zpbpp"
Jul 20 13:09:42.327402 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:09:42.327348    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8mfg6" event={"ID":"b0766cad-d4d5-4a6c-83f0-0cf22645d569","Type":"ContainerStarted","Data":"9e831f639d523b33656c2f3ddd0f53e5f366a5b7e13c65ffb774b6739474ebed"}
Jul 20 13:09:42.327852 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:09:42.327522    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8mfg6"
Jul 20 13:09:42.356494 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:09:42.356441    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8mfg6" podStartSLOduration=2.377430003 podStartE2EDuration="7.356428119s" totalImagesPullingTime="4.978998116s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 13:09:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 13:09:42.354006561 +0000 UTC m=+472.070553972" watchObservedRunningTime="2026-07-20 13:09:42.356428119 +0000 UTC m=+472.072975530"
Jul 20 13:09:53.335168 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:09:53.335138    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8mfg6"
Jul 20 13:09:55.534651 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:09:55.534618    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8mfg6"]
Jul 20 13:09:55.535248 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:09:55.534839    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8mfg6" podUID="b0766cad-d4d5-4a6c-83f0-0cf22645d569" containerName="manager" containerID="cri-o://9e831f639d523b33656c2f3ddd0f53e5f366a5b7e13c65ffb774b6739474ebed" gracePeriod=2
Jul 20 13:09:55.560390 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:09:55.560364    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8mfg6"]
Jul 20 13:09:55.622278 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:09:55.622246    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-drk7b"]
Jul 20 13:09:55.622689 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:09:55.622671    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b0766cad-d4d5-4a6c-83f0-0cf22645d569" containerName="manager"
Jul 20 13:09:55.622780 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:09:55.622691    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="b0766cad-d4d5-4a6c-83f0-0cf22645d569" containerName="manager"
Jul 20 13:09:55.622780 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:09:55.622770    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="b0766cad-d4d5-4a6c-83f0-0cf22645d569" containerName="manager"
Jul 20 13:09:55.626323 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:09:55.626302    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-drk7b"
Jul 20 13:09:55.648465 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:09:55.648444    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-drk7b"]
Jul 20 13:09:55.703469 ip-10-0-134-121 kubenswrapper[2584]: E0720 13:09:55.703436    2584 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-8mfg6\" is forbidden: User \"system:node:ip-10-0-134-121.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-121.ec2.internal' and this object" podUID="b0766cad-d4d5-4a6c-83f0-0cf22645d569" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8mfg6"
Jul 20 13:09:55.717404 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:09:55.717019    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/093fc2b6-71cd-43fe-81b2-422d4186f5c4-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-drk7b\" (UID: \"093fc2b6-71cd-43fe-81b2-422d4186f5c4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-drk7b"
Jul 20 13:09:55.717404 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:09:55.717121    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g48wp\" (UniqueName: \"kubernetes.io/projected/093fc2b6-71cd-43fe-81b2-422d4186f5c4-kube-api-access-g48wp\") pod \"kuadrant-operator-controller-manager-55467d9f7-drk7b\" (UID: \"093fc2b6-71cd-43fe-81b2-422d4186f5c4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-drk7b"
Jul 20 13:09:55.784926 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:09:55.784869    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8mfg6"
Jul 20 13:09:55.787781 ip-10-0-134-121 kubenswrapper[2584]: E0720 13:09:55.787748    2584 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-8mfg6\" is forbidden: User \"system:node:ip-10-0-134-121.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-121.ec2.internal' and this object" podUID="b0766cad-d4d5-4a6c-83f0-0cf22645d569" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8mfg6"
Jul 20 13:09:55.818176 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:09:55.818152    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b0766cad-d4d5-4a6c-83f0-0cf22645d569-extensions-socket-volume\") pod \"b0766cad-d4d5-4a6c-83f0-0cf22645d569\" (UID: \"b0766cad-d4d5-4a6c-83f0-0cf22645d569\") "
Jul 20 13:09:55.818291 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:09:55.818230    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dktsw\" (UniqueName: \"kubernetes.io/projected/b0766cad-d4d5-4a6c-83f0-0cf22645d569-kube-api-access-dktsw\") pod \"b0766cad-d4d5-4a6c-83f0-0cf22645d569\" (UID: \"b0766cad-d4d5-4a6c-83f0-0cf22645d569\") "
Jul 20 13:09:55.818345 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:09:55.818310    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/093fc2b6-71cd-43fe-81b2-422d4186f5c4-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-drk7b\" (UID: \"093fc2b6-71cd-43fe-81b2-422d4186f5c4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-drk7b"
Jul 20 13:09:55.818345 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:09:55.818340    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g48wp\" (UniqueName: \"kubernetes.io/projected/093fc2b6-71cd-43fe-81b2-422d4186f5c4-kube-api-access-g48wp\") pod \"kuadrant-operator-controller-manager-55467d9f7-drk7b\" (UID: \"093fc2b6-71cd-43fe-81b2-422d4186f5c4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-drk7b"
Jul 20 13:09:55.818584 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:09:55.818555    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b0766cad-d4d5-4a6c-83f0-0cf22645d569-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "b0766cad-d4d5-4a6c-83f0-0cf22645d569" (UID: "b0766cad-d4d5-4a6c-83f0-0cf22645d569"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 13:09:55.818694 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:09:55.818650    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/093fc2b6-71cd-43fe-81b2-422d4186f5c4-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-drk7b\" (UID: \"093fc2b6-71cd-43fe-81b2-422d4186f5c4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-drk7b"
Jul 20 13:09:55.820276 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:09:55.820257    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b0766cad-d4d5-4a6c-83f0-0cf22645d569-kube-api-access-dktsw" (OuterVolumeSpecName: "kube-api-access-dktsw") pod "b0766cad-d4d5-4a6c-83f0-0cf22645d569" (UID: "b0766cad-d4d5-4a6c-83f0-0cf22645d569"). InnerVolumeSpecName "kube-api-access-dktsw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 13:09:55.841296 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:09:55.841271    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g48wp\" (UniqueName: \"kubernetes.io/projected/093fc2b6-71cd-43fe-81b2-422d4186f5c4-kube-api-access-g48wp\") pod \"kuadrant-operator-controller-manager-55467d9f7-drk7b\" (UID: \"093fc2b6-71cd-43fe-81b2-422d4186f5c4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-drk7b"
Jul 20 13:09:55.919089 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:09:55.919065    2584 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b0766cad-d4d5-4a6c-83f0-0cf22645d569-extensions-socket-volume\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 20 13:09:55.919089 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:09:55.919088    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dktsw\" (UniqueName: \"kubernetes.io/projected/b0766cad-d4d5-4a6c-83f0-0cf22645d569-kube-api-access-dktsw\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 20 13:09:55.935996 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:09:55.935953    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-drk7b"
Jul 20 13:09:56.084943 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:09:56.084879    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-drk7b"]
Jul 20 13:09:56.089371 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:09:56.089340    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod093fc2b6_71cd_43fe_81b2_422d4186f5c4.slice/crio-50a23ebf98531c31868890b3573e94c5b53923a641227684a814e7e298051f1d WatchSource:0}: Error finding container 50a23ebf98531c31868890b3573e94c5b53923a641227684a814e7e298051f1d: Status 404 returned error can't find the container with id 50a23ebf98531c31868890b3573e94c5b53923a641227684a814e7e298051f1d
Jul 20 13:09:56.398724 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:09:56.398630    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-drk7b" event={"ID":"093fc2b6-71cd-43fe-81b2-422d4186f5c4","Type":"ContainerStarted","Data":"79a7c35efc8f2f4b7ddd6a64368309a5df72a04a122f848152df6be20eb21484"}
Jul 20 13:09:56.398724 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:09:56.398688    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-drk7b" event={"ID":"093fc2b6-71cd-43fe-81b2-422d4186f5c4","Type":"ContainerStarted","Data":"50a23ebf98531c31868890b3573e94c5b53923a641227684a814e7e298051f1d"}
Jul 20 13:09:56.398937 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:09:56.398747    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-drk7b"
Jul 20 13:09:56.399927 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:09:56.399901    2584 generic.go:356] "Generic (PLEG): container finished" podID="b0766cad-d4d5-4a6c-83f0-0cf22645d569" containerID="9e831f639d523b33656c2f3ddd0f53e5f366a5b7e13c65ffb774b6739474ebed" exitCode=0
Jul 20 13:09:56.400042 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:09:56.399937    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8mfg6"
Jul 20 13:09:56.400042 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:09:56.399951    2584 scope.go:117] "RemoveContainer" containerID="9e831f639d523b33656c2f3ddd0f53e5f366a5b7e13c65ffb774b6739474ebed"
Jul 20 13:09:56.400656 ip-10-0-134-121 kubenswrapper[2584]: E0720 13:09:56.400629    2584 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-8mfg6\" is forbidden: User \"system:node:ip-10-0-134-121.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-121.ec2.internal' and this object" podUID="b0766cad-d4d5-4a6c-83f0-0cf22645d569" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8mfg6"
Jul 20 13:09:56.408463 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:09:56.408443    2584 scope.go:117] "RemoveContainer" containerID="9e831f639d523b33656c2f3ddd0f53e5f366a5b7e13c65ffb774b6739474ebed"
Jul 20 13:09:56.408753 ip-10-0-134-121 kubenswrapper[2584]: E0720 13:09:56.408733    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9e831f639d523b33656c2f3ddd0f53e5f366a5b7e13c65ffb774b6739474ebed\": container with ID starting with 9e831f639d523b33656c2f3ddd0f53e5f366a5b7e13c65ffb774b6739474ebed not found: ID does not exist" containerID="9e831f639d523b33656c2f3ddd0f53e5f366a5b7e13c65ffb774b6739474ebed"
Jul 20 13:09:56.408811 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:09:56.408760    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9e831f639d523b33656c2f3ddd0f53e5f366a5b7e13c65ffb774b6739474ebed"} err="failed to get container status \"9e831f639d523b33656c2f3ddd0f53e5f366a5b7e13c65ffb774b6739474ebed\": rpc error: code = NotFound desc = could not find container \"9e831f639d523b33656c2f3ddd0f53e5f366a5b7e13c65ffb774b6739474ebed\": container with ID starting with 9e831f639d523b33656c2f3ddd0f53e5f366a5b7e13c65ffb774b6739474ebed not found: ID does not exist"
Jul 20 13:09:56.443333 ip-10-0-134-121 kubenswrapper[2584]: E0720 13:09:56.443302    2584 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-8mfg6\" is forbidden: User \"system:node:ip-10-0-134-121.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-121.ec2.internal' and this object" podUID="b0766cad-d4d5-4a6c-83f0-0cf22645d569" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8mfg6"
Jul 20 13:09:56.443876 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:09:56.443838    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-drk7b" podStartSLOduration=1.4438258290000001 podStartE2EDuration="1.443825829s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 13:09:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 13:09:56.44029452 +0000 UTC m=+486.156841932" watchObservedRunningTime="2026-07-20 13:09:56.443825829 +0000 UTC m=+486.160373240"
Jul 20 13:09:57.094439 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:09:57.094405    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b0766cad-d4d5-4a6c-83f0-0cf22645d569" path="/var/lib/kubelet/pods/b0766cad-d4d5-4a6c-83f0-0cf22645d569/volumes"
Jul 20 13:10:07.408738 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:10:07.408712    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-drk7b"
Jul 20 13:10:20.397236 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:10:20.397206    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-drk7b"]
Jul 20 13:10:20.397586 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:10:20.397420    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-drk7b" podUID="093fc2b6-71cd-43fe-81b2-422d4186f5c4" containerName="manager" containerID="cri-o://79a7c35efc8f2f4b7ddd6a64368309a5df72a04a122f848152df6be20eb21484" gracePeriod=10
Jul 20 13:10:20.516988 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:10:20.516939    2584 generic.go:356] "Generic (PLEG): container finished" podID="093fc2b6-71cd-43fe-81b2-422d4186f5c4" containerID="79a7c35efc8f2f4b7ddd6a64368309a5df72a04a122f848152df6be20eb21484" exitCode=0
Jul 20 13:10:20.517087 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:10:20.516998    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-drk7b" event={"ID":"093fc2b6-71cd-43fe-81b2-422d4186f5c4","Type":"ContainerDied","Data":"79a7c35efc8f2f4b7ddd6a64368309a5df72a04a122f848152df6be20eb21484"}
Jul 20 13:10:20.645134 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:10:20.645114    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-drk7b"
Jul 20 13:10:20.731153 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:10:20.731087    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g48wp\" (UniqueName: \"kubernetes.io/projected/093fc2b6-71cd-43fe-81b2-422d4186f5c4-kube-api-access-g48wp\") pod \"093fc2b6-71cd-43fe-81b2-422d4186f5c4\" (UID: \"093fc2b6-71cd-43fe-81b2-422d4186f5c4\") "
Jul 20 13:10:20.731153 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:10:20.731145    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/093fc2b6-71cd-43fe-81b2-422d4186f5c4-extensions-socket-volume\") pod \"093fc2b6-71cd-43fe-81b2-422d4186f5c4\" (UID: \"093fc2b6-71cd-43fe-81b2-422d4186f5c4\") "
Jul 20 13:10:20.731504 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:10:20.731480    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/093fc2b6-71cd-43fe-81b2-422d4186f5c4-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "093fc2b6-71cd-43fe-81b2-422d4186f5c4" (UID: "093fc2b6-71cd-43fe-81b2-422d4186f5c4"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 13:10:20.733117 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:10:20.733096    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/093fc2b6-71cd-43fe-81b2-422d4186f5c4-kube-api-access-g48wp" (OuterVolumeSpecName: "kube-api-access-g48wp") pod "093fc2b6-71cd-43fe-81b2-422d4186f5c4" (UID: "093fc2b6-71cd-43fe-81b2-422d4186f5c4"). InnerVolumeSpecName "kube-api-access-g48wp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 13:10:20.832567 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:10:20.832542    2584 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/093fc2b6-71cd-43fe-81b2-422d4186f5c4-extensions-socket-volume\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 20 13:10:20.832567 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:10:20.832569    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g48wp\" (UniqueName: \"kubernetes.io/projected/093fc2b6-71cd-43fe-81b2-422d4186f5c4-kube-api-access-g48wp\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 20 13:10:21.523584 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:10:21.523555    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-drk7b"
Jul 20 13:10:21.523961 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:10:21.523557    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-drk7b" event={"ID":"093fc2b6-71cd-43fe-81b2-422d4186f5c4","Type":"ContainerDied","Data":"50a23ebf98531c31868890b3573e94c5b53923a641227684a814e7e298051f1d"}
Jul 20 13:10:21.523961 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:10:21.523694    2584 scope.go:117] "RemoveContainer" containerID="79a7c35efc8f2f4b7ddd6a64368309a5df72a04a122f848152df6be20eb21484"
Jul 20 13:10:21.547561 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:10:21.547536    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-drk7b"]
Jul 20 13:10:21.556801 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:10:21.556777    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-drk7b"]
Jul 20 13:10:23.094888 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:10:23.094853    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="093fc2b6-71cd-43fe-81b2-422d4186f5c4" path="/var/lib/kubelet/pods/093fc2b6-71cd-43fe-81b2-422d4186f5c4/volumes"
Jul 20 13:10:23.892273 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:10:23.892243    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-669mt"]
Jul 20 13:10:23.892625 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:10:23.892613    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="093fc2b6-71cd-43fe-81b2-422d4186f5c4" containerName="manager"
Jul 20 13:10:23.892664 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:10:23.892626    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="093fc2b6-71cd-43fe-81b2-422d4186f5c4" containerName="manager"
Jul 20 13:10:23.892701 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:10:23.892685    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="093fc2b6-71cd-43fe-81b2-422d4186f5c4" containerName="manager"
Jul 20 13:10:23.895342 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:10:23.895326    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-669mt"
Jul 20 13:10:23.897788 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:10:23.897754    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-ddtvn\""
Jul 20 13:10:23.906881 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:10:23.906834    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-669mt"]
Jul 20 13:10:24.060461 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:10:24.060433    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d1f7d779-906f-40bb-945a-fae805b1d5f7-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-669mt\" (UID: \"d1f7d779-906f-40bb-945a-fae805b1d5f7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-669mt"
Jul 20 13:10:24.060461 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:10:24.060465    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d1f7d779-906f-40bb-945a-fae805b1d5f7-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-669mt\" (UID: \"d1f7d779-906f-40bb-945a-fae805b1d5f7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-669mt"
Jul 20 13:10:24.060691 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:10:24.060502    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fvlrg\" (UniqueName: \"kubernetes.io/projected/d1f7d779-906f-40bb-945a-fae805b1d5f7-kube-api-access-fvlrg\") pod \"maas-default-gateway-openshift-default-56654dcf7-669mt\" (UID: \"d1f7d779-906f-40bb-945a-fae805b1d5f7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-669mt"
Jul 20 13:10:24.060691 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:10:24.060529    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d1f7d779-906f-40bb-945a-fae805b1d5f7-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-669mt\" (UID: \"d1f7d779-906f-40bb-945a-fae805b1d5f7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-669mt"
Jul 20 13:10:24.060691 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:10:24.060568    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d1f7d779-906f-40bb-945a-fae805b1d5f7-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-669mt\" (UID: \"d1f7d779-906f-40bb-945a-fae805b1d5f7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-669mt"
Jul 20 13:10:24.060691 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:10:24.060590    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d1f7d779-906f-40bb-945a-fae805b1d5f7-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-669mt\" (UID: \"d1f7d779-906f-40bb-945a-fae805b1d5f7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-669mt"
Jul 20 13:10:24.060691 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:10:24.060620    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d1f7d779-906f-40bb-945a-fae805b1d5f7-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-669mt\" (UID: \"d1f7d779-906f-40bb-945a-fae805b1d5f7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-669mt"
Jul 20 13:10:24.060691 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:10:24.060649    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d1f7d779-906f-40bb-945a-fae805b1d5f7-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-669mt\" (UID: \"d1f7d779-906f-40bb-945a-fae805b1d5f7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-669mt"
Jul 20 13:10:24.060893 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:10:24.060733    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d1f7d779-906f-40bb-945a-fae805b1d5f7-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-669mt\" (UID: \"d1f7d779-906f-40bb-945a-fae805b1d5f7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-669mt"
Jul 20 13:10:24.161601 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:10:24.161524    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d1f7d779-906f-40bb-945a-fae805b1d5f7-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-669mt\" (UID: \"d1f7d779-906f-40bb-945a-fae805b1d5f7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-669mt"
Jul 20 13:10:24.161601 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:10:24.161560    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d1f7d779-906f-40bb-945a-fae805b1d5f7-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-669mt\" (UID: \"d1f7d779-906f-40bb-945a-fae805b1d5f7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-669mt"
Jul 20 13:10:24.161601 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:10:24.161594    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fvlrg\" (UniqueName: \"kubernetes.io/projected/d1f7d779-906f-40bb-945a-fae805b1d5f7-kube-api-access-fvlrg\") pod \"maas-default-gateway-openshift-default-56654dcf7-669mt\" (UID: \"d1f7d779-906f-40bb-945a-fae805b1d5f7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-669mt"
Jul 20 13:10:24.162215 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:10:24.161627    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d1f7d779-906f-40bb-945a-fae805b1d5f7-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-669mt\" (UID: \"d1f7d779-906f-40bb-945a-fae805b1d5f7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-669mt"
Jul 20 13:10:24.162215 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:10:24.161679    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d1f7d779-906f-40bb-945a-fae805b1d5f7-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-669mt\" (UID: \"d1f7d779-906f-40bb-945a-fae805b1d5f7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-669mt"
Jul 20 13:10:24.162215 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:10:24.161705    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d1f7d779-906f-40bb-945a-fae805b1d5f7-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-669mt\" (UID: \"d1f7d779-906f-40bb-945a-fae805b1d5f7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-669mt"
Jul 20 13:10:24.162215 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:10:24.161734    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d1f7d779-906f-40bb-945a-fae805b1d5f7-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-669mt\" (UID: \"d1f7d779-906f-40bb-945a-fae805b1d5f7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-669mt"
Jul 20 13:10:24.162215 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:10:24.161793    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d1f7d779-906f-40bb-945a-fae805b1d5f7-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-669mt\" (UID: \"d1f7d779-906f-40bb-945a-fae805b1d5f7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-669mt"
Jul 20 13:10:24.162215 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:10:24.161877    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d1f7d779-906f-40bb-945a-fae805b1d5f7-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-669mt\" (UID: \"d1f7d779-906f-40bb-945a-fae805b1d5f7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-669mt"
Jul 20 13:10:24.162215 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:10:24.161986    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d1f7d779-906f-40bb-945a-fae805b1d5f7-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-669mt\" (UID: \"d1f7d779-906f-40bb-945a-fae805b1d5f7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-669mt"
Jul 20 13:10:24.162215 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:10:24.162197    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d1f7d779-906f-40bb-945a-fae805b1d5f7-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-669mt\" (UID: \"d1f7d779-906f-40bb-945a-fae805b1d5f7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-669mt"
Jul 20 13:10:24.162525 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:10:24.162260    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d1f7d779-906f-40bb-945a-fae805b1d5f7-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-669mt\" (UID: \"d1f7d779-906f-40bb-945a-fae805b1d5f7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-669mt"
Jul 20 13:10:24.162525 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:10:24.162273    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d1f7d779-906f-40bb-945a-fae805b1d5f7-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-669mt\" (UID: \"d1f7d779-906f-40bb-945a-fae805b1d5f7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-669mt"
Jul 20 13:10:24.162525 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:10:24.162468    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d1f7d779-906f-40bb-945a-fae805b1d5f7-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-669mt\" (UID: \"d1f7d779-906f-40bb-945a-fae805b1d5f7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-669mt"
Jul 20 13:10:24.163924 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:10:24.163904    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d1f7d779-906f-40bb-945a-fae805b1d5f7-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-669mt\" (UID: \"d1f7d779-906f-40bb-945a-fae805b1d5f7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-669mt"
Jul 20 13:10:24.164098 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:10:24.164081    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d1f7d779-906f-40bb-945a-fae805b1d5f7-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-669mt\" (UID: \"d1f7d779-906f-40bb-945a-fae805b1d5f7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-669mt"
Jul 20 13:10:24.169886 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:10:24.169864    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fvlrg\" (UniqueName: \"kubernetes.io/projected/d1f7d779-906f-40bb-945a-fae805b1d5f7-kube-api-access-fvlrg\") pod \"maas-default-gateway-openshift-default-56654dcf7-669mt\" (UID: \"d1f7d779-906f-40bb-945a-fae805b1d5f7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-669mt"
Jul 20 13:10:24.170098 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:10:24.170081    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d1f7d779-906f-40bb-945a-fae805b1d5f7-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-669mt\" (UID: \"d1f7d779-906f-40bb-945a-fae805b1d5f7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-669mt"
Jul 20 13:10:24.205495 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:10:24.205468    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-669mt"
Jul 20 13:10:24.339431 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:10:24.339408    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-669mt"]
Jul 20 13:10:24.341523 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:10:24.341483    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd1f7d779_906f_40bb_945a_fae805b1d5f7.slice/crio-ad7c5b6e7b36cc54bcec0c88a66bcbfb7ccd017f4332da9aee2e9f94ea2bbb7f WatchSource:0}: Error finding container ad7c5b6e7b36cc54bcec0c88a66bcbfb7ccd017f4332da9aee2e9f94ea2bbb7f: Status 404 returned error can't find the container with id ad7c5b6e7b36cc54bcec0c88a66bcbfb7ccd017f4332da9aee2e9f94ea2bbb7f
Jul 20 13:10:24.343981 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:10:24.343935    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 20 13:10:24.344055 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:10:24.344032    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 20 13:10:24.344096 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:10:24.344072    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 20 13:10:24.542067 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:10:24.542035    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-669mt" event={"ID":"d1f7d779-906f-40bb-945a-fae805b1d5f7","Type":"ContainerStarted","Data":"43bcc41f4a45cdb135e84afc72d7993fa5e0cd907678dfb93f82eebdfd37f9ea"}
Jul 20 13:10:24.542221 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:10:24.542092    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-669mt" event={"ID":"d1f7d779-906f-40bb-945a-fae805b1d5f7","Type":"ContainerStarted","Data":"ad7c5b6e7b36cc54bcec0c88a66bcbfb7ccd017f4332da9aee2e9f94ea2bbb7f"}
Jul 20 13:10:24.567799 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:10:24.567750    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-669mt" podStartSLOduration=1.567734658 podStartE2EDuration="1.567734658s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 13:10:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 13:10:24.564470296 +0000 UTC m=+514.281017707" watchObservedRunningTime="2026-07-20 13:10:24.567734658 +0000 UTC m=+514.284282068"
Jul 20 13:10:25.205907 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:10:25.205876    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-669mt"
Jul 20 13:10:25.210106 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:10:25.210082    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-669mt"
Jul 20 13:10:25.547210 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:10:25.547182    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-669mt"
Jul 20 13:10:25.548126 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:10:25.548103    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-669mt"
Jul 20 13:10:40.898227 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:10:40.898194    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-4mf5l"]
Jul 20 13:10:40.902072 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:10:40.902056    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-4mf5l"
Jul 20 13:10:40.904283 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:10:40.904250    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-kpwv5\""
Jul 20 13:10:40.904400 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:10:40.904366    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 20 13:10:40.914775 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:10:40.914747    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-4mf5l"]
Jul 20 13:10:40.970734 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:10:40.970696    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-4mf5l"]
Jul 20 13:10:41.009568 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:10:41.009541    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/7faffd3c-2b6d-43e1-888c-17d98dbecf93-config-file\") pod \"limitador-limitador-64c94fd64f-4mf5l\" (UID: \"7faffd3c-2b6d-43e1-888c-17d98dbecf93\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-4mf5l"
Jul 20 13:10:41.009718 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:10:41.009577    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lqnr2\" (UniqueName: \"kubernetes.io/projected/7faffd3c-2b6d-43e1-888c-17d98dbecf93-kube-api-access-lqnr2\") pod \"limitador-limitador-64c94fd64f-4mf5l\" (UID: \"7faffd3c-2b6d-43e1-888c-17d98dbecf93\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-4mf5l"
Jul 20 13:10:41.110324 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:10:41.110295    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/7faffd3c-2b6d-43e1-888c-17d98dbecf93-config-file\") pod \"limitador-limitador-64c94fd64f-4mf5l\" (UID: \"7faffd3c-2b6d-43e1-888c-17d98dbecf93\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-4mf5l"
Jul 20 13:10:41.110475 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:10:41.110330    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lqnr2\" (UniqueName: \"kubernetes.io/projected/7faffd3c-2b6d-43e1-888c-17d98dbecf93-kube-api-access-lqnr2\") pod \"limitador-limitador-64c94fd64f-4mf5l\" (UID: \"7faffd3c-2b6d-43e1-888c-17d98dbecf93\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-4mf5l"
Jul 20 13:10:41.110892 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:10:41.110874    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/7faffd3c-2b6d-43e1-888c-17d98dbecf93-config-file\") pod \"limitador-limitador-64c94fd64f-4mf5l\" (UID: \"7faffd3c-2b6d-43e1-888c-17d98dbecf93\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-4mf5l"
Jul 20 13:10:41.122489 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:10:41.122467    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lqnr2\" (UniqueName: \"kubernetes.io/projected/7faffd3c-2b6d-43e1-888c-17d98dbecf93-kube-api-access-lqnr2\") pod \"limitador-limitador-64c94fd64f-4mf5l\" (UID: \"7faffd3c-2b6d-43e1-888c-17d98dbecf93\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-4mf5l"
Jul 20 13:10:41.214923 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:10:41.214858    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-4mf5l"
Jul 20 13:10:41.359473 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:10:41.359449    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-4mf5l"]
Jul 20 13:10:41.361163 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:10:41.361133    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7faffd3c_2b6d_43e1_888c_17d98dbecf93.slice/crio-ed7a86aa87d3f2251e5667698959e3de63b937a278746a581c7011108f5dc363 WatchSource:0}: Error finding container ed7a86aa87d3f2251e5667698959e3de63b937a278746a581c7011108f5dc363: Status 404 returned error can't find the container with id ed7a86aa87d3f2251e5667698959e3de63b937a278746a581c7011108f5dc363
Jul 20 13:10:41.624559 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:10:41.624522    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-4mf5l" event={"ID":"7faffd3c-2b6d-43e1-888c-17d98dbecf93","Type":"ContainerStarted","Data":"ed7a86aa87d3f2251e5667698959e3de63b937a278746a581c7011108f5dc363"}
Jul 20 13:10:44.644793 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:10:44.644764    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-4mf5l" event={"ID":"7faffd3c-2b6d-43e1-888c-17d98dbecf93","Type":"ContainerStarted","Data":"02460bad95f67fb7219c6ee2272652b8e15dedec4aba2084c8ecd877f78c54d2"}
Jul 20 13:10:44.645175 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:10:44.644851    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-4mf5l"
Jul 20 13:10:44.663144 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:10:44.663101    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-4mf5l" podStartSLOduration=1.9892206460000001 podStartE2EDuration="4.663084511s" totalImagesPullingTime="2.673863865s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 13:10:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 13:10:44.662717763 +0000 UTC m=+534.379265174" watchObservedRunningTime="2026-07-20 13:10:44.663084511 +0000 UTC m=+534.379631919"
Jul 20 13:10:55.566339 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:10:55.566303    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-4mf5l"]
Jul 20 13:10:55.566819 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:10:55.566557    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-4mf5l" podUID="7faffd3c-2b6d-43e1-888c-17d98dbecf93" containerName="limitador" containerID="cri-o://02460bad95f67fb7219c6ee2272652b8e15dedec4aba2084c8ecd877f78c54d2" gracePeriod=30
Jul 20 13:10:55.567295 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:10:55.567117    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-4mf5l"
Jul 20 13:10:56.115688 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:10:56.115664    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-4mf5l"
Jul 20 13:10:56.247125 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:10:56.247096    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lqnr2\" (UniqueName: \"kubernetes.io/projected/7faffd3c-2b6d-43e1-888c-17d98dbecf93-kube-api-access-lqnr2\") pod \"7faffd3c-2b6d-43e1-888c-17d98dbecf93\" (UID: \"7faffd3c-2b6d-43e1-888c-17d98dbecf93\") "
Jul 20 13:10:56.247273 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:10:56.247135    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/7faffd3c-2b6d-43e1-888c-17d98dbecf93-config-file\") pod \"7faffd3c-2b6d-43e1-888c-17d98dbecf93\" (UID: \"7faffd3c-2b6d-43e1-888c-17d98dbecf93\") "
Jul 20 13:10:56.247496 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:10:56.247471    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7faffd3c-2b6d-43e1-888c-17d98dbecf93-config-file" (OuterVolumeSpecName: "config-file") pod "7faffd3c-2b6d-43e1-888c-17d98dbecf93" (UID: "7faffd3c-2b6d-43e1-888c-17d98dbecf93"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 13:10:56.249098 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:10:56.249077    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7faffd3c-2b6d-43e1-888c-17d98dbecf93-kube-api-access-lqnr2" (OuterVolumeSpecName: "kube-api-access-lqnr2") pod "7faffd3c-2b6d-43e1-888c-17d98dbecf93" (UID: "7faffd3c-2b6d-43e1-888c-17d98dbecf93"). InnerVolumeSpecName "kube-api-access-lqnr2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 13:10:56.347638 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:10:56.347611    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lqnr2\" (UniqueName: \"kubernetes.io/projected/7faffd3c-2b6d-43e1-888c-17d98dbecf93-kube-api-access-lqnr2\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 20 13:10:56.347638 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:10:56.347632    2584 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/7faffd3c-2b6d-43e1-888c-17d98dbecf93-config-file\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 20 13:10:56.698600 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:10:56.698533    2584 generic.go:356] "Generic (PLEG): container finished" podID="7faffd3c-2b6d-43e1-888c-17d98dbecf93" containerID="02460bad95f67fb7219c6ee2272652b8e15dedec4aba2084c8ecd877f78c54d2" exitCode=0
Jul 20 13:10:56.698600 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:10:56.698582    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-4mf5l"
Jul 20 13:10:56.699024 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:10:56.698619    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-4mf5l" event={"ID":"7faffd3c-2b6d-43e1-888c-17d98dbecf93","Type":"ContainerDied","Data":"02460bad95f67fb7219c6ee2272652b8e15dedec4aba2084c8ecd877f78c54d2"}
Jul 20 13:10:56.699024 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:10:56.698672    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-4mf5l" event={"ID":"7faffd3c-2b6d-43e1-888c-17d98dbecf93","Type":"ContainerDied","Data":"ed7a86aa87d3f2251e5667698959e3de63b937a278746a581c7011108f5dc363"}
Jul 20 13:10:56.699024 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:10:56.698694    2584 scope.go:117] "RemoveContainer" containerID="02460bad95f67fb7219c6ee2272652b8e15dedec4aba2084c8ecd877f78c54d2"
Jul 20 13:10:56.707398 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:10:56.707383    2584 scope.go:117] "RemoveContainer" containerID="02460bad95f67fb7219c6ee2272652b8e15dedec4aba2084c8ecd877f78c54d2"
Jul 20 13:10:56.707616 ip-10-0-134-121 kubenswrapper[2584]: E0720 13:10:56.707598    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"02460bad95f67fb7219c6ee2272652b8e15dedec4aba2084c8ecd877f78c54d2\": container with ID starting with 02460bad95f67fb7219c6ee2272652b8e15dedec4aba2084c8ecd877f78c54d2 not found: ID does not exist" containerID="02460bad95f67fb7219c6ee2272652b8e15dedec4aba2084c8ecd877f78c54d2"
Jul 20 13:10:56.707670 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:10:56.707624    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"02460bad95f67fb7219c6ee2272652b8e15dedec4aba2084c8ecd877f78c54d2"} err="failed to get container status \"02460bad95f67fb7219c6ee2272652b8e15dedec4aba2084c8ecd877f78c54d2\": rpc error: code = NotFound desc = could not find container \"02460bad95f67fb7219c6ee2272652b8e15dedec4aba2084c8ecd877f78c54d2\": container with ID starting with 02460bad95f67fb7219c6ee2272652b8e15dedec4aba2084c8ecd877f78c54d2 not found: ID does not exist"
Jul 20 13:10:56.721676 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:10:56.721656    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-4mf5l"]
Jul 20 13:10:56.730094 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:10:56.730077    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-4mf5l"]
Jul 20 13:10:57.096064 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:10:57.096040    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7faffd3c-2b6d-43e1-888c-17d98dbecf93" path="/var/lib/kubelet/pods/7faffd3c-2b6d-43e1-888c-17d98dbecf93/volumes"
Jul 20 13:10:57.587986 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:10:57.587939    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-m8kjd"]
Jul 20 13:10:57.588332 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:10:57.588318    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7faffd3c-2b6d-43e1-888c-17d98dbecf93" containerName="limitador"
Jul 20 13:10:57.588332 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:10:57.588333    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="7faffd3c-2b6d-43e1-888c-17d98dbecf93" containerName="limitador"
Jul 20 13:10:57.588423 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:10:57.588414    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="7faffd3c-2b6d-43e1-888c-17d98dbecf93" containerName="limitador"
Jul 20 13:10:57.592839 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:10:57.592818    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-m8kjd"
Jul 20 13:10:57.595134 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:10:57.594952    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\""
Jul 20 13:10:57.595134 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:10:57.595035    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 20 13:10:57.595595 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:10:57.595577    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-9mv7v\""
Jul 20 13:10:57.595672 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:10:57.595609    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 20 13:10:57.599080 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:10:57.599060    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-m8kjd"]
Jul 20 13:10:57.657346 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:10:57.657319    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/c477a836-5447-480a-ae37-ca61dd0cab85-data\") pod \"postgres-69fb4594cf-m8kjd\" (UID: \"c477a836-5447-480a-ae37-ca61dd0cab85\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-m8kjd"
Jul 20 13:10:57.657441 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:10:57.657362    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bf5wc\" (UniqueName: \"kubernetes.io/projected/c477a836-5447-480a-ae37-ca61dd0cab85-kube-api-access-bf5wc\") pod \"postgres-69fb4594cf-m8kjd\" (UID: \"c477a836-5447-480a-ae37-ca61dd0cab85\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-m8kjd"
Jul 20 13:10:57.758153 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:10:57.758123    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/c477a836-5447-480a-ae37-ca61dd0cab85-data\") pod \"postgres-69fb4594cf-m8kjd\" (UID: \"c477a836-5447-480a-ae37-ca61dd0cab85\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-m8kjd"
Jul 20 13:10:57.758494 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:10:57.758173    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bf5wc\" (UniqueName: \"kubernetes.io/projected/c477a836-5447-480a-ae37-ca61dd0cab85-kube-api-access-bf5wc\") pod \"postgres-69fb4594cf-m8kjd\" (UID: \"c477a836-5447-480a-ae37-ca61dd0cab85\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-m8kjd"
Jul 20 13:10:57.758494 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:10:57.758463    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/c477a836-5447-480a-ae37-ca61dd0cab85-data\") pod \"postgres-69fb4594cf-m8kjd\" (UID: \"c477a836-5447-480a-ae37-ca61dd0cab85\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-m8kjd"
Jul 20 13:10:57.772195 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:10:57.772163    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bf5wc\" (UniqueName: \"kubernetes.io/projected/c477a836-5447-480a-ae37-ca61dd0cab85-kube-api-access-bf5wc\") pod \"postgres-69fb4594cf-m8kjd\" (UID: \"c477a836-5447-480a-ae37-ca61dd0cab85\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-m8kjd"
Jul 20 13:10:57.905345 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:10:57.905279    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-m8kjd"
Jul 20 13:10:58.032374 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:10:58.032338    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-m8kjd"]
Jul 20 13:10:58.039773 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:10:58.039751    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc477a836_5447_480a_ae37_ca61dd0cab85.slice/crio-a47f0a4833bb314b207a68d9979bf67c933b16c24eef81791008984794b3baa4 WatchSource:0}: Error finding container a47f0a4833bb314b207a68d9979bf67c933b16c24eef81791008984794b3baa4: Status 404 returned error can't find the container with id a47f0a4833bb314b207a68d9979bf67c933b16c24eef81791008984794b3baa4
Jul 20 13:10:58.712682 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:10:58.712624    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-m8kjd" event={"ID":"c477a836-5447-480a-ae37-ca61dd0cab85","Type":"ContainerStarted","Data":"a47f0a4833bb314b207a68d9979bf67c933b16c24eef81791008984794b3baa4"}
Jul 20 13:11:02.735435 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:11:02.735403    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-m8kjd" event={"ID":"c477a836-5447-480a-ae37-ca61dd0cab85","Type":"ContainerStarted","Data":"5deb9aea0e53be11221b6b65df70328fb63bf522df327649271911bc0989734f"}
Jul 20 13:11:02.735788 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:11:02.735556    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-m8kjd"
Jul 20 13:11:02.754679 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:11:02.754632    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-m8kjd" podStartSLOduration=1.146710551 podStartE2EDuration="5.754618562s" totalImagesPullingTime="4.607908011s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 13:10:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 13:11:02.751697459 +0000 UTC m=+552.468244869" watchObservedRunningTime="2026-07-20 13:11:02.754618562 +0000 UTC m=+552.471165970"
Jul 20 13:11:08.769396 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:11:08.769366    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-m8kjd"
Jul 20 13:11:09.312393 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:11:09.312362    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-pgbkl"]
Jul 20 13:11:09.319098 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:11:09.319079    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-pgbkl"
Jul 20 13:11:09.321233 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:11:09.321213    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-cfngg\""
Jul 20 13:11:09.322808 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:11:09.322786    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-pgbkl"]
Jul 20 13:11:09.463536 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:11:09.463508    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n5jpb\" (UniqueName: \"kubernetes.io/projected/e3ebd6a3-2320-4335-81e4-b2f3c50fc196-kube-api-access-n5jpb\") pod \"authorino-5d4b67c446-pgbkl\" (UID: \"e3ebd6a3-2320-4335-81e4-b2f3c50fc196\") " pod="kuadrant-system/authorino-5d4b67c446-pgbkl"
Jul 20 13:11:09.546339 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:11:09.546315    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-pgbkl"]
Jul 20 13:11:09.546594 ip-10-0-134-121 kubenswrapper[2584]: E0720 13:11:09.546575    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-n5jpb], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-5d4b67c446-pgbkl" podUID="e3ebd6a3-2320-4335-81e4-b2f3c50fc196"
Jul 20 13:11:09.564192 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:11:09.564132    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n5jpb\" (UniqueName: \"kubernetes.io/projected/e3ebd6a3-2320-4335-81e4-b2f3c50fc196-kube-api-access-n5jpb\") pod \"authorino-5d4b67c446-pgbkl\" (UID: \"e3ebd6a3-2320-4335-81e4-b2f3c50fc196\") " pod="kuadrant-system/authorino-5d4b67c446-pgbkl"
Jul 20 13:11:09.574164 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:11:09.574137    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5db48fdb79-2dxwh"]
Jul 20 13:11:09.578311 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:11:09.578292    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5db48fdb79-2dxwh"
Jul 20 13:11:09.579634 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:11:09.579609    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n5jpb\" (UniqueName: \"kubernetes.io/projected/e3ebd6a3-2320-4335-81e4-b2f3c50fc196-kube-api-access-n5jpb\") pod \"authorino-5d4b67c446-pgbkl\" (UID: \"e3ebd6a3-2320-4335-81e4-b2f3c50fc196\") " pod="kuadrant-system/authorino-5d4b67c446-pgbkl"
Jul 20 13:11:09.584888 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:11:09.584866    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5db48fdb79-2dxwh"]
Jul 20 13:11:09.664846 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:11:09.664823    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vn85c\" (UniqueName: \"kubernetes.io/projected/f2dee997-92a0-499d-956d-8c0d1874664c-kube-api-access-vn85c\") pod \"authorino-5db48fdb79-2dxwh\" (UID: \"f2dee997-92a0-499d-956d-8c0d1874664c\") " pod="kuadrant-system/authorino-5db48fdb79-2dxwh"
Jul 20 13:11:09.737942 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:11:09.737918    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5db48fdb79-2dxwh"]
Jul 20 13:11:09.738183 ip-10-0-134-121 kubenswrapper[2584]: E0720 13:11:09.738166    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-vn85c], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-5db48fdb79-2dxwh" podUID="f2dee997-92a0-499d-956d-8c0d1874664c"
Jul 20 13:11:09.765538 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:11:09.765508    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vn85c\" (UniqueName: \"kubernetes.io/projected/f2dee997-92a0-499d-956d-8c0d1874664c-kube-api-access-vn85c\") pod \"authorino-5db48fdb79-2dxwh\" (UID: \"f2dee997-92a0-499d-956d-8c0d1874664c\") " pod="kuadrant-system/authorino-5db48fdb79-2dxwh"
Jul 20 13:11:09.769572 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:11:09.769544    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-pgbkl"
Jul 20 13:11:09.769895 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:11:09.769550    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5db48fdb79-2dxwh"
Jul 20 13:11:09.775342 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:11:09.775323    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vn85c\" (UniqueName: \"kubernetes.io/projected/f2dee997-92a0-499d-956d-8c0d1874664c-kube-api-access-vn85c\") pod \"authorino-5db48fdb79-2dxwh\" (UID: \"f2dee997-92a0-499d-956d-8c0d1874664c\") " pod="kuadrant-system/authorino-5db48fdb79-2dxwh"
Jul 20 13:11:09.777396 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:11:09.777382    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-pgbkl"
Jul 20 13:11:09.788673 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:11:09.788656    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5db48fdb79-2dxwh"
Jul 20 13:11:09.866529 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:11:09.866473    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n5jpb\" (UniqueName: \"kubernetes.io/projected/e3ebd6a3-2320-4335-81e4-b2f3c50fc196-kube-api-access-n5jpb\") pod \"e3ebd6a3-2320-4335-81e4-b2f3c50fc196\" (UID: \"e3ebd6a3-2320-4335-81e4-b2f3c50fc196\") "
Jul 20 13:11:09.868382 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:11:09.868354    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e3ebd6a3-2320-4335-81e4-b2f3c50fc196-kube-api-access-n5jpb" (OuterVolumeSpecName: "kube-api-access-n5jpb") pod "e3ebd6a3-2320-4335-81e4-b2f3c50fc196" (UID: "e3ebd6a3-2320-4335-81e4-b2f3c50fc196"). InnerVolumeSpecName "kube-api-access-n5jpb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 13:11:09.966957 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:11:09.966932    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vn85c\" (UniqueName: \"kubernetes.io/projected/f2dee997-92a0-499d-956d-8c0d1874664c-kube-api-access-vn85c\") pod \"f2dee997-92a0-499d-956d-8c0d1874664c\" (UID: \"f2dee997-92a0-499d-956d-8c0d1874664c\") "
Jul 20 13:11:09.967189 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:11:09.967173    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n5jpb\" (UniqueName: \"kubernetes.io/projected/e3ebd6a3-2320-4335-81e4-b2f3c50fc196-kube-api-access-n5jpb\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 20 13:11:09.968704 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:11:09.968673    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f2dee997-92a0-499d-956d-8c0d1874664c-kube-api-access-vn85c" (OuterVolumeSpecName: "kube-api-access-vn85c") pod "f2dee997-92a0-499d-956d-8c0d1874664c" (UID: "f2dee997-92a0-499d-956d-8c0d1874664c"). InnerVolumeSpecName "kube-api-access-vn85c". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 13:11:10.068424 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:11:10.068400    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vn85c\" (UniqueName: \"kubernetes.io/projected/f2dee997-92a0-499d-956d-8c0d1874664c-kube-api-access-vn85c\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 20 13:11:10.773831 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:11:10.773805    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-pgbkl"
Jul 20 13:11:10.774291 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:11:10.773805    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5db48fdb79-2dxwh"
Jul 20 13:11:10.803190 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:11:10.803163    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-pgbkl"]
Jul 20 13:11:10.806721 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:11:10.806696    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-pgbkl"]
Jul 20 13:11:10.824593 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:11:10.824565    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5db48fdb79-2dxwh"]
Jul 20 13:11:10.826410 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:11:10.826389    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5db48fdb79-2dxwh"]
Jul 20 13:11:11.095306 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:11:11.095234    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e3ebd6a3-2320-4335-81e4-b2f3c50fc196" path="/var/lib/kubelet/pods/e3ebd6a3-2320-4335-81e4-b2f3c50fc196/volumes"
Jul 20 13:11:11.095451 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:11:11.095439    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f2dee997-92a0-499d-956d-8c0d1874664c" path="/var/lib/kubelet/pods/f2dee997-92a0-499d-956d-8c0d1874664c/volumes"
Jul 20 13:11:16.267761 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:11:16.267725    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-59c84b5b7-lwvmh"]
Jul 20 13:11:16.410930 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:11:16.410899    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-59c84b5b7-lwvmh"]
Jul 20 13:11:16.411106 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:11:16.411000    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-59c84b5b7-lwvmh"
Jul 20 13:11:16.417390 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:11:16.417368    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-b5km6\""
Jul 20 13:11:16.417863 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:11:16.417763    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 20 13:11:16.418148 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:11:16.418133    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 20 13:11:16.459299 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:11:16.459273    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-78b9bfcd6-64n7t"]
Jul 20 13:11:16.493435 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:11:16.493406    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-78b9bfcd6-64n7t"]
Jul 20 13:11:16.493567 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:11:16.493545    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-78b9bfcd6-64n7t"
Jul 20 13:11:16.521170 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:11:16.521109    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1e63ff2c-4c4f-484a-b8af-4f4ca452657c-webhook-cert\") pod \"maas-controller-59c84b5b7-lwvmh\" (UID: \"1e63ff2c-4c4f-484a-b8af-4f4ca452657c\") " pod="opendatahub/maas-controller-59c84b5b7-lwvmh"
Jul 20 13:11:16.521170 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:11:16.521152    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tmnnt\" (UniqueName: \"kubernetes.io/projected/1e63ff2c-4c4f-484a-b8af-4f4ca452657c-kube-api-access-tmnnt\") pod \"maas-controller-59c84b5b7-lwvmh\" (UID: \"1e63ff2c-4c4f-484a-b8af-4f4ca452657c\") " pod="opendatahub/maas-controller-59c84b5b7-lwvmh"
Jul 20 13:11:16.622449 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:11:16.622415    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/26e63a08-fdbc-43f7-9913-7605c4c9602f-webhook-cert\") pod \"maas-controller-78b9bfcd6-64n7t\" (UID: \"26e63a08-fdbc-43f7-9913-7605c4c9602f\") " pod="opendatahub/maas-controller-78b9bfcd6-64n7t"
Jul 20 13:11:16.622449 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:11:16.622448    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p5f54\" (UniqueName: \"kubernetes.io/projected/26e63a08-fdbc-43f7-9913-7605c4c9602f-kube-api-access-p5f54\") pod \"maas-controller-78b9bfcd6-64n7t\" (UID: \"26e63a08-fdbc-43f7-9913-7605c4c9602f\") " pod="opendatahub/maas-controller-78b9bfcd6-64n7t"
Jul 20 13:11:16.622655 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:11:16.622487    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1e63ff2c-4c4f-484a-b8af-4f4ca452657c-webhook-cert\") pod \"maas-controller-59c84b5b7-lwvmh\" (UID: \"1e63ff2c-4c4f-484a-b8af-4f4ca452657c\") " pod="opendatahub/maas-controller-59c84b5b7-lwvmh"
Jul 20 13:11:16.622655 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:11:16.622539    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tmnnt\" (UniqueName: \"kubernetes.io/projected/1e63ff2c-4c4f-484a-b8af-4f4ca452657c-kube-api-access-tmnnt\") pod \"maas-controller-59c84b5b7-lwvmh\" (UID: \"1e63ff2c-4c4f-484a-b8af-4f4ca452657c\") " pod="opendatahub/maas-controller-59c84b5b7-lwvmh"
Jul 20 13:11:16.622655 ip-10-0-134-121 kubenswrapper[2584]: E0720 13:11:16.622585    2584 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found
Jul 20 13:11:16.622655 ip-10-0-134-121 kubenswrapper[2584]: E0720 13:11:16.622657    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1e63ff2c-4c4f-484a-b8af-4f4ca452657c-webhook-cert podName:1e63ff2c-4c4f-484a-b8af-4f4ca452657c nodeName:}" failed. No retries permitted until 2026-07-20 13:11:17.122637432 +0000 UTC m=+566.839184821 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/1e63ff2c-4c4f-484a-b8af-4f4ca452657c-webhook-cert") pod "maas-controller-59c84b5b7-lwvmh" (UID: "1e63ff2c-4c4f-484a-b8af-4f4ca452657c") : secret "maas-controller-webhook-cert" not found
Jul 20 13:11:16.635386 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:11:16.635361    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tmnnt\" (UniqueName: \"kubernetes.io/projected/1e63ff2c-4c4f-484a-b8af-4f4ca452657c-kube-api-access-tmnnt\") pod \"maas-controller-59c84b5b7-lwvmh\" (UID: \"1e63ff2c-4c4f-484a-b8af-4f4ca452657c\") " pod="opendatahub/maas-controller-59c84b5b7-lwvmh"
Jul 20 13:11:16.723920 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:11:16.723885    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/26e63a08-fdbc-43f7-9913-7605c4c9602f-webhook-cert\") pod \"maas-controller-78b9bfcd6-64n7t\" (UID: \"26e63a08-fdbc-43f7-9913-7605c4c9602f\") " pod="opendatahub/maas-controller-78b9bfcd6-64n7t"
Jul 20 13:11:16.723920 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:11:16.723921    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p5f54\" (UniqueName: \"kubernetes.io/projected/26e63a08-fdbc-43f7-9913-7605c4c9602f-kube-api-access-p5f54\") pod \"maas-controller-78b9bfcd6-64n7t\" (UID: \"26e63a08-fdbc-43f7-9913-7605c4c9602f\") " pod="opendatahub/maas-controller-78b9bfcd6-64n7t"
Jul 20 13:11:16.724120 ip-10-0-134-121 kubenswrapper[2584]: E0720 13:11:16.724060    2584 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found
Jul 20 13:11:16.724156 ip-10-0-134-121 kubenswrapper[2584]: E0720 13:11:16.724123    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/26e63a08-fdbc-43f7-9913-7605c4c9602f-webhook-cert podName:26e63a08-fdbc-43f7-9913-7605c4c9602f nodeName:}" failed. No retries permitted until 2026-07-20 13:11:17.224108293 +0000 UTC m=+566.940655681 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/26e63a08-fdbc-43f7-9913-7605c4c9602f-webhook-cert") pod "maas-controller-78b9bfcd6-64n7t" (UID: "26e63a08-fdbc-43f7-9913-7605c4c9602f") : secret "maas-controller-webhook-cert" not found
Jul 20 13:11:16.733327 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:11:16.733304    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p5f54\" (UniqueName: \"kubernetes.io/projected/26e63a08-fdbc-43f7-9913-7605c4c9602f-kube-api-access-p5f54\") pod \"maas-controller-78b9bfcd6-64n7t\" (UID: \"26e63a08-fdbc-43f7-9913-7605c4c9602f\") " pod="opendatahub/maas-controller-78b9bfcd6-64n7t"
Jul 20 13:11:17.128005 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:11:17.127978    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1e63ff2c-4c4f-484a-b8af-4f4ca452657c-webhook-cert\") pod \"maas-controller-59c84b5b7-lwvmh\" (UID: \"1e63ff2c-4c4f-484a-b8af-4f4ca452657c\") " pod="opendatahub/maas-controller-59c84b5b7-lwvmh"
Jul 20 13:11:17.130323 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:11:17.130298    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1e63ff2c-4c4f-484a-b8af-4f4ca452657c-webhook-cert\") pod \"maas-controller-59c84b5b7-lwvmh\" (UID: \"1e63ff2c-4c4f-484a-b8af-4f4ca452657c\") " pod="opendatahub/maas-controller-59c84b5b7-lwvmh"
Jul 20 13:11:17.229096 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:11:17.229067    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/26e63a08-fdbc-43f7-9913-7605c4c9602f-webhook-cert\") pod \"maas-controller-78b9bfcd6-64n7t\" (UID: \"26e63a08-fdbc-43f7-9913-7605c4c9602f\") " pod="opendatahub/maas-controller-78b9bfcd6-64n7t"
Jul 20 13:11:17.231343 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:11:17.231319    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/26e63a08-fdbc-43f7-9913-7605c4c9602f-webhook-cert\") pod \"maas-controller-78b9bfcd6-64n7t\" (UID: \"26e63a08-fdbc-43f7-9913-7605c4c9602f\") " pod="opendatahub/maas-controller-78b9bfcd6-64n7t"
Jul 20 13:11:17.321053 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:11:17.321020    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-59c84b5b7-lwvmh"
Jul 20 13:11:17.404124 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:11:17.404086    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-78b9bfcd6-64n7t"
Jul 20 13:11:17.517767 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:11:17.517735    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-59c84b5b7-lwvmh"]
Jul 20 13:11:17.519932 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:11:17.519592    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1e63ff2c_4c4f_484a_b8af_4f4ca452657c.slice/crio-a0281351809712e09067cd314bb33fdf0858961999c2ecb370217f75c5e96987 WatchSource:0}: Error finding container a0281351809712e09067cd314bb33fdf0858961999c2ecb370217f75c5e96987: Status 404 returned error can't find the container with id a0281351809712e09067cd314bb33fdf0858961999c2ecb370217f75c5e96987
Jul 20 13:11:17.567558 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:11:17.567536    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-78b9bfcd6-64n7t"]
Jul 20 13:11:17.569299 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:11:17.569268    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod26e63a08_fdbc_43f7_9913_7605c4c9602f.slice/crio-5e03112d9aa0de0b949fe803e0cb6a3746e1b59454d02df274a84bf76efc0359 WatchSource:0}: Error finding container 5e03112d9aa0de0b949fe803e0cb6a3746e1b59454d02df274a84bf76efc0359: Status 404 returned error can't find the container with id 5e03112d9aa0de0b949fe803e0cb6a3746e1b59454d02df274a84bf76efc0359
Jul 20 13:11:17.808021 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:11:17.807987    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-59c84b5b7-lwvmh" event={"ID":"1e63ff2c-4c4f-484a-b8af-4f4ca452657c","Type":"ContainerStarted","Data":"a0281351809712e09067cd314bb33fdf0858961999c2ecb370217f75c5e96987"}
Jul 20 13:11:17.809110 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:11:17.809086    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-78b9bfcd6-64n7t" event={"ID":"26e63a08-fdbc-43f7-9913-7605c4c9602f","Type":"ContainerStarted","Data":"5e03112d9aa0de0b949fe803e0cb6a3746e1b59454d02df274a84bf76efc0359"}
Jul 20 13:11:20.828851 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:11:20.828816    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-59c84b5b7-lwvmh" event={"ID":"1e63ff2c-4c4f-484a-b8af-4f4ca452657c","Type":"ContainerStarted","Data":"bd033ec9144163514fc859de935e0511acabb309762a22f8c506ca99a3df0cc5"}
Jul 20 13:11:20.829309 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:11:20.828911    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-59c84b5b7-lwvmh"
Jul 20 13:11:20.830276 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:11:20.830251    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-78b9bfcd6-64n7t" event={"ID":"26e63a08-fdbc-43f7-9913-7605c4c9602f","Type":"ContainerStarted","Data":"fa03c64c1f441687121bd3ab641b4d1981e40a19ec227f9f4309642a7bfca156"}
Jul 20 13:11:20.830368 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:11:20.830307    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-78b9bfcd6-64n7t"
Jul 20 13:11:20.865986 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:11:20.865920    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-59c84b5b7-lwvmh" podStartSLOduration=2.054782932 podStartE2EDuration="4.865906154s" totalImagesPullingTime="2.811123222s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 13:11:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 13:11:20.864592209 +0000 UTC m=+570.581139621" watchObservedRunningTime="2026-07-20 13:11:20.865906154 +0000 UTC m=+570.582453565"
Jul 20 13:11:20.909845 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:11:20.909800    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-78b9bfcd6-64n7t" podStartSLOduration=2.141625273 podStartE2EDuration="4.909788411s" totalImagesPullingTime="2.768163138s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 13:11:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 13:11:20.909667156 +0000 UTC m=+570.626214567" watchObservedRunningTime="2026-07-20 13:11:20.909788411 +0000 UTC m=+570.626335822"
Jul 20 13:11:31.838333 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:11:31.838305    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-78b9bfcd6-64n7t"
Jul 20 13:11:31.838791 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:11:31.838391    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-59c84b5b7-lwvmh"
Jul 20 13:11:31.898806 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:11:31.898774    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-59c84b5b7-lwvmh"]
Jul 20 13:11:31.899600 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:11:31.899571    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-59c84b5b7-lwvmh" podUID="1e63ff2c-4c4f-484a-b8af-4f4ca452657c" containerName="manager" containerID="cri-o://bd033ec9144163514fc859de935e0511acabb309762a22f8c506ca99a3df0cc5" gracePeriod=30
Jul 20 13:11:32.151514 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:11:32.151490    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-59c84b5b7-lwvmh"
Jul 20 13:11:32.261536 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:11:32.261494    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tmnnt\" (UniqueName: \"kubernetes.io/projected/1e63ff2c-4c4f-484a-b8af-4f4ca452657c-kube-api-access-tmnnt\") pod \"1e63ff2c-4c4f-484a-b8af-4f4ca452657c\" (UID: \"1e63ff2c-4c4f-484a-b8af-4f4ca452657c\") "
Jul 20 13:11:32.261536 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:11:32.261549    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1e63ff2c-4c4f-484a-b8af-4f4ca452657c-webhook-cert\") pod \"1e63ff2c-4c4f-484a-b8af-4f4ca452657c\" (UID: \"1e63ff2c-4c4f-484a-b8af-4f4ca452657c\") "
Jul 20 13:11:32.263603 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:11:32.263577    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1e63ff2c-4c4f-484a-b8af-4f4ca452657c-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "1e63ff2c-4c4f-484a-b8af-4f4ca452657c" (UID: "1e63ff2c-4c4f-484a-b8af-4f4ca452657c"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 13:11:32.263702 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:11:32.263623    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1e63ff2c-4c4f-484a-b8af-4f4ca452657c-kube-api-access-tmnnt" (OuterVolumeSpecName: "kube-api-access-tmnnt") pod "1e63ff2c-4c4f-484a-b8af-4f4ca452657c" (UID: "1e63ff2c-4c4f-484a-b8af-4f4ca452657c"). InnerVolumeSpecName "kube-api-access-tmnnt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 13:11:32.363218 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:11:32.363185    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tmnnt\" (UniqueName: \"kubernetes.io/projected/1e63ff2c-4c4f-484a-b8af-4f4ca452657c-kube-api-access-tmnnt\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 20 13:11:32.363218 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:11:32.363213    2584 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1e63ff2c-4c4f-484a-b8af-4f4ca452657c-webhook-cert\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 20 13:11:32.896746 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:11:32.896713    2584 generic.go:356] "Generic (PLEG): container finished" podID="1e63ff2c-4c4f-484a-b8af-4f4ca452657c" containerID="bd033ec9144163514fc859de935e0511acabb309762a22f8c506ca99a3df0cc5" exitCode=0
Jul 20 13:11:32.897156 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:11:32.896750    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-59c84b5b7-lwvmh"
Jul 20 13:11:32.897156 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:11:32.896780    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-59c84b5b7-lwvmh" event={"ID":"1e63ff2c-4c4f-484a-b8af-4f4ca452657c","Type":"ContainerDied","Data":"bd033ec9144163514fc859de935e0511acabb309762a22f8c506ca99a3df0cc5"}
Jul 20 13:11:32.897156 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:11:32.896849    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-59c84b5b7-lwvmh" event={"ID":"1e63ff2c-4c4f-484a-b8af-4f4ca452657c","Type":"ContainerDied","Data":"a0281351809712e09067cd314bb33fdf0858961999c2ecb370217f75c5e96987"}
Jul 20 13:11:32.897156 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:11:32.896872    2584 scope.go:117] "RemoveContainer" containerID="bd033ec9144163514fc859de935e0511acabb309762a22f8c506ca99a3df0cc5"
Jul 20 13:11:32.906543 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:11:32.906372    2584 scope.go:117] "RemoveContainer" containerID="bd033ec9144163514fc859de935e0511acabb309762a22f8c506ca99a3df0cc5"
Jul 20 13:11:32.906657 ip-10-0-134-121 kubenswrapper[2584]: E0720 13:11:32.906639    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bd033ec9144163514fc859de935e0511acabb309762a22f8c506ca99a3df0cc5\": container with ID starting with bd033ec9144163514fc859de935e0511acabb309762a22f8c506ca99a3df0cc5 not found: ID does not exist" containerID="bd033ec9144163514fc859de935e0511acabb309762a22f8c506ca99a3df0cc5"
Jul 20 13:11:32.906708 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:11:32.906666    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bd033ec9144163514fc859de935e0511acabb309762a22f8c506ca99a3df0cc5"} err="failed to get container status \"bd033ec9144163514fc859de935e0511acabb309762a22f8c506ca99a3df0cc5\": rpc error: code = NotFound desc = could not find container \"bd033ec9144163514fc859de935e0511acabb309762a22f8c506ca99a3df0cc5\": container with ID starting with bd033ec9144163514fc859de935e0511acabb309762a22f8c506ca99a3df0cc5 not found: ID does not exist"
Jul 20 13:11:32.919163 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:11:32.919070    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-59c84b5b7-lwvmh"]
Jul 20 13:11:32.920878 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:11:32.920856    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-59c84b5b7-lwvmh"]
Jul 20 13:11:33.095165 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:11:33.095132    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1e63ff2c-4c4f-484a-b8af-4f4ca452657c" path="/var/lib/kubelet/pods/1e63ff2c-4c4f-484a-b8af-4f4ca452657c/volumes"
Jul 20 13:11:53.066446 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:11:53.066413    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-b896b746d-qzcqc"]
Jul 20 13:11:53.066858 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:11:53.066791    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1e63ff2c-4c4f-484a-b8af-4f4ca452657c" containerName="manager"
Jul 20 13:11:53.066858 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:11:53.066803    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="1e63ff2c-4c4f-484a-b8af-4f4ca452657c" containerName="manager"
Jul 20 13:11:53.066932 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:11:53.066882    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="1e63ff2c-4c4f-484a-b8af-4f4ca452657c" containerName="manager"
Jul 20 13:11:53.071381 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:11:53.071362    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-b896b746d-qzcqc"
Jul 20 13:11:53.078368 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:11:53.078352    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Jul 20 13:11:53.101039 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:11:53.101003    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-b896b746d-qzcqc"]
Jul 20 13:11:53.143364 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:11:53.143335    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8wdhm\" (UniqueName: \"kubernetes.io/projected/66d075e2-2f46-4e16-888b-fd322516c2b6-kube-api-access-8wdhm\") pod \"maas-api-b896b746d-qzcqc\" (UID: \"66d075e2-2f46-4e16-888b-fd322516c2b6\") " pod="odh-ai-gateway-infra/maas-api-b896b746d-qzcqc"
Jul 20 13:11:53.143471 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:11:53.143396    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/66d075e2-2f46-4e16-888b-fd322516c2b6-maas-api-tls\") pod \"maas-api-b896b746d-qzcqc\" (UID: \"66d075e2-2f46-4e16-888b-fd322516c2b6\") " pod="odh-ai-gateway-infra/maas-api-b896b746d-qzcqc"
Jul 20 13:11:53.143471 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:11:53.143434    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/66d075e2-2f46-4e16-888b-fd322516c2b6-openshift-service-ca\") pod \"maas-api-b896b746d-qzcqc\" (UID: \"66d075e2-2f46-4e16-888b-fd322516c2b6\") " pod="odh-ai-gateway-infra/maas-api-b896b746d-qzcqc"
Jul 20 13:11:53.244148 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:11:53.244118    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/66d075e2-2f46-4e16-888b-fd322516c2b6-maas-api-tls\") pod \"maas-api-b896b746d-qzcqc\" (UID: \"66d075e2-2f46-4e16-888b-fd322516c2b6\") " pod="odh-ai-gateway-infra/maas-api-b896b746d-qzcqc"
Jul 20 13:11:53.244148 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:11:53.244150    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/66d075e2-2f46-4e16-888b-fd322516c2b6-openshift-service-ca\") pod \"maas-api-b896b746d-qzcqc\" (UID: \"66d075e2-2f46-4e16-888b-fd322516c2b6\") " pod="odh-ai-gateway-infra/maas-api-b896b746d-qzcqc"
Jul 20 13:11:53.244381 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:11:53.244223    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8wdhm\" (UniqueName: \"kubernetes.io/projected/66d075e2-2f46-4e16-888b-fd322516c2b6-kube-api-access-8wdhm\") pod \"maas-api-b896b746d-qzcqc\" (UID: \"66d075e2-2f46-4e16-888b-fd322516c2b6\") " pod="odh-ai-gateway-infra/maas-api-b896b746d-qzcqc"
Jul 20 13:11:53.244381 ip-10-0-134-121 kubenswrapper[2584]: E0720 13:11:53.244270    2584 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-serving-cert: secret "maas-api-serving-cert" not found
Jul 20 13:11:53.244381 ip-10-0-134-121 kubenswrapper[2584]: E0720 13:11:53.244334    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/66d075e2-2f46-4e16-888b-fd322516c2b6-maas-api-tls podName:66d075e2-2f46-4e16-888b-fd322516c2b6 nodeName:}" failed. No retries permitted until 2026-07-20 13:11:53.74431641 +0000 UTC m=+603.460863800 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/66d075e2-2f46-4e16-888b-fd322516c2b6-maas-api-tls") pod "maas-api-b896b746d-qzcqc" (UID: "66d075e2-2f46-4e16-888b-fd322516c2b6") : secret "maas-api-serving-cert" not found
Jul 20 13:11:53.244909 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:11:53.244886    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/66d075e2-2f46-4e16-888b-fd322516c2b6-openshift-service-ca\") pod \"maas-api-b896b746d-qzcqc\" (UID: \"66d075e2-2f46-4e16-888b-fd322516c2b6\") " pod="odh-ai-gateway-infra/maas-api-b896b746d-qzcqc"
Jul 20 13:11:53.254895 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:11:53.254874    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8wdhm\" (UniqueName: \"kubernetes.io/projected/66d075e2-2f46-4e16-888b-fd322516c2b6-kube-api-access-8wdhm\") pod \"maas-api-b896b746d-qzcqc\" (UID: \"66d075e2-2f46-4e16-888b-fd322516c2b6\") " pod="odh-ai-gateway-infra/maas-api-b896b746d-qzcqc"
Jul 20 13:11:53.664248 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:11:53.664214    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-74584bb9f8-fkdl9"]
Jul 20 13:11:53.671724 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:11:53.671704    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-74584bb9f8-fkdl9"
Jul 20 13:11:53.673697 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:11:53.673677    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Jul 20 13:11:53.673870 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:11:53.673853    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-g52dc\""
Jul 20 13:11:53.678150 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:11:53.678125    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-74584bb9f8-fkdl9"]
Jul 20 13:11:53.695685 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:11:53.695662    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-f9b8d9b9b-d5qcq"]
Jul 20 13:11:53.704001 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:11:53.703744    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-f9b8d9b9b-d5qcq"
Jul 20 13:11:53.708755 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:11:53.708723    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-f9b8d9b9b-d5qcq"]
Jul 20 13:11:53.749443 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:11:53.749409    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f9b38cd6-b909-4389-b30f-0a995edacec4-plugins-config-volume\") pod \"payload-pre-processing-74584bb9f8-fkdl9\" (UID: \"f9b38cd6-b909-4389-b30f-0a995edacec4\") " pod="openshift-ingress/payload-pre-processing-74584bb9f8-fkdl9"
Jul 20 13:11:53.749628 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:11:53.749485    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/66d075e2-2f46-4e16-888b-fd322516c2b6-maas-api-tls\") pod \"maas-api-b896b746d-qzcqc\" (UID: \"66d075e2-2f46-4e16-888b-fd322516c2b6\") " pod="odh-ai-gateway-infra/maas-api-b896b746d-qzcqc"
Jul 20 13:11:53.749628 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:11:53.749591    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qpm94\" (UniqueName: \"kubernetes.io/projected/f9b38cd6-b909-4389-b30f-0a995edacec4-kube-api-access-qpm94\") pod \"payload-pre-processing-74584bb9f8-fkdl9\" (UID: \"f9b38cd6-b909-4389-b30f-0a995edacec4\") " pod="openshift-ingress/payload-pre-processing-74584bb9f8-fkdl9"
Jul 20 13:11:53.751885 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:11:53.751856    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/66d075e2-2f46-4e16-888b-fd322516c2b6-maas-api-tls\") pod \"maas-api-b896b746d-qzcqc\" (UID: \"66d075e2-2f46-4e16-888b-fd322516c2b6\") " pod="odh-ai-gateway-infra/maas-api-b896b746d-qzcqc"
Jul 20 13:11:53.850611 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:11:53.850577    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mls28\" (UniqueName: \"kubernetes.io/projected/ba9fa0dd-9b78-428e-b33b-b6d75669f26c-kube-api-access-mls28\") pod \"payload-processing-f9b8d9b9b-d5qcq\" (UID: \"ba9fa0dd-9b78-428e-b33b-b6d75669f26c\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-d5qcq"
Jul 20 13:11:53.850771 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:11:53.850634    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ba9fa0dd-9b78-428e-b33b-b6d75669f26c-plugins-config-volume\") pod \"payload-processing-f9b8d9b9b-d5qcq\" (UID: \"ba9fa0dd-9b78-428e-b33b-b6d75669f26c\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-d5qcq"
Jul 20 13:11:53.850771 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:11:53.850661    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qpm94\" (UniqueName: \"kubernetes.io/projected/f9b38cd6-b909-4389-b30f-0a995edacec4-kube-api-access-qpm94\") pod \"payload-pre-processing-74584bb9f8-fkdl9\" (UID: \"f9b38cd6-b909-4389-b30f-0a995edacec4\") " pod="openshift-ingress/payload-pre-processing-74584bb9f8-fkdl9"
Jul 20 13:11:53.850843 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:11:53.850763    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f9b38cd6-b909-4389-b30f-0a995edacec4-plugins-config-volume\") pod \"payload-pre-processing-74584bb9f8-fkdl9\" (UID: \"f9b38cd6-b909-4389-b30f-0a995edacec4\") " pod="openshift-ingress/payload-pre-processing-74584bb9f8-fkdl9"
Jul 20 13:11:53.851461 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:11:53.851442    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f9b38cd6-b909-4389-b30f-0a995edacec4-plugins-config-volume\") pod \"payload-pre-processing-74584bb9f8-fkdl9\" (UID: \"f9b38cd6-b909-4389-b30f-0a995edacec4\") " pod="openshift-ingress/payload-pre-processing-74584bb9f8-fkdl9"
Jul 20 13:11:53.858876 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:11:53.858856    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qpm94\" (UniqueName: \"kubernetes.io/projected/f9b38cd6-b909-4389-b30f-0a995edacec4-kube-api-access-qpm94\") pod \"payload-pre-processing-74584bb9f8-fkdl9\" (UID: \"f9b38cd6-b909-4389-b30f-0a995edacec4\") " pod="openshift-ingress/payload-pre-processing-74584bb9f8-fkdl9"
Jul 20 13:11:53.951559 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:11:53.951484    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mls28\" (UniqueName: \"kubernetes.io/projected/ba9fa0dd-9b78-428e-b33b-b6d75669f26c-kube-api-access-mls28\") pod \"payload-processing-f9b8d9b9b-d5qcq\" (UID: \"ba9fa0dd-9b78-428e-b33b-b6d75669f26c\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-d5qcq"
Jul 20 13:11:53.951559 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:11:53.951524    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ba9fa0dd-9b78-428e-b33b-b6d75669f26c-plugins-config-volume\") pod \"payload-processing-f9b8d9b9b-d5qcq\" (UID: \"ba9fa0dd-9b78-428e-b33b-b6d75669f26c\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-d5qcq"
Jul 20 13:11:53.952259 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:11:53.952238    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ba9fa0dd-9b78-428e-b33b-b6d75669f26c-plugins-config-volume\") pod \"payload-processing-f9b8d9b9b-d5qcq\" (UID: \"ba9fa0dd-9b78-428e-b33b-b6d75669f26c\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-d5qcq"
Jul 20 13:11:53.960088 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:11:53.960065    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mls28\" (UniqueName: \"kubernetes.io/projected/ba9fa0dd-9b78-428e-b33b-b6d75669f26c-kube-api-access-mls28\") pod \"payload-processing-f9b8d9b9b-d5qcq\" (UID: \"ba9fa0dd-9b78-428e-b33b-b6d75669f26c\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-d5qcq"
Jul 20 13:11:53.981911 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:11:53.981890    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-b896b746d-qzcqc"
Jul 20 13:11:53.984050 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:11:53.984032    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-74584bb9f8-fkdl9"
Jul 20 13:11:54.016213 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:11:54.015845    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-f9b8d9b9b-d5qcq"
Jul 20 13:11:54.200421 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:11:54.200354    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-b896b746d-qzcqc"]
Jul 20 13:11:54.202573 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:11:54.202502    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod66d075e2_2f46_4e16_888b_fd322516c2b6.slice/crio-de48681a434843e2ade8da574780474fdb9ad1c415fefe1112b59f1a3d28ac84 WatchSource:0}: Error finding container de48681a434843e2ade8da574780474fdb9ad1c415fefe1112b59f1a3d28ac84: Status 404 returned error can't find the container with id de48681a434843e2ade8da574780474fdb9ad1c415fefe1112b59f1a3d28ac84
Jul 20 13:11:54.226725 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:11:54.226684    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-74584bb9f8-fkdl9"]
Jul 20 13:11:54.229661 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:11:54.229632    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf9b38cd6_b909_4389_b30f_0a995edacec4.slice/crio-7eb7d7a7cf70572c0a16bf97cb038afea3ebd790050e26386f5681e633a0fa91 WatchSource:0}: Error finding container 7eb7d7a7cf70572c0a16bf97cb038afea3ebd790050e26386f5681e633a0fa91: Status 404 returned error can't find the container with id 7eb7d7a7cf70572c0a16bf97cb038afea3ebd790050e26386f5681e633a0fa91
Jul 20 13:11:54.250511 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:11:54.250484    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-f9b8d9b9b-d5qcq"]
Jul 20 13:11:54.252499 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:11:54.252472    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba9fa0dd_9b78_428e_b33b_b6d75669f26c.slice/crio-fa893cd93219045eba6c9c757f88c47d822e242514b299a551acf1fda6ae6077 WatchSource:0}: Error finding container fa893cd93219045eba6c9c757f88c47d822e242514b299a551acf1fda6ae6077: Status 404 returned error can't find the container with id fa893cd93219045eba6c9c757f88c47d822e242514b299a551acf1fda6ae6077
Jul 20 13:11:55.010954 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:11:55.010875    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-f9b8d9b9b-d5qcq" event={"ID":"ba9fa0dd-9b78-428e-b33b-b6d75669f26c","Type":"ContainerStarted","Data":"fa893cd93219045eba6c9c757f88c47d822e242514b299a551acf1fda6ae6077"}
Jul 20 13:11:55.013364 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:11:55.013312    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-74584bb9f8-fkdl9" event={"ID":"f9b38cd6-b909-4389-b30f-0a995edacec4","Type":"ContainerStarted","Data":"7eb7d7a7cf70572c0a16bf97cb038afea3ebd790050e26386f5681e633a0fa91"}
Jul 20 13:11:55.015882 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:11:55.015807    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-b896b746d-qzcqc" event={"ID":"66d075e2-2f46-4e16-888b-fd322516c2b6","Type":"ContainerStarted","Data":"de48681a434843e2ade8da574780474fdb9ad1c415fefe1112b59f1a3d28ac84"}
Jul 20 13:11:57.028749 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:11:57.028708    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-f9b8d9b9b-d5qcq" event={"ID":"ba9fa0dd-9b78-428e-b33b-b6d75669f26c","Type":"ContainerStarted","Data":"23757ad74f1b462192f8b0f3b825a3028c501143298c1b5f83f0f9bbc2471e60"}
Jul 20 13:11:57.030170 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:11:57.030146    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-f9b8d9b9b-d5qcq"
Jul 20 13:11:57.032645 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:11:57.032623    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-74584bb9f8-fkdl9" event={"ID":"f9b38cd6-b909-4389-b30f-0a995edacec4","Type":"ContainerStarted","Data":"0a737334b1e8ba1d0ab31e9a4f1f79b3685c90c4935ff65d87a4127855559fd7"}
Jul 20 13:11:57.033673 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:11:57.033658    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-74584bb9f8-fkdl9"
Jul 20 13:11:57.035061 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:11:57.035040    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-b896b746d-qzcqc" event={"ID":"66d075e2-2f46-4e16-888b-fd322516c2b6","Type":"ContainerStarted","Data":"750d4d5c6385ce005886d0b84175dac1d9ca17b7592bd72d41fe5d628b8bbb31"}
Jul 20 13:11:57.035634 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:11:57.035618    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-b896b746d-qzcqc"
Jul 20 13:11:57.065266 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:11:57.065216    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-f9b8d9b9b-d5qcq" podStartSLOduration=1.831110403 podStartE2EDuration="4.065200555s" totalImagesPullingTime="2.234090152s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 13:11:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 13:11:57.048678657 +0000 UTC m=+606.765226072" watchObservedRunningTime="2026-07-20 13:11:57.065200555 +0000 UTC m=+606.781747966"
Jul 20 13:11:57.065404 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:11:57.065387    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-b896b746d-qzcqc" podStartSLOduration=1.780273741 podStartE2EDuration="4.06538226s" totalImagesPullingTime="2.285108519s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 13:11:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 13:11:57.064048056 +0000 UTC m=+606.780595459" watchObservedRunningTime="2026-07-20 13:11:57.06538226 +0000 UTC m=+606.781929702"
Jul 20 13:11:57.078747 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:11:57.078701    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-74584bb9f8-fkdl9" podStartSLOduration=1.819469887 podStartE2EDuration="4.078682423s" totalImagesPullingTime="2.259212536s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 13:11:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 13:11:57.077448309 +0000 UTC m=+606.793995722" watchObservedRunningTime="2026-07-20 13:11:57.078682423 +0000 UTC m=+606.795229837"
Jul 20 13:12:02.067797 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:12:02.067759    2584 generic.go:356] "Generic (PLEG): container finished" podID="d1f7d779-906f-40bb-945a-fae805b1d5f7" containerID="43bcc41f4a45cdb135e84afc72d7993fa5e0cd907678dfb93f82eebdfd37f9ea" exitCode=0
Jul 20 13:12:02.067797 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:12:02.067799    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-669mt" event={"ID":"d1f7d779-906f-40bb-945a-fae805b1d5f7","Type":"ContainerDied","Data":"43bcc41f4a45cdb135e84afc72d7993fa5e0cd907678dfb93f82eebdfd37f9ea"}
Jul 20 13:12:02.068270 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:12:02.068229    2584 scope.go:117] "RemoveContainer" containerID="43bcc41f4a45cdb135e84afc72d7993fa5e0cd907678dfb93f82eebdfd37f9ea"
Jul 20 13:12:02.069257 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:12:02.069226    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 20 13:12:02.069333 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:12:02.069312    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 20 13:12:02.069375 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:12:02.069350    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 20 13:12:03.074465 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:12:03.074432    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-669mt" event={"ID":"d1f7d779-906f-40bb-945a-fae805b1d5f7","Type":"ContainerStarted","Data":"7a21c86d081933d0936c635fd747e775182da6253a97129ede8f1a9bdf505803"}
Jul 20 13:12:03.205791 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:12:03.205751    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-669mt"
Jul 20 13:12:03.206045 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:12:03.206021    2584 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-669mt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.33:15021/healthz/ready\": dial tcp 10.134.0.33:15021: connect: connection refused" start-of-body=
Jul 20 13:12:03.206096 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:12:03.206070    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-669mt" podUID="d1f7d779-906f-40bb-945a-fae805b1d5f7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.33:15021/healthz/ready\": dial tcp 10.134.0.33:15021: connect: connection refused"
Jul 20 13:12:04.055859 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:12:04.055831    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-b896b746d-qzcqc"
Jul 20 13:12:04.206560 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:12:04.206525    2584 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-669mt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.33:15021/healthz/ready\": dial tcp 10.134.0.33:15021: connect: connection refused" start-of-body=
Jul 20 13:12:04.207041 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:12:04.206585    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-669mt" podUID="d1f7d779-906f-40bb-945a-fae805b1d5f7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.33:15021/healthz/ready\": dial tcp 10.134.0.33:15021: connect: connection refused"
Jul 20 13:12:05.206148 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:12:05.206112    2584 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-669mt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.33:15021/healthz/ready\": dial tcp 10.134.0.33:15021: connect: connection refused" start-of-body=
Jul 20 13:12:05.206308 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:12:05.206163    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-669mt" podUID="d1f7d779-906f-40bb-945a-fae805b1d5f7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.33:15021/healthz/ready\": dial tcp 10.134.0.33:15021: connect: connection refused"
Jul 20 13:12:06.205869 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:12:06.205832    2584 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-669mt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.33:15021/healthz/ready\": dial tcp 10.134.0.33:15021: connect: connection refused" start-of-body=
Jul 20 13:12:06.206344 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:12:06.205891    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-669mt" podUID="d1f7d779-906f-40bb-945a-fae805b1d5f7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.33:15021/healthz/ready\": dial tcp 10.134.0.33:15021: connect: connection refused"
Jul 20 13:12:07.209603 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:12:07.209571    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-669mt"
Jul 20 13:12:07.210006 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:12:07.209903    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-669mt"
Jul 20 13:12:07.210439 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:12:07.210422    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-669mt"
Jul 20 13:12:09.052414 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:12:09.052389    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-f9b8d9b9b-d5qcq"
Jul 20 13:12:09.052843 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:12:09.052655    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-74584bb9f8-fkdl9"
Jul 20 13:12:21.930556 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:12:21.930486    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-g2xqc"]
Jul 20 13:12:21.934327 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:12:21.934308    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-g2xqc"
Jul 20 13:12:21.936416 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:12:21.936384    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 20 13:12:21.936524 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:12:21.936440    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-x7r74\""
Jul 20 13:12:21.936977 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:12:21.936945    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
Jul 20 13:12:21.937050 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:12:21.937037    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 20 13:12:21.946600 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:12:21.946581    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-g2xqc"]
Jul 20 13:12:22.010060 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:12:22.010031    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gc29s\" (UniqueName: \"kubernetes.io/projected/704381f3-0889-40ae-bc6a-f3efad70d6b0-kube-api-access-gc29s\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-g2xqc\" (UID: \"704381f3-0889-40ae-bc6a-f3efad70d6b0\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-g2xqc"
Jul 20 13:12:22.010157 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:12:22.010106    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/704381f3-0889-40ae-bc6a-f3efad70d6b0-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-g2xqc\" (UID: \"704381f3-0889-40ae-bc6a-f3efad70d6b0\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-g2xqc"
Jul 20 13:12:22.010203 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:12:22.010186    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/704381f3-0889-40ae-bc6a-f3efad70d6b0-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-g2xqc\" (UID: \"704381f3-0889-40ae-bc6a-f3efad70d6b0\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-g2xqc"
Jul 20 13:12:22.010251 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:12:22.010210    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/704381f3-0889-40ae-bc6a-f3efad70d6b0-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-g2xqc\" (UID: \"704381f3-0889-40ae-bc6a-f3efad70d6b0\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-g2xqc"
Jul 20 13:12:22.010299 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:12:22.010274    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/704381f3-0889-40ae-bc6a-f3efad70d6b0-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-g2xqc\" (UID: \"704381f3-0889-40ae-bc6a-f3efad70d6b0\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-g2xqc"
Jul 20 13:12:22.010345 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:12:22.010331    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/704381f3-0889-40ae-bc6a-f3efad70d6b0-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-g2xqc\" (UID: \"704381f3-0889-40ae-bc6a-f3efad70d6b0\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-g2xqc"
Jul 20 13:12:22.111256 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:12:22.111225    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/704381f3-0889-40ae-bc6a-f3efad70d6b0-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-g2xqc\" (UID: \"704381f3-0889-40ae-bc6a-f3efad70d6b0\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-g2xqc"
Jul 20 13:12:22.111392 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:12:22.111275    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gc29s\" (UniqueName: \"kubernetes.io/projected/704381f3-0889-40ae-bc6a-f3efad70d6b0-kube-api-access-gc29s\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-g2xqc\" (UID: \"704381f3-0889-40ae-bc6a-f3efad70d6b0\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-g2xqc"
Jul 20 13:12:22.111464 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:12:22.111448    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/704381f3-0889-40ae-bc6a-f3efad70d6b0-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-g2xqc\" (UID: \"704381f3-0889-40ae-bc6a-f3efad70d6b0\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-g2xqc"
Jul 20 13:12:22.111521 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:12:22.111508    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/704381f3-0889-40ae-bc6a-f3efad70d6b0-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-g2xqc\" (UID: \"704381f3-0889-40ae-bc6a-f3efad70d6b0\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-g2xqc"
Jul 20 13:12:22.111554 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:12:22.111538    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/704381f3-0889-40ae-bc6a-f3efad70d6b0-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-g2xqc\" (UID: \"704381f3-0889-40ae-bc6a-f3efad70d6b0\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-g2xqc"
Jul 20 13:12:22.111587 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:12:22.111571    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/704381f3-0889-40ae-bc6a-f3efad70d6b0-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-g2xqc\" (UID: \"704381f3-0889-40ae-bc6a-f3efad70d6b0\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-g2xqc"
Jul 20 13:12:22.111587 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:12:22.111574    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/704381f3-0889-40ae-bc6a-f3efad70d6b0-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-g2xqc\" (UID: \"704381f3-0889-40ae-bc6a-f3efad70d6b0\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-g2xqc"
Jul 20 13:12:22.111845 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:12:22.111823    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/704381f3-0889-40ae-bc6a-f3efad70d6b0-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-g2xqc\" (UID: \"704381f3-0889-40ae-bc6a-f3efad70d6b0\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-g2xqc"
Jul 20 13:12:22.111927 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:12:22.111824    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/704381f3-0889-40ae-bc6a-f3efad70d6b0-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-g2xqc\" (UID: \"704381f3-0889-40ae-bc6a-f3efad70d6b0\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-g2xqc"
Jul 20 13:12:22.113761 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:12:22.113737    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/704381f3-0889-40ae-bc6a-f3efad70d6b0-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-g2xqc\" (UID: \"704381f3-0889-40ae-bc6a-f3efad70d6b0\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-g2xqc"
Jul 20 13:12:22.113939 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:12:22.113923    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/704381f3-0889-40ae-bc6a-f3efad70d6b0-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-g2xqc\" (UID: \"704381f3-0889-40ae-bc6a-f3efad70d6b0\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-g2xqc"
Jul 20 13:12:22.119301 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:12:22.119282    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gc29s\" (UniqueName: \"kubernetes.io/projected/704381f3-0889-40ae-bc6a-f3efad70d6b0-kube-api-access-gc29s\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-g2xqc\" (UID: \"704381f3-0889-40ae-bc6a-f3efad70d6b0\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-g2xqc"
Jul 20 13:12:22.244142 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:12:22.244113    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-g2xqc"
Jul 20 13:12:22.379380 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:12:22.379357    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-g2xqc"]
Jul 20 13:12:22.381298 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:12:22.381270    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod704381f3_0889_40ae_bc6a_f3efad70d6b0.slice/crio-b4d538f7d0c20f11cb872a291b93f41f754cdfebf9cfe8947ff72a72d0bf90cb WatchSource:0}: Error finding container b4d538f7d0c20f11cb872a291b93f41f754cdfebf9cfe8947ff72a72d0bf90cb: Status 404 returned error can't find the container with id b4d538f7d0c20f11cb872a291b93f41f754cdfebf9cfe8947ff72a72d0bf90cb
Jul 20 13:12:23.174411 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:12:23.174373    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-g2xqc" event={"ID":"704381f3-0889-40ae-bc6a-f3efad70d6b0","Type":"ContainerStarted","Data":"b4d538f7d0c20f11cb872a291b93f41f754cdfebf9cfe8947ff72a72d0bf90cb"}
Jul 20 13:12:24.180850 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:12:24.180762    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-g2xqc" event={"ID":"704381f3-0889-40ae-bc6a-f3efad70d6b0","Type":"ContainerStarted","Data":"7015447826ed109307c44a94b2ff0a833721887cad957a277098944859cdda95"}
Jul 20 13:12:24.199342 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:12:24.199297    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-g2xqc" podStartSLOduration=1.818107718 podStartE2EDuration="3.199281769s" totalImagesPullingTime="1.381174051s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 13:12:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 13:12:24.19820467 +0000 UTC m=+633.914752082" watchObservedRunningTime="2026-07-20 13:12:24.199281769 +0000 UTC m=+633.915829180"
Jul 20 13:12:26.727503 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:12:26.727469    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-b5xwt"]
Jul 20 13:12:26.731341 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:12:26.731324    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-b5xwt"
Jul 20 13:12:26.733538 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:12:26.733516    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\""
Jul 20 13:12:26.740621 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:12:26.740600    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-b5xwt"]
Jul 20 13:12:26.855582 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:12:26.855547    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/99071a2d-5375-4db0-ae41-1174b8c9c754-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-b5xwt\" (UID: \"99071a2d-5375-4db0-ae41-1174b8c9c754\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-b5xwt"
Jul 20 13:12:26.855723 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:12:26.855598    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/99071a2d-5375-4db0-ae41-1174b8c9c754-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-b5xwt\" (UID: \"99071a2d-5375-4db0-ae41-1174b8c9c754\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-b5xwt"
Jul 20 13:12:26.855723 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:12:26.855648    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/99071a2d-5375-4db0-ae41-1174b8c9c754-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-b5xwt\" (UID: \"99071a2d-5375-4db0-ae41-1174b8c9c754\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-b5xwt"
Jul 20 13:12:26.855723 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:12:26.855664    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/99071a2d-5375-4db0-ae41-1174b8c9c754-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-b5xwt\" (UID: \"99071a2d-5375-4db0-ae41-1174b8c9c754\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-b5xwt"
Jul 20 13:12:26.855832 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:12:26.855748    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rbx84\" (UniqueName: \"kubernetes.io/projected/99071a2d-5375-4db0-ae41-1174b8c9c754-kube-api-access-rbx84\") pod \"e2e-distinct-simulated-kserve-59975d69f9-b5xwt\" (UID: \"99071a2d-5375-4db0-ae41-1174b8c9c754\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-b5xwt"
Jul 20 13:12:26.855832 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:12:26.855785    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/99071a2d-5375-4db0-ae41-1174b8c9c754-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-b5xwt\" (UID: \"99071a2d-5375-4db0-ae41-1174b8c9c754\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-b5xwt"
Jul 20 13:12:26.956891 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:12:26.956857    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/99071a2d-5375-4db0-ae41-1174b8c9c754-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-b5xwt\" (UID: \"99071a2d-5375-4db0-ae41-1174b8c9c754\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-b5xwt"
Jul 20 13:12:26.957063 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:12:26.956905    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/99071a2d-5375-4db0-ae41-1174b8c9c754-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-b5xwt\" (UID: \"99071a2d-5375-4db0-ae41-1174b8c9c754\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-b5xwt"
Jul 20 13:12:26.957063 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:12:26.956935    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/99071a2d-5375-4db0-ae41-1174b8c9c754-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-b5xwt\" (UID: \"99071a2d-5375-4db0-ae41-1174b8c9c754\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-b5xwt"
Jul 20 13:12:26.957063 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:12:26.956960    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/99071a2d-5375-4db0-ae41-1174b8c9c754-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-b5xwt\" (UID: \"99071a2d-5375-4db0-ae41-1174b8c9c754\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-b5xwt"
Jul 20 13:12:26.957063 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:12:26.956993    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/99071a2d-5375-4db0-ae41-1174b8c9c754-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-b5xwt\" (UID: \"99071a2d-5375-4db0-ae41-1174b8c9c754\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-b5xwt"
Jul 20 13:12:26.957260 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:12:26.957066    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rbx84\" (UniqueName: \"kubernetes.io/projected/99071a2d-5375-4db0-ae41-1174b8c9c754-kube-api-access-rbx84\") pod \"e2e-distinct-simulated-kserve-59975d69f9-b5xwt\" (UID: \"99071a2d-5375-4db0-ae41-1174b8c9c754\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-b5xwt"
Jul 20 13:12:26.957369 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:12:26.957341    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/99071a2d-5375-4db0-ae41-1174b8c9c754-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-b5xwt\" (UID: \"99071a2d-5375-4db0-ae41-1174b8c9c754\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-b5xwt"
Jul 20 13:12:26.957430 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:12:26.957406    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/99071a2d-5375-4db0-ae41-1174b8c9c754-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-b5xwt\" (UID: \"99071a2d-5375-4db0-ae41-1174b8c9c754\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-b5xwt"
Jul 20 13:12:26.957470 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:12:26.957412    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/99071a2d-5375-4db0-ae41-1174b8c9c754-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-b5xwt\" (UID: \"99071a2d-5375-4db0-ae41-1174b8c9c754\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-b5xwt"
Jul 20 13:12:26.959298 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:12:26.959276    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/99071a2d-5375-4db0-ae41-1174b8c9c754-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-b5xwt\" (UID: \"99071a2d-5375-4db0-ae41-1174b8c9c754\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-b5xwt"
Jul 20 13:12:26.959427 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:12:26.959411    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/99071a2d-5375-4db0-ae41-1174b8c9c754-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-b5xwt\" (UID: \"99071a2d-5375-4db0-ae41-1174b8c9c754\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-b5xwt"
Jul 20 13:12:26.964563 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:12:26.964544    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rbx84\" (UniqueName: \"kubernetes.io/projected/99071a2d-5375-4db0-ae41-1174b8c9c754-kube-api-access-rbx84\") pod \"e2e-distinct-simulated-kserve-59975d69f9-b5xwt\" (UID: \"99071a2d-5375-4db0-ae41-1174b8c9c754\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-b5xwt"
Jul 20 13:12:27.041627 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:12:27.041602    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-b5xwt"
Jul 20 13:12:27.173128 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:12:27.173104    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-b5xwt"]
Jul 20 13:12:27.175043 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:12:27.175010    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod99071a2d_5375_4db0_ae41_1174b8c9c754.slice/crio-8c14799d18e3c84600f0bd070dd154f013b5341163cd5f415cf3819d40987c3d WatchSource:0}: Error finding container 8c14799d18e3c84600f0bd070dd154f013b5341163cd5f415cf3819d40987c3d: Status 404 returned error can't find the container with id 8c14799d18e3c84600f0bd070dd154f013b5341163cd5f415cf3819d40987c3d
Jul 20 13:12:27.176525 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:12:27.176508    2584 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 20 13:12:27.196313 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:12:27.196289    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-b5xwt" event={"ID":"99071a2d-5375-4db0-ae41-1174b8c9c754","Type":"ContainerStarted","Data":"8c14799d18e3c84600f0bd070dd154f013b5341163cd5f415cf3819d40987c3d"}
Jul 20 13:12:28.203183 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:12:28.203151    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-b5xwt" event={"ID":"99071a2d-5375-4db0-ae41-1174b8c9c754","Type":"ContainerStarted","Data":"8668b2d2164e923b731cba0e48439f339b0d393acf65bf9009e18b59cf6a9e11"}
Jul 20 13:12:28.225906 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:12:28.225861    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-b5xwt" podStartSLOduration=1.695889544 podStartE2EDuration="2.225847513s" totalImagesPullingTime="529.957969ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 13:12:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 13:12:28.223401151 +0000 UTC m=+637.939948571" watchObservedRunningTime="2026-07-20 13:12:28.225847513 +0000 UTC m=+637.942394940"
Jul 20 13:12:32.244805 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:12:32.244771    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-g2xqc"
Jul 20 13:12:32.245262 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:12:32.244846    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-g2xqc"
Jul 20 13:12:32.258293 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:12:32.258273    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-g2xqc"
Jul 20 13:12:33.237249 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:12:33.237221    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-g2xqc"
Jul 20 13:12:37.042318 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:12:37.042283    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-b5xwt"
Jul 20 13:12:37.042722 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:12:37.042336    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-b5xwt"
Jul 20 13:12:37.054609 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:12:37.054587    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-b5xwt"
Jul 20 13:12:37.257354 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:12:37.257326    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-b5xwt"
Jul 20 13:15:00.151622 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:15:00.151589    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29742555-dpmwc"]
Jul 20 13:15:00.155145 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:15:00.155128    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29742555-dpmwc"
Jul 20 13:15:00.157515 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:15:00.157492    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-zcsfd\""
Jul 20 13:15:00.163132 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:15:00.163107    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29742555-dpmwc"]
Jul 20 13:15:00.166297 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:15:00.166280    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29742555-dpmwc"
Jul 20 13:15:00.301653 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:15:00.301627    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29742555-dpmwc"]
Jul 20 13:15:00.303317 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:15:00.303287    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddcd65622_d09b_438f_90bf_9a79360971b7.slice/crio-cb67ca7082464484e73b5f9a82353d616df9b6f33b27debc4e2f17ed0e663bec WatchSource:0}: Error finding container cb67ca7082464484e73b5f9a82353d616df9b6f33b27debc4e2f17ed0e663bec: Status 404 returned error can't find the container with id cb67ca7082464484e73b5f9a82353d616df9b6f33b27debc4e2f17ed0e663bec
Jul 20 13:15:00.949327 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:15:00.949284    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29742555-dpmwc" event={"ID":"dcd65622-d09b-438f-90bf-9a79360971b7","Type":"ContainerStarted","Data":"cb67ca7082464484e73b5f9a82353d616df9b6f33b27debc4e2f17ed0e663bec"}
Jul 20 13:15:03.969793 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:15:03.969696    2584 generic.go:356] "Generic (PLEG): container finished" podID="dcd65622-d09b-438f-90bf-9a79360971b7" containerID="7aed14f65e88405f0298ea05f3c2ba93b70bdc9ff8f12ccf388c651b553b2b53" exitCode=0
Jul 20 13:15:03.969793 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:15:03.969770    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29742555-dpmwc" event={"ID":"dcd65622-d09b-438f-90bf-9a79360971b7","Type":"ContainerDied","Data":"7aed14f65e88405f0298ea05f3c2ba93b70bdc9ff8f12ccf388c651b553b2b53"}
Jul 20 13:15:05.110348 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:15:05.110322    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29742555-dpmwc"
Jul 20 13:15:05.981327 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:15:05.981301    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29742555-dpmwc"
Jul 20 13:15:05.981327 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:15:05.981305    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29742555-dpmwc" event={"ID":"dcd65622-d09b-438f-90bf-9a79360971b7","Type":"ContainerDied","Data":"cb67ca7082464484e73b5f9a82353d616df9b6f33b27debc4e2f17ed0e663bec"}
Jul 20 13:15:05.981518 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:15:05.981355    2584 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="cb67ca7082464484e73b5f9a82353d616df9b6f33b27debc4e2f17ed0e663bec"
Jul 20 13:15:41.641806 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:15:41.641766    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-78b9bfcd6-64n7t"]
Jul 20 13:15:41.642411 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:15:41.642029    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-78b9bfcd6-64n7t" podUID="26e63a08-fdbc-43f7-9913-7605c4c9602f" containerName="manager" containerID="cri-o://fa03c64c1f441687121bd3ab641b4d1981e40a19ec227f9f4309642a7bfca156" gracePeriod=30
Jul 20 13:15:41.886932 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:15:41.886908    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-78b9bfcd6-64n7t"
Jul 20 13:15:42.027700 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:15:42.027671    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p5f54\" (UniqueName: \"kubernetes.io/projected/26e63a08-fdbc-43f7-9913-7605c4c9602f-kube-api-access-p5f54\") pod \"26e63a08-fdbc-43f7-9913-7605c4c9602f\" (UID: \"26e63a08-fdbc-43f7-9913-7605c4c9602f\") "
Jul 20 13:15:42.027849 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:15:42.027772    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/26e63a08-fdbc-43f7-9913-7605c4c9602f-webhook-cert\") pod \"26e63a08-fdbc-43f7-9913-7605c4c9602f\" (UID: \"26e63a08-fdbc-43f7-9913-7605c4c9602f\") "
Jul 20 13:15:42.029666 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:15:42.029636    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/26e63a08-fdbc-43f7-9913-7605c4c9602f-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "26e63a08-fdbc-43f7-9913-7605c4c9602f" (UID: "26e63a08-fdbc-43f7-9913-7605c4c9602f"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 13:15:42.029776 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:15:42.029709    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/26e63a08-fdbc-43f7-9913-7605c4c9602f-kube-api-access-p5f54" (OuterVolumeSpecName: "kube-api-access-p5f54") pod "26e63a08-fdbc-43f7-9913-7605c4c9602f" (UID: "26e63a08-fdbc-43f7-9913-7605c4c9602f"). InnerVolumeSpecName "kube-api-access-p5f54". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 13:15:42.129150 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:15:42.129127    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p5f54\" (UniqueName: \"kubernetes.io/projected/26e63a08-fdbc-43f7-9913-7605c4c9602f-kube-api-access-p5f54\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 20 13:15:42.129150 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:15:42.129147    2584 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/26e63a08-fdbc-43f7-9913-7605c4c9602f-webhook-cert\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 20 13:15:42.163903 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:15:42.163875    2584 generic.go:356] "Generic (PLEG): container finished" podID="26e63a08-fdbc-43f7-9913-7605c4c9602f" containerID="fa03c64c1f441687121bd3ab641b4d1981e40a19ec227f9f4309642a7bfca156" exitCode=0
Jul 20 13:15:42.164024 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:15:42.163927    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-78b9bfcd6-64n7t"
Jul 20 13:15:42.164024 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:15:42.163937    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-78b9bfcd6-64n7t" event={"ID":"26e63a08-fdbc-43f7-9913-7605c4c9602f","Type":"ContainerDied","Data":"fa03c64c1f441687121bd3ab641b4d1981e40a19ec227f9f4309642a7bfca156"}
Jul 20 13:15:42.164105 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:15:42.164030    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-78b9bfcd6-64n7t" event={"ID":"26e63a08-fdbc-43f7-9913-7605c4c9602f","Type":"ContainerDied","Data":"5e03112d9aa0de0b949fe803e0cb6a3746e1b59454d02df274a84bf76efc0359"}
Jul 20 13:15:42.164105 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:15:42.164058    2584 scope.go:117] "RemoveContainer" containerID="fa03c64c1f441687121bd3ab641b4d1981e40a19ec227f9f4309642a7bfca156"
Jul 20 13:15:42.173507 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:15:42.173492    2584 scope.go:117] "RemoveContainer" containerID="fa03c64c1f441687121bd3ab641b4d1981e40a19ec227f9f4309642a7bfca156"
Jul 20 13:15:42.173744 ip-10-0-134-121 kubenswrapper[2584]: E0720 13:15:42.173727    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fa03c64c1f441687121bd3ab641b4d1981e40a19ec227f9f4309642a7bfca156\": container with ID starting with fa03c64c1f441687121bd3ab641b4d1981e40a19ec227f9f4309642a7bfca156 not found: ID does not exist" containerID="fa03c64c1f441687121bd3ab641b4d1981e40a19ec227f9f4309642a7bfca156"
Jul 20 13:15:42.173791 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:15:42.173750    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fa03c64c1f441687121bd3ab641b4d1981e40a19ec227f9f4309642a7bfca156"} err="failed to get container status \"fa03c64c1f441687121bd3ab641b4d1981e40a19ec227f9f4309642a7bfca156\": rpc error: code = NotFound desc = could not find container \"fa03c64c1f441687121bd3ab641b4d1981e40a19ec227f9f4309642a7bfca156\": container with ID starting with fa03c64c1f441687121bd3ab641b4d1981e40a19ec227f9f4309642a7bfca156 not found: ID does not exist"
Jul 20 13:15:42.184242 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:15:42.184220    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-78b9bfcd6-64n7t"]
Jul 20 13:15:42.187424 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:15:42.187405    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-78b9bfcd6-64n7t"]
Jul 20 13:15:42.836921 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:15:42.836878    2584 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/maas-controller-78b9bfcd6-64n7t" podUID="26e63a08-fdbc-43f7-9913-7605c4c9602f" containerName="manager" probeResult="failure" output="Get \"http://10.134.0.39:8081/readyz\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 20 13:15:42.967560 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:15:42.967528    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-78b9bfcd6-ztpbk"]
Jul 20 13:15:42.968034 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:15:42.968017    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dcd65622-d09b-438f-90bf-9a79360971b7" containerName="cleanup"
Jul 20 13:15:42.968034 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:15:42.968034    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="dcd65622-d09b-438f-90bf-9a79360971b7" containerName="cleanup"
Jul 20 13:15:42.968157 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:15:42.968053    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="26e63a08-fdbc-43f7-9913-7605c4c9602f" containerName="manager"
Jul 20 13:15:42.968157 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:15:42.968062    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="26e63a08-fdbc-43f7-9913-7605c4c9602f" containerName="manager"
Jul 20 13:15:42.968157 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:15:42.968141    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="26e63a08-fdbc-43f7-9913-7605c4c9602f" containerName="manager"
Jul 20 13:15:42.968157 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:15:42.968154    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="dcd65622-d09b-438f-90bf-9a79360971b7" containerName="cleanup"
Jul 20 13:15:42.971284 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:15:42.971269    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-78b9bfcd6-ztpbk"
Jul 20 13:15:42.977799 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:15:42.977772    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 20 13:15:42.977894 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:15:42.977808    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 20 13:15:42.977894 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:15:42.977811    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-b5km6\""
Jul 20 13:15:42.983559 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:15:42.983538    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-78b9bfcd6-ztpbk"]
Jul 20 13:15:43.095909 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:15:43.095836    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="26e63a08-fdbc-43f7-9913-7605c4c9602f" path="/var/lib/kubelet/pods/26e63a08-fdbc-43f7-9913-7605c4c9602f/volumes"
Jul 20 13:15:43.139070 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:15:43.139047    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8jg8d\" (UniqueName: \"kubernetes.io/projected/bf4a9a9d-ad38-43aa-87be-4818eabc0199-kube-api-access-8jg8d\") pod \"maas-controller-78b9bfcd6-ztpbk\" (UID: \"bf4a9a9d-ad38-43aa-87be-4818eabc0199\") " pod="opendatahub/maas-controller-78b9bfcd6-ztpbk"
Jul 20 13:15:43.139171 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:15:43.139089    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/bf4a9a9d-ad38-43aa-87be-4818eabc0199-webhook-cert\") pod \"maas-controller-78b9bfcd6-ztpbk\" (UID: \"bf4a9a9d-ad38-43aa-87be-4818eabc0199\") " pod="opendatahub/maas-controller-78b9bfcd6-ztpbk"
Jul 20 13:15:43.240322 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:15:43.240293    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8jg8d\" (UniqueName: \"kubernetes.io/projected/bf4a9a9d-ad38-43aa-87be-4818eabc0199-kube-api-access-8jg8d\") pod \"maas-controller-78b9bfcd6-ztpbk\" (UID: \"bf4a9a9d-ad38-43aa-87be-4818eabc0199\") " pod="opendatahub/maas-controller-78b9bfcd6-ztpbk"
Jul 20 13:15:43.240438 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:15:43.240340    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/bf4a9a9d-ad38-43aa-87be-4818eabc0199-webhook-cert\") pod \"maas-controller-78b9bfcd6-ztpbk\" (UID: \"bf4a9a9d-ad38-43aa-87be-4818eabc0199\") " pod="opendatahub/maas-controller-78b9bfcd6-ztpbk"
Jul 20 13:15:43.242662 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:15:43.242641    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/bf4a9a9d-ad38-43aa-87be-4818eabc0199-webhook-cert\") pod \"maas-controller-78b9bfcd6-ztpbk\" (UID: \"bf4a9a9d-ad38-43aa-87be-4818eabc0199\") " pod="opendatahub/maas-controller-78b9bfcd6-ztpbk"
Jul 20 13:15:43.251355 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:15:43.251327    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8jg8d\" (UniqueName: \"kubernetes.io/projected/bf4a9a9d-ad38-43aa-87be-4818eabc0199-kube-api-access-8jg8d\") pod \"maas-controller-78b9bfcd6-ztpbk\" (UID: \"bf4a9a9d-ad38-43aa-87be-4818eabc0199\") " pod="opendatahub/maas-controller-78b9bfcd6-ztpbk"
Jul 20 13:15:43.281320 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:15:43.281297    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-78b9bfcd6-ztpbk"
Jul 20 13:15:43.413927 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:15:43.413904    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-78b9bfcd6-ztpbk"]
Jul 20 13:15:43.415946 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:15:43.415916    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbf4a9a9d_ad38_43aa_87be_4818eabc0199.slice/crio-7ee61fb1f3ade2c4cf1e4506dc816f1cf1fed1d9b1ef3ac5e66eb78f4e9563fd WatchSource:0}: Error finding container 7ee61fb1f3ade2c4cf1e4506dc816f1cf1fed1d9b1ef3ac5e66eb78f4e9563fd: Status 404 returned error can't find the container with id 7ee61fb1f3ade2c4cf1e4506dc816f1cf1fed1d9b1ef3ac5e66eb78f4e9563fd
Jul 20 13:15:44.176488 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:15:44.176453    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-78b9bfcd6-ztpbk" event={"ID":"bf4a9a9d-ad38-43aa-87be-4818eabc0199","Type":"ContainerStarted","Data":"3f0351f69aba1b52f0867c2c9f7c78f98cde116ebbd2b2068b7bec1d5ee61724"}
Jul 20 13:15:44.176888 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:15:44.176504    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-78b9bfcd6-ztpbk" event={"ID":"bf4a9a9d-ad38-43aa-87be-4818eabc0199","Type":"ContainerStarted","Data":"7ee61fb1f3ade2c4cf1e4506dc816f1cf1fed1d9b1ef3ac5e66eb78f4e9563fd"}
Jul 20 13:15:44.176888 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:15:44.176530    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-78b9bfcd6-ztpbk"
Jul 20 13:15:44.196434 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:15:44.196391    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-78b9bfcd6-ztpbk" podStartSLOduration=1.617060471 podStartE2EDuration="2.196377553s" totalImagesPullingTime="579.317082ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 13:15:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 13:15:44.194267831 +0000 UTC m=+833.910815251" watchObservedRunningTime="2026-07-20 13:15:44.196377553 +0000 UTC m=+833.912924962"
Jul 20 13:15:55.182899 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:15:55.182872    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-78b9bfcd6-ztpbk"
Jul 20 13:28:11.893441 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:28:11.893409    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-7291c4b7-openshift-default-7f9b9c497c-jj44x"]
Jul 20 13:28:11.896639 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:28:11.896622    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-7291c4b7-openshift-default-7f9b9c497c-jj44x"
Jul 20 13:28:11.900452 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:28:11.900424    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-7291c4b7-openshift-default-dockercfg-k52td\""
Jul 20 13:28:11.913915 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:28:11.913888    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-7291c4b7-openshift-default-7f9b9c497c-jj44x"]
Jul 20 13:28:11.971378 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:28:11.971345    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ee15f478-f6cf-47fd-a955-ef2e99dbda48-istio-envoy\") pod \"e2e-ait-7291c4b7-openshift-default-7f9b9c497c-jj44x\" (UID: \"ee15f478-f6cf-47fd-a955-ef2e99dbda48\") " pod="openshift-ingress/e2e-ait-7291c4b7-openshift-default-7f9b9c497c-jj44x"
Jul 20 13:28:11.971378 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:28:11.971382    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ee15f478-f6cf-47fd-a955-ef2e99dbda48-credential-socket\") pod \"e2e-ait-7291c4b7-openshift-default-7f9b9c497c-jj44x\" (UID: \"ee15f478-f6cf-47fd-a955-ef2e99dbda48\") " pod="openshift-ingress/e2e-ait-7291c4b7-openshift-default-7f9b9c497c-jj44x"
Jul 20 13:28:11.971568 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:28:11.971436    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ee15f478-f6cf-47fd-a955-ef2e99dbda48-istiod-ca-cert\") pod \"e2e-ait-7291c4b7-openshift-default-7f9b9c497c-jj44x\" (UID: \"ee15f478-f6cf-47fd-a955-ef2e99dbda48\") " pod="openshift-ingress/e2e-ait-7291c4b7-openshift-default-7f9b9c497c-jj44x"
Jul 20 13:28:11.971568 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:28:11.971460    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ee15f478-f6cf-47fd-a955-ef2e99dbda48-istio-data\") pod \"e2e-ait-7291c4b7-openshift-default-7f9b9c497c-jj44x\" (UID: \"ee15f478-f6cf-47fd-a955-ef2e99dbda48\") " pod="openshift-ingress/e2e-ait-7291c4b7-openshift-default-7f9b9c497c-jj44x"
Jul 20 13:28:11.971568 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:28:11.971497    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4bv4l\" (UniqueName: \"kubernetes.io/projected/ee15f478-f6cf-47fd-a955-ef2e99dbda48-kube-api-access-4bv4l\") pod \"e2e-ait-7291c4b7-openshift-default-7f9b9c497c-jj44x\" (UID: \"ee15f478-f6cf-47fd-a955-ef2e99dbda48\") " pod="openshift-ingress/e2e-ait-7291c4b7-openshift-default-7f9b9c497c-jj44x"
Jul 20 13:28:11.971568 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:28:11.971522    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ee15f478-f6cf-47fd-a955-ef2e99dbda48-istio-podinfo\") pod \"e2e-ait-7291c4b7-openshift-default-7f9b9c497c-jj44x\" (UID: \"ee15f478-f6cf-47fd-a955-ef2e99dbda48\") " pod="openshift-ingress/e2e-ait-7291c4b7-openshift-default-7f9b9c497c-jj44x"
Jul 20 13:28:11.971568 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:28:11.971544    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ee15f478-f6cf-47fd-a955-ef2e99dbda48-workload-certs\") pod \"e2e-ait-7291c4b7-openshift-default-7f9b9c497c-jj44x\" (UID: \"ee15f478-f6cf-47fd-a955-ef2e99dbda48\") " pod="openshift-ingress/e2e-ait-7291c4b7-openshift-default-7f9b9c497c-jj44x"
Jul 20 13:28:11.971568 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:28:11.971566    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ee15f478-f6cf-47fd-a955-ef2e99dbda48-istio-token\") pod \"e2e-ait-7291c4b7-openshift-default-7f9b9c497c-jj44x\" (UID: \"ee15f478-f6cf-47fd-a955-ef2e99dbda48\") " pod="openshift-ingress/e2e-ait-7291c4b7-openshift-default-7f9b9c497c-jj44x"
Jul 20 13:28:11.971746 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:28:11.971592    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ee15f478-f6cf-47fd-a955-ef2e99dbda48-workload-socket\") pod \"e2e-ait-7291c4b7-openshift-default-7f9b9c497c-jj44x\" (UID: \"ee15f478-f6cf-47fd-a955-ef2e99dbda48\") " pod="openshift-ingress/e2e-ait-7291c4b7-openshift-default-7f9b9c497c-jj44x"
Jul 20 13:28:12.072520 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:28:12.072486    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ee15f478-f6cf-47fd-a955-ef2e99dbda48-workload-certs\") pod \"e2e-ait-7291c4b7-openshift-default-7f9b9c497c-jj44x\" (UID: \"ee15f478-f6cf-47fd-a955-ef2e99dbda48\") " pod="openshift-ingress/e2e-ait-7291c4b7-openshift-default-7f9b9c497c-jj44x"
Jul 20 13:28:12.072689 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:28:12.072528    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ee15f478-f6cf-47fd-a955-ef2e99dbda48-istio-token\") pod \"e2e-ait-7291c4b7-openshift-default-7f9b9c497c-jj44x\" (UID: \"ee15f478-f6cf-47fd-a955-ef2e99dbda48\") " pod="openshift-ingress/e2e-ait-7291c4b7-openshift-default-7f9b9c497c-jj44x"
Jul 20 13:28:12.072689 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:28:12.072557    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ee15f478-f6cf-47fd-a955-ef2e99dbda48-workload-socket\") pod \"e2e-ait-7291c4b7-openshift-default-7f9b9c497c-jj44x\" (UID: \"ee15f478-f6cf-47fd-a955-ef2e99dbda48\") " pod="openshift-ingress/e2e-ait-7291c4b7-openshift-default-7f9b9c497c-jj44x"
Jul 20 13:28:12.072689 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:28:12.072618    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ee15f478-f6cf-47fd-a955-ef2e99dbda48-istio-envoy\") pod \"e2e-ait-7291c4b7-openshift-default-7f9b9c497c-jj44x\" (UID: \"ee15f478-f6cf-47fd-a955-ef2e99dbda48\") " pod="openshift-ingress/e2e-ait-7291c4b7-openshift-default-7f9b9c497c-jj44x"
Jul 20 13:28:12.072689 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:28:12.072646    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ee15f478-f6cf-47fd-a955-ef2e99dbda48-credential-socket\") pod \"e2e-ait-7291c4b7-openshift-default-7f9b9c497c-jj44x\" (UID: \"ee15f478-f6cf-47fd-a955-ef2e99dbda48\") " pod="openshift-ingress/e2e-ait-7291c4b7-openshift-default-7f9b9c497c-jj44x"
Jul 20 13:28:12.072869 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:28:12.072696    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ee15f478-f6cf-47fd-a955-ef2e99dbda48-istiod-ca-cert\") pod \"e2e-ait-7291c4b7-openshift-default-7f9b9c497c-jj44x\" (UID: \"ee15f478-f6cf-47fd-a955-ef2e99dbda48\") " pod="openshift-ingress/e2e-ait-7291c4b7-openshift-default-7f9b9c497c-jj44x"
Jul 20 13:28:12.072869 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:28:12.072726    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ee15f478-f6cf-47fd-a955-ef2e99dbda48-istio-data\") pod \"e2e-ait-7291c4b7-openshift-default-7f9b9c497c-jj44x\" (UID: \"ee15f478-f6cf-47fd-a955-ef2e99dbda48\") " pod="openshift-ingress/e2e-ait-7291c4b7-openshift-default-7f9b9c497c-jj44x"
Jul 20 13:28:12.072869 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:28:12.072781    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4bv4l\" (UniqueName: \"kubernetes.io/projected/ee15f478-f6cf-47fd-a955-ef2e99dbda48-kube-api-access-4bv4l\") pod \"e2e-ait-7291c4b7-openshift-default-7f9b9c497c-jj44x\" (UID: \"ee15f478-f6cf-47fd-a955-ef2e99dbda48\") " pod="openshift-ingress/e2e-ait-7291c4b7-openshift-default-7f9b9c497c-jj44x"
Jul 20 13:28:12.072869 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:28:12.072812    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ee15f478-f6cf-47fd-a955-ef2e99dbda48-istio-podinfo\") pod \"e2e-ait-7291c4b7-openshift-default-7f9b9c497c-jj44x\" (UID: \"ee15f478-f6cf-47fd-a955-ef2e99dbda48\") " pod="openshift-ingress/e2e-ait-7291c4b7-openshift-default-7f9b9c497c-jj44x"
Jul 20 13:28:12.073096 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:28:12.072902    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ee15f478-f6cf-47fd-a955-ef2e99dbda48-workload-certs\") pod \"e2e-ait-7291c4b7-openshift-default-7f9b9c497c-jj44x\" (UID: \"ee15f478-f6cf-47fd-a955-ef2e99dbda48\") " pod="openshift-ingress/e2e-ait-7291c4b7-openshift-default-7f9b9c497c-jj44x"
Jul 20 13:28:12.073096 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:28:12.073051    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ee15f478-f6cf-47fd-a955-ef2e99dbda48-workload-socket\") pod \"e2e-ait-7291c4b7-openshift-default-7f9b9c497c-jj44x\" (UID: \"ee15f478-f6cf-47fd-a955-ef2e99dbda48\") " pod="openshift-ingress/e2e-ait-7291c4b7-openshift-default-7f9b9c497c-jj44x"
Jul 20 13:28:12.073394 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:28:12.073368    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ee15f478-f6cf-47fd-a955-ef2e99dbda48-istio-data\") pod \"e2e-ait-7291c4b7-openshift-default-7f9b9c497c-jj44x\" (UID: \"ee15f478-f6cf-47fd-a955-ef2e99dbda48\") " pod="openshift-ingress/e2e-ait-7291c4b7-openshift-default-7f9b9c497c-jj44x"
Jul 20 13:28:12.073394 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:28:12.073381    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ee15f478-f6cf-47fd-a955-ef2e99dbda48-istiod-ca-cert\") pod \"e2e-ait-7291c4b7-openshift-default-7f9b9c497c-jj44x\" (UID: \"ee15f478-f6cf-47fd-a955-ef2e99dbda48\") " pod="openshift-ingress/e2e-ait-7291c4b7-openshift-default-7f9b9c497c-jj44x"
Jul 20 13:28:12.073510 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:28:12.073376    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ee15f478-f6cf-47fd-a955-ef2e99dbda48-credential-socket\") pod \"e2e-ait-7291c4b7-openshift-default-7f9b9c497c-jj44x\" (UID: \"ee15f478-f6cf-47fd-a955-ef2e99dbda48\") " pod="openshift-ingress/e2e-ait-7291c4b7-openshift-default-7f9b9c497c-jj44x"
Jul 20 13:28:12.074859 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:28:12.074841    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ee15f478-f6cf-47fd-a955-ef2e99dbda48-istio-envoy\") pod \"e2e-ait-7291c4b7-openshift-default-7f9b9c497c-jj44x\" (UID: \"ee15f478-f6cf-47fd-a955-ef2e99dbda48\") " pod="openshift-ingress/e2e-ait-7291c4b7-openshift-default-7f9b9c497c-jj44x"
Jul 20 13:28:12.075145 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:28:12.075129    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ee15f478-f6cf-47fd-a955-ef2e99dbda48-istio-podinfo\") pod \"e2e-ait-7291c4b7-openshift-default-7f9b9c497c-jj44x\" (UID: \"ee15f478-f6cf-47fd-a955-ef2e99dbda48\") " pod="openshift-ingress/e2e-ait-7291c4b7-openshift-default-7f9b9c497c-jj44x"
Jul 20 13:28:12.081217 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:28:12.081197    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ee15f478-f6cf-47fd-a955-ef2e99dbda48-istio-token\") pod \"e2e-ait-7291c4b7-openshift-default-7f9b9c497c-jj44x\" (UID: \"ee15f478-f6cf-47fd-a955-ef2e99dbda48\") " pod="openshift-ingress/e2e-ait-7291c4b7-openshift-default-7f9b9c497c-jj44x"
Jul 20 13:28:12.083629 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:28:12.083606    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4bv4l\" (UniqueName: \"kubernetes.io/projected/ee15f478-f6cf-47fd-a955-ef2e99dbda48-kube-api-access-4bv4l\") pod \"e2e-ait-7291c4b7-openshift-default-7f9b9c497c-jj44x\" (UID: \"ee15f478-f6cf-47fd-a955-ef2e99dbda48\") " pod="openshift-ingress/e2e-ait-7291c4b7-openshift-default-7f9b9c497c-jj44x"
Jul 20 13:28:12.207830 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:28:12.207744    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-7291c4b7-openshift-default-7f9b9c497c-jj44x"
Jul 20 13:28:12.353090 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:28:12.353066    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-7291c4b7-openshift-default-7f9b9c497c-jj44x"]
Jul 20 13:28:12.355946 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:28:12.355919    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podee15f478_f6cf_47fd_a955_ef2e99dbda48.slice/crio-0ec7db847db88d5248e9a99f9e7d506b0a42b3557e1f944809f4846f51ce7575 WatchSource:0}: Error finding container 0ec7db847db88d5248e9a99f9e7d506b0a42b3557e1f944809f4846f51ce7575: Status 404 returned error can't find the container with id 0ec7db847db88d5248e9a99f9e7d506b0a42b3557e1f944809f4846f51ce7575
Jul 20 13:28:12.358099 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:28:12.358057    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 20 13:28:12.358175 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:28:12.358146    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 20 13:28:12.358365 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:28:12.358188    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 20 13:28:12.925263 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:28:12.925230    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-7291c4b7-openshift-default-7f9b9c497c-jj44x" event={"ID":"ee15f478-f6cf-47fd-a955-ef2e99dbda48","Type":"ContainerStarted","Data":"7546689dc61ddf7e9bee57e55314eddeb177adadc15e8796c30cdbf9a0c22443"}
Jul 20 13:28:12.925664 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:28:12.925283    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-7291c4b7-openshift-default-7f9b9c497c-jj44x" event={"ID":"ee15f478-f6cf-47fd-a955-ef2e99dbda48","Type":"ContainerStarted","Data":"0ec7db847db88d5248e9a99f9e7d506b0a42b3557e1f944809f4846f51ce7575"}
Jul 20 13:28:12.949929 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:28:12.949882    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-7291c4b7-openshift-default-7f9b9c497c-jj44x" podStartSLOduration=1.949867975 podStartE2EDuration="1.949867975s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 13:28:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 13:28:12.947571873 +0000 UTC m=+1582.664119282" watchObservedRunningTime="2026-07-20 13:28:12.949867975 +0000 UTC m=+1582.666415384"
Jul 20 13:28:13.208463 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:28:13.208380    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-7291c4b7-openshift-default-7f9b9c497c-jj44x"
Jul 20 13:28:13.213154 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:28:13.213130    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-7291c4b7-openshift-default-7f9b9c497c-jj44x"
Jul 20 13:28:13.464848 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:28:13.464772    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-7291c4b7-85689bfc8d-rn5t7"]
Jul 20 13:28:13.468522 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:28:13.468501    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-7291c4b7-85689bfc8d-rn5t7"
Jul 20 13:28:13.472246 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:28:13.472227    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-vf2sw\""
Jul 20 13:28:13.473648 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:28:13.473632    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-7291c4b7-serving-cert\""
Jul 20 13:28:13.485514 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:28:13.485477    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fee8a84b-f10c-4011-8525-9c09371feca8-maas-api-tls\") pod \"maas-api-e2e-ait-7291c4b7-85689bfc8d-rn5t7\" (UID: \"fee8a84b-f10c-4011-8525-9c09371feca8\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-7291c4b7-85689bfc8d-rn5t7"
Jul 20 13:28:13.485618 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:28:13.485554    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tp5kh\" (UniqueName: \"kubernetes.io/projected/fee8a84b-f10c-4011-8525-9c09371feca8-kube-api-access-tp5kh\") pod \"maas-api-e2e-ait-7291c4b7-85689bfc8d-rn5t7\" (UID: \"fee8a84b-f10c-4011-8525-9c09371feca8\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-7291c4b7-85689bfc8d-rn5t7"
Jul 20 13:28:13.485682 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:28:13.485622    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fee8a84b-f10c-4011-8525-9c09371feca8-openshift-service-ca\") pod \"maas-api-e2e-ait-7291c4b7-85689bfc8d-rn5t7\" (UID: \"fee8a84b-f10c-4011-8525-9c09371feca8\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-7291c4b7-85689bfc8d-rn5t7"
Jul 20 13:28:13.496149 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:28:13.496127    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-7291c4b7-85689bfc8d-rn5t7"]
Jul 20 13:28:13.586548 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:28:13.586517    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tp5kh\" (UniqueName: \"kubernetes.io/projected/fee8a84b-f10c-4011-8525-9c09371feca8-kube-api-access-tp5kh\") pod \"maas-api-e2e-ait-7291c4b7-85689bfc8d-rn5t7\" (UID: \"fee8a84b-f10c-4011-8525-9c09371feca8\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-7291c4b7-85689bfc8d-rn5t7"
Jul 20 13:28:13.586724 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:28:13.586594    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fee8a84b-f10c-4011-8525-9c09371feca8-openshift-service-ca\") pod \"maas-api-e2e-ait-7291c4b7-85689bfc8d-rn5t7\" (UID: \"fee8a84b-f10c-4011-8525-9c09371feca8\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-7291c4b7-85689bfc8d-rn5t7"
Jul 20 13:28:13.586724 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:28:13.586699    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fee8a84b-f10c-4011-8525-9c09371feca8-maas-api-tls\") pod \"maas-api-e2e-ait-7291c4b7-85689bfc8d-rn5t7\" (UID: \"fee8a84b-f10c-4011-8525-9c09371feca8\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-7291c4b7-85689bfc8d-rn5t7"
Jul 20 13:28:13.586847 ip-10-0-134-121 kubenswrapper[2584]: E0720 13:28:13.586802    2584 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-7291c4b7-serving-cert: secret "maas-api-e2e-ait-7291c4b7-serving-cert" not found
Jul 20 13:28:13.586908 ip-10-0-134-121 kubenswrapper[2584]: E0720 13:28:13.586858    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fee8a84b-f10c-4011-8525-9c09371feca8-maas-api-tls podName:fee8a84b-f10c-4011-8525-9c09371feca8 nodeName:}" failed. No retries permitted until 2026-07-20 13:28:14.086841668 +0000 UTC m=+1583.803389070 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/fee8a84b-f10c-4011-8525-9c09371feca8-maas-api-tls") pod "maas-api-e2e-ait-7291c4b7-85689bfc8d-rn5t7" (UID: "fee8a84b-f10c-4011-8525-9c09371feca8") : secret "maas-api-e2e-ait-7291c4b7-serving-cert" not found
Jul 20 13:28:13.587291 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:28:13.587268    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fee8a84b-f10c-4011-8525-9c09371feca8-openshift-service-ca\") pod \"maas-api-e2e-ait-7291c4b7-85689bfc8d-rn5t7\" (UID: \"fee8a84b-f10c-4011-8525-9c09371feca8\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-7291c4b7-85689bfc8d-rn5t7"
Jul 20 13:28:13.609373 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:28:13.609341    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tp5kh\" (UniqueName: \"kubernetes.io/projected/fee8a84b-f10c-4011-8525-9c09371feca8-kube-api-access-tp5kh\") pod \"maas-api-e2e-ait-7291c4b7-85689bfc8d-rn5t7\" (UID: \"fee8a84b-f10c-4011-8525-9c09371feca8\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-7291c4b7-85689bfc8d-rn5t7"
Jul 20 13:28:13.930649 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:28:13.930619    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-7291c4b7-openshift-default-7f9b9c497c-jj44x"
Jul 20 13:28:13.931546 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:28:13.931529    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-7291c4b7-openshift-default-7f9b9c497c-jj44x"
Jul 20 13:28:14.092010 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:28:14.091959    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fee8a84b-f10c-4011-8525-9c09371feca8-maas-api-tls\") pod \"maas-api-e2e-ait-7291c4b7-85689bfc8d-rn5t7\" (UID: \"fee8a84b-f10c-4011-8525-9c09371feca8\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-7291c4b7-85689bfc8d-rn5t7"
Jul 20 13:28:14.094255 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:28:14.094230    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fee8a84b-f10c-4011-8525-9c09371feca8-maas-api-tls\") pod \"maas-api-e2e-ait-7291c4b7-85689bfc8d-rn5t7\" (UID: \"fee8a84b-f10c-4011-8525-9c09371feca8\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-7291c4b7-85689bfc8d-rn5t7"
Jul 20 13:28:14.379206 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:28:14.379173    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-7291c4b7-85689bfc8d-rn5t7"
Jul 20 13:28:14.537338 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:28:14.537128    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-7291c4b7-85689bfc8d-rn5t7"]
Jul 20 13:28:14.539625 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:28:14.539593    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfee8a84b_f10c_4011_8525_9c09371feca8.slice/crio-3c9aa8ca26bc6617ab535d1fb5d18ba22393783bec98a8b8df4e2a2b10ea6154 WatchSource:0}: Error finding container 3c9aa8ca26bc6617ab535d1fb5d18ba22393783bec98a8b8df4e2a2b10ea6154: Status 404 returned error can't find the container with id 3c9aa8ca26bc6617ab535d1fb5d18ba22393783bec98a8b8df4e2a2b10ea6154
Jul 20 13:28:14.541142 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:28:14.541123    2584 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 20 13:28:14.936052 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:28:14.936008    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-7291c4b7-85689bfc8d-rn5t7" event={"ID":"fee8a84b-f10c-4011-8525-9c09371feca8","Type":"ContainerStarted","Data":"3c9aa8ca26bc6617ab535d1fb5d18ba22393783bec98a8b8df4e2a2b10ea6154"}
Jul 20 13:28:15.942369 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:28:15.942271    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-7291c4b7-85689bfc8d-rn5t7" event={"ID":"fee8a84b-f10c-4011-8525-9c09371feca8","Type":"ContainerStarted","Data":"a3f3e625c9193b329ab65af7a53f5af7383c27607023557447ca7bc994552e04"}
Jul 20 13:28:15.942750 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:28:15.942415    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-7291c4b7-85689bfc8d-rn5t7"
Jul 20 13:28:15.960317 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:28:15.960273    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-7291c4b7-85689bfc8d-rn5t7" podStartSLOduration=2.254549453 podStartE2EDuration="2.960259648s" totalImagesPullingTime="705.710195ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 13:28:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 13:28:15.958394854 +0000 UTC m=+1585.674942274" watchObservedRunningTime="2026-07-20 13:28:15.960259648 +0000 UTC m=+1585.676807057"
Jul 20 13:28:21.952760 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:28:21.952723    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-7291c4b7-85689bfc8d-rn5t7"
Jul 20 13:28:28.839603 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:28:28.839521    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-7291c4b7-85689bfc8d-rn5t7"]
Jul 20 13:28:28.840020 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:28:28.839743    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-7291c4b7-85689bfc8d-rn5t7" podUID="fee8a84b-f10c-4011-8525-9c09371feca8" containerName="maas-api" containerID="cri-o://a3f3e625c9193b329ab65af7a53f5af7383c27607023557447ca7bc994552e04" gracePeriod=30
Jul 20 13:28:28.932038 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:28:28.932013    2584 patch_prober.go:28] interesting pod/e2e-ait-7291c4b7-openshift-default-7f9b9c497c-jj44x container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused" start-of-body=
Jul 20 13:28:28.932145 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:28:28.932073    2584 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-7291c4b7-openshift-default-7f9b9c497c-jj44x" podUID="ee15f478-f6cf-47fd-a955-ef2e99dbda48" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused"
Jul 20 13:28:29.012340 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:28:29.012307    2584 generic.go:356] "Generic (PLEG): container finished" podID="ee15f478-f6cf-47fd-a955-ef2e99dbda48" containerID="7546689dc61ddf7e9bee57e55314eddeb177adadc15e8796c30cdbf9a0c22443" exitCode=0
Jul 20 13:28:29.012481 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:28:29.012380    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-7291c4b7-openshift-default-7f9b9c497c-jj44x" event={"ID":"ee15f478-f6cf-47fd-a955-ef2e99dbda48","Type":"ContainerDied","Data":"7546689dc61ddf7e9bee57e55314eddeb177adadc15e8796c30cdbf9a0c22443"}
Jul 20 13:28:29.012918 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:28:29.012897    2584 scope.go:117] "RemoveContainer" containerID="7546689dc61ddf7e9bee57e55314eddeb177adadc15e8796c30cdbf9a0c22443"
Jul 20 13:28:29.014342 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:28:29.014309    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 20 13:28:29.014525 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:28:29.014503    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 20 13:28:29.014646 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:28:29.014627    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 20 13:28:29.014721 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:28:29.014648    2584 generic.go:356] "Generic (PLEG): container finished" podID="fee8a84b-f10c-4011-8525-9c09371feca8" containerID="a3f3e625c9193b329ab65af7a53f5af7383c27607023557447ca7bc994552e04" exitCode=0
Jul 20 13:28:29.014721 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:28:29.014706    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-7291c4b7-85689bfc8d-rn5t7" event={"ID":"fee8a84b-f10c-4011-8525-9c09371feca8","Type":"ContainerDied","Data":"a3f3e625c9193b329ab65af7a53f5af7383c27607023557447ca7bc994552e04"}
Jul 20 13:28:29.105904 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:28:29.105848    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-7291c4b7-85689bfc8d-rn5t7"
Jul 20 13:28:29.238275 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:28:29.238247    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fee8a84b-f10c-4011-8525-9c09371feca8-openshift-service-ca\") pod \"fee8a84b-f10c-4011-8525-9c09371feca8\" (UID: \"fee8a84b-f10c-4011-8525-9c09371feca8\") "
Jul 20 13:28:29.238455 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:28:29.238442    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tp5kh\" (UniqueName: \"kubernetes.io/projected/fee8a84b-f10c-4011-8525-9c09371feca8-kube-api-access-tp5kh\") pod \"fee8a84b-f10c-4011-8525-9c09371feca8\" (UID: \"fee8a84b-f10c-4011-8525-9c09371feca8\") "
Jul 20 13:28:29.238515 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:28:29.238477    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fee8a84b-f10c-4011-8525-9c09371feca8-maas-api-tls\") pod \"fee8a84b-f10c-4011-8525-9c09371feca8\" (UID: \"fee8a84b-f10c-4011-8525-9c09371feca8\") "
Jul 20 13:28:29.238742 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:28:29.238659    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fee8a84b-f10c-4011-8525-9c09371feca8-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "fee8a84b-f10c-4011-8525-9c09371feca8" (UID: "fee8a84b-f10c-4011-8525-9c09371feca8"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 13:28:29.238861 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:28:29.238842    2584 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fee8a84b-f10c-4011-8525-9c09371feca8-openshift-service-ca\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 20 13:28:29.240636 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:28:29.240608    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fee8a84b-f10c-4011-8525-9c09371feca8-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "fee8a84b-f10c-4011-8525-9c09371feca8" (UID: "fee8a84b-f10c-4011-8525-9c09371feca8"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 13:28:29.240747 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:28:29.240689    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fee8a84b-f10c-4011-8525-9c09371feca8-kube-api-access-tp5kh" (OuterVolumeSpecName: "kube-api-access-tp5kh") pod "fee8a84b-f10c-4011-8525-9c09371feca8" (UID: "fee8a84b-f10c-4011-8525-9c09371feca8"). InnerVolumeSpecName "kube-api-access-tp5kh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 13:28:29.339842 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:28:29.339815    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tp5kh\" (UniqueName: \"kubernetes.io/projected/fee8a84b-f10c-4011-8525-9c09371feca8-kube-api-access-tp5kh\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 20 13:28:29.339842 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:28:29.339841    2584 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fee8a84b-f10c-4011-8525-9c09371feca8-maas-api-tls\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 20 13:28:30.021905 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:28:30.021868    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-7291c4b7-openshift-default-7f9b9c497c-jj44x" event={"ID":"ee15f478-f6cf-47fd-a955-ef2e99dbda48","Type":"ContainerStarted","Data":"30701f3a01bedbd6d991d1902bdc4ea23237b8e8d607ba80ee70e65389f64edf"}
Jul 20 13:28:30.023118 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:28:30.023092    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-7291c4b7-85689bfc8d-rn5t7"
Jul 20 13:28:30.023262 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:28:30.023112    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-7291c4b7-85689bfc8d-rn5t7" event={"ID":"fee8a84b-f10c-4011-8525-9c09371feca8","Type":"ContainerDied","Data":"3c9aa8ca26bc6617ab535d1fb5d18ba22393783bec98a8b8df4e2a2b10ea6154"}
Jul 20 13:28:30.023262 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:28:30.023173    2584 scope.go:117] "RemoveContainer" containerID="a3f3e625c9193b329ab65af7a53f5af7383c27607023557447ca7bc994552e04"
Jul 20 13:28:30.066423 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:28:30.065430    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-7291c4b7-85689bfc8d-rn5t7"]
Jul 20 13:28:30.066423 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:28:30.065488    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-7291c4b7-85689bfc8d-rn5t7"]
Jul 20 13:28:30.208076 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:28:30.208041    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-7291c4b7-openshift-default-7f9b9c497c-jj44x"
Jul 20 13:28:30.208332 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:28:30.208310    2584 patch_prober.go:28] interesting pod/e2e-ait-7291c4b7-openshift-default-7f9b9c497c-jj44x container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused" start-of-body=
Jul 20 13:28:30.208380 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:28:30.208360    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-7291c4b7-openshift-default-7f9b9c497c-jj44x" podUID="ee15f478-f6cf-47fd-a955-ef2e99dbda48" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused"
Jul 20 13:28:31.096865 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:28:31.096833    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fee8a84b-f10c-4011-8525-9c09371feca8" path="/var/lib/kubelet/pods/fee8a84b-f10c-4011-8525-9c09371feca8/volumes"
Jul 20 13:28:31.208463 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:28:31.208433    2584 patch_prober.go:28] interesting pod/e2e-ait-7291c4b7-openshift-default-7f9b9c497c-jj44x container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused" start-of-body=
Jul 20 13:28:31.208623 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:28:31.208481    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-7291c4b7-openshift-default-7f9b9c497c-jj44x" podUID="ee15f478-f6cf-47fd-a955-ef2e99dbda48" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused"
Jul 20 13:28:32.208768 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:28:32.208733    2584 patch_prober.go:28] interesting pod/e2e-ait-7291c4b7-openshift-default-7f9b9c497c-jj44x container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused" start-of-body=
Jul 20 13:28:32.209168 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:28:32.208785    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-7291c4b7-openshift-default-7f9b9c497c-jj44x" podUID="ee15f478-f6cf-47fd-a955-ef2e99dbda48" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused"
Jul 20 13:28:33.208984 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:28:33.208929    2584 patch_prober.go:28] interesting pod/e2e-ait-7291c4b7-openshift-default-7f9b9c497c-jj44x container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused" start-of-body=
Jul 20 13:28:33.209351 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:28:33.209008    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-7291c4b7-openshift-default-7f9b9c497c-jj44x" podUID="ee15f478-f6cf-47fd-a955-ef2e99dbda48" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused"
Jul 20 13:28:34.212145 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:28:34.212115    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-7291c4b7-openshift-default-7f9b9c497c-jj44x"
Jul 20 13:28:34.212515 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:28:34.212498    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-7291c4b7-openshift-default-7f9b9c497c-jj44x"
Jul 20 13:28:34.213192 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:28:34.213173    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-7291c4b7-openshift-default-7f9b9c497c-jj44x"
Jul 20 13:28:43.537703 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:28:43.537619    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-7291c4b7-openshift-default-7f9b9c497c-jj44x"]
Jul 20 13:28:43.538230 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:28:43.537863    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-7291c4b7-openshift-default-7f9b9c497c-jj44x" podUID="ee15f478-f6cf-47fd-a955-ef2e99dbda48" containerName="istio-proxy" containerID="cri-o://30701f3a01bedbd6d991d1902bdc4ea23237b8e8d607ba80ee70e65389f64edf" gracePeriod=30
Jul 20 13:28:44.115568 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:28:44.115533    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-migrate-dc1ba087-gw-openshift-default-754cbcbfd7-kf9qr"]
Jul 20 13:28:44.116274 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:28:44.116248    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fee8a84b-f10c-4011-8525-9c09371feca8" containerName="maas-api"
Jul 20 13:28:44.116274 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:28:44.116274    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="fee8a84b-f10c-4011-8525-9c09371feca8" containerName="maas-api"
Jul 20 13:28:44.116456 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:28:44.116391    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="fee8a84b-f10c-4011-8525-9c09371feca8" containerName="maas-api"
Jul 20 13:28:44.119641 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:28:44.119619    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-dc1ba087-gw-openshift-default-754cbcbfd7-kf9qr"
Jul 20 13:28:44.121715 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:28:44.121686    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-migrate-dc1ba087-gw-openshift-default-dockercfg-ztzt8\""
Jul 20 13:28:44.130793 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:28:44.130771    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-dc1ba087-gw-openshift-default-754cbcbfd7-kf9qr"]
Jul 20 13:28:44.279729 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:28:44.279697    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/901c1746-cdcc-45f2-8e03-d74fd51e3521-workload-socket\") pod \"e2e-migrate-dc1ba087-gw-openshift-default-754cbcbfd7-kf9qr\" (UID: \"901c1746-cdcc-45f2-8e03-d74fd51e3521\") " pod="openshift-ingress/e2e-migrate-dc1ba087-gw-openshift-default-754cbcbfd7-kf9qr"
Jul 20 13:28:44.279900 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:28:44.279758    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/901c1746-cdcc-45f2-8e03-d74fd51e3521-istio-token\") pod \"e2e-migrate-dc1ba087-gw-openshift-default-754cbcbfd7-kf9qr\" (UID: \"901c1746-cdcc-45f2-8e03-d74fd51e3521\") " pod="openshift-ingress/e2e-migrate-dc1ba087-gw-openshift-default-754cbcbfd7-kf9qr"
Jul 20 13:28:44.279900 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:28:44.279810    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/901c1746-cdcc-45f2-8e03-d74fd51e3521-istio-podinfo\") pod \"e2e-migrate-dc1ba087-gw-openshift-default-754cbcbfd7-kf9qr\" (UID: \"901c1746-cdcc-45f2-8e03-d74fd51e3521\") " pod="openshift-ingress/e2e-migrate-dc1ba087-gw-openshift-default-754cbcbfd7-kf9qr"
Jul 20 13:28:44.279900 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:28:44.279842    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/901c1746-cdcc-45f2-8e03-d74fd51e3521-workload-certs\") pod \"e2e-migrate-dc1ba087-gw-openshift-default-754cbcbfd7-kf9qr\" (UID: \"901c1746-cdcc-45f2-8e03-d74fd51e3521\") " pod="openshift-ingress/e2e-migrate-dc1ba087-gw-openshift-default-754cbcbfd7-kf9qr"
Jul 20 13:28:44.279900 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:28:44.279895    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/901c1746-cdcc-45f2-8e03-d74fd51e3521-istio-data\") pod \"e2e-migrate-dc1ba087-gw-openshift-default-754cbcbfd7-kf9qr\" (UID: \"901c1746-cdcc-45f2-8e03-d74fd51e3521\") " pod="openshift-ingress/e2e-migrate-dc1ba087-gw-openshift-default-754cbcbfd7-kf9qr"
Jul 20 13:28:44.280065 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:28:44.279916    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/901c1746-cdcc-45f2-8e03-d74fd51e3521-credential-socket\") pod \"e2e-migrate-dc1ba087-gw-openshift-default-754cbcbfd7-kf9qr\" (UID: \"901c1746-cdcc-45f2-8e03-d74fd51e3521\") " pod="openshift-ingress/e2e-migrate-dc1ba087-gw-openshift-default-754cbcbfd7-kf9qr"
Jul 20 13:28:44.280065 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:28:44.279944    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pmwmx\" (UniqueName: \"kubernetes.io/projected/901c1746-cdcc-45f2-8e03-d74fd51e3521-kube-api-access-pmwmx\") pod \"e2e-migrate-dc1ba087-gw-openshift-default-754cbcbfd7-kf9qr\" (UID: \"901c1746-cdcc-45f2-8e03-d74fd51e3521\") " pod="openshift-ingress/e2e-migrate-dc1ba087-gw-openshift-default-754cbcbfd7-kf9qr"
Jul 20 13:28:44.280065 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:28:44.280017    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/901c1746-cdcc-45f2-8e03-d74fd51e3521-istiod-ca-cert\") pod \"e2e-migrate-dc1ba087-gw-openshift-default-754cbcbfd7-kf9qr\" (UID: \"901c1746-cdcc-45f2-8e03-d74fd51e3521\") " pod="openshift-ingress/e2e-migrate-dc1ba087-gw-openshift-default-754cbcbfd7-kf9qr"
Jul 20 13:28:44.280160 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:28:44.280075    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/901c1746-cdcc-45f2-8e03-d74fd51e3521-istio-envoy\") pod \"e2e-migrate-dc1ba087-gw-openshift-default-754cbcbfd7-kf9qr\" (UID: \"901c1746-cdcc-45f2-8e03-d74fd51e3521\") " pod="openshift-ingress/e2e-migrate-dc1ba087-gw-openshift-default-754cbcbfd7-kf9qr"
Jul 20 13:28:44.380807 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:28:44.380732    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pmwmx\" (UniqueName: \"kubernetes.io/projected/901c1746-cdcc-45f2-8e03-d74fd51e3521-kube-api-access-pmwmx\") pod \"e2e-migrate-dc1ba087-gw-openshift-default-754cbcbfd7-kf9qr\" (UID: \"901c1746-cdcc-45f2-8e03-d74fd51e3521\") " pod="openshift-ingress/e2e-migrate-dc1ba087-gw-openshift-default-754cbcbfd7-kf9qr"
Jul 20 13:28:44.380807 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:28:44.380790    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/901c1746-cdcc-45f2-8e03-d74fd51e3521-istiod-ca-cert\") pod \"e2e-migrate-dc1ba087-gw-openshift-default-754cbcbfd7-kf9qr\" (UID: \"901c1746-cdcc-45f2-8e03-d74fd51e3521\") " pod="openshift-ingress/e2e-migrate-dc1ba087-gw-openshift-default-754cbcbfd7-kf9qr"
Jul 20 13:28:44.381016 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:28:44.380845    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/901c1746-cdcc-45f2-8e03-d74fd51e3521-istio-envoy\") pod \"e2e-migrate-dc1ba087-gw-openshift-default-754cbcbfd7-kf9qr\" (UID: \"901c1746-cdcc-45f2-8e03-d74fd51e3521\") " pod="openshift-ingress/e2e-migrate-dc1ba087-gw-openshift-default-754cbcbfd7-kf9qr"
Jul 20 13:28:44.381016 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:28:44.380872    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/901c1746-cdcc-45f2-8e03-d74fd51e3521-workload-socket\") pod \"e2e-migrate-dc1ba087-gw-openshift-default-754cbcbfd7-kf9qr\" (UID: \"901c1746-cdcc-45f2-8e03-d74fd51e3521\") " pod="openshift-ingress/e2e-migrate-dc1ba087-gw-openshift-default-754cbcbfd7-kf9qr"
Jul 20 13:28:44.381016 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:28:44.380922    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/901c1746-cdcc-45f2-8e03-d74fd51e3521-istio-token\") pod \"e2e-migrate-dc1ba087-gw-openshift-default-754cbcbfd7-kf9qr\" (UID: \"901c1746-cdcc-45f2-8e03-d74fd51e3521\") " pod="openshift-ingress/e2e-migrate-dc1ba087-gw-openshift-default-754cbcbfd7-kf9qr"
Jul 20 13:28:44.381016 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:28:44.380993    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/901c1746-cdcc-45f2-8e03-d74fd51e3521-istio-podinfo\") pod \"e2e-migrate-dc1ba087-gw-openshift-default-754cbcbfd7-kf9qr\" (UID: \"901c1746-cdcc-45f2-8e03-d74fd51e3521\") " pod="openshift-ingress/e2e-migrate-dc1ba087-gw-openshift-default-754cbcbfd7-kf9qr"
Jul 20 13:28:44.381221 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:28:44.381127    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/901c1746-cdcc-45f2-8e03-d74fd51e3521-workload-certs\") pod \"e2e-migrate-dc1ba087-gw-openshift-default-754cbcbfd7-kf9qr\" (UID: \"901c1746-cdcc-45f2-8e03-d74fd51e3521\") " pod="openshift-ingress/e2e-migrate-dc1ba087-gw-openshift-default-754cbcbfd7-kf9qr"
Jul 20 13:28:44.381221 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:28:44.381207    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/901c1746-cdcc-45f2-8e03-d74fd51e3521-istio-data\") pod \"e2e-migrate-dc1ba087-gw-openshift-default-754cbcbfd7-kf9qr\" (UID: \"901c1746-cdcc-45f2-8e03-d74fd51e3521\") " pod="openshift-ingress/e2e-migrate-dc1ba087-gw-openshift-default-754cbcbfd7-kf9qr"
Jul 20 13:28:44.381326 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:28:44.381241    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/901c1746-cdcc-45f2-8e03-d74fd51e3521-credential-socket\") pod \"e2e-migrate-dc1ba087-gw-openshift-default-754cbcbfd7-kf9qr\" (UID: \"901c1746-cdcc-45f2-8e03-d74fd51e3521\") " pod="openshift-ingress/e2e-migrate-dc1ba087-gw-openshift-default-754cbcbfd7-kf9qr"
Jul 20 13:28:44.381326 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:28:44.381296    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/901c1746-cdcc-45f2-8e03-d74fd51e3521-workload-socket\") pod \"e2e-migrate-dc1ba087-gw-openshift-default-754cbcbfd7-kf9qr\" (UID: \"901c1746-cdcc-45f2-8e03-d74fd51e3521\") " pod="openshift-ingress/e2e-migrate-dc1ba087-gw-openshift-default-754cbcbfd7-kf9qr"
Jul 20 13:28:44.381539 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:28:44.381518    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/901c1746-cdcc-45f2-8e03-d74fd51e3521-workload-certs\") pod \"e2e-migrate-dc1ba087-gw-openshift-default-754cbcbfd7-kf9qr\" (UID: \"901c1746-cdcc-45f2-8e03-d74fd51e3521\") " pod="openshift-ingress/e2e-migrate-dc1ba087-gw-openshift-default-754cbcbfd7-kf9qr"
Jul 20 13:28:44.381634 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:28:44.381570    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/901c1746-cdcc-45f2-8e03-d74fd51e3521-credential-socket\") pod \"e2e-migrate-dc1ba087-gw-openshift-default-754cbcbfd7-kf9qr\" (UID: \"901c1746-cdcc-45f2-8e03-d74fd51e3521\") " pod="openshift-ingress/e2e-migrate-dc1ba087-gw-openshift-default-754cbcbfd7-kf9qr"
Jul 20 13:28:44.381634 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:28:44.381581    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/901c1746-cdcc-45f2-8e03-d74fd51e3521-istiod-ca-cert\") pod \"e2e-migrate-dc1ba087-gw-openshift-default-754cbcbfd7-kf9qr\" (UID: \"901c1746-cdcc-45f2-8e03-d74fd51e3521\") " pod="openshift-ingress/e2e-migrate-dc1ba087-gw-openshift-default-754cbcbfd7-kf9qr"
Jul 20 13:28:44.381634 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:28:44.381614    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/901c1746-cdcc-45f2-8e03-d74fd51e3521-istio-data\") pod \"e2e-migrate-dc1ba087-gw-openshift-default-754cbcbfd7-kf9qr\" (UID: \"901c1746-cdcc-45f2-8e03-d74fd51e3521\") " pod="openshift-ingress/e2e-migrate-dc1ba087-gw-openshift-default-754cbcbfd7-kf9qr"
Jul 20 13:28:44.383108 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:28:44.383088    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/901c1746-cdcc-45f2-8e03-d74fd51e3521-istio-envoy\") pod \"e2e-migrate-dc1ba087-gw-openshift-default-754cbcbfd7-kf9qr\" (UID: \"901c1746-cdcc-45f2-8e03-d74fd51e3521\") " pod="openshift-ingress/e2e-migrate-dc1ba087-gw-openshift-default-754cbcbfd7-kf9qr"
Jul 20 13:28:44.383299 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:28:44.383285    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/901c1746-cdcc-45f2-8e03-d74fd51e3521-istio-podinfo\") pod \"e2e-migrate-dc1ba087-gw-openshift-default-754cbcbfd7-kf9qr\" (UID: \"901c1746-cdcc-45f2-8e03-d74fd51e3521\") " pod="openshift-ingress/e2e-migrate-dc1ba087-gw-openshift-default-754cbcbfd7-kf9qr"
Jul 20 13:28:44.387537 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:28:44.387516    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/901c1746-cdcc-45f2-8e03-d74fd51e3521-istio-token\") pod \"e2e-migrate-dc1ba087-gw-openshift-default-754cbcbfd7-kf9qr\" (UID: \"901c1746-cdcc-45f2-8e03-d74fd51e3521\") " pod="openshift-ingress/e2e-migrate-dc1ba087-gw-openshift-default-754cbcbfd7-kf9qr"
Jul 20 13:28:44.387823 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:28:44.387807    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pmwmx\" (UniqueName: \"kubernetes.io/projected/901c1746-cdcc-45f2-8e03-d74fd51e3521-kube-api-access-pmwmx\") pod \"e2e-migrate-dc1ba087-gw-openshift-default-754cbcbfd7-kf9qr\" (UID: \"901c1746-cdcc-45f2-8e03-d74fd51e3521\") " pod="openshift-ingress/e2e-migrate-dc1ba087-gw-openshift-default-754cbcbfd7-kf9qr"
Jul 20 13:28:44.433421 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:28:44.433396    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-dc1ba087-gw-openshift-default-754cbcbfd7-kf9qr"
Jul 20 13:28:44.563544 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:28:44.563519    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-dc1ba087-gw-openshift-default-754cbcbfd7-kf9qr"]
Jul 20 13:28:44.565392 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:28:44.565365    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod901c1746_cdcc_45f2_8e03_d74fd51e3521.slice/crio-e12ac084ab1b09ccc21097a5b5b6fa603312c42a780ce95f3c901d470919ab7b WatchSource:0}: Error finding container e12ac084ab1b09ccc21097a5b5b6fa603312c42a780ce95f3c901d470919ab7b: Status 404 returned error can't find the container with id e12ac084ab1b09ccc21097a5b5b6fa603312c42a780ce95f3c901d470919ab7b
Jul 20 13:28:44.568108 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:28:44.568076    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 20 13:28:44.568172 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:28:44.568141    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 20 13:28:44.568209 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:28:44.568169    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 20 13:28:45.116289 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:28:45.116255    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-dc1ba087-gw-openshift-default-754cbcbfd7-kf9qr" event={"ID":"901c1746-cdcc-45f2-8e03-d74fd51e3521","Type":"ContainerStarted","Data":"6e211e1a71238b23b1f36573952e993abc633689064e6f90285681fc6d77b770"}
Jul 20 13:28:45.116485 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:28:45.116303    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-dc1ba087-gw-openshift-default-754cbcbfd7-kf9qr" event={"ID":"901c1746-cdcc-45f2-8e03-d74fd51e3521","Type":"ContainerStarted","Data":"e12ac084ab1b09ccc21097a5b5b6fa603312c42a780ce95f3c901d470919ab7b"}
Jul 20 13:28:45.137165 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:28:45.137121    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-migrate-dc1ba087-gw-openshift-default-754cbcbfd7-kf9qr" podStartSLOduration=1.137105891 podStartE2EDuration="1.137105891s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 13:28:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 13:28:45.135900118 +0000 UTC m=+1614.852447522" watchObservedRunningTime="2026-07-20 13:28:45.137105891 +0000 UTC m=+1614.853653300"
Jul 20 13:28:45.433555 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:28:45.433487    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-dc1ba087-gw-openshift-default-754cbcbfd7-kf9qr"
Jul 20 13:28:45.438306 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:28:45.438285    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-dc1ba087-gw-openshift-default-754cbcbfd7-kf9qr"
Jul 20 13:28:45.482994 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:28:45.482951    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-dc1ba087-64b4f7cf48-fxhgw"]
Jul 20 13:28:45.486080 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:28:45.486060    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-dc1ba087-64b4f7cf48-fxhgw"
Jul 20 13:28:45.488342 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:28:45.488321    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-migrate-dc1ba087-serving-cert\""
Jul 20 13:28:45.488464 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:28:45.488410    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-vf2sw\""
Jul 20 13:28:45.494703 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:28:45.494682    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-dc1ba087-64b4f7cf48-fxhgw"]
Jul 20 13:28:45.593562 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:28:45.593533    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mv9tf\" (UniqueName: \"kubernetes.io/projected/682205bd-0c92-4e58-ac42-e4babaad6ad2-kube-api-access-mv9tf\") pod \"maas-api-e2e-migrate-dc1ba087-64b4f7cf48-fxhgw\" (UID: \"682205bd-0c92-4e58-ac42-e4babaad6ad2\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-dc1ba087-64b4f7cf48-fxhgw"
Jul 20 13:28:45.593912 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:28:45.593582    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/682205bd-0c92-4e58-ac42-e4babaad6ad2-maas-api-tls\") pod \"maas-api-e2e-migrate-dc1ba087-64b4f7cf48-fxhgw\" (UID: \"682205bd-0c92-4e58-ac42-e4babaad6ad2\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-dc1ba087-64b4f7cf48-fxhgw"
Jul 20 13:28:45.593912 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:28:45.593662    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/682205bd-0c92-4e58-ac42-e4babaad6ad2-openshift-service-ca\") pod \"maas-api-e2e-migrate-dc1ba087-64b4f7cf48-fxhgw\" (UID: \"682205bd-0c92-4e58-ac42-e4babaad6ad2\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-dc1ba087-64b4f7cf48-fxhgw"
Jul 20 13:28:45.695196 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:28:45.695110    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/682205bd-0c92-4e58-ac42-e4babaad6ad2-maas-api-tls\") pod \"maas-api-e2e-migrate-dc1ba087-64b4f7cf48-fxhgw\" (UID: \"682205bd-0c92-4e58-ac42-e4babaad6ad2\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-dc1ba087-64b4f7cf48-fxhgw"
Jul 20 13:28:45.695363 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:28:45.695201    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/682205bd-0c92-4e58-ac42-e4babaad6ad2-openshift-service-ca\") pod \"maas-api-e2e-migrate-dc1ba087-64b4f7cf48-fxhgw\" (UID: \"682205bd-0c92-4e58-ac42-e4babaad6ad2\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-dc1ba087-64b4f7cf48-fxhgw"
Jul 20 13:28:45.695363 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:28:45.695295    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mv9tf\" (UniqueName: \"kubernetes.io/projected/682205bd-0c92-4e58-ac42-e4babaad6ad2-kube-api-access-mv9tf\") pod \"maas-api-e2e-migrate-dc1ba087-64b4f7cf48-fxhgw\" (UID: \"682205bd-0c92-4e58-ac42-e4babaad6ad2\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-dc1ba087-64b4f7cf48-fxhgw"
Jul 20 13:28:45.695887 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:28:45.695861    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/682205bd-0c92-4e58-ac42-e4babaad6ad2-openshift-service-ca\") pod \"maas-api-e2e-migrate-dc1ba087-64b4f7cf48-fxhgw\" (UID: \"682205bd-0c92-4e58-ac42-e4babaad6ad2\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-dc1ba087-64b4f7cf48-fxhgw"
Jul 20 13:28:45.697440 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:28:45.697419    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/682205bd-0c92-4e58-ac42-e4babaad6ad2-maas-api-tls\") pod \"maas-api-e2e-migrate-dc1ba087-64b4f7cf48-fxhgw\" (UID: \"682205bd-0c92-4e58-ac42-e4babaad6ad2\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-dc1ba087-64b4f7cf48-fxhgw"
Jul 20 13:28:45.703591 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:28:45.703571    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mv9tf\" (UniqueName: \"kubernetes.io/projected/682205bd-0c92-4e58-ac42-e4babaad6ad2-kube-api-access-mv9tf\") pod \"maas-api-e2e-migrate-dc1ba087-64b4f7cf48-fxhgw\" (UID: \"682205bd-0c92-4e58-ac42-e4babaad6ad2\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-dc1ba087-64b4f7cf48-fxhgw"
Jul 20 13:28:45.798021 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:28:45.797995    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-dc1ba087-64b4f7cf48-fxhgw"
Jul 20 13:28:45.933502 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:28:45.933477    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-dc1ba087-64b4f7cf48-fxhgw"]
Jul 20 13:28:45.935166 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:28:45.935139    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod682205bd_0c92_4e58_ac42_e4babaad6ad2.slice/crio-55d159209b248b0fa4941a05988cd6e70fff23d8057071aee1ad6f62f10fa530 WatchSource:0}: Error finding container 55d159209b248b0fa4941a05988cd6e70fff23d8057071aee1ad6f62f10fa530: Status 404 returned error can't find the container with id 55d159209b248b0fa4941a05988cd6e70fff23d8057071aee1ad6f62f10fa530
Jul 20 13:28:46.122735 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:28:46.122707    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-dc1ba087-64b4f7cf48-fxhgw" event={"ID":"682205bd-0c92-4e58-ac42-e4babaad6ad2","Type":"ContainerStarted","Data":"55d159209b248b0fa4941a05988cd6e70fff23d8057071aee1ad6f62f10fa530"}
Jul 20 13:28:46.122995 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:28:46.122983    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-dc1ba087-gw-openshift-default-754cbcbfd7-kf9qr"
Jul 20 13:28:46.123891 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:28:46.123875    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-dc1ba087-gw-openshift-default-754cbcbfd7-kf9qr"
Jul 20 13:28:47.129797 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:28:47.129764    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-dc1ba087-64b4f7cf48-fxhgw" event={"ID":"682205bd-0c92-4e58-ac42-e4babaad6ad2","Type":"ContainerStarted","Data":"da8a0fc0a0e14a0c1ceb0ad3d801cf2eb535a905d972ace177da23f9baa41256"}
Jul 20 13:28:47.130289 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:28:47.129844    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-dc1ba087-64b4f7cf48-fxhgw"
Jul 20 13:28:47.153871 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:28:47.153824    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-dc1ba087-64b4f7cf48-fxhgw" podStartSLOduration=1.7070163900000002 podStartE2EDuration="2.153809833s" totalImagesPullingTime="446.793443ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 13:28:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 13:28:47.151755502 +0000 UTC m=+1616.868302911" watchObservedRunningTime="2026-07-20 13:28:47.153809833 +0000 UTC m=+1616.870357242"
Jul 20 13:28:48.791319 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:28:48.791295    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-7291c4b7-openshift-default-7f9b9c497c-jj44x"
Jul 20 13:28:48.826111 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:28:48.826049    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ee15f478-f6cf-47fd-a955-ef2e99dbda48-workload-certs\") pod \"ee15f478-f6cf-47fd-a955-ef2e99dbda48\" (UID: \"ee15f478-f6cf-47fd-a955-ef2e99dbda48\") "
Jul 20 13:28:48.826111 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:28:48.826105    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ee15f478-f6cf-47fd-a955-ef2e99dbda48-istio-token\") pod \"ee15f478-f6cf-47fd-a955-ef2e99dbda48\" (UID: \"ee15f478-f6cf-47fd-a955-ef2e99dbda48\") "
Jul 20 13:28:48.826287 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:28:48.826128    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ee15f478-f6cf-47fd-a955-ef2e99dbda48-credential-socket\") pod \"ee15f478-f6cf-47fd-a955-ef2e99dbda48\" (UID: \"ee15f478-f6cf-47fd-a955-ef2e99dbda48\") "
Jul 20 13:28:48.826287 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:28:48.826184    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ee15f478-f6cf-47fd-a955-ef2e99dbda48-istio-podinfo\") pod \"ee15f478-f6cf-47fd-a955-ef2e99dbda48\" (UID: \"ee15f478-f6cf-47fd-a955-ef2e99dbda48\") "
Jul 20 13:28:48.826287 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:28:48.826219    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4bv4l\" (UniqueName: \"kubernetes.io/projected/ee15f478-f6cf-47fd-a955-ef2e99dbda48-kube-api-access-4bv4l\") pod \"ee15f478-f6cf-47fd-a955-ef2e99dbda48\" (UID: \"ee15f478-f6cf-47fd-a955-ef2e99dbda48\") "
Jul 20 13:28:48.826287 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:28:48.826277    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ee15f478-f6cf-47fd-a955-ef2e99dbda48-istiod-ca-cert\") pod \"ee15f478-f6cf-47fd-a955-ef2e99dbda48\" (UID: \"ee15f478-f6cf-47fd-a955-ef2e99dbda48\") "
Jul 20 13:28:48.826485 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:28:48.826322    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ee15f478-f6cf-47fd-a955-ef2e99dbda48-istio-envoy\") pod \"ee15f478-f6cf-47fd-a955-ef2e99dbda48\" (UID: \"ee15f478-f6cf-47fd-a955-ef2e99dbda48\") "
Jul 20 13:28:48.826485 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:28:48.826329    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ee15f478-f6cf-47fd-a955-ef2e99dbda48-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "ee15f478-f6cf-47fd-a955-ef2e99dbda48" (UID: "ee15f478-f6cf-47fd-a955-ef2e99dbda48"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 13:28:48.826485 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:28:48.826345    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ee15f478-f6cf-47fd-a955-ef2e99dbda48-workload-socket\") pod \"ee15f478-f6cf-47fd-a955-ef2e99dbda48\" (UID: \"ee15f478-f6cf-47fd-a955-ef2e99dbda48\") "
Jul 20 13:28:48.826485 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:28:48.826395    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ee15f478-f6cf-47fd-a955-ef2e99dbda48-istio-data\") pod \"ee15f478-f6cf-47fd-a955-ef2e99dbda48\" (UID: \"ee15f478-f6cf-47fd-a955-ef2e99dbda48\") "
Jul 20 13:28:48.826485 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:28:48.826422    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ee15f478-f6cf-47fd-a955-ef2e99dbda48-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "ee15f478-f6cf-47fd-a955-ef2e99dbda48" (UID: "ee15f478-f6cf-47fd-a955-ef2e99dbda48"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 13:28:48.826736 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:28:48.826642    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ee15f478-f6cf-47fd-a955-ef2e99dbda48-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "ee15f478-f6cf-47fd-a955-ef2e99dbda48" (UID: "ee15f478-f6cf-47fd-a955-ef2e99dbda48"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 13:28:48.826876 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:28:48.826848    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ee15f478-f6cf-47fd-a955-ef2e99dbda48-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "ee15f478-f6cf-47fd-a955-ef2e99dbda48" (UID: "ee15f478-f6cf-47fd-a955-ef2e99dbda48"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 13:28:48.827008 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:28:48.826910    2584 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ee15f478-f6cf-47fd-a955-ef2e99dbda48-workload-certs\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 20 13:28:48.827008 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:28:48.826940    2584 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ee15f478-f6cf-47fd-a955-ef2e99dbda48-credential-socket\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 20 13:28:48.827008 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:28:48.826956    2584 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ee15f478-f6cf-47fd-a955-ef2e99dbda48-istiod-ca-cert\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 20 13:28:48.827430 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:28:48.827403    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ee15f478-f6cf-47fd-a955-ef2e99dbda48-istio-data" (OuterVolumeSpecName: "istio-data") pod "ee15f478-f6cf-47fd-a955-ef2e99dbda48" (UID: "ee15f478-f6cf-47fd-a955-ef2e99dbda48"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 13:28:48.828397 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:28:48.828339    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ee15f478-f6cf-47fd-a955-ef2e99dbda48-istio-token" (OuterVolumeSpecName: "istio-token") pod "ee15f478-f6cf-47fd-a955-ef2e99dbda48" (UID: "ee15f478-f6cf-47fd-a955-ef2e99dbda48"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 13:28:48.828690 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:28:48.828668    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ee15f478-f6cf-47fd-a955-ef2e99dbda48-kube-api-access-4bv4l" (OuterVolumeSpecName: "kube-api-access-4bv4l") pod "ee15f478-f6cf-47fd-a955-ef2e99dbda48" (UID: "ee15f478-f6cf-47fd-a955-ef2e99dbda48"). InnerVolumeSpecName "kube-api-access-4bv4l". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 13:28:48.828885 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:28:48.828858    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ee15f478-f6cf-47fd-a955-ef2e99dbda48-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "ee15f478-f6cf-47fd-a955-ef2e99dbda48" (UID: "ee15f478-f6cf-47fd-a955-ef2e99dbda48"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 13:28:48.829095 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:28:48.828939    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/ee15f478-f6cf-47fd-a955-ef2e99dbda48-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "ee15f478-f6cf-47fd-a955-ef2e99dbda48" (UID: "ee15f478-f6cf-47fd-a955-ef2e99dbda48"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 20 13:28:48.927756 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:28:48.927734    2584 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ee15f478-f6cf-47fd-a955-ef2e99dbda48-istio-envoy\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 20 13:28:48.927756 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:28:48.927756    2584 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ee15f478-f6cf-47fd-a955-ef2e99dbda48-workload-socket\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 20 13:28:48.927883 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:28:48.927764    2584 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ee15f478-f6cf-47fd-a955-ef2e99dbda48-istio-data\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 20 13:28:48.927883 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:28:48.927773    2584 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ee15f478-f6cf-47fd-a955-ef2e99dbda48-istio-token\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 20 13:28:48.927883 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:28:48.927780    2584 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ee15f478-f6cf-47fd-a955-ef2e99dbda48-istio-podinfo\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 20 13:28:48.927883 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:28:48.927787    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4bv4l\" (UniqueName: \"kubernetes.io/projected/ee15f478-f6cf-47fd-a955-ef2e99dbda48-kube-api-access-4bv4l\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 20 13:28:49.141602 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:28:49.141576    2584 generic.go:356] "Generic (PLEG): container finished" podID="ee15f478-f6cf-47fd-a955-ef2e99dbda48" containerID="30701f3a01bedbd6d991d1902bdc4ea23237b8e8d607ba80ee70e65389f64edf" exitCode=0
Jul 20 13:28:49.141719 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:28:49.141624    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-7291c4b7-openshift-default-7f9b9c497c-jj44x"
Jul 20 13:28:49.141719 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:28:49.141659    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-7291c4b7-openshift-default-7f9b9c497c-jj44x" event={"ID":"ee15f478-f6cf-47fd-a955-ef2e99dbda48","Type":"ContainerDied","Data":"30701f3a01bedbd6d991d1902bdc4ea23237b8e8d607ba80ee70e65389f64edf"}
Jul 20 13:28:49.141790 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:28:49.141718    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-7291c4b7-openshift-default-7f9b9c497c-jj44x" event={"ID":"ee15f478-f6cf-47fd-a955-ef2e99dbda48","Type":"ContainerDied","Data":"0ec7db847db88d5248e9a99f9e7d506b0a42b3557e1f944809f4846f51ce7575"}
Jul 20 13:28:49.141790 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:28:49.141745    2584 scope.go:117] "RemoveContainer" containerID="30701f3a01bedbd6d991d1902bdc4ea23237b8e8d607ba80ee70e65389f64edf"
Jul 20 13:28:49.150496 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:28:49.150476    2584 scope.go:117] "RemoveContainer" containerID="7546689dc61ddf7e9bee57e55314eddeb177adadc15e8796c30cdbf9a0c22443"
Jul 20 13:28:49.158549 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:28:49.158529    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-7291c4b7-openshift-default-7f9b9c497c-jj44x"]
Jul 20 13:28:49.158727 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:28:49.158713    2584 scope.go:117] "RemoveContainer" containerID="30701f3a01bedbd6d991d1902bdc4ea23237b8e8d607ba80ee70e65389f64edf"
Jul 20 13:28:49.158984 ip-10-0-134-121 kubenswrapper[2584]: E0720 13:28:49.158948    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"30701f3a01bedbd6d991d1902bdc4ea23237b8e8d607ba80ee70e65389f64edf\": container with ID starting with 30701f3a01bedbd6d991d1902bdc4ea23237b8e8d607ba80ee70e65389f64edf not found: ID does not exist" containerID="30701f3a01bedbd6d991d1902bdc4ea23237b8e8d607ba80ee70e65389f64edf"
Jul 20 13:28:49.159036 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:28:49.158993    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"30701f3a01bedbd6d991d1902bdc4ea23237b8e8d607ba80ee70e65389f64edf"} err="failed to get container status \"30701f3a01bedbd6d991d1902bdc4ea23237b8e8d607ba80ee70e65389f64edf\": rpc error: code = NotFound desc = could not find container \"30701f3a01bedbd6d991d1902bdc4ea23237b8e8d607ba80ee70e65389f64edf\": container with ID starting with 30701f3a01bedbd6d991d1902bdc4ea23237b8e8d607ba80ee70e65389f64edf not found: ID does not exist"
Jul 20 13:28:49.159036 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:28:49.159009    2584 scope.go:117] "RemoveContainer" containerID="7546689dc61ddf7e9bee57e55314eddeb177adadc15e8796c30cdbf9a0c22443"
Jul 20 13:28:49.159224 ip-10-0-134-121 kubenswrapper[2584]: E0720 13:28:49.159208    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7546689dc61ddf7e9bee57e55314eddeb177adadc15e8796c30cdbf9a0c22443\": container with ID starting with 7546689dc61ddf7e9bee57e55314eddeb177adadc15e8796c30cdbf9a0c22443 not found: ID does not exist" containerID="7546689dc61ddf7e9bee57e55314eddeb177adadc15e8796c30cdbf9a0c22443"
Jul 20 13:28:49.159263 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:28:49.159230    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7546689dc61ddf7e9bee57e55314eddeb177adadc15e8796c30cdbf9a0c22443"} err="failed to get container status \"7546689dc61ddf7e9bee57e55314eddeb177adadc15e8796c30cdbf9a0c22443\": rpc error: code = NotFound desc = could not find container \"7546689dc61ddf7e9bee57e55314eddeb177adadc15e8796c30cdbf9a0c22443\": container with ID starting with 7546689dc61ddf7e9bee57e55314eddeb177adadc15e8796c30cdbf9a0c22443 not found: ID does not exist"
Jul 20 13:28:49.162633 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:28:49.162614    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-7291c4b7-openshift-default-7f9b9c497c-jj44x"]
Jul 20 13:28:51.097279 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:28:51.097239    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ee15f478-f6cf-47fd-a955-ef2e99dbda48" path="/var/lib/kubelet/pods/ee15f478-f6cf-47fd-a955-ef2e99dbda48/volumes"
Jul 20 13:28:53.140688 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:28:53.140661    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-dc1ba087-64b4f7cf48-fxhgw"
Jul 20 13:29:01.124669 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:29:01.124577    2584 patch_prober.go:28] interesting pod/e2e-migrate-dc1ba087-gw-openshift-default-754cbcbfd7-kf9qr container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused" start-of-body=
Jul 20 13:29:01.124669 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:29:01.124635    2584 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-migrate-dc1ba087-gw-openshift-default-754cbcbfd7-kf9qr" podUID="901c1746-cdcc-45f2-8e03-d74fd51e3521" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused"
Jul 20 13:29:01.207544 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:29:01.207510    2584 generic.go:356] "Generic (PLEG): container finished" podID="901c1746-cdcc-45f2-8e03-d74fd51e3521" containerID="6e211e1a71238b23b1f36573952e993abc633689064e6f90285681fc6d77b770" exitCode=0
Jul 20 13:29:01.207707 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:29:01.207585    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-dc1ba087-gw-openshift-default-754cbcbfd7-kf9qr" event={"ID":"901c1746-cdcc-45f2-8e03-d74fd51e3521","Type":"ContainerDied","Data":"6e211e1a71238b23b1f36573952e993abc633689064e6f90285681fc6d77b770"}
Jul 20 13:29:01.208059 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:29:01.208044    2584 scope.go:117] "RemoveContainer" containerID="6e211e1a71238b23b1f36573952e993abc633689064e6f90285681fc6d77b770"
Jul 20 13:29:01.209103 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:29:01.209070    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 20 13:29:01.209196 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:29:01.209177    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 20 13:29:01.209245 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:29:01.209232    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 20 13:29:02.214868 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:29:02.214832    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-dc1ba087-gw-openshift-default-754cbcbfd7-kf9qr" event={"ID":"901c1746-cdcc-45f2-8e03-d74fd51e3521","Type":"ContainerStarted","Data":"22305bc5ee1b9932b447a37202c45ecfe59ba64a58196ecc103259aca6c54792"}
Jul 20 13:29:02.434628 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:29:02.434594    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-dc1ba087-gw-openshift-default-754cbcbfd7-kf9qr"
Jul 20 13:29:02.434982 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:29:02.434940    2584 patch_prober.go:28] interesting pod/e2e-migrate-dc1ba087-gw-openshift-default-754cbcbfd7-kf9qr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused" start-of-body=
Jul 20 13:29:02.435143 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:29:02.435120    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-dc1ba087-gw-openshift-default-754cbcbfd7-kf9qr" podUID="901c1746-cdcc-45f2-8e03-d74fd51e3521" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused"
Jul 20 13:29:03.434385 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:29:03.434347    2584 patch_prober.go:28] interesting pod/e2e-migrate-dc1ba087-gw-openshift-default-754cbcbfd7-kf9qr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused" start-of-body=
Jul 20 13:29:03.434864 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:29:03.434415    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-dc1ba087-gw-openshift-default-754cbcbfd7-kf9qr" podUID="901c1746-cdcc-45f2-8e03-d74fd51e3521" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused"
Jul 20 13:29:04.434499 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:29:04.434454    2584 patch_prober.go:28] interesting pod/e2e-migrate-dc1ba087-gw-openshift-default-754cbcbfd7-kf9qr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused" start-of-body=
Jul 20 13:29:04.434995 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:29:04.434545    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-dc1ba087-gw-openshift-default-754cbcbfd7-kf9qr" podUID="901c1746-cdcc-45f2-8e03-d74fd51e3521" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused"
Jul 20 13:29:05.434391 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:29:05.434351    2584 patch_prober.go:28] interesting pod/e2e-migrate-dc1ba087-gw-openshift-default-754cbcbfd7-kf9qr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused" start-of-body=
Jul 20 13:29:05.434688 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:29:05.434656    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-dc1ba087-gw-openshift-default-754cbcbfd7-kf9qr" podUID="901c1746-cdcc-45f2-8e03-d74fd51e3521" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused"
Jul 20 13:29:06.437901 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:29:06.437869    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-dc1ba087-gw-openshift-default-754cbcbfd7-kf9qr"
Jul 20 13:29:06.438314 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:29:06.438215    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-dc1ba087-gw-openshift-default-754cbcbfd7-kf9qr"
Jul 20 13:29:06.438812 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:29:06.438792    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-dc1ba087-gw-openshift-default-754cbcbfd7-kf9qr"
Jul 20 13:29:29.355709 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:29:29.355674    2584 generic.go:356] "Generic (PLEG): container finished" podID="c71d47d7-dd2b-4439-9a99-5edf9b7a05cc" containerID="24353a4eaac61ff2dca2c4631ae1e0e865af7092f241901ce8258c94c8725bd2" exitCode=1
Jul 20 13:29:29.356121 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:29:29.355742    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-zpbpp" event={"ID":"c71d47d7-dd2b-4439-9a99-5edf9b7a05cc","Type":"ContainerDied","Data":"24353a4eaac61ff2dca2c4631ae1e0e865af7092f241901ce8258c94c8725bd2"}
Jul 20 13:29:29.356121 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:29:29.356097    2584 scope.go:117] "RemoveContainer" containerID="24353a4eaac61ff2dca2c4631ae1e0e865af7092f241901ce8258c94c8725bd2"
Jul 20 13:29:30.362612 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:29:30.362574    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-zpbpp" event={"ID":"c71d47d7-dd2b-4439-9a99-5edf9b7a05cc","Type":"ContainerStarted","Data":"cd794dc0c6c8280874450a60d5089fc8fad3f38f5b83bfb1e2649f2120e5d3c1"}
Jul 20 13:29:30.362981 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:29:30.362788    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-zpbpp"
Jul 20 13:29:41.369503 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:29:41.369472    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-zpbpp"
Jul 20 13:29:50.117349 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:29:50.117320    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-dc1ba087-gw-openshift-default-754cbcbfd7-kf9qr"]
Jul 20 13:29:50.117801 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:29:50.117514    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-migrate-dc1ba087-gw-openshift-default-754cbcbfd7-kf9qr" podUID="901c1746-cdcc-45f2-8e03-d74fd51e3521" containerName="istio-proxy" containerID="cri-o://22305bc5ee1b9932b447a37202c45ecfe59ba64a58196ecc103259aca6c54792" gracePeriod=30
Jul 20 13:29:51.440778 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:29:51.440691    2584 patch_prober.go:28] interesting pod/e2e-migrate-dc1ba087-gw-openshift-default-754cbcbfd7-kf9qr container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=upstream connect error or disconnect/reset before headers. reset reason: remote connection failure, transport failure reason: delayed connect error: Connection refused
Jul 20 13:29:51.440778 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:29:51.440748    2584 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-migrate-dc1ba087-gw-openshift-default-754cbcbfd7-kf9qr" podUID="901c1746-cdcc-45f2-8e03-d74fd51e3521" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 20 13:29:55.373750 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:29:55.373726    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-dc1ba087-gw-openshift-default-754cbcbfd7-kf9qr"
Jul 20 13:29:55.453370 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:29:55.453305    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/901c1746-cdcc-45f2-8e03-d74fd51e3521-istio-data\") pod \"901c1746-cdcc-45f2-8e03-d74fd51e3521\" (UID: \"901c1746-cdcc-45f2-8e03-d74fd51e3521\") "
Jul 20 13:29:55.453370 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:29:55.453344    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/901c1746-cdcc-45f2-8e03-d74fd51e3521-istiod-ca-cert\") pod \"901c1746-cdcc-45f2-8e03-d74fd51e3521\" (UID: \"901c1746-cdcc-45f2-8e03-d74fd51e3521\") "
Jul 20 13:29:55.453370 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:29:55.453363    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/901c1746-cdcc-45f2-8e03-d74fd51e3521-istio-podinfo\") pod \"901c1746-cdcc-45f2-8e03-d74fd51e3521\" (UID: \"901c1746-cdcc-45f2-8e03-d74fd51e3521\") "
Jul 20 13:29:55.453610 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:29:55.453383    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/901c1746-cdcc-45f2-8e03-d74fd51e3521-istio-envoy\") pod \"901c1746-cdcc-45f2-8e03-d74fd51e3521\" (UID: \"901c1746-cdcc-45f2-8e03-d74fd51e3521\") "
Jul 20 13:29:55.453610 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:29:55.453490    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/901c1746-cdcc-45f2-8e03-d74fd51e3521-istio-token\") pod \"901c1746-cdcc-45f2-8e03-d74fd51e3521\" (UID: \"901c1746-cdcc-45f2-8e03-d74fd51e3521\") "
Jul 20 13:29:55.453610 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:29:55.453533    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/901c1746-cdcc-45f2-8e03-d74fd51e3521-workload-certs\") pod \"901c1746-cdcc-45f2-8e03-d74fd51e3521\" (UID: \"901c1746-cdcc-45f2-8e03-d74fd51e3521\") "
Jul 20 13:29:55.453610 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:29:55.453567    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/901c1746-cdcc-45f2-8e03-d74fd51e3521-workload-socket\") pod \"901c1746-cdcc-45f2-8e03-d74fd51e3521\" (UID: \"901c1746-cdcc-45f2-8e03-d74fd51e3521\") "
Jul 20 13:29:55.453610 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:29:55.453595    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pmwmx\" (UniqueName: \"kubernetes.io/projected/901c1746-cdcc-45f2-8e03-d74fd51e3521-kube-api-access-pmwmx\") pod \"901c1746-cdcc-45f2-8e03-d74fd51e3521\" (UID: \"901c1746-cdcc-45f2-8e03-d74fd51e3521\") "
Jul 20 13:29:55.453878 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:29:55.453629    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/901c1746-cdcc-45f2-8e03-d74fd51e3521-credential-socket\") pod \"901c1746-cdcc-45f2-8e03-d74fd51e3521\" (UID: \"901c1746-cdcc-45f2-8e03-d74fd51e3521\") "
Jul 20 13:29:55.453878 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:29:55.453785    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/901c1746-cdcc-45f2-8e03-d74fd51e3521-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "901c1746-cdcc-45f2-8e03-d74fd51e3521" (UID: "901c1746-cdcc-45f2-8e03-d74fd51e3521"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 13:29:55.454063 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:29:55.454034    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/901c1746-cdcc-45f2-8e03-d74fd51e3521-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "901c1746-cdcc-45f2-8e03-d74fd51e3521" (UID: "901c1746-cdcc-45f2-8e03-d74fd51e3521"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 13:29:55.454417 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:29:55.454223    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/901c1746-cdcc-45f2-8e03-d74fd51e3521-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "901c1746-cdcc-45f2-8e03-d74fd51e3521" (UID: "901c1746-cdcc-45f2-8e03-d74fd51e3521"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 13:29:55.454417 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:29:55.454237    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/901c1746-cdcc-45f2-8e03-d74fd51e3521-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "901c1746-cdcc-45f2-8e03-d74fd51e3521" (UID: "901c1746-cdcc-45f2-8e03-d74fd51e3521"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 13:29:55.454417 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:29:55.454325    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/901c1746-cdcc-45f2-8e03-d74fd51e3521-istio-data" (OuterVolumeSpecName: "istio-data") pod "901c1746-cdcc-45f2-8e03-d74fd51e3521" (UID: "901c1746-cdcc-45f2-8e03-d74fd51e3521"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 13:29:55.454417 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:29:55.454336    2584 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/901c1746-cdcc-45f2-8e03-d74fd51e3521-istiod-ca-cert\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 20 13:29:55.454417 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:29:55.454355    2584 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/901c1746-cdcc-45f2-8e03-d74fd51e3521-workload-certs\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 20 13:29:55.454417 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:29:55.454368    2584 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/901c1746-cdcc-45f2-8e03-d74fd51e3521-workload-socket\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 20 13:29:55.454417 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:29:55.454382    2584 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/901c1746-cdcc-45f2-8e03-d74fd51e3521-credential-socket\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 20 13:29:55.456504 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:29:55.456469    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/901c1746-cdcc-45f2-8e03-d74fd51e3521-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "901c1746-cdcc-45f2-8e03-d74fd51e3521" (UID: "901c1746-cdcc-45f2-8e03-d74fd51e3521"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 20 13:29:55.456793 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:29:55.456745    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/901c1746-cdcc-45f2-8e03-d74fd51e3521-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "901c1746-cdcc-45f2-8e03-d74fd51e3521" (UID: "901c1746-cdcc-45f2-8e03-d74fd51e3521"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 13:29:55.457548 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:29:55.457515    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/901c1746-cdcc-45f2-8e03-d74fd51e3521-istio-token" (OuterVolumeSpecName: "istio-token") pod "901c1746-cdcc-45f2-8e03-d74fd51e3521" (UID: "901c1746-cdcc-45f2-8e03-d74fd51e3521"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 13:29:55.458455 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:29:55.458429    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/901c1746-cdcc-45f2-8e03-d74fd51e3521-kube-api-access-pmwmx" (OuterVolumeSpecName: "kube-api-access-pmwmx") pod "901c1746-cdcc-45f2-8e03-d74fd51e3521" (UID: "901c1746-cdcc-45f2-8e03-d74fd51e3521"). InnerVolumeSpecName "kube-api-access-pmwmx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 13:29:55.495169 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:29:55.495140    2584 generic.go:356] "Generic (PLEG): container finished" podID="901c1746-cdcc-45f2-8e03-d74fd51e3521" containerID="22305bc5ee1b9932b447a37202c45ecfe59ba64a58196ecc103259aca6c54792" exitCode=0
Jul 20 13:29:55.495296 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:29:55.495202    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-dc1ba087-gw-openshift-default-754cbcbfd7-kf9qr"
Jul 20 13:29:55.495296 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:29:55.495234    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-dc1ba087-gw-openshift-default-754cbcbfd7-kf9qr" event={"ID":"901c1746-cdcc-45f2-8e03-d74fd51e3521","Type":"ContainerDied","Data":"22305bc5ee1b9932b447a37202c45ecfe59ba64a58196ecc103259aca6c54792"}
Jul 20 13:29:55.495412 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:29:55.495295    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-dc1ba087-gw-openshift-default-754cbcbfd7-kf9qr" event={"ID":"901c1746-cdcc-45f2-8e03-d74fd51e3521","Type":"ContainerDied","Data":"e12ac084ab1b09ccc21097a5b5b6fa603312c42a780ce95f3c901d470919ab7b"}
Jul 20 13:29:55.495412 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:29:55.495324    2584 scope.go:117] "RemoveContainer" containerID="22305bc5ee1b9932b447a37202c45ecfe59ba64a58196ecc103259aca6c54792"
Jul 20 13:29:55.506576 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:29:55.506557    2584 scope.go:117] "RemoveContainer" containerID="6e211e1a71238b23b1f36573952e993abc633689064e6f90285681fc6d77b770"
Jul 20 13:29:55.516720 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:29:55.516673    2584 scope.go:117] "RemoveContainer" containerID="22305bc5ee1b9932b447a37202c45ecfe59ba64a58196ecc103259aca6c54792"
Jul 20 13:29:55.517334 ip-10-0-134-121 kubenswrapper[2584]: E0720 13:29:55.517311    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"22305bc5ee1b9932b447a37202c45ecfe59ba64a58196ecc103259aca6c54792\": container with ID starting with 22305bc5ee1b9932b447a37202c45ecfe59ba64a58196ecc103259aca6c54792 not found: ID does not exist" containerID="22305bc5ee1b9932b447a37202c45ecfe59ba64a58196ecc103259aca6c54792"
Jul 20 13:29:55.517434 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:29:55.517343    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"22305bc5ee1b9932b447a37202c45ecfe59ba64a58196ecc103259aca6c54792"} err="failed to get container status \"22305bc5ee1b9932b447a37202c45ecfe59ba64a58196ecc103259aca6c54792\": rpc error: code = NotFound desc = could not find container \"22305bc5ee1b9932b447a37202c45ecfe59ba64a58196ecc103259aca6c54792\": container with ID starting with 22305bc5ee1b9932b447a37202c45ecfe59ba64a58196ecc103259aca6c54792 not found: ID does not exist"
Jul 20 13:29:55.517434 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:29:55.517360    2584 scope.go:117] "RemoveContainer" containerID="6e211e1a71238b23b1f36573952e993abc633689064e6f90285681fc6d77b770"
Jul 20 13:29:55.517726 ip-10-0-134-121 kubenswrapper[2584]: E0720 13:29:55.517695    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6e211e1a71238b23b1f36573952e993abc633689064e6f90285681fc6d77b770\": container with ID starting with 6e211e1a71238b23b1f36573952e993abc633689064e6f90285681fc6d77b770 not found: ID does not exist" containerID="6e211e1a71238b23b1f36573952e993abc633689064e6f90285681fc6d77b770"
Jul 20 13:29:55.517820 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:29:55.517728    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6e211e1a71238b23b1f36573952e993abc633689064e6f90285681fc6d77b770"} err="failed to get container status \"6e211e1a71238b23b1f36573952e993abc633689064e6f90285681fc6d77b770\": rpc error: code = NotFound desc = could not find container \"6e211e1a71238b23b1f36573952e993abc633689064e6f90285681fc6d77b770\": container with ID starting with 6e211e1a71238b23b1f36573952e993abc633689064e6f90285681fc6d77b770 not found: ID does not exist"
Jul 20 13:29:55.536847 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:29:55.536827    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-dc1ba087-gw-openshift-default-754cbcbfd7-kf9qr"]
Jul 20 13:29:55.544784 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:29:55.544765    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-migrate-dc1ba087-gw-openshift-default-754cbcbfd7-kf9qr"]
Jul 20 13:29:55.555658 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:29:55.555643    2584 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/901c1746-cdcc-45f2-8e03-d74fd51e3521-istio-token\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 20 13:29:55.555722 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:29:55.555662    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pmwmx\" (UniqueName: \"kubernetes.io/projected/901c1746-cdcc-45f2-8e03-d74fd51e3521-kube-api-access-pmwmx\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 20 13:29:55.555722 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:29:55.555677    2584 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/901c1746-cdcc-45f2-8e03-d74fd51e3521-istio-data\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 20 13:29:55.555722 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:29:55.555689    2584 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/901c1746-cdcc-45f2-8e03-d74fd51e3521-istio-podinfo\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 20 13:29:55.555722 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:29:55.555696    2584 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/901c1746-cdcc-45f2-8e03-d74fd51e3521-istio-envoy\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 20 13:29:55.713772 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:29:55.713678    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-dc1ba087-64b4f7cf48-fxhgw"]
Jul 20 13:29:55.713931 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:29:55.713903    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-dc1ba087-64b4f7cf48-fxhgw" podUID="682205bd-0c92-4e58-ac42-e4babaad6ad2" containerName="maas-api" containerID="cri-o://da8a0fc0a0e14a0c1ceb0ad3d801cf2eb535a905d972ace177da23f9baa41256" gracePeriod=30
Jul 20 13:29:55.954759 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:29:55.954737    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-dc1ba087-64b4f7cf48-fxhgw"
Jul 20 13:29:56.059601 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:29:56.059576    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/682205bd-0c92-4e58-ac42-e4babaad6ad2-openshift-service-ca\") pod \"682205bd-0c92-4e58-ac42-e4babaad6ad2\" (UID: \"682205bd-0c92-4e58-ac42-e4babaad6ad2\") "
Jul 20 13:29:56.059742 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:29:56.059625    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mv9tf\" (UniqueName: \"kubernetes.io/projected/682205bd-0c92-4e58-ac42-e4babaad6ad2-kube-api-access-mv9tf\") pod \"682205bd-0c92-4e58-ac42-e4babaad6ad2\" (UID: \"682205bd-0c92-4e58-ac42-e4babaad6ad2\") "
Jul 20 13:29:56.059742 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:29:56.059645    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/682205bd-0c92-4e58-ac42-e4babaad6ad2-maas-api-tls\") pod \"682205bd-0c92-4e58-ac42-e4babaad6ad2\" (UID: \"682205bd-0c92-4e58-ac42-e4babaad6ad2\") "
Jul 20 13:29:56.060032 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:29:56.060009    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/682205bd-0c92-4e58-ac42-e4babaad6ad2-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "682205bd-0c92-4e58-ac42-e4babaad6ad2" (UID: "682205bd-0c92-4e58-ac42-e4babaad6ad2"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 13:29:56.061544 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:29:56.061526    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/682205bd-0c92-4e58-ac42-e4babaad6ad2-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "682205bd-0c92-4e58-ac42-e4babaad6ad2" (UID: "682205bd-0c92-4e58-ac42-e4babaad6ad2"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 13:29:56.061609 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:29:56.061545    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/682205bd-0c92-4e58-ac42-e4babaad6ad2-kube-api-access-mv9tf" (OuterVolumeSpecName: "kube-api-access-mv9tf") pod "682205bd-0c92-4e58-ac42-e4babaad6ad2" (UID: "682205bd-0c92-4e58-ac42-e4babaad6ad2"). InnerVolumeSpecName "kube-api-access-mv9tf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 13:29:56.161228 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:29:56.161204    2584 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/682205bd-0c92-4e58-ac42-e4babaad6ad2-openshift-service-ca\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 20 13:29:56.161228 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:29:56.161227    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mv9tf\" (UniqueName: \"kubernetes.io/projected/682205bd-0c92-4e58-ac42-e4babaad6ad2-kube-api-access-mv9tf\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 20 13:29:56.161364 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:29:56.161237    2584 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/682205bd-0c92-4e58-ac42-e4babaad6ad2-maas-api-tls\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 20 13:29:56.502586 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:29:56.502550    2584 generic.go:356] "Generic (PLEG): container finished" podID="682205bd-0c92-4e58-ac42-e4babaad6ad2" containerID="da8a0fc0a0e14a0c1ceb0ad3d801cf2eb535a905d972ace177da23f9baa41256" exitCode=0
Jul 20 13:29:56.502956 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:29:56.502602    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-dc1ba087-64b4f7cf48-fxhgw"
Jul 20 13:29:56.502956 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:29:56.502633    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-dc1ba087-64b4f7cf48-fxhgw" event={"ID":"682205bd-0c92-4e58-ac42-e4babaad6ad2","Type":"ContainerDied","Data":"da8a0fc0a0e14a0c1ceb0ad3d801cf2eb535a905d972ace177da23f9baa41256"}
Jul 20 13:29:56.502956 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:29:56.502698    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-dc1ba087-64b4f7cf48-fxhgw" event={"ID":"682205bd-0c92-4e58-ac42-e4babaad6ad2","Type":"ContainerDied","Data":"55d159209b248b0fa4941a05988cd6e70fff23d8057071aee1ad6f62f10fa530"}
Jul 20 13:29:56.502956 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:29:56.502723    2584 scope.go:117] "RemoveContainer" containerID="da8a0fc0a0e14a0c1ceb0ad3d801cf2eb535a905d972ace177da23f9baa41256"
Jul 20 13:29:56.519113 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:29:56.519090    2584 scope.go:117] "RemoveContainer" containerID="da8a0fc0a0e14a0c1ceb0ad3d801cf2eb535a905d972ace177da23f9baa41256"
Jul 20 13:29:56.519424 ip-10-0-134-121 kubenswrapper[2584]: E0720 13:29:56.519402    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"da8a0fc0a0e14a0c1ceb0ad3d801cf2eb535a905d972ace177da23f9baa41256\": container with ID starting with da8a0fc0a0e14a0c1ceb0ad3d801cf2eb535a905d972ace177da23f9baa41256 not found: ID does not exist" containerID="da8a0fc0a0e14a0c1ceb0ad3d801cf2eb535a905d972ace177da23f9baa41256"
Jul 20 13:29:56.519511 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:29:56.519429    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"da8a0fc0a0e14a0c1ceb0ad3d801cf2eb535a905d972ace177da23f9baa41256"} err="failed to get container status \"da8a0fc0a0e14a0c1ceb0ad3d801cf2eb535a905d972ace177da23f9baa41256\": rpc error: code = NotFound desc = could not find container \"da8a0fc0a0e14a0c1ceb0ad3d801cf2eb535a905d972ace177da23f9baa41256\": container with ID starting with da8a0fc0a0e14a0c1ceb0ad3d801cf2eb535a905d972ace177da23f9baa41256 not found: ID does not exist"
Jul 20 13:29:56.528325 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:29:56.528303    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-dc1ba087-64b4f7cf48-fxhgw"]
Jul 20 13:29:56.535617 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:29:56.535596    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-dc1ba087-64b4f7cf48-fxhgw"]
Jul 20 13:29:57.095620 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:29:57.095590    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="682205bd-0c92-4e58-ac42-e4babaad6ad2" path="/var/lib/kubelet/pods/682205bd-0c92-4e58-ac42-e4babaad6ad2/volumes"
Jul 20 13:29:57.096032 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:29:57.096018    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="901c1746-cdcc-45f2-8e03-d74fd51e3521" path="/var/lib/kubelet/pods/901c1746-cdcc-45f2-8e03-d74fd51e3521/volumes"
Jul 20 13:30:02.503092 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:30:02.503058    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-22b1bd43-openshift-default-789f47496c-59nwb"]
Jul 20 13:30:02.503826 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:30:02.503643    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ee15f478-f6cf-47fd-a955-ef2e99dbda48" containerName="istio-proxy"
Jul 20 13:30:02.503826 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:30:02.503663    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="ee15f478-f6cf-47fd-a955-ef2e99dbda48" containerName="istio-proxy"
Jul 20 13:30:02.503826 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:30:02.503679    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ee15f478-f6cf-47fd-a955-ef2e99dbda48" containerName="istio-proxy"
Jul 20 13:30:02.503826 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:30:02.503688    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="ee15f478-f6cf-47fd-a955-ef2e99dbda48" containerName="istio-proxy"
Jul 20 13:30:02.503826 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:30:02.503708    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="901c1746-cdcc-45f2-8e03-d74fd51e3521" containerName="istio-proxy"
Jul 20 13:30:02.503826 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:30:02.503717    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="901c1746-cdcc-45f2-8e03-d74fd51e3521" containerName="istio-proxy"
Jul 20 13:30:02.503826 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:30:02.503725    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="901c1746-cdcc-45f2-8e03-d74fd51e3521" containerName="istio-proxy"
Jul 20 13:30:02.503826 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:30:02.503733    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="901c1746-cdcc-45f2-8e03-d74fd51e3521" containerName="istio-proxy"
Jul 20 13:30:02.503826 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:30:02.503748    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="682205bd-0c92-4e58-ac42-e4babaad6ad2" containerName="maas-api"
Jul 20 13:30:02.503826 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:30:02.503753    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="682205bd-0c92-4e58-ac42-e4babaad6ad2" containerName="maas-api"
Jul 20 13:30:02.503826 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:30:02.503824    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="901c1746-cdcc-45f2-8e03-d74fd51e3521" containerName="istio-proxy"
Jul 20 13:30:02.503826 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:30:02.503834    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="901c1746-cdcc-45f2-8e03-d74fd51e3521" containerName="istio-proxy"
Jul 20 13:30:02.504496 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:30:02.503839    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="ee15f478-f6cf-47fd-a955-ef2e99dbda48" containerName="istio-proxy"
Jul 20 13:30:02.504496 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:30:02.503846    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="682205bd-0c92-4e58-ac42-e4babaad6ad2" containerName="maas-api"
Jul 20 13:30:02.508630 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:30:02.508610    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-22b1bd43-openshift-default-789f47496c-59nwb"
Jul 20 13:30:02.510776 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:30:02.510754    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-22b1bd43-openshift-default-dockercfg-wj2nf\""
Jul 20 13:30:02.518978 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:30:02.518940    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-22b1bd43-openshift-default-789f47496c-59nwb"]
Jul 20 13:30:02.621475 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:30:02.621439    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3d81acb0-7210-4422-b6c5-e08ace19c3bc-workload-certs\") pod \"e2e-ait-22b1bd43-openshift-default-789f47496c-59nwb\" (UID: \"3d81acb0-7210-4422-b6c5-e08ace19c3bc\") " pod="openshift-ingress/e2e-ait-22b1bd43-openshift-default-789f47496c-59nwb"
Jul 20 13:30:02.621639 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:30:02.621478    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3d81acb0-7210-4422-b6c5-e08ace19c3bc-istio-envoy\") pod \"e2e-ait-22b1bd43-openshift-default-789f47496c-59nwb\" (UID: \"3d81acb0-7210-4422-b6c5-e08ace19c3bc\") " pod="openshift-ingress/e2e-ait-22b1bd43-openshift-default-789f47496c-59nwb"
Jul 20 13:30:02.621639 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:30:02.621564    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3d81acb0-7210-4422-b6c5-e08ace19c3bc-istio-data\") pod \"e2e-ait-22b1bd43-openshift-default-789f47496c-59nwb\" (UID: \"3d81acb0-7210-4422-b6c5-e08ace19c3bc\") " pod="openshift-ingress/e2e-ait-22b1bd43-openshift-default-789f47496c-59nwb"
Jul 20 13:30:02.621639 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:30:02.621610    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3d81acb0-7210-4422-b6c5-e08ace19c3bc-workload-socket\") pod \"e2e-ait-22b1bd43-openshift-default-789f47496c-59nwb\" (UID: \"3d81acb0-7210-4422-b6c5-e08ace19c3bc\") " pod="openshift-ingress/e2e-ait-22b1bd43-openshift-default-789f47496c-59nwb"
Jul 20 13:30:02.621639 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:30:02.621628    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3d81acb0-7210-4422-b6c5-e08ace19c3bc-istio-token\") pod \"e2e-ait-22b1bd43-openshift-default-789f47496c-59nwb\" (UID: \"3d81acb0-7210-4422-b6c5-e08ace19c3bc\") " pod="openshift-ingress/e2e-ait-22b1bd43-openshift-default-789f47496c-59nwb"
Jul 20 13:30:02.621783 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:30:02.621676    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zmhkx\" (UniqueName: \"kubernetes.io/projected/3d81acb0-7210-4422-b6c5-e08ace19c3bc-kube-api-access-zmhkx\") pod \"e2e-ait-22b1bd43-openshift-default-789f47496c-59nwb\" (UID: \"3d81acb0-7210-4422-b6c5-e08ace19c3bc\") " pod="openshift-ingress/e2e-ait-22b1bd43-openshift-default-789f47496c-59nwb"
Jul 20 13:30:02.621783 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:30:02.621749    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3d81acb0-7210-4422-b6c5-e08ace19c3bc-istiod-ca-cert\") pod \"e2e-ait-22b1bd43-openshift-default-789f47496c-59nwb\" (UID: \"3d81acb0-7210-4422-b6c5-e08ace19c3bc\") " pod="openshift-ingress/e2e-ait-22b1bd43-openshift-default-789f47496c-59nwb"
Jul 20 13:30:02.621846 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:30:02.621793    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3d81acb0-7210-4422-b6c5-e08ace19c3bc-credential-socket\") pod \"e2e-ait-22b1bd43-openshift-default-789f47496c-59nwb\" (UID: \"3d81acb0-7210-4422-b6c5-e08ace19c3bc\") " pod="openshift-ingress/e2e-ait-22b1bd43-openshift-default-789f47496c-59nwb"
Jul 20 13:30:02.621846 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:30:02.621815    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3d81acb0-7210-4422-b6c5-e08ace19c3bc-istio-podinfo\") pod \"e2e-ait-22b1bd43-openshift-default-789f47496c-59nwb\" (UID: \"3d81acb0-7210-4422-b6c5-e08ace19c3bc\") " pod="openshift-ingress/e2e-ait-22b1bd43-openshift-default-789f47496c-59nwb"
Jul 20 13:30:02.722574 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:30:02.722526    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3d81acb0-7210-4422-b6c5-e08ace19c3bc-istio-podinfo\") pod \"e2e-ait-22b1bd43-openshift-default-789f47496c-59nwb\" (UID: \"3d81acb0-7210-4422-b6c5-e08ace19c3bc\") " pod="openshift-ingress/e2e-ait-22b1bd43-openshift-default-789f47496c-59nwb"
Jul 20 13:30:02.722760 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:30:02.722595    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3d81acb0-7210-4422-b6c5-e08ace19c3bc-workload-certs\") pod \"e2e-ait-22b1bd43-openshift-default-789f47496c-59nwb\" (UID: \"3d81acb0-7210-4422-b6c5-e08ace19c3bc\") " pod="openshift-ingress/e2e-ait-22b1bd43-openshift-default-789f47496c-59nwb"
Jul 20 13:30:02.722760 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:30:02.722622    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3d81acb0-7210-4422-b6c5-e08ace19c3bc-istio-envoy\") pod \"e2e-ait-22b1bd43-openshift-default-789f47496c-59nwb\" (UID: \"3d81acb0-7210-4422-b6c5-e08ace19c3bc\") " pod="openshift-ingress/e2e-ait-22b1bd43-openshift-default-789f47496c-59nwb"
Jul 20 13:30:02.722760 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:30:02.722674    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3d81acb0-7210-4422-b6c5-e08ace19c3bc-istio-data\") pod \"e2e-ait-22b1bd43-openshift-default-789f47496c-59nwb\" (UID: \"3d81acb0-7210-4422-b6c5-e08ace19c3bc\") " pod="openshift-ingress/e2e-ait-22b1bd43-openshift-default-789f47496c-59nwb"
Jul 20 13:30:02.722760 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:30:02.722721    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3d81acb0-7210-4422-b6c5-e08ace19c3bc-workload-socket\") pod \"e2e-ait-22b1bd43-openshift-default-789f47496c-59nwb\" (UID: \"3d81acb0-7210-4422-b6c5-e08ace19c3bc\") " pod="openshift-ingress/e2e-ait-22b1bd43-openshift-default-789f47496c-59nwb"
Jul 20 13:30:02.722760 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:30:02.722748    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3d81acb0-7210-4422-b6c5-e08ace19c3bc-istio-token\") pod \"e2e-ait-22b1bd43-openshift-default-789f47496c-59nwb\" (UID: \"3d81acb0-7210-4422-b6c5-e08ace19c3bc\") " pod="openshift-ingress/e2e-ait-22b1bd43-openshift-default-789f47496c-59nwb"
Jul 20 13:30:02.723069 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:30:02.722780    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zmhkx\" (UniqueName: \"kubernetes.io/projected/3d81acb0-7210-4422-b6c5-e08ace19c3bc-kube-api-access-zmhkx\") pod \"e2e-ait-22b1bd43-openshift-default-789f47496c-59nwb\" (UID: \"3d81acb0-7210-4422-b6c5-e08ace19c3bc\") " pod="openshift-ingress/e2e-ait-22b1bd43-openshift-default-789f47496c-59nwb"
Jul 20 13:30:02.723069 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:30:02.722846    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3d81acb0-7210-4422-b6c5-e08ace19c3bc-istiod-ca-cert\") pod \"e2e-ait-22b1bd43-openshift-default-789f47496c-59nwb\" (UID: \"3d81acb0-7210-4422-b6c5-e08ace19c3bc\") " pod="openshift-ingress/e2e-ait-22b1bd43-openshift-default-789f47496c-59nwb"
Jul 20 13:30:02.723069 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:30:02.722910    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3d81acb0-7210-4422-b6c5-e08ace19c3bc-credential-socket\") pod \"e2e-ait-22b1bd43-openshift-default-789f47496c-59nwb\" (UID: \"3d81acb0-7210-4422-b6c5-e08ace19c3bc\") " pod="openshift-ingress/e2e-ait-22b1bd43-openshift-default-789f47496c-59nwb"
Jul 20 13:30:02.723320 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:30:02.723288    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3d81acb0-7210-4422-b6c5-e08ace19c3bc-workload-certs\") pod \"e2e-ait-22b1bd43-openshift-default-789f47496c-59nwb\" (UID: \"3d81acb0-7210-4422-b6c5-e08ace19c3bc\") " pod="openshift-ingress/e2e-ait-22b1bd43-openshift-default-789f47496c-59nwb"
Jul 20 13:30:02.723828 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:30:02.723503    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3d81acb0-7210-4422-b6c5-e08ace19c3bc-credential-socket\") pod \"e2e-ait-22b1bd43-openshift-default-789f47496c-59nwb\" (UID: \"3d81acb0-7210-4422-b6c5-e08ace19c3bc\") " pod="openshift-ingress/e2e-ait-22b1bd43-openshift-default-789f47496c-59nwb"
Jul 20 13:30:02.723828 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:30:02.723541    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3d81acb0-7210-4422-b6c5-e08ace19c3bc-workload-socket\") pod \"e2e-ait-22b1bd43-openshift-default-789f47496c-59nwb\" (UID: \"3d81acb0-7210-4422-b6c5-e08ace19c3bc\") " pod="openshift-ingress/e2e-ait-22b1bd43-openshift-default-789f47496c-59nwb"
Jul 20 13:30:02.723828 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:30:02.723687    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3d81acb0-7210-4422-b6c5-e08ace19c3bc-istiod-ca-cert\") pod \"e2e-ait-22b1bd43-openshift-default-789f47496c-59nwb\" (UID: \"3d81acb0-7210-4422-b6c5-e08ace19c3bc\") " pod="openshift-ingress/e2e-ait-22b1bd43-openshift-default-789f47496c-59nwb"
Jul 20 13:30:02.723828 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:30:02.723783    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3d81acb0-7210-4422-b6c5-e08ace19c3bc-istio-data\") pod \"e2e-ait-22b1bd43-openshift-default-789f47496c-59nwb\" (UID: \"3d81acb0-7210-4422-b6c5-e08ace19c3bc\") " pod="openshift-ingress/e2e-ait-22b1bd43-openshift-default-789f47496c-59nwb"
Jul 20 13:30:02.725523 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:30:02.725494    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3d81acb0-7210-4422-b6c5-e08ace19c3bc-istio-envoy\") pod \"e2e-ait-22b1bd43-openshift-default-789f47496c-59nwb\" (UID: \"3d81acb0-7210-4422-b6c5-e08ace19c3bc\") " pod="openshift-ingress/e2e-ait-22b1bd43-openshift-default-789f47496c-59nwb"
Jul 20 13:30:02.726233 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:30:02.725956    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3d81acb0-7210-4422-b6c5-e08ace19c3bc-istio-podinfo\") pod \"e2e-ait-22b1bd43-openshift-default-789f47496c-59nwb\" (UID: \"3d81acb0-7210-4422-b6c5-e08ace19c3bc\") " pod="openshift-ingress/e2e-ait-22b1bd43-openshift-default-789f47496c-59nwb"
Jul 20 13:30:02.740818 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:30:02.740792    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zmhkx\" (UniqueName: \"kubernetes.io/projected/3d81acb0-7210-4422-b6c5-e08ace19c3bc-kube-api-access-zmhkx\") pod \"e2e-ait-22b1bd43-openshift-default-789f47496c-59nwb\" (UID: \"3d81acb0-7210-4422-b6c5-e08ace19c3bc\") " pod="openshift-ingress/e2e-ait-22b1bd43-openshift-default-789f47496c-59nwb"
Jul 20 13:30:02.742190 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:30:02.742168    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3d81acb0-7210-4422-b6c5-e08ace19c3bc-istio-token\") pod \"e2e-ait-22b1bd43-openshift-default-789f47496c-59nwb\" (UID: \"3d81acb0-7210-4422-b6c5-e08ace19c3bc\") " pod="openshift-ingress/e2e-ait-22b1bd43-openshift-default-789f47496c-59nwb"
Jul 20 13:30:02.820843 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:30:02.820768    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-22b1bd43-openshift-default-789f47496c-59nwb"
Jul 20 13:30:02.959298 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:30:02.959204    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-22b1bd43-openshift-default-789f47496c-59nwb"]
Jul 20 13:30:02.961740 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:30:02.961700    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3d81acb0_7210_4422_b6c5_e08ace19c3bc.slice/crio-9c897c9a70454f29bbdf314d89c0f05f41a5cb61b5959923480a92923c2fb85c WatchSource:0}: Error finding container 9c897c9a70454f29bbdf314d89c0f05f41a5cb61b5959923480a92923c2fb85c: Status 404 returned error can't find the container with id 9c897c9a70454f29bbdf314d89c0f05f41a5cb61b5959923480a92923c2fb85c
Jul 20 13:30:02.963998 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:30:02.963919    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 20 13:30:02.964085 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:30:02.964031    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 20 13:30:02.964085 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:30:02.964062    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 20 13:30:03.542495 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:30:03.542462    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-22b1bd43-openshift-default-789f47496c-59nwb" event={"ID":"3d81acb0-7210-4422-b6c5-e08ace19c3bc","Type":"ContainerStarted","Data":"5ca327955eceb481ff93c26de3df6c0fd054580ac494f4ce880bbc90478489b5"}
Jul 20 13:30:03.542854 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:30:03.542515    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-22b1bd43-openshift-default-789f47496c-59nwb" event={"ID":"3d81acb0-7210-4422-b6c5-e08ace19c3bc","Type":"ContainerStarted","Data":"9c897c9a70454f29bbdf314d89c0f05f41a5cb61b5959923480a92923c2fb85c"}
Jul 20 13:30:03.563505 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:30:03.563460    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-22b1bd43-openshift-default-789f47496c-59nwb" podStartSLOduration=1.563444472 podStartE2EDuration="1.563444472s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 13:30:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 13:30:03.561954895 +0000 UTC m=+1693.278502329" watchObservedRunningTime="2026-07-20 13:30:03.563444472 +0000 UTC m=+1693.279991882"
Jul 20 13:30:03.820919 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:30:03.820832    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-22b1bd43-openshift-default-789f47496c-59nwb"
Jul 20 13:30:03.871052 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:30:03.871014    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-22b1bd43-589688dcc-sn8tg"]
Jul 20 13:30:03.871512 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:30:03.871497    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="ee15f478-f6cf-47fd-a955-ef2e99dbda48" containerName="istio-proxy"
Jul 20 13:30:03.875032 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:30:03.875009    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-22b1bd43-589688dcc-sn8tg"
Jul 20 13:30:03.877146 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:30:03.877128    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-22b1bd43-serving-cert\""
Jul 20 13:30:03.877146 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:30:03.877136    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-vf2sw\""
Jul 20 13:30:03.886100 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:30:03.886042    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-22b1bd43-589688dcc-sn8tg"]
Jul 20 13:30:04.036356 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:30:04.036315    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/38dbfad6-5258-4812-8268-907e2c36096d-openshift-service-ca\") pod \"maas-api-e2e-ait-22b1bd43-589688dcc-sn8tg\" (UID: \"38dbfad6-5258-4812-8268-907e2c36096d\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-22b1bd43-589688dcc-sn8tg"
Jul 20 13:30:04.036356 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:30:04.036369    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/38dbfad6-5258-4812-8268-907e2c36096d-maas-api-tls\") pod \"maas-api-e2e-ait-22b1bd43-589688dcc-sn8tg\" (UID: \"38dbfad6-5258-4812-8268-907e2c36096d\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-22b1bd43-589688dcc-sn8tg"
Jul 20 13:30:04.036570 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:30:04.036466    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k8js2\" (UniqueName: \"kubernetes.io/projected/38dbfad6-5258-4812-8268-907e2c36096d-kube-api-access-k8js2\") pod \"maas-api-e2e-ait-22b1bd43-589688dcc-sn8tg\" (UID: \"38dbfad6-5258-4812-8268-907e2c36096d\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-22b1bd43-589688dcc-sn8tg"
Jul 20 13:30:04.137617 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:30:04.137476    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/38dbfad6-5258-4812-8268-907e2c36096d-openshift-service-ca\") pod \"maas-api-e2e-ait-22b1bd43-589688dcc-sn8tg\" (UID: \"38dbfad6-5258-4812-8268-907e2c36096d\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-22b1bd43-589688dcc-sn8tg"
Jul 20 13:30:04.137617 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:30:04.137616    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/38dbfad6-5258-4812-8268-907e2c36096d-maas-api-tls\") pod \"maas-api-e2e-ait-22b1bd43-589688dcc-sn8tg\" (UID: \"38dbfad6-5258-4812-8268-907e2c36096d\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-22b1bd43-589688dcc-sn8tg"
Jul 20 13:30:04.137869 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:30:04.137677    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k8js2\" (UniqueName: \"kubernetes.io/projected/38dbfad6-5258-4812-8268-907e2c36096d-kube-api-access-k8js2\") pod \"maas-api-e2e-ait-22b1bd43-589688dcc-sn8tg\" (UID: \"38dbfad6-5258-4812-8268-907e2c36096d\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-22b1bd43-589688dcc-sn8tg"
Jul 20 13:30:04.138067 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:30:04.138047    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/38dbfad6-5258-4812-8268-907e2c36096d-openshift-service-ca\") pod \"maas-api-e2e-ait-22b1bd43-589688dcc-sn8tg\" (UID: \"38dbfad6-5258-4812-8268-907e2c36096d\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-22b1bd43-589688dcc-sn8tg"
Jul 20 13:30:04.139896 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:30:04.139875    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/38dbfad6-5258-4812-8268-907e2c36096d-maas-api-tls\") pod \"maas-api-e2e-ait-22b1bd43-589688dcc-sn8tg\" (UID: \"38dbfad6-5258-4812-8268-907e2c36096d\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-22b1bd43-589688dcc-sn8tg"
Jul 20 13:30:04.150213 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:30:04.150192    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k8js2\" (UniqueName: \"kubernetes.io/projected/38dbfad6-5258-4812-8268-907e2c36096d-kube-api-access-k8js2\") pod \"maas-api-e2e-ait-22b1bd43-589688dcc-sn8tg\" (UID: \"38dbfad6-5258-4812-8268-907e2c36096d\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-22b1bd43-589688dcc-sn8tg"
Jul 20 13:30:04.189845 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:30:04.189820    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-22b1bd43-589688dcc-sn8tg"
Jul 20 13:30:04.340459 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:30:04.340431    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-22b1bd43-589688dcc-sn8tg"]
Jul 20 13:30:04.342188 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:30:04.342161    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod38dbfad6_5258_4812_8268_907e2c36096d.slice/crio-c309765e743a17408d0a0fa33cbe3ef2d1815d5d44cde224283c274477f183dd WatchSource:0}: Error finding container c309765e743a17408d0a0fa33cbe3ef2d1815d5d44cde224283c274477f183dd: Status 404 returned error can't find the container with id c309765e743a17408d0a0fa33cbe3ef2d1815d5d44cde224283c274477f183dd
Jul 20 13:30:04.548151 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:30:04.548123    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-22b1bd43-589688dcc-sn8tg" event={"ID":"38dbfad6-5258-4812-8268-907e2c36096d","Type":"ContainerStarted","Data":"c309765e743a17408d0a0fa33cbe3ef2d1815d5d44cde224283c274477f183dd"}
Jul 20 13:30:04.825685 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:30:04.825661    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-22b1bd43-openshift-default-789f47496c-59nwb"
Jul 20 13:30:05.554120 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:30:05.554078    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-22b1bd43-589688dcc-sn8tg" event={"ID":"38dbfad6-5258-4812-8268-907e2c36096d","Type":"ContainerStarted","Data":"5351e859aa08502badcbc99ac18d48ddca02fad4e6621f518e74559977b36d43"}
Jul 20 13:30:05.554556 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:30:05.554291    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-22b1bd43-589688dcc-sn8tg"
Jul 20 13:30:05.554556 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:30:05.554338    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-22b1bd43-openshift-default-789f47496c-59nwb"
Jul 20 13:30:05.555129 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:30:05.555113    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-22b1bd43-openshift-default-789f47496c-59nwb"
Jul 20 13:30:05.571228 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:30:05.571186    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-22b1bd43-589688dcc-sn8tg" podStartSLOduration=2.11644907 podStartE2EDuration="2.5711725s" totalImagesPullingTime="454.72343ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 13:30:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 13:30:05.569823503 +0000 UTC m=+1695.286370914" watchObservedRunningTime="2026-07-20 13:30:05.5711725 +0000 UTC m=+1695.287719909"
Jul 20 13:30:11.568998 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:30:11.568954    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-22b1bd43-589688dcc-sn8tg"
Jul 20 13:30:14.604806 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:30:14.604775    2584 generic.go:356] "Generic (PLEG): container finished" podID="3d81acb0-7210-4422-b6c5-e08ace19c3bc" containerID="5ca327955eceb481ff93c26de3df6c0fd054580ac494f4ce880bbc90478489b5" exitCode=0
Jul 20 13:30:14.605207 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:30:14.604850    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-22b1bd43-openshift-default-789f47496c-59nwb" event={"ID":"3d81acb0-7210-4422-b6c5-e08ace19c3bc","Type":"ContainerDied","Data":"5ca327955eceb481ff93c26de3df6c0fd054580ac494f4ce880bbc90478489b5"}
Jul 20 13:30:14.605249 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:30:14.605238    2584 scope.go:117] "RemoveContainer" containerID="5ca327955eceb481ff93c26de3df6c0fd054580ac494f4ce880bbc90478489b5"
Jul 20 13:30:14.606278 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:30:14.606253    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 20 13:30:14.606335 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:30:14.606317    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 20 13:30:14.606369 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:30:14.606355    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 20 13:30:15.610959 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:30:15.610928    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-22b1bd43-openshift-default-789f47496c-59nwb" event={"ID":"3d81acb0-7210-4422-b6c5-e08ace19c3bc","Type":"ContainerStarted","Data":"35e6c7e0330b7a46e098e407e39c042c014e2302c7147068c419c15562f2b0ef"}
Jul 20 13:30:15.821905 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:30:15.821872    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-22b1bd43-openshift-default-789f47496c-59nwb"
Jul 20 13:30:15.823416 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:30:15.823101    2584 patch_prober.go:28] interesting pod/e2e-ait-22b1bd43-openshift-default-789f47496c-59nwb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused" start-of-body=
Jul 20 13:30:15.823416 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:30:15.823159    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-22b1bd43-openshift-default-789f47496c-59nwb" podUID="3d81acb0-7210-4422-b6c5-e08ace19c3bc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused"
Jul 20 13:30:16.821584 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:30:16.821549    2584 patch_prober.go:28] interesting pod/e2e-ait-22b1bd43-openshift-default-789f47496c-59nwb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused" start-of-body=
Jul 20 13:30:16.821991 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:30:16.821600    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-22b1bd43-openshift-default-789f47496c-59nwb" podUID="3d81acb0-7210-4422-b6c5-e08ace19c3bc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused"
Jul 20 13:30:17.822034 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:30:17.821996    2584 patch_prober.go:28] interesting pod/e2e-ait-22b1bd43-openshift-default-789f47496c-59nwb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused" start-of-body=
Jul 20 13:30:17.822412 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:30:17.822050    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-22b1bd43-openshift-default-789f47496c-59nwb" podUID="3d81acb0-7210-4422-b6c5-e08ace19c3bc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused"
Jul 20 13:30:18.821880 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:30:18.821848    2584 patch_prober.go:28] interesting pod/e2e-ait-22b1bd43-openshift-default-789f47496c-59nwb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused" start-of-body=
Jul 20 13:30:18.822080 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:30:18.821927    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-22b1bd43-openshift-default-789f47496c-59nwb" podUID="3d81acb0-7210-4422-b6c5-e08ace19c3bc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused"
Jul 20 13:30:19.824758 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:30:19.824726    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-22b1bd43-openshift-default-789f47496c-59nwb"
Jul 20 13:30:19.825158 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:30:19.825002    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-22b1bd43-openshift-default-789f47496c-59nwb"
Jul 20 13:30:19.825640 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:30:19.825623    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-22b1bd43-openshift-default-789f47496c-59nwb"
Jul 20 13:31:09.744709 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:31:09.744676    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-22b1bd43-589688dcc-sn8tg"]
Jul 20 13:31:09.745263 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:31:09.744931    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-22b1bd43-589688dcc-sn8tg" podUID="38dbfad6-5258-4812-8268-907e2c36096d" containerName="maas-api" containerID="cri-o://5351e859aa08502badcbc99ac18d48ddca02fad4e6621f518e74559977b36d43" gracePeriod=30
Jul 20 13:31:09.889197 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:31:09.889159    2584 generic.go:356] "Generic (PLEG): container finished" podID="38dbfad6-5258-4812-8268-907e2c36096d" containerID="5351e859aa08502badcbc99ac18d48ddca02fad4e6621f518e74559977b36d43" exitCode=0
Jul 20 13:31:09.889346 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:31:09.889233    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-22b1bd43-589688dcc-sn8tg" event={"ID":"38dbfad6-5258-4812-8268-907e2c36096d","Type":"ContainerDied","Data":"5351e859aa08502badcbc99ac18d48ddca02fad4e6621f518e74559977b36d43"}
Jul 20 13:31:09.988176 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:31:09.988154    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-22b1bd43-589688dcc-sn8tg"
Jul 20 13:31:10.051855 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:31:10.051789    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k8js2\" (UniqueName: \"kubernetes.io/projected/38dbfad6-5258-4812-8268-907e2c36096d-kube-api-access-k8js2\") pod \"38dbfad6-5258-4812-8268-907e2c36096d\" (UID: \"38dbfad6-5258-4812-8268-907e2c36096d\") "
Jul 20 13:31:10.051855 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:31:10.051833    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/38dbfad6-5258-4812-8268-907e2c36096d-openshift-service-ca\") pod \"38dbfad6-5258-4812-8268-907e2c36096d\" (UID: \"38dbfad6-5258-4812-8268-907e2c36096d\") "
Jul 20 13:31:10.052079 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:31:10.051868    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/38dbfad6-5258-4812-8268-907e2c36096d-maas-api-tls\") pod \"38dbfad6-5258-4812-8268-907e2c36096d\" (UID: \"38dbfad6-5258-4812-8268-907e2c36096d\") "
Jul 20 13:31:10.052247 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:31:10.052226    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/38dbfad6-5258-4812-8268-907e2c36096d-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "38dbfad6-5258-4812-8268-907e2c36096d" (UID: "38dbfad6-5258-4812-8268-907e2c36096d"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 13:31:10.053891 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:31:10.053870    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/38dbfad6-5258-4812-8268-907e2c36096d-kube-api-access-k8js2" (OuterVolumeSpecName: "kube-api-access-k8js2") pod "38dbfad6-5258-4812-8268-907e2c36096d" (UID: "38dbfad6-5258-4812-8268-907e2c36096d"). InnerVolumeSpecName "kube-api-access-k8js2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 13:31:10.054000 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:31:10.053899    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/38dbfad6-5258-4812-8268-907e2c36096d-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "38dbfad6-5258-4812-8268-907e2c36096d" (UID: "38dbfad6-5258-4812-8268-907e2c36096d"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 13:31:10.153498 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:31:10.153471    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k8js2\" (UniqueName: \"kubernetes.io/projected/38dbfad6-5258-4812-8268-907e2c36096d-kube-api-access-k8js2\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 20 13:31:10.153498 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:31:10.153494    2584 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/38dbfad6-5258-4812-8268-907e2c36096d-openshift-service-ca\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 20 13:31:10.153633 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:31:10.153507    2584 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/38dbfad6-5258-4812-8268-907e2c36096d-maas-api-tls\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 20 13:31:10.895377 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:31:10.895351    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-22b1bd43-589688dcc-sn8tg"
Jul 20 13:31:10.895764 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:31:10.895385    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-22b1bd43-589688dcc-sn8tg" event={"ID":"38dbfad6-5258-4812-8268-907e2c36096d","Type":"ContainerDied","Data":"c309765e743a17408d0a0fa33cbe3ef2d1815d5d44cde224283c274477f183dd"}
Jul 20 13:31:10.895764 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:31:10.895441    2584 scope.go:117] "RemoveContainer" containerID="5351e859aa08502badcbc99ac18d48ddca02fad4e6621f518e74559977b36d43"
Jul 20 13:31:10.917572 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:31:10.917402    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-22b1bd43-589688dcc-sn8tg"]
Jul 20 13:31:10.919974 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:31:10.919944    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-22b1bd43-589688dcc-sn8tg"]
Jul 20 13:31:11.096790 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:31:11.096757    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="38dbfad6-5258-4812-8268-907e2c36096d" path="/var/lib/kubelet/pods/38dbfad6-5258-4812-8268-907e2c36096d/volumes"
Jul 20 13:31:25.079793 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:31:25.079765    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-22b1bd43-openshift-default-789f47496c-59nwb"]
Jul 20 13:31:25.080292 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:31:25.079960    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-22b1bd43-openshift-default-789f47496c-59nwb" podUID="3d81acb0-7210-4422-b6c5-e08ace19c3bc" containerName="istio-proxy" containerID="cri-o://35e6c7e0330b7a46e098e407e39c042c014e2302c7147068c419c15562f2b0ef" gracePeriod=30
Jul 20 13:31:25.402771 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:31:25.402679    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-704386e9-openshift-default-bc5b85b87-5dk95"]
Jul 20 13:31:25.403150 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:31:25.403133    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="38dbfad6-5258-4812-8268-907e2c36096d" containerName="maas-api"
Jul 20 13:31:25.403150 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:31:25.403147    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="38dbfad6-5258-4812-8268-907e2c36096d" containerName="maas-api"
Jul 20 13:31:25.403338 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:31:25.403214    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="38dbfad6-5258-4812-8268-907e2c36096d" containerName="maas-api"
Jul 20 13:31:25.405360 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:31:25.405341    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-704386e9-openshift-default-bc5b85b87-5dk95"
Jul 20 13:31:25.407500 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:31:25.407478    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-704386e9-openshift-default-dockercfg-hnprc\""
Jul 20 13:31:25.419687 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:31:25.419665    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-704386e9-openshift-default-bc5b85b87-5dk95"]
Jul 20 13:31:25.496836 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:31:25.496806    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7228240c-caa8-404b-b38a-c7d7403736f4-istio-envoy\") pod \"e2e-derive-704386e9-openshift-default-bc5b85b87-5dk95\" (UID: \"7228240c-caa8-404b-b38a-c7d7403736f4\") " pod="openshift-ingress/e2e-derive-704386e9-openshift-default-bc5b85b87-5dk95"
Jul 20 13:31:25.497000 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:31:25.496840    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7228240c-caa8-404b-b38a-c7d7403736f4-istio-data\") pod \"e2e-derive-704386e9-openshift-default-bc5b85b87-5dk95\" (UID: \"7228240c-caa8-404b-b38a-c7d7403736f4\") " pod="openshift-ingress/e2e-derive-704386e9-openshift-default-bc5b85b87-5dk95"
Jul 20 13:31:25.497000 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:31:25.496861    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7228240c-caa8-404b-b38a-c7d7403736f4-credential-socket\") pod \"e2e-derive-704386e9-openshift-default-bc5b85b87-5dk95\" (UID: \"7228240c-caa8-404b-b38a-c7d7403736f4\") " pod="openshift-ingress/e2e-derive-704386e9-openshift-default-bc5b85b87-5dk95"
Jul 20 13:31:25.497000 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:31:25.496905    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p96sq\" (UniqueName: \"kubernetes.io/projected/7228240c-caa8-404b-b38a-c7d7403736f4-kube-api-access-p96sq\") pod \"e2e-derive-704386e9-openshift-default-bc5b85b87-5dk95\" (UID: \"7228240c-caa8-404b-b38a-c7d7403736f4\") " pod="openshift-ingress/e2e-derive-704386e9-openshift-default-bc5b85b87-5dk95"
Jul 20 13:31:25.497000 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:31:25.496932    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7228240c-caa8-404b-b38a-c7d7403736f4-workload-socket\") pod \"e2e-derive-704386e9-openshift-default-bc5b85b87-5dk95\" (UID: \"7228240c-caa8-404b-b38a-c7d7403736f4\") " pod="openshift-ingress/e2e-derive-704386e9-openshift-default-bc5b85b87-5dk95"
Jul 20 13:31:25.497000 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:31:25.496958    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7228240c-caa8-404b-b38a-c7d7403736f4-istio-token\") pod \"e2e-derive-704386e9-openshift-default-bc5b85b87-5dk95\" (UID: \"7228240c-caa8-404b-b38a-c7d7403736f4\") " pod="openshift-ingress/e2e-derive-704386e9-openshift-default-bc5b85b87-5dk95"
Jul 20 13:31:25.497169 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:31:25.497033    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7228240c-caa8-404b-b38a-c7d7403736f4-istio-podinfo\") pod \"e2e-derive-704386e9-openshift-default-bc5b85b87-5dk95\" (UID: \"7228240c-caa8-404b-b38a-c7d7403736f4\") " pod="openshift-ingress/e2e-derive-704386e9-openshift-default-bc5b85b87-5dk95"
Jul 20 13:31:25.497169 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:31:25.497054    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7228240c-caa8-404b-b38a-c7d7403736f4-workload-certs\") pod \"e2e-derive-704386e9-openshift-default-bc5b85b87-5dk95\" (UID: \"7228240c-caa8-404b-b38a-c7d7403736f4\") " pod="openshift-ingress/e2e-derive-704386e9-openshift-default-bc5b85b87-5dk95"
Jul 20 13:31:25.497231 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:31:25.497170    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7228240c-caa8-404b-b38a-c7d7403736f4-istiod-ca-cert\") pod \"e2e-derive-704386e9-openshift-default-bc5b85b87-5dk95\" (UID: \"7228240c-caa8-404b-b38a-c7d7403736f4\") " pod="openshift-ingress/e2e-derive-704386e9-openshift-default-bc5b85b87-5dk95"
Jul 20 13:31:25.598328 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:31:25.598295    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7228240c-caa8-404b-b38a-c7d7403736f4-istiod-ca-cert\") pod \"e2e-derive-704386e9-openshift-default-bc5b85b87-5dk95\" (UID: \"7228240c-caa8-404b-b38a-c7d7403736f4\") " pod="openshift-ingress/e2e-derive-704386e9-openshift-default-bc5b85b87-5dk95"
Jul 20 13:31:25.598328 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:31:25.598331    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7228240c-caa8-404b-b38a-c7d7403736f4-istio-envoy\") pod \"e2e-derive-704386e9-openshift-default-bc5b85b87-5dk95\" (UID: \"7228240c-caa8-404b-b38a-c7d7403736f4\") " pod="openshift-ingress/e2e-derive-704386e9-openshift-default-bc5b85b87-5dk95"
Jul 20 13:31:25.598582 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:31:25.598349    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7228240c-caa8-404b-b38a-c7d7403736f4-istio-data\") pod \"e2e-derive-704386e9-openshift-default-bc5b85b87-5dk95\" (UID: \"7228240c-caa8-404b-b38a-c7d7403736f4\") " pod="openshift-ingress/e2e-derive-704386e9-openshift-default-bc5b85b87-5dk95"
Jul 20 13:31:25.598582 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:31:25.598365    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7228240c-caa8-404b-b38a-c7d7403736f4-credential-socket\") pod \"e2e-derive-704386e9-openshift-default-bc5b85b87-5dk95\" (UID: \"7228240c-caa8-404b-b38a-c7d7403736f4\") " pod="openshift-ingress/e2e-derive-704386e9-openshift-default-bc5b85b87-5dk95"
Jul 20 13:31:25.598582 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:31:25.598382    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p96sq\" (UniqueName: \"kubernetes.io/projected/7228240c-caa8-404b-b38a-c7d7403736f4-kube-api-access-p96sq\") pod \"e2e-derive-704386e9-openshift-default-bc5b85b87-5dk95\" (UID: \"7228240c-caa8-404b-b38a-c7d7403736f4\") " pod="openshift-ingress/e2e-derive-704386e9-openshift-default-bc5b85b87-5dk95"
Jul 20 13:31:25.598582 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:31:25.598399    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7228240c-caa8-404b-b38a-c7d7403736f4-workload-socket\") pod \"e2e-derive-704386e9-openshift-default-bc5b85b87-5dk95\" (UID: \"7228240c-caa8-404b-b38a-c7d7403736f4\") " pod="openshift-ingress/e2e-derive-704386e9-openshift-default-bc5b85b87-5dk95"
Jul 20 13:31:25.598582 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:31:25.598531    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7228240c-caa8-404b-b38a-c7d7403736f4-istio-token\") pod \"e2e-derive-704386e9-openshift-default-bc5b85b87-5dk95\" (UID: \"7228240c-caa8-404b-b38a-c7d7403736f4\") " pod="openshift-ingress/e2e-derive-704386e9-openshift-default-bc5b85b87-5dk95"
Jul 20 13:31:25.598582 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:31:25.598581    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7228240c-caa8-404b-b38a-c7d7403736f4-istio-podinfo\") pod \"e2e-derive-704386e9-openshift-default-bc5b85b87-5dk95\" (UID: \"7228240c-caa8-404b-b38a-c7d7403736f4\") " pod="openshift-ingress/e2e-derive-704386e9-openshift-default-bc5b85b87-5dk95"
Jul 20 13:31:25.598886 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:31:25.598609    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7228240c-caa8-404b-b38a-c7d7403736f4-workload-certs\") pod \"e2e-derive-704386e9-openshift-default-bc5b85b87-5dk95\" (UID: \"7228240c-caa8-404b-b38a-c7d7403736f4\") " pod="openshift-ingress/e2e-derive-704386e9-openshift-default-bc5b85b87-5dk95"
Jul 20 13:31:25.598886 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:31:25.598812    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7228240c-caa8-404b-b38a-c7d7403736f4-workload-socket\") pod \"e2e-derive-704386e9-openshift-default-bc5b85b87-5dk95\" (UID: \"7228240c-caa8-404b-b38a-c7d7403736f4\") " pod="openshift-ingress/e2e-derive-704386e9-openshift-default-bc5b85b87-5dk95"
Jul 20 13:31:25.598886 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:31:25.598863    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7228240c-caa8-404b-b38a-c7d7403736f4-istio-data\") pod \"e2e-derive-704386e9-openshift-default-bc5b85b87-5dk95\" (UID: \"7228240c-caa8-404b-b38a-c7d7403736f4\") " pod="openshift-ingress/e2e-derive-704386e9-openshift-default-bc5b85b87-5dk95"
Jul 20 13:31:25.599044 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:31:25.598931    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7228240c-caa8-404b-b38a-c7d7403736f4-credential-socket\") pod \"e2e-derive-704386e9-openshift-default-bc5b85b87-5dk95\" (UID: \"7228240c-caa8-404b-b38a-c7d7403736f4\") " pod="openshift-ingress/e2e-derive-704386e9-openshift-default-bc5b85b87-5dk95"
Jul 20 13:31:25.599122 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:31:25.599106    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7228240c-caa8-404b-b38a-c7d7403736f4-workload-certs\") pod \"e2e-derive-704386e9-openshift-default-bc5b85b87-5dk95\" (UID: \"7228240c-caa8-404b-b38a-c7d7403736f4\") " pod="openshift-ingress/e2e-derive-704386e9-openshift-default-bc5b85b87-5dk95"
Jul 20 13:31:25.599165 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:31:25.599124    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7228240c-caa8-404b-b38a-c7d7403736f4-istiod-ca-cert\") pod \"e2e-derive-704386e9-openshift-default-bc5b85b87-5dk95\" (UID: \"7228240c-caa8-404b-b38a-c7d7403736f4\") " pod="openshift-ingress/e2e-derive-704386e9-openshift-default-bc5b85b87-5dk95"
Jul 20 13:31:25.600857 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:31:25.600834    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7228240c-caa8-404b-b38a-c7d7403736f4-istio-envoy\") pod \"e2e-derive-704386e9-openshift-default-bc5b85b87-5dk95\" (UID: \"7228240c-caa8-404b-b38a-c7d7403736f4\") " pod="openshift-ingress/e2e-derive-704386e9-openshift-default-bc5b85b87-5dk95"
Jul 20 13:31:25.600938 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:31:25.600895    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7228240c-caa8-404b-b38a-c7d7403736f4-istio-podinfo\") pod \"e2e-derive-704386e9-openshift-default-bc5b85b87-5dk95\" (UID: \"7228240c-caa8-404b-b38a-c7d7403736f4\") " pod="openshift-ingress/e2e-derive-704386e9-openshift-default-bc5b85b87-5dk95"
Jul 20 13:31:25.606695 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:31:25.606667    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7228240c-caa8-404b-b38a-c7d7403736f4-istio-token\") pod \"e2e-derive-704386e9-openshift-default-bc5b85b87-5dk95\" (UID: \"7228240c-caa8-404b-b38a-c7d7403736f4\") " pod="openshift-ingress/e2e-derive-704386e9-openshift-default-bc5b85b87-5dk95"
Jul 20 13:31:25.606780 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:31:25.606694    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p96sq\" (UniqueName: \"kubernetes.io/projected/7228240c-caa8-404b-b38a-c7d7403736f4-kube-api-access-p96sq\") pod \"e2e-derive-704386e9-openshift-default-bc5b85b87-5dk95\" (UID: \"7228240c-caa8-404b-b38a-c7d7403736f4\") " pod="openshift-ingress/e2e-derive-704386e9-openshift-default-bc5b85b87-5dk95"
Jul 20 13:31:25.717497 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:31:25.717403    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-704386e9-openshift-default-bc5b85b87-5dk95"
Jul 20 13:31:25.853190 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:31:25.853168    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-704386e9-openshift-default-bc5b85b87-5dk95"]
Jul 20 13:31:25.855336 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:31:25.855309    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7228240c_caa8_404b_b38a_c7d7403736f4.slice/crio-cd1547e57af7de4ec81fc08d0d1d7cd87bfef5d3a6f82844a1d31098f6ce4e79 WatchSource:0}: Error finding container cd1547e57af7de4ec81fc08d0d1d7cd87bfef5d3a6f82844a1d31098f6ce4e79: Status 404 returned error can't find the container with id cd1547e57af7de4ec81fc08d0d1d7cd87bfef5d3a6f82844a1d31098f6ce4e79
Jul 20 13:31:25.857399 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:31:25.857366    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 20 13:31:25.857487 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:31:25.857434    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 20 13:31:25.857487 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:31:25.857463    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 20 13:31:25.977366 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:31:25.977281    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-704386e9-openshift-default-bc5b85b87-5dk95" event={"ID":"7228240c-caa8-404b-b38a-c7d7403736f4","Type":"ContainerStarted","Data":"7b562f96e3fa3ae1e5a064d5d9c8ae1a744ff4df3b87897e6922eea211ede4bc"}
Jul 20 13:31:25.977366 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:31:25.977338    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-704386e9-openshift-default-bc5b85b87-5dk95" event={"ID":"7228240c-caa8-404b-b38a-c7d7403736f4","Type":"ContainerStarted","Data":"cd1547e57af7de4ec81fc08d0d1d7cd87bfef5d3a6f82844a1d31098f6ce4e79"}
Jul 20 13:31:26.002082 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:31:25.998638    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-704386e9-openshift-default-bc5b85b87-5dk95" podStartSLOduration=0.998616585 podStartE2EDuration="998.616585ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 13:31:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 13:31:25.994325327 +0000 UTC m=+1775.710872742" watchObservedRunningTime="2026-07-20 13:31:25.998616585 +0000 UTC m=+1775.715163995"
Jul 20 13:31:26.718578 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:31:26.718541    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-704386e9-openshift-default-bc5b85b87-5dk95"
Jul 20 13:31:26.723589 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:31:26.723560    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-704386e9-openshift-default-bc5b85b87-5dk95"
Jul 20 13:31:26.790630 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:31:26.790603    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-704386e9-b95d74f8-jnlrq"]
Jul 20 13:31:26.793483 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:31:26.793460    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-704386e9-b95d74f8-jnlrq"
Jul 20 13:31:26.795653 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:31:26.795608    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-vf2sw\""
Jul 20 13:31:26.795810 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:31:26.795793    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-derive-704386e9-serving-cert\""
Jul 20 13:31:26.815505 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:31:26.815484    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-704386e9-b95d74f8-jnlrq"]
Jul 20 13:31:26.914296 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:31:26.914263    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wqrr7\" (UniqueName: \"kubernetes.io/projected/e040e5b0-a0cd-4099-a399-696c5ab85eae-kube-api-access-wqrr7\") pod \"maas-api-e2e-derive-704386e9-b95d74f8-jnlrq\" (UID: \"e040e5b0-a0cd-4099-a399-696c5ab85eae\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-704386e9-b95d74f8-jnlrq"
Jul 20 13:31:26.914466 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:31:26.914333    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e040e5b0-a0cd-4099-a399-696c5ab85eae-openshift-service-ca\") pod \"maas-api-e2e-derive-704386e9-b95d74f8-jnlrq\" (UID: \"e040e5b0-a0cd-4099-a399-696c5ab85eae\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-704386e9-b95d74f8-jnlrq"
Jul 20 13:31:26.914466 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:31:26.914368    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e040e5b0-a0cd-4099-a399-696c5ab85eae-maas-api-tls\") pod \"maas-api-e2e-derive-704386e9-b95d74f8-jnlrq\" (UID: \"e040e5b0-a0cd-4099-a399-696c5ab85eae\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-704386e9-b95d74f8-jnlrq"
Jul 20 13:31:26.982569 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:31:26.982480    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-704386e9-openshift-default-bc5b85b87-5dk95"
Jul 20 13:31:26.983296 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:31:26.983271    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-704386e9-openshift-default-bc5b85b87-5dk95"
Jul 20 13:31:27.014819 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:31:27.014791    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e040e5b0-a0cd-4099-a399-696c5ab85eae-openshift-service-ca\") pod \"maas-api-e2e-derive-704386e9-b95d74f8-jnlrq\" (UID: \"e040e5b0-a0cd-4099-a399-696c5ab85eae\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-704386e9-b95d74f8-jnlrq"
Jul 20 13:31:27.015013 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:31:27.014849    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e040e5b0-a0cd-4099-a399-696c5ab85eae-maas-api-tls\") pod \"maas-api-e2e-derive-704386e9-b95d74f8-jnlrq\" (UID: \"e040e5b0-a0cd-4099-a399-696c5ab85eae\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-704386e9-b95d74f8-jnlrq"
Jul 20 13:31:27.015013 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:31:27.014935    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wqrr7\" (UniqueName: \"kubernetes.io/projected/e040e5b0-a0cd-4099-a399-696c5ab85eae-kube-api-access-wqrr7\") pod \"maas-api-e2e-derive-704386e9-b95d74f8-jnlrq\" (UID: \"e040e5b0-a0cd-4099-a399-696c5ab85eae\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-704386e9-b95d74f8-jnlrq"
Jul 20 13:31:27.015343 ip-10-0-134-121 kubenswrapper[2584]: E0720 13:31:27.015325    2584 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-derive-704386e9-serving-cert: secret "maas-api-e2e-derive-704386e9-serving-cert" not found
Jul 20 13:31:27.015407 ip-10-0-134-121 kubenswrapper[2584]: E0720 13:31:27.015387    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e040e5b0-a0cd-4099-a399-696c5ab85eae-maas-api-tls podName:e040e5b0-a0cd-4099-a399-696c5ab85eae nodeName:}" failed. No retries permitted until 2026-07-20 13:31:27.515369099 +0000 UTC m=+1777.231916493 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/e040e5b0-a0cd-4099-a399-696c5ab85eae-maas-api-tls") pod "maas-api-e2e-derive-704386e9-b95d74f8-jnlrq" (UID: "e040e5b0-a0cd-4099-a399-696c5ab85eae") : secret "maas-api-e2e-derive-704386e9-serving-cert" not found
Jul 20 13:31:27.015604 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:31:27.015583    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e040e5b0-a0cd-4099-a399-696c5ab85eae-openshift-service-ca\") pod \"maas-api-e2e-derive-704386e9-b95d74f8-jnlrq\" (UID: \"e040e5b0-a0cd-4099-a399-696c5ab85eae\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-704386e9-b95d74f8-jnlrq"
Jul 20 13:31:27.025149 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:31:27.025123    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wqrr7\" (UniqueName: \"kubernetes.io/projected/e040e5b0-a0cd-4099-a399-696c5ab85eae-kube-api-access-wqrr7\") pod \"maas-api-e2e-derive-704386e9-b95d74f8-jnlrq\" (UID: \"e040e5b0-a0cd-4099-a399-696c5ab85eae\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-704386e9-b95d74f8-jnlrq"
Jul 20 13:31:27.519958 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:31:27.519922    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e040e5b0-a0cd-4099-a399-696c5ab85eae-maas-api-tls\") pod \"maas-api-e2e-derive-704386e9-b95d74f8-jnlrq\" (UID: \"e040e5b0-a0cd-4099-a399-696c5ab85eae\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-704386e9-b95d74f8-jnlrq"
Jul 20 13:31:27.520157 ip-10-0-134-121 kubenswrapper[2584]: E0720 13:31:27.520063    2584 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-derive-704386e9-serving-cert: secret "maas-api-e2e-derive-704386e9-serving-cert" not found
Jul 20 13:31:27.520157 ip-10-0-134-121 kubenswrapper[2584]: E0720 13:31:27.520132    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e040e5b0-a0cd-4099-a399-696c5ab85eae-maas-api-tls podName:e040e5b0-a0cd-4099-a399-696c5ab85eae nodeName:}" failed. No retries permitted until 2026-07-20 13:31:28.52011762 +0000 UTC m=+1778.236665008 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/e040e5b0-a0cd-4099-a399-696c5ab85eae-maas-api-tls") pod "maas-api-e2e-derive-704386e9-b95d74f8-jnlrq" (UID: "e040e5b0-a0cd-4099-a399-696c5ab85eae") : secret "maas-api-e2e-derive-704386e9-serving-cert" not found
Jul 20 13:31:28.530596 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:31:28.530561    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e040e5b0-a0cd-4099-a399-696c5ab85eae-maas-api-tls\") pod \"maas-api-e2e-derive-704386e9-b95d74f8-jnlrq\" (UID: \"e040e5b0-a0cd-4099-a399-696c5ab85eae\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-704386e9-b95d74f8-jnlrq"
Jul 20 13:31:28.532910 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:31:28.532892    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e040e5b0-a0cd-4099-a399-696c5ab85eae-maas-api-tls\") pod \"maas-api-e2e-derive-704386e9-b95d74f8-jnlrq\" (UID: \"e040e5b0-a0cd-4099-a399-696c5ab85eae\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-704386e9-b95d74f8-jnlrq"
Jul 20 13:31:28.604281 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:31:28.604255    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-704386e9-b95d74f8-jnlrq"
Jul 20 13:31:28.737527 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:31:28.737502    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-704386e9-b95d74f8-jnlrq"]
Jul 20 13:31:28.738955 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:31:28.738921    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode040e5b0_a0cd_4099_a399_696c5ab85eae.slice/crio-370899fb7dd38601a3fa9962e47968f388a4b852d4e03c7b550ad84572570624 WatchSource:0}: Error finding container 370899fb7dd38601a3fa9962e47968f388a4b852d4e03c7b550ad84572570624: Status 404 returned error can't find the container with id 370899fb7dd38601a3fa9962e47968f388a4b852d4e03c7b550ad84572570624
Jul 20 13:31:28.992572 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:31:28.992536    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-704386e9-b95d74f8-jnlrq" event={"ID":"e040e5b0-a0cd-4099-a399-696c5ab85eae","Type":"ContainerStarted","Data":"370899fb7dd38601a3fa9962e47968f388a4b852d4e03c7b550ad84572570624"}
Jul 20 13:31:30.003240 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:31:30.003199    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-704386e9-b95d74f8-jnlrq" event={"ID":"e040e5b0-a0cd-4099-a399-696c5ab85eae","Type":"ContainerStarted","Data":"b5c76dc60e038576746c61d05bf60dd876845114b29f4585aea832cde7e32f7a"}
Jul 20 13:31:30.003668 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:31:30.003267    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-704386e9-b95d74f8-jnlrq"
Jul 20 13:31:30.041353 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:31:30.041287    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-derive-704386e9-b95d74f8-jnlrq" podStartSLOduration=3.596051456 podStartE2EDuration="4.041259199s" totalImagesPullingTime="445.207743ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 13:31:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 13:31:30.036746127 +0000 UTC m=+1779.753293538" watchObservedRunningTime="2026-07-20 13:31:30.041259199 +0000 UTC m=+1779.757806609"
Jul 20 13:31:30.381810 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:31:30.381786    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-22b1bd43-openshift-default-789f47496c-59nwb"
Jul 20 13:31:30.552045 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:31:30.551938    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3d81acb0-7210-4422-b6c5-e08ace19c3bc-istio-envoy\") pod \"3d81acb0-7210-4422-b6c5-e08ace19c3bc\" (UID: \"3d81acb0-7210-4422-b6c5-e08ace19c3bc\") "
Jul 20 13:31:30.552045 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:31:30.552003    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3d81acb0-7210-4422-b6c5-e08ace19c3bc-istiod-ca-cert\") pod \"3d81acb0-7210-4422-b6c5-e08ace19c3bc\" (UID: \"3d81acb0-7210-4422-b6c5-e08ace19c3bc\") "
Jul 20 13:31:30.552279 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:31:30.552076    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3d81acb0-7210-4422-b6c5-e08ace19c3bc-workload-certs\") pod \"3d81acb0-7210-4422-b6c5-e08ace19c3bc\" (UID: \"3d81acb0-7210-4422-b6c5-e08ace19c3bc\") "
Jul 20 13:31:30.552279 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:31:30.552098    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3d81acb0-7210-4422-b6c5-e08ace19c3bc-istio-data\") pod \"3d81acb0-7210-4422-b6c5-e08ace19c3bc\" (UID: \"3d81acb0-7210-4422-b6c5-e08ace19c3bc\") "
Jul 20 13:31:30.552279 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:31:30.552143    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3d81acb0-7210-4422-b6c5-e08ace19c3bc-credential-socket\") pod \"3d81acb0-7210-4422-b6c5-e08ace19c3bc\" (UID: \"3d81acb0-7210-4422-b6c5-e08ace19c3bc\") "
Jul 20 13:31:30.552279 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:31:30.552174    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3d81acb0-7210-4422-b6c5-e08ace19c3bc-istio-podinfo\") pod \"3d81acb0-7210-4422-b6c5-e08ace19c3bc\" (UID: \"3d81acb0-7210-4422-b6c5-e08ace19c3bc\") "
Jul 20 13:31:30.552279 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:31:30.552212    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3d81acb0-7210-4422-b6c5-e08ace19c3bc-istio-token\") pod \"3d81acb0-7210-4422-b6c5-e08ace19c3bc\" (UID: \"3d81acb0-7210-4422-b6c5-e08ace19c3bc\") "
Jul 20 13:31:30.552554 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:31:30.552274    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3d81acb0-7210-4422-b6c5-e08ace19c3bc-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "3d81acb0-7210-4422-b6c5-e08ace19c3bc" (UID: "3d81acb0-7210-4422-b6c5-e08ace19c3bc"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 13:31:30.552554 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:31:30.552290    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3d81acb0-7210-4422-b6c5-e08ace19c3bc-workload-socket\") pod \"3d81acb0-7210-4422-b6c5-e08ace19c3bc\" (UID: \"3d81acb0-7210-4422-b6c5-e08ace19c3bc\") "
Jul 20 13:31:30.552554 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:31:30.552343    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zmhkx\" (UniqueName: \"kubernetes.io/projected/3d81acb0-7210-4422-b6c5-e08ace19c3bc-kube-api-access-zmhkx\") pod \"3d81acb0-7210-4422-b6c5-e08ace19c3bc\" (UID: \"3d81acb0-7210-4422-b6c5-e08ace19c3bc\") "
Jul 20 13:31:30.552554 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:31:30.552425    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3d81acb0-7210-4422-b6c5-e08ace19c3bc-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "3d81acb0-7210-4422-b6c5-e08ace19c3bc" (UID: "3d81acb0-7210-4422-b6c5-e08ace19c3bc"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 13:31:30.552554 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:31:30.552448    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3d81acb0-7210-4422-b6c5-e08ace19c3bc-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "3d81acb0-7210-4422-b6c5-e08ace19c3bc" (UID: "3d81acb0-7210-4422-b6c5-e08ace19c3bc"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 13:31:30.552554 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:31:30.552528    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3d81acb0-7210-4422-b6c5-e08ace19c3bc-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "3d81acb0-7210-4422-b6c5-e08ace19c3bc" (UID: "3d81acb0-7210-4422-b6c5-e08ace19c3bc"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 13:31:30.552934 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:31:30.552801    2584 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3d81acb0-7210-4422-b6c5-e08ace19c3bc-workload-certs\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 20 13:31:30.552934 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:31:30.552822    2584 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3d81acb0-7210-4422-b6c5-e08ace19c3bc-credential-socket\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 20 13:31:30.552934 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:31:30.552835    2584 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3d81acb0-7210-4422-b6c5-e08ace19c3bc-workload-socket\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 20 13:31:30.552934 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:31:30.552844    2584 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3d81acb0-7210-4422-b6c5-e08ace19c3bc-istiod-ca-cert\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 20 13:31:30.553113 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:31:30.552949    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3d81acb0-7210-4422-b6c5-e08ace19c3bc-istio-data" (OuterVolumeSpecName: "istio-data") pod "3d81acb0-7210-4422-b6c5-e08ace19c3bc" (UID: "3d81acb0-7210-4422-b6c5-e08ace19c3bc"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 13:31:30.554667 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:31:30.554636    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/3d81acb0-7210-4422-b6c5-e08ace19c3bc-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "3d81acb0-7210-4422-b6c5-e08ace19c3bc" (UID: "3d81acb0-7210-4422-b6c5-e08ace19c3bc"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 20 13:31:30.554667 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:31:30.554639    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3d81acb0-7210-4422-b6c5-e08ace19c3bc-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "3d81acb0-7210-4422-b6c5-e08ace19c3bc" (UID: "3d81acb0-7210-4422-b6c5-e08ace19c3bc"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 13:31:30.554860 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:31:30.554842    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3d81acb0-7210-4422-b6c5-e08ace19c3bc-kube-api-access-zmhkx" (OuterVolumeSpecName: "kube-api-access-zmhkx") pod "3d81acb0-7210-4422-b6c5-e08ace19c3bc" (UID: "3d81acb0-7210-4422-b6c5-e08ace19c3bc"). InnerVolumeSpecName "kube-api-access-zmhkx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 13:31:30.555345 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:31:30.555326    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3d81acb0-7210-4422-b6c5-e08ace19c3bc-istio-token" (OuterVolumeSpecName: "istio-token") pod "3d81acb0-7210-4422-b6c5-e08ace19c3bc" (UID: "3d81acb0-7210-4422-b6c5-e08ace19c3bc"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 13:31:30.654405 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:31:30.654371    2584 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3d81acb0-7210-4422-b6c5-e08ace19c3bc-istio-data\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 20 13:31:30.654405 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:31:30.654401    2584 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3d81acb0-7210-4422-b6c5-e08ace19c3bc-istio-podinfo\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 20 13:31:30.654405 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:31:30.654412    2584 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3d81acb0-7210-4422-b6c5-e08ace19c3bc-istio-token\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 20 13:31:30.654682 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:31:30.654424    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zmhkx\" (UniqueName: \"kubernetes.io/projected/3d81acb0-7210-4422-b6c5-e08ace19c3bc-kube-api-access-zmhkx\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 20 13:31:30.654682 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:31:30.654437    2584 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3d81acb0-7210-4422-b6c5-e08ace19c3bc-istio-envoy\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 20 13:31:31.011728 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:31:31.011695    2584 generic.go:356] "Generic (PLEG): container finished" podID="3d81acb0-7210-4422-b6c5-e08ace19c3bc" containerID="35e6c7e0330b7a46e098e407e39c042c014e2302c7147068c419c15562f2b0ef" exitCode=0
Jul 20 13:31:31.012207 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:31:31.011757    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-22b1bd43-openshift-default-789f47496c-59nwb"
Jul 20 13:31:31.012207 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:31:31.011792    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-22b1bd43-openshift-default-789f47496c-59nwb" event={"ID":"3d81acb0-7210-4422-b6c5-e08ace19c3bc","Type":"ContainerDied","Data":"35e6c7e0330b7a46e098e407e39c042c014e2302c7147068c419c15562f2b0ef"}
Jul 20 13:31:31.012207 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:31:31.011864    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-22b1bd43-openshift-default-789f47496c-59nwb" event={"ID":"3d81acb0-7210-4422-b6c5-e08ace19c3bc","Type":"ContainerDied","Data":"9c897c9a70454f29bbdf314d89c0f05f41a5cb61b5959923480a92923c2fb85c"}
Jul 20 13:31:31.012207 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:31:31.011897    2584 scope.go:117] "RemoveContainer" containerID="35e6c7e0330b7a46e098e407e39c042c014e2302c7147068c419c15562f2b0ef"
Jul 20 13:31:31.021086 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:31:31.021069    2584 scope.go:117] "RemoveContainer" containerID="5ca327955eceb481ff93c26de3df6c0fd054580ac494f4ce880bbc90478489b5"
Jul 20 13:31:31.046391 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:31:31.046155    2584 scope.go:117] "RemoveContainer" containerID="35e6c7e0330b7a46e098e407e39c042c014e2302c7147068c419c15562f2b0ef"
Jul 20 13:31:31.046391 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:31:31.046336    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-22b1bd43-openshift-default-789f47496c-59nwb"]
Jul 20 13:31:31.050340 ip-10-0-134-121 kubenswrapper[2584]: E0720 13:31:31.050088    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"35e6c7e0330b7a46e098e407e39c042c014e2302c7147068c419c15562f2b0ef\": container with ID starting with 35e6c7e0330b7a46e098e407e39c042c014e2302c7147068c419c15562f2b0ef not found: ID does not exist" containerID="35e6c7e0330b7a46e098e407e39c042c014e2302c7147068c419c15562f2b0ef"
Jul 20 13:31:31.050340 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:31:31.050125    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"35e6c7e0330b7a46e098e407e39c042c014e2302c7147068c419c15562f2b0ef"} err="failed to get container status \"35e6c7e0330b7a46e098e407e39c042c014e2302c7147068c419c15562f2b0ef\": rpc error: code = NotFound desc = could not find container \"35e6c7e0330b7a46e098e407e39c042c014e2302c7147068c419c15562f2b0ef\": container with ID starting with 35e6c7e0330b7a46e098e407e39c042c014e2302c7147068c419c15562f2b0ef not found: ID does not exist"
Jul 20 13:31:31.050340 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:31:31.050150    2584 scope.go:117] "RemoveContainer" containerID="5ca327955eceb481ff93c26de3df6c0fd054580ac494f4ce880bbc90478489b5"
Jul 20 13:31:31.050861 ip-10-0-134-121 kubenswrapper[2584]: E0720 13:31:31.050797    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5ca327955eceb481ff93c26de3df6c0fd054580ac494f4ce880bbc90478489b5\": container with ID starting with 5ca327955eceb481ff93c26de3df6c0fd054580ac494f4ce880bbc90478489b5 not found: ID does not exist" containerID="5ca327955eceb481ff93c26de3df6c0fd054580ac494f4ce880bbc90478489b5"
Jul 20 13:31:31.050861 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:31:31.050829    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5ca327955eceb481ff93c26de3df6c0fd054580ac494f4ce880bbc90478489b5"} err="failed to get container status \"5ca327955eceb481ff93c26de3df6c0fd054580ac494f4ce880bbc90478489b5\": rpc error: code = NotFound desc = could not find container \"5ca327955eceb481ff93c26de3df6c0fd054580ac494f4ce880bbc90478489b5\": container with ID starting with 5ca327955eceb481ff93c26de3df6c0fd054580ac494f4ce880bbc90478489b5 not found: ID does not exist"
Jul 20 13:31:31.054647 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:31:31.053776    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-22b1bd43-openshift-default-789f47496c-59nwb"]
Jul 20 13:31:31.095118 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:31:31.095096    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3d81acb0-7210-4422-b6c5-e08ace19c3bc" path="/var/lib/kubelet/pods/3d81acb0-7210-4422-b6c5-e08ace19c3bc/volumes"
Jul 20 13:31:36.019083 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:31:36.019057    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-704386e9-b95d74f8-jnlrq"
Jul 20 13:31:37.048282 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:31:37.048216    2584 generic.go:356] "Generic (PLEG): container finished" podID="7228240c-caa8-404b-b38a-c7d7403736f4" containerID="7b562f96e3fa3ae1e5a064d5d9c8ae1a744ff4df3b87897e6922eea211ede4bc" exitCode=0
Jul 20 13:31:37.048282 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:31:37.048269    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-704386e9-openshift-default-bc5b85b87-5dk95" event={"ID":"7228240c-caa8-404b-b38a-c7d7403736f4","Type":"ContainerDied","Data":"7b562f96e3fa3ae1e5a064d5d9c8ae1a744ff4df3b87897e6922eea211ede4bc"}
Jul 20 13:31:37.048745 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:31:37.048601    2584 scope.go:117] "RemoveContainer" containerID="7b562f96e3fa3ae1e5a064d5d9c8ae1a744ff4df3b87897e6922eea211ede4bc"
Jul 20 13:31:37.049761 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:31:37.049623    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 20 13:31:37.049761 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:31:37.049699    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 20 13:31:37.049761 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:31:37.049746    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 20 13:31:38.055386 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:31:38.055349    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-704386e9-openshift-default-bc5b85b87-5dk95" event={"ID":"7228240c-caa8-404b-b38a-c7d7403736f4","Type":"ContainerStarted","Data":"8b1b6ede67897e7cfb775808bf757872c138181f32a3eeb132bd2a544c41ff91"}
Jul 20 13:31:38.718433 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:31:38.718401    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-704386e9-openshift-default-bc5b85b87-5dk95"
Jul 20 13:31:38.719312 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:31:38.719282    2584 patch_prober.go:28] interesting pod/e2e-derive-704386e9-openshift-default-bc5b85b87-5dk95 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused" start-of-body=
Jul 20 13:31:38.719449 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:31:38.719332    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-704386e9-openshift-default-bc5b85b87-5dk95" podUID="7228240c-caa8-404b-b38a-c7d7403736f4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused"
Jul 20 13:31:39.718070 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:31:39.718036    2584 patch_prober.go:28] interesting pod/e2e-derive-704386e9-openshift-default-bc5b85b87-5dk95 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused" start-of-body=
Jul 20 13:31:39.718444 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:31:39.718100    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-704386e9-openshift-default-bc5b85b87-5dk95" podUID="7228240c-caa8-404b-b38a-c7d7403736f4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused"
Jul 20 13:31:40.718438 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:31:40.718402    2584 patch_prober.go:28] interesting pod/e2e-derive-704386e9-openshift-default-bc5b85b87-5dk95 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused" start-of-body=
Jul 20 13:31:40.718824 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:31:40.718472    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-704386e9-openshift-default-bc5b85b87-5dk95" podUID="7228240c-caa8-404b-b38a-c7d7403736f4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused"
Jul 20 13:31:41.718319 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:31:41.718281    2584 patch_prober.go:28] interesting pod/e2e-derive-704386e9-openshift-default-bc5b85b87-5dk95 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused" start-of-body=
Jul 20 13:31:41.718504 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:31:41.718366    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-704386e9-openshift-default-bc5b85b87-5dk95" podUID="7228240c-caa8-404b-b38a-c7d7403736f4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused"
Jul 20 13:31:41.982657 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:31:41.982577    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-704386e9-openshift-default-bc5b85b87-5dk95"
Jul 20 13:31:42.722275 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:31:42.722251    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-704386e9-openshift-default-bc5b85b87-5dk95"
Jul 20 13:31:42.723306 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:31:42.723283    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-704386e9-openshift-default-bc5b85b87-5dk95"
Jul 20 13:32:31.720697 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:32:31.720658    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-704386e9-b95d74f8-jnlrq"]
Jul 20 13:32:31.721286 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:32:31.720908    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-derive-704386e9-b95d74f8-jnlrq" podUID="e040e5b0-a0cd-4099-a399-696c5ab85eae" containerName="maas-api" containerID="cri-o://b5c76dc60e038576746c61d05bf60dd876845114b29f4585aea832cde7e32f7a" gracePeriod=30
Jul 20 13:32:31.970551 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:32:31.970529    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-704386e9-b95d74f8-jnlrq"
Jul 20 13:32:32.024260 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:32:32.024233    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e040e5b0-a0cd-4099-a399-696c5ab85eae-maas-api-tls\") pod \"e040e5b0-a0cd-4099-a399-696c5ab85eae\" (UID: \"e040e5b0-a0cd-4099-a399-696c5ab85eae\") "
Jul 20 13:32:32.024490 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:32:32.024316    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wqrr7\" (UniqueName: \"kubernetes.io/projected/e040e5b0-a0cd-4099-a399-696c5ab85eae-kube-api-access-wqrr7\") pod \"e040e5b0-a0cd-4099-a399-696c5ab85eae\" (UID: \"e040e5b0-a0cd-4099-a399-696c5ab85eae\") "
Jul 20 13:32:32.024490 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:32:32.024360    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e040e5b0-a0cd-4099-a399-696c5ab85eae-openshift-service-ca\") pod \"e040e5b0-a0cd-4099-a399-696c5ab85eae\" (UID: \"e040e5b0-a0cd-4099-a399-696c5ab85eae\") "
Jul 20 13:32:32.024789 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:32:32.024764    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e040e5b0-a0cd-4099-a399-696c5ab85eae-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "e040e5b0-a0cd-4099-a399-696c5ab85eae" (UID: "e040e5b0-a0cd-4099-a399-696c5ab85eae"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 13:32:32.026346 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:32:32.026325    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e040e5b0-a0cd-4099-a399-696c5ab85eae-kube-api-access-wqrr7" (OuterVolumeSpecName: "kube-api-access-wqrr7") pod "e040e5b0-a0cd-4099-a399-696c5ab85eae" (UID: "e040e5b0-a0cd-4099-a399-696c5ab85eae"). InnerVolumeSpecName "kube-api-access-wqrr7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 13:32:32.026346 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:32:32.026336    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e040e5b0-a0cd-4099-a399-696c5ab85eae-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "e040e5b0-a0cd-4099-a399-696c5ab85eae" (UID: "e040e5b0-a0cd-4099-a399-696c5ab85eae"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 13:32:32.125497 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:32:32.125466    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wqrr7\" (UniqueName: \"kubernetes.io/projected/e040e5b0-a0cd-4099-a399-696c5ab85eae-kube-api-access-wqrr7\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 20 13:32:32.125497 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:32:32.125493    2584 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e040e5b0-a0cd-4099-a399-696c5ab85eae-openshift-service-ca\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 20 13:32:32.125680 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:32:32.125507    2584 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e040e5b0-a0cd-4099-a399-696c5ab85eae-maas-api-tls\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 20 13:32:32.329101 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:32:32.329009    2584 generic.go:356] "Generic (PLEG): container finished" podID="e040e5b0-a0cd-4099-a399-696c5ab85eae" containerID="b5c76dc60e038576746c61d05bf60dd876845114b29f4585aea832cde7e32f7a" exitCode=0
Jul 20 13:32:32.329101 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:32:32.329071    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-704386e9-b95d74f8-jnlrq"
Jul 20 13:32:32.329280 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:32:32.329097    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-704386e9-b95d74f8-jnlrq" event={"ID":"e040e5b0-a0cd-4099-a399-696c5ab85eae","Type":"ContainerDied","Data":"b5c76dc60e038576746c61d05bf60dd876845114b29f4585aea832cde7e32f7a"}
Jul 20 13:32:32.329280 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:32:32.329182    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-704386e9-b95d74f8-jnlrq" event={"ID":"e040e5b0-a0cd-4099-a399-696c5ab85eae","Type":"ContainerDied","Data":"370899fb7dd38601a3fa9962e47968f388a4b852d4e03c7b550ad84572570624"}
Jul 20 13:32:32.329280 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:32:32.329206    2584 scope.go:117] "RemoveContainer" containerID="b5c76dc60e038576746c61d05bf60dd876845114b29f4585aea832cde7e32f7a"
Jul 20 13:32:32.338348 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:32:32.338329    2584 scope.go:117] "RemoveContainer" containerID="b5c76dc60e038576746c61d05bf60dd876845114b29f4585aea832cde7e32f7a"
Jul 20 13:32:32.338599 ip-10-0-134-121 kubenswrapper[2584]: E0720 13:32:32.338581    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b5c76dc60e038576746c61d05bf60dd876845114b29f4585aea832cde7e32f7a\": container with ID starting with b5c76dc60e038576746c61d05bf60dd876845114b29f4585aea832cde7e32f7a not found: ID does not exist" containerID="b5c76dc60e038576746c61d05bf60dd876845114b29f4585aea832cde7e32f7a"
Jul 20 13:32:32.338638 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:32:32.338609    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b5c76dc60e038576746c61d05bf60dd876845114b29f4585aea832cde7e32f7a"} err="failed to get container status \"b5c76dc60e038576746c61d05bf60dd876845114b29f4585aea832cde7e32f7a\": rpc error: code = NotFound desc = could not find container \"b5c76dc60e038576746c61d05bf60dd876845114b29f4585aea832cde7e32f7a\": container with ID starting with b5c76dc60e038576746c61d05bf60dd876845114b29f4585aea832cde7e32f7a not found: ID does not exist"
Jul 20 13:32:32.351313 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:32:32.351290    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-704386e9-b95d74f8-jnlrq"]
Jul 20 13:32:32.356464 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:32:32.356444    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-704386e9-b95d74f8-jnlrq"]
Jul 20 13:32:33.098214 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:32:33.098179    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e040e5b0-a0cd-4099-a399-696c5ab85eae" path="/var/lib/kubelet/pods/e040e5b0-a0cd-4099-a399-696c5ab85eae/volumes"
Jul 20 13:32:46.576194 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:32:46.576157    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-704386e9-openshift-default-bc5b85b87-5dk95"]
Jul 20 13:32:46.576647 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:32:46.576361    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-704386e9-openshift-default-bc5b85b87-5dk95" podUID="7228240c-caa8-404b-b38a-c7d7403736f4" containerName="istio-proxy" containerID="cri-o://8b1b6ede67897e7cfb775808bf757872c138181f32a3eeb132bd2a544c41ff91" gracePeriod=30
Jul 20 13:32:51.841724 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:32:51.841648    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-704386e9-openshift-default-bc5b85b87-5dk95"
Jul 20 13:32:52.019178 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:32:52.019143    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7228240c-caa8-404b-b38a-c7d7403736f4-istio-token\") pod \"7228240c-caa8-404b-b38a-c7d7403736f4\" (UID: \"7228240c-caa8-404b-b38a-c7d7403736f4\") "
Jul 20 13:32:52.019351 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:32:52.019194    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7228240c-caa8-404b-b38a-c7d7403736f4-istio-podinfo\") pod \"7228240c-caa8-404b-b38a-c7d7403736f4\" (UID: \"7228240c-caa8-404b-b38a-c7d7403736f4\") "
Jul 20 13:32:52.019351 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:32:52.019234    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p96sq\" (UniqueName: \"kubernetes.io/projected/7228240c-caa8-404b-b38a-c7d7403736f4-kube-api-access-p96sq\") pod \"7228240c-caa8-404b-b38a-c7d7403736f4\" (UID: \"7228240c-caa8-404b-b38a-c7d7403736f4\") "
Jul 20 13:32:52.019485 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:32:52.019358    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7228240c-caa8-404b-b38a-c7d7403736f4-istio-envoy\") pod \"7228240c-caa8-404b-b38a-c7d7403736f4\" (UID: \"7228240c-caa8-404b-b38a-c7d7403736f4\") "
Jul 20 13:32:52.019485 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:32:52.019420    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7228240c-caa8-404b-b38a-c7d7403736f4-credential-socket\") pod \"7228240c-caa8-404b-b38a-c7d7403736f4\" (UID: \"7228240c-caa8-404b-b38a-c7d7403736f4\") "
Jul 20 13:32:52.019485 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:32:52.019459    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7228240c-caa8-404b-b38a-c7d7403736f4-workload-socket\") pod \"7228240c-caa8-404b-b38a-c7d7403736f4\" (UID: \"7228240c-caa8-404b-b38a-c7d7403736f4\") "
Jul 20 13:32:52.019646 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:32:52.019489    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7228240c-caa8-404b-b38a-c7d7403736f4-workload-certs\") pod \"7228240c-caa8-404b-b38a-c7d7403736f4\" (UID: \"7228240c-caa8-404b-b38a-c7d7403736f4\") "
Jul 20 13:32:52.019646 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:32:52.019514    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7228240c-caa8-404b-b38a-c7d7403736f4-istiod-ca-cert\") pod \"7228240c-caa8-404b-b38a-c7d7403736f4\" (UID: \"7228240c-caa8-404b-b38a-c7d7403736f4\") "
Jul 20 13:32:52.019646 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:32:52.019574    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7228240c-caa8-404b-b38a-c7d7403736f4-istio-data\") pod \"7228240c-caa8-404b-b38a-c7d7403736f4\" (UID: \"7228240c-caa8-404b-b38a-c7d7403736f4\") "
Jul 20 13:32:52.019797 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:32:52.019675    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7228240c-caa8-404b-b38a-c7d7403736f4-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "7228240c-caa8-404b-b38a-c7d7403736f4" (UID: "7228240c-caa8-404b-b38a-c7d7403736f4"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 13:32:52.019887 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:32:52.019858    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7228240c-caa8-404b-b38a-c7d7403736f4-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "7228240c-caa8-404b-b38a-c7d7403736f4" (UID: "7228240c-caa8-404b-b38a-c7d7403736f4"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 13:32:52.020037 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:32:52.020019    2584 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7228240c-caa8-404b-b38a-c7d7403736f4-credential-socket\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 20 13:32:52.020124 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:32:52.020041    2584 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7228240c-caa8-404b-b38a-c7d7403736f4-workload-certs\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 20 13:32:52.020229 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:32:52.020203    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7228240c-caa8-404b-b38a-c7d7403736f4-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "7228240c-caa8-404b-b38a-c7d7403736f4" (UID: "7228240c-caa8-404b-b38a-c7d7403736f4"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 13:32:52.020331 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:32:52.020309    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7228240c-caa8-404b-b38a-c7d7403736f4-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "7228240c-caa8-404b-b38a-c7d7403736f4" (UID: "7228240c-caa8-404b-b38a-c7d7403736f4"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 13:32:52.020755 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:32:52.020729    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7228240c-caa8-404b-b38a-c7d7403736f4-istio-data" (OuterVolumeSpecName: "istio-data") pod "7228240c-caa8-404b-b38a-c7d7403736f4" (UID: "7228240c-caa8-404b-b38a-c7d7403736f4"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 13:32:52.021634 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:32:52.021602    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7228240c-caa8-404b-b38a-c7d7403736f4-kube-api-access-p96sq" (OuterVolumeSpecName: "kube-api-access-p96sq") pod "7228240c-caa8-404b-b38a-c7d7403736f4" (UID: "7228240c-caa8-404b-b38a-c7d7403736f4"). InnerVolumeSpecName "kube-api-access-p96sq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 13:32:52.021756 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:32:52.021655    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7228240c-caa8-404b-b38a-c7d7403736f4-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "7228240c-caa8-404b-b38a-c7d7403736f4" (UID: "7228240c-caa8-404b-b38a-c7d7403736f4"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 13:32:52.021756 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:32:52.021666    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7228240c-caa8-404b-b38a-c7d7403736f4-istio-token" (OuterVolumeSpecName: "istio-token") pod "7228240c-caa8-404b-b38a-c7d7403736f4" (UID: "7228240c-caa8-404b-b38a-c7d7403736f4"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 13:32:52.021756 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:32:52.021683    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/7228240c-caa8-404b-b38a-c7d7403736f4-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "7228240c-caa8-404b-b38a-c7d7403736f4" (UID: "7228240c-caa8-404b-b38a-c7d7403736f4"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 20 13:32:52.120922 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:32:52.120839    2584 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7228240c-caa8-404b-b38a-c7d7403736f4-istio-envoy\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 20 13:32:52.120922 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:32:52.120878    2584 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7228240c-caa8-404b-b38a-c7d7403736f4-workload-socket\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 20 13:32:52.120922 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:32:52.120889    2584 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7228240c-caa8-404b-b38a-c7d7403736f4-istiod-ca-cert\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 20 13:32:52.120922 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:32:52.120897    2584 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7228240c-caa8-404b-b38a-c7d7403736f4-istio-data\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 20 13:32:52.120922 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:32:52.120904    2584 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7228240c-caa8-404b-b38a-c7d7403736f4-istio-token\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 20 13:32:52.120922 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:32:52.120913    2584 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7228240c-caa8-404b-b38a-c7d7403736f4-istio-podinfo\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 20 13:32:52.120922 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:32:52.120921    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p96sq\" (UniqueName: \"kubernetes.io/projected/7228240c-caa8-404b-b38a-c7d7403736f4-kube-api-access-p96sq\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 20 13:32:52.435505 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:32:52.435422    2584 generic.go:356] "Generic (PLEG): container finished" podID="7228240c-caa8-404b-b38a-c7d7403736f4" containerID="8b1b6ede67897e7cfb775808bf757872c138181f32a3eeb132bd2a544c41ff91" exitCode=0
Jul 20 13:32:52.435505 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:32:52.435466    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-704386e9-openshift-default-bc5b85b87-5dk95" event={"ID":"7228240c-caa8-404b-b38a-c7d7403736f4","Type":"ContainerDied","Data":"8b1b6ede67897e7cfb775808bf757872c138181f32a3eeb132bd2a544c41ff91"}
Jul 20 13:32:52.435723 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:32:52.435509    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-704386e9-openshift-default-bc5b85b87-5dk95" event={"ID":"7228240c-caa8-404b-b38a-c7d7403736f4","Type":"ContainerDied","Data":"cd1547e57af7de4ec81fc08d0d1d7cd87bfef5d3a6f82844a1d31098f6ce4e79"}
Jul 20 13:32:52.435723 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:32:52.435532    2584 scope.go:117] "RemoveContainer" containerID="8b1b6ede67897e7cfb775808bf757872c138181f32a3eeb132bd2a544c41ff91"
Jul 20 13:32:52.435723 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:32:52.435467    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-704386e9-openshift-default-bc5b85b87-5dk95"
Jul 20 13:32:52.448749 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:32:52.448729    2584 scope.go:117] "RemoveContainer" containerID="7b562f96e3fa3ae1e5a064d5d9c8ae1a744ff4df3b87897e6922eea211ede4bc"
Jul 20 13:32:52.457231 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:32:52.457189    2584 scope.go:117] "RemoveContainer" containerID="8b1b6ede67897e7cfb775808bf757872c138181f32a3eeb132bd2a544c41ff91"
Jul 20 13:32:52.457476 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:32:52.457453    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-704386e9-openshift-default-bc5b85b87-5dk95"]
Jul 20 13:32:52.457580 ip-10-0-134-121 kubenswrapper[2584]: E0720 13:32:52.457485    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8b1b6ede67897e7cfb775808bf757872c138181f32a3eeb132bd2a544c41ff91\": container with ID starting with 8b1b6ede67897e7cfb775808bf757872c138181f32a3eeb132bd2a544c41ff91 not found: ID does not exist" containerID="8b1b6ede67897e7cfb775808bf757872c138181f32a3eeb132bd2a544c41ff91"
Jul 20 13:32:52.457580 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:32:52.457512    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8b1b6ede67897e7cfb775808bf757872c138181f32a3eeb132bd2a544c41ff91"} err="failed to get container status \"8b1b6ede67897e7cfb775808bf757872c138181f32a3eeb132bd2a544c41ff91\": rpc error: code = NotFound desc = could not find container \"8b1b6ede67897e7cfb775808bf757872c138181f32a3eeb132bd2a544c41ff91\": container with ID starting with 8b1b6ede67897e7cfb775808bf757872c138181f32a3eeb132bd2a544c41ff91 not found: ID does not exist"
Jul 20 13:32:52.457580 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:32:52.457529    2584 scope.go:117] "RemoveContainer" containerID="7b562f96e3fa3ae1e5a064d5d9c8ae1a744ff4df3b87897e6922eea211ede4bc"
Jul 20 13:32:52.457781 ip-10-0-134-121 kubenswrapper[2584]: E0720 13:32:52.457762    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7b562f96e3fa3ae1e5a064d5d9c8ae1a744ff4df3b87897e6922eea211ede4bc\": container with ID starting with 7b562f96e3fa3ae1e5a064d5d9c8ae1a744ff4df3b87897e6922eea211ede4bc not found: ID does not exist" containerID="7b562f96e3fa3ae1e5a064d5d9c8ae1a744ff4df3b87897e6922eea211ede4bc"
Jul 20 13:32:52.457844 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:32:52.457787    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7b562f96e3fa3ae1e5a064d5d9c8ae1a744ff4df3b87897e6922eea211ede4bc"} err="failed to get container status \"7b562f96e3fa3ae1e5a064d5d9c8ae1a744ff4df3b87897e6922eea211ede4bc\": rpc error: code = NotFound desc = could not find container \"7b562f96e3fa3ae1e5a064d5d9c8ae1a744ff4df3b87897e6922eea211ede4bc\": container with ID starting with 7b562f96e3fa3ae1e5a064d5d9c8ae1a744ff4df3b87897e6922eea211ede4bc not found: ID does not exist"
Jul 20 13:32:52.461995 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:32:52.461959    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-704386e9-openshift-default-bc5b85b87-5dk95"]
Jul 20 13:32:53.096527 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:32:53.096495    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7228240c-caa8-404b-b38a-c7d7403736f4" path="/var/lib/kubelet/pods/7228240c-caa8-404b-b38a-c7d7403736f4/volumes"
Jul 20 13:34:45.298423 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:34:45.298334    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-28e80ad8-openshift-default-5f7f95ffb7-dx48z"]
Jul 20 13:34:45.299049 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:34:45.299030    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7228240c-caa8-404b-b38a-c7d7403736f4" containerName="istio-proxy"
Jul 20 13:34:45.299144 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:34:45.299053    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="7228240c-caa8-404b-b38a-c7d7403736f4" containerName="istio-proxy"
Jul 20 13:34:45.299144 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:34:45.299070    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7228240c-caa8-404b-b38a-c7d7403736f4" containerName="istio-proxy"
Jul 20 13:34:45.299144 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:34:45.299079    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="7228240c-caa8-404b-b38a-c7d7403736f4" containerName="istio-proxy"
Jul 20 13:34:45.299144 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:34:45.299101    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3d81acb0-7210-4422-b6c5-e08ace19c3bc" containerName="istio-proxy"
Jul 20 13:34:45.299144 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:34:45.299110    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="3d81acb0-7210-4422-b6c5-e08ace19c3bc" containerName="istio-proxy"
Jul 20 13:34:45.299144 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:34:45.299138    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e040e5b0-a0cd-4099-a399-696c5ab85eae" containerName="maas-api"
Jul 20 13:34:45.299144 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:34:45.299146    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="e040e5b0-a0cd-4099-a399-696c5ab85eae" containerName="maas-api"
Jul 20 13:34:45.299419 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:34:45.299233    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="e040e5b0-a0cd-4099-a399-696c5ab85eae" containerName="maas-api"
Jul 20 13:34:45.299419 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:34:45.299243    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="3d81acb0-7210-4422-b6c5-e08ace19c3bc" containerName="istio-proxy"
Jul 20 13:34:45.299419 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:34:45.299255    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="3d81acb0-7210-4422-b6c5-e08ace19c3bc" containerName="istio-proxy"
Jul 20 13:34:45.299419 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:34:45.299267    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="7228240c-caa8-404b-b38a-c7d7403736f4" containerName="istio-proxy"
Jul 20 13:34:45.299419 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:34:45.299279    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="7228240c-caa8-404b-b38a-c7d7403736f4" containerName="istio-proxy"
Jul 20 13:34:45.302883 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:34:45.302860    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-28e80ad8-openshift-default-5f7f95ffb7-dx48z"
Jul 20 13:34:45.305027 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:34:45.305004    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-28e80ad8-openshift-default-dockercfg-q74hk\""
Jul 20 13:34:45.313735 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:34:45.313703    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-28e80ad8-openshift-default-5f7f95ffb7-dx48z"]
Jul 20 13:34:45.430809 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:34:45.430773    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fdba1a38-8f9a-47ac-8465-86fb2837c552-workload-socket\") pod \"e2e-mt-28e80ad8-openshift-default-5f7f95ffb7-dx48z\" (UID: \"fdba1a38-8f9a-47ac-8465-86fb2837c552\") " pod="openshift-ingress/e2e-mt-28e80ad8-openshift-default-5f7f95ffb7-dx48z"
Jul 20 13:34:45.431009 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:34:45.430832    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fdba1a38-8f9a-47ac-8465-86fb2837c552-istiod-ca-cert\") pod \"e2e-mt-28e80ad8-openshift-default-5f7f95ffb7-dx48z\" (UID: \"fdba1a38-8f9a-47ac-8465-86fb2837c552\") " pod="openshift-ingress/e2e-mt-28e80ad8-openshift-default-5f7f95ffb7-dx48z"
Jul 20 13:34:45.431009 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:34:45.430930    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jxctr\" (UniqueName: \"kubernetes.io/projected/fdba1a38-8f9a-47ac-8465-86fb2837c552-kube-api-access-jxctr\") pod \"e2e-mt-28e80ad8-openshift-default-5f7f95ffb7-dx48z\" (UID: \"fdba1a38-8f9a-47ac-8465-86fb2837c552\") " pod="openshift-ingress/e2e-mt-28e80ad8-openshift-default-5f7f95ffb7-dx48z"
Jul 20 13:34:45.431092 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:34:45.431015    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fdba1a38-8f9a-47ac-8465-86fb2837c552-istio-data\") pod \"e2e-mt-28e80ad8-openshift-default-5f7f95ffb7-dx48z\" (UID: \"fdba1a38-8f9a-47ac-8465-86fb2837c552\") " pod="openshift-ingress/e2e-mt-28e80ad8-openshift-default-5f7f95ffb7-dx48z"
Jul 20 13:34:45.431092 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:34:45.431053    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fdba1a38-8f9a-47ac-8465-86fb2837c552-istio-token\") pod \"e2e-mt-28e80ad8-openshift-default-5f7f95ffb7-dx48z\" (UID: \"fdba1a38-8f9a-47ac-8465-86fb2837c552\") " pod="openshift-ingress/e2e-mt-28e80ad8-openshift-default-5f7f95ffb7-dx48z"
Jul 20 13:34:45.431169 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:34:45.431092    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fdba1a38-8f9a-47ac-8465-86fb2837c552-istio-envoy\") pod \"e2e-mt-28e80ad8-openshift-default-5f7f95ffb7-dx48z\" (UID: \"fdba1a38-8f9a-47ac-8465-86fb2837c552\") " pod="openshift-ingress/e2e-mt-28e80ad8-openshift-default-5f7f95ffb7-dx48z"
Jul 20 13:34:45.431169 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:34:45.431109    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fdba1a38-8f9a-47ac-8465-86fb2837c552-istio-podinfo\") pod \"e2e-mt-28e80ad8-openshift-default-5f7f95ffb7-dx48z\" (UID: \"fdba1a38-8f9a-47ac-8465-86fb2837c552\") " pod="openshift-ingress/e2e-mt-28e80ad8-openshift-default-5f7f95ffb7-dx48z"
Jul 20 13:34:45.431233 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:34:45.431173    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fdba1a38-8f9a-47ac-8465-86fb2837c552-credential-socket\") pod \"e2e-mt-28e80ad8-openshift-default-5f7f95ffb7-dx48z\" (UID: \"fdba1a38-8f9a-47ac-8465-86fb2837c552\") " pod="openshift-ingress/e2e-mt-28e80ad8-openshift-default-5f7f95ffb7-dx48z"
Jul 20 13:34:45.431233 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:34:45.431209    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fdba1a38-8f9a-47ac-8465-86fb2837c552-workload-certs\") pod \"e2e-mt-28e80ad8-openshift-default-5f7f95ffb7-dx48z\" (UID: \"fdba1a38-8f9a-47ac-8465-86fb2837c552\") " pod="openshift-ingress/e2e-mt-28e80ad8-openshift-default-5f7f95ffb7-dx48z"
Jul 20 13:34:45.531938 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:34:45.531885    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jxctr\" (UniqueName: \"kubernetes.io/projected/fdba1a38-8f9a-47ac-8465-86fb2837c552-kube-api-access-jxctr\") pod \"e2e-mt-28e80ad8-openshift-default-5f7f95ffb7-dx48z\" (UID: \"fdba1a38-8f9a-47ac-8465-86fb2837c552\") " pod="openshift-ingress/e2e-mt-28e80ad8-openshift-default-5f7f95ffb7-dx48z"
Jul 20 13:34:45.531938 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:34:45.531941    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fdba1a38-8f9a-47ac-8465-86fb2837c552-istio-data\") pod \"e2e-mt-28e80ad8-openshift-default-5f7f95ffb7-dx48z\" (UID: \"fdba1a38-8f9a-47ac-8465-86fb2837c552\") " pod="openshift-ingress/e2e-mt-28e80ad8-openshift-default-5f7f95ffb7-dx48z"
Jul 20 13:34:45.532251 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:34:45.532026    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fdba1a38-8f9a-47ac-8465-86fb2837c552-istio-token\") pod \"e2e-mt-28e80ad8-openshift-default-5f7f95ffb7-dx48z\" (UID: \"fdba1a38-8f9a-47ac-8465-86fb2837c552\") " pod="openshift-ingress/e2e-mt-28e80ad8-openshift-default-5f7f95ffb7-dx48z"
Jul 20 13:34:45.532251 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:34:45.532070    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fdba1a38-8f9a-47ac-8465-86fb2837c552-istio-envoy\") pod \"e2e-mt-28e80ad8-openshift-default-5f7f95ffb7-dx48z\" (UID: \"fdba1a38-8f9a-47ac-8465-86fb2837c552\") " pod="openshift-ingress/e2e-mt-28e80ad8-openshift-default-5f7f95ffb7-dx48z"
Jul 20 13:34:45.532251 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:34:45.532092    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fdba1a38-8f9a-47ac-8465-86fb2837c552-istio-podinfo\") pod \"e2e-mt-28e80ad8-openshift-default-5f7f95ffb7-dx48z\" (UID: \"fdba1a38-8f9a-47ac-8465-86fb2837c552\") " pod="openshift-ingress/e2e-mt-28e80ad8-openshift-default-5f7f95ffb7-dx48z"
Jul 20 13:34:45.532251 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:34:45.532125    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fdba1a38-8f9a-47ac-8465-86fb2837c552-credential-socket\") pod \"e2e-mt-28e80ad8-openshift-default-5f7f95ffb7-dx48z\" (UID: \"fdba1a38-8f9a-47ac-8465-86fb2837c552\") " pod="openshift-ingress/e2e-mt-28e80ad8-openshift-default-5f7f95ffb7-dx48z"
Jul 20 13:34:45.532251 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:34:45.532168    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fdba1a38-8f9a-47ac-8465-86fb2837c552-workload-certs\") pod \"e2e-mt-28e80ad8-openshift-default-5f7f95ffb7-dx48z\" (UID: \"fdba1a38-8f9a-47ac-8465-86fb2837c552\") " pod="openshift-ingress/e2e-mt-28e80ad8-openshift-default-5f7f95ffb7-dx48z"
Jul 20 13:34:45.532251 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:34:45.532226    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fdba1a38-8f9a-47ac-8465-86fb2837c552-workload-socket\") pod \"e2e-mt-28e80ad8-openshift-default-5f7f95ffb7-dx48z\" (UID: \"fdba1a38-8f9a-47ac-8465-86fb2837c552\") " pod="openshift-ingress/e2e-mt-28e80ad8-openshift-default-5f7f95ffb7-dx48z"
Jul 20 13:34:45.532556 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:34:45.532294    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fdba1a38-8f9a-47ac-8465-86fb2837c552-istiod-ca-cert\") pod \"e2e-mt-28e80ad8-openshift-default-5f7f95ffb7-dx48z\" (UID: \"fdba1a38-8f9a-47ac-8465-86fb2837c552\") " pod="openshift-ingress/e2e-mt-28e80ad8-openshift-default-5f7f95ffb7-dx48z"
Jul 20 13:34:45.532556 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:34:45.532407    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fdba1a38-8f9a-47ac-8465-86fb2837c552-istio-data\") pod \"e2e-mt-28e80ad8-openshift-default-5f7f95ffb7-dx48z\" (UID: \"fdba1a38-8f9a-47ac-8465-86fb2837c552\") " pod="openshift-ingress/e2e-mt-28e80ad8-openshift-default-5f7f95ffb7-dx48z"
Jul 20 13:34:45.532556 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:34:45.532531    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fdba1a38-8f9a-47ac-8465-86fb2837c552-workload-certs\") pod \"e2e-mt-28e80ad8-openshift-default-5f7f95ffb7-dx48z\" (UID: \"fdba1a38-8f9a-47ac-8465-86fb2837c552\") " pod="openshift-ingress/e2e-mt-28e80ad8-openshift-default-5f7f95ffb7-dx48z"
Jul 20 13:34:45.532725 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:34:45.532580    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fdba1a38-8f9a-47ac-8465-86fb2837c552-credential-socket\") pod \"e2e-mt-28e80ad8-openshift-default-5f7f95ffb7-dx48z\" (UID: \"fdba1a38-8f9a-47ac-8465-86fb2837c552\") " pod="openshift-ingress/e2e-mt-28e80ad8-openshift-default-5f7f95ffb7-dx48z"
Jul 20 13:34:45.532725 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:34:45.532601    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fdba1a38-8f9a-47ac-8465-86fb2837c552-workload-socket\") pod \"e2e-mt-28e80ad8-openshift-default-5f7f95ffb7-dx48z\" (UID: \"fdba1a38-8f9a-47ac-8465-86fb2837c552\") " pod="openshift-ingress/e2e-mt-28e80ad8-openshift-default-5f7f95ffb7-dx48z"
Jul 20 13:34:45.533022 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:34:45.533001    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fdba1a38-8f9a-47ac-8465-86fb2837c552-istiod-ca-cert\") pod \"e2e-mt-28e80ad8-openshift-default-5f7f95ffb7-dx48z\" (UID: \"fdba1a38-8f9a-47ac-8465-86fb2837c552\") " pod="openshift-ingress/e2e-mt-28e80ad8-openshift-default-5f7f95ffb7-dx48z"
Jul 20 13:34:45.534416 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:34:45.534395    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fdba1a38-8f9a-47ac-8465-86fb2837c552-istio-envoy\") pod \"e2e-mt-28e80ad8-openshift-default-5f7f95ffb7-dx48z\" (UID: \"fdba1a38-8f9a-47ac-8465-86fb2837c552\") " pod="openshift-ingress/e2e-mt-28e80ad8-openshift-default-5f7f95ffb7-dx48z"
Jul 20 13:34:45.534625 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:34:45.534606    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fdba1a38-8f9a-47ac-8465-86fb2837c552-istio-podinfo\") pod \"e2e-mt-28e80ad8-openshift-default-5f7f95ffb7-dx48z\" (UID: \"fdba1a38-8f9a-47ac-8465-86fb2837c552\") " pod="openshift-ingress/e2e-mt-28e80ad8-openshift-default-5f7f95ffb7-dx48z"
Jul 20 13:34:45.541168 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:34:45.541129    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jxctr\" (UniqueName: \"kubernetes.io/projected/fdba1a38-8f9a-47ac-8465-86fb2837c552-kube-api-access-jxctr\") pod \"e2e-mt-28e80ad8-openshift-default-5f7f95ffb7-dx48z\" (UID: \"fdba1a38-8f9a-47ac-8465-86fb2837c552\") " pod="openshift-ingress/e2e-mt-28e80ad8-openshift-default-5f7f95ffb7-dx48z"
Jul 20 13:34:45.541333 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:34:45.541290    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fdba1a38-8f9a-47ac-8465-86fb2837c552-istio-token\") pod \"e2e-mt-28e80ad8-openshift-default-5f7f95ffb7-dx48z\" (UID: \"fdba1a38-8f9a-47ac-8465-86fb2837c552\") " pod="openshift-ingress/e2e-mt-28e80ad8-openshift-default-5f7f95ffb7-dx48z"
Jul 20 13:34:45.615285 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:34:45.615186    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-28e80ad8-openshift-default-5f7f95ffb7-dx48z"
Jul 20 13:34:45.765925 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:34:45.765900    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-28e80ad8-openshift-default-5f7f95ffb7-dx48z"]
Jul 20 13:34:45.767903 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:34:45.767877    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfdba1a38_8f9a_47ac_8465_86fb2837c552.slice/crio-e47192b9b3c0a305268bf832d9e7727ab6cb28bc274e6908e5ddf3ac40d15262 WatchSource:0}: Error finding container e47192b9b3c0a305268bf832d9e7727ab6cb28bc274e6908e5ddf3ac40d15262: Status 404 returned error can't find the container with id e47192b9b3c0a305268bf832d9e7727ab6cb28bc274e6908e5ddf3ac40d15262
Jul 20 13:34:45.770203 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:34:45.770166    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 20 13:34:45.770284 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:34:45.770236    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 20 13:34:45.770284 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:34:45.770267    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 20 13:34:46.033358 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:34:46.033313    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-28e80ad8-openshift-default-5f7f95ffb7-dx48z" event={"ID":"fdba1a38-8f9a-47ac-8465-86fb2837c552","Type":"ContainerStarted","Data":"9184bd9b3358e7b778c275fb49260c919ecf2e334d4b28d10631dc79f7cbb2e8"}
Jul 20 13:34:46.033551 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:34:46.033396    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-28e80ad8-openshift-default-5f7f95ffb7-dx48z" event={"ID":"fdba1a38-8f9a-47ac-8465-86fb2837c552","Type":"ContainerStarted","Data":"e47192b9b3c0a305268bf832d9e7727ab6cb28bc274e6908e5ddf3ac40d15262"}
Jul 20 13:34:46.054407 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:34:46.054350    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-28e80ad8-openshift-default-5f7f95ffb7-dx48z" podStartSLOduration=1.054331296 podStartE2EDuration="1.054331296s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 13:34:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 13:34:46.051879224 +0000 UTC m=+1975.768426626" watchObservedRunningTime="2026-07-20 13:34:46.054331296 +0000 UTC m=+1975.770878706"
Jul 20 13:34:46.615644 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:34:46.615602    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-28e80ad8-openshift-default-5f7f95ffb7-dx48z"
Jul 20 13:34:46.620844 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:34:46.620816    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-28e80ad8-openshift-default-5f7f95ffb7-dx48z"
Jul 20 13:34:47.038851 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:34:47.038822    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-28e80ad8-openshift-default-5f7f95ffb7-dx48z"
Jul 20 13:34:47.039927 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:34:47.039912    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-28e80ad8-openshift-default-5f7f95ffb7-dx48z"
Jul 20 13:34:48.305936 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:34:48.305571    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-28e80ad8-5bb76fb758-fglp9"]
Jul 20 13:34:48.306733 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:34:48.306711    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3d81acb0-7210-4422-b6c5-e08ace19c3bc" containerName="istio-proxy"
Jul 20 13:34:48.306790 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:34:48.306738    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="3d81acb0-7210-4422-b6c5-e08ace19c3bc" containerName="istio-proxy"
Jul 20 13:34:48.310656 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:34:48.310635    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-28e80ad8-5bb76fb758-fglp9"
Jul 20 13:34:48.312705 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:34:48.312668    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-28e80ad8-serving-cert\""
Jul 20 13:34:48.312844 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:34:48.312733    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-vf2sw\""
Jul 20 13:34:48.319895 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:34:48.319871    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-28e80ad8-5bb76fb758-fglp9"]
Jul 20 13:34:48.355926 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:34:48.355887    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/732dfd65-2768-45ce-8606-a1d933535740-maas-api-tls\") pod \"maas-api-e2e-mt-28e80ad8-5bb76fb758-fglp9\" (UID: \"732dfd65-2768-45ce-8606-a1d933535740\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-28e80ad8-5bb76fb758-fglp9"
Jul 20 13:34:48.356159 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:34:48.355949    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/732dfd65-2768-45ce-8606-a1d933535740-openshift-service-ca\") pod \"maas-api-e2e-mt-28e80ad8-5bb76fb758-fglp9\" (UID: \"732dfd65-2768-45ce-8606-a1d933535740\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-28e80ad8-5bb76fb758-fglp9"
Jul 20 13:34:48.356159 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:34:48.356004    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kwv9c\" (UniqueName: \"kubernetes.io/projected/732dfd65-2768-45ce-8606-a1d933535740-kube-api-access-kwv9c\") pod \"maas-api-e2e-mt-28e80ad8-5bb76fb758-fglp9\" (UID: \"732dfd65-2768-45ce-8606-a1d933535740\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-28e80ad8-5bb76fb758-fglp9"
Jul 20 13:34:48.457301 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:34:48.457264    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/732dfd65-2768-45ce-8606-a1d933535740-openshift-service-ca\") pod \"maas-api-e2e-mt-28e80ad8-5bb76fb758-fglp9\" (UID: \"732dfd65-2768-45ce-8606-a1d933535740\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-28e80ad8-5bb76fb758-fglp9"
Jul 20 13:34:48.457483 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:34:48.457313    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kwv9c\" (UniqueName: \"kubernetes.io/projected/732dfd65-2768-45ce-8606-a1d933535740-kube-api-access-kwv9c\") pod \"maas-api-e2e-mt-28e80ad8-5bb76fb758-fglp9\" (UID: \"732dfd65-2768-45ce-8606-a1d933535740\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-28e80ad8-5bb76fb758-fglp9"
Jul 20 13:34:48.457483 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:34:48.457442    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/732dfd65-2768-45ce-8606-a1d933535740-maas-api-tls\") pod \"maas-api-e2e-mt-28e80ad8-5bb76fb758-fglp9\" (UID: \"732dfd65-2768-45ce-8606-a1d933535740\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-28e80ad8-5bb76fb758-fglp9"
Jul 20 13:34:48.457605 ip-10-0-134-121 kubenswrapper[2584]: E0720 13:34:48.457582    2584 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-mt-28e80ad8-serving-cert: secret "maas-api-e2e-mt-28e80ad8-serving-cert" not found
Jul 20 13:34:48.457682 ip-10-0-134-121 kubenswrapper[2584]: E0720 13:34:48.457670    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/732dfd65-2768-45ce-8606-a1d933535740-maas-api-tls podName:732dfd65-2768-45ce-8606-a1d933535740 nodeName:}" failed. No retries permitted until 2026-07-20 13:34:48.957639579 +0000 UTC m=+1978.674186969 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/732dfd65-2768-45ce-8606-a1d933535740-maas-api-tls") pod "maas-api-e2e-mt-28e80ad8-5bb76fb758-fglp9" (UID: "732dfd65-2768-45ce-8606-a1d933535740") : secret "maas-api-e2e-mt-28e80ad8-serving-cert" not found
Jul 20 13:34:48.458098 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:34:48.458079    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/732dfd65-2768-45ce-8606-a1d933535740-openshift-service-ca\") pod \"maas-api-e2e-mt-28e80ad8-5bb76fb758-fglp9\" (UID: \"732dfd65-2768-45ce-8606-a1d933535740\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-28e80ad8-5bb76fb758-fglp9"
Jul 20 13:34:48.472498 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:34:48.472462    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kwv9c\" (UniqueName: \"kubernetes.io/projected/732dfd65-2768-45ce-8606-a1d933535740-kube-api-access-kwv9c\") pod \"maas-api-e2e-mt-28e80ad8-5bb76fb758-fglp9\" (UID: \"732dfd65-2768-45ce-8606-a1d933535740\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-28e80ad8-5bb76fb758-fglp9"
Jul 20 13:34:48.961589 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:34:48.961553    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/732dfd65-2768-45ce-8606-a1d933535740-maas-api-tls\") pod \"maas-api-e2e-mt-28e80ad8-5bb76fb758-fglp9\" (UID: \"732dfd65-2768-45ce-8606-a1d933535740\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-28e80ad8-5bb76fb758-fglp9"
Jul 20 13:34:48.964007 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:34:48.963958    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/732dfd65-2768-45ce-8606-a1d933535740-maas-api-tls\") pod \"maas-api-e2e-mt-28e80ad8-5bb76fb758-fglp9\" (UID: \"732dfd65-2768-45ce-8606-a1d933535740\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-28e80ad8-5bb76fb758-fglp9"
Jul 20 13:34:49.223899 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:34:49.223817    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-28e80ad8-5bb76fb758-fglp9"
Jul 20 13:34:49.364198 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:34:49.364172    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-28e80ad8-5bb76fb758-fglp9"]
Jul 20 13:34:49.365812 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:34:49.365781    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod732dfd65_2768_45ce_8606_a1d933535740.slice/crio-bbeb2668e2a226160aa2fa98f761576ee3ca87d6aa410e299512c647a4026b00 WatchSource:0}: Error finding container bbeb2668e2a226160aa2fa98f761576ee3ca87d6aa410e299512c647a4026b00: Status 404 returned error can't find the container with id bbeb2668e2a226160aa2fa98f761576ee3ca87d6aa410e299512c647a4026b00
Jul 20 13:34:49.367253 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:34:49.367235    2584 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 20 13:34:50.055749 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:34:50.055651    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-28e80ad8-5bb76fb758-fglp9" event={"ID":"732dfd65-2768-45ce-8606-a1d933535740","Type":"ContainerStarted","Data":"8bdbd50d68d971b8c26199e8d02d7baa35d11908851668878e7f9bb3a0e1f84c"}
Jul 20 13:34:50.055749 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:34:50.055713    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-28e80ad8-5bb76fb758-fglp9" event={"ID":"732dfd65-2768-45ce-8606-a1d933535740","Type":"ContainerStarted","Data":"bbeb2668e2a226160aa2fa98f761576ee3ca87d6aa410e299512c647a4026b00"}
Jul 20 13:34:50.055749 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:34:50.055743    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-28e80ad8-5bb76fb758-fglp9"
Jul 20 13:34:50.074544 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:34:50.074492    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-28e80ad8-5bb76fb758-fglp9" podStartSLOduration=1.6620337090000001 podStartE2EDuration="2.074475944s" totalImagesPullingTime="412.442235ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 13:34:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 13:34:50.073154885 +0000 UTC m=+1979.789702297" watchObservedRunningTime="2026-07-20 13:34:50.074475944 +0000 UTC m=+1979.791023352"
Jul 20 13:34:56.066026 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:34:56.065994    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-28e80ad8-5bb76fb758-fglp9"
Jul 20 13:35:02.040804 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:35:02.040761    2584 patch_prober.go:28] interesting pod/e2e-mt-28e80ad8-openshift-default-5f7f95ffb7-dx48z container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused" start-of-body=
Jul 20 13:35:02.041252 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:35:02.040816    2584 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-28e80ad8-openshift-default-5f7f95ffb7-dx48z" podUID="fdba1a38-8f9a-47ac-8465-86fb2837c552" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused"
Jul 20 13:35:02.126959 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:35:02.126925    2584 generic.go:356] "Generic (PLEG): container finished" podID="fdba1a38-8f9a-47ac-8465-86fb2837c552" containerID="9184bd9b3358e7b778c275fb49260c919ecf2e334d4b28d10631dc79f7cbb2e8" exitCode=0
Jul 20 13:35:02.127143 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:35:02.127002    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-28e80ad8-openshift-default-5f7f95ffb7-dx48z" event={"ID":"fdba1a38-8f9a-47ac-8465-86fb2837c552","Type":"ContainerDied","Data":"9184bd9b3358e7b778c275fb49260c919ecf2e334d4b28d10631dc79f7cbb2e8"}
Jul 20 13:35:02.127500 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:35:02.127483    2584 scope.go:117] "RemoveContainer" containerID="9184bd9b3358e7b778c275fb49260c919ecf2e334d4b28d10631dc79f7cbb2e8"
Jul 20 13:35:02.128527 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:35:02.128497    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 20 13:35:02.128633 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:35:02.128584    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 20 13:35:02.128699 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:35:02.128630    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 20 13:35:03.138376 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:35:03.138336    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-28e80ad8-openshift-default-5f7f95ffb7-dx48z" event={"ID":"fdba1a38-8f9a-47ac-8465-86fb2837c552","Type":"ContainerStarted","Data":"c2ab438d01c4b0930b81870c903766858e272ff4481459f1d04f26a27113257c"}
Jul 20 13:35:03.615671 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:35:03.615637    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-28e80ad8-openshift-default-5f7f95ffb7-dx48z"
Jul 20 13:35:03.615875 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:35:03.615853    2584 patch_prober.go:28] interesting pod/e2e-mt-28e80ad8-openshift-default-5f7f95ffb7-dx48z container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused" start-of-body=
Jul 20 13:35:03.615923 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:35:03.615902    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-28e80ad8-openshift-default-5f7f95ffb7-dx48z" podUID="fdba1a38-8f9a-47ac-8465-86fb2837c552" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused"
Jul 20 13:35:04.616382 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:35:04.616347    2584 patch_prober.go:28] interesting pod/e2e-mt-28e80ad8-openshift-default-5f7f95ffb7-dx48z container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused" start-of-body=
Jul 20 13:35:04.616810 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:35:04.616405    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-28e80ad8-openshift-default-5f7f95ffb7-dx48z" podUID="fdba1a38-8f9a-47ac-8465-86fb2837c552" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused"
Jul 20 13:35:05.616199 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:35:05.616166    2584 patch_prober.go:28] interesting pod/e2e-mt-28e80ad8-openshift-default-5f7f95ffb7-dx48z container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused" start-of-body=
Jul 20 13:35:05.616369 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:35:05.616222    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-28e80ad8-openshift-default-5f7f95ffb7-dx48z" podUID="fdba1a38-8f9a-47ac-8465-86fb2837c552" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused"
Jul 20 13:35:06.615821 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:35:06.615779    2584 patch_prober.go:28] interesting pod/e2e-mt-28e80ad8-openshift-default-5f7f95ffb7-dx48z container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused" start-of-body=
Jul 20 13:35:06.616270 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:35:06.615839    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-28e80ad8-openshift-default-5f7f95ffb7-dx48z" podUID="fdba1a38-8f9a-47ac-8465-86fb2837c552" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused"
Jul 20 13:35:07.619954 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:35:07.619921    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-28e80ad8-openshift-default-5f7f95ffb7-dx48z"
Jul 20 13:35:07.620373 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:35:07.620242    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-28e80ad8-openshift-default-5f7f95ffb7-dx48z"
Jul 20 13:35:07.621146 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:35:07.621127    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-28e80ad8-openshift-default-5f7f95ffb7-dx48z"
Jul 20 13:35:10.931073 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:35:10.931035    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-28e80ad8-5bb76fb758-fglp9"]
Jul 20 13:35:10.931541 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:35:10.931269    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-28e80ad8-5bb76fb758-fglp9" podUID="732dfd65-2768-45ce-8606-a1d933535740" containerName="maas-api" containerID="cri-o://8bdbd50d68d971b8c26199e8d02d7baa35d11908851668878e7f9bb3a0e1f84c" gracePeriod=30
Jul 20 13:35:11.060736 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:35:11.060694    2584 prober.go:120] "Probe failed" probeType="Readiness" pod="odh-ai-gateway-infra/maas-api-e2e-mt-28e80ad8-5bb76fb758-fglp9" podUID="732dfd65-2768-45ce-8606-a1d933535740" containerName="maas-api" probeResult="failure" output="Get \"https://10.134.0.56:8443/health\": dial tcp 10.134.0.56:8443: connect: connection refused"
Jul 20 13:35:11.188302 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:35:11.188219    2584 generic.go:356] "Generic (PLEG): container finished" podID="732dfd65-2768-45ce-8606-a1d933535740" containerID="8bdbd50d68d971b8c26199e8d02d7baa35d11908851668878e7f9bb3a0e1f84c" exitCode=0
Jul 20 13:35:11.188302 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:35:11.188257    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-28e80ad8-5bb76fb758-fglp9" event={"ID":"732dfd65-2768-45ce-8606-a1d933535740","Type":"ContainerDied","Data":"8bdbd50d68d971b8c26199e8d02d7baa35d11908851668878e7f9bb3a0e1f84c"}
Jul 20 13:35:11.188302 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:35:11.188297    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-28e80ad8-5bb76fb758-fglp9" event={"ID":"732dfd65-2768-45ce-8606-a1d933535740","Type":"ContainerDied","Data":"bbeb2668e2a226160aa2fa98f761576ee3ca87d6aa410e299512c647a4026b00"}
Jul 20 13:35:11.188511 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:35:11.188312    2584 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="bbeb2668e2a226160aa2fa98f761576ee3ca87d6aa410e299512c647a4026b00"
Jul 20 13:35:11.194715 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:35:11.194690    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-28e80ad8-5bb76fb758-fglp9"
Jul 20 13:35:11.294686 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:35:11.294655    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/732dfd65-2768-45ce-8606-a1d933535740-openshift-service-ca\") pod \"732dfd65-2768-45ce-8606-a1d933535740\" (UID: \"732dfd65-2768-45ce-8606-a1d933535740\") "
Jul 20 13:35:11.294860 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:35:11.294764    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/732dfd65-2768-45ce-8606-a1d933535740-maas-api-tls\") pod \"732dfd65-2768-45ce-8606-a1d933535740\" (UID: \"732dfd65-2768-45ce-8606-a1d933535740\") "
Jul 20 13:35:11.294860 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:35:11.294846    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kwv9c\" (UniqueName: \"kubernetes.io/projected/732dfd65-2768-45ce-8606-a1d933535740-kube-api-access-kwv9c\") pod \"732dfd65-2768-45ce-8606-a1d933535740\" (UID: \"732dfd65-2768-45ce-8606-a1d933535740\") "
Jul 20 13:35:11.295083 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:35:11.295057    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/732dfd65-2768-45ce-8606-a1d933535740-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "732dfd65-2768-45ce-8606-a1d933535740" (UID: "732dfd65-2768-45ce-8606-a1d933535740"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 13:35:11.295197 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:35:11.295176    2584 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/732dfd65-2768-45ce-8606-a1d933535740-openshift-service-ca\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 20 13:35:11.296882 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:35:11.296860    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/732dfd65-2768-45ce-8606-a1d933535740-kube-api-access-kwv9c" (OuterVolumeSpecName: "kube-api-access-kwv9c") pod "732dfd65-2768-45ce-8606-a1d933535740" (UID: "732dfd65-2768-45ce-8606-a1d933535740"). InnerVolumeSpecName "kube-api-access-kwv9c". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 13:35:11.296993 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:35:11.296862    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/732dfd65-2768-45ce-8606-a1d933535740-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "732dfd65-2768-45ce-8606-a1d933535740" (UID: "732dfd65-2768-45ce-8606-a1d933535740"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 13:35:11.396353 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:35:11.396309    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kwv9c\" (UniqueName: \"kubernetes.io/projected/732dfd65-2768-45ce-8606-a1d933535740-kube-api-access-kwv9c\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 20 13:35:11.396353 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:35:11.396345    2584 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/732dfd65-2768-45ce-8606-a1d933535740-maas-api-tls\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 20 13:35:12.193751 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:35:12.193715    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-28e80ad8-5bb76fb758-fglp9"
Jul 20 13:35:12.215175 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:35:12.215141    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-28e80ad8-5bb76fb758-fglp9"]
Jul 20 13:35:12.221625 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:35:12.221595    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-28e80ad8-5bb76fb758-fglp9"]
Jul 20 13:35:13.096381 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:35:13.096344    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="732dfd65-2768-45ce-8606-a1d933535740" path="/var/lib/kubelet/pods/732dfd65-2768-45ce-8606-a1d933535740/volumes"
Jul 20 13:35:25.975396 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:35:25.975359    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-28e80ad8-openshift-default-5f7f95ffb7-dx48z"]
Jul 20 13:35:25.976025 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:35:25.975625    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-28e80ad8-openshift-default-5f7f95ffb7-dx48z" podUID="fdba1a38-8f9a-47ac-8465-86fb2837c552" containerName="istio-proxy" containerID="cri-o://c2ab438d01c4b0930b81870c903766858e272ff4481459f1d04f26a27113257c" gracePeriod=30
Jul 20 13:35:31.229849 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:35:31.229820    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-28e80ad8-openshift-default-5f7f95ffb7-dx48z"
Jul 20 13:35:31.294686 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:35:31.294655    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fdba1a38-8f9a-47ac-8465-86fb2837c552-workload-certs\") pod \"fdba1a38-8f9a-47ac-8465-86fb2837c552\" (UID: \"fdba1a38-8f9a-47ac-8465-86fb2837c552\") "
Jul 20 13:35:31.294873 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:35:31.294717    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fdba1a38-8f9a-47ac-8465-86fb2837c552-workload-socket\") pod \"fdba1a38-8f9a-47ac-8465-86fb2837c552\" (UID: \"fdba1a38-8f9a-47ac-8465-86fb2837c552\") "
Jul 20 13:35:31.294873 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:35:31.294751    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fdba1a38-8f9a-47ac-8465-86fb2837c552-credential-socket\") pod \"fdba1a38-8f9a-47ac-8465-86fb2837c552\" (UID: \"fdba1a38-8f9a-47ac-8465-86fb2837c552\") "
Jul 20 13:35:31.294873 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:35:31.294784    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jxctr\" (UniqueName: \"kubernetes.io/projected/fdba1a38-8f9a-47ac-8465-86fb2837c552-kube-api-access-jxctr\") pod \"fdba1a38-8f9a-47ac-8465-86fb2837c552\" (UID: \"fdba1a38-8f9a-47ac-8465-86fb2837c552\") "
Jul 20 13:35:31.294873 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:35:31.294830    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fdba1a38-8f9a-47ac-8465-86fb2837c552-istiod-ca-cert\") pod \"fdba1a38-8f9a-47ac-8465-86fb2837c552\" (UID: \"fdba1a38-8f9a-47ac-8465-86fb2837c552\") "
Jul 20 13:35:31.294873 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:35:31.294860    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fdba1a38-8f9a-47ac-8465-86fb2837c552-istio-token\") pod \"fdba1a38-8f9a-47ac-8465-86fb2837c552\" (UID: \"fdba1a38-8f9a-47ac-8465-86fb2837c552\") "
Jul 20 13:35:31.295166 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:35:31.294904    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fdba1a38-8f9a-47ac-8465-86fb2837c552-istio-podinfo\") pod \"fdba1a38-8f9a-47ac-8465-86fb2837c552\" (UID: \"fdba1a38-8f9a-47ac-8465-86fb2837c552\") "
Jul 20 13:35:31.295166 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:35:31.294978    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fdba1a38-8f9a-47ac-8465-86fb2837c552-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "fdba1a38-8f9a-47ac-8465-86fb2837c552" (UID: "fdba1a38-8f9a-47ac-8465-86fb2837c552"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 13:35:31.295166 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:35:31.295003    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fdba1a38-8f9a-47ac-8465-86fb2837c552-istio-envoy\") pod \"fdba1a38-8f9a-47ac-8465-86fb2837c552\" (UID: \"fdba1a38-8f9a-47ac-8465-86fb2837c552\") "
Jul 20 13:35:31.295166 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:35:31.295029    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fdba1a38-8f9a-47ac-8465-86fb2837c552-istio-data\") pod \"fdba1a38-8f9a-47ac-8465-86fb2837c552\" (UID: \"fdba1a38-8f9a-47ac-8465-86fb2837c552\") "
Jul 20 13:35:31.295166 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:35:31.295022    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fdba1a38-8f9a-47ac-8465-86fb2837c552-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "fdba1a38-8f9a-47ac-8465-86fb2837c552" (UID: "fdba1a38-8f9a-47ac-8465-86fb2837c552"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 13:35:31.295445 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:35:31.295228    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fdba1a38-8f9a-47ac-8465-86fb2837c552-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "fdba1a38-8f9a-47ac-8465-86fb2837c552" (UID: "fdba1a38-8f9a-47ac-8465-86fb2837c552"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 13:35:31.295445 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:35:31.295393    2584 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fdba1a38-8f9a-47ac-8465-86fb2837c552-workload-certs\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 20 13:35:31.295445 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:35:31.295410    2584 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fdba1a38-8f9a-47ac-8465-86fb2837c552-workload-socket\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 20 13:35:31.295445 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:35:31.295429    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fdba1a38-8f9a-47ac-8465-86fb2837c552-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "fdba1a38-8f9a-47ac-8465-86fb2837c552" (UID: "fdba1a38-8f9a-47ac-8465-86fb2837c552"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 13:35:31.295842 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:35:31.295819    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fdba1a38-8f9a-47ac-8465-86fb2837c552-istio-data" (OuterVolumeSpecName: "istio-data") pod "fdba1a38-8f9a-47ac-8465-86fb2837c552" (UID: "fdba1a38-8f9a-47ac-8465-86fb2837c552"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 13:35:31.297191 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:35:31.297167    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fdba1a38-8f9a-47ac-8465-86fb2837c552-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "fdba1a38-8f9a-47ac-8465-86fb2837c552" (UID: "fdba1a38-8f9a-47ac-8465-86fb2837c552"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 13:35:31.297191 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:35:31.297187    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fdba1a38-8f9a-47ac-8465-86fb2837c552-istio-token" (OuterVolumeSpecName: "istio-token") pod "fdba1a38-8f9a-47ac-8465-86fb2837c552" (UID: "fdba1a38-8f9a-47ac-8465-86fb2837c552"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 13:35:31.297447 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:35:31.297414    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/fdba1a38-8f9a-47ac-8465-86fb2837c552-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "fdba1a38-8f9a-47ac-8465-86fb2837c552" (UID: "fdba1a38-8f9a-47ac-8465-86fb2837c552"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 20 13:35:31.297447 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:35:31.297418    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fdba1a38-8f9a-47ac-8465-86fb2837c552-kube-api-access-jxctr" (OuterVolumeSpecName: "kube-api-access-jxctr") pod "fdba1a38-8f9a-47ac-8465-86fb2837c552" (UID: "fdba1a38-8f9a-47ac-8465-86fb2837c552"). InnerVolumeSpecName "kube-api-access-jxctr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 13:35:31.307883 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:35:31.307858    2584 generic.go:356] "Generic (PLEG): container finished" podID="fdba1a38-8f9a-47ac-8465-86fb2837c552" containerID="c2ab438d01c4b0930b81870c903766858e272ff4481459f1d04f26a27113257c" exitCode=0
Jul 20 13:35:31.308005 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:35:31.307912    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-28e80ad8-openshift-default-5f7f95ffb7-dx48z"
Jul 20 13:35:31.308005 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:35:31.307936    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-28e80ad8-openshift-default-5f7f95ffb7-dx48z" event={"ID":"fdba1a38-8f9a-47ac-8465-86fb2837c552","Type":"ContainerDied","Data":"c2ab438d01c4b0930b81870c903766858e272ff4481459f1d04f26a27113257c"}
Jul 20 13:35:31.308119 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:35:31.308017    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-28e80ad8-openshift-default-5f7f95ffb7-dx48z" event={"ID":"fdba1a38-8f9a-47ac-8465-86fb2837c552","Type":"ContainerDied","Data":"e47192b9b3c0a305268bf832d9e7727ab6cb28bc274e6908e5ddf3ac40d15262"}
Jul 20 13:35:31.308119 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:35:31.308042    2584 scope.go:117] "RemoveContainer" containerID="c2ab438d01c4b0930b81870c903766858e272ff4481459f1d04f26a27113257c"
Jul 20 13:35:31.319070 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:35:31.319048    2584 scope.go:117] "RemoveContainer" containerID="9184bd9b3358e7b778c275fb49260c919ecf2e334d4b28d10631dc79f7cbb2e8"
Jul 20 13:35:31.327577 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:35:31.327546    2584 scope.go:117] "RemoveContainer" containerID="c2ab438d01c4b0930b81870c903766858e272ff4481459f1d04f26a27113257c"
Jul 20 13:35:31.328004 ip-10-0-134-121 kubenswrapper[2584]: E0720 13:35:31.327907    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c2ab438d01c4b0930b81870c903766858e272ff4481459f1d04f26a27113257c\": container with ID starting with c2ab438d01c4b0930b81870c903766858e272ff4481459f1d04f26a27113257c not found: ID does not exist" containerID="c2ab438d01c4b0930b81870c903766858e272ff4481459f1d04f26a27113257c"
Jul 20 13:35:31.328109 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:35:31.327945    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c2ab438d01c4b0930b81870c903766858e272ff4481459f1d04f26a27113257c"} err="failed to get container status \"c2ab438d01c4b0930b81870c903766858e272ff4481459f1d04f26a27113257c\": rpc error: code = NotFound desc = could not find container \"c2ab438d01c4b0930b81870c903766858e272ff4481459f1d04f26a27113257c\": container with ID starting with c2ab438d01c4b0930b81870c903766858e272ff4481459f1d04f26a27113257c not found: ID does not exist"
Jul 20 13:35:31.328109 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:35:31.328041    2584 scope.go:117] "RemoveContainer" containerID="9184bd9b3358e7b778c275fb49260c919ecf2e334d4b28d10631dc79f7cbb2e8"
Jul 20 13:35:31.328363 ip-10-0-134-121 kubenswrapper[2584]: E0720 13:35:31.328347    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9184bd9b3358e7b778c275fb49260c919ecf2e334d4b28d10631dc79f7cbb2e8\": container with ID starting with 9184bd9b3358e7b778c275fb49260c919ecf2e334d4b28d10631dc79f7cbb2e8 not found: ID does not exist" containerID="9184bd9b3358e7b778c275fb49260c919ecf2e334d4b28d10631dc79f7cbb2e8"
Jul 20 13:35:31.328413 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:35:31.328369    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9184bd9b3358e7b778c275fb49260c919ecf2e334d4b28d10631dc79f7cbb2e8"} err="failed to get container status \"9184bd9b3358e7b778c275fb49260c919ecf2e334d4b28d10631dc79f7cbb2e8\": rpc error: code = NotFound desc = could not find container \"9184bd9b3358e7b778c275fb49260c919ecf2e334d4b28d10631dc79f7cbb2e8\": container with ID starting with 9184bd9b3358e7b778c275fb49260c919ecf2e334d4b28d10631dc79f7cbb2e8 not found: ID does not exist"
Jul 20 13:35:31.329638 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:35:31.329617    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-28e80ad8-openshift-default-5f7f95ffb7-dx48z"]
Jul 20 13:35:31.337446 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:35:31.337425    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-28e80ad8-openshift-default-5f7f95ffb7-dx48z"]
Jul 20 13:35:31.396570 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:35:31.396542    2584 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fdba1a38-8f9a-47ac-8465-86fb2837c552-istio-podinfo\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 20 13:35:31.396570 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:35:31.396565    2584 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fdba1a38-8f9a-47ac-8465-86fb2837c552-istio-envoy\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 20 13:35:31.396570 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:35:31.396576    2584 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fdba1a38-8f9a-47ac-8465-86fb2837c552-istio-data\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 20 13:35:31.396797 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:35:31.396583    2584 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fdba1a38-8f9a-47ac-8465-86fb2837c552-credential-socket\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 20 13:35:31.396797 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:35:31.396594    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jxctr\" (UniqueName: \"kubernetes.io/projected/fdba1a38-8f9a-47ac-8465-86fb2837c552-kube-api-access-jxctr\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 20 13:35:31.396797 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:35:31.396603    2584 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fdba1a38-8f9a-47ac-8465-86fb2837c552-istiod-ca-cert\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 20 13:35:31.396797 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:35:31.396611    2584 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fdba1a38-8f9a-47ac-8465-86fb2837c552-istio-token\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 20 13:35:33.096160 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:35:33.096124    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fdba1a38-8f9a-47ac-8465-86fb2837c552" path="/var/lib/kubelet/pods/fdba1a38-8f9a-47ac-8465-86fb2837c552/volumes"
Jul 20 13:35:45.920861 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:35:45.920824    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-aba71aa1-openshift-default-7c5988845f-mxjc5"]
Jul 20 13:35:45.921547 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:35:45.921526    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="732dfd65-2768-45ce-8606-a1d933535740" containerName="maas-api"
Jul 20 13:35:45.921633 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:35:45.921551    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="732dfd65-2768-45ce-8606-a1d933535740" containerName="maas-api"
Jul 20 13:35:45.921633 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:35:45.921570    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fdba1a38-8f9a-47ac-8465-86fb2837c552" containerName="istio-proxy"
Jul 20 13:35:45.921633 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:35:45.921580    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="fdba1a38-8f9a-47ac-8465-86fb2837c552" containerName="istio-proxy"
Jul 20 13:35:45.921633 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:35:45.921591    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fdba1a38-8f9a-47ac-8465-86fb2837c552" containerName="istio-proxy"
Jul 20 13:35:45.921633 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:35:45.921601    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="fdba1a38-8f9a-47ac-8465-86fb2837c552" containerName="istio-proxy"
Jul 20 13:35:45.921889 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:35:45.921722    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="fdba1a38-8f9a-47ac-8465-86fb2837c552" containerName="istio-proxy"
Jul 20 13:35:45.921889 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:35:45.921737    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="732dfd65-2768-45ce-8606-a1d933535740" containerName="maas-api"
Jul 20 13:35:45.921889 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:35:45.921748    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="fdba1a38-8f9a-47ac-8465-86fb2837c552" containerName="istio-proxy"
Jul 20 13:35:45.927215 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:35:45.927193    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-aba71aa1-openshift-default-7c5988845f-mxjc5"
Jul 20 13:35:45.929628 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:35:45.929609    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-aba71aa1-openshift-default-dockercfg-8zswm\""
Jul 20 13:35:45.938392 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:35:45.938348    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-aba71aa1-openshift-default-7c5988845f-mxjc5"]
Jul 20 13:35:46.037448 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:35:46.037409    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a078a7b6-d9bd-4566-b092-80c3cfdfeec3-workload-certs\") pod \"e2e-mt-aba71aa1-openshift-default-7c5988845f-mxjc5\" (UID: \"a078a7b6-d9bd-4566-b092-80c3cfdfeec3\") " pod="openshift-ingress/e2e-mt-aba71aa1-openshift-default-7c5988845f-mxjc5"
Jul 20 13:35:46.037637 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:35:46.037453    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a078a7b6-d9bd-4566-b092-80c3cfdfeec3-credential-socket\") pod \"e2e-mt-aba71aa1-openshift-default-7c5988845f-mxjc5\" (UID: \"a078a7b6-d9bd-4566-b092-80c3cfdfeec3\") " pod="openshift-ingress/e2e-mt-aba71aa1-openshift-default-7c5988845f-mxjc5"
Jul 20 13:35:46.037637 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:35:46.037512    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a078a7b6-d9bd-4566-b092-80c3cfdfeec3-istio-token\") pod \"e2e-mt-aba71aa1-openshift-default-7c5988845f-mxjc5\" (UID: \"a078a7b6-d9bd-4566-b092-80c3cfdfeec3\") " pod="openshift-ingress/e2e-mt-aba71aa1-openshift-default-7c5988845f-mxjc5"
Jul 20 13:35:46.037637 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:35:46.037561    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a078a7b6-d9bd-4566-b092-80c3cfdfeec3-istio-envoy\") pod \"e2e-mt-aba71aa1-openshift-default-7c5988845f-mxjc5\" (UID: \"a078a7b6-d9bd-4566-b092-80c3cfdfeec3\") " pod="openshift-ingress/e2e-mt-aba71aa1-openshift-default-7c5988845f-mxjc5"
Jul 20 13:35:46.037637 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:35:46.037594    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a078a7b6-d9bd-4566-b092-80c3cfdfeec3-workload-socket\") pod \"e2e-mt-aba71aa1-openshift-default-7c5988845f-mxjc5\" (UID: \"a078a7b6-d9bd-4566-b092-80c3cfdfeec3\") " pod="openshift-ingress/e2e-mt-aba71aa1-openshift-default-7c5988845f-mxjc5"
Jul 20 13:35:46.037825 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:35:46.037665    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pj9gs\" (UniqueName: \"kubernetes.io/projected/a078a7b6-d9bd-4566-b092-80c3cfdfeec3-kube-api-access-pj9gs\") pod \"e2e-mt-aba71aa1-openshift-default-7c5988845f-mxjc5\" (UID: \"a078a7b6-d9bd-4566-b092-80c3cfdfeec3\") " pod="openshift-ingress/e2e-mt-aba71aa1-openshift-default-7c5988845f-mxjc5"
Jul 20 13:35:46.037825 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:35:46.037711    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a078a7b6-d9bd-4566-b092-80c3cfdfeec3-istio-podinfo\") pod \"e2e-mt-aba71aa1-openshift-default-7c5988845f-mxjc5\" (UID: \"a078a7b6-d9bd-4566-b092-80c3cfdfeec3\") " pod="openshift-ingress/e2e-mt-aba71aa1-openshift-default-7c5988845f-mxjc5"
Jul 20 13:35:46.037825 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:35:46.037756    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a078a7b6-d9bd-4566-b092-80c3cfdfeec3-istio-data\") pod \"e2e-mt-aba71aa1-openshift-default-7c5988845f-mxjc5\" (UID: \"a078a7b6-d9bd-4566-b092-80c3cfdfeec3\") " pod="openshift-ingress/e2e-mt-aba71aa1-openshift-default-7c5988845f-mxjc5"
Jul 20 13:35:46.037825 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:35:46.037778    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a078a7b6-d9bd-4566-b092-80c3cfdfeec3-istiod-ca-cert\") pod \"e2e-mt-aba71aa1-openshift-default-7c5988845f-mxjc5\" (UID: \"a078a7b6-d9bd-4566-b092-80c3cfdfeec3\") " pod="openshift-ingress/e2e-mt-aba71aa1-openshift-default-7c5988845f-mxjc5"
Jul 20 13:35:46.139005 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:35:46.138944    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a078a7b6-d9bd-4566-b092-80c3cfdfeec3-istio-envoy\") pod \"e2e-mt-aba71aa1-openshift-default-7c5988845f-mxjc5\" (UID: \"a078a7b6-d9bd-4566-b092-80c3cfdfeec3\") " pod="openshift-ingress/e2e-mt-aba71aa1-openshift-default-7c5988845f-mxjc5"
Jul 20 13:35:46.139190 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:35:46.139019    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a078a7b6-d9bd-4566-b092-80c3cfdfeec3-workload-socket\") pod \"e2e-mt-aba71aa1-openshift-default-7c5988845f-mxjc5\" (UID: \"a078a7b6-d9bd-4566-b092-80c3cfdfeec3\") " pod="openshift-ingress/e2e-mt-aba71aa1-openshift-default-7c5988845f-mxjc5"
Jul 20 13:35:46.139190 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:35:46.139053    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pj9gs\" (UniqueName: \"kubernetes.io/projected/a078a7b6-d9bd-4566-b092-80c3cfdfeec3-kube-api-access-pj9gs\") pod \"e2e-mt-aba71aa1-openshift-default-7c5988845f-mxjc5\" (UID: \"a078a7b6-d9bd-4566-b092-80c3cfdfeec3\") " pod="openshift-ingress/e2e-mt-aba71aa1-openshift-default-7c5988845f-mxjc5"
Jul 20 13:35:46.139190 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:35:46.139097    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a078a7b6-d9bd-4566-b092-80c3cfdfeec3-istio-podinfo\") pod \"e2e-mt-aba71aa1-openshift-default-7c5988845f-mxjc5\" (UID: \"a078a7b6-d9bd-4566-b092-80c3cfdfeec3\") " pod="openshift-ingress/e2e-mt-aba71aa1-openshift-default-7c5988845f-mxjc5"
Jul 20 13:35:46.139190 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:35:46.139137    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a078a7b6-d9bd-4566-b092-80c3cfdfeec3-istio-data\") pod \"e2e-mt-aba71aa1-openshift-default-7c5988845f-mxjc5\" (UID: \"a078a7b6-d9bd-4566-b092-80c3cfdfeec3\") " pod="openshift-ingress/e2e-mt-aba71aa1-openshift-default-7c5988845f-mxjc5"
Jul 20 13:35:46.139190 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:35:46.139159    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a078a7b6-d9bd-4566-b092-80c3cfdfeec3-istiod-ca-cert\") pod \"e2e-mt-aba71aa1-openshift-default-7c5988845f-mxjc5\" (UID: \"a078a7b6-d9bd-4566-b092-80c3cfdfeec3\") " pod="openshift-ingress/e2e-mt-aba71aa1-openshift-default-7c5988845f-mxjc5"
Jul 20 13:35:46.139190 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:35:46.139186    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a078a7b6-d9bd-4566-b092-80c3cfdfeec3-workload-certs\") pod \"e2e-mt-aba71aa1-openshift-default-7c5988845f-mxjc5\" (UID: \"a078a7b6-d9bd-4566-b092-80c3cfdfeec3\") " pod="openshift-ingress/e2e-mt-aba71aa1-openshift-default-7c5988845f-mxjc5"
Jul 20 13:35:46.139551 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:35:46.139215    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a078a7b6-d9bd-4566-b092-80c3cfdfeec3-credential-socket\") pod \"e2e-mt-aba71aa1-openshift-default-7c5988845f-mxjc5\" (UID: \"a078a7b6-d9bd-4566-b092-80c3cfdfeec3\") " pod="openshift-ingress/e2e-mt-aba71aa1-openshift-default-7c5988845f-mxjc5"
Jul 20 13:35:46.139551 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:35:46.139238    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a078a7b6-d9bd-4566-b092-80c3cfdfeec3-istio-token\") pod \"e2e-mt-aba71aa1-openshift-default-7c5988845f-mxjc5\" (UID: \"a078a7b6-d9bd-4566-b092-80c3cfdfeec3\") " pod="openshift-ingress/e2e-mt-aba71aa1-openshift-default-7c5988845f-mxjc5"
Jul 20 13:35:46.139551 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:35:46.139476    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a078a7b6-d9bd-4566-b092-80c3cfdfeec3-workload-socket\") pod \"e2e-mt-aba71aa1-openshift-default-7c5988845f-mxjc5\" (UID: \"a078a7b6-d9bd-4566-b092-80c3cfdfeec3\") " pod="openshift-ingress/e2e-mt-aba71aa1-openshift-default-7c5988845f-mxjc5"
Jul 20 13:35:46.139721 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:35:46.139664    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a078a7b6-d9bd-4566-b092-80c3cfdfeec3-istio-data\") pod \"e2e-mt-aba71aa1-openshift-default-7c5988845f-mxjc5\" (UID: \"a078a7b6-d9bd-4566-b092-80c3cfdfeec3\") " pod="openshift-ingress/e2e-mt-aba71aa1-openshift-default-7c5988845f-mxjc5"
Jul 20 13:35:46.139721 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:35:46.139693    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a078a7b6-d9bd-4566-b092-80c3cfdfeec3-credential-socket\") pod \"e2e-mt-aba71aa1-openshift-default-7c5988845f-mxjc5\" (UID: \"a078a7b6-d9bd-4566-b092-80c3cfdfeec3\") " pod="openshift-ingress/e2e-mt-aba71aa1-openshift-default-7c5988845f-mxjc5"
Jul 20 13:35:46.139721 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:35:46.139717    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a078a7b6-d9bd-4566-b092-80c3cfdfeec3-workload-certs\") pod \"e2e-mt-aba71aa1-openshift-default-7c5988845f-mxjc5\" (UID: \"a078a7b6-d9bd-4566-b092-80c3cfdfeec3\") " pod="openshift-ingress/e2e-mt-aba71aa1-openshift-default-7c5988845f-mxjc5"
Jul 20 13:35:46.139909 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:35:46.139802    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a078a7b6-d9bd-4566-b092-80c3cfdfeec3-istiod-ca-cert\") pod \"e2e-mt-aba71aa1-openshift-default-7c5988845f-mxjc5\" (UID: \"a078a7b6-d9bd-4566-b092-80c3cfdfeec3\") " pod="openshift-ingress/e2e-mt-aba71aa1-openshift-default-7c5988845f-mxjc5"
Jul 20 13:35:46.141269 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:35:46.141244    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a078a7b6-d9bd-4566-b092-80c3cfdfeec3-istio-envoy\") pod \"e2e-mt-aba71aa1-openshift-default-7c5988845f-mxjc5\" (UID: \"a078a7b6-d9bd-4566-b092-80c3cfdfeec3\") " pod="openshift-ingress/e2e-mt-aba71aa1-openshift-default-7c5988845f-mxjc5"
Jul 20 13:35:46.141539 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:35:46.141522    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a078a7b6-d9bd-4566-b092-80c3cfdfeec3-istio-podinfo\") pod \"e2e-mt-aba71aa1-openshift-default-7c5988845f-mxjc5\" (UID: \"a078a7b6-d9bd-4566-b092-80c3cfdfeec3\") " pod="openshift-ingress/e2e-mt-aba71aa1-openshift-default-7c5988845f-mxjc5"
Jul 20 13:35:46.146882 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:35:46.146857    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pj9gs\" (UniqueName: \"kubernetes.io/projected/a078a7b6-d9bd-4566-b092-80c3cfdfeec3-kube-api-access-pj9gs\") pod \"e2e-mt-aba71aa1-openshift-default-7c5988845f-mxjc5\" (UID: \"a078a7b6-d9bd-4566-b092-80c3cfdfeec3\") " pod="openshift-ingress/e2e-mt-aba71aa1-openshift-default-7c5988845f-mxjc5"
Jul 20 13:35:46.147003 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:35:46.146957    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a078a7b6-d9bd-4566-b092-80c3cfdfeec3-istio-token\") pod \"e2e-mt-aba71aa1-openshift-default-7c5988845f-mxjc5\" (UID: \"a078a7b6-d9bd-4566-b092-80c3cfdfeec3\") " pod="openshift-ingress/e2e-mt-aba71aa1-openshift-default-7c5988845f-mxjc5"
Jul 20 13:35:46.239370 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:35:46.239275    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-aba71aa1-openshift-default-7c5988845f-mxjc5"
Jul 20 13:35:46.388765 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:35:46.388741    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-aba71aa1-openshift-default-7c5988845f-mxjc5"]
Jul 20 13:35:46.391200 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:35:46.391173    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda078a7b6_d9bd_4566_b092_80c3cfdfeec3.slice/crio-b84b9b390aa5eb96eb7aeaa1f53415ae10b217478860dfd8f3a7a77e8687f837 WatchSource:0}: Error finding container b84b9b390aa5eb96eb7aeaa1f53415ae10b217478860dfd8f3a7a77e8687f837: Status 404 returned error can't find the container with id b84b9b390aa5eb96eb7aeaa1f53415ae10b217478860dfd8f3a7a77e8687f837
Jul 20 13:35:46.393560 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:35:46.393527    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 20 13:35:46.393649 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:35:46.393593    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 20 13:35:46.393649 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:35:46.393619    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 20 13:35:47.398569 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:35:47.398530    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-aba71aa1-openshift-default-7c5988845f-mxjc5" event={"ID":"a078a7b6-d9bd-4566-b092-80c3cfdfeec3","Type":"ContainerStarted","Data":"ad889afa9866d30de8a0e015c92af682bcb9be456e842f890dd222f4435212a3"}
Jul 20 13:35:47.399092 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:35:47.398589    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-aba71aa1-openshift-default-7c5988845f-mxjc5" event={"ID":"a078a7b6-d9bd-4566-b092-80c3cfdfeec3","Type":"ContainerStarted","Data":"b84b9b390aa5eb96eb7aeaa1f53415ae10b217478860dfd8f3a7a77e8687f837"}
Jul 20 13:35:48.240139 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:35:48.240104    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-aba71aa1-openshift-default-7c5988845f-mxjc5"
Jul 20 13:35:48.245045 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:35:48.245017    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-aba71aa1-openshift-default-7c5988845f-mxjc5"
Jul 20 13:35:48.265789 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:35:48.265738    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-aba71aa1-openshift-default-7c5988845f-mxjc5" podStartSLOduration=3.26572165 podStartE2EDuration="3.26572165s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 13:35:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 13:35:47.434454847 +0000 UTC m=+2037.151002258" watchObservedRunningTime="2026-07-20 13:35:48.26572165 +0000 UTC m=+2037.982269060"
Jul 20 13:35:48.405287 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:35:48.405256    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-aba71aa1-openshift-default-7c5988845f-mxjc5"
Jul 20 13:35:48.406384 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:35:48.406362    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-aba71aa1-openshift-default-7c5988845f-mxjc5"
Jul 20 13:35:49.547342 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:35:49.547308    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-aba71aa1-cbc9cd64f-fmp46"]
Jul 20 13:35:49.551486 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:35:49.551461    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-aba71aa1-cbc9cd64f-fmp46"
Jul 20 13:35:49.554237 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:35:49.554213    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-aba71aa1-serving-cert\""
Jul 20 13:35:49.554405 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:35:49.554341    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-vf2sw\""
Jul 20 13:35:49.561870 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:35:49.561840    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-aba71aa1-cbc9cd64f-fmp46"]
Jul 20 13:35:49.675768 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:35:49.675733    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/90966cbe-6c55-47e9-a727-3be4f619d3fd-maas-api-tls\") pod \"maas-api-e2e-mt-aba71aa1-cbc9cd64f-fmp46\" (UID: \"90966cbe-6c55-47e9-a727-3be4f619d3fd\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-aba71aa1-cbc9cd64f-fmp46"
Jul 20 13:35:49.675978 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:35:49.675795    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lvrzb\" (UniqueName: \"kubernetes.io/projected/90966cbe-6c55-47e9-a727-3be4f619d3fd-kube-api-access-lvrzb\") pod \"maas-api-e2e-mt-aba71aa1-cbc9cd64f-fmp46\" (UID: \"90966cbe-6c55-47e9-a727-3be4f619d3fd\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-aba71aa1-cbc9cd64f-fmp46"
Jul 20 13:35:49.675978 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:35:49.675904    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/90966cbe-6c55-47e9-a727-3be4f619d3fd-openshift-service-ca\") pod \"maas-api-e2e-mt-aba71aa1-cbc9cd64f-fmp46\" (UID: \"90966cbe-6c55-47e9-a727-3be4f619d3fd\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-aba71aa1-cbc9cd64f-fmp46"
Jul 20 13:35:49.776842 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:35:49.776805    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/90966cbe-6c55-47e9-a727-3be4f619d3fd-maas-api-tls\") pod \"maas-api-e2e-mt-aba71aa1-cbc9cd64f-fmp46\" (UID: \"90966cbe-6c55-47e9-a727-3be4f619d3fd\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-aba71aa1-cbc9cd64f-fmp46"
Jul 20 13:35:49.777064 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:35:49.776997    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lvrzb\" (UniqueName: \"kubernetes.io/projected/90966cbe-6c55-47e9-a727-3be4f619d3fd-kube-api-access-lvrzb\") pod \"maas-api-e2e-mt-aba71aa1-cbc9cd64f-fmp46\" (UID: \"90966cbe-6c55-47e9-a727-3be4f619d3fd\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-aba71aa1-cbc9cd64f-fmp46"
Jul 20 13:35:49.777141 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:35:49.777108    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/90966cbe-6c55-47e9-a727-3be4f619d3fd-openshift-service-ca\") pod \"maas-api-e2e-mt-aba71aa1-cbc9cd64f-fmp46\" (UID: \"90966cbe-6c55-47e9-a727-3be4f619d3fd\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-aba71aa1-cbc9cd64f-fmp46"
Jul 20 13:35:49.777710 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:35:49.777692    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/90966cbe-6c55-47e9-a727-3be4f619d3fd-openshift-service-ca\") pod \"maas-api-e2e-mt-aba71aa1-cbc9cd64f-fmp46\" (UID: \"90966cbe-6c55-47e9-a727-3be4f619d3fd\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-aba71aa1-cbc9cd64f-fmp46"
Jul 20 13:35:49.779350 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:35:49.779329    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/90966cbe-6c55-47e9-a727-3be4f619d3fd-maas-api-tls\") pod \"maas-api-e2e-mt-aba71aa1-cbc9cd64f-fmp46\" (UID: \"90966cbe-6c55-47e9-a727-3be4f619d3fd\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-aba71aa1-cbc9cd64f-fmp46"
Jul 20 13:35:49.785674 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:35:49.785635    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lvrzb\" (UniqueName: \"kubernetes.io/projected/90966cbe-6c55-47e9-a727-3be4f619d3fd-kube-api-access-lvrzb\") pod \"maas-api-e2e-mt-aba71aa1-cbc9cd64f-fmp46\" (UID: \"90966cbe-6c55-47e9-a727-3be4f619d3fd\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-aba71aa1-cbc9cd64f-fmp46"
Jul 20 13:35:49.864899 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:35:49.864792    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-aba71aa1-cbc9cd64f-fmp46"
Jul 20 13:35:50.004612 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:35:50.004588    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-aba71aa1-cbc9cd64f-fmp46"]
Jul 20 13:35:50.007219 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:35:50.007183    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod90966cbe_6c55_47e9_a727_3be4f619d3fd.slice/crio-258e4509c399ea9fde4ba29a7fbd6e9886fe89b886e114be2911d277af5983a4 WatchSource:0}: Error finding container 258e4509c399ea9fde4ba29a7fbd6e9886fe89b886e114be2911d277af5983a4: Status 404 returned error can't find the container with id 258e4509c399ea9fde4ba29a7fbd6e9886fe89b886e114be2911d277af5983a4
Jul 20 13:35:50.417216 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:35:50.417181    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-aba71aa1-cbc9cd64f-fmp46" event={"ID":"90966cbe-6c55-47e9-a727-3be4f619d3fd","Type":"ContainerStarted","Data":"258e4509c399ea9fde4ba29a7fbd6e9886fe89b886e114be2911d277af5983a4"}
Jul 20 13:35:51.424306 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:35:51.424210    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-aba71aa1-cbc9cd64f-fmp46" event={"ID":"90966cbe-6c55-47e9-a727-3be4f619d3fd","Type":"ContainerStarted","Data":"bfb93a0c46bf726860b5c075d0c2838587acff3533aea88d588ca8f35ebd6a52"}
Jul 20 13:35:51.424865 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:35:51.424401    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-aba71aa1-cbc9cd64f-fmp46"
Jul 20 13:35:51.442840 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:35:51.442795    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-aba71aa1-cbc9cd64f-fmp46" podStartSLOduration=1.9727167589999999 podStartE2EDuration="2.442779702s" totalImagesPullingTime="470.062943ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 13:35:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 13:35:51.44182631 +0000 UTC m=+2041.158373722" watchObservedRunningTime="2026-07-20 13:35:51.442779702 +0000 UTC m=+2041.159327113"
Jul 20 13:35:57.440617 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:35:57.439883    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-aba71aa1-cbc9cd64f-fmp46"
Jul 20 13:36:02.490367 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:36:02.490333    2584 generic.go:356] "Generic (PLEG): container finished" podID="a078a7b6-d9bd-4566-b092-80c3cfdfeec3" containerID="ad889afa9866d30de8a0e015c92af682bcb9be456e842f890dd222f4435212a3" exitCode=0
Jul 20 13:36:02.490823 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:36:02.490406    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-aba71aa1-openshift-default-7c5988845f-mxjc5" event={"ID":"a078a7b6-d9bd-4566-b092-80c3cfdfeec3","Type":"ContainerDied","Data":"ad889afa9866d30de8a0e015c92af682bcb9be456e842f890dd222f4435212a3"}
Jul 20 13:36:02.490871 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:36:02.490839    2584 scope.go:117] "RemoveContainer" containerID="ad889afa9866d30de8a0e015c92af682bcb9be456e842f890dd222f4435212a3"
Jul 20 13:36:02.491913 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:36:02.491881    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 20 13:36:02.492011 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:36:02.491996    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 20 13:36:02.492056 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:36:02.492033    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 20 13:36:03.405917 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:36:03.405875    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-aba71aa1-openshift-default-7c5988845f-mxjc5"
Jul 20 13:36:03.498021 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:36:03.497989    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-aba71aa1-openshift-default-7c5988845f-mxjc5" event={"ID":"a078a7b6-d9bd-4566-b092-80c3cfdfeec3","Type":"ContainerStarted","Data":"989e296602a8c142cc3b1f068a260f919c576a1af48324b97633d1668c779067"}
Jul 20 13:36:04.240402 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:36:04.240361    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-aba71aa1-openshift-default-7c5988845f-mxjc5"
Jul 20 13:36:04.241337 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:36:04.241304    2584 patch_prober.go:28] interesting pod/e2e-mt-aba71aa1-openshift-default-7c5988845f-mxjc5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.57:15021/healthz/ready\": dial tcp 10.134.0.57:15021: connect: connection refused" start-of-body=
Jul 20 13:36:04.241471 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:36:04.241366    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-aba71aa1-openshift-default-7c5988845f-mxjc5" podUID="a078a7b6-d9bd-4566-b092-80c3cfdfeec3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.57:15021/healthz/ready\": dial tcp 10.134.0.57:15021: connect: connection refused"
Jul 20 13:36:05.240723 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:36:05.240272    2584 patch_prober.go:28] interesting pod/e2e-mt-aba71aa1-openshift-default-7c5988845f-mxjc5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.57:15021/healthz/ready\": dial tcp 10.134.0.57:15021: connect: connection refused" start-of-body=
Jul 20 13:36:05.240723 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:36:05.240335    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-aba71aa1-openshift-default-7c5988845f-mxjc5" podUID="a078a7b6-d9bd-4566-b092-80c3cfdfeec3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.57:15021/healthz/ready\": dial tcp 10.134.0.57:15021: connect: connection refused"
Jul 20 13:36:06.241336 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:36:06.241302    2584 patch_prober.go:28] interesting pod/e2e-mt-aba71aa1-openshift-default-7c5988845f-mxjc5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.57:15021/healthz/ready\": dial tcp 10.134.0.57:15021: connect: connection refused" start-of-body=
Jul 20 13:36:06.241975 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:36:06.241919    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-aba71aa1-openshift-default-7c5988845f-mxjc5" podUID="a078a7b6-d9bd-4566-b092-80c3cfdfeec3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.57:15021/healthz/ready\": dial tcp 10.134.0.57:15021: connect: connection refused"
Jul 20 13:36:07.239930 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:36:07.239890    2584 patch_prober.go:28] interesting pod/e2e-mt-aba71aa1-openshift-default-7c5988845f-mxjc5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.57:15021/healthz/ready\": dial tcp 10.134.0.57:15021: connect: connection refused" start-of-body=
Jul 20 13:36:07.240817 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:36:07.240783    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-aba71aa1-openshift-default-7c5988845f-mxjc5" podUID="a078a7b6-d9bd-4566-b092-80c3cfdfeec3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.57:15021/healthz/ready\": dial tcp 10.134.0.57:15021: connect: connection refused"
Jul 20 13:36:08.244319 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:36:08.244290    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-aba71aa1-openshift-default-7c5988845f-mxjc5"
Jul 20 13:36:08.244735 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:36:08.244684    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-aba71aa1-openshift-default-7c5988845f-mxjc5"
Jul 20 13:36:08.245458 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:36:08.245439    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-aba71aa1-openshift-default-7c5988845f-mxjc5"
Jul 20 13:36:48.623355 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:36:48.623267    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-aba71aa1-cbc9cd64f-fmp46"]
Jul 20 13:36:48.623926 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:36:48.623519    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-aba71aa1-cbc9cd64f-fmp46" podUID="90966cbe-6c55-47e9-a727-3be4f619d3fd" containerName="maas-api" containerID="cri-o://bfb93a0c46bf726860b5c075d0c2838587acff3533aea88d588ca8f35ebd6a52" gracePeriod=30
Jul 20 13:36:48.740061 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:36:48.740023    2584 generic.go:356] "Generic (PLEG): container finished" podID="90966cbe-6c55-47e9-a727-3be4f619d3fd" containerID="bfb93a0c46bf726860b5c075d0c2838587acff3533aea88d588ca8f35ebd6a52" exitCode=0
Jul 20 13:36:48.740183 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:36:48.740114    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-aba71aa1-cbc9cd64f-fmp46" event={"ID":"90966cbe-6c55-47e9-a727-3be4f619d3fd","Type":"ContainerDied","Data":"bfb93a0c46bf726860b5c075d0c2838587acff3533aea88d588ca8f35ebd6a52"}
Jul 20 13:36:48.881171 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:36:48.881099    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-aba71aa1-cbc9cd64f-fmp46"
Jul 20 13:36:48.990744 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:36:48.990708    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/90966cbe-6c55-47e9-a727-3be4f619d3fd-maas-api-tls\") pod \"90966cbe-6c55-47e9-a727-3be4f619d3fd\" (UID: \"90966cbe-6c55-47e9-a727-3be4f619d3fd\") "
Jul 20 13:36:48.990744 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:36:48.990751    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lvrzb\" (UniqueName: \"kubernetes.io/projected/90966cbe-6c55-47e9-a727-3be4f619d3fd-kube-api-access-lvrzb\") pod \"90966cbe-6c55-47e9-a727-3be4f619d3fd\" (UID: \"90966cbe-6c55-47e9-a727-3be4f619d3fd\") "
Jul 20 13:36:48.990988 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:36:48.990785    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/90966cbe-6c55-47e9-a727-3be4f619d3fd-openshift-service-ca\") pod \"90966cbe-6c55-47e9-a727-3be4f619d3fd\" (UID: \"90966cbe-6c55-47e9-a727-3be4f619d3fd\") "
Jul 20 13:36:48.991215 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:36:48.991183    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/90966cbe-6c55-47e9-a727-3be4f619d3fd-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "90966cbe-6c55-47e9-a727-3be4f619d3fd" (UID: "90966cbe-6c55-47e9-a727-3be4f619d3fd"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 13:36:48.992940 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:36:48.992913    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/90966cbe-6c55-47e9-a727-3be4f619d3fd-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "90966cbe-6c55-47e9-a727-3be4f619d3fd" (UID: "90966cbe-6c55-47e9-a727-3be4f619d3fd"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 13:36:48.993056 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:36:48.993001    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/90966cbe-6c55-47e9-a727-3be4f619d3fd-kube-api-access-lvrzb" (OuterVolumeSpecName: "kube-api-access-lvrzb") pod "90966cbe-6c55-47e9-a727-3be4f619d3fd" (UID: "90966cbe-6c55-47e9-a727-3be4f619d3fd"). InnerVolumeSpecName "kube-api-access-lvrzb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 13:36:49.092365 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:36:49.092323    2584 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/90966cbe-6c55-47e9-a727-3be4f619d3fd-maas-api-tls\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 20 13:36:49.092365 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:36:49.092350    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lvrzb\" (UniqueName: \"kubernetes.io/projected/90966cbe-6c55-47e9-a727-3be4f619d3fd-kube-api-access-lvrzb\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 20 13:36:49.092365 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:36:49.092360    2584 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/90966cbe-6c55-47e9-a727-3be4f619d3fd-openshift-service-ca\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 20 13:36:49.747104 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:36:49.747065    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-aba71aa1-cbc9cd64f-fmp46" event={"ID":"90966cbe-6c55-47e9-a727-3be4f619d3fd","Type":"ContainerDied","Data":"258e4509c399ea9fde4ba29a7fbd6e9886fe89b886e114be2911d277af5983a4"}
Jul 20 13:36:49.747104 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:36:49.747102    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-aba71aa1-cbc9cd64f-fmp46"
Jul 20 13:36:49.747642 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:36:49.747128    2584 scope.go:117] "RemoveContainer" containerID="bfb93a0c46bf726860b5c075d0c2838587acff3533aea88d588ca8f35ebd6a52"
Jul 20 13:36:49.763067 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:36:49.763038    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-aba71aa1-cbc9cd64f-fmp46"]
Jul 20 13:36:49.769407 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:36:49.769375    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-aba71aa1-cbc9cd64f-fmp46"]
Jul 20 13:36:51.095755 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:36:51.095720    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="90966cbe-6c55-47e9-a727-3be4f619d3fd" path="/var/lib/kubelet/pods/90966cbe-6c55-47e9-a727-3be4f619d3fd/volumes"
Jul 20 13:37:45.506911 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:37:45.506818    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-aba71aa1-openshift-default-7c5988845f-mxjc5"]
Jul 20 13:37:45.507514 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:37:45.507127    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-aba71aa1-openshift-default-7c5988845f-mxjc5" podUID="a078a7b6-d9bd-4566-b092-80c3cfdfeec3" containerName="istio-proxy" containerID="cri-o://989e296602a8c142cc3b1f068a260f919c576a1af48324b97633d1668c779067" gracePeriod=30
Jul 20 13:37:50.774279 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:37:50.774205    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-aba71aa1-openshift-default-7c5988845f-mxjc5"
Jul 20 13:37:50.921044 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:37:50.921005    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a078a7b6-d9bd-4566-b092-80c3cfdfeec3-credential-socket\") pod \"a078a7b6-d9bd-4566-b092-80c3cfdfeec3\" (UID: \"a078a7b6-d9bd-4566-b092-80c3cfdfeec3\") "
Jul 20 13:37:50.921044 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:37:50.921047    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pj9gs\" (UniqueName: \"kubernetes.io/projected/a078a7b6-d9bd-4566-b092-80c3cfdfeec3-kube-api-access-pj9gs\") pod \"a078a7b6-d9bd-4566-b092-80c3cfdfeec3\" (UID: \"a078a7b6-d9bd-4566-b092-80c3cfdfeec3\") "
Jul 20 13:37:50.921262 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:37:50.921097    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a078a7b6-d9bd-4566-b092-80c3cfdfeec3-istiod-ca-cert\") pod \"a078a7b6-d9bd-4566-b092-80c3cfdfeec3\" (UID: \"a078a7b6-d9bd-4566-b092-80c3cfdfeec3\") "
Jul 20 13:37:50.921262 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:37:50.921162    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a078a7b6-d9bd-4566-b092-80c3cfdfeec3-istio-podinfo\") pod \"a078a7b6-d9bd-4566-b092-80c3cfdfeec3\" (UID: \"a078a7b6-d9bd-4566-b092-80c3cfdfeec3\") "
Jul 20 13:37:50.921327 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:37:50.921299    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a078a7b6-d9bd-4566-b092-80c3cfdfeec3-istio-data\") pod \"a078a7b6-d9bd-4566-b092-80c3cfdfeec3\" (UID: \"a078a7b6-d9bd-4566-b092-80c3cfdfeec3\") "
Jul 20 13:37:50.921362 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:37:50.921318    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a078a7b6-d9bd-4566-b092-80c3cfdfeec3-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "a078a7b6-d9bd-4566-b092-80c3cfdfeec3" (UID: "a078a7b6-d9bd-4566-b092-80c3cfdfeec3"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 13:37:50.921362 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:37:50.921348    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a078a7b6-d9bd-4566-b092-80c3cfdfeec3-workload-certs\") pod \"a078a7b6-d9bd-4566-b092-80c3cfdfeec3\" (UID: \"a078a7b6-d9bd-4566-b092-80c3cfdfeec3\") "
Jul 20 13:37:50.921453 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:37:50.921374    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a078a7b6-d9bd-4566-b092-80c3cfdfeec3-istio-token\") pod \"a078a7b6-d9bd-4566-b092-80c3cfdfeec3\" (UID: \"a078a7b6-d9bd-4566-b092-80c3cfdfeec3\") "
Jul 20 13:37:50.921453 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:37:50.921435    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a078a7b6-d9bd-4566-b092-80c3cfdfeec3-workload-socket\") pod \"a078a7b6-d9bd-4566-b092-80c3cfdfeec3\" (UID: \"a078a7b6-d9bd-4566-b092-80c3cfdfeec3\") "
Jul 20 13:37:50.921552 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:37:50.921459    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a078a7b6-d9bd-4566-b092-80c3cfdfeec3-istio-envoy\") pod \"a078a7b6-d9bd-4566-b092-80c3cfdfeec3\" (UID: \"a078a7b6-d9bd-4566-b092-80c3cfdfeec3\") "
Jul 20 13:37:50.921608 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:37:50.921557    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a078a7b6-d9bd-4566-b092-80c3cfdfeec3-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "a078a7b6-d9bd-4566-b092-80c3cfdfeec3" (UID: "a078a7b6-d9bd-4566-b092-80c3cfdfeec3"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 13:37:50.921672 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:37:50.921627    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a078a7b6-d9bd-4566-b092-80c3cfdfeec3-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "a078a7b6-d9bd-4566-b092-80c3cfdfeec3" (UID: "a078a7b6-d9bd-4566-b092-80c3cfdfeec3"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 13:37:50.921880 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:37:50.921779    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a078a7b6-d9bd-4566-b092-80c3cfdfeec3-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "a078a7b6-d9bd-4566-b092-80c3cfdfeec3" (UID: "a078a7b6-d9bd-4566-b092-80c3cfdfeec3"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 13:37:50.922028 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:37:50.922006    2584 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a078a7b6-d9bd-4566-b092-80c3cfdfeec3-credential-socket\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 20 13:37:50.922104 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:37:50.922026    2584 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a078a7b6-d9bd-4566-b092-80c3cfdfeec3-istiod-ca-cert\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 20 13:37:50.922104 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:37:50.922040    2584 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a078a7b6-d9bd-4566-b092-80c3cfdfeec3-workload-certs\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 20 13:37:50.922104 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:37:50.922053    2584 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a078a7b6-d9bd-4566-b092-80c3cfdfeec3-workload-socket\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 20 13:37:50.922325 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:37:50.922177    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a078a7b6-d9bd-4566-b092-80c3cfdfeec3-istio-data" (OuterVolumeSpecName: "istio-data") pod "a078a7b6-d9bd-4566-b092-80c3cfdfeec3" (UID: "a078a7b6-d9bd-4566-b092-80c3cfdfeec3"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 13:37:50.923465 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:37:50.923433    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/a078a7b6-d9bd-4566-b092-80c3cfdfeec3-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "a078a7b6-d9bd-4566-b092-80c3cfdfeec3" (UID: "a078a7b6-d9bd-4566-b092-80c3cfdfeec3"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 20 13:37:50.923584 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:37:50.923498    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a078a7b6-d9bd-4566-b092-80c3cfdfeec3-kube-api-access-pj9gs" (OuterVolumeSpecName: "kube-api-access-pj9gs") pod "a078a7b6-d9bd-4566-b092-80c3cfdfeec3" (UID: "a078a7b6-d9bd-4566-b092-80c3cfdfeec3"). InnerVolumeSpecName "kube-api-access-pj9gs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 13:37:50.923584 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:37:50.923553    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a078a7b6-d9bd-4566-b092-80c3cfdfeec3-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "a078a7b6-d9bd-4566-b092-80c3cfdfeec3" (UID: "a078a7b6-d9bd-4566-b092-80c3cfdfeec3"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 13:37:50.923668 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:37:50.923626    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a078a7b6-d9bd-4566-b092-80c3cfdfeec3-istio-token" (OuterVolumeSpecName: "istio-token") pod "a078a7b6-d9bd-4566-b092-80c3cfdfeec3" (UID: "a078a7b6-d9bd-4566-b092-80c3cfdfeec3"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 13:37:51.023614 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:37:51.023568    2584 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a078a7b6-d9bd-4566-b092-80c3cfdfeec3-istio-podinfo\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 20 13:37:51.023614 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:37:51.023603    2584 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a078a7b6-d9bd-4566-b092-80c3cfdfeec3-istio-data\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 20 13:37:51.023614 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:37:51.023613    2584 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a078a7b6-d9bd-4566-b092-80c3cfdfeec3-istio-token\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 20 13:37:51.023614 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:37:51.023621    2584 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a078a7b6-d9bd-4566-b092-80c3cfdfeec3-istio-envoy\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 20 13:37:51.023614 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:37:51.023629    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pj9gs\" (UniqueName: \"kubernetes.io/projected/a078a7b6-d9bd-4566-b092-80c3cfdfeec3-kube-api-access-pj9gs\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 20 13:37:51.081102 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:37:51.081002    2584 generic.go:356] "Generic (PLEG): container finished" podID="a078a7b6-d9bd-4566-b092-80c3cfdfeec3" containerID="989e296602a8c142cc3b1f068a260f919c576a1af48324b97633d1668c779067" exitCode=0
Jul 20 13:37:51.081102 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:37:51.081061    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-aba71aa1-openshift-default-7c5988845f-mxjc5"
Jul 20 13:37:51.081337 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:37:51.081095    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-aba71aa1-openshift-default-7c5988845f-mxjc5" event={"ID":"a078a7b6-d9bd-4566-b092-80c3cfdfeec3","Type":"ContainerDied","Data":"989e296602a8c142cc3b1f068a260f919c576a1af48324b97633d1668c779067"}
Jul 20 13:37:51.081337 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:37:51.081162    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-aba71aa1-openshift-default-7c5988845f-mxjc5" event={"ID":"a078a7b6-d9bd-4566-b092-80c3cfdfeec3","Type":"ContainerDied","Data":"b84b9b390aa5eb96eb7aeaa1f53415ae10b217478860dfd8f3a7a77e8687f837"}
Jul 20 13:37:51.081337 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:37:51.081192    2584 scope.go:117] "RemoveContainer" containerID="989e296602a8c142cc3b1f068a260f919c576a1af48324b97633d1668c779067"
Jul 20 13:37:51.091325 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:37:51.091301    2584 scope.go:117] "RemoveContainer" containerID="ad889afa9866d30de8a0e015c92af682bcb9be456e842f890dd222f4435212a3"
Jul 20 13:37:51.100470 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:37:51.100448    2584 scope.go:117] "RemoveContainer" containerID="989e296602a8c142cc3b1f068a260f919c576a1af48324b97633d1668c779067"
Jul 20 13:37:51.100729 ip-10-0-134-121 kubenswrapper[2584]: E0720 13:37:51.100709    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"989e296602a8c142cc3b1f068a260f919c576a1af48324b97633d1668c779067\": container with ID starting with 989e296602a8c142cc3b1f068a260f919c576a1af48324b97633d1668c779067 not found: ID does not exist" containerID="989e296602a8c142cc3b1f068a260f919c576a1af48324b97633d1668c779067"
Jul 20 13:37:51.100811 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:37:51.100742    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"989e296602a8c142cc3b1f068a260f919c576a1af48324b97633d1668c779067"} err="failed to get container status \"989e296602a8c142cc3b1f068a260f919c576a1af48324b97633d1668c779067\": rpc error: code = NotFound desc = could not find container \"989e296602a8c142cc3b1f068a260f919c576a1af48324b97633d1668c779067\": container with ID starting with 989e296602a8c142cc3b1f068a260f919c576a1af48324b97633d1668c779067 not found: ID does not exist"
Jul 20 13:37:51.100811 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:37:51.100770    2584 scope.go:117] "RemoveContainer" containerID="ad889afa9866d30de8a0e015c92af682bcb9be456e842f890dd222f4435212a3"
Jul 20 13:37:51.101065 ip-10-0-134-121 kubenswrapper[2584]: E0720 13:37:51.101038    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ad889afa9866d30de8a0e015c92af682bcb9be456e842f890dd222f4435212a3\": container with ID starting with ad889afa9866d30de8a0e015c92af682bcb9be456e842f890dd222f4435212a3 not found: ID does not exist" containerID="ad889afa9866d30de8a0e015c92af682bcb9be456e842f890dd222f4435212a3"
Jul 20 13:37:51.101116 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:37:51.101075    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ad889afa9866d30de8a0e015c92af682bcb9be456e842f890dd222f4435212a3"} err="failed to get container status \"ad889afa9866d30de8a0e015c92af682bcb9be456e842f890dd222f4435212a3\": rpc error: code = NotFound desc = could not find container \"ad889afa9866d30de8a0e015c92af682bcb9be456e842f890dd222f4435212a3\": container with ID starting with ad889afa9866d30de8a0e015c92af682bcb9be456e842f890dd222f4435212a3 not found: ID does not exist"
Jul 20 13:37:51.108264 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:37:51.108236    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-aba71aa1-openshift-default-7c5988845f-mxjc5"]
Jul 20 13:37:51.111831 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:37:51.111806    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-aba71aa1-openshift-default-7c5988845f-mxjc5"]
Jul 20 13:37:53.096232 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:37:53.096202    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a078a7b6-d9bd-4566-b092-80c3cfdfeec3" path="/var/lib/kubelet/pods/a078a7b6-d9bd-4566-b092-80c3cfdfeec3/volumes"
Jul 20 13:38:40.944635 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:38:40.944601    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-5ce595-openshift-default-6754f78fc7-wbw4z"]
Jul 20 13:38:40.945139 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:38:40.945087    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="90966cbe-6c55-47e9-a727-3be4f619d3fd" containerName="maas-api"
Jul 20 13:38:40.945139 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:38:40.945100    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="90966cbe-6c55-47e9-a727-3be4f619d3fd" containerName="maas-api"
Jul 20 13:38:40.945139 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:38:40.945109    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a078a7b6-d9bd-4566-b092-80c3cfdfeec3" containerName="istio-proxy"
Jul 20 13:38:40.945139 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:38:40.945115    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="a078a7b6-d9bd-4566-b092-80c3cfdfeec3" containerName="istio-proxy"
Jul 20 13:38:40.945139 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:38:40.945129    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a078a7b6-d9bd-4566-b092-80c3cfdfeec3" containerName="istio-proxy"
Jul 20 13:38:40.945139 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:38:40.945135    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="a078a7b6-d9bd-4566-b092-80c3cfdfeec3" containerName="istio-proxy"
Jul 20 13:38:40.945336 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:38:40.945220    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="a078a7b6-d9bd-4566-b092-80c3cfdfeec3" containerName="istio-proxy"
Jul 20 13:38:40.945336 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:38:40.945230    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="a078a7b6-d9bd-4566-b092-80c3cfdfeec3" containerName="istio-proxy"
Jul 20 13:38:40.945336 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:38:40.945241    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="90966cbe-6c55-47e9-a727-3be4f619d3fd" containerName="maas-api"
Jul 20 13:38:40.948474 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:38:40.948456    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-5ce595-openshift-default-6754f78fc7-wbw4z"
Jul 20 13:38:40.950798 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:38:40.950781    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-5ce595-openshift-default-dockercfg-nhp7b\""
Jul 20 13:38:40.959395 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:38:40.959356    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-5ce595-openshift-default-6754f78fc7-wbw4z"]
Jul 20 13:38:41.016894 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:38:41.016859    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ebb5d898-02f9-4ea8-8c12-43e6df126353-istio-envoy\") pod \"e2e-inf-a-5ce595-openshift-default-6754f78fc7-wbw4z\" (UID: \"ebb5d898-02f9-4ea8-8c12-43e6df126353\") " pod="openshift-ingress/e2e-inf-a-5ce595-openshift-default-6754f78fc7-wbw4z"
Jul 20 13:38:41.016894 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:38:41.016899    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ebb5d898-02f9-4ea8-8c12-43e6df126353-istio-podinfo\") pod \"e2e-inf-a-5ce595-openshift-default-6754f78fc7-wbw4z\" (UID: \"ebb5d898-02f9-4ea8-8c12-43e6df126353\") " pod="openshift-ingress/e2e-inf-a-5ce595-openshift-default-6754f78fc7-wbw4z"
Jul 20 13:38:41.017112 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:38:41.016935    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ebb5d898-02f9-4ea8-8c12-43e6df126353-workload-socket\") pod \"e2e-inf-a-5ce595-openshift-default-6754f78fc7-wbw4z\" (UID: \"ebb5d898-02f9-4ea8-8c12-43e6df126353\") " pod="openshift-ingress/e2e-inf-a-5ce595-openshift-default-6754f78fc7-wbw4z"
Jul 20 13:38:41.017112 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:38:41.016995    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ebb5d898-02f9-4ea8-8c12-43e6df126353-workload-certs\") pod \"e2e-inf-a-5ce595-openshift-default-6754f78fc7-wbw4z\" (UID: \"ebb5d898-02f9-4ea8-8c12-43e6df126353\") " pod="openshift-ingress/e2e-inf-a-5ce595-openshift-default-6754f78fc7-wbw4z"
Jul 20 13:38:41.017112 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:38:41.017017    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ebb5d898-02f9-4ea8-8c12-43e6df126353-istio-token\") pod \"e2e-inf-a-5ce595-openshift-default-6754f78fc7-wbw4z\" (UID: \"ebb5d898-02f9-4ea8-8c12-43e6df126353\") " pod="openshift-ingress/e2e-inf-a-5ce595-openshift-default-6754f78fc7-wbw4z"
Jul 20 13:38:41.017112 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:38:41.017058    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ebb5d898-02f9-4ea8-8c12-43e6df126353-istio-data\") pod \"e2e-inf-a-5ce595-openshift-default-6754f78fc7-wbw4z\" (UID: \"ebb5d898-02f9-4ea8-8c12-43e6df126353\") " pod="openshift-ingress/e2e-inf-a-5ce595-openshift-default-6754f78fc7-wbw4z"
Jul 20 13:38:41.017245 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:38:41.017136    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m6bgh\" (UniqueName: \"kubernetes.io/projected/ebb5d898-02f9-4ea8-8c12-43e6df126353-kube-api-access-m6bgh\") pod \"e2e-inf-a-5ce595-openshift-default-6754f78fc7-wbw4z\" (UID: \"ebb5d898-02f9-4ea8-8c12-43e6df126353\") " pod="openshift-ingress/e2e-inf-a-5ce595-openshift-default-6754f78fc7-wbw4z"
Jul 20 13:38:41.017245 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:38:41.017177    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ebb5d898-02f9-4ea8-8c12-43e6df126353-istiod-ca-cert\") pod \"e2e-inf-a-5ce595-openshift-default-6754f78fc7-wbw4z\" (UID: \"ebb5d898-02f9-4ea8-8c12-43e6df126353\") " pod="openshift-ingress/e2e-inf-a-5ce595-openshift-default-6754f78fc7-wbw4z"
Jul 20 13:38:41.017245 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:38:41.017239    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ebb5d898-02f9-4ea8-8c12-43e6df126353-credential-socket\") pod \"e2e-inf-a-5ce595-openshift-default-6754f78fc7-wbw4z\" (UID: \"ebb5d898-02f9-4ea8-8c12-43e6df126353\") " pod="openshift-ingress/e2e-inf-a-5ce595-openshift-default-6754f78fc7-wbw4z"
Jul 20 13:38:41.118181 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:38:41.118143    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ebb5d898-02f9-4ea8-8c12-43e6df126353-istio-token\") pod \"e2e-inf-a-5ce595-openshift-default-6754f78fc7-wbw4z\" (UID: \"ebb5d898-02f9-4ea8-8c12-43e6df126353\") " pod="openshift-ingress/e2e-inf-a-5ce595-openshift-default-6754f78fc7-wbw4z"
Jul 20 13:38:41.118181 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:38:41.118181    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ebb5d898-02f9-4ea8-8c12-43e6df126353-istio-data\") pod \"e2e-inf-a-5ce595-openshift-default-6754f78fc7-wbw4z\" (UID: \"ebb5d898-02f9-4ea8-8c12-43e6df126353\") " pod="openshift-ingress/e2e-inf-a-5ce595-openshift-default-6754f78fc7-wbw4z"
Jul 20 13:38:41.118443 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:38:41.118226    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m6bgh\" (UniqueName: \"kubernetes.io/projected/ebb5d898-02f9-4ea8-8c12-43e6df126353-kube-api-access-m6bgh\") pod \"e2e-inf-a-5ce595-openshift-default-6754f78fc7-wbw4z\" (UID: \"ebb5d898-02f9-4ea8-8c12-43e6df126353\") " pod="openshift-ingress/e2e-inf-a-5ce595-openshift-default-6754f78fc7-wbw4z"
Jul 20 13:38:41.118443 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:38:41.118248    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ebb5d898-02f9-4ea8-8c12-43e6df126353-istiod-ca-cert\") pod \"e2e-inf-a-5ce595-openshift-default-6754f78fc7-wbw4z\" (UID: \"ebb5d898-02f9-4ea8-8c12-43e6df126353\") " pod="openshift-ingress/e2e-inf-a-5ce595-openshift-default-6754f78fc7-wbw4z"
Jul 20 13:38:41.118443 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:38:41.118286    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ebb5d898-02f9-4ea8-8c12-43e6df126353-credential-socket\") pod \"e2e-inf-a-5ce595-openshift-default-6754f78fc7-wbw4z\" (UID: \"ebb5d898-02f9-4ea8-8c12-43e6df126353\") " pod="openshift-ingress/e2e-inf-a-5ce595-openshift-default-6754f78fc7-wbw4z"
Jul 20 13:38:41.118443 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:38:41.118306    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ebb5d898-02f9-4ea8-8c12-43e6df126353-istio-envoy\") pod \"e2e-inf-a-5ce595-openshift-default-6754f78fc7-wbw4z\" (UID: \"ebb5d898-02f9-4ea8-8c12-43e6df126353\") " pod="openshift-ingress/e2e-inf-a-5ce595-openshift-default-6754f78fc7-wbw4z"
Jul 20 13:38:41.118443 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:38:41.118325    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ebb5d898-02f9-4ea8-8c12-43e6df126353-istio-podinfo\") pod \"e2e-inf-a-5ce595-openshift-default-6754f78fc7-wbw4z\" (UID: \"ebb5d898-02f9-4ea8-8c12-43e6df126353\") " pod="openshift-ingress/e2e-inf-a-5ce595-openshift-default-6754f78fc7-wbw4z"
Jul 20 13:38:41.118443 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:38:41.118376    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ebb5d898-02f9-4ea8-8c12-43e6df126353-workload-socket\") pod \"e2e-inf-a-5ce595-openshift-default-6754f78fc7-wbw4z\" (UID: \"ebb5d898-02f9-4ea8-8c12-43e6df126353\") " pod="openshift-ingress/e2e-inf-a-5ce595-openshift-default-6754f78fc7-wbw4z"
Jul 20 13:38:41.118443 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:38:41.118417    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ebb5d898-02f9-4ea8-8c12-43e6df126353-workload-certs\") pod \"e2e-inf-a-5ce595-openshift-default-6754f78fc7-wbw4z\" (UID: \"ebb5d898-02f9-4ea8-8c12-43e6df126353\") " pod="openshift-ingress/e2e-inf-a-5ce595-openshift-default-6754f78fc7-wbw4z"
Jul 20 13:38:41.118796 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:38:41.118672    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ebb5d898-02f9-4ea8-8c12-43e6df126353-istio-data\") pod \"e2e-inf-a-5ce595-openshift-default-6754f78fc7-wbw4z\" (UID: \"ebb5d898-02f9-4ea8-8c12-43e6df126353\") " pod="openshift-ingress/e2e-inf-a-5ce595-openshift-default-6754f78fc7-wbw4z"
Jul 20 13:38:41.118796 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:38:41.118779    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ebb5d898-02f9-4ea8-8c12-43e6df126353-credential-socket\") pod \"e2e-inf-a-5ce595-openshift-default-6754f78fc7-wbw4z\" (UID: \"ebb5d898-02f9-4ea8-8c12-43e6df126353\") " pod="openshift-ingress/e2e-inf-a-5ce595-openshift-default-6754f78fc7-wbw4z"
Jul 20 13:38:41.118908 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:38:41.118856    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ebb5d898-02f9-4ea8-8c12-43e6df126353-workload-certs\") pod \"e2e-inf-a-5ce595-openshift-default-6754f78fc7-wbw4z\" (UID: \"ebb5d898-02f9-4ea8-8c12-43e6df126353\") " pod="openshift-ingress/e2e-inf-a-5ce595-openshift-default-6754f78fc7-wbw4z"
Jul 20 13:38:41.118980 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:38:41.118907    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ebb5d898-02f9-4ea8-8c12-43e6df126353-workload-socket\") pod \"e2e-inf-a-5ce595-openshift-default-6754f78fc7-wbw4z\" (UID: \"ebb5d898-02f9-4ea8-8c12-43e6df126353\") " pod="openshift-ingress/e2e-inf-a-5ce595-openshift-default-6754f78fc7-wbw4z"
Jul 20 13:38:41.119032 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:38:41.119005    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ebb5d898-02f9-4ea8-8c12-43e6df126353-istiod-ca-cert\") pod \"e2e-inf-a-5ce595-openshift-default-6754f78fc7-wbw4z\" (UID: \"ebb5d898-02f9-4ea8-8c12-43e6df126353\") " pod="openshift-ingress/e2e-inf-a-5ce595-openshift-default-6754f78fc7-wbw4z"
Jul 20 13:38:41.120553 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:38:41.120522    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ebb5d898-02f9-4ea8-8c12-43e6df126353-istio-envoy\") pod \"e2e-inf-a-5ce595-openshift-default-6754f78fc7-wbw4z\" (UID: \"ebb5d898-02f9-4ea8-8c12-43e6df126353\") " pod="openshift-ingress/e2e-inf-a-5ce595-openshift-default-6754f78fc7-wbw4z"
Jul 20 13:38:41.120752 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:38:41.120735    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ebb5d898-02f9-4ea8-8c12-43e6df126353-istio-podinfo\") pod \"e2e-inf-a-5ce595-openshift-default-6754f78fc7-wbw4z\" (UID: \"ebb5d898-02f9-4ea8-8c12-43e6df126353\") " pod="openshift-ingress/e2e-inf-a-5ce595-openshift-default-6754f78fc7-wbw4z"
Jul 20 13:38:41.125842 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:38:41.125820    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m6bgh\" (UniqueName: \"kubernetes.io/projected/ebb5d898-02f9-4ea8-8c12-43e6df126353-kube-api-access-m6bgh\") pod \"e2e-inf-a-5ce595-openshift-default-6754f78fc7-wbw4z\" (UID: \"ebb5d898-02f9-4ea8-8c12-43e6df126353\") " pod="openshift-ingress/e2e-inf-a-5ce595-openshift-default-6754f78fc7-wbw4z"
Jul 20 13:38:41.126311 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:38:41.126290    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ebb5d898-02f9-4ea8-8c12-43e6df126353-istio-token\") pod \"e2e-inf-a-5ce595-openshift-default-6754f78fc7-wbw4z\" (UID: \"ebb5d898-02f9-4ea8-8c12-43e6df126353\") " pod="openshift-ingress/e2e-inf-a-5ce595-openshift-default-6754f78fc7-wbw4z"
Jul 20 13:38:41.259919 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:38:41.259885    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-5ce595-openshift-default-6754f78fc7-wbw4z"
Jul 20 13:38:41.408901 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:38:41.408870    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-5ce595-openshift-default-6754f78fc7-wbw4z"]
Jul 20 13:38:41.410429 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:38:41.410405    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podebb5d898_02f9_4ea8_8c12_43e6df126353.slice/crio-7a7c18d64c3db306cf314e432cef684023e515f17bd8e47940c8275dd135054e WatchSource:0}: Error finding container 7a7c18d64c3db306cf314e432cef684023e515f17bd8e47940c8275dd135054e: Status 404 returned error can't find the container with id 7a7c18d64c3db306cf314e432cef684023e515f17bd8e47940c8275dd135054e
Jul 20 13:38:41.412604 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:38:41.412569    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 20 13:38:41.412686 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:38:41.412634    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 20 13:38:41.412686 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:38:41.412664    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 20 13:38:42.358731 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:38:42.358694    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-5ce595-openshift-default-6754f78fc7-wbw4z" event={"ID":"ebb5d898-02f9-4ea8-8c12-43e6df126353","Type":"ContainerStarted","Data":"b857dc92692d7024555f2650aebedae2784afdecaed95726e5fb766839f2cc1c"}
Jul 20 13:38:42.359170 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:38:42.358752    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-5ce595-openshift-default-6754f78fc7-wbw4z" event={"ID":"ebb5d898-02f9-4ea8-8c12-43e6df126353","Type":"ContainerStarted","Data":"7a7c18d64c3db306cf314e432cef684023e515f17bd8e47940c8275dd135054e"}
Jul 20 13:38:42.381124 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:38:42.381069    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-5ce595-openshift-default-6754f78fc7-wbw4z" podStartSLOduration=2.381052848 podStartE2EDuration="2.381052848s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 13:38:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 13:38:42.378847654 +0000 UTC m=+2212.095395066" watchObservedRunningTime="2026-07-20 13:38:42.381052848 +0000 UTC m=+2212.097600259"
Jul 20 13:38:43.260328 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:38:43.260294    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-5ce595-openshift-default-6754f78fc7-wbw4z"
Jul 20 13:38:43.265112 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:38:43.265088    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-5ce595-openshift-default-6754f78fc7-wbw4z"
Jul 20 13:38:43.363890 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:38:43.363861    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-5ce595-openshift-default-6754f78fc7-wbw4z"
Jul 20 13:38:43.364918 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:38:43.364897    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-5ce595-openshift-default-6754f78fc7-wbw4z"
Jul 20 13:38:44.529742 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:38:44.529701    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-5ce595-5588dcf694-slw7h"]
Jul 20 13:38:44.533914 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:38:44.533892    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-5ce595-5588dcf694-slw7h"
Jul 20 13:38:44.536199 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:38:44.536176    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-vf2sw\""
Jul 20 13:38:44.536761 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:38:44.536745    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-a-5ce595-serving-cert\""
Jul 20 13:38:44.544911 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:38:44.544880    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-5ce595-5588dcf694-slw7h"]
Jul 20 13:38:44.653725 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:38:44.653675    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ljlr8\" (UniqueName: \"kubernetes.io/projected/69d39865-95c9-4462-9826-329fcc9aff50-kube-api-access-ljlr8\") pod \"maas-api-e2e-inf-a-5ce595-5588dcf694-slw7h\" (UID: \"69d39865-95c9-4462-9826-329fcc9aff50\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-5ce595-5588dcf694-slw7h"
Jul 20 13:38:44.653910 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:38:44.653782    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/69d39865-95c9-4462-9826-329fcc9aff50-openshift-service-ca\") pod \"maas-api-e2e-inf-a-5ce595-5588dcf694-slw7h\" (UID: \"69d39865-95c9-4462-9826-329fcc9aff50\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-5ce595-5588dcf694-slw7h"
Jul 20 13:38:44.653910 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:38:44.653818    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/69d39865-95c9-4462-9826-329fcc9aff50-maas-api-tls\") pod \"maas-api-e2e-inf-a-5ce595-5588dcf694-slw7h\" (UID: \"69d39865-95c9-4462-9826-329fcc9aff50\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-5ce595-5588dcf694-slw7h"
Jul 20 13:38:44.755391 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:38:44.755347    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ljlr8\" (UniqueName: \"kubernetes.io/projected/69d39865-95c9-4462-9826-329fcc9aff50-kube-api-access-ljlr8\") pod \"maas-api-e2e-inf-a-5ce595-5588dcf694-slw7h\" (UID: \"69d39865-95c9-4462-9826-329fcc9aff50\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-5ce595-5588dcf694-slw7h"
Jul 20 13:38:44.755584 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:38:44.755411    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/69d39865-95c9-4462-9826-329fcc9aff50-openshift-service-ca\") pod \"maas-api-e2e-inf-a-5ce595-5588dcf694-slw7h\" (UID: \"69d39865-95c9-4462-9826-329fcc9aff50\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-5ce595-5588dcf694-slw7h"
Jul 20 13:38:44.755584 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:38:44.755445    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/69d39865-95c9-4462-9826-329fcc9aff50-maas-api-tls\") pod \"maas-api-e2e-inf-a-5ce595-5588dcf694-slw7h\" (UID: \"69d39865-95c9-4462-9826-329fcc9aff50\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-5ce595-5588dcf694-slw7h"
Jul 20 13:38:44.755661 ip-10-0-134-121 kubenswrapper[2584]: E0720 13:38:44.755586    2584 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-a-5ce595-serving-cert: secret "maas-api-e2e-inf-a-5ce595-serving-cert" not found
Jul 20 13:38:44.755661 ip-10-0-134-121 kubenswrapper[2584]: E0720 13:38:44.755656    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/69d39865-95c9-4462-9826-329fcc9aff50-maas-api-tls podName:69d39865-95c9-4462-9826-329fcc9aff50 nodeName:}" failed. No retries permitted until 2026-07-20 13:38:45.255634991 +0000 UTC m=+2214.972182379 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/69d39865-95c9-4462-9826-329fcc9aff50-maas-api-tls") pod "maas-api-e2e-inf-a-5ce595-5588dcf694-slw7h" (UID: "69d39865-95c9-4462-9826-329fcc9aff50") : secret "maas-api-e2e-inf-a-5ce595-serving-cert" not found
Jul 20 13:38:44.756286 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:38:44.756266    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/69d39865-95c9-4462-9826-329fcc9aff50-openshift-service-ca\") pod \"maas-api-e2e-inf-a-5ce595-5588dcf694-slw7h\" (UID: \"69d39865-95c9-4462-9826-329fcc9aff50\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-5ce595-5588dcf694-slw7h"
Jul 20 13:38:44.765622 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:38:44.765582    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ljlr8\" (UniqueName: \"kubernetes.io/projected/69d39865-95c9-4462-9826-329fcc9aff50-kube-api-access-ljlr8\") pod \"maas-api-e2e-inf-a-5ce595-5588dcf694-slw7h\" (UID: \"69d39865-95c9-4462-9826-329fcc9aff50\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-5ce595-5588dcf694-slw7h"
Jul 20 13:38:45.260502 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:38:45.260460    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/69d39865-95c9-4462-9826-329fcc9aff50-maas-api-tls\") pod \"maas-api-e2e-inf-a-5ce595-5588dcf694-slw7h\" (UID: \"69d39865-95c9-4462-9826-329fcc9aff50\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-5ce595-5588dcf694-slw7h"
Jul 20 13:38:45.262850 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:38:45.262831    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/69d39865-95c9-4462-9826-329fcc9aff50-maas-api-tls\") pod \"maas-api-e2e-inf-a-5ce595-5588dcf694-slw7h\" (UID: \"69d39865-95c9-4462-9826-329fcc9aff50\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-5ce595-5588dcf694-slw7h"
Jul 20 13:38:45.447332 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:38:45.447295    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-5ce595-5588dcf694-slw7h"
Jul 20 13:38:45.596137 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:38:45.596111    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-5ce595-5588dcf694-slw7h"]
Jul 20 13:38:45.597840 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:38:45.597802    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod69d39865_95c9_4462_9826_329fcc9aff50.slice/crio-0a22d2b91494cea333f996f8ec2129f4779d8bc687010e1320ebab6acb6f8368 WatchSource:0}: Error finding container 0a22d2b91494cea333f996f8ec2129f4779d8bc687010e1320ebab6acb6f8368: Status 404 returned error can't find the container with id 0a22d2b91494cea333f996f8ec2129f4779d8bc687010e1320ebab6acb6f8368
Jul 20 13:38:46.382673 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:38:46.382580    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-5ce595-5588dcf694-slw7h" event={"ID":"69d39865-95c9-4462-9826-329fcc9aff50","Type":"ContainerStarted","Data":"280991be9bbf5b935993de574328be62e016f9da262ea0ca737a06ebe81f6750"}
Jul 20 13:38:46.382673 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:38:46.382637    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-5ce595-5588dcf694-slw7h" event={"ID":"69d39865-95c9-4462-9826-329fcc9aff50","Type":"ContainerStarted","Data":"0a22d2b91494cea333f996f8ec2129f4779d8bc687010e1320ebab6acb6f8368"}
Jul 20 13:38:46.382673 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:38:46.382665    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-5ce595-5588dcf694-slw7h"
Jul 20 13:38:46.412940 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:38:46.412876    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-5ce595-5588dcf694-slw7h" podStartSLOduration=1.999959111 podStartE2EDuration="2.412859448s" totalImagesPullingTime="412.900337ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 13:38:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 13:38:46.410395895 +0000 UTC m=+2216.126943321" watchObservedRunningTime="2026-07-20 13:38:46.412859448 +0000 UTC m=+2216.129406859"
Jul 20 13:38:49.606334 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:38:49.606286    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-fc9057-openshift-default-7c5cf5bfb7-sjh4s"]
Jul 20 13:38:49.610988 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:38:49.610954    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-fc9057-openshift-default-7c5cf5bfb7-sjh4s"
Jul 20 13:38:49.613126 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:38:49.613106    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-fc9057-openshift-default-dockercfg-ljh2f\""
Jul 20 13:38:49.619443 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:38:49.619415    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-fc9057-openshift-default-7c5cf5bfb7-sjh4s"]
Jul 20 13:38:49.705334 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:38:49.705300    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b29e9121-1dfc-4c76-a336-38cac493823a-workload-certs\") pod \"e2e-inf-b-fc9057-openshift-default-7c5cf5bfb7-sjh4s\" (UID: \"b29e9121-1dfc-4c76-a336-38cac493823a\") " pod="openshift-ingress/e2e-inf-b-fc9057-openshift-default-7c5cf5bfb7-sjh4s"
Jul 20 13:38:49.705334 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:38:49.705336    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b29e9121-1dfc-4c76-a336-38cac493823a-istio-data\") pod \"e2e-inf-b-fc9057-openshift-default-7c5cf5bfb7-sjh4s\" (UID: \"b29e9121-1dfc-4c76-a336-38cac493823a\") " pod="openshift-ingress/e2e-inf-b-fc9057-openshift-default-7c5cf5bfb7-sjh4s"
Jul 20 13:38:49.705627 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:38:49.705412    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b29e9121-1dfc-4c76-a336-38cac493823a-credential-socket\") pod \"e2e-inf-b-fc9057-openshift-default-7c5cf5bfb7-sjh4s\" (UID: \"b29e9121-1dfc-4c76-a336-38cac493823a\") " pod="openshift-ingress/e2e-inf-b-fc9057-openshift-default-7c5cf5bfb7-sjh4s"
Jul 20 13:38:49.705627 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:38:49.705432    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b29e9121-1dfc-4c76-a336-38cac493823a-istio-token\") pod \"e2e-inf-b-fc9057-openshift-default-7c5cf5bfb7-sjh4s\" (UID: \"b29e9121-1dfc-4c76-a336-38cac493823a\") " pod="openshift-ingress/e2e-inf-b-fc9057-openshift-default-7c5cf5bfb7-sjh4s"
Jul 20 13:38:49.705627 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:38:49.705586    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b29e9121-1dfc-4c76-a336-38cac493823a-istiod-ca-cert\") pod \"e2e-inf-b-fc9057-openshift-default-7c5cf5bfb7-sjh4s\" (UID: \"b29e9121-1dfc-4c76-a336-38cac493823a\") " pod="openshift-ingress/e2e-inf-b-fc9057-openshift-default-7c5cf5bfb7-sjh4s"
Jul 20 13:38:49.705811 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:38:49.705665    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kdmwd\" (UniqueName: \"kubernetes.io/projected/b29e9121-1dfc-4c76-a336-38cac493823a-kube-api-access-kdmwd\") pod \"e2e-inf-b-fc9057-openshift-default-7c5cf5bfb7-sjh4s\" (UID: \"b29e9121-1dfc-4c76-a336-38cac493823a\") " pod="openshift-ingress/e2e-inf-b-fc9057-openshift-default-7c5cf5bfb7-sjh4s"
Jul 20 13:38:49.705811 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:38:49.705717    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b29e9121-1dfc-4c76-a336-38cac493823a-workload-socket\") pod \"e2e-inf-b-fc9057-openshift-default-7c5cf5bfb7-sjh4s\" (UID: \"b29e9121-1dfc-4c76-a336-38cac493823a\") " pod="openshift-ingress/e2e-inf-b-fc9057-openshift-default-7c5cf5bfb7-sjh4s"
Jul 20 13:38:49.705811 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:38:49.705773    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b29e9121-1dfc-4c76-a336-38cac493823a-istio-podinfo\") pod \"e2e-inf-b-fc9057-openshift-default-7c5cf5bfb7-sjh4s\" (UID: \"b29e9121-1dfc-4c76-a336-38cac493823a\") " pod="openshift-ingress/e2e-inf-b-fc9057-openshift-default-7c5cf5bfb7-sjh4s"
Jul 20 13:38:49.706070 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:38:49.705838    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b29e9121-1dfc-4c76-a336-38cac493823a-istio-envoy\") pod \"e2e-inf-b-fc9057-openshift-default-7c5cf5bfb7-sjh4s\" (UID: \"b29e9121-1dfc-4c76-a336-38cac493823a\") " pod="openshift-ingress/e2e-inf-b-fc9057-openshift-default-7c5cf5bfb7-sjh4s"
Jul 20 13:38:49.807493 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:38:49.807452    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b29e9121-1dfc-4c76-a336-38cac493823a-credential-socket\") pod \"e2e-inf-b-fc9057-openshift-default-7c5cf5bfb7-sjh4s\" (UID: \"b29e9121-1dfc-4c76-a336-38cac493823a\") " pod="openshift-ingress/e2e-inf-b-fc9057-openshift-default-7c5cf5bfb7-sjh4s"
Jul 20 13:38:49.807698 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:38:49.807501    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b29e9121-1dfc-4c76-a336-38cac493823a-istio-token\") pod \"e2e-inf-b-fc9057-openshift-default-7c5cf5bfb7-sjh4s\" (UID: \"b29e9121-1dfc-4c76-a336-38cac493823a\") " pod="openshift-ingress/e2e-inf-b-fc9057-openshift-default-7c5cf5bfb7-sjh4s"
Jul 20 13:38:49.807698 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:38:49.807560    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b29e9121-1dfc-4c76-a336-38cac493823a-istiod-ca-cert\") pod \"e2e-inf-b-fc9057-openshift-default-7c5cf5bfb7-sjh4s\" (UID: \"b29e9121-1dfc-4c76-a336-38cac493823a\") " pod="openshift-ingress/e2e-inf-b-fc9057-openshift-default-7c5cf5bfb7-sjh4s"
Jul 20 13:38:49.807698 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:38:49.807619    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kdmwd\" (UniqueName: \"kubernetes.io/projected/b29e9121-1dfc-4c76-a336-38cac493823a-kube-api-access-kdmwd\") pod \"e2e-inf-b-fc9057-openshift-default-7c5cf5bfb7-sjh4s\" (UID: \"b29e9121-1dfc-4c76-a336-38cac493823a\") " pod="openshift-ingress/e2e-inf-b-fc9057-openshift-default-7c5cf5bfb7-sjh4s"
Jul 20 13:38:49.807698 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:38:49.807659    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b29e9121-1dfc-4c76-a336-38cac493823a-workload-socket\") pod \"e2e-inf-b-fc9057-openshift-default-7c5cf5bfb7-sjh4s\" (UID: \"b29e9121-1dfc-4c76-a336-38cac493823a\") " pod="openshift-ingress/e2e-inf-b-fc9057-openshift-default-7c5cf5bfb7-sjh4s"
Jul 20 13:38:49.807884 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:38:49.807705    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b29e9121-1dfc-4c76-a336-38cac493823a-istio-podinfo\") pod \"e2e-inf-b-fc9057-openshift-default-7c5cf5bfb7-sjh4s\" (UID: \"b29e9121-1dfc-4c76-a336-38cac493823a\") " pod="openshift-ingress/e2e-inf-b-fc9057-openshift-default-7c5cf5bfb7-sjh4s"
Jul 20 13:38:49.807884 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:38:49.807772    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b29e9121-1dfc-4c76-a336-38cac493823a-istio-envoy\") pod \"e2e-inf-b-fc9057-openshift-default-7c5cf5bfb7-sjh4s\" (UID: \"b29e9121-1dfc-4c76-a336-38cac493823a\") " pod="openshift-ingress/e2e-inf-b-fc9057-openshift-default-7c5cf5bfb7-sjh4s"
Jul 20 13:38:49.807884 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:38:49.807807    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b29e9121-1dfc-4c76-a336-38cac493823a-workload-certs\") pod \"e2e-inf-b-fc9057-openshift-default-7c5cf5bfb7-sjh4s\" (UID: \"b29e9121-1dfc-4c76-a336-38cac493823a\") " pod="openshift-ingress/e2e-inf-b-fc9057-openshift-default-7c5cf5bfb7-sjh4s"
Jul 20 13:38:49.807884 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:38:49.807831    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b29e9121-1dfc-4c76-a336-38cac493823a-istio-data\") pod \"e2e-inf-b-fc9057-openshift-default-7c5cf5bfb7-sjh4s\" (UID: \"b29e9121-1dfc-4c76-a336-38cac493823a\") " pod="openshift-ingress/e2e-inf-b-fc9057-openshift-default-7c5cf5bfb7-sjh4s"
Jul 20 13:38:49.808218 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:38:49.808193    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b29e9121-1dfc-4c76-a336-38cac493823a-workload-socket\") pod \"e2e-inf-b-fc9057-openshift-default-7c5cf5bfb7-sjh4s\" (UID: \"b29e9121-1dfc-4c76-a336-38cac493823a\") " pod="openshift-ingress/e2e-inf-b-fc9057-openshift-default-7c5cf5bfb7-sjh4s"
Jul 20 13:38:49.808306 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:38:49.808216    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b29e9121-1dfc-4c76-a336-38cac493823a-credential-socket\") pod \"e2e-inf-b-fc9057-openshift-default-7c5cf5bfb7-sjh4s\" (UID: \"b29e9121-1dfc-4c76-a336-38cac493823a\") " pod="openshift-ingress/e2e-inf-b-fc9057-openshift-default-7c5cf5bfb7-sjh4s"
Jul 20 13:38:49.808306 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:38:49.808264    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b29e9121-1dfc-4c76-a336-38cac493823a-istio-data\") pod \"e2e-inf-b-fc9057-openshift-default-7c5cf5bfb7-sjh4s\" (UID: \"b29e9121-1dfc-4c76-a336-38cac493823a\") " pod="openshift-ingress/e2e-inf-b-fc9057-openshift-default-7c5cf5bfb7-sjh4s"
Jul 20 13:38:49.808518 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:38:49.808497    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b29e9121-1dfc-4c76-a336-38cac493823a-istiod-ca-cert\") pod \"e2e-inf-b-fc9057-openshift-default-7c5cf5bfb7-sjh4s\" (UID: \"b29e9121-1dfc-4c76-a336-38cac493823a\") " pod="openshift-ingress/e2e-inf-b-fc9057-openshift-default-7c5cf5bfb7-sjh4s"
Jul 20 13:38:49.808633 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:38:49.808616    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b29e9121-1dfc-4c76-a336-38cac493823a-workload-certs\") pod \"e2e-inf-b-fc9057-openshift-default-7c5cf5bfb7-sjh4s\" (UID: \"b29e9121-1dfc-4c76-a336-38cac493823a\") " pod="openshift-ingress/e2e-inf-b-fc9057-openshift-default-7c5cf5bfb7-sjh4s"
Jul 20 13:38:49.810700 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:38:49.810680    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b29e9121-1dfc-4c76-a336-38cac493823a-istio-podinfo\") pod \"e2e-inf-b-fc9057-openshift-default-7c5cf5bfb7-sjh4s\" (UID: \"b29e9121-1dfc-4c76-a336-38cac493823a\") " pod="openshift-ingress/e2e-inf-b-fc9057-openshift-default-7c5cf5bfb7-sjh4s"
Jul 20 13:38:49.810807 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:38:49.810750    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b29e9121-1dfc-4c76-a336-38cac493823a-istio-envoy\") pod \"e2e-inf-b-fc9057-openshift-default-7c5cf5bfb7-sjh4s\" (UID: \"b29e9121-1dfc-4c76-a336-38cac493823a\") " pod="openshift-ingress/e2e-inf-b-fc9057-openshift-default-7c5cf5bfb7-sjh4s"
Jul 20 13:38:49.815240 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:38:49.815212    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b29e9121-1dfc-4c76-a336-38cac493823a-istio-token\") pod \"e2e-inf-b-fc9057-openshift-default-7c5cf5bfb7-sjh4s\" (UID: \"b29e9121-1dfc-4c76-a336-38cac493823a\") " pod="openshift-ingress/e2e-inf-b-fc9057-openshift-default-7c5cf5bfb7-sjh4s"
Jul 20 13:38:49.815381 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:38:49.815366    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kdmwd\" (UniqueName: \"kubernetes.io/projected/b29e9121-1dfc-4c76-a336-38cac493823a-kube-api-access-kdmwd\") pod \"e2e-inf-b-fc9057-openshift-default-7c5cf5bfb7-sjh4s\" (UID: \"b29e9121-1dfc-4c76-a336-38cac493823a\") " pod="openshift-ingress/e2e-inf-b-fc9057-openshift-default-7c5cf5bfb7-sjh4s"
Jul 20 13:38:49.923220 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:38:49.923116    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-fc9057-openshift-default-7c5cf5bfb7-sjh4s"
Jul 20 13:38:50.071133 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:38:50.071107    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-fc9057-openshift-default-7c5cf5bfb7-sjh4s"]
Jul 20 13:38:50.073238 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:38:50.073205    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb29e9121_1dfc_4c76_a336_38cac493823a.slice/crio-e91aed3b22134fec1e1ee2e7d7c5d95d8335038209a86687124ec0e4ffe4c294 WatchSource:0}: Error finding container e91aed3b22134fec1e1ee2e7d7c5d95d8335038209a86687124ec0e4ffe4c294: Status 404 returned error can't find the container with id e91aed3b22134fec1e1ee2e7d7c5d95d8335038209a86687124ec0e4ffe4c294
Jul 20 13:38:50.075435 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:38:50.075400    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 20 13:38:50.075557 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:38:50.075480    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 20 13:38:50.075557 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:38:50.075549    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 20 13:38:50.407156 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:38:50.407116    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-fc9057-openshift-default-7c5cf5bfb7-sjh4s" event={"ID":"b29e9121-1dfc-4c76-a336-38cac493823a","Type":"ContainerStarted","Data":"2a0a3807aa53f1847a5c8a999afb8a1dd919c893e62c898f931b8dc5ae0cb4bb"}
Jul 20 13:38:50.407369 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:38:50.407169    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-fc9057-openshift-default-7c5cf5bfb7-sjh4s" event={"ID":"b29e9121-1dfc-4c76-a336-38cac493823a","Type":"ContainerStarted","Data":"e91aed3b22134fec1e1ee2e7d7c5d95d8335038209a86687124ec0e4ffe4c294"}
Jul 20 13:38:50.429589 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:38:50.429538    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-fc9057-openshift-default-7c5cf5bfb7-sjh4s" podStartSLOduration=1.429522532 podStartE2EDuration="1.429522532s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 13:38:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 13:38:50.427245522 +0000 UTC m=+2220.143792974" watchObservedRunningTime="2026-07-20 13:38:50.429522532 +0000 UTC m=+2220.146069942"
Jul 20 13:38:50.923792 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:38:50.923759    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-fc9057-openshift-default-7c5cf5bfb7-sjh4s"
Jul 20 13:38:51.928844 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:38:51.928812    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-fc9057-openshift-default-7c5cf5bfb7-sjh4s"
Jul 20 13:38:52.393373 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:38:52.393344    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-5ce595-5588dcf694-slw7h"
Jul 20 13:38:52.418626 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:38:52.418599    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-fc9057-openshift-default-7c5cf5bfb7-sjh4s"
Jul 20 13:38:52.419743 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:38:52.419721    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-fc9057-openshift-default-7c5cf5bfb7-sjh4s"
Jul 20 13:38:52.581978 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:38:52.581925    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-fc9057-bddf5dcbc-2mmfn"]
Jul 20 13:38:52.587763 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:38:52.587733    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-fc9057-bddf5dcbc-2mmfn"
Jul 20 13:38:52.589917 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:38:52.589891    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-b-fc9057-serving-cert\""
Jul 20 13:38:52.595238 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:38:52.595214    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-fc9057-bddf5dcbc-2mmfn"]
Jul 20 13:38:52.741834 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:38:52.741787    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/40ef7874-90a3-41ea-9c22-3725515da6b2-maas-api-tls\") pod \"maas-api-e2e-inf-b-fc9057-bddf5dcbc-2mmfn\" (UID: \"40ef7874-90a3-41ea-9c22-3725515da6b2\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-fc9057-bddf5dcbc-2mmfn"
Jul 20 13:38:52.742043 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:38:52.741887    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rzdr2\" (UniqueName: \"kubernetes.io/projected/40ef7874-90a3-41ea-9c22-3725515da6b2-kube-api-access-rzdr2\") pod \"maas-api-e2e-inf-b-fc9057-bddf5dcbc-2mmfn\" (UID: \"40ef7874-90a3-41ea-9c22-3725515da6b2\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-fc9057-bddf5dcbc-2mmfn"
Jul 20 13:38:52.742043 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:38:52.742015    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/40ef7874-90a3-41ea-9c22-3725515da6b2-openshift-service-ca\") pod \"maas-api-e2e-inf-b-fc9057-bddf5dcbc-2mmfn\" (UID: \"40ef7874-90a3-41ea-9c22-3725515da6b2\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-fc9057-bddf5dcbc-2mmfn"
Jul 20 13:38:52.843855 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:38:52.843807    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/40ef7874-90a3-41ea-9c22-3725515da6b2-maas-api-tls\") pod \"maas-api-e2e-inf-b-fc9057-bddf5dcbc-2mmfn\" (UID: \"40ef7874-90a3-41ea-9c22-3725515da6b2\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-fc9057-bddf5dcbc-2mmfn"
Jul 20 13:38:52.844724 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:38:52.844698    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rzdr2\" (UniqueName: \"kubernetes.io/projected/40ef7874-90a3-41ea-9c22-3725515da6b2-kube-api-access-rzdr2\") pod \"maas-api-e2e-inf-b-fc9057-bddf5dcbc-2mmfn\" (UID: \"40ef7874-90a3-41ea-9c22-3725515da6b2\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-fc9057-bddf5dcbc-2mmfn"
Jul 20 13:38:52.845479 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:38:52.845460    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/40ef7874-90a3-41ea-9c22-3725515da6b2-openshift-service-ca\") pod \"maas-api-e2e-inf-b-fc9057-bddf5dcbc-2mmfn\" (UID: \"40ef7874-90a3-41ea-9c22-3725515da6b2\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-fc9057-bddf5dcbc-2mmfn"
Jul 20 13:38:52.846465 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:38:52.846337    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/40ef7874-90a3-41ea-9c22-3725515da6b2-openshift-service-ca\") pod \"maas-api-e2e-inf-b-fc9057-bddf5dcbc-2mmfn\" (UID: \"40ef7874-90a3-41ea-9c22-3725515da6b2\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-fc9057-bddf5dcbc-2mmfn"
Jul 20 13:38:52.848476 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:38:52.848442    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/40ef7874-90a3-41ea-9c22-3725515da6b2-maas-api-tls\") pod \"maas-api-e2e-inf-b-fc9057-bddf5dcbc-2mmfn\" (UID: \"40ef7874-90a3-41ea-9c22-3725515da6b2\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-fc9057-bddf5dcbc-2mmfn"
Jul 20 13:38:52.853232 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:38:52.853211    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rzdr2\" (UniqueName: \"kubernetes.io/projected/40ef7874-90a3-41ea-9c22-3725515da6b2-kube-api-access-rzdr2\") pod \"maas-api-e2e-inf-b-fc9057-bddf5dcbc-2mmfn\" (UID: \"40ef7874-90a3-41ea-9c22-3725515da6b2\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-fc9057-bddf5dcbc-2mmfn"
Jul 20 13:38:52.903396 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:38:52.903354    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-fc9057-bddf5dcbc-2mmfn"
Jul 20 13:38:53.104917 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:38:53.104884    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-fc9057-bddf5dcbc-2mmfn"]
Jul 20 13:38:53.107203 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:38:53.107173    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod40ef7874_90a3_41ea_9c22_3725515da6b2.slice/crio-dca71b00e7fc9387403e9c6929495493cfdb21b2a1f484dffe02521dc6eaa60f WatchSource:0}: Error finding container dca71b00e7fc9387403e9c6929495493cfdb21b2a1f484dffe02521dc6eaa60f: Status 404 returned error can't find the container with id dca71b00e7fc9387403e9c6929495493cfdb21b2a1f484dffe02521dc6eaa60f
Jul 20 13:38:53.426616 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:38:53.426509    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-fc9057-bddf5dcbc-2mmfn" event={"ID":"40ef7874-90a3-41ea-9c22-3725515da6b2","Type":"ContainerStarted","Data":"dca71b00e7fc9387403e9c6929495493cfdb21b2a1f484dffe02521dc6eaa60f"}
Jul 20 13:38:54.439190 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:38:54.439148    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-fc9057-bddf5dcbc-2mmfn" event={"ID":"40ef7874-90a3-41ea-9c22-3725515da6b2","Type":"ContainerStarted","Data":"7652a04216d15e60b64e0e9ada3ca3859f82968e90cfb0b421277ce5c43f1606"}
Jul 20 13:38:54.439715 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:38:54.439237    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-fc9057-bddf5dcbc-2mmfn"
Jul 20 13:38:54.461216 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:38:54.461131    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-fc9057-bddf5dcbc-2mmfn" podStartSLOduration=2.077528362 podStartE2EDuration="2.46110914s" totalImagesPullingTime="383.580778ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 13:38:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 13:38:54.458022152 +0000 UTC m=+2224.174569566" watchObservedRunningTime="2026-07-20 13:38:54.46110914 +0000 UTC m=+2224.177656552"
Jul 20 13:38:59.364366 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:38:59.364313    2584 patch_prober.go:28] interesting pod/e2e-inf-a-5ce595-openshift-default-6754f78fc7-wbw4z container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.59:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 20 13:38:59.364910 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:38:59.364405    2584 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-5ce595-openshift-default-6754f78fc7-wbw4z" podUID="ebb5d898-02f9-4ea8-8c12-43e6df126353" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.59:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 20 13:39:00.475624 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:39:00.475593    2584 generic.go:356] "Generic (PLEG): container finished" podID="ebb5d898-02f9-4ea8-8c12-43e6df126353" containerID="b857dc92692d7024555f2650aebedae2784afdecaed95726e5fb766839f2cc1c" exitCode=0
Jul 20 13:39:00.476105 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:39:00.475668    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-5ce595-openshift-default-6754f78fc7-wbw4z" event={"ID":"ebb5d898-02f9-4ea8-8c12-43e6df126353","Type":"ContainerDied","Data":"b857dc92692d7024555f2650aebedae2784afdecaed95726e5fb766839f2cc1c"}
Jul 20 13:39:00.476155 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:39:00.476134    2584 scope.go:117] "RemoveContainer" containerID="b857dc92692d7024555f2650aebedae2784afdecaed95726e5fb766839f2cc1c"
Jul 20 13:39:00.477132 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:39:00.477106    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 20 13:39:00.477204 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:39:00.477174    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 20 13:39:00.477248 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:39:00.477206    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 20 13:39:01.467418 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:39:01.467378    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-fc9057-bddf5dcbc-2mmfn"
Jul 20 13:39:01.484807 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:39:01.484771    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-5ce595-openshift-default-6754f78fc7-wbw4z" event={"ID":"ebb5d898-02f9-4ea8-8c12-43e6df126353","Type":"ContainerStarted","Data":"8a138113dd2e346072845d877227f57193199dcdb2c101fddfe8eb695b6427c7"}
Jul 20 13:39:02.260708 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:39:02.260666    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-5ce595-openshift-default-6754f78fc7-wbw4z"
Jul 20 13:39:02.261142 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:39:02.261118    2584 patch_prober.go:28] interesting pod/e2e-inf-a-5ce595-openshift-default-6754f78fc7-wbw4z container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused" start-of-body=
Jul 20 13:39:02.261320 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:39:02.261288    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-5ce595-openshift-default-6754f78fc7-wbw4z" podUID="ebb5d898-02f9-4ea8-8c12-43e6df126353" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused"
Jul 20 13:39:03.260941 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:39:03.260893    2584 patch_prober.go:28] interesting pod/e2e-inf-a-5ce595-openshift-default-6754f78fc7-wbw4z container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused" start-of-body=
Jul 20 13:39:03.261468 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:39:03.260994    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-5ce595-openshift-default-6754f78fc7-wbw4z" podUID="ebb5d898-02f9-4ea8-8c12-43e6df126353" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused"
Jul 20 13:39:04.260866 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:39:04.260822    2584 patch_prober.go:28] interesting pod/e2e-inf-a-5ce595-openshift-default-6754f78fc7-wbw4z container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused" start-of-body=
Jul 20 13:39:04.261102 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:39:04.260895    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-5ce595-openshift-default-6754f78fc7-wbw4z" podUID="ebb5d898-02f9-4ea8-8c12-43e6df126353" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused"
Jul 20 13:39:05.260640 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:39:05.260597    2584 patch_prober.go:28] interesting pod/e2e-inf-a-5ce595-openshift-default-6754f78fc7-wbw4z container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused" start-of-body=
Jul 20 13:39:05.260819 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:39:05.260658    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-5ce595-openshift-default-6754f78fc7-wbw4z" podUID="ebb5d898-02f9-4ea8-8c12-43e6df126353" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused"
Jul 20 13:39:06.263601 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:39:06.263569    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-5ce595-openshift-default-6754f78fc7-wbw4z"
Jul 20 13:39:06.264116 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:39:06.263957    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-5ce595-openshift-default-6754f78fc7-wbw4z"
Jul 20 13:39:06.273229 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:39:06.273195    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-5ce595-openshift-default-6754f78fc7-wbw4z"
Jul 20 13:39:07.419762 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:39:07.419721    2584 patch_prober.go:28] interesting pod/e2e-inf-b-fc9057-openshift-default-7c5cf5bfb7-sjh4s container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.61:15021/healthz/ready\": dial tcp 10.134.0.61:15021: connect: connection refused" start-of-body=
Jul 20 13:39:07.420227 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:39:07.419773    2584 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-fc9057-openshift-default-7c5cf5bfb7-sjh4s" podUID="b29e9121-1dfc-4c76-a336-38cac493823a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.61:15021/healthz/ready\": dial tcp 10.134.0.61:15021: connect: connection refused"
Jul 20 13:39:07.520895 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:39:07.520865    2584 generic.go:356] "Generic (PLEG): container finished" podID="b29e9121-1dfc-4c76-a336-38cac493823a" containerID="2a0a3807aa53f1847a5c8a999afb8a1dd919c893e62c898f931b8dc5ae0cb4bb" exitCode=0
Jul 20 13:39:07.521091 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:39:07.520952    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-fc9057-openshift-default-7c5cf5bfb7-sjh4s" event={"ID":"b29e9121-1dfc-4c76-a336-38cac493823a","Type":"ContainerDied","Data":"2a0a3807aa53f1847a5c8a999afb8a1dd919c893e62c898f931b8dc5ae0cb4bb"}
Jul 20 13:39:07.521485 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:39:07.521470    2584 scope.go:117] "RemoveContainer" containerID="2a0a3807aa53f1847a5c8a999afb8a1dd919c893e62c898f931b8dc5ae0cb4bb"
Jul 20 13:39:07.522446 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:39:07.522418    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 20 13:39:07.522503 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:39:07.522488    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 20 13:39:07.522545 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:39:07.522517    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 20 13:39:08.528808 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:39:08.528774    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-fc9057-openshift-default-7c5cf5bfb7-sjh4s" event={"ID":"b29e9121-1dfc-4c76-a336-38cac493823a","Type":"ContainerStarted","Data":"16a91bf5449f4ebf906b83e1ac27d51668db579ce94fa45f7769c5e12b3f2e24"}
Jul 20 13:39:08.924335 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:39:08.924229    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-fc9057-openshift-default-7c5cf5bfb7-sjh4s"
Jul 20 13:39:08.924754 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:39:08.924708    2584 patch_prober.go:28] interesting pod/e2e-inf-b-fc9057-openshift-default-7c5cf5bfb7-sjh4s container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.61:15021/healthz/ready\": dial tcp 10.134.0.61:15021: connect: connection refused" start-of-body=
Jul 20 13:39:08.925004 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:39:08.924948    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-fc9057-openshift-default-7c5cf5bfb7-sjh4s" podUID="b29e9121-1dfc-4c76-a336-38cac493823a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.61:15021/healthz/ready\": dial tcp 10.134.0.61:15021: connect: connection refused"
Jul 20 13:39:09.923594 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:39:09.923553    2584 patch_prober.go:28] interesting pod/e2e-inf-b-fc9057-openshift-default-7c5cf5bfb7-sjh4s container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.61:15021/healthz/ready\": dial tcp 10.134.0.61:15021: connect: connection refused" start-of-body=
Jul 20 13:39:09.924255 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:39:09.924204    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-fc9057-openshift-default-7c5cf5bfb7-sjh4s" podUID="b29e9121-1dfc-4c76-a336-38cac493823a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.61:15021/healthz/ready\": dial tcp 10.134.0.61:15021: connect: connection refused"
Jul 20 13:39:10.932462 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:39:10.932418    2584 patch_prober.go:28] interesting pod/e2e-inf-b-fc9057-openshift-default-7c5cf5bfb7-sjh4s container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.61:15021/healthz/ready\": dial tcp 10.134.0.61:15021: connect: connection refused" start-of-body=
Jul 20 13:39:10.932994 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:39:10.932494    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-fc9057-openshift-default-7c5cf5bfb7-sjh4s" podUID="b29e9121-1dfc-4c76-a336-38cac493823a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.61:15021/healthz/ready\": dial tcp 10.134.0.61:15021: connect: connection refused"
Jul 20 13:39:11.923549 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:39:11.923512    2584 patch_prober.go:28] interesting pod/e2e-inf-b-fc9057-openshift-default-7c5cf5bfb7-sjh4s container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.61:15021/healthz/ready\": dial tcp 10.134.0.61:15021: connect: connection refused" start-of-body=
Jul 20 13:39:11.923886 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:39:11.923852    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-fc9057-openshift-default-7c5cf5bfb7-sjh4s" podUID="b29e9121-1dfc-4c76-a336-38cac493823a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.61:15021/healthz/ready\": dial tcp 10.134.0.61:15021: connect: connection refused"
Jul 20 13:39:12.928276 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:39:12.928190    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-fc9057-openshift-default-7c5cf5bfb7-sjh4s"
Jul 20 13:39:12.928697 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:39:12.928661    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-fc9057-openshift-default-7c5cf5bfb7-sjh4s"
Jul 20 13:39:12.929444 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:39:12.929424    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-fc9057-openshift-default-7c5cf5bfb7-sjh4s"
Jul 20 13:40:07.497373 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:40:07.497338    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-5ce595-5588dcf694-slw7h"]
Jul 20 13:40:07.497907 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:40:07.497712    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-5ce595-5588dcf694-slw7h" podUID="69d39865-95c9-4462-9826-329fcc9aff50" containerName="maas-api" containerID="cri-o://280991be9bbf5b935993de574328be62e016f9da262ea0ca737a06ebe81f6750" gracePeriod=30
Jul 20 13:40:07.767130 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:40:07.767102    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-5ce595-5588dcf694-slw7h"
Jul 20 13:40:07.858876 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:40:07.858835    2584 generic.go:356] "Generic (PLEG): container finished" podID="69d39865-95c9-4462-9826-329fcc9aff50" containerID="280991be9bbf5b935993de574328be62e016f9da262ea0ca737a06ebe81f6750" exitCode=0
Jul 20 13:40:07.858876 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:40:07.858879    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-5ce595-5588dcf694-slw7h"
Jul 20 13:40:07.859215 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:40:07.858917    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-5ce595-5588dcf694-slw7h" event={"ID":"69d39865-95c9-4462-9826-329fcc9aff50","Type":"ContainerDied","Data":"280991be9bbf5b935993de574328be62e016f9da262ea0ca737a06ebe81f6750"}
Jul 20 13:40:07.859215 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:40:07.858992    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-5ce595-5588dcf694-slw7h" event={"ID":"69d39865-95c9-4462-9826-329fcc9aff50","Type":"ContainerDied","Data":"0a22d2b91494cea333f996f8ec2129f4779d8bc687010e1320ebab6acb6f8368"}
Jul 20 13:40:07.859215 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:40:07.859021    2584 scope.go:117] "RemoveContainer" containerID="280991be9bbf5b935993de574328be62e016f9da262ea0ca737a06ebe81f6750"
Jul 20 13:40:07.865178 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:40:07.865157    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ljlr8\" (UniqueName: \"kubernetes.io/projected/69d39865-95c9-4462-9826-329fcc9aff50-kube-api-access-ljlr8\") pod \"69d39865-95c9-4462-9826-329fcc9aff50\" (UID: \"69d39865-95c9-4462-9826-329fcc9aff50\") "
Jul 20 13:40:07.865298 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:40:07.865219    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/69d39865-95c9-4462-9826-329fcc9aff50-maas-api-tls\") pod \"69d39865-95c9-4462-9826-329fcc9aff50\" (UID: \"69d39865-95c9-4462-9826-329fcc9aff50\") "
Jul 20 13:40:07.865298 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:40:07.865268    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/69d39865-95c9-4462-9826-329fcc9aff50-openshift-service-ca\") pod \"69d39865-95c9-4462-9826-329fcc9aff50\" (UID: \"69d39865-95c9-4462-9826-329fcc9aff50\") "
Jul 20 13:40:07.865674 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:40:07.865651    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/69d39865-95c9-4462-9826-329fcc9aff50-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "69d39865-95c9-4462-9826-329fcc9aff50" (UID: "69d39865-95c9-4462-9826-329fcc9aff50"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 13:40:07.867082 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:40:07.867052    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/69d39865-95c9-4462-9826-329fcc9aff50-kube-api-access-ljlr8" (OuterVolumeSpecName: "kube-api-access-ljlr8") pod "69d39865-95c9-4462-9826-329fcc9aff50" (UID: "69d39865-95c9-4462-9826-329fcc9aff50"). InnerVolumeSpecName "kube-api-access-ljlr8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 13:40:07.867313 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:40:07.867287    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/69d39865-95c9-4462-9826-329fcc9aff50-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "69d39865-95c9-4462-9826-329fcc9aff50" (UID: "69d39865-95c9-4462-9826-329fcc9aff50"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 13:40:07.868053 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:40:07.868038    2584 scope.go:117] "RemoveContainer" containerID="280991be9bbf5b935993de574328be62e016f9da262ea0ca737a06ebe81f6750"
Jul 20 13:40:07.868331 ip-10-0-134-121 kubenswrapper[2584]: E0720 13:40:07.868313    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"280991be9bbf5b935993de574328be62e016f9da262ea0ca737a06ebe81f6750\": container with ID starting with 280991be9bbf5b935993de574328be62e016f9da262ea0ca737a06ebe81f6750 not found: ID does not exist" containerID="280991be9bbf5b935993de574328be62e016f9da262ea0ca737a06ebe81f6750"
Jul 20 13:40:07.868374 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:40:07.868339    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"280991be9bbf5b935993de574328be62e016f9da262ea0ca737a06ebe81f6750"} err="failed to get container status \"280991be9bbf5b935993de574328be62e016f9da262ea0ca737a06ebe81f6750\": rpc error: code = NotFound desc = could not find container \"280991be9bbf5b935993de574328be62e016f9da262ea0ca737a06ebe81f6750\": container with ID starting with 280991be9bbf5b935993de574328be62e016f9da262ea0ca737a06ebe81f6750 not found: ID does not exist"
Jul 20 13:40:07.966627 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:40:07.966572    2584 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/69d39865-95c9-4462-9826-329fcc9aff50-maas-api-tls\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 20 13:40:07.966627 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:40:07.966622    2584 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/69d39865-95c9-4462-9826-329fcc9aff50-openshift-service-ca\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 20 13:40:07.966627 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:40:07.966632    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ljlr8\" (UniqueName: \"kubernetes.io/projected/69d39865-95c9-4462-9826-329fcc9aff50-kube-api-access-ljlr8\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 20 13:40:08.181744 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:40:08.181716    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-5ce595-5588dcf694-slw7h"]
Jul 20 13:40:08.185463 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:40:08.185440    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-5ce595-5588dcf694-slw7h"]
Jul 20 13:40:09.095868 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:40:09.095832    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="69d39865-95c9-4462-9826-329fcc9aff50" path="/var/lib/kubelet/pods/69d39865-95c9-4462-9826-329fcc9aff50/volumes"
Jul 20 13:40:22.874895 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:40:22.874857    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-5ce595-openshift-default-6754f78fc7-wbw4z"]
Jul 20 13:40:22.875446 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:40:22.875141    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-5ce595-openshift-default-6754f78fc7-wbw4z" podUID="ebb5d898-02f9-4ea8-8c12-43e6df126353" containerName="istio-proxy" containerID="cri-o://8a138113dd2e346072845d877227f57193199dcdb2c101fddfe8eb695b6427c7" gracePeriod=30
Jul 20 13:40:28.136044 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:40:28.136018    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-5ce595-openshift-default-6754f78fc7-wbw4z"
Jul 20 13:40:28.260450 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:40:28.260402    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ebb5d898-02f9-4ea8-8c12-43e6df126353-istio-token\") pod \"ebb5d898-02f9-4ea8-8c12-43e6df126353\" (UID: \"ebb5d898-02f9-4ea8-8c12-43e6df126353\") "
Jul 20 13:40:28.260450 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:40:28.260457    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ebb5d898-02f9-4ea8-8c12-43e6df126353-workload-certs\") pod \"ebb5d898-02f9-4ea8-8c12-43e6df126353\" (UID: \"ebb5d898-02f9-4ea8-8c12-43e6df126353\") "
Jul 20 13:40:28.260705 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:40:28.260493    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ebb5d898-02f9-4ea8-8c12-43e6df126353-istio-envoy\") pod \"ebb5d898-02f9-4ea8-8c12-43e6df126353\" (UID: \"ebb5d898-02f9-4ea8-8c12-43e6df126353\") "
Jul 20 13:40:28.260705 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:40:28.260527    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ebb5d898-02f9-4ea8-8c12-43e6df126353-istiod-ca-cert\") pod \"ebb5d898-02f9-4ea8-8c12-43e6df126353\" (UID: \"ebb5d898-02f9-4ea8-8c12-43e6df126353\") "
Jul 20 13:40:28.260705 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:40:28.260573    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m6bgh\" (UniqueName: \"kubernetes.io/projected/ebb5d898-02f9-4ea8-8c12-43e6df126353-kube-api-access-m6bgh\") pod \"ebb5d898-02f9-4ea8-8c12-43e6df126353\" (UID: \"ebb5d898-02f9-4ea8-8c12-43e6df126353\") "
Jul 20 13:40:28.260705 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:40:28.260620    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ebb5d898-02f9-4ea8-8c12-43e6df126353-istio-data\") pod \"ebb5d898-02f9-4ea8-8c12-43e6df126353\" (UID: \"ebb5d898-02f9-4ea8-8c12-43e6df126353\") "
Jul 20 13:40:28.260705 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:40:28.260663    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ebb5d898-02f9-4ea8-8c12-43e6df126353-workload-socket\") pod \"ebb5d898-02f9-4ea8-8c12-43e6df126353\" (UID: \"ebb5d898-02f9-4ea8-8c12-43e6df126353\") "
Jul 20 13:40:28.260705 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:40:28.260687    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ebb5d898-02f9-4ea8-8c12-43e6df126353-credential-socket\") pod \"ebb5d898-02f9-4ea8-8c12-43e6df126353\" (UID: \"ebb5d898-02f9-4ea8-8c12-43e6df126353\") "
Jul 20 13:40:28.261054 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:40:28.260724    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ebb5d898-02f9-4ea8-8c12-43e6df126353-istio-podinfo\") pod \"ebb5d898-02f9-4ea8-8c12-43e6df126353\" (UID: \"ebb5d898-02f9-4ea8-8c12-43e6df126353\") "
Jul 20 13:40:28.261054 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:40:28.260837    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ebb5d898-02f9-4ea8-8c12-43e6df126353-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "ebb5d898-02f9-4ea8-8c12-43e6df126353" (UID: "ebb5d898-02f9-4ea8-8c12-43e6df126353"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 13:40:28.261162 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:40:28.261065    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ebb5d898-02f9-4ea8-8c12-43e6df126353-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "ebb5d898-02f9-4ea8-8c12-43e6df126353" (UID: "ebb5d898-02f9-4ea8-8c12-43e6df126353"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 13:40:28.261162 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:40:28.261079    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ebb5d898-02f9-4ea8-8c12-43e6df126353-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "ebb5d898-02f9-4ea8-8c12-43e6df126353" (UID: "ebb5d898-02f9-4ea8-8c12-43e6df126353"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 13:40:28.261264 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:40:28.261215    2584 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ebb5d898-02f9-4ea8-8c12-43e6df126353-workload-socket\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 20 13:40:28.261264 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:40:28.261237    2584 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ebb5d898-02f9-4ea8-8c12-43e6df126353-workload-certs\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 20 13:40:28.261264 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:40:28.261251    2584 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ebb5d898-02f9-4ea8-8c12-43e6df126353-istiod-ca-cert\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 20 13:40:28.261366 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:40:28.261272    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ebb5d898-02f9-4ea8-8c12-43e6df126353-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "ebb5d898-02f9-4ea8-8c12-43e6df126353" (UID: "ebb5d898-02f9-4ea8-8c12-43e6df126353"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 13:40:28.261865 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:40:28.261832    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ebb5d898-02f9-4ea8-8c12-43e6df126353-istio-data" (OuterVolumeSpecName: "istio-data") pod "ebb5d898-02f9-4ea8-8c12-43e6df126353" (UID: "ebb5d898-02f9-4ea8-8c12-43e6df126353"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 13:40:28.262786 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:40:28.262757    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ebb5d898-02f9-4ea8-8c12-43e6df126353-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "ebb5d898-02f9-4ea8-8c12-43e6df126353" (UID: "ebb5d898-02f9-4ea8-8c12-43e6df126353"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 13:40:28.262889 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:40:28.262870    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ebb5d898-02f9-4ea8-8c12-43e6df126353-istio-token" (OuterVolumeSpecName: "istio-token") pod "ebb5d898-02f9-4ea8-8c12-43e6df126353" (UID: "ebb5d898-02f9-4ea8-8c12-43e6df126353"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 13:40:28.262952 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:40:28.262935    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/ebb5d898-02f9-4ea8-8c12-43e6df126353-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "ebb5d898-02f9-4ea8-8c12-43e6df126353" (UID: "ebb5d898-02f9-4ea8-8c12-43e6df126353"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 20 13:40:28.263238 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:40:28.263210    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ebb5d898-02f9-4ea8-8c12-43e6df126353-kube-api-access-m6bgh" (OuterVolumeSpecName: "kube-api-access-m6bgh") pod "ebb5d898-02f9-4ea8-8c12-43e6df126353" (UID: "ebb5d898-02f9-4ea8-8c12-43e6df126353"). InnerVolumeSpecName "kube-api-access-m6bgh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 13:40:28.362034 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:40:28.362000    2584 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ebb5d898-02f9-4ea8-8c12-43e6df126353-istio-envoy\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 20 13:40:28.362034 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:40:28.362029    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m6bgh\" (UniqueName: \"kubernetes.io/projected/ebb5d898-02f9-4ea8-8c12-43e6df126353-kube-api-access-m6bgh\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 20 13:40:28.362034 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:40:28.362038    2584 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ebb5d898-02f9-4ea8-8c12-43e6df126353-istio-data\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 20 13:40:28.362270 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:40:28.362048    2584 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ebb5d898-02f9-4ea8-8c12-43e6df126353-credential-socket\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 20 13:40:28.362270 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:40:28.362056    2584 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ebb5d898-02f9-4ea8-8c12-43e6df126353-istio-podinfo\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 20 13:40:28.362270 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:40:28.362064    2584 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ebb5d898-02f9-4ea8-8c12-43e6df126353-istio-token\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 20 13:40:28.973033 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:40:28.972998    2584 generic.go:356] "Generic (PLEG): container finished" podID="ebb5d898-02f9-4ea8-8c12-43e6df126353" containerID="8a138113dd2e346072845d877227f57193199dcdb2c101fddfe8eb695b6427c7" exitCode=0
Jul 20 13:40:28.973234 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:40:28.973047    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-5ce595-openshift-default-6754f78fc7-wbw4z" event={"ID":"ebb5d898-02f9-4ea8-8c12-43e6df126353","Type":"ContainerDied","Data":"8a138113dd2e346072845d877227f57193199dcdb2c101fddfe8eb695b6427c7"}
Jul 20 13:40:28.973234 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:40:28.973056    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-5ce595-openshift-default-6754f78fc7-wbw4z"
Jul 20 13:40:28.973234 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:40:28.973088    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-5ce595-openshift-default-6754f78fc7-wbw4z" event={"ID":"ebb5d898-02f9-4ea8-8c12-43e6df126353","Type":"ContainerDied","Data":"7a7c18d64c3db306cf314e432cef684023e515f17bd8e47940c8275dd135054e"}
Jul 20 13:40:28.973234 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:40:28.973111    2584 scope.go:117] "RemoveContainer" containerID="8a138113dd2e346072845d877227f57193199dcdb2c101fddfe8eb695b6427c7"
Jul 20 13:40:28.985154 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:40:28.985135    2584 scope.go:117] "RemoveContainer" containerID="b857dc92692d7024555f2650aebedae2784afdecaed95726e5fb766839f2cc1c"
Jul 20 13:40:28.994478 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:40:28.994202    2584 scope.go:117] "RemoveContainer" containerID="8a138113dd2e346072845d877227f57193199dcdb2c101fddfe8eb695b6427c7"
Jul 20 13:40:28.994549 ip-10-0-134-121 kubenswrapper[2584]: E0720 13:40:28.994513    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8a138113dd2e346072845d877227f57193199dcdb2c101fddfe8eb695b6427c7\": container with ID starting with 8a138113dd2e346072845d877227f57193199dcdb2c101fddfe8eb695b6427c7 not found: ID does not exist" containerID="8a138113dd2e346072845d877227f57193199dcdb2c101fddfe8eb695b6427c7"
Jul 20 13:40:28.994599 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:40:28.994547    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8a138113dd2e346072845d877227f57193199dcdb2c101fddfe8eb695b6427c7"} err="failed to get container status \"8a138113dd2e346072845d877227f57193199dcdb2c101fddfe8eb695b6427c7\": rpc error: code = NotFound desc = could not find container \"8a138113dd2e346072845d877227f57193199dcdb2c101fddfe8eb695b6427c7\": container with ID starting with 8a138113dd2e346072845d877227f57193199dcdb2c101fddfe8eb695b6427c7 not found: ID does not exist"
Jul 20 13:40:28.994599 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:40:28.994570    2584 scope.go:117] "RemoveContainer" containerID="b857dc92692d7024555f2650aebedae2784afdecaed95726e5fb766839f2cc1c"
Jul 20 13:40:28.994829 ip-10-0-134-121 kubenswrapper[2584]: E0720 13:40:28.994811    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b857dc92692d7024555f2650aebedae2784afdecaed95726e5fb766839f2cc1c\": container with ID starting with b857dc92692d7024555f2650aebedae2784afdecaed95726e5fb766839f2cc1c not found: ID does not exist" containerID="b857dc92692d7024555f2650aebedae2784afdecaed95726e5fb766839f2cc1c"
Jul 20 13:40:28.994879 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:40:28.994835    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b857dc92692d7024555f2650aebedae2784afdecaed95726e5fb766839f2cc1c"} err="failed to get container status \"b857dc92692d7024555f2650aebedae2784afdecaed95726e5fb766839f2cc1c\": rpc error: code = NotFound desc = could not find container \"b857dc92692d7024555f2650aebedae2784afdecaed95726e5fb766839f2cc1c\": container with ID starting with b857dc92692d7024555f2650aebedae2784afdecaed95726e5fb766839f2cc1c not found: ID does not exist"
Jul 20 13:40:28.996301 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:40:28.996279    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-5ce595-openshift-default-6754f78fc7-wbw4z"]
Jul 20 13:40:29.000192 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:40:29.000170    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-5ce595-openshift-default-6754f78fc7-wbw4z"]
Jul 20 13:40:29.096248 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:40:29.096218    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ebb5d898-02f9-4ea8-8c12-43e6df126353" path="/var/lib/kubelet/pods/ebb5d898-02f9-4ea8-8c12-43e6df126353/volumes"
Jul 20 13:40:33.947676 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:40:33.947643    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-fc9057-bddf5dcbc-2mmfn"]
Jul 20 13:40:33.948199 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:40:33.947947    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-fc9057-bddf5dcbc-2mmfn" podUID="40ef7874-90a3-41ea-9c22-3725515da6b2" containerName="maas-api" containerID="cri-o://7652a04216d15e60b64e0e9ada3ca3859f82968e90cfb0b421277ce5c43f1606" gracePeriod=30
Jul 20 13:40:34.207986 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:40:34.207902    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-fc9057-bddf5dcbc-2mmfn"
Jul 20 13:40:34.327793 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:40:34.327753    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/40ef7874-90a3-41ea-9c22-3725515da6b2-maas-api-tls\") pod \"40ef7874-90a3-41ea-9c22-3725515da6b2\" (UID: \"40ef7874-90a3-41ea-9c22-3725515da6b2\") "
Jul 20 13:40:34.328013 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:40:34.327811    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rzdr2\" (UniqueName: \"kubernetes.io/projected/40ef7874-90a3-41ea-9c22-3725515da6b2-kube-api-access-rzdr2\") pod \"40ef7874-90a3-41ea-9c22-3725515da6b2\" (UID: \"40ef7874-90a3-41ea-9c22-3725515da6b2\") "
Jul 20 13:40:34.328013 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:40:34.327852    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/40ef7874-90a3-41ea-9c22-3725515da6b2-openshift-service-ca\") pod \"40ef7874-90a3-41ea-9c22-3725515da6b2\" (UID: \"40ef7874-90a3-41ea-9c22-3725515da6b2\") "
Jul 20 13:40:34.328271 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:40:34.328239    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/40ef7874-90a3-41ea-9c22-3725515da6b2-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "40ef7874-90a3-41ea-9c22-3725515da6b2" (UID: "40ef7874-90a3-41ea-9c22-3725515da6b2"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 13:40:34.329984 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:40:34.329942    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/40ef7874-90a3-41ea-9c22-3725515da6b2-kube-api-access-rzdr2" (OuterVolumeSpecName: "kube-api-access-rzdr2") pod "40ef7874-90a3-41ea-9c22-3725515da6b2" (UID: "40ef7874-90a3-41ea-9c22-3725515da6b2"). InnerVolumeSpecName "kube-api-access-rzdr2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 13:40:34.330071 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:40:34.330001    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/40ef7874-90a3-41ea-9c22-3725515da6b2-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "40ef7874-90a3-41ea-9c22-3725515da6b2" (UID: "40ef7874-90a3-41ea-9c22-3725515da6b2"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 13:40:34.429214 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:40:34.429174    2584 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/40ef7874-90a3-41ea-9c22-3725515da6b2-maas-api-tls\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 20 13:40:34.429214 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:40:34.429207    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rzdr2\" (UniqueName: \"kubernetes.io/projected/40ef7874-90a3-41ea-9c22-3725515da6b2-kube-api-access-rzdr2\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 20 13:40:34.429214 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:40:34.429220    2584 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/40ef7874-90a3-41ea-9c22-3725515da6b2-openshift-service-ca\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 20 13:40:35.009743 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:40:35.009696    2584 generic.go:356] "Generic (PLEG): container finished" podID="40ef7874-90a3-41ea-9c22-3725515da6b2" containerID="7652a04216d15e60b64e0e9ada3ca3859f82968e90cfb0b421277ce5c43f1606" exitCode=0
Jul 20 13:40:35.009743 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:40:35.009747    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-fc9057-bddf5dcbc-2mmfn"
Jul 20 13:40:35.010287 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:40:35.009758    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-fc9057-bddf5dcbc-2mmfn" event={"ID":"40ef7874-90a3-41ea-9c22-3725515da6b2","Type":"ContainerDied","Data":"7652a04216d15e60b64e0e9ada3ca3859f82968e90cfb0b421277ce5c43f1606"}
Jul 20 13:40:35.010287 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:40:35.009803    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-fc9057-bddf5dcbc-2mmfn" event={"ID":"40ef7874-90a3-41ea-9c22-3725515da6b2","Type":"ContainerDied","Data":"dca71b00e7fc9387403e9c6929495493cfdb21b2a1f484dffe02521dc6eaa60f"}
Jul 20 13:40:35.010287 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:40:35.009824    2584 scope.go:117] "RemoveContainer" containerID="7652a04216d15e60b64e0e9ada3ca3859f82968e90cfb0b421277ce5c43f1606"
Jul 20 13:40:35.019851 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:40:35.019829    2584 scope.go:117] "RemoveContainer" containerID="7652a04216d15e60b64e0e9ada3ca3859f82968e90cfb0b421277ce5c43f1606"
Jul 20 13:40:35.020148 ip-10-0-134-121 kubenswrapper[2584]: E0720 13:40:35.020128    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7652a04216d15e60b64e0e9ada3ca3859f82968e90cfb0b421277ce5c43f1606\": container with ID starting with 7652a04216d15e60b64e0e9ada3ca3859f82968e90cfb0b421277ce5c43f1606 not found: ID does not exist" containerID="7652a04216d15e60b64e0e9ada3ca3859f82968e90cfb0b421277ce5c43f1606"
Jul 20 13:40:35.020209 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:40:35.020158    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7652a04216d15e60b64e0e9ada3ca3859f82968e90cfb0b421277ce5c43f1606"} err="failed to get container status \"7652a04216d15e60b64e0e9ada3ca3859f82968e90cfb0b421277ce5c43f1606\": rpc error: code = NotFound desc = could not find container \"7652a04216d15e60b64e0e9ada3ca3859f82968e90cfb0b421277ce5c43f1606\": container with ID starting with 7652a04216d15e60b64e0e9ada3ca3859f82968e90cfb0b421277ce5c43f1606 not found: ID does not exist"
Jul 20 13:40:35.034787 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:40:35.034712    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-fc9057-bddf5dcbc-2mmfn"]
Jul 20 13:40:35.037413 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:40:35.037390    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-fc9057-bddf5dcbc-2mmfn"]
Jul 20 13:40:35.096389 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:40:35.096355    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="40ef7874-90a3-41ea-9c22-3725515da6b2" path="/var/lib/kubelet/pods/40ef7874-90a3-41ea-9c22-3725515da6b2/volumes"
Jul 20 13:40:49.157928 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:40:49.157848    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-fc9057-openshift-default-7c5cf5bfb7-sjh4s"]
Jul 20 13:40:49.158353 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:40:49.158115    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-fc9057-openshift-default-7c5cf5bfb7-sjh4s" podUID="b29e9121-1dfc-4c76-a336-38cac493823a" containerName="istio-proxy" containerID="cri-o://16a91bf5449f4ebf906b83e1ac27d51668db579ce94fa45f7769c5e12b3f2e24" gracePeriod=30
Jul 20 13:40:50.120298 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:40:50.120263    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-15a544-openshift-default-77778bf5c5-nwfdr"]
Jul 20 13:40:50.120731 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:40:50.120717    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="40ef7874-90a3-41ea-9c22-3725515da6b2" containerName="maas-api"
Jul 20 13:40:50.120731 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:40:50.120732    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="40ef7874-90a3-41ea-9c22-3725515da6b2" containerName="maas-api"
Jul 20 13:40:50.120853 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:40:50.120752    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ebb5d898-02f9-4ea8-8c12-43e6df126353" containerName="istio-proxy"
Jul 20 13:40:50.120853 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:40:50.120758    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="ebb5d898-02f9-4ea8-8c12-43e6df126353" containerName="istio-proxy"
Jul 20 13:40:50.120853 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:40:50.120764    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="69d39865-95c9-4462-9826-329fcc9aff50" containerName="maas-api"
Jul 20 13:40:50.120853 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:40:50.120770    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="69d39865-95c9-4462-9826-329fcc9aff50" containerName="maas-api"
Jul 20 13:40:50.120853 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:40:50.120783    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ebb5d898-02f9-4ea8-8c12-43e6df126353" containerName="istio-proxy"
Jul 20 13:40:50.120853 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:40:50.120789    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="ebb5d898-02f9-4ea8-8c12-43e6df126353" containerName="istio-proxy"
Jul 20 13:40:50.121043 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:40:50.120886    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="ebb5d898-02f9-4ea8-8c12-43e6df126353" containerName="istio-proxy"
Jul 20 13:40:50.121043 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:40:50.120896    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="69d39865-95c9-4462-9826-329fcc9aff50" containerName="maas-api"
Jul 20 13:40:50.121043 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:40:50.120909    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="40ef7874-90a3-41ea-9c22-3725515da6b2" containerName="maas-api"
Jul 20 13:40:50.125647 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:40:50.125618    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-15a544-openshift-default-77778bf5c5-nwfdr"
Jul 20 13:40:50.128372 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:40:50.128343    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-15a544-openshift-default-dockercfg-sb6t2\""
Jul 20 13:40:50.140356 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:40:50.139695    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-15a544-openshift-default-77778bf5c5-nwfdr"]
Jul 20 13:40:50.292474 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:40:50.292430    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/226617a4-9da0-4305-9435-2d94524bdb24-istiod-ca-cert\") pod \"e2e-api-a-15a544-openshift-default-77778bf5c5-nwfdr\" (UID: \"226617a4-9da0-4305-9435-2d94524bdb24\") " pod="openshift-ingress/e2e-api-a-15a544-openshift-default-77778bf5c5-nwfdr"
Jul 20 13:40:50.292474 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:40:50.292470    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/226617a4-9da0-4305-9435-2d94524bdb24-istio-envoy\") pod \"e2e-api-a-15a544-openshift-default-77778bf5c5-nwfdr\" (UID: \"226617a4-9da0-4305-9435-2d94524bdb24\") " pod="openshift-ingress/e2e-api-a-15a544-openshift-default-77778bf5c5-nwfdr"
Jul 20 13:40:50.292956 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:40:50.292494    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/226617a4-9da0-4305-9435-2d94524bdb24-istio-data\") pod \"e2e-api-a-15a544-openshift-default-77778bf5c5-nwfdr\" (UID: \"226617a4-9da0-4305-9435-2d94524bdb24\") " pod="openshift-ingress/e2e-api-a-15a544-openshift-default-77778bf5c5-nwfdr"
Jul 20 13:40:50.292956 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:40:50.292520    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/226617a4-9da0-4305-9435-2d94524bdb24-istio-token\") pod \"e2e-api-a-15a544-openshift-default-77778bf5c5-nwfdr\" (UID: \"226617a4-9da0-4305-9435-2d94524bdb24\") " pod="openshift-ingress/e2e-api-a-15a544-openshift-default-77778bf5c5-nwfdr"
Jul 20 13:40:50.292956 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:40:50.292543    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/226617a4-9da0-4305-9435-2d94524bdb24-workload-certs\") pod \"e2e-api-a-15a544-openshift-default-77778bf5c5-nwfdr\" (UID: \"226617a4-9da0-4305-9435-2d94524bdb24\") " pod="openshift-ingress/e2e-api-a-15a544-openshift-default-77778bf5c5-nwfdr"
Jul 20 13:40:50.292956 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:40:50.292566    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/226617a4-9da0-4305-9435-2d94524bdb24-istio-podinfo\") pod \"e2e-api-a-15a544-openshift-default-77778bf5c5-nwfdr\" (UID: \"226617a4-9da0-4305-9435-2d94524bdb24\") " pod="openshift-ingress/e2e-api-a-15a544-openshift-default-77778bf5c5-nwfdr"
Jul 20 13:40:50.292956 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:40:50.292630    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vhqc6\" (UniqueName: \"kubernetes.io/projected/226617a4-9da0-4305-9435-2d94524bdb24-kube-api-access-vhqc6\") pod \"e2e-api-a-15a544-openshift-default-77778bf5c5-nwfdr\" (UID: \"226617a4-9da0-4305-9435-2d94524bdb24\") " pod="openshift-ingress/e2e-api-a-15a544-openshift-default-77778bf5c5-nwfdr"
Jul 20 13:40:50.292956 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:40:50.292667    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/226617a4-9da0-4305-9435-2d94524bdb24-workload-socket\") pod \"e2e-api-a-15a544-openshift-default-77778bf5c5-nwfdr\" (UID: \"226617a4-9da0-4305-9435-2d94524bdb24\") " pod="openshift-ingress/e2e-api-a-15a544-openshift-default-77778bf5c5-nwfdr"
Jul 20 13:40:50.292956 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:40:50.292695    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/226617a4-9da0-4305-9435-2d94524bdb24-credential-socket\") pod \"e2e-api-a-15a544-openshift-default-77778bf5c5-nwfdr\" (UID: \"226617a4-9da0-4305-9435-2d94524bdb24\") " pod="openshift-ingress/e2e-api-a-15a544-openshift-default-77778bf5c5-nwfdr"
Jul 20 13:40:50.393544 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:40:50.393449    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/226617a4-9da0-4305-9435-2d94524bdb24-istiod-ca-cert\") pod \"e2e-api-a-15a544-openshift-default-77778bf5c5-nwfdr\" (UID: \"226617a4-9da0-4305-9435-2d94524bdb24\") " pod="openshift-ingress/e2e-api-a-15a544-openshift-default-77778bf5c5-nwfdr"
Jul 20 13:40:50.393544 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:40:50.393491    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/226617a4-9da0-4305-9435-2d94524bdb24-istio-envoy\") pod \"e2e-api-a-15a544-openshift-default-77778bf5c5-nwfdr\" (UID: \"226617a4-9da0-4305-9435-2d94524bdb24\") " pod="openshift-ingress/e2e-api-a-15a544-openshift-default-77778bf5c5-nwfdr"
Jul 20 13:40:50.393544 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:40:50.393512    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/226617a4-9da0-4305-9435-2d94524bdb24-istio-data\") pod \"e2e-api-a-15a544-openshift-default-77778bf5c5-nwfdr\" (UID: \"226617a4-9da0-4305-9435-2d94524bdb24\") " pod="openshift-ingress/e2e-api-a-15a544-openshift-default-77778bf5c5-nwfdr"
Jul 20 13:40:50.393544 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:40:50.393531    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/226617a4-9da0-4305-9435-2d94524bdb24-istio-token\") pod \"e2e-api-a-15a544-openshift-default-77778bf5c5-nwfdr\" (UID: \"226617a4-9da0-4305-9435-2d94524bdb24\") " pod="openshift-ingress/e2e-api-a-15a544-openshift-default-77778bf5c5-nwfdr"
Jul 20 13:40:50.393876 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:40:50.393555    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/226617a4-9da0-4305-9435-2d94524bdb24-workload-certs\") pod \"e2e-api-a-15a544-openshift-default-77778bf5c5-nwfdr\" (UID: \"226617a4-9da0-4305-9435-2d94524bdb24\") " pod="openshift-ingress/e2e-api-a-15a544-openshift-default-77778bf5c5-nwfdr"
Jul 20 13:40:50.393876 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:40:50.393580    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/226617a4-9da0-4305-9435-2d94524bdb24-istio-podinfo\") pod \"e2e-api-a-15a544-openshift-default-77778bf5c5-nwfdr\" (UID: \"226617a4-9da0-4305-9435-2d94524bdb24\") " pod="openshift-ingress/e2e-api-a-15a544-openshift-default-77778bf5c5-nwfdr"
Jul 20 13:40:50.393876 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:40:50.393637    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vhqc6\" (UniqueName: \"kubernetes.io/projected/226617a4-9da0-4305-9435-2d94524bdb24-kube-api-access-vhqc6\") pod \"e2e-api-a-15a544-openshift-default-77778bf5c5-nwfdr\" (UID: \"226617a4-9da0-4305-9435-2d94524bdb24\") " pod="openshift-ingress/e2e-api-a-15a544-openshift-default-77778bf5c5-nwfdr"
Jul 20 13:40:50.393876 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:40:50.393694    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/226617a4-9da0-4305-9435-2d94524bdb24-workload-socket\") pod \"e2e-api-a-15a544-openshift-default-77778bf5c5-nwfdr\" (UID: \"226617a4-9da0-4305-9435-2d94524bdb24\") " pod="openshift-ingress/e2e-api-a-15a544-openshift-default-77778bf5c5-nwfdr"
Jul 20 13:40:50.393876 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:40:50.393748    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/226617a4-9da0-4305-9435-2d94524bdb24-credential-socket\") pod \"e2e-api-a-15a544-openshift-default-77778bf5c5-nwfdr\" (UID: \"226617a4-9da0-4305-9435-2d94524bdb24\") " pod="openshift-ingress/e2e-api-a-15a544-openshift-default-77778bf5c5-nwfdr"
Jul 20 13:40:50.394173 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:40:50.394068    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/226617a4-9da0-4305-9435-2d94524bdb24-workload-certs\") pod \"e2e-api-a-15a544-openshift-default-77778bf5c5-nwfdr\" (UID: \"226617a4-9da0-4305-9435-2d94524bdb24\") " pod="openshift-ingress/e2e-api-a-15a544-openshift-default-77778bf5c5-nwfdr"
Jul 20 13:40:50.394173 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:40:50.394141    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/226617a4-9da0-4305-9435-2d94524bdb24-credential-socket\") pod \"e2e-api-a-15a544-openshift-default-77778bf5c5-nwfdr\" (UID: \"226617a4-9da0-4305-9435-2d94524bdb24\") " pod="openshift-ingress/e2e-api-a-15a544-openshift-default-77778bf5c5-nwfdr"
Jul 20 13:40:50.394287 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:40:50.394224    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/226617a4-9da0-4305-9435-2d94524bdb24-workload-socket\") pod \"e2e-api-a-15a544-openshift-default-77778bf5c5-nwfdr\" (UID: \"226617a4-9da0-4305-9435-2d94524bdb24\") " pod="openshift-ingress/e2e-api-a-15a544-openshift-default-77778bf5c5-nwfdr"
Jul 20 13:40:50.394287 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:40:50.394223    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/226617a4-9da0-4305-9435-2d94524bdb24-istio-data\") pod \"e2e-api-a-15a544-openshift-default-77778bf5c5-nwfdr\" (UID: \"226617a4-9da0-4305-9435-2d94524bdb24\") " pod="openshift-ingress/e2e-api-a-15a544-openshift-default-77778bf5c5-nwfdr"
Jul 20 13:40:50.394388 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:40:50.394329    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/226617a4-9da0-4305-9435-2d94524bdb24-istiod-ca-cert\") pod \"e2e-api-a-15a544-openshift-default-77778bf5c5-nwfdr\" (UID: \"226617a4-9da0-4305-9435-2d94524bdb24\") " pod="openshift-ingress/e2e-api-a-15a544-openshift-default-77778bf5c5-nwfdr"
Jul 20 13:40:50.395770 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:40:50.395748    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/226617a4-9da0-4305-9435-2d94524bdb24-istio-envoy\") pod \"e2e-api-a-15a544-openshift-default-77778bf5c5-nwfdr\" (UID: \"226617a4-9da0-4305-9435-2d94524bdb24\") " pod="openshift-ingress/e2e-api-a-15a544-openshift-default-77778bf5c5-nwfdr"
Jul 20 13:40:50.396199 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:40:50.396177    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/226617a4-9da0-4305-9435-2d94524bdb24-istio-podinfo\") pod \"e2e-api-a-15a544-openshift-default-77778bf5c5-nwfdr\" (UID: \"226617a4-9da0-4305-9435-2d94524bdb24\") " pod="openshift-ingress/e2e-api-a-15a544-openshift-default-77778bf5c5-nwfdr"
Jul 20 13:40:50.402202 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:40:50.402179    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vhqc6\" (UniqueName: \"kubernetes.io/projected/226617a4-9da0-4305-9435-2d94524bdb24-kube-api-access-vhqc6\") pod \"e2e-api-a-15a544-openshift-default-77778bf5c5-nwfdr\" (UID: \"226617a4-9da0-4305-9435-2d94524bdb24\") " pod="openshift-ingress/e2e-api-a-15a544-openshift-default-77778bf5c5-nwfdr"
Jul 20 13:40:50.402287 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:40:50.402179    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/226617a4-9da0-4305-9435-2d94524bdb24-istio-token\") pod \"e2e-api-a-15a544-openshift-default-77778bf5c5-nwfdr\" (UID: \"226617a4-9da0-4305-9435-2d94524bdb24\") " pod="openshift-ingress/e2e-api-a-15a544-openshift-default-77778bf5c5-nwfdr"
Jul 20 13:40:50.441528 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:40:50.441485    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-15a544-openshift-default-77778bf5c5-nwfdr"
Jul 20 13:40:50.591953 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:40:50.591789    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-15a544-openshift-default-77778bf5c5-nwfdr"]
Jul 20 13:40:50.594921 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:40:50.594879    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod226617a4_9da0_4305_9435_2d94524bdb24.slice/crio-0a9ae9e6c235b8b968cb094e38fd96c2612f8a032ba15da57980c97ef5058a61 WatchSource:0}: Error finding container 0a9ae9e6c235b8b968cb094e38fd96c2612f8a032ba15da57980c97ef5058a61: Status 404 returned error can't find the container with id 0a9ae9e6c235b8b968cb094e38fd96c2612f8a032ba15da57980c97ef5058a61
Jul 20 13:40:50.597033 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:40:50.596995    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 20 13:40:50.597127 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:40:50.597069    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 20 13:40:50.597127 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:40:50.597098    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 20 13:40:51.097272 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:40:51.097239    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-15a544-openshift-default-77778bf5c5-nwfdr" event={"ID":"226617a4-9da0-4305-9435-2d94524bdb24","Type":"ContainerStarted","Data":"9c4d871d0f9ec9c33974259fb30c2644ead477835ae639bf3342d72c7d3372f0"}
Jul 20 13:40:51.097479 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:40:51.097299    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-15a544-openshift-default-77778bf5c5-nwfdr" event={"ID":"226617a4-9da0-4305-9435-2d94524bdb24","Type":"ContainerStarted","Data":"0a9ae9e6c235b8b968cb094e38fd96c2612f8a032ba15da57980c97ef5058a61"}
Jul 20 13:40:51.117867 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:40:51.117801    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-15a544-openshift-default-77778bf5c5-nwfdr" podStartSLOduration=1.117777917 podStartE2EDuration="1.117777917s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 13:40:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 13:40:51.116194553 +0000 UTC m=+2340.832741992" watchObservedRunningTime="2026-07-20 13:40:51.117777917 +0000 UTC m=+2340.834325329"
Jul 20 13:40:51.122336 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:40:51.122308    2584 scope.go:117] "RemoveContainer" containerID="8bdbd50d68d971b8c26199e8d02d7baa35d11908851668878e7f9bb3a0e1f84c"
Jul 20 13:40:51.442007 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:40:51.441899    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-15a544-openshift-default-77778bf5c5-nwfdr"
Jul 20 13:40:51.446975 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:40:51.446934    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-15a544-openshift-default-77778bf5c5-nwfdr"
Jul 20 13:40:52.102263 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:40:52.102233    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-15a544-openshift-default-77778bf5c5-nwfdr"
Jul 20 13:40:52.103383 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:40:52.103364    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-15a544-openshift-default-77778bf5c5-nwfdr"
Jul 20 13:40:53.198582 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:40:53.198540    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-15a544-868cc6f867-rq8bd"]
Jul 20 13:40:53.199496 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:40:53.199472    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="ebb5d898-02f9-4ea8-8c12-43e6df126353" containerName="istio-proxy"
Jul 20 13:40:53.204831 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:40:53.204805    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-15a544-868cc6f867-rq8bd"
Jul 20 13:40:53.207050 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:40:53.207026    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-vf2sw\""
Jul 20 13:40:53.207163 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:40:53.207055    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-a-15a544-serving-cert\""
Jul 20 13:40:53.211077 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:40:53.211031    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-15a544-868cc6f867-rq8bd"]
Jul 20 13:40:53.221770 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:40:53.221728    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e781df20-4898-4bb7-8f5b-d11a128c7cb4-openshift-service-ca\") pod \"maas-api-e2e-api-a-15a544-868cc6f867-rq8bd\" (UID: \"e781df20-4898-4bb7-8f5b-d11a128c7cb4\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-15a544-868cc6f867-rq8bd"
Jul 20 13:40:53.221942 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:40:53.221858    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e781df20-4898-4bb7-8f5b-d11a128c7cb4-maas-api-tls\") pod \"maas-api-e2e-api-a-15a544-868cc6f867-rq8bd\" (UID: \"e781df20-4898-4bb7-8f5b-d11a128c7cb4\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-15a544-868cc6f867-rq8bd"
Jul 20 13:40:53.221942 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:40:53.221890    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mb275\" (UniqueName: \"kubernetes.io/projected/e781df20-4898-4bb7-8f5b-d11a128c7cb4-kube-api-access-mb275\") pod \"maas-api-e2e-api-a-15a544-868cc6f867-rq8bd\" (UID: \"e781df20-4898-4bb7-8f5b-d11a128c7cb4\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-15a544-868cc6f867-rq8bd"
Jul 20 13:40:53.323648 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:40:53.323611    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e781df20-4898-4bb7-8f5b-d11a128c7cb4-openshift-service-ca\") pod \"maas-api-e2e-api-a-15a544-868cc6f867-rq8bd\" (UID: \"e781df20-4898-4bb7-8f5b-d11a128c7cb4\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-15a544-868cc6f867-rq8bd"
Jul 20 13:40:53.324432 ip-10-0-134-121 kubenswrapper[2584]: E0720 13:40:53.324085    2584 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-api-a-15a544-serving-cert: secret "maas-api-e2e-api-a-15a544-serving-cert" not found
Jul 20 13:40:53.324432 ip-10-0-134-121 kubenswrapper[2584]: E0720 13:40:53.324179    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e781df20-4898-4bb7-8f5b-d11a128c7cb4-maas-api-tls podName:e781df20-4898-4bb7-8f5b-d11a128c7cb4 nodeName:}" failed. No retries permitted until 2026-07-20 13:40:53.824153641 +0000 UTC m=+2343.540701033 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/e781df20-4898-4bb7-8f5b-d11a128c7cb4-maas-api-tls") pod "maas-api-e2e-api-a-15a544-868cc6f867-rq8bd" (UID: "e781df20-4898-4bb7-8f5b-d11a128c7cb4") : secret "maas-api-e2e-api-a-15a544-serving-cert" not found
Jul 20 13:40:53.324611 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:40:53.324560    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e781df20-4898-4bb7-8f5b-d11a128c7cb4-maas-api-tls\") pod \"maas-api-e2e-api-a-15a544-868cc6f867-rq8bd\" (UID: \"e781df20-4898-4bb7-8f5b-d11a128c7cb4\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-15a544-868cc6f867-rq8bd"
Jul 20 13:40:53.324706 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:40:53.324633    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mb275\" (UniqueName: \"kubernetes.io/projected/e781df20-4898-4bb7-8f5b-d11a128c7cb4-kube-api-access-mb275\") pod \"maas-api-e2e-api-a-15a544-868cc6f867-rq8bd\" (UID: \"e781df20-4898-4bb7-8f5b-d11a128c7cb4\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-15a544-868cc6f867-rq8bd"
Jul 20 13:40:53.324870 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:40:53.324816    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e781df20-4898-4bb7-8f5b-d11a128c7cb4-openshift-service-ca\") pod \"maas-api-e2e-api-a-15a544-868cc6f867-rq8bd\" (UID: \"e781df20-4898-4bb7-8f5b-d11a128c7cb4\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-15a544-868cc6f867-rq8bd"
Jul 20 13:40:53.333886 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:40:53.333857    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mb275\" (UniqueName: \"kubernetes.io/projected/e781df20-4898-4bb7-8f5b-d11a128c7cb4-kube-api-access-mb275\") pod \"maas-api-e2e-api-a-15a544-868cc6f867-rq8bd\" (UID: \"e781df20-4898-4bb7-8f5b-d11a128c7cb4\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-15a544-868cc6f867-rq8bd"
Jul 20 13:40:53.830511 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:40:53.830467    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e781df20-4898-4bb7-8f5b-d11a128c7cb4-maas-api-tls\") pod \"maas-api-e2e-api-a-15a544-868cc6f867-rq8bd\" (UID: \"e781df20-4898-4bb7-8f5b-d11a128c7cb4\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-15a544-868cc6f867-rq8bd"
Jul 20 13:40:53.833141 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:40:53.833103    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e781df20-4898-4bb7-8f5b-d11a128c7cb4-maas-api-tls\") pod \"maas-api-e2e-api-a-15a544-868cc6f867-rq8bd\" (UID: \"e781df20-4898-4bb7-8f5b-d11a128c7cb4\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-15a544-868cc6f867-rq8bd"
Jul 20 13:40:54.121599 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:40:54.121484    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-15a544-868cc6f867-rq8bd"
Jul 20 13:40:54.303349 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:40:54.303322    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-15a544-868cc6f867-rq8bd"]
Jul 20 13:40:54.306062 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:40:54.306030    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode781df20_4898_4bb7_8f5b_d11a128c7cb4.slice/crio-7c49d2cbde4a5593de3cd4310db4147ead5b4485febc22713f603efc6f163713 WatchSource:0}: Error finding container 7c49d2cbde4a5593de3cd4310db4147ead5b4485febc22713f603efc6f163713: Status 404 returned error can't find the container with id 7c49d2cbde4a5593de3cd4310db4147ead5b4485febc22713f603efc6f163713
Jul 20 13:40:54.307527 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:40:54.307509    2584 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 20 13:40:54.429054 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:40:54.429019    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-fc9057-openshift-default-7c5cf5bfb7-sjh4s"
Jul 20 13:40:54.437341 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:40:54.437310    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b29e9121-1dfc-4c76-a336-38cac493823a-credential-socket\") pod \"b29e9121-1dfc-4c76-a336-38cac493823a\" (UID: \"b29e9121-1dfc-4c76-a336-38cac493823a\") "
Jul 20 13:40:54.437533 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:40:54.437362    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b29e9121-1dfc-4c76-a336-38cac493823a-istiod-ca-cert\") pod \"b29e9121-1dfc-4c76-a336-38cac493823a\" (UID: \"b29e9121-1dfc-4c76-a336-38cac493823a\") "
Jul 20 13:40:54.437533 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:40:54.437389    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b29e9121-1dfc-4c76-a336-38cac493823a-workload-certs\") pod \"b29e9121-1dfc-4c76-a336-38cac493823a\" (UID: \"b29e9121-1dfc-4c76-a336-38cac493823a\") "
Jul 20 13:40:54.437533 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:40:54.437411    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b29e9121-1dfc-4c76-a336-38cac493823a-istio-data\") pod \"b29e9121-1dfc-4c76-a336-38cac493823a\" (UID: \"b29e9121-1dfc-4c76-a336-38cac493823a\") "
Jul 20 13:40:54.437533 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:40:54.437443    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b29e9121-1dfc-4c76-a336-38cac493823a-istio-envoy\") pod \"b29e9121-1dfc-4c76-a336-38cac493823a\" (UID: \"b29e9121-1dfc-4c76-a336-38cac493823a\") "
Jul 20 13:40:54.437533 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:40:54.437468    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b29e9121-1dfc-4c76-a336-38cac493823a-istio-token\") pod \"b29e9121-1dfc-4c76-a336-38cac493823a\" (UID: \"b29e9121-1dfc-4c76-a336-38cac493823a\") "
Jul 20 13:40:54.437533 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:40:54.437516    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b29e9121-1dfc-4c76-a336-38cac493823a-workload-socket\") pod \"b29e9121-1dfc-4c76-a336-38cac493823a\" (UID: \"b29e9121-1dfc-4c76-a336-38cac493823a\") "
Jul 20 13:40:54.437844 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:40:54.437545    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kdmwd\" (UniqueName: \"kubernetes.io/projected/b29e9121-1dfc-4c76-a336-38cac493823a-kube-api-access-kdmwd\") pod \"b29e9121-1dfc-4c76-a336-38cac493823a\" (UID: \"b29e9121-1dfc-4c76-a336-38cac493823a\") "
Jul 20 13:40:54.437844 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:40:54.437576    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b29e9121-1dfc-4c76-a336-38cac493823a-istio-podinfo\") pod \"b29e9121-1dfc-4c76-a336-38cac493823a\" (UID: \"b29e9121-1dfc-4c76-a336-38cac493823a\") "
Jul 20 13:40:54.437844 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:40:54.437628    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b29e9121-1dfc-4c76-a336-38cac493823a-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "b29e9121-1dfc-4c76-a336-38cac493823a" (UID: "b29e9121-1dfc-4c76-a336-38cac493823a"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 13:40:54.437844 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:40:54.437743    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b29e9121-1dfc-4c76-a336-38cac493823a-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "b29e9121-1dfc-4c76-a336-38cac493823a" (UID: "b29e9121-1dfc-4c76-a336-38cac493823a"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 13:40:54.438078 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:40:54.437954    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b29e9121-1dfc-4c76-a336-38cac493823a-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "b29e9121-1dfc-4c76-a336-38cac493823a" (UID: "b29e9121-1dfc-4c76-a336-38cac493823a"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 13:40:54.438078 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:40:54.438021    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b29e9121-1dfc-4c76-a336-38cac493823a-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "b29e9121-1dfc-4c76-a336-38cac493823a" (UID: "b29e9121-1dfc-4c76-a336-38cac493823a"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 13:40:54.438158 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:40:54.438123    2584 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b29e9121-1dfc-4c76-a336-38cac493823a-credential-socket\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 20 13:40:54.438158 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:40:54.438140    2584 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b29e9121-1dfc-4c76-a336-38cac493823a-istiod-ca-cert\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 20 13:40:54.438158 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:40:54.438153    2584 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b29e9121-1dfc-4c76-a336-38cac493823a-workload-certs\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 20 13:40:54.438317 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:40:54.438165    2584 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b29e9121-1dfc-4c76-a336-38cac493823a-workload-socket\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 20 13:40:54.438372 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:40:54.438313    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b29e9121-1dfc-4c76-a336-38cac493823a-istio-data" (OuterVolumeSpecName: "istio-data") pod "b29e9121-1dfc-4c76-a336-38cac493823a" (UID: "b29e9121-1dfc-4c76-a336-38cac493823a"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 13:40:54.439882 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:40:54.439852    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b29e9121-1dfc-4c76-a336-38cac493823a-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "b29e9121-1dfc-4c76-a336-38cac493823a" (UID: "b29e9121-1dfc-4c76-a336-38cac493823a"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 13:40:54.440041 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:40:54.439939    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b29e9121-1dfc-4c76-a336-38cac493823a-kube-api-access-kdmwd" (OuterVolumeSpecName: "kube-api-access-kdmwd") pod "b29e9121-1dfc-4c76-a336-38cac493823a" (UID: "b29e9121-1dfc-4c76-a336-38cac493823a"). InnerVolumeSpecName "kube-api-access-kdmwd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 13:40:54.440307 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:40:54.440281    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/b29e9121-1dfc-4c76-a336-38cac493823a-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "b29e9121-1dfc-4c76-a336-38cac493823a" (UID: "b29e9121-1dfc-4c76-a336-38cac493823a"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 20 13:40:54.440473 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:40:54.440309    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b29e9121-1dfc-4c76-a336-38cac493823a-istio-token" (OuterVolumeSpecName: "istio-token") pod "b29e9121-1dfc-4c76-a336-38cac493823a" (UID: "b29e9121-1dfc-4c76-a336-38cac493823a"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 13:40:54.539696 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:40:54.539651    2584 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b29e9121-1dfc-4c76-a336-38cac493823a-istio-data\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 20 13:40:54.539696 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:40:54.539686    2584 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b29e9121-1dfc-4c76-a336-38cac493823a-istio-envoy\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 20 13:40:54.539696 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:40:54.539695    2584 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b29e9121-1dfc-4c76-a336-38cac493823a-istio-token\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 20 13:40:54.539696 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:40:54.539704    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kdmwd\" (UniqueName: \"kubernetes.io/projected/b29e9121-1dfc-4c76-a336-38cac493823a-kube-api-access-kdmwd\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 20 13:40:54.540020 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:40:54.539716    2584 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b29e9121-1dfc-4c76-a336-38cac493823a-istio-podinfo\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 20 13:40:55.128885 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:40:55.128850    2584 generic.go:356] "Generic (PLEG): container finished" podID="b29e9121-1dfc-4c76-a336-38cac493823a" containerID="16a91bf5449f4ebf906b83e1ac27d51668db579ce94fa45f7769c5e12b3f2e24" exitCode=0
Jul 20 13:40:55.129111 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:40:55.128908    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-fc9057-openshift-default-7c5cf5bfb7-sjh4s"
Jul 20 13:40:55.129111 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:40:55.128955    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-fc9057-openshift-default-7c5cf5bfb7-sjh4s" event={"ID":"b29e9121-1dfc-4c76-a336-38cac493823a","Type":"ContainerDied","Data":"16a91bf5449f4ebf906b83e1ac27d51668db579ce94fa45f7769c5e12b3f2e24"}
Jul 20 13:40:55.129111 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:40:55.129028    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-fc9057-openshift-default-7c5cf5bfb7-sjh4s" event={"ID":"b29e9121-1dfc-4c76-a336-38cac493823a","Type":"ContainerDied","Data":"e91aed3b22134fec1e1ee2e7d7c5d95d8335038209a86687124ec0e4ffe4c294"}
Jul 20 13:40:55.129111 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:40:55.129063    2584 scope.go:117] "RemoveContainer" containerID="16a91bf5449f4ebf906b83e1ac27d51668db579ce94fa45f7769c5e12b3f2e24"
Jul 20 13:40:55.131080 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:40:55.130942    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-15a544-868cc6f867-rq8bd" event={"ID":"e781df20-4898-4bb7-8f5b-d11a128c7cb4","Type":"ContainerStarted","Data":"3a8ce2e4d2a0011933331340d789ed99c84b92c467a1a587f28cbcea3d4d0f60"}
Jul 20 13:40:55.131080 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:40:55.131021    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-15a544-868cc6f867-rq8bd"
Jul 20 13:40:55.131080 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:40:55.131046    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-15a544-868cc6f867-rq8bd" event={"ID":"e781df20-4898-4bb7-8f5b-d11a128c7cb4","Type":"ContainerStarted","Data":"7c49d2cbde4a5593de3cd4310db4147ead5b4485febc22713f603efc6f163713"}
Jul 20 13:40:55.141089 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:40:55.141067    2584 scope.go:117] "RemoveContainer" containerID="2a0a3807aa53f1847a5c8a999afb8a1dd919c893e62c898f931b8dc5ae0cb4bb"
Jul 20 13:40:55.146390 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:40:55.146362    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-fc9057-openshift-default-7c5cf5bfb7-sjh4s"]
Jul 20 13:40:55.150527 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:40:55.150497    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-fc9057-openshift-default-7c5cf5bfb7-sjh4s"]
Jul 20 13:40:55.151638 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:40:55.151616    2584 scope.go:117] "RemoveContainer" containerID="16a91bf5449f4ebf906b83e1ac27d51668db579ce94fa45f7769c5e12b3f2e24"
Jul 20 13:40:55.151959 ip-10-0-134-121 kubenswrapper[2584]: E0720 13:40:55.151936    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"16a91bf5449f4ebf906b83e1ac27d51668db579ce94fa45f7769c5e12b3f2e24\": container with ID starting with 16a91bf5449f4ebf906b83e1ac27d51668db579ce94fa45f7769c5e12b3f2e24 not found: ID does not exist" containerID="16a91bf5449f4ebf906b83e1ac27d51668db579ce94fa45f7769c5e12b3f2e24"
Jul 20 13:40:55.151959 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:40:55.151994    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"16a91bf5449f4ebf906b83e1ac27d51668db579ce94fa45f7769c5e12b3f2e24"} err="failed to get container status \"16a91bf5449f4ebf906b83e1ac27d51668db579ce94fa45f7769c5e12b3f2e24\": rpc error: code = NotFound desc = could not find container \"16a91bf5449f4ebf906b83e1ac27d51668db579ce94fa45f7769c5e12b3f2e24\": container with ID starting with 16a91bf5449f4ebf906b83e1ac27d51668db579ce94fa45f7769c5e12b3f2e24 not found: ID does not exist"
Jul 20 13:40:55.152127 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:40:55.152013    2584 scope.go:117] "RemoveContainer" containerID="2a0a3807aa53f1847a5c8a999afb8a1dd919c893e62c898f931b8dc5ae0cb4bb"
Jul 20 13:40:55.152267 ip-10-0-134-121 kubenswrapper[2584]: E0720 13:40:55.152251    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2a0a3807aa53f1847a5c8a999afb8a1dd919c893e62c898f931b8dc5ae0cb4bb\": container with ID starting with 2a0a3807aa53f1847a5c8a999afb8a1dd919c893e62c898f931b8dc5ae0cb4bb not found: ID does not exist" containerID="2a0a3807aa53f1847a5c8a999afb8a1dd919c893e62c898f931b8dc5ae0cb4bb"
Jul 20 13:40:55.152310 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:40:55.152270    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2a0a3807aa53f1847a5c8a999afb8a1dd919c893e62c898f931b8dc5ae0cb4bb"} err="failed to get container status \"2a0a3807aa53f1847a5c8a999afb8a1dd919c893e62c898f931b8dc5ae0cb4bb\": rpc error: code = NotFound desc = could not find container \"2a0a3807aa53f1847a5c8a999afb8a1dd919c893e62c898f931b8dc5ae0cb4bb\": container with ID starting with 2a0a3807aa53f1847a5c8a999afb8a1dd919c893e62c898f931b8dc5ae0cb4bb not found: ID does not exist"
Jul 20 13:40:55.164120 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:40:55.164070    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-15a544-868cc6f867-rq8bd" podStartSLOduration=1.758190766 podStartE2EDuration="2.164054341s" totalImagesPullingTime="405.863575ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 13:40:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 13:40:55.161415795 +0000 UTC m=+2344.877963207" watchObservedRunningTime="2026-07-20 13:40:55.164054341 +0000 UTC m=+2344.880601751"
Jul 20 13:40:57.096068 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:40:57.096034    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b29e9121-1dfc-4c76-a336-38cac493823a" path="/var/lib/kubelet/pods/b29e9121-1dfc-4c76-a336-38cac493823a/volumes"
Jul 20 13:40:58.492846 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:40:58.492807    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-b738bb-openshift-default-7b6d5fb4df-vvl6f"]
Jul 20 13:40:58.493356 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:40:58.493340    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b29e9121-1dfc-4c76-a336-38cac493823a" containerName="istio-proxy"
Jul 20 13:40:58.493401 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:40:58.493358    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="b29e9121-1dfc-4c76-a336-38cac493823a" containerName="istio-proxy"
Jul 20 13:40:58.493442 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:40:58.493432    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="b29e9121-1dfc-4c76-a336-38cac493823a" containerName="istio-proxy"
Jul 20 13:40:58.493475 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:40:58.493447    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="b29e9121-1dfc-4c76-a336-38cac493823a" containerName="istio-proxy"
Jul 20 13:40:58.496878 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:40:58.496854    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-b738bb-openshift-default-7b6d5fb4df-vvl6f"
Jul 20 13:40:58.499507 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:40:58.499486    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-b738bb-openshift-default-dockercfg-6qt2z\""
Jul 20 13:40:58.508158 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:40:58.508129    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-b738bb-openshift-default-7b6d5fb4df-vvl6f"]
Jul 20 13:40:58.582223 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:40:58.582164    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e8477791-6b58-46a7-b5f4-39b8ca759919-istio-data\") pod \"e2e-api-b-b738bb-openshift-default-7b6d5fb4df-vvl6f\" (UID: \"e8477791-6b58-46a7-b5f4-39b8ca759919\") " pod="openshift-ingress/e2e-api-b-b738bb-openshift-default-7b6d5fb4df-vvl6f"
Jul 20 13:40:58.582561 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:40:58.582251    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e8477791-6b58-46a7-b5f4-39b8ca759919-istiod-ca-cert\") pod \"e2e-api-b-b738bb-openshift-default-7b6d5fb4df-vvl6f\" (UID: \"e8477791-6b58-46a7-b5f4-39b8ca759919\") " pod="openshift-ingress/e2e-api-b-b738bb-openshift-default-7b6d5fb4df-vvl6f"
Jul 20 13:40:58.582679 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:40:58.582649    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9fdqc\" (UniqueName: \"kubernetes.io/projected/e8477791-6b58-46a7-b5f4-39b8ca759919-kube-api-access-9fdqc\") pod \"e2e-api-b-b738bb-openshift-default-7b6d5fb4df-vvl6f\" (UID: \"e8477791-6b58-46a7-b5f4-39b8ca759919\") " pod="openshift-ingress/e2e-api-b-b738bb-openshift-default-7b6d5fb4df-vvl6f"
Jul 20 13:40:58.582734 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:40:58.582704    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e8477791-6b58-46a7-b5f4-39b8ca759919-workload-socket\") pod \"e2e-api-b-b738bb-openshift-default-7b6d5fb4df-vvl6f\" (UID: \"e8477791-6b58-46a7-b5f4-39b8ca759919\") " pod="openshift-ingress/e2e-api-b-b738bb-openshift-default-7b6d5fb4df-vvl6f"
Jul 20 13:40:58.582811 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:40:58.582789    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e8477791-6b58-46a7-b5f4-39b8ca759919-credential-socket\") pod \"e2e-api-b-b738bb-openshift-default-7b6d5fb4df-vvl6f\" (UID: \"e8477791-6b58-46a7-b5f4-39b8ca759919\") " pod="openshift-ingress/e2e-api-b-b738bb-openshift-default-7b6d5fb4df-vvl6f"
Jul 20 13:40:58.582859 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:40:58.582826    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e8477791-6b58-46a7-b5f4-39b8ca759919-istio-token\") pod \"e2e-api-b-b738bb-openshift-default-7b6d5fb4df-vvl6f\" (UID: \"e8477791-6b58-46a7-b5f4-39b8ca759919\") " pod="openshift-ingress/e2e-api-b-b738bb-openshift-default-7b6d5fb4df-vvl6f"
Jul 20 13:40:58.582941 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:40:58.582927    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e8477791-6b58-46a7-b5f4-39b8ca759919-istio-podinfo\") pod \"e2e-api-b-b738bb-openshift-default-7b6d5fb4df-vvl6f\" (UID: \"e8477791-6b58-46a7-b5f4-39b8ca759919\") " pod="openshift-ingress/e2e-api-b-b738bb-openshift-default-7b6d5fb4df-vvl6f"
Jul 20 13:40:58.583001 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:40:58.582959    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e8477791-6b58-46a7-b5f4-39b8ca759919-istio-envoy\") pod \"e2e-api-b-b738bb-openshift-default-7b6d5fb4df-vvl6f\" (UID: \"e8477791-6b58-46a7-b5f4-39b8ca759919\") " pod="openshift-ingress/e2e-api-b-b738bb-openshift-default-7b6d5fb4df-vvl6f"
Jul 20 13:40:58.583039 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:40:58.583012    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e8477791-6b58-46a7-b5f4-39b8ca759919-workload-certs\") pod \"e2e-api-b-b738bb-openshift-default-7b6d5fb4df-vvl6f\" (UID: \"e8477791-6b58-46a7-b5f4-39b8ca759919\") " pod="openshift-ingress/e2e-api-b-b738bb-openshift-default-7b6d5fb4df-vvl6f"
Jul 20 13:40:58.684704 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:40:58.684662    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e8477791-6b58-46a7-b5f4-39b8ca759919-istio-data\") pod \"e2e-api-b-b738bb-openshift-default-7b6d5fb4df-vvl6f\" (UID: \"e8477791-6b58-46a7-b5f4-39b8ca759919\") " pod="openshift-ingress/e2e-api-b-b738bb-openshift-default-7b6d5fb4df-vvl6f"
Jul 20 13:40:58.684881 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:40:58.684714    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e8477791-6b58-46a7-b5f4-39b8ca759919-istiod-ca-cert\") pod \"e2e-api-b-b738bb-openshift-default-7b6d5fb4df-vvl6f\" (UID: \"e8477791-6b58-46a7-b5f4-39b8ca759919\") " pod="openshift-ingress/e2e-api-b-b738bb-openshift-default-7b6d5fb4df-vvl6f"
Jul 20 13:40:58.684881 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:40:58.684750    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9fdqc\" (UniqueName: \"kubernetes.io/projected/e8477791-6b58-46a7-b5f4-39b8ca759919-kube-api-access-9fdqc\") pod \"e2e-api-b-b738bb-openshift-default-7b6d5fb4df-vvl6f\" (UID: \"e8477791-6b58-46a7-b5f4-39b8ca759919\") " pod="openshift-ingress/e2e-api-b-b738bb-openshift-default-7b6d5fb4df-vvl6f"
Jul 20 13:40:58.684881 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:40:58.684779    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e8477791-6b58-46a7-b5f4-39b8ca759919-workload-socket\") pod \"e2e-api-b-b738bb-openshift-default-7b6d5fb4df-vvl6f\" (UID: \"e8477791-6b58-46a7-b5f4-39b8ca759919\") " pod="openshift-ingress/e2e-api-b-b738bb-openshift-default-7b6d5fb4df-vvl6f"
Jul 20 13:40:58.684881 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:40:58.684833    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e8477791-6b58-46a7-b5f4-39b8ca759919-credential-socket\") pod \"e2e-api-b-b738bb-openshift-default-7b6d5fb4df-vvl6f\" (UID: \"e8477791-6b58-46a7-b5f4-39b8ca759919\") " pod="openshift-ingress/e2e-api-b-b738bb-openshift-default-7b6d5fb4df-vvl6f"
Jul 20 13:40:58.684881 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:40:58.684863    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e8477791-6b58-46a7-b5f4-39b8ca759919-istio-token\") pod \"e2e-api-b-b738bb-openshift-default-7b6d5fb4df-vvl6f\" (UID: \"e8477791-6b58-46a7-b5f4-39b8ca759919\") " pod="openshift-ingress/e2e-api-b-b738bb-openshift-default-7b6d5fb4df-vvl6f"
Jul 20 13:40:58.685338 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:40:58.685004    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e8477791-6b58-46a7-b5f4-39b8ca759919-istio-podinfo\") pod \"e2e-api-b-b738bb-openshift-default-7b6d5fb4df-vvl6f\" (UID: \"e8477791-6b58-46a7-b5f4-39b8ca759919\") " pod="openshift-ingress/e2e-api-b-b738bb-openshift-default-7b6d5fb4df-vvl6f"
Jul 20 13:40:58.685338 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:40:58.685039    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e8477791-6b58-46a7-b5f4-39b8ca759919-istio-envoy\") pod \"e2e-api-b-b738bb-openshift-default-7b6d5fb4df-vvl6f\" (UID: \"e8477791-6b58-46a7-b5f4-39b8ca759919\") " pod="openshift-ingress/e2e-api-b-b738bb-openshift-default-7b6d5fb4df-vvl6f"
Jul 20 13:40:58.685338 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:40:58.685087    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e8477791-6b58-46a7-b5f4-39b8ca759919-workload-certs\") pod \"e2e-api-b-b738bb-openshift-default-7b6d5fb4df-vvl6f\" (UID: \"e8477791-6b58-46a7-b5f4-39b8ca759919\") " pod="openshift-ingress/e2e-api-b-b738bb-openshift-default-7b6d5fb4df-vvl6f"
Jul 20 13:40:58.685338 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:40:58.685240    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e8477791-6b58-46a7-b5f4-39b8ca759919-credential-socket\") pod \"e2e-api-b-b738bb-openshift-default-7b6d5fb4df-vvl6f\" (UID: \"e8477791-6b58-46a7-b5f4-39b8ca759919\") " pod="openshift-ingress/e2e-api-b-b738bb-openshift-default-7b6d5fb4df-vvl6f"
Jul 20 13:40:58.685338 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:40:58.685296    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e8477791-6b58-46a7-b5f4-39b8ca759919-workload-socket\") pod \"e2e-api-b-b738bb-openshift-default-7b6d5fb4df-vvl6f\" (UID: \"e8477791-6b58-46a7-b5f4-39b8ca759919\") " pod="openshift-ingress/e2e-api-b-b738bb-openshift-default-7b6d5fb4df-vvl6f"
Jul 20 13:40:58.685610 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:40:58.685536    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e8477791-6b58-46a7-b5f4-39b8ca759919-workload-certs\") pod \"e2e-api-b-b738bb-openshift-default-7b6d5fb4df-vvl6f\" (UID: \"e8477791-6b58-46a7-b5f4-39b8ca759919\") " pod="openshift-ingress/e2e-api-b-b738bb-openshift-default-7b6d5fb4df-vvl6f"
Jul 20 13:40:58.685712 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:40:58.685669    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e8477791-6b58-46a7-b5f4-39b8ca759919-istiod-ca-cert\") pod \"e2e-api-b-b738bb-openshift-default-7b6d5fb4df-vvl6f\" (UID: \"e8477791-6b58-46a7-b5f4-39b8ca759919\") " pod="openshift-ingress/e2e-api-b-b738bb-openshift-default-7b6d5fb4df-vvl6f"
Jul 20 13:40:58.685847 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:40:58.685802    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e8477791-6b58-46a7-b5f4-39b8ca759919-istio-data\") pod \"e2e-api-b-b738bb-openshift-default-7b6d5fb4df-vvl6f\" (UID: \"e8477791-6b58-46a7-b5f4-39b8ca759919\") " pod="openshift-ingress/e2e-api-b-b738bb-openshift-default-7b6d5fb4df-vvl6f"
Jul 20 13:40:58.688306 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:40:58.688279    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e8477791-6b58-46a7-b5f4-39b8ca759919-istio-envoy\") pod \"e2e-api-b-b738bb-openshift-default-7b6d5fb4df-vvl6f\" (UID: \"e8477791-6b58-46a7-b5f4-39b8ca759919\") " pod="openshift-ingress/e2e-api-b-b738bb-openshift-default-7b6d5fb4df-vvl6f"
Jul 20 13:40:58.688717 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:40:58.688693    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e8477791-6b58-46a7-b5f4-39b8ca759919-istio-podinfo\") pod \"e2e-api-b-b738bb-openshift-default-7b6d5fb4df-vvl6f\" (UID: \"e8477791-6b58-46a7-b5f4-39b8ca759919\") " pod="openshift-ingress/e2e-api-b-b738bb-openshift-default-7b6d5fb4df-vvl6f"
Jul 20 13:40:58.699264 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:40:58.699234    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e8477791-6b58-46a7-b5f4-39b8ca759919-istio-token\") pod \"e2e-api-b-b738bb-openshift-default-7b6d5fb4df-vvl6f\" (UID: \"e8477791-6b58-46a7-b5f4-39b8ca759919\") " pod="openshift-ingress/e2e-api-b-b738bb-openshift-default-7b6d5fb4df-vvl6f"
Jul 20 13:40:58.701608 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:40:58.701584    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9fdqc\" (UniqueName: \"kubernetes.io/projected/e8477791-6b58-46a7-b5f4-39b8ca759919-kube-api-access-9fdqc\") pod \"e2e-api-b-b738bb-openshift-default-7b6d5fb4df-vvl6f\" (UID: \"e8477791-6b58-46a7-b5f4-39b8ca759919\") " pod="openshift-ingress/e2e-api-b-b738bb-openshift-default-7b6d5fb4df-vvl6f"
Jul 20 13:40:58.809027 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:40:58.808896    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-b738bb-openshift-default-7b6d5fb4df-vvl6f"
Jul 20 13:40:58.959857 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:40:58.959830    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-b738bb-openshift-default-7b6d5fb4df-vvl6f"]
Jul 20 13:40:58.962111 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:40:58.962082    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode8477791_6b58_46a7_b5f4_39b8ca759919.slice/crio-6cadc7c1e67ecc36cac6af46e0ec44e0df217815b3856a3bb9e1daaed3b3e67d WatchSource:0}: Error finding container 6cadc7c1e67ecc36cac6af46e0ec44e0df217815b3856a3bb9e1daaed3b3e67d: Status 404 returned error can't find the container with id 6cadc7c1e67ecc36cac6af46e0ec44e0df217815b3856a3bb9e1daaed3b3e67d
Jul 20 13:40:58.964738 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:40:58.964705    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 20 13:40:58.964837 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:40:58.964785    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 20 13:40:58.964837 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:40:58.964831    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 20 13:40:59.164841 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:40:59.164741    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-b738bb-openshift-default-7b6d5fb4df-vvl6f" event={"ID":"e8477791-6b58-46a7-b5f4-39b8ca759919","Type":"ContainerStarted","Data":"97ee7def7a6e73dd4adf7afdf7662745f6fbdacd2c0dc6e12d796365929007dc"}
Jul 20 13:40:59.164841 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:40:59.164811    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-b738bb-openshift-default-7b6d5fb4df-vvl6f" event={"ID":"e8477791-6b58-46a7-b5f4-39b8ca759919","Type":"ContainerStarted","Data":"6cadc7c1e67ecc36cac6af46e0ec44e0df217815b3856a3bb9e1daaed3b3e67d"}
Jul 20 13:40:59.188013 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:40:59.187941    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-b738bb-openshift-default-7b6d5fb4df-vvl6f" podStartSLOduration=1.187922803 podStartE2EDuration="1.187922803s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 13:40:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 13:40:59.186012955 +0000 UTC m=+2348.902560369" watchObservedRunningTime="2026-07-20 13:40:59.187922803 +0000 UTC m=+2348.904470213"
Jul 20 13:40:59.809376 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:40:59.809338    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-b738bb-openshift-default-7b6d5fb4df-vvl6f"
Jul 20 13:41:00.814444 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:41:00.814413    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-b738bb-openshift-default-7b6d5fb4df-vvl6f"
Jul 20 13:41:01.148866 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:41:01.148773    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-15a544-868cc6f867-rq8bd"
Jul 20 13:41:01.177447 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:41:01.177413    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-b738bb-openshift-default-7b6d5fb4df-vvl6f"
Jul 20 13:41:01.178332 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:41:01.178315    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-b738bb-openshift-default-7b6d5fb4df-vvl6f"
Jul 20 13:41:01.296769 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:41:01.296729    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-b738bb-75dd48565b-77mzl"]
Jul 20 13:41:01.297614 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:41:01.297595    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b29e9121-1dfc-4c76-a336-38cac493823a" containerName="istio-proxy"
Jul 20 13:41:01.297678 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:41:01.297619    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="b29e9121-1dfc-4c76-a336-38cac493823a" containerName="istio-proxy"
Jul 20 13:41:01.301612 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:41:01.301588    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-b738bb-75dd48565b-77mzl"
Jul 20 13:41:01.303647 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:41:01.303627    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-b-b738bb-serving-cert\""
Jul 20 13:41:01.311576 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:41:01.311492    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-b738bb-75dd48565b-77mzl"]
Jul 20 13:41:01.432645 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:41:01.432541    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8dea318c-5f2a-4ed6-a153-6eee80c3abfc-maas-api-tls\") pod \"maas-api-e2e-api-b-b738bb-75dd48565b-77mzl\" (UID: \"8dea318c-5f2a-4ed6-a153-6eee80c3abfc\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-b738bb-75dd48565b-77mzl"
Jul 20 13:41:01.433023 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:41:01.432997    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m9hv2\" (UniqueName: \"kubernetes.io/projected/8dea318c-5f2a-4ed6-a153-6eee80c3abfc-kube-api-access-m9hv2\") pod \"maas-api-e2e-api-b-b738bb-75dd48565b-77mzl\" (UID: \"8dea318c-5f2a-4ed6-a153-6eee80c3abfc\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-b738bb-75dd48565b-77mzl"
Jul 20 13:41:01.433242 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:41:01.433222    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8dea318c-5f2a-4ed6-a153-6eee80c3abfc-openshift-service-ca\") pod \"maas-api-e2e-api-b-b738bb-75dd48565b-77mzl\" (UID: \"8dea318c-5f2a-4ed6-a153-6eee80c3abfc\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-b738bb-75dd48565b-77mzl"
Jul 20 13:41:01.535076 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:41:01.535006    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8dea318c-5f2a-4ed6-a153-6eee80c3abfc-maas-api-tls\") pod \"maas-api-e2e-api-b-b738bb-75dd48565b-77mzl\" (UID: \"8dea318c-5f2a-4ed6-a153-6eee80c3abfc\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-b738bb-75dd48565b-77mzl"
Jul 20 13:41:01.535314 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:41:01.535127    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m9hv2\" (UniqueName: \"kubernetes.io/projected/8dea318c-5f2a-4ed6-a153-6eee80c3abfc-kube-api-access-m9hv2\") pod \"maas-api-e2e-api-b-b738bb-75dd48565b-77mzl\" (UID: \"8dea318c-5f2a-4ed6-a153-6eee80c3abfc\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-b738bb-75dd48565b-77mzl"
Jul 20 13:41:01.535314 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:41:01.535199    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8dea318c-5f2a-4ed6-a153-6eee80c3abfc-openshift-service-ca\") pod \"maas-api-e2e-api-b-b738bb-75dd48565b-77mzl\" (UID: \"8dea318c-5f2a-4ed6-a153-6eee80c3abfc\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-b738bb-75dd48565b-77mzl"
Jul 20 13:41:01.536183 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:41:01.536151    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8dea318c-5f2a-4ed6-a153-6eee80c3abfc-openshift-service-ca\") pod \"maas-api-e2e-api-b-b738bb-75dd48565b-77mzl\" (UID: \"8dea318c-5f2a-4ed6-a153-6eee80c3abfc\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-b738bb-75dd48565b-77mzl"
Jul 20 13:41:01.536303 ip-10-0-134-121 kubenswrapper[2584]: E0720 13:41:01.536278    2584 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-api-b-b738bb-serving-cert: secret "maas-api-e2e-api-b-b738bb-serving-cert" not found
Jul 20 13:41:01.536375 ip-10-0-134-121 kubenswrapper[2584]: E0720 13:41:01.536342    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8dea318c-5f2a-4ed6-a153-6eee80c3abfc-maas-api-tls podName:8dea318c-5f2a-4ed6-a153-6eee80c3abfc nodeName:}" failed. No retries permitted until 2026-07-20 13:41:02.036318639 +0000 UTC m=+2351.752866042 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/8dea318c-5f2a-4ed6-a153-6eee80c3abfc-maas-api-tls") pod "maas-api-e2e-api-b-b738bb-75dd48565b-77mzl" (UID: "8dea318c-5f2a-4ed6-a153-6eee80c3abfc") : secret "maas-api-e2e-api-b-b738bb-serving-cert" not found
Jul 20 13:41:01.548726 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:41:01.548685    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m9hv2\" (UniqueName: \"kubernetes.io/projected/8dea318c-5f2a-4ed6-a153-6eee80c3abfc-kube-api-access-m9hv2\") pod \"maas-api-e2e-api-b-b738bb-75dd48565b-77mzl\" (UID: \"8dea318c-5f2a-4ed6-a153-6eee80c3abfc\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-b738bb-75dd48565b-77mzl"
Jul 20 13:41:02.047230 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:41:02.047180    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8dea318c-5f2a-4ed6-a153-6eee80c3abfc-maas-api-tls\") pod \"maas-api-e2e-api-b-b738bb-75dd48565b-77mzl\" (UID: \"8dea318c-5f2a-4ed6-a153-6eee80c3abfc\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-b738bb-75dd48565b-77mzl"
Jul 20 13:41:02.050496 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:41:02.050463    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8dea318c-5f2a-4ed6-a153-6eee80c3abfc-maas-api-tls\") pod \"maas-api-e2e-api-b-b738bb-75dd48565b-77mzl\" (UID: \"8dea318c-5f2a-4ed6-a153-6eee80c3abfc\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-b738bb-75dd48565b-77mzl"
Jul 20 13:41:02.215492 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:41:02.215460    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-b738bb-75dd48565b-77mzl"
Jul 20 13:41:02.454045 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:41:02.451677    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-b738bb-75dd48565b-77mzl"]
Jul 20 13:41:03.190333 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:41:03.190236    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-b738bb-75dd48565b-77mzl" event={"ID":"8dea318c-5f2a-4ed6-a153-6eee80c3abfc","Type":"ContainerStarted","Data":"ec1ec6ce9c31d4505387d14bdbbcbe23f43edc48047f2854acea0242aa57e25f"}
Jul 20 13:41:03.190333 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:41:03.190303    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-b738bb-75dd48565b-77mzl" event={"ID":"8dea318c-5f2a-4ed6-a153-6eee80c3abfc","Type":"ContainerStarted","Data":"b44ac49db5b58bbe80818e26a72793bcd8c1f001a2861fe07e4881404966732d"}
Jul 20 13:41:03.190738 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:41:03.190469    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-b738bb-75dd48565b-77mzl"
Jul 20 13:41:03.210511 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:41:03.210462    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-b738bb-75dd48565b-77mzl" podStartSLOduration=1.809616298 podStartE2EDuration="2.210445301s" totalImagesPullingTime="400.829003ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 13:41:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 13:41:03.20804234 +0000 UTC m=+2352.924589750" watchObservedRunningTime="2026-07-20 13:41:03.210445301 +0000 UTC m=+2352.926992708"
Jul 20 13:41:06.211131 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:41:06.211096    2584 generic.go:356] "Generic (PLEG): container finished" podID="226617a4-9da0-4305-9435-2d94524bdb24" containerID="9c4d871d0f9ec9c33974259fb30c2644ead477835ae639bf3342d72c7d3372f0" exitCode=0
Jul 20 13:41:06.211552 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:41:06.211173    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-15a544-openshift-default-77778bf5c5-nwfdr" event={"ID":"226617a4-9da0-4305-9435-2d94524bdb24","Type":"ContainerDied","Data":"9c4d871d0f9ec9c33974259fb30c2644ead477835ae639bf3342d72c7d3372f0"}
Jul 20 13:41:06.211708 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:41:06.211691    2584 scope.go:117] "RemoveContainer" containerID="9c4d871d0f9ec9c33974259fb30c2644ead477835ae639bf3342d72c7d3372f0"
Jul 20 13:41:06.212780 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:41:06.212749    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 20 13:41:06.212845 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:41:06.212830    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 20 13:41:06.212882 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:41:06.212870    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 20 13:41:07.102710 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:41:07.102669    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-15a544-openshift-default-77778bf5c5-nwfdr"
Jul 20 13:41:07.218559 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:41:07.218523    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-15a544-openshift-default-77778bf5c5-nwfdr" event={"ID":"226617a4-9da0-4305-9435-2d94524bdb24","Type":"ContainerStarted","Data":"96ab53c5d0263fb6eb41cd34476a0c8d7e509ba9537714d4d61fcd04bac9f3f5"}
Jul 20 13:41:07.442260 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:41:07.442145    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-15a544-openshift-default-77778bf5c5-nwfdr"
Jul 20 13:41:07.443696 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:41:07.443658    2584 patch_prober.go:28] interesting pod/e2e-api-a-15a544-openshift-default-77778bf5c5-nwfdr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused" start-of-body=
Jul 20 13:41:07.443842 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:41:07.443771    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-15a544-openshift-default-77778bf5c5-nwfdr" podUID="226617a4-9da0-4305-9435-2d94524bdb24" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused"
Jul 20 13:41:08.442610 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:41:08.442560    2584 patch_prober.go:28] interesting pod/e2e-api-a-15a544-openshift-default-77778bf5c5-nwfdr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused" start-of-body=
Jul 20 13:41:08.443133 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:41:08.442634    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-15a544-openshift-default-77778bf5c5-nwfdr" podUID="226617a4-9da0-4305-9435-2d94524bdb24" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused"
Jul 20 13:41:09.203339 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:41:09.203310    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-b738bb-75dd48565b-77mzl"
Jul 20 13:41:09.442406 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:41:09.442363    2584 patch_prober.go:28] interesting pod/e2e-api-a-15a544-openshift-default-77778bf5c5-nwfdr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused" start-of-body=
Jul 20 13:41:09.442706 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:41:09.442676    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-15a544-openshift-default-77778bf5c5-nwfdr" podUID="226617a4-9da0-4305-9435-2d94524bdb24" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused"
Jul 20 13:41:10.443460 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:41:10.442990    2584 patch_prober.go:28] interesting pod/e2e-api-a-15a544-openshift-default-77778bf5c5-nwfdr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused" start-of-body=
Jul 20 13:41:10.443460 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:41:10.443058    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-15a544-openshift-default-77778bf5c5-nwfdr" podUID="226617a4-9da0-4305-9435-2d94524bdb24" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused"
Jul 20 13:41:11.450350 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:41:11.450317    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-15a544-openshift-default-77778bf5c5-nwfdr"
Jul 20 13:41:11.450882 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:41:11.450791    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-15a544-openshift-default-77778bf5c5-nwfdr"
Jul 20 13:41:11.451787 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:41:11.451764    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-15a544-openshift-default-77778bf5c5-nwfdr"
Jul 20 13:41:17.220196 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:41:17.220155    2584 patch_prober.go:28] interesting pod/e2e-api-b-b738bb-openshift-default-7b6d5fb4df-vvl6f container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.65:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 20 13:41:17.220619 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:41:17.220219    2584 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-b-b738bb-openshift-default-7b6d5fb4df-vvl6f" podUID="e8477791-6b58-46a7-b5f4-39b8ca759919" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.65:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 20 13:41:18.292588 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:41:18.292549    2584 generic.go:356] "Generic (PLEG): container finished" podID="e8477791-6b58-46a7-b5f4-39b8ca759919" containerID="97ee7def7a6e73dd4adf7afdf7662745f6fbdacd2c0dc6e12d796365929007dc" exitCode=0
Jul 20 13:41:18.293074 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:41:18.292623    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-b738bb-openshift-default-7b6d5fb4df-vvl6f" event={"ID":"e8477791-6b58-46a7-b5f4-39b8ca759919","Type":"ContainerDied","Data":"97ee7def7a6e73dd4adf7afdf7662745f6fbdacd2c0dc6e12d796365929007dc"}
Jul 20 13:41:18.293125 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:41:18.293114    2584 scope.go:117] "RemoveContainer" containerID="97ee7def7a6e73dd4adf7afdf7662745f6fbdacd2c0dc6e12d796365929007dc"
Jul 20 13:41:18.294229 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:41:18.294198    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 20 13:41:18.294293 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:41:18.294273    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 20 13:41:18.294340 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:41:18.294306    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 20 13:41:19.299672 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:41:19.299637    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-b738bb-openshift-default-7b6d5fb4df-vvl6f" event={"ID":"e8477791-6b58-46a7-b5f4-39b8ca759919","Type":"ContainerStarted","Data":"6899a6f19d68eadcec50b9a6996aefcab76250f375e5c9c37f1a99bdca47016d"}
Jul 20 13:41:19.809606 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:41:19.809559    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-b738bb-openshift-default-7b6d5fb4df-vvl6f"
Jul 20 13:41:19.809811 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:41:19.809767    2584 patch_prober.go:28] interesting pod/e2e-api-b-b738bb-openshift-default-7b6d5fb4df-vvl6f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused" start-of-body=
Jul 20 13:41:19.809856 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:41:19.809813    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-b738bb-openshift-default-7b6d5fb4df-vvl6f" podUID="e8477791-6b58-46a7-b5f4-39b8ca759919" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused"
Jul 20 13:41:20.809424 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:41:20.809389    2584 patch_prober.go:28] interesting pod/e2e-api-b-b738bb-openshift-default-7b6d5fb4df-vvl6f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused" start-of-body=
Jul 20 13:41:20.809801 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:41:20.809458    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-b738bb-openshift-default-7b6d5fb4df-vvl6f" podUID="e8477791-6b58-46a7-b5f4-39b8ca759919" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused"
Jul 20 13:41:21.810332 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:41:21.810290    2584 patch_prober.go:28] interesting pod/e2e-api-b-b738bb-openshift-default-7b6d5fb4df-vvl6f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused" start-of-body=
Jul 20 13:41:21.810748 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:41:21.810362    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-b738bb-openshift-default-7b6d5fb4df-vvl6f" podUID="e8477791-6b58-46a7-b5f4-39b8ca759919" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused"
Jul 20 13:41:22.809417 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:41:22.809375    2584 patch_prober.go:28] interesting pod/e2e-api-b-b738bb-openshift-default-7b6d5fb4df-vvl6f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused" start-of-body=
Jul 20 13:41:22.809625 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:41:22.809436    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-b738bb-openshift-default-7b6d5fb4df-vvl6f" podUID="e8477791-6b58-46a7-b5f4-39b8ca759919" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused"
Jul 20 13:41:23.813588 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:41:23.813556    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-b738bb-openshift-default-7b6d5fb4df-vvl6f"
Jul 20 13:41:23.814046 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:41:23.813912    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-b738bb-openshift-default-7b6d5fb4df-vvl6f"
Jul 20 13:41:23.814923 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:41:23.814904    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-b738bb-openshift-default-7b6d5fb4df-vvl6f"
Jul 20 13:41:24.903642 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:41:24.903607    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-15a544-868cc6f867-rq8bd"]
Jul 20 13:41:24.904500 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:41:24.904464    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-15a544-868cc6f867-rq8bd" podUID="e781df20-4898-4bb7-8f5b-d11a128c7cb4" containerName="maas-api" containerID="cri-o://3a8ce2e4d2a0011933331340d789ed99c84b92c467a1a587f28cbcea3d4d0f60" gracePeriod=30
Jul 20 13:41:25.174536 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:41:25.174508    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-15a544-868cc6f867-rq8bd"
Jul 20 13:41:25.308653 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:41:25.308610    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e781df20-4898-4bb7-8f5b-d11a128c7cb4-maas-api-tls\") pod \"e781df20-4898-4bb7-8f5b-d11a128c7cb4\" (UID: \"e781df20-4898-4bb7-8f5b-d11a128c7cb4\") "
Jul 20 13:41:25.308864 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:41:25.308679    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mb275\" (UniqueName: \"kubernetes.io/projected/e781df20-4898-4bb7-8f5b-d11a128c7cb4-kube-api-access-mb275\") pod \"e781df20-4898-4bb7-8f5b-d11a128c7cb4\" (UID: \"e781df20-4898-4bb7-8f5b-d11a128c7cb4\") "
Jul 20 13:41:25.308864 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:41:25.308714    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e781df20-4898-4bb7-8f5b-d11a128c7cb4-openshift-service-ca\") pod \"e781df20-4898-4bb7-8f5b-d11a128c7cb4\" (UID: \"e781df20-4898-4bb7-8f5b-d11a128c7cb4\") "
Jul 20 13:41:25.309126 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:41:25.309097    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e781df20-4898-4bb7-8f5b-d11a128c7cb4-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "e781df20-4898-4bb7-8f5b-d11a128c7cb4" (UID: "e781df20-4898-4bb7-8f5b-d11a128c7cb4"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 13:41:25.310851 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:41:25.310828    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e781df20-4898-4bb7-8f5b-d11a128c7cb4-kube-api-access-mb275" (OuterVolumeSpecName: "kube-api-access-mb275") pod "e781df20-4898-4bb7-8f5b-d11a128c7cb4" (UID: "e781df20-4898-4bb7-8f5b-d11a128c7cb4"). InnerVolumeSpecName "kube-api-access-mb275". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 13:41:25.310932 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:41:25.310855    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e781df20-4898-4bb7-8f5b-d11a128c7cb4-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "e781df20-4898-4bb7-8f5b-d11a128c7cb4" (UID: "e781df20-4898-4bb7-8f5b-d11a128c7cb4"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 13:41:25.333274 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:41:25.333243    2584 generic.go:356] "Generic (PLEG): container finished" podID="e781df20-4898-4bb7-8f5b-d11a128c7cb4" containerID="3a8ce2e4d2a0011933331340d789ed99c84b92c467a1a587f28cbcea3d4d0f60" exitCode=0
Jul 20 13:41:25.333435 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:41:25.333283    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-15a544-868cc6f867-rq8bd"
Jul 20 13:41:25.333435 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:41:25.333318    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-15a544-868cc6f867-rq8bd" event={"ID":"e781df20-4898-4bb7-8f5b-d11a128c7cb4","Type":"ContainerDied","Data":"3a8ce2e4d2a0011933331340d789ed99c84b92c467a1a587f28cbcea3d4d0f60"}
Jul 20 13:41:25.333435 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:41:25.333377    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-15a544-868cc6f867-rq8bd" event={"ID":"e781df20-4898-4bb7-8f5b-d11a128c7cb4","Type":"ContainerDied","Data":"7c49d2cbde4a5593de3cd4310db4147ead5b4485febc22713f603efc6f163713"}
Jul 20 13:41:25.333435 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:41:25.333406    2584 scope.go:117] "RemoveContainer" containerID="3a8ce2e4d2a0011933331340d789ed99c84b92c467a1a587f28cbcea3d4d0f60"
Jul 20 13:41:25.344178 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:41:25.344157    2584 scope.go:117] "RemoveContainer" containerID="3a8ce2e4d2a0011933331340d789ed99c84b92c467a1a587f28cbcea3d4d0f60"
Jul 20 13:41:25.344501 ip-10-0-134-121 kubenswrapper[2584]: E0720 13:41:25.344478    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3a8ce2e4d2a0011933331340d789ed99c84b92c467a1a587f28cbcea3d4d0f60\": container with ID starting with 3a8ce2e4d2a0011933331340d789ed99c84b92c467a1a587f28cbcea3d4d0f60 not found: ID does not exist" containerID="3a8ce2e4d2a0011933331340d789ed99c84b92c467a1a587f28cbcea3d4d0f60"
Jul 20 13:41:25.344546 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:41:25.344512    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3a8ce2e4d2a0011933331340d789ed99c84b92c467a1a587f28cbcea3d4d0f60"} err="failed to get container status \"3a8ce2e4d2a0011933331340d789ed99c84b92c467a1a587f28cbcea3d4d0f60\": rpc error: code = NotFound desc = could not find container \"3a8ce2e4d2a0011933331340d789ed99c84b92c467a1a587f28cbcea3d4d0f60\": container with ID starting with 3a8ce2e4d2a0011933331340d789ed99c84b92c467a1a587f28cbcea3d4d0f60 not found: ID does not exist"
Jul 20 13:41:25.356383 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:41:25.356353    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-15a544-868cc6f867-rq8bd"]
Jul 20 13:41:25.359789 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:41:25.359762    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-15a544-868cc6f867-rq8bd"]
Jul 20 13:41:25.410294 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:41:25.410190    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mb275\" (UniqueName: \"kubernetes.io/projected/e781df20-4898-4bb7-8f5b-d11a128c7cb4-kube-api-access-mb275\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 20 13:41:25.410294 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:41:25.410223    2584 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e781df20-4898-4bb7-8f5b-d11a128c7cb4-openshift-service-ca\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 20 13:41:25.410294 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:41:25.410234    2584 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e781df20-4898-4bb7-8f5b-d11a128c7cb4-maas-api-tls\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 20 13:41:27.096377 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:41:27.096336    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e781df20-4898-4bb7-8f5b-d11a128c7cb4" path="/var/lib/kubelet/pods/e781df20-4898-4bb7-8f5b-d11a128c7cb4/volumes"
Jul 20 13:41:39.816721 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:41:39.816682    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-15a544-openshift-default-77778bf5c5-nwfdr"]
Jul 20 13:41:39.817178 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:41:39.816954    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-15a544-openshift-default-77778bf5c5-nwfdr" podUID="226617a4-9da0-4305-9435-2d94524bdb24" containerName="istio-proxy" containerID="cri-o://96ab53c5d0263fb6eb41cd34476a0c8d7e509ba9537714d4d61fcd04bac9f3f5" gracePeriod=30
Jul 20 13:41:41.453711 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:41:41.453674    2584 patch_prober.go:28] interesting pod/e2e-api-a-15a544-openshift-default-77778bf5c5-nwfdr container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 20 13:41:41.454119 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:41:41.453753    2584 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-15a544-openshift-default-77778bf5c5-nwfdr" podUID="226617a4-9da0-4305-9435-2d94524bdb24" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 20 13:41:45.082655 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:41:45.082577    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-15a544-openshift-default-77778bf5c5-nwfdr"
Jul 20 13:41:45.218204 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:41:45.218165    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vhqc6\" (UniqueName: \"kubernetes.io/projected/226617a4-9da0-4305-9435-2d94524bdb24-kube-api-access-vhqc6\") pod \"226617a4-9da0-4305-9435-2d94524bdb24\" (UID: \"226617a4-9da0-4305-9435-2d94524bdb24\") "
Jul 20 13:41:45.218421 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:41:45.218241    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/226617a4-9da0-4305-9435-2d94524bdb24-istio-envoy\") pod \"226617a4-9da0-4305-9435-2d94524bdb24\" (UID: \"226617a4-9da0-4305-9435-2d94524bdb24\") "
Jul 20 13:41:45.218421 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:41:45.218264    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/226617a4-9da0-4305-9435-2d94524bdb24-istio-data\") pod \"226617a4-9da0-4305-9435-2d94524bdb24\" (UID: \"226617a4-9da0-4305-9435-2d94524bdb24\") "
Jul 20 13:41:45.218421 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:41:45.218292    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/226617a4-9da0-4305-9435-2d94524bdb24-istiod-ca-cert\") pod \"226617a4-9da0-4305-9435-2d94524bdb24\" (UID: \"226617a4-9da0-4305-9435-2d94524bdb24\") "
Jul 20 13:41:45.218421 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:41:45.218314    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/226617a4-9da0-4305-9435-2d94524bdb24-istio-token\") pod \"226617a4-9da0-4305-9435-2d94524bdb24\" (UID: \"226617a4-9da0-4305-9435-2d94524bdb24\") "
Jul 20 13:41:45.218421 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:41:45.218341    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/226617a4-9da0-4305-9435-2d94524bdb24-istio-podinfo\") pod \"226617a4-9da0-4305-9435-2d94524bdb24\" (UID: \"226617a4-9da0-4305-9435-2d94524bdb24\") "
Jul 20 13:41:45.218421 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:41:45.218374    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/226617a4-9da0-4305-9435-2d94524bdb24-workload-socket\") pod \"226617a4-9da0-4305-9435-2d94524bdb24\" (UID: \"226617a4-9da0-4305-9435-2d94524bdb24\") "
Jul 20 13:41:45.218819 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:41:45.218484    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/226617a4-9da0-4305-9435-2d94524bdb24-workload-certs\") pod \"226617a4-9da0-4305-9435-2d94524bdb24\" (UID: \"226617a4-9da0-4305-9435-2d94524bdb24\") "
Jul 20 13:41:45.218819 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:41:45.218541    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/226617a4-9da0-4305-9435-2d94524bdb24-credential-socket\") pod \"226617a4-9da0-4305-9435-2d94524bdb24\" (UID: \"226617a4-9da0-4305-9435-2d94524bdb24\") "
Jul 20 13:41:45.218819 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:41:45.218790    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/226617a4-9da0-4305-9435-2d94524bdb24-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "226617a4-9da0-4305-9435-2d94524bdb24" (UID: "226617a4-9da0-4305-9435-2d94524bdb24"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 13:41:45.218819 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:41:45.218809    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/226617a4-9da0-4305-9435-2d94524bdb24-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "226617a4-9da0-4305-9435-2d94524bdb24" (UID: "226617a4-9da0-4305-9435-2d94524bdb24"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 13:41:45.219068 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:41:45.219032    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/226617a4-9da0-4305-9435-2d94524bdb24-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "226617a4-9da0-4305-9435-2d94524bdb24" (UID: "226617a4-9da0-4305-9435-2d94524bdb24"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 13:41:45.219177 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:41:45.219155    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/226617a4-9da0-4305-9435-2d94524bdb24-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "226617a4-9da0-4305-9435-2d94524bdb24" (UID: "226617a4-9da0-4305-9435-2d94524bdb24"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 13:41:45.219299 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:41:45.219273    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/226617a4-9da0-4305-9435-2d94524bdb24-istio-data" (OuterVolumeSpecName: "istio-data") pod "226617a4-9da0-4305-9435-2d94524bdb24" (UID: "226617a4-9da0-4305-9435-2d94524bdb24"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 13:41:45.219383 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:41:45.219279    2584 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/226617a4-9da0-4305-9435-2d94524bdb24-workload-certs\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 20 13:41:45.219383 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:41:45.219333    2584 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/226617a4-9da0-4305-9435-2d94524bdb24-credential-socket\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 20 13:41:45.219383 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:41:45.219352    2584 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/226617a4-9da0-4305-9435-2d94524bdb24-istiod-ca-cert\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 20 13:41:45.219383 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:41:45.219370    2584 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/226617a4-9da0-4305-9435-2d94524bdb24-workload-socket\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 20 13:41:45.220727 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:41:45.220701    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/226617a4-9da0-4305-9435-2d94524bdb24-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "226617a4-9da0-4305-9435-2d94524bdb24" (UID: "226617a4-9da0-4305-9435-2d94524bdb24"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 13:41:45.220844 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:41:45.220756    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/226617a4-9da0-4305-9435-2d94524bdb24-kube-api-access-vhqc6" (OuterVolumeSpecName: "kube-api-access-vhqc6") pod "226617a4-9da0-4305-9435-2d94524bdb24" (UID: "226617a4-9da0-4305-9435-2d94524bdb24"). InnerVolumeSpecName "kube-api-access-vhqc6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 13:41:45.220844 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:41:45.220754    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/226617a4-9da0-4305-9435-2d94524bdb24-istio-token" (OuterVolumeSpecName: "istio-token") pod "226617a4-9da0-4305-9435-2d94524bdb24" (UID: "226617a4-9da0-4305-9435-2d94524bdb24"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 13:41:45.220917 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:41:45.220868    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/226617a4-9da0-4305-9435-2d94524bdb24-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "226617a4-9da0-4305-9435-2d94524bdb24" (UID: "226617a4-9da0-4305-9435-2d94524bdb24"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 20 13:41:45.320769 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:41:45.320735    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vhqc6\" (UniqueName: \"kubernetes.io/projected/226617a4-9da0-4305-9435-2d94524bdb24-kube-api-access-vhqc6\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 20 13:41:45.320769 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:41:45.320767    2584 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/226617a4-9da0-4305-9435-2d94524bdb24-istio-envoy\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 20 13:41:45.321008 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:41:45.320788    2584 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/226617a4-9da0-4305-9435-2d94524bdb24-istio-data\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 20 13:41:45.321008 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:41:45.320798    2584 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/226617a4-9da0-4305-9435-2d94524bdb24-istio-token\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 20 13:41:45.321008 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:41:45.320807    2584 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/226617a4-9da0-4305-9435-2d94524bdb24-istio-podinfo\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 20 13:41:45.444512 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:41:45.444425    2584 generic.go:356] "Generic (PLEG): container finished" podID="226617a4-9da0-4305-9435-2d94524bdb24" containerID="96ab53c5d0263fb6eb41cd34476a0c8d7e509ba9537714d4d61fcd04bac9f3f5" exitCode=0
Jul 20 13:41:45.444512 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:41:45.444474    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-15a544-openshift-default-77778bf5c5-nwfdr"
Jul 20 13:41:45.444512 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:41:45.444492    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-15a544-openshift-default-77778bf5c5-nwfdr" event={"ID":"226617a4-9da0-4305-9435-2d94524bdb24","Type":"ContainerDied","Data":"96ab53c5d0263fb6eb41cd34476a0c8d7e509ba9537714d4d61fcd04bac9f3f5"}
Jul 20 13:41:45.444747 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:41:45.444537    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-15a544-openshift-default-77778bf5c5-nwfdr" event={"ID":"226617a4-9da0-4305-9435-2d94524bdb24","Type":"ContainerDied","Data":"0a9ae9e6c235b8b968cb094e38fd96c2612f8a032ba15da57980c97ef5058a61"}
Jul 20 13:41:45.444747 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:41:45.444560    2584 scope.go:117] "RemoveContainer" containerID="96ab53c5d0263fb6eb41cd34476a0c8d7e509ba9537714d4d61fcd04bac9f3f5"
Jul 20 13:41:45.454262 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:41:45.454242    2584 scope.go:117] "RemoveContainer" containerID="9c4d871d0f9ec9c33974259fb30c2644ead477835ae639bf3342d72c7d3372f0"
Jul 20 13:41:45.462696 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:41:45.462676    2584 scope.go:117] "RemoveContainer" containerID="96ab53c5d0263fb6eb41cd34476a0c8d7e509ba9537714d4d61fcd04bac9f3f5"
Jul 20 13:41:45.462988 ip-10-0-134-121 kubenswrapper[2584]: E0720 13:41:45.462957    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"96ab53c5d0263fb6eb41cd34476a0c8d7e509ba9537714d4d61fcd04bac9f3f5\": container with ID starting with 96ab53c5d0263fb6eb41cd34476a0c8d7e509ba9537714d4d61fcd04bac9f3f5 not found: ID does not exist" containerID="96ab53c5d0263fb6eb41cd34476a0c8d7e509ba9537714d4d61fcd04bac9f3f5"
Jul 20 13:41:45.463040 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:41:45.463000    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"96ab53c5d0263fb6eb41cd34476a0c8d7e509ba9537714d4d61fcd04bac9f3f5"} err="failed to get container status \"96ab53c5d0263fb6eb41cd34476a0c8d7e509ba9537714d4d61fcd04bac9f3f5\": rpc error: code = NotFound desc = could not find container \"96ab53c5d0263fb6eb41cd34476a0c8d7e509ba9537714d4d61fcd04bac9f3f5\": container with ID starting with 96ab53c5d0263fb6eb41cd34476a0c8d7e509ba9537714d4d61fcd04bac9f3f5 not found: ID does not exist"
Jul 20 13:41:45.463040 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:41:45.463019    2584 scope.go:117] "RemoveContainer" containerID="9c4d871d0f9ec9c33974259fb30c2644ead477835ae639bf3342d72c7d3372f0"
Jul 20 13:41:45.463258 ip-10-0-134-121 kubenswrapper[2584]: E0720 13:41:45.463244    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9c4d871d0f9ec9c33974259fb30c2644ead477835ae639bf3342d72c7d3372f0\": container with ID starting with 9c4d871d0f9ec9c33974259fb30c2644ead477835ae639bf3342d72c7d3372f0 not found: ID does not exist" containerID="9c4d871d0f9ec9c33974259fb30c2644ead477835ae639bf3342d72c7d3372f0"
Jul 20 13:41:45.463299 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:41:45.463262    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9c4d871d0f9ec9c33974259fb30c2644ead477835ae639bf3342d72c7d3372f0"} err="failed to get container status \"9c4d871d0f9ec9c33974259fb30c2644ead477835ae639bf3342d72c7d3372f0\": rpc error: code = NotFound desc = could not find container \"9c4d871d0f9ec9c33974259fb30c2644ead477835ae639bf3342d72c7d3372f0\": container with ID starting with 9c4d871d0f9ec9c33974259fb30c2644ead477835ae639bf3342d72c7d3372f0 not found: ID does not exist"
Jul 20 13:41:45.471206 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:41:45.471180    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-15a544-openshift-default-77778bf5c5-nwfdr"]
Jul 20 13:41:45.475367 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:41:45.475332    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-15a544-openshift-default-77778bf5c5-nwfdr"]
Jul 20 13:41:47.096479 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:41:47.096441    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="226617a4-9da0-4305-9435-2d94524bdb24" path="/var/lib/kubelet/pods/226617a4-9da0-4305-9435-2d94524bdb24/volumes"
Jul 20 13:41:50.740529 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:41:50.740483    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-b738bb-75dd48565b-77mzl"]
Jul 20 13:41:50.741029 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:41:50.740746    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-b738bb-75dd48565b-77mzl" podUID="8dea318c-5f2a-4ed6-a153-6eee80c3abfc" containerName="maas-api" containerID="cri-o://ec1ec6ce9c31d4505387d14bdbbcbe23f43edc48047f2854acea0242aa57e25f" gracePeriod=30
Jul 20 13:41:51.001109 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:41:51.001079    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-b738bb-75dd48565b-77mzl"
Jul 20 13:41:51.076888 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:41:51.076847    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8dea318c-5f2a-4ed6-a153-6eee80c3abfc-openshift-service-ca\") pod \"8dea318c-5f2a-4ed6-a153-6eee80c3abfc\" (UID: \"8dea318c-5f2a-4ed6-a153-6eee80c3abfc\") "
Jul 20 13:41:51.077095 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:41:51.076948    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8dea318c-5f2a-4ed6-a153-6eee80c3abfc-maas-api-tls\") pod \"8dea318c-5f2a-4ed6-a153-6eee80c3abfc\" (UID: \"8dea318c-5f2a-4ed6-a153-6eee80c3abfc\") "
Jul 20 13:41:51.077195 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:41:51.077127    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m9hv2\" (UniqueName: \"kubernetes.io/projected/8dea318c-5f2a-4ed6-a153-6eee80c3abfc-kube-api-access-m9hv2\") pod \"8dea318c-5f2a-4ed6-a153-6eee80c3abfc\" (UID: \"8dea318c-5f2a-4ed6-a153-6eee80c3abfc\") "
Jul 20 13:41:51.077336 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:41:51.077313    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8dea318c-5f2a-4ed6-a153-6eee80c3abfc-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "8dea318c-5f2a-4ed6-a153-6eee80c3abfc" (UID: "8dea318c-5f2a-4ed6-a153-6eee80c3abfc"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 13:41:51.077477 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:41:51.077462    2584 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8dea318c-5f2a-4ed6-a153-6eee80c3abfc-openshift-service-ca\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 20 13:41:51.079176 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:41:51.079152    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8dea318c-5f2a-4ed6-a153-6eee80c3abfc-kube-api-access-m9hv2" (OuterVolumeSpecName: "kube-api-access-m9hv2") pod "8dea318c-5f2a-4ed6-a153-6eee80c3abfc" (UID: "8dea318c-5f2a-4ed6-a153-6eee80c3abfc"). InnerVolumeSpecName "kube-api-access-m9hv2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 13:41:51.079249 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:41:51.079186    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8dea318c-5f2a-4ed6-a153-6eee80c3abfc-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "8dea318c-5f2a-4ed6-a153-6eee80c3abfc" (UID: "8dea318c-5f2a-4ed6-a153-6eee80c3abfc"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 13:41:51.178205 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:41:51.178168    2584 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8dea318c-5f2a-4ed6-a153-6eee80c3abfc-maas-api-tls\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 20 13:41:51.178205 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:41:51.178193    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m9hv2\" (UniqueName: \"kubernetes.io/projected/8dea318c-5f2a-4ed6-a153-6eee80c3abfc-kube-api-access-m9hv2\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 20 13:41:51.477546 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:41:51.477459    2584 generic.go:356] "Generic (PLEG): container finished" podID="8dea318c-5f2a-4ed6-a153-6eee80c3abfc" containerID="ec1ec6ce9c31d4505387d14bdbbcbe23f43edc48047f2854acea0242aa57e25f" exitCode=0
Jul 20 13:41:51.477546 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:41:51.477508    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-b738bb-75dd48565b-77mzl"
Jul 20 13:41:51.477759 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:41:51.477542    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-b738bb-75dd48565b-77mzl" event={"ID":"8dea318c-5f2a-4ed6-a153-6eee80c3abfc","Type":"ContainerDied","Data":"ec1ec6ce9c31d4505387d14bdbbcbe23f43edc48047f2854acea0242aa57e25f"}
Jul 20 13:41:51.477759 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:41:51.477595    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-b738bb-75dd48565b-77mzl" event={"ID":"8dea318c-5f2a-4ed6-a153-6eee80c3abfc","Type":"ContainerDied","Data":"b44ac49db5b58bbe80818e26a72793bcd8c1f001a2861fe07e4881404966732d"}
Jul 20 13:41:51.477759 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:41:51.477620    2584 scope.go:117] "RemoveContainer" containerID="ec1ec6ce9c31d4505387d14bdbbcbe23f43edc48047f2854acea0242aa57e25f"
Jul 20 13:41:51.494106 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:41:51.494085    2584 scope.go:117] "RemoveContainer" containerID="ec1ec6ce9c31d4505387d14bdbbcbe23f43edc48047f2854acea0242aa57e25f"
Jul 20 13:41:51.494413 ip-10-0-134-121 kubenswrapper[2584]: E0720 13:41:51.494393    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ec1ec6ce9c31d4505387d14bdbbcbe23f43edc48047f2854acea0242aa57e25f\": container with ID starting with ec1ec6ce9c31d4505387d14bdbbcbe23f43edc48047f2854acea0242aa57e25f not found: ID does not exist" containerID="ec1ec6ce9c31d4505387d14bdbbcbe23f43edc48047f2854acea0242aa57e25f"
Jul 20 13:41:51.494459 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:41:51.494422    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ec1ec6ce9c31d4505387d14bdbbcbe23f43edc48047f2854acea0242aa57e25f"} err="failed to get container status \"ec1ec6ce9c31d4505387d14bdbbcbe23f43edc48047f2854acea0242aa57e25f\": rpc error: code = NotFound desc = could not find container \"ec1ec6ce9c31d4505387d14bdbbcbe23f43edc48047f2854acea0242aa57e25f\": container with ID starting with ec1ec6ce9c31d4505387d14bdbbcbe23f43edc48047f2854acea0242aa57e25f not found: ID does not exist"
Jul 20 13:41:51.503103 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:41:51.503068    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-b738bb-75dd48565b-77mzl"]
Jul 20 13:41:51.505092 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:41:51.505073    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-b738bb-75dd48565b-77mzl"]
Jul 20 13:41:53.096287 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:41:53.096251    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8dea318c-5f2a-4ed6-a153-6eee80c3abfc" path="/var/lib/kubelet/pods/8dea318c-5f2a-4ed6-a153-6eee80c3abfc/volumes"
Jul 20 13:42:06.058035 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:42:06.058002    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-b738bb-openshift-default-7b6d5fb4df-vvl6f"]
Jul 20 13:42:06.058641 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:42:06.058275    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-b738bb-openshift-default-7b6d5fb4df-vvl6f" podUID="e8477791-6b58-46a7-b5f4-39b8ca759919" containerName="istio-proxy" containerID="cri-o://6899a6f19d68eadcec50b9a6996aefcab76250f375e5c9c37f1a99bdca47016d" gracePeriod=30
Jul 20 13:42:07.013155 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:42:07.013122    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-5e9fd6-openshift-default-84cbf7d455-r7bpf"]
Jul 20 13:42:07.013567 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:42:07.013555    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="226617a4-9da0-4305-9435-2d94524bdb24" containerName="istio-proxy"
Jul 20 13:42:07.013616 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:42:07.013569    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="226617a4-9da0-4305-9435-2d94524bdb24" containerName="istio-proxy"
Jul 20 13:42:07.013616 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:42:07.013578    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e781df20-4898-4bb7-8f5b-d11a128c7cb4" containerName="maas-api"
Jul 20 13:42:07.013616 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:42:07.013584    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="e781df20-4898-4bb7-8f5b-d11a128c7cb4" containerName="maas-api"
Jul 20 13:42:07.013616 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:42:07.013599    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8dea318c-5f2a-4ed6-a153-6eee80c3abfc" containerName="maas-api"
Jul 20 13:42:07.013616 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:42:07.013605    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="8dea318c-5f2a-4ed6-a153-6eee80c3abfc" containerName="maas-api"
Jul 20 13:42:07.013616 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:42:07.013616    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="226617a4-9da0-4305-9435-2d94524bdb24" containerName="istio-proxy"
Jul 20 13:42:07.013821 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:42:07.013621    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="226617a4-9da0-4305-9435-2d94524bdb24" containerName="istio-proxy"
Jul 20 13:42:07.013821 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:42:07.013679    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="226617a4-9da0-4305-9435-2d94524bdb24" containerName="istio-proxy"
Jul 20 13:42:07.013821 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:42:07.013687    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="e781df20-4898-4bb7-8f5b-d11a128c7cb4" containerName="maas-api"
Jul 20 13:42:07.013821 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:42:07.013699    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="8dea318c-5f2a-4ed6-a153-6eee80c3abfc" containerName="maas-api"
Jul 20 13:42:07.016903 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:42:07.016879    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-5e9fd6-openshift-default-84cbf7d455-r7bpf"
Jul 20 13:42:07.020476 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:42:07.020453    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-5e9fd6-openshift-default-dockercfg-dlsnv\""
Jul 20 13:42:07.032161 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:42:07.032134    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-5e9fd6-openshift-default-84cbf7d455-r7bpf"]
Jul 20 13:42:07.142217 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:42:07.142175    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fcf8644f-7edd-4803-80d2-4cf300b32912-istio-token\") pod \"e2e-shared-a-5e9fd6-openshift-default-84cbf7d455-r7bpf\" (UID: \"fcf8644f-7edd-4803-80d2-4cf300b32912\") " pod="openshift-ingress/e2e-shared-a-5e9fd6-openshift-default-84cbf7d455-r7bpf"
Jul 20 13:42:07.142217 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:42:07.142217    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pmchd\" (UniqueName: \"kubernetes.io/projected/fcf8644f-7edd-4803-80d2-4cf300b32912-kube-api-access-pmchd\") pod \"e2e-shared-a-5e9fd6-openshift-default-84cbf7d455-r7bpf\" (UID: \"fcf8644f-7edd-4803-80d2-4cf300b32912\") " pod="openshift-ingress/e2e-shared-a-5e9fd6-openshift-default-84cbf7d455-r7bpf"
Jul 20 13:42:07.142663 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:42:07.142240    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fcf8644f-7edd-4803-80d2-4cf300b32912-istio-envoy\") pod \"e2e-shared-a-5e9fd6-openshift-default-84cbf7d455-r7bpf\" (UID: \"fcf8644f-7edd-4803-80d2-4cf300b32912\") " pod="openshift-ingress/e2e-shared-a-5e9fd6-openshift-default-84cbf7d455-r7bpf"
Jul 20 13:42:07.142663 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:42:07.142292    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fcf8644f-7edd-4803-80d2-4cf300b32912-credential-socket\") pod \"e2e-shared-a-5e9fd6-openshift-default-84cbf7d455-r7bpf\" (UID: \"fcf8644f-7edd-4803-80d2-4cf300b32912\") " pod="openshift-ingress/e2e-shared-a-5e9fd6-openshift-default-84cbf7d455-r7bpf"
Jul 20 13:42:07.142663 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:42:07.142394    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fcf8644f-7edd-4803-80d2-4cf300b32912-workload-socket\") pod \"e2e-shared-a-5e9fd6-openshift-default-84cbf7d455-r7bpf\" (UID: \"fcf8644f-7edd-4803-80d2-4cf300b32912\") " pod="openshift-ingress/e2e-shared-a-5e9fd6-openshift-default-84cbf7d455-r7bpf"
Jul 20 13:42:07.142663 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:42:07.142445    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fcf8644f-7edd-4803-80d2-4cf300b32912-istio-data\") pod \"e2e-shared-a-5e9fd6-openshift-default-84cbf7d455-r7bpf\" (UID: \"fcf8644f-7edd-4803-80d2-4cf300b32912\") " pod="openshift-ingress/e2e-shared-a-5e9fd6-openshift-default-84cbf7d455-r7bpf"
Jul 20 13:42:07.142663 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:42:07.142477    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fcf8644f-7edd-4803-80d2-4cf300b32912-istiod-ca-cert\") pod \"e2e-shared-a-5e9fd6-openshift-default-84cbf7d455-r7bpf\" (UID: \"fcf8644f-7edd-4803-80d2-4cf300b32912\") " pod="openshift-ingress/e2e-shared-a-5e9fd6-openshift-default-84cbf7d455-r7bpf"
Jul 20 13:42:07.142663 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:42:07.142502    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fcf8644f-7edd-4803-80d2-4cf300b32912-istio-podinfo\") pod \"e2e-shared-a-5e9fd6-openshift-default-84cbf7d455-r7bpf\" (UID: \"fcf8644f-7edd-4803-80d2-4cf300b32912\") " pod="openshift-ingress/e2e-shared-a-5e9fd6-openshift-default-84cbf7d455-r7bpf"
Jul 20 13:42:07.142663 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:42:07.142559    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fcf8644f-7edd-4803-80d2-4cf300b32912-workload-certs\") pod \"e2e-shared-a-5e9fd6-openshift-default-84cbf7d455-r7bpf\" (UID: \"fcf8644f-7edd-4803-80d2-4cf300b32912\") " pod="openshift-ingress/e2e-shared-a-5e9fd6-openshift-default-84cbf7d455-r7bpf"
Jul 20 13:42:07.243314 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:42:07.243276    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pmchd\" (UniqueName: \"kubernetes.io/projected/fcf8644f-7edd-4803-80d2-4cf300b32912-kube-api-access-pmchd\") pod \"e2e-shared-a-5e9fd6-openshift-default-84cbf7d455-r7bpf\" (UID: \"fcf8644f-7edd-4803-80d2-4cf300b32912\") " pod="openshift-ingress/e2e-shared-a-5e9fd6-openshift-default-84cbf7d455-r7bpf"
Jul 20 13:42:07.243488 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:42:07.243325    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fcf8644f-7edd-4803-80d2-4cf300b32912-istio-envoy\") pod \"e2e-shared-a-5e9fd6-openshift-default-84cbf7d455-r7bpf\" (UID: \"fcf8644f-7edd-4803-80d2-4cf300b32912\") " pod="openshift-ingress/e2e-shared-a-5e9fd6-openshift-default-84cbf7d455-r7bpf"
Jul 20 13:42:07.243488 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:42:07.243371    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fcf8644f-7edd-4803-80d2-4cf300b32912-credential-socket\") pod \"e2e-shared-a-5e9fd6-openshift-default-84cbf7d455-r7bpf\" (UID: \"fcf8644f-7edd-4803-80d2-4cf300b32912\") " pod="openshift-ingress/e2e-shared-a-5e9fd6-openshift-default-84cbf7d455-r7bpf"
Jul 20 13:42:07.243488 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:42:07.243431    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fcf8644f-7edd-4803-80d2-4cf300b32912-workload-socket\") pod \"e2e-shared-a-5e9fd6-openshift-default-84cbf7d455-r7bpf\" (UID: \"fcf8644f-7edd-4803-80d2-4cf300b32912\") " pod="openshift-ingress/e2e-shared-a-5e9fd6-openshift-default-84cbf7d455-r7bpf"
Jul 20 13:42:07.243488 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:42:07.243462    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fcf8644f-7edd-4803-80d2-4cf300b32912-istio-data\") pod \"e2e-shared-a-5e9fd6-openshift-default-84cbf7d455-r7bpf\" (UID: \"fcf8644f-7edd-4803-80d2-4cf300b32912\") " pod="openshift-ingress/e2e-shared-a-5e9fd6-openshift-default-84cbf7d455-r7bpf"
Jul 20 13:42:07.243686 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:42:07.243494    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fcf8644f-7edd-4803-80d2-4cf300b32912-istiod-ca-cert\") pod \"e2e-shared-a-5e9fd6-openshift-default-84cbf7d455-r7bpf\" (UID: \"fcf8644f-7edd-4803-80d2-4cf300b32912\") " pod="openshift-ingress/e2e-shared-a-5e9fd6-openshift-default-84cbf7d455-r7bpf"
Jul 20 13:42:07.243686 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:42:07.243524    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fcf8644f-7edd-4803-80d2-4cf300b32912-istio-podinfo\") pod \"e2e-shared-a-5e9fd6-openshift-default-84cbf7d455-r7bpf\" (UID: \"fcf8644f-7edd-4803-80d2-4cf300b32912\") " pod="openshift-ingress/e2e-shared-a-5e9fd6-openshift-default-84cbf7d455-r7bpf"
Jul 20 13:42:07.243686 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:42:07.243575    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fcf8644f-7edd-4803-80d2-4cf300b32912-workload-certs\") pod \"e2e-shared-a-5e9fd6-openshift-default-84cbf7d455-r7bpf\" (UID: \"fcf8644f-7edd-4803-80d2-4cf300b32912\") " pod="openshift-ingress/e2e-shared-a-5e9fd6-openshift-default-84cbf7d455-r7bpf"
Jul 20 13:42:07.243686 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:42:07.243620    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fcf8644f-7edd-4803-80d2-4cf300b32912-istio-token\") pod \"e2e-shared-a-5e9fd6-openshift-default-84cbf7d455-r7bpf\" (UID: \"fcf8644f-7edd-4803-80d2-4cf300b32912\") " pod="openshift-ingress/e2e-shared-a-5e9fd6-openshift-default-84cbf7d455-r7bpf"
Jul 20 13:42:07.243951 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:42:07.243888    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fcf8644f-7edd-4803-80d2-4cf300b32912-credential-socket\") pod \"e2e-shared-a-5e9fd6-openshift-default-84cbf7d455-r7bpf\" (UID: \"fcf8644f-7edd-4803-80d2-4cf300b32912\") " pod="openshift-ingress/e2e-shared-a-5e9fd6-openshift-default-84cbf7d455-r7bpf"
Jul 20 13:42:07.244041 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:42:07.243943    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fcf8644f-7edd-4803-80d2-4cf300b32912-workload-socket\") pod \"e2e-shared-a-5e9fd6-openshift-default-84cbf7d455-r7bpf\" (UID: \"fcf8644f-7edd-4803-80d2-4cf300b32912\") " pod="openshift-ingress/e2e-shared-a-5e9fd6-openshift-default-84cbf7d455-r7bpf"
Jul 20 13:42:07.244041 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:42:07.243999    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fcf8644f-7edd-4803-80d2-4cf300b32912-workload-certs\") pod \"e2e-shared-a-5e9fd6-openshift-default-84cbf7d455-r7bpf\" (UID: \"fcf8644f-7edd-4803-80d2-4cf300b32912\") " pod="openshift-ingress/e2e-shared-a-5e9fd6-openshift-default-84cbf7d455-r7bpf"
Jul 20 13:42:07.244154 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:42:07.244032    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fcf8644f-7edd-4803-80d2-4cf300b32912-istio-data\") pod \"e2e-shared-a-5e9fd6-openshift-default-84cbf7d455-r7bpf\" (UID: \"fcf8644f-7edd-4803-80d2-4cf300b32912\") " pod="openshift-ingress/e2e-shared-a-5e9fd6-openshift-default-84cbf7d455-r7bpf"
Jul 20 13:42:07.244577 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:42:07.244552    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fcf8644f-7edd-4803-80d2-4cf300b32912-istiod-ca-cert\") pod \"e2e-shared-a-5e9fd6-openshift-default-84cbf7d455-r7bpf\" (UID: \"fcf8644f-7edd-4803-80d2-4cf300b32912\") " pod="openshift-ingress/e2e-shared-a-5e9fd6-openshift-default-84cbf7d455-r7bpf"
Jul 20 13:42:07.245744 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:42:07.245726    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fcf8644f-7edd-4803-80d2-4cf300b32912-istio-envoy\") pod \"e2e-shared-a-5e9fd6-openshift-default-84cbf7d455-r7bpf\" (UID: \"fcf8644f-7edd-4803-80d2-4cf300b32912\") " pod="openshift-ingress/e2e-shared-a-5e9fd6-openshift-default-84cbf7d455-r7bpf"
Jul 20 13:42:07.246091 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:42:07.246071    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fcf8644f-7edd-4803-80d2-4cf300b32912-istio-podinfo\") pod \"e2e-shared-a-5e9fd6-openshift-default-84cbf7d455-r7bpf\" (UID: \"fcf8644f-7edd-4803-80d2-4cf300b32912\") " pod="openshift-ingress/e2e-shared-a-5e9fd6-openshift-default-84cbf7d455-r7bpf"
Jul 20 13:42:07.251662 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:42:07.251635    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fcf8644f-7edd-4803-80d2-4cf300b32912-istio-token\") pod \"e2e-shared-a-5e9fd6-openshift-default-84cbf7d455-r7bpf\" (UID: \"fcf8644f-7edd-4803-80d2-4cf300b32912\") " pod="openshift-ingress/e2e-shared-a-5e9fd6-openshift-default-84cbf7d455-r7bpf"
Jul 20 13:42:07.252529 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:42:07.252500    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pmchd\" (UniqueName: \"kubernetes.io/projected/fcf8644f-7edd-4803-80d2-4cf300b32912-kube-api-access-pmchd\") pod \"e2e-shared-a-5e9fd6-openshift-default-84cbf7d455-r7bpf\" (UID: \"fcf8644f-7edd-4803-80d2-4cf300b32912\") " pod="openshift-ingress/e2e-shared-a-5e9fd6-openshift-default-84cbf7d455-r7bpf"
Jul 20 13:42:07.327636 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:42:07.327543    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-5e9fd6-openshift-default-84cbf7d455-r7bpf"
Jul 20 13:42:07.479908 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:42:07.479882    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-5e9fd6-openshift-default-84cbf7d455-r7bpf"]
Jul 20 13:42:07.482158 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:42:07.482132    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfcf8644f_7edd_4803_80d2_4cf300b32912.slice/crio-194639d563ac6b556ca42e14e63d66dbdf80628b535c8e533af6610c117b30fa WatchSource:0}: Error finding container 194639d563ac6b556ca42e14e63d66dbdf80628b535c8e533af6610c117b30fa: Status 404 returned error can't find the container with id 194639d563ac6b556ca42e14e63d66dbdf80628b535c8e533af6610c117b30fa
Jul 20 13:42:07.484431 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:42:07.484389    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 20 13:42:07.484521 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:42:07.484478    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 20 13:42:07.484561 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:42:07.484527    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 20 13:42:07.565678 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:42:07.565646    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-5e9fd6-openshift-default-84cbf7d455-r7bpf" event={"ID":"fcf8644f-7edd-4803-80d2-4cf300b32912","Type":"ContainerStarted","Data":"67ddbab1a8836d93154e64d3667910fde0cfb2c41200ab55330b089e01678304"}
Jul 20 13:42:07.565835 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:42:07.565701    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-5e9fd6-openshift-default-84cbf7d455-r7bpf" event={"ID":"fcf8644f-7edd-4803-80d2-4cf300b32912","Type":"ContainerStarted","Data":"194639d563ac6b556ca42e14e63d66dbdf80628b535c8e533af6610c117b30fa"}
Jul 20 13:42:07.593259 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:42:07.593163    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-5e9fd6-openshift-default-84cbf7d455-r7bpf" podStartSLOduration=1.593147275 podStartE2EDuration="1.593147275s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 13:42:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 13:42:07.590635677 +0000 UTC m=+2417.307183089" watchObservedRunningTime="2026-07-20 13:42:07.593147275 +0000 UTC m=+2417.309694685"
Jul 20 13:42:08.327819 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:42:08.327787    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-5e9fd6-openshift-default-84cbf7d455-r7bpf"
Jul 20 13:42:08.332807 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:42:08.332783    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-5e9fd6-openshift-default-84cbf7d455-r7bpf"
Jul 20 13:42:08.571794 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:42:08.571764    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-5e9fd6-openshift-default-84cbf7d455-r7bpf"
Jul 20 13:42:08.572747 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:42:08.572726    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-5e9fd6-openshift-default-84cbf7d455-r7bpf"
Jul 20 13:42:08.816305 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:42:08.816267    2584 patch_prober.go:28] interesting pod/e2e-api-b-b738bb-openshift-default-7b6d5fb4df-vvl6f container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 20 13:42:08.816482 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:42:08.816323    2584 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-b-b738bb-openshift-default-7b6d5fb4df-vvl6f" podUID="e8477791-6b58-46a7-b5f4-39b8ca759919" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 20 13:42:09.701170 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:42:09.701138    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-5e9fd6-68fc6dc4d7-txzbm"]
Jul 20 13:42:09.701668 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:42:09.701654    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="226617a4-9da0-4305-9435-2d94524bdb24" containerName="istio-proxy"
Jul 20 13:42:09.704903 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:42:09.704882    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-5e9fd6-68fc6dc4d7-txzbm"
Jul 20 13:42:09.708438 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:42:09.708418    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-5e9fd6-serving-cert\""
Jul 20 13:42:09.708645 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:42:09.708632    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-vf2sw\""
Jul 20 13:42:09.720778 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:42:09.720754    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-5e9fd6-68fc6dc4d7-txzbm"]
Jul 20 13:42:09.773092 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:42:09.773055    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k4jd9\" (UniqueName: \"kubernetes.io/projected/27240daa-9832-4d48-88e4-207ee61b0e8e-kube-api-access-k4jd9\") pod \"maas-api-e2e-shared-a-5e9fd6-68fc6dc4d7-txzbm\" (UID: \"27240daa-9832-4d48-88e4-207ee61b0e8e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-5e9fd6-68fc6dc4d7-txzbm"
Jul 20 13:42:09.773265 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:42:09.773123    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/27240daa-9832-4d48-88e4-207ee61b0e8e-openshift-service-ca\") pod \"maas-api-e2e-shared-a-5e9fd6-68fc6dc4d7-txzbm\" (UID: \"27240daa-9832-4d48-88e4-207ee61b0e8e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-5e9fd6-68fc6dc4d7-txzbm"
Jul 20 13:42:09.773265 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:42:09.773210    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/27240daa-9832-4d48-88e4-207ee61b0e8e-maas-api-tls\") pod \"maas-api-e2e-shared-a-5e9fd6-68fc6dc4d7-txzbm\" (UID: \"27240daa-9832-4d48-88e4-207ee61b0e8e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-5e9fd6-68fc6dc4d7-txzbm"
Jul 20 13:42:09.874190 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:42:09.874147    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/27240daa-9832-4d48-88e4-207ee61b0e8e-maas-api-tls\") pod \"maas-api-e2e-shared-a-5e9fd6-68fc6dc4d7-txzbm\" (UID: \"27240daa-9832-4d48-88e4-207ee61b0e8e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-5e9fd6-68fc6dc4d7-txzbm"
Jul 20 13:42:09.874399 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:42:09.874209    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k4jd9\" (UniqueName: \"kubernetes.io/projected/27240daa-9832-4d48-88e4-207ee61b0e8e-kube-api-access-k4jd9\") pod \"maas-api-e2e-shared-a-5e9fd6-68fc6dc4d7-txzbm\" (UID: \"27240daa-9832-4d48-88e4-207ee61b0e8e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-5e9fd6-68fc6dc4d7-txzbm"
Jul 20 13:42:09.874399 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:42:09.874274    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/27240daa-9832-4d48-88e4-207ee61b0e8e-openshift-service-ca\") pod \"maas-api-e2e-shared-a-5e9fd6-68fc6dc4d7-txzbm\" (UID: \"27240daa-9832-4d48-88e4-207ee61b0e8e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-5e9fd6-68fc6dc4d7-txzbm"
Jul 20 13:42:09.874399 ip-10-0-134-121 kubenswrapper[2584]: E0720 13:42:09.874305    2584 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-a-5e9fd6-serving-cert: secret "maas-api-e2e-shared-a-5e9fd6-serving-cert" not found
Jul 20 13:42:09.874399 ip-10-0-134-121 kubenswrapper[2584]: E0720 13:42:09.874393    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/27240daa-9832-4d48-88e4-207ee61b0e8e-maas-api-tls podName:27240daa-9832-4d48-88e4-207ee61b0e8e nodeName:}" failed. No retries permitted until 2026-07-20 13:42:10.374370339 +0000 UTC m=+2420.090917727 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/27240daa-9832-4d48-88e4-207ee61b0e8e-maas-api-tls") pod "maas-api-e2e-shared-a-5e9fd6-68fc6dc4d7-txzbm" (UID: "27240daa-9832-4d48-88e4-207ee61b0e8e") : secret "maas-api-e2e-shared-a-5e9fd6-serving-cert" not found
Jul 20 13:42:09.875034 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:42:09.875017    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/27240daa-9832-4d48-88e4-207ee61b0e8e-openshift-service-ca\") pod \"maas-api-e2e-shared-a-5e9fd6-68fc6dc4d7-txzbm\" (UID: \"27240daa-9832-4d48-88e4-207ee61b0e8e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-5e9fd6-68fc6dc4d7-txzbm"
Jul 20 13:42:09.895805 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:42:09.895777    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k4jd9\" (UniqueName: \"kubernetes.io/projected/27240daa-9832-4d48-88e4-207ee61b0e8e-kube-api-access-k4jd9\") pod \"maas-api-e2e-shared-a-5e9fd6-68fc6dc4d7-txzbm\" (UID: \"27240daa-9832-4d48-88e4-207ee61b0e8e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-5e9fd6-68fc6dc4d7-txzbm"
Jul 20 13:42:10.379835 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:42:10.379793    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/27240daa-9832-4d48-88e4-207ee61b0e8e-maas-api-tls\") pod \"maas-api-e2e-shared-a-5e9fd6-68fc6dc4d7-txzbm\" (UID: \"27240daa-9832-4d48-88e4-207ee61b0e8e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-5e9fd6-68fc6dc4d7-txzbm"
Jul 20 13:42:10.382519 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:42:10.382487    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/27240daa-9832-4d48-88e4-207ee61b0e8e-maas-api-tls\") pod \"maas-api-e2e-shared-a-5e9fd6-68fc6dc4d7-txzbm\" (UID: \"27240daa-9832-4d48-88e4-207ee61b0e8e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-5e9fd6-68fc6dc4d7-txzbm"
Jul 20 13:42:10.615262 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:42:10.615228    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-5e9fd6-68fc6dc4d7-txzbm"
Jul 20 13:42:10.769052 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:42:10.769028    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-5e9fd6-68fc6dc4d7-txzbm"]
Jul 20 13:42:10.771291 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:42:10.771252    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod27240daa_9832_4d48_88e4_207ee61b0e8e.slice/crio-56af748f1ff8228e46e95a5e95f30079db3eecadfb11b353e6976e676c659317 WatchSource:0}: Error finding container 56af748f1ff8228e46e95a5e95f30079db3eecadfb11b353e6976e676c659317: Status 404 returned error can't find the container with id 56af748f1ff8228e46e95a5e95f30079db3eecadfb11b353e6976e676c659317
Jul 20 13:42:11.330235 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:42:11.330175    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-b738bb-openshift-default-7b6d5fb4df-vvl6f"
Jul 20 13:42:11.502280 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:42:11.502250    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e8477791-6b58-46a7-b5f4-39b8ca759919-istio-envoy\") pod \"e8477791-6b58-46a7-b5f4-39b8ca759919\" (UID: \"e8477791-6b58-46a7-b5f4-39b8ca759919\") "
Jul 20 13:42:11.502484 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:42:11.502309    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e8477791-6b58-46a7-b5f4-39b8ca759919-istiod-ca-cert\") pod \"e8477791-6b58-46a7-b5f4-39b8ca759919\" (UID: \"e8477791-6b58-46a7-b5f4-39b8ca759919\") "
Jul 20 13:42:11.502484 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:42:11.502335    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e8477791-6b58-46a7-b5f4-39b8ca759919-istio-token\") pod \"e8477791-6b58-46a7-b5f4-39b8ca759919\" (UID: \"e8477791-6b58-46a7-b5f4-39b8ca759919\") "
Jul 20 13:42:11.502484 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:42:11.502360    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e8477791-6b58-46a7-b5f4-39b8ca759919-istio-data\") pod \"e8477791-6b58-46a7-b5f4-39b8ca759919\" (UID: \"e8477791-6b58-46a7-b5f4-39b8ca759919\") "
Jul 20 13:42:11.502484 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:42:11.502393    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e8477791-6b58-46a7-b5f4-39b8ca759919-istio-podinfo\") pod \"e8477791-6b58-46a7-b5f4-39b8ca759919\" (UID: \"e8477791-6b58-46a7-b5f4-39b8ca759919\") "
Jul 20 13:42:11.502484 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:42:11.502453    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e8477791-6b58-46a7-b5f4-39b8ca759919-workload-socket\") pod \"e8477791-6b58-46a7-b5f4-39b8ca759919\" (UID: \"e8477791-6b58-46a7-b5f4-39b8ca759919\") "
Jul 20 13:42:11.502763 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:42:11.502544    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e8477791-6b58-46a7-b5f4-39b8ca759919-workload-certs\") pod \"e8477791-6b58-46a7-b5f4-39b8ca759919\" (UID: \"e8477791-6b58-46a7-b5f4-39b8ca759919\") "
Jul 20 13:42:11.502763 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:42:11.502596    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e8477791-6b58-46a7-b5f4-39b8ca759919-credential-socket\") pod \"e8477791-6b58-46a7-b5f4-39b8ca759919\" (UID: \"e8477791-6b58-46a7-b5f4-39b8ca759919\") "
Jul 20 13:42:11.502763 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:42:11.502651    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9fdqc\" (UniqueName: \"kubernetes.io/projected/e8477791-6b58-46a7-b5f4-39b8ca759919-kube-api-access-9fdqc\") pod \"e8477791-6b58-46a7-b5f4-39b8ca759919\" (UID: \"e8477791-6b58-46a7-b5f4-39b8ca759919\") "
Jul 20 13:42:11.502911 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:42:11.502778    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e8477791-6b58-46a7-b5f4-39b8ca759919-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "e8477791-6b58-46a7-b5f4-39b8ca759919" (UID: "e8477791-6b58-46a7-b5f4-39b8ca759919"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 13:42:11.503329 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:42:11.503033    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e8477791-6b58-46a7-b5f4-39b8ca759919-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "e8477791-6b58-46a7-b5f4-39b8ca759919" (UID: "e8477791-6b58-46a7-b5f4-39b8ca759919"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 13:42:11.503329 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:42:11.503162    2584 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e8477791-6b58-46a7-b5f4-39b8ca759919-workload-certs\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 20 13:42:11.503329 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:42:11.503181    2584 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e8477791-6b58-46a7-b5f4-39b8ca759919-istiod-ca-cert\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 20 13:42:11.503329 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:42:11.503233    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e8477791-6b58-46a7-b5f4-39b8ca759919-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "e8477791-6b58-46a7-b5f4-39b8ca759919" (UID: "e8477791-6b58-46a7-b5f4-39b8ca759919"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 13:42:11.503329 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:42:11.503293    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e8477791-6b58-46a7-b5f4-39b8ca759919-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "e8477791-6b58-46a7-b5f4-39b8ca759919" (UID: "e8477791-6b58-46a7-b5f4-39b8ca759919"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 13:42:11.503676 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:42:11.503361    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e8477791-6b58-46a7-b5f4-39b8ca759919-istio-data" (OuterVolumeSpecName: "istio-data") pod "e8477791-6b58-46a7-b5f4-39b8ca759919" (UID: "e8477791-6b58-46a7-b5f4-39b8ca759919"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 13:42:11.504673 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:42:11.504652    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e8477791-6b58-46a7-b5f4-39b8ca759919-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "e8477791-6b58-46a7-b5f4-39b8ca759919" (UID: "e8477791-6b58-46a7-b5f4-39b8ca759919"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 13:42:11.504764 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:42:11.504742    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e8477791-6b58-46a7-b5f4-39b8ca759919-kube-api-access-9fdqc" (OuterVolumeSpecName: "kube-api-access-9fdqc") pod "e8477791-6b58-46a7-b5f4-39b8ca759919" (UID: "e8477791-6b58-46a7-b5f4-39b8ca759919"). InnerVolumeSpecName "kube-api-access-9fdqc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 13:42:11.505021 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:42:11.504993    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/e8477791-6b58-46a7-b5f4-39b8ca759919-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "e8477791-6b58-46a7-b5f4-39b8ca759919" (UID: "e8477791-6b58-46a7-b5f4-39b8ca759919"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 20 13:42:11.505115 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:42:11.505027    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e8477791-6b58-46a7-b5f4-39b8ca759919-istio-token" (OuterVolumeSpecName: "istio-token") pod "e8477791-6b58-46a7-b5f4-39b8ca759919" (UID: "e8477791-6b58-46a7-b5f4-39b8ca759919"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 13:42:11.591927 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:42:11.591836    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-5e9fd6-68fc6dc4d7-txzbm" event={"ID":"27240daa-9832-4d48-88e4-207ee61b0e8e","Type":"ContainerStarted","Data":"45e204ba29883ff3dd09813419faae3557764fdca3230a109b764aeeb24f01dc"}
Jul 20 13:42:11.591927 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:42:11.591906    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-5e9fd6-68fc6dc4d7-txzbm" event={"ID":"27240daa-9832-4d48-88e4-207ee61b0e8e","Type":"ContainerStarted","Data":"56af748f1ff8228e46e95a5e95f30079db3eecadfb11b353e6976e676c659317"}
Jul 20 13:42:11.592286 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:42:11.591939    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-5e9fd6-68fc6dc4d7-txzbm"
Jul 20 13:42:11.593409 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:42:11.593383    2584 generic.go:356] "Generic (PLEG): container finished" podID="e8477791-6b58-46a7-b5f4-39b8ca759919" containerID="6899a6f19d68eadcec50b9a6996aefcab76250f375e5c9c37f1a99bdca47016d" exitCode=0
Jul 20 13:42:11.593537 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:42:11.593460    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-b738bb-openshift-default-7b6d5fb4df-vvl6f" event={"ID":"e8477791-6b58-46a7-b5f4-39b8ca759919","Type":"ContainerDied","Data":"6899a6f19d68eadcec50b9a6996aefcab76250f375e5c9c37f1a99bdca47016d"}
Jul 20 13:42:11.593537 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:42:11.593474    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-b738bb-openshift-default-7b6d5fb4df-vvl6f"
Jul 20 13:42:11.593537 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:42:11.593501    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-b738bb-openshift-default-7b6d5fb4df-vvl6f" event={"ID":"e8477791-6b58-46a7-b5f4-39b8ca759919","Type":"ContainerDied","Data":"6cadc7c1e67ecc36cac6af46e0ec44e0df217815b3856a3bb9e1daaed3b3e67d"}
Jul 20 13:42:11.593537 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:42:11.593529    2584 scope.go:117] "RemoveContainer" containerID="6899a6f19d68eadcec50b9a6996aefcab76250f375e5c9c37f1a99bdca47016d"
Jul 20 13:42:11.603834 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:42:11.603812    2584 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e8477791-6b58-46a7-b5f4-39b8ca759919-credential-socket\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 20 13:42:11.603951 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:42:11.603838    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9fdqc\" (UniqueName: \"kubernetes.io/projected/e8477791-6b58-46a7-b5f4-39b8ca759919-kube-api-access-9fdqc\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 20 13:42:11.603951 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:42:11.603850    2584 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e8477791-6b58-46a7-b5f4-39b8ca759919-istio-envoy\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 20 13:42:11.603951 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:42:11.603860    2584 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e8477791-6b58-46a7-b5f4-39b8ca759919-istio-token\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 20 13:42:11.603951 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:42:11.603872    2584 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e8477791-6b58-46a7-b5f4-39b8ca759919-istio-data\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 20 13:42:11.603951 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:42:11.603884    2584 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e8477791-6b58-46a7-b5f4-39b8ca759919-istio-podinfo\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 20 13:42:11.603951 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:42:11.603895    2584 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e8477791-6b58-46a7-b5f4-39b8ca759919-workload-socket\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 20 13:42:11.604654 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:42:11.604637    2584 scope.go:117] "RemoveContainer" containerID="97ee7def7a6e73dd4adf7afdf7662745f6fbdacd2c0dc6e12d796365929007dc"
Jul 20 13:42:11.610430 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:42:11.610387    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-5e9fd6-68fc6dc4d7-txzbm" podStartSLOduration=2.047295004 podStartE2EDuration="2.610372508s" totalImagesPullingTime="563.077504ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 13:42:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 13:42:11.608460471 +0000 UTC m=+2421.325007883" watchObservedRunningTime="2026-07-20 13:42:11.610372508 +0000 UTC m=+2421.326919920"
Jul 20 13:42:11.615812 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:42:11.615789    2584 scope.go:117] "RemoveContainer" containerID="6899a6f19d68eadcec50b9a6996aefcab76250f375e5c9c37f1a99bdca47016d"
Jul 20 13:42:11.616083 ip-10-0-134-121 kubenswrapper[2584]: E0720 13:42:11.616054    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6899a6f19d68eadcec50b9a6996aefcab76250f375e5c9c37f1a99bdca47016d\": container with ID starting with 6899a6f19d68eadcec50b9a6996aefcab76250f375e5c9c37f1a99bdca47016d not found: ID does not exist" containerID="6899a6f19d68eadcec50b9a6996aefcab76250f375e5c9c37f1a99bdca47016d"
Jul 20 13:42:11.616191 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:42:11.616090    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6899a6f19d68eadcec50b9a6996aefcab76250f375e5c9c37f1a99bdca47016d"} err="failed to get container status \"6899a6f19d68eadcec50b9a6996aefcab76250f375e5c9c37f1a99bdca47016d\": rpc error: code = NotFound desc = could not find container \"6899a6f19d68eadcec50b9a6996aefcab76250f375e5c9c37f1a99bdca47016d\": container with ID starting with 6899a6f19d68eadcec50b9a6996aefcab76250f375e5c9c37f1a99bdca47016d not found: ID does not exist"
Jul 20 13:42:11.616191 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:42:11.616113    2584 scope.go:117] "RemoveContainer" containerID="97ee7def7a6e73dd4adf7afdf7662745f6fbdacd2c0dc6e12d796365929007dc"
Jul 20 13:42:11.616379 ip-10-0-134-121 kubenswrapper[2584]: E0720 13:42:11.616358    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"97ee7def7a6e73dd4adf7afdf7662745f6fbdacd2c0dc6e12d796365929007dc\": container with ID starting with 97ee7def7a6e73dd4adf7afdf7662745f6fbdacd2c0dc6e12d796365929007dc not found: ID does not exist" containerID="97ee7def7a6e73dd4adf7afdf7662745f6fbdacd2c0dc6e12d796365929007dc"
Jul 20 13:42:11.616458 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:42:11.616387    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"97ee7def7a6e73dd4adf7afdf7662745f6fbdacd2c0dc6e12d796365929007dc"} err="failed to get container status \"97ee7def7a6e73dd4adf7afdf7662745f6fbdacd2c0dc6e12d796365929007dc\": rpc error: code = NotFound desc = could not find container \"97ee7def7a6e73dd4adf7afdf7662745f6fbdacd2c0dc6e12d796365929007dc\": container with ID starting with 97ee7def7a6e73dd4adf7afdf7662745f6fbdacd2c0dc6e12d796365929007dc not found: ID does not exist"
Jul 20 13:42:11.623071 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:42:11.623048    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-b738bb-openshift-default-7b6d5fb4df-vvl6f"]
Jul 20 13:42:11.632638 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:42:11.632609    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-b738bb-openshift-default-7b6d5fb4df-vvl6f"]
Jul 20 13:42:13.096088 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:42:13.096009    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e8477791-6b58-46a7-b5f4-39b8ca759919" path="/var/lib/kubelet/pods/e8477791-6b58-46a7-b5f4-39b8ca759919/volumes"
Jul 20 13:42:14.735339 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:42:14.735310    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-a69896-openshift-default-69f5488d99-b6cwh"]
Jul 20 13:42:14.735909 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:42:14.735890    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e8477791-6b58-46a7-b5f4-39b8ca759919" containerName="istio-proxy"
Jul 20 13:42:14.735909 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:42:14.735911    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="e8477791-6b58-46a7-b5f4-39b8ca759919" containerName="istio-proxy"
Jul 20 13:42:14.736051 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:42:14.736039    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="e8477791-6b58-46a7-b5f4-39b8ca759919" containerName="istio-proxy"
Jul 20 13:42:14.736051 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:42:14.736050    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="e8477791-6b58-46a7-b5f4-39b8ca759919" containerName="istio-proxy"
Jul 20 13:42:14.740667 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:42:14.740641    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-a69896-openshift-default-69f5488d99-b6cwh"
Jul 20 13:42:14.743213 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:42:14.743189    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-a69896-openshift-default-dockercfg-djvxv\""
Jul 20 13:42:14.756153 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:42:14.756124    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-a69896-openshift-default-69f5488d99-b6cwh"]
Jul 20 13:42:14.834847 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:42:14.834809    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/444f22c0-f5d6-4122-aba5-d8758f13fee2-istio-data\") pod \"e2e-shared-b-a69896-openshift-default-69f5488d99-b6cwh\" (UID: \"444f22c0-f5d6-4122-aba5-d8758f13fee2\") " pod="openshift-ingress/e2e-shared-b-a69896-openshift-default-69f5488d99-b6cwh"
Jul 20 13:42:14.835087 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:42:14.834854    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/444f22c0-f5d6-4122-aba5-d8758f13fee2-credential-socket\") pod \"e2e-shared-b-a69896-openshift-default-69f5488d99-b6cwh\" (UID: \"444f22c0-f5d6-4122-aba5-d8758f13fee2\") " pod="openshift-ingress/e2e-shared-b-a69896-openshift-default-69f5488d99-b6cwh"
Jul 20 13:42:14.835087 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:42:14.834887    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/444f22c0-f5d6-4122-aba5-d8758f13fee2-istio-token\") pod \"e2e-shared-b-a69896-openshift-default-69f5488d99-b6cwh\" (UID: \"444f22c0-f5d6-4122-aba5-d8758f13fee2\") " pod="openshift-ingress/e2e-shared-b-a69896-openshift-default-69f5488d99-b6cwh"
Jul 20 13:42:14.835087 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:42:14.835026    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jbbft\" (UniqueName: \"kubernetes.io/projected/444f22c0-f5d6-4122-aba5-d8758f13fee2-kube-api-access-jbbft\") pod \"e2e-shared-b-a69896-openshift-default-69f5488d99-b6cwh\" (UID: \"444f22c0-f5d6-4122-aba5-d8758f13fee2\") " pod="openshift-ingress/e2e-shared-b-a69896-openshift-default-69f5488d99-b6cwh"
Jul 20 13:42:14.835277 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:42:14.835103    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/444f22c0-f5d6-4122-aba5-d8758f13fee2-workload-certs\") pod \"e2e-shared-b-a69896-openshift-default-69f5488d99-b6cwh\" (UID: \"444f22c0-f5d6-4122-aba5-d8758f13fee2\") " pod="openshift-ingress/e2e-shared-b-a69896-openshift-default-69f5488d99-b6cwh"
Jul 20 13:42:14.835277 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:42:14.835138    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/444f22c0-f5d6-4122-aba5-d8758f13fee2-istio-podinfo\") pod \"e2e-shared-b-a69896-openshift-default-69f5488d99-b6cwh\" (UID: \"444f22c0-f5d6-4122-aba5-d8758f13fee2\") " pod="openshift-ingress/e2e-shared-b-a69896-openshift-default-69f5488d99-b6cwh"
Jul 20 13:42:14.835391 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:42:14.835288    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/444f22c0-f5d6-4122-aba5-d8758f13fee2-istiod-ca-cert\") pod \"e2e-shared-b-a69896-openshift-default-69f5488d99-b6cwh\" (UID: \"444f22c0-f5d6-4122-aba5-d8758f13fee2\") " pod="openshift-ingress/e2e-shared-b-a69896-openshift-default-69f5488d99-b6cwh"
Jul 20 13:42:14.835391 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:42:14.835336    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/444f22c0-f5d6-4122-aba5-d8758f13fee2-istio-envoy\") pod \"e2e-shared-b-a69896-openshift-default-69f5488d99-b6cwh\" (UID: \"444f22c0-f5d6-4122-aba5-d8758f13fee2\") " pod="openshift-ingress/e2e-shared-b-a69896-openshift-default-69f5488d99-b6cwh"
Jul 20 13:42:14.835391 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:42:14.835362    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/444f22c0-f5d6-4122-aba5-d8758f13fee2-workload-socket\") pod \"e2e-shared-b-a69896-openshift-default-69f5488d99-b6cwh\" (UID: \"444f22c0-f5d6-4122-aba5-d8758f13fee2\") " pod="openshift-ingress/e2e-shared-b-a69896-openshift-default-69f5488d99-b6cwh"
Jul 20 13:42:14.936665 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:42:14.936625    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/444f22c0-f5d6-4122-aba5-d8758f13fee2-istio-data\") pod \"e2e-shared-b-a69896-openshift-default-69f5488d99-b6cwh\" (UID: \"444f22c0-f5d6-4122-aba5-d8758f13fee2\") " pod="openshift-ingress/e2e-shared-b-a69896-openshift-default-69f5488d99-b6cwh"
Jul 20 13:42:14.936665 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:42:14.936668    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/444f22c0-f5d6-4122-aba5-d8758f13fee2-credential-socket\") pod \"e2e-shared-b-a69896-openshift-default-69f5488d99-b6cwh\" (UID: \"444f22c0-f5d6-4122-aba5-d8758f13fee2\") " pod="openshift-ingress/e2e-shared-b-a69896-openshift-default-69f5488d99-b6cwh"
Jul 20 13:42:14.936932 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:42:14.936689    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/444f22c0-f5d6-4122-aba5-d8758f13fee2-istio-token\") pod \"e2e-shared-b-a69896-openshift-default-69f5488d99-b6cwh\" (UID: \"444f22c0-f5d6-4122-aba5-d8758f13fee2\") " pod="openshift-ingress/e2e-shared-b-a69896-openshift-default-69f5488d99-b6cwh"
Jul 20 13:42:14.936932 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:42:14.936728    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jbbft\" (UniqueName: \"kubernetes.io/projected/444f22c0-f5d6-4122-aba5-d8758f13fee2-kube-api-access-jbbft\") pod \"e2e-shared-b-a69896-openshift-default-69f5488d99-b6cwh\" (UID: \"444f22c0-f5d6-4122-aba5-d8758f13fee2\") " pod="openshift-ingress/e2e-shared-b-a69896-openshift-default-69f5488d99-b6cwh"
Jul 20 13:42:14.936932 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:42:14.936771    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/444f22c0-f5d6-4122-aba5-d8758f13fee2-workload-certs\") pod \"e2e-shared-b-a69896-openshift-default-69f5488d99-b6cwh\" (UID: \"444f22c0-f5d6-4122-aba5-d8758f13fee2\") " pod="openshift-ingress/e2e-shared-b-a69896-openshift-default-69f5488d99-b6cwh"
Jul 20 13:42:14.936932 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:42:14.936802    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/444f22c0-f5d6-4122-aba5-d8758f13fee2-istio-podinfo\") pod \"e2e-shared-b-a69896-openshift-default-69f5488d99-b6cwh\" (UID: \"444f22c0-f5d6-4122-aba5-d8758f13fee2\") " pod="openshift-ingress/e2e-shared-b-a69896-openshift-default-69f5488d99-b6cwh"
Jul 20 13:42:14.936932 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:42:14.936887    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/444f22c0-f5d6-4122-aba5-d8758f13fee2-istiod-ca-cert\") pod \"e2e-shared-b-a69896-openshift-default-69f5488d99-b6cwh\" (UID: \"444f22c0-f5d6-4122-aba5-d8758f13fee2\") " pod="openshift-ingress/e2e-shared-b-a69896-openshift-default-69f5488d99-b6cwh"
Jul 20 13:42:14.936932 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:42:14.936927    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/444f22c0-f5d6-4122-aba5-d8758f13fee2-istio-envoy\") pod \"e2e-shared-b-a69896-openshift-default-69f5488d99-b6cwh\" (UID: \"444f22c0-f5d6-4122-aba5-d8758f13fee2\") " pod="openshift-ingress/e2e-shared-b-a69896-openshift-default-69f5488d99-b6cwh"
Jul 20 13:42:14.937294 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:42:14.936952    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/444f22c0-f5d6-4122-aba5-d8758f13fee2-workload-socket\") pod \"e2e-shared-b-a69896-openshift-default-69f5488d99-b6cwh\" (UID: \"444f22c0-f5d6-4122-aba5-d8758f13fee2\") " pod="openshift-ingress/e2e-shared-b-a69896-openshift-default-69f5488d99-b6cwh"
Jul 20 13:42:14.937294 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:42:14.937163    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/444f22c0-f5d6-4122-aba5-d8758f13fee2-istio-data\") pod \"e2e-shared-b-a69896-openshift-default-69f5488d99-b6cwh\" (UID: \"444f22c0-f5d6-4122-aba5-d8758f13fee2\") " pod="openshift-ingress/e2e-shared-b-a69896-openshift-default-69f5488d99-b6cwh"
Jul 20 13:42:14.937387 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:42:14.937309    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/444f22c0-f5d6-4122-aba5-d8758f13fee2-workload-certs\") pod \"e2e-shared-b-a69896-openshift-default-69f5488d99-b6cwh\" (UID: \"444f22c0-f5d6-4122-aba5-d8758f13fee2\") " pod="openshift-ingress/e2e-shared-b-a69896-openshift-default-69f5488d99-b6cwh"
Jul 20 13:42:14.937387 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:42:14.937357    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/444f22c0-f5d6-4122-aba5-d8758f13fee2-workload-socket\") pod \"e2e-shared-b-a69896-openshift-default-69f5488d99-b6cwh\" (UID: \"444f22c0-f5d6-4122-aba5-d8758f13fee2\") " pod="openshift-ingress/e2e-shared-b-a69896-openshift-default-69f5488d99-b6cwh"
Jul 20 13:42:14.937387 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:42:14.937323    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/444f22c0-f5d6-4122-aba5-d8758f13fee2-credential-socket\") pod \"e2e-shared-b-a69896-openshift-default-69f5488d99-b6cwh\" (UID: \"444f22c0-f5d6-4122-aba5-d8758f13fee2\") " pod="openshift-ingress/e2e-shared-b-a69896-openshift-default-69f5488d99-b6cwh"
Jul 20 13:42:14.937674 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:42:14.937651    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/444f22c0-f5d6-4122-aba5-d8758f13fee2-istiod-ca-cert\") pod \"e2e-shared-b-a69896-openshift-default-69f5488d99-b6cwh\" (UID: \"444f22c0-f5d6-4122-aba5-d8758f13fee2\") " pod="openshift-ingress/e2e-shared-b-a69896-openshift-default-69f5488d99-b6cwh"
Jul 20 13:42:14.939243 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:42:14.939223    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/444f22c0-f5d6-4122-aba5-d8758f13fee2-istio-envoy\") pod \"e2e-shared-b-a69896-openshift-default-69f5488d99-b6cwh\" (UID: \"444f22c0-f5d6-4122-aba5-d8758f13fee2\") " pod="openshift-ingress/e2e-shared-b-a69896-openshift-default-69f5488d99-b6cwh"
Jul 20 13:42:14.939605 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:42:14.939573    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/444f22c0-f5d6-4122-aba5-d8758f13fee2-istio-podinfo\") pod \"e2e-shared-b-a69896-openshift-default-69f5488d99-b6cwh\" (UID: \"444f22c0-f5d6-4122-aba5-d8758f13fee2\") " pod="openshift-ingress/e2e-shared-b-a69896-openshift-default-69f5488d99-b6cwh"
Jul 20 13:42:14.945173 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:42:14.945153    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jbbft\" (UniqueName: \"kubernetes.io/projected/444f22c0-f5d6-4122-aba5-d8758f13fee2-kube-api-access-jbbft\") pod \"e2e-shared-b-a69896-openshift-default-69f5488d99-b6cwh\" (UID: \"444f22c0-f5d6-4122-aba5-d8758f13fee2\") " pod="openshift-ingress/e2e-shared-b-a69896-openshift-default-69f5488d99-b6cwh"
Jul 20 13:42:14.946508 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:42:14.946483    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/444f22c0-f5d6-4122-aba5-d8758f13fee2-istio-token\") pod \"e2e-shared-b-a69896-openshift-default-69f5488d99-b6cwh\" (UID: \"444f22c0-f5d6-4122-aba5-d8758f13fee2\") " pod="openshift-ingress/e2e-shared-b-a69896-openshift-default-69f5488d99-b6cwh"
Jul 20 13:42:15.052613 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:42:15.052566    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-a69896-openshift-default-69f5488d99-b6cwh"
Jul 20 13:42:15.214710 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:42:15.214672    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-a69896-openshift-default-69f5488d99-b6cwh"]
Jul 20 13:42:15.215391 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:42:15.215363    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod444f22c0_f5d6_4122_aba5_d8758f13fee2.slice/crio-b2027eab80765b443911ee02be902b44616f53b2a7086272d3407394addbe7e0 WatchSource:0}: Error finding container b2027eab80765b443911ee02be902b44616f53b2a7086272d3407394addbe7e0: Status 404 returned error can't find the container with id b2027eab80765b443911ee02be902b44616f53b2a7086272d3407394addbe7e0
Jul 20 13:42:15.218433 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:42:15.218394    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 20 13:42:15.218546 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:42:15.218489    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 20 13:42:15.218546 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:42:15.218537    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 20 13:42:15.624732 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:42:15.624691    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-a69896-openshift-default-69f5488d99-b6cwh" event={"ID":"444f22c0-f5d6-4122-aba5-d8758f13fee2","Type":"ContainerStarted","Data":"6a63d1f5b76916118dc5bec0243c281e329f33230e03b044b12bffa1e85d40df"}
Jul 20 13:42:15.625032 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:42:15.625010    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-a69896-openshift-default-69f5488d99-b6cwh" event={"ID":"444f22c0-f5d6-4122-aba5-d8758f13fee2","Type":"ContainerStarted","Data":"b2027eab80765b443911ee02be902b44616f53b2a7086272d3407394addbe7e0"}
Jul 20 13:42:15.652274 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:42:15.652211    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-a69896-openshift-default-69f5488d99-b6cwh" podStartSLOduration=1.652187262 podStartE2EDuration="1.652187262s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 13:42:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 13:42:15.651558611 +0000 UTC m=+2425.368106023" watchObservedRunningTime="2026-07-20 13:42:15.652187262 +0000 UTC m=+2425.368734673"
Jul 20 13:42:16.053399 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:42:16.053352    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-a69896-openshift-default-69f5488d99-b6cwh"
Jul 20 13:42:16.058942 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:42:16.058914    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-a69896-openshift-default-69f5488d99-b6cwh"
Jul 20 13:42:16.633829 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:42:16.633794    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-a69896-openshift-default-69f5488d99-b6cwh"
Jul 20 13:42:16.639453 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:42:16.639421    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-a69896-openshift-default-69f5488d99-b6cwh"
Jul 20 13:42:17.607668 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:42:17.607637    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-5e9fd6-68fc6dc4d7-txzbm"
Jul 20 13:42:17.916748 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:42:17.916669    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-a69896-66969579f4-25lw9"]
Jul 20 13:42:17.917219 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:42:17.917205    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e8477791-6b58-46a7-b5f4-39b8ca759919" containerName="istio-proxy"
Jul 20 13:42:17.917272 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:42:17.917221    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="e8477791-6b58-46a7-b5f4-39b8ca759919" containerName="istio-proxy"
Jul 20 13:42:17.920876 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:42:17.920854    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-a69896-66969579f4-25lw9"
Jul 20 13:42:17.926072 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:42:17.925791    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-a69896-serving-cert\""
Jul 20 13:42:17.935893 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:42:17.934775    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-a69896-66969579f4-25lw9"]
Jul 20 13:42:18.072930 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:42:18.072890    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e9e96e68-82cf-4f77-8bff-9a06e5587b9b-openshift-service-ca\") pod \"maas-api-e2e-shared-b-a69896-66969579f4-25lw9\" (UID: \"e9e96e68-82cf-4f77-8bff-9a06e5587b9b\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-a69896-66969579f4-25lw9"
Jul 20 13:42:18.073163 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:42:18.073044    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e9e96e68-82cf-4f77-8bff-9a06e5587b9b-maas-api-tls\") pod \"maas-api-e2e-shared-b-a69896-66969579f4-25lw9\" (UID: \"e9e96e68-82cf-4f77-8bff-9a06e5587b9b\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-a69896-66969579f4-25lw9"
Jul 20 13:42:18.073241 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:42:18.073211    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g5jhx\" (UniqueName: \"kubernetes.io/projected/e9e96e68-82cf-4f77-8bff-9a06e5587b9b-kube-api-access-g5jhx\") pod \"maas-api-e2e-shared-b-a69896-66969579f4-25lw9\" (UID: \"e9e96e68-82cf-4f77-8bff-9a06e5587b9b\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-a69896-66969579f4-25lw9"
Jul 20 13:42:18.173836 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:42:18.173733    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g5jhx\" (UniqueName: \"kubernetes.io/projected/e9e96e68-82cf-4f77-8bff-9a06e5587b9b-kube-api-access-g5jhx\") pod \"maas-api-e2e-shared-b-a69896-66969579f4-25lw9\" (UID: \"e9e96e68-82cf-4f77-8bff-9a06e5587b9b\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-a69896-66969579f4-25lw9"
Jul 20 13:42:18.173836 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:42:18.173824    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e9e96e68-82cf-4f77-8bff-9a06e5587b9b-openshift-service-ca\") pod \"maas-api-e2e-shared-b-a69896-66969579f4-25lw9\" (UID: \"e9e96e68-82cf-4f77-8bff-9a06e5587b9b\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-a69896-66969579f4-25lw9"
Jul 20 13:42:18.174117 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:42:18.173902    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e9e96e68-82cf-4f77-8bff-9a06e5587b9b-maas-api-tls\") pod \"maas-api-e2e-shared-b-a69896-66969579f4-25lw9\" (UID: \"e9e96e68-82cf-4f77-8bff-9a06e5587b9b\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-a69896-66969579f4-25lw9"
Jul 20 13:42:18.174117 ip-10-0-134-121 kubenswrapper[2584]: E0720 13:42:18.174048    2584 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-b-a69896-serving-cert: secret "maas-api-e2e-shared-b-a69896-serving-cert" not found
Jul 20 13:42:18.174225 ip-10-0-134-121 kubenswrapper[2584]: E0720 13:42:18.174143    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e9e96e68-82cf-4f77-8bff-9a06e5587b9b-maas-api-tls podName:e9e96e68-82cf-4f77-8bff-9a06e5587b9b nodeName:}" failed. No retries permitted until 2026-07-20 13:42:18.674116062 +0000 UTC m=+2428.390663468 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/e9e96e68-82cf-4f77-8bff-9a06e5587b9b-maas-api-tls") pod "maas-api-e2e-shared-b-a69896-66969579f4-25lw9" (UID: "e9e96e68-82cf-4f77-8bff-9a06e5587b9b") : secret "maas-api-e2e-shared-b-a69896-serving-cert" not found
Jul 20 13:42:18.174672 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:42:18.174646    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e9e96e68-82cf-4f77-8bff-9a06e5587b9b-openshift-service-ca\") pod \"maas-api-e2e-shared-b-a69896-66969579f4-25lw9\" (UID: \"e9e96e68-82cf-4f77-8bff-9a06e5587b9b\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-a69896-66969579f4-25lw9"
Jul 20 13:42:18.188811 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:42:18.188786    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g5jhx\" (UniqueName: \"kubernetes.io/projected/e9e96e68-82cf-4f77-8bff-9a06e5587b9b-kube-api-access-g5jhx\") pod \"maas-api-e2e-shared-b-a69896-66969579f4-25lw9\" (UID: \"e9e96e68-82cf-4f77-8bff-9a06e5587b9b\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-a69896-66969579f4-25lw9"
Jul 20 13:42:18.678819 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:42:18.678777    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e9e96e68-82cf-4f77-8bff-9a06e5587b9b-maas-api-tls\") pod \"maas-api-e2e-shared-b-a69896-66969579f4-25lw9\" (UID: \"e9e96e68-82cf-4f77-8bff-9a06e5587b9b\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-a69896-66969579f4-25lw9"
Jul 20 13:42:18.681297 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:42:18.681276    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e9e96e68-82cf-4f77-8bff-9a06e5587b9b-maas-api-tls\") pod \"maas-api-e2e-shared-b-a69896-66969579f4-25lw9\" (UID: \"e9e96e68-82cf-4f77-8bff-9a06e5587b9b\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-a69896-66969579f4-25lw9"
Jul 20 13:42:18.840296 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:42:18.840253    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-a69896-66969579f4-25lw9"
Jul 20 13:42:19.014995 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:42:19.014586    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-a69896-66969579f4-25lw9"]
Jul 20 13:42:19.019522 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:42:19.019491    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode9e96e68_82cf_4f77_8bff_9a06e5587b9b.slice/crio-7a6c4b488d3a30bde361e175e86c589635ffa4885c295741a8324d8af3e6ee78 WatchSource:0}: Error finding container 7a6c4b488d3a30bde361e175e86c589635ffa4885c295741a8324d8af3e6ee78: Status 404 returned error can't find the container with id 7a6c4b488d3a30bde361e175e86c589635ffa4885c295741a8324d8af3e6ee78
Jul 20 13:42:19.662951 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:42:19.662855    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-a69896-66969579f4-25lw9" event={"ID":"e9e96e68-82cf-4f77-8bff-9a06e5587b9b","Type":"ContainerStarted","Data":"966a525ab46020985d8341644663fe9671c8be534dfb513e0f4b6042706874ea"}
Jul 20 13:42:19.662951 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:42:19.662913    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-a69896-66969579f4-25lw9" event={"ID":"e9e96e68-82cf-4f77-8bff-9a06e5587b9b","Type":"ContainerStarted","Data":"7a6c4b488d3a30bde361e175e86c589635ffa4885c295741a8324d8af3e6ee78"}
Jul 20 13:42:19.662951 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:42:19.662937    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-a69896-66969579f4-25lw9"
Jul 20 13:42:19.688114 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:42:19.688056    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-a69896-66969579f4-25lw9" podStartSLOduration=2.349443993 podStartE2EDuration="2.688040159s" totalImagesPullingTime="338.596166ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 13:42:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 13:42:19.685696722 +0000 UTC m=+2429.402244135" watchObservedRunningTime="2026-07-20 13:42:19.688040159 +0000 UTC m=+2429.404587570"
Jul 20 13:42:23.573785 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:42:23.573745    2584 patch_prober.go:28] interesting pod/e2e-shared-a-5e9fd6-openshift-default-84cbf7d455-r7bpf container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.67:15021/healthz/ready\": dial tcp 10.134.0.67:15021: connect: connection refused" start-of-body=
Jul 20 13:42:23.574236 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:42:23.573801    2584 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-5e9fd6-openshift-default-84cbf7d455-r7bpf" podUID="fcf8644f-7edd-4803-80d2-4cf300b32912" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.67:15021/healthz/ready\": dial tcp 10.134.0.67:15021: connect: connection refused"
Jul 20 13:42:23.685389 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:42:23.685355    2584 generic.go:356] "Generic (PLEG): container finished" podID="fcf8644f-7edd-4803-80d2-4cf300b32912" containerID="67ddbab1a8836d93154e64d3667910fde0cfb2c41200ab55330b089e01678304" exitCode=0
Jul 20 13:42:23.685547 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:42:23.685425    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-5e9fd6-openshift-default-84cbf7d455-r7bpf" event={"ID":"fcf8644f-7edd-4803-80d2-4cf300b32912","Type":"ContainerDied","Data":"67ddbab1a8836d93154e64d3667910fde0cfb2c41200ab55330b089e01678304"}
Jul 20 13:42:23.685876 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:42:23.685861    2584 scope.go:117] "RemoveContainer" containerID="67ddbab1a8836d93154e64d3667910fde0cfb2c41200ab55330b089e01678304"
Jul 20 13:42:23.687039 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:42:23.687006    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 20 13:42:23.687099 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:42:23.687088    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 20 13:42:23.687136 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:42:23.687124    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 20 13:42:24.692558 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:42:24.692520    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-5e9fd6-openshift-default-84cbf7d455-r7bpf" event={"ID":"fcf8644f-7edd-4803-80d2-4cf300b32912","Type":"ContainerStarted","Data":"dd91bde280e0e58b139054f4d50e213c0d0598ec94725c48724fb0416c865493"}
Jul 20 13:42:25.328552 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:42:25.328512    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-5e9fd6-openshift-default-84cbf7d455-r7bpf"
Jul 20 13:42:25.328910 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:42:25.328888    2584 patch_prober.go:28] interesting pod/e2e-shared-a-5e9fd6-openshift-default-84cbf7d455-r7bpf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.67:15021/healthz/ready\": dial tcp 10.134.0.67:15021: connect: connection refused" start-of-body=
Jul 20 13:42:25.329084 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:42:25.329058    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-5e9fd6-openshift-default-84cbf7d455-r7bpf" podUID="fcf8644f-7edd-4803-80d2-4cf300b32912" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.67:15021/healthz/ready\": dial tcp 10.134.0.67:15021: connect: connection refused"
Jul 20 13:42:25.677059 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:42:25.676949    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-a69896-66969579f4-25lw9"
Jul 20 13:42:26.328809 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:42:26.328759    2584 patch_prober.go:28] interesting pod/e2e-shared-a-5e9fd6-openshift-default-84cbf7d455-r7bpf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.67:15021/healthz/ready\": dial tcp 10.134.0.67:15021: connect: connection refused" start-of-body=
Jul 20 13:42:26.329324 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:42:26.328832    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-5e9fd6-openshift-default-84cbf7d455-r7bpf" podUID="fcf8644f-7edd-4803-80d2-4cf300b32912" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.67:15021/healthz/ready\": dial tcp 10.134.0.67:15021: connect: connection refused"
Jul 20 13:42:27.328823 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:42:27.328776    2584 patch_prober.go:28] interesting pod/e2e-shared-a-5e9fd6-openshift-default-84cbf7d455-r7bpf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.67:15021/healthz/ready\": dial tcp 10.134.0.67:15021: connect: connection refused" start-of-body=
Jul 20 13:42:27.329358 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:42:27.328855    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-5e9fd6-openshift-default-84cbf7d455-r7bpf" podUID="fcf8644f-7edd-4803-80d2-4cf300b32912" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.67:15021/healthz/ready\": dial tcp 10.134.0.67:15021: connect: connection refused"
Jul 20 13:42:28.328760 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:42:28.328711    2584 patch_prober.go:28] interesting pod/e2e-shared-a-5e9fd6-openshift-default-84cbf7d455-r7bpf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.67:15021/healthz/ready\": dial tcp 10.134.0.67:15021: connect: connection refused" start-of-body=
Jul 20 13:42:28.329000 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:42:28.328785    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-5e9fd6-openshift-default-84cbf7d455-r7bpf" podUID="fcf8644f-7edd-4803-80d2-4cf300b32912" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.67:15021/healthz/ready\": dial tcp 10.134.0.67:15021: connect: connection refused"
Jul 20 13:42:29.333061 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:42:29.333021    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-5e9fd6-openshift-default-84cbf7d455-r7bpf"
Jul 20 13:42:29.333523 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:42:29.333424    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-5e9fd6-openshift-default-84cbf7d455-r7bpf"
Jul 20 13:42:29.334312 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:42:29.334288    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-5e9fd6-openshift-default-84cbf7d455-r7bpf"
Jul 20 13:42:31.635024 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:42:31.634988    2584 patch_prober.go:28] interesting pod/e2e-shared-b-a69896-openshift-default-69f5488d99-b6cwh container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.69:15021/healthz/ready\": dial tcp 10.134.0.69:15021: connect: connection refused" start-of-body=
Jul 20 13:42:31.635427 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:42:31.635043    2584 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-a69896-openshift-default-69f5488d99-b6cwh" podUID="444f22c0-f5d6-4122-aba5-d8758f13fee2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.69:15021/healthz/ready\": dial tcp 10.134.0.69:15021: connect: connection refused"
Jul 20 13:42:31.732541 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:42:31.732508    2584 generic.go:356] "Generic (PLEG): container finished" podID="444f22c0-f5d6-4122-aba5-d8758f13fee2" containerID="6a63d1f5b76916118dc5bec0243c281e329f33230e03b044b12bffa1e85d40df" exitCode=0
Jul 20 13:42:31.732715 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:42:31.732590    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-a69896-openshift-default-69f5488d99-b6cwh" event={"ID":"444f22c0-f5d6-4122-aba5-d8758f13fee2","Type":"ContainerDied","Data":"6a63d1f5b76916118dc5bec0243c281e329f33230e03b044b12bffa1e85d40df"}
Jul 20 13:42:31.733084 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:42:31.733067    2584 scope.go:117] "RemoveContainer" containerID="6a63d1f5b76916118dc5bec0243c281e329f33230e03b044b12bffa1e85d40df"
Jul 20 13:42:31.734191 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:42:31.734164    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 20 13:42:31.734256 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:42:31.734234    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 20 13:42:31.734292 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:42:31.734271    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 20 13:42:32.749446 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:42:32.749410    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-a69896-openshift-default-69f5488d99-b6cwh" event={"ID":"444f22c0-f5d6-4122-aba5-d8758f13fee2","Type":"ContainerStarted","Data":"d45613948e6cf0754d5052c31f3f714fb3d4115068f101b67e856dafbd5fbc88"}
Jul 20 13:42:33.053350 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:42:33.053259    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-a69896-openshift-default-69f5488d99-b6cwh"
Jul 20 13:42:33.053540 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:42:33.053506    2584 patch_prober.go:28] interesting pod/e2e-shared-b-a69896-openshift-default-69f5488d99-b6cwh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.69:15021/healthz/ready\": dial tcp 10.134.0.69:15021: connect: connection refused" start-of-body=
Jul 20 13:42:33.053611 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:42:33.053559    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-a69896-openshift-default-69f5488d99-b6cwh" podUID="444f22c0-f5d6-4122-aba5-d8758f13fee2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.69:15021/healthz/ready\": dial tcp 10.134.0.69:15021: connect: connection refused"
Jul 20 13:42:34.053795 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:42:34.053758    2584 patch_prober.go:28] interesting pod/e2e-shared-b-a69896-openshift-default-69f5488d99-b6cwh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.69:15021/healthz/ready\": dial tcp 10.134.0.69:15021: connect: connection refused" start-of-body=
Jul 20 13:42:34.054214 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:42:34.053813    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-a69896-openshift-default-69f5488d99-b6cwh" podUID="444f22c0-f5d6-4122-aba5-d8758f13fee2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.69:15021/healthz/ready\": dial tcp 10.134.0.69:15021: connect: connection refused"
Jul 20 13:42:35.053245 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:42:35.053207    2584 patch_prober.go:28] interesting pod/e2e-shared-b-a69896-openshift-default-69f5488d99-b6cwh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.69:15021/healthz/ready\": dial tcp 10.134.0.69:15021: connect: connection refused" start-of-body=
Jul 20 13:42:35.053450 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:42:35.053263    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-a69896-openshift-default-69f5488d99-b6cwh" podUID="444f22c0-f5d6-4122-aba5-d8758f13fee2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.69:15021/healthz/ready\": dial tcp 10.134.0.69:15021: connect: connection refused"
Jul 20 13:42:36.053116 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:42:36.053058    2584 patch_prober.go:28] interesting pod/e2e-shared-b-a69896-openshift-default-69f5488d99-b6cwh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.69:15021/healthz/ready\": dial tcp 10.134.0.69:15021: connect: connection refused" start-of-body=
Jul 20 13:42:36.053539 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:42:36.053139    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-a69896-openshift-default-69f5488d99-b6cwh" podUID="444f22c0-f5d6-4122-aba5-d8758f13fee2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.69:15021/healthz/ready\": dial tcp 10.134.0.69:15021: connect: connection refused"
Jul 20 13:42:37.057319 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:42:37.057286    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-a69896-openshift-default-69f5488d99-b6cwh"
Jul 20 13:42:37.057737 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:42:37.057639    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-a69896-openshift-default-69f5488d99-b6cwh"
Jul 20 13:42:37.058284 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:42:37.058262    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-a69896-openshift-default-69f5488d99-b6cwh"
Jul 20 13:48:07.122940 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:48:07.122901    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-5e9fd6-68fc6dc4d7-txzbm"]
Jul 20 13:48:07.125435 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:48:07.123185    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-5e9fd6-68fc6dc4d7-txzbm" podUID="27240daa-9832-4d48-88e4-207ee61b0e8e" containerName="maas-api" containerID="cri-o://45e204ba29883ff3dd09813419faae3557764fdca3230a109b764aeeb24f01dc" gracePeriod=30
Jul 20 13:48:07.385907 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:48:07.385836    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-5e9fd6-68fc6dc4d7-txzbm"
Jul 20 13:48:07.551051 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:48:07.551013    2584 generic.go:356] "Generic (PLEG): container finished" podID="27240daa-9832-4d48-88e4-207ee61b0e8e" containerID="45e204ba29883ff3dd09813419faae3557764fdca3230a109b764aeeb24f01dc" exitCode=0
Jul 20 13:48:07.551051 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:48:07.551055    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-5e9fd6-68fc6dc4d7-txzbm"
Jul 20 13:48:07.551265 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:48:07.551104    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-5e9fd6-68fc6dc4d7-txzbm" event={"ID":"27240daa-9832-4d48-88e4-207ee61b0e8e","Type":"ContainerDied","Data":"45e204ba29883ff3dd09813419faae3557764fdca3230a109b764aeeb24f01dc"}
Jul 20 13:48:07.551265 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:48:07.551156    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-5e9fd6-68fc6dc4d7-txzbm" event={"ID":"27240daa-9832-4d48-88e4-207ee61b0e8e","Type":"ContainerDied","Data":"56af748f1ff8228e46e95a5e95f30079db3eecadfb11b353e6976e676c659317"}
Jul 20 13:48:07.551265 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:48:07.551179    2584 scope.go:117] "RemoveContainer" containerID="45e204ba29883ff3dd09813419faae3557764fdca3230a109b764aeeb24f01dc"
Jul 20 13:48:07.559834 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:48:07.559810    2584 scope.go:117] "RemoveContainer" containerID="45e204ba29883ff3dd09813419faae3557764fdca3230a109b764aeeb24f01dc"
Jul 20 13:48:07.560128 ip-10-0-134-121 kubenswrapper[2584]: E0720 13:48:07.560110    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"45e204ba29883ff3dd09813419faae3557764fdca3230a109b764aeeb24f01dc\": container with ID starting with 45e204ba29883ff3dd09813419faae3557764fdca3230a109b764aeeb24f01dc not found: ID does not exist" containerID="45e204ba29883ff3dd09813419faae3557764fdca3230a109b764aeeb24f01dc"
Jul 20 13:48:07.560192 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:48:07.560138    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"45e204ba29883ff3dd09813419faae3557764fdca3230a109b764aeeb24f01dc"} err="failed to get container status \"45e204ba29883ff3dd09813419faae3557764fdca3230a109b764aeeb24f01dc\": rpc error: code = NotFound desc = could not find container \"45e204ba29883ff3dd09813419faae3557764fdca3230a109b764aeeb24f01dc\": container with ID starting with 45e204ba29883ff3dd09813419faae3557764fdca3230a109b764aeeb24f01dc not found: ID does not exist"
Jul 20 13:48:07.562498 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:48:07.562482    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/27240daa-9832-4d48-88e4-207ee61b0e8e-maas-api-tls\") pod \"27240daa-9832-4d48-88e4-207ee61b0e8e\" (UID: \"27240daa-9832-4d48-88e4-207ee61b0e8e\") "
Jul 20 13:48:07.562554 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:48:07.562513    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/27240daa-9832-4d48-88e4-207ee61b0e8e-openshift-service-ca\") pod \"27240daa-9832-4d48-88e4-207ee61b0e8e\" (UID: \"27240daa-9832-4d48-88e4-207ee61b0e8e\") "
Jul 20 13:48:07.562554 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:48:07.562540    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k4jd9\" (UniqueName: \"kubernetes.io/projected/27240daa-9832-4d48-88e4-207ee61b0e8e-kube-api-access-k4jd9\") pod \"27240daa-9832-4d48-88e4-207ee61b0e8e\" (UID: \"27240daa-9832-4d48-88e4-207ee61b0e8e\") "
Jul 20 13:48:07.562876 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:48:07.562849    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/27240daa-9832-4d48-88e4-207ee61b0e8e-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "27240daa-9832-4d48-88e4-207ee61b0e8e" (UID: "27240daa-9832-4d48-88e4-207ee61b0e8e"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 13:48:07.564405 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:48:07.564387    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/27240daa-9832-4d48-88e4-207ee61b0e8e-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "27240daa-9832-4d48-88e4-207ee61b0e8e" (UID: "27240daa-9832-4d48-88e4-207ee61b0e8e"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 13:48:07.564515 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:48:07.564501    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/27240daa-9832-4d48-88e4-207ee61b0e8e-kube-api-access-k4jd9" (OuterVolumeSpecName: "kube-api-access-k4jd9") pod "27240daa-9832-4d48-88e4-207ee61b0e8e" (UID: "27240daa-9832-4d48-88e4-207ee61b0e8e"). InnerVolumeSpecName "kube-api-access-k4jd9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 13:48:07.663527 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:48:07.663439    2584 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/27240daa-9832-4d48-88e4-207ee61b0e8e-maas-api-tls\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 20 13:48:07.663527 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:48:07.663467    2584 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/27240daa-9832-4d48-88e4-207ee61b0e8e-openshift-service-ca\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 20 13:48:07.663527 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:48:07.663479    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k4jd9\" (UniqueName: \"kubernetes.io/projected/27240daa-9832-4d48-88e4-207ee61b0e8e-kube-api-access-k4jd9\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 20 13:48:07.874829 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:48:07.874795    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-5e9fd6-68fc6dc4d7-txzbm"]
Jul 20 13:48:07.881805 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:48:07.881778    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-5e9fd6-68fc6dc4d7-txzbm"]
Jul 20 13:48:09.095773 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:48:09.095743    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="27240daa-9832-4d48-88e4-207ee61b0e8e" path="/var/lib/kubelet/pods/27240daa-9832-4d48-88e4-207ee61b0e8e/volumes"
Jul 20 13:48:22.280751 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:48:22.280671    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-5e9fd6-openshift-default-84cbf7d455-r7bpf"]
Jul 20 13:48:22.281291 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:48:22.280935    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-5e9fd6-openshift-default-84cbf7d455-r7bpf" podUID="fcf8644f-7edd-4803-80d2-4cf300b32912" containerName="istio-proxy" containerID="cri-o://dd91bde280e0e58b139054f4d50e213c0d0598ec94725c48724fb0416c865493" gracePeriod=30
Jul 20 13:48:27.550736 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:48:27.550660    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-5e9fd6-openshift-default-84cbf7d455-r7bpf"
Jul 20 13:48:27.661954 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:48:27.661919    2584 generic.go:356] "Generic (PLEG): container finished" podID="fcf8644f-7edd-4803-80d2-4cf300b32912" containerID="dd91bde280e0e58b139054f4d50e213c0d0598ec94725c48724fb0416c865493" exitCode=0
Jul 20 13:48:27.662166 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:48:27.661983    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-5e9fd6-openshift-default-84cbf7d455-r7bpf" event={"ID":"fcf8644f-7edd-4803-80d2-4cf300b32912","Type":"ContainerDied","Data":"dd91bde280e0e58b139054f4d50e213c0d0598ec94725c48724fb0416c865493"}
Jul 20 13:48:27.662166 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:48:27.662010    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-5e9fd6-openshift-default-84cbf7d455-r7bpf"
Jul 20 13:48:27.662166 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:48:27.662040    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-5e9fd6-openshift-default-84cbf7d455-r7bpf" event={"ID":"fcf8644f-7edd-4803-80d2-4cf300b32912","Type":"ContainerDied","Data":"194639d563ac6b556ca42e14e63d66dbdf80628b535c8e533af6610c117b30fa"}
Jul 20 13:48:27.662166 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:48:27.662054    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fcf8644f-7edd-4803-80d2-4cf300b32912-istio-data\") pod \"fcf8644f-7edd-4803-80d2-4cf300b32912\" (UID: \"fcf8644f-7edd-4803-80d2-4cf300b32912\") "
Jul 20 13:48:27.662166 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:48:27.662069    2584 scope.go:117] "RemoveContainer" containerID="dd91bde280e0e58b139054f4d50e213c0d0598ec94725c48724fb0416c865493"
Jul 20 13:48:27.662166 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:48:27.662140    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fcf8644f-7edd-4803-80d2-4cf300b32912-credential-socket\") pod \"fcf8644f-7edd-4803-80d2-4cf300b32912\" (UID: \"fcf8644f-7edd-4803-80d2-4cf300b32912\") "
Jul 20 13:48:27.662490 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:48:27.662183    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pmchd\" (UniqueName: \"kubernetes.io/projected/fcf8644f-7edd-4803-80d2-4cf300b32912-kube-api-access-pmchd\") pod \"fcf8644f-7edd-4803-80d2-4cf300b32912\" (UID: \"fcf8644f-7edd-4803-80d2-4cf300b32912\") "
Jul 20 13:48:27.662490 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:48:27.662210    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fcf8644f-7edd-4803-80d2-4cf300b32912-istio-envoy\") pod \"fcf8644f-7edd-4803-80d2-4cf300b32912\" (UID: \"fcf8644f-7edd-4803-80d2-4cf300b32912\") "
Jul 20 13:48:27.662490 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:48:27.662236    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fcf8644f-7edd-4803-80d2-4cf300b32912-istiod-ca-cert\") pod \"fcf8644f-7edd-4803-80d2-4cf300b32912\" (UID: \"fcf8644f-7edd-4803-80d2-4cf300b32912\") "
Jul 20 13:48:27.662490 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:48:27.662442    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fcf8644f-7edd-4803-80d2-4cf300b32912-workload-certs\") pod \"fcf8644f-7edd-4803-80d2-4cf300b32912\" (UID: \"fcf8644f-7edd-4803-80d2-4cf300b32912\") "
Jul 20 13:48:27.662490 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:48:27.662485    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fcf8644f-7edd-4803-80d2-4cf300b32912-workload-socket\") pod \"fcf8644f-7edd-4803-80d2-4cf300b32912\" (UID: \"fcf8644f-7edd-4803-80d2-4cf300b32912\") "
Jul 20 13:48:27.662746 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:48:27.662488    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fcf8644f-7edd-4803-80d2-4cf300b32912-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "fcf8644f-7edd-4803-80d2-4cf300b32912" (UID: "fcf8644f-7edd-4803-80d2-4cf300b32912"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 13:48:27.662746 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:48:27.662558    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fcf8644f-7edd-4803-80d2-4cf300b32912-istio-podinfo\") pod \"fcf8644f-7edd-4803-80d2-4cf300b32912\" (UID: \"fcf8644f-7edd-4803-80d2-4cf300b32912\") "
Jul 20 13:48:27.662746 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:48:27.662601    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fcf8644f-7edd-4803-80d2-4cf300b32912-istio-token\") pod \"fcf8644f-7edd-4803-80d2-4cf300b32912\" (UID: \"fcf8644f-7edd-4803-80d2-4cf300b32912\") "
Jul 20 13:48:27.662746 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:48:27.662642    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fcf8644f-7edd-4803-80d2-4cf300b32912-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "fcf8644f-7edd-4803-80d2-4cf300b32912" (UID: "fcf8644f-7edd-4803-80d2-4cf300b32912"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 13:48:27.662746 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:48:27.662710    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fcf8644f-7edd-4803-80d2-4cf300b32912-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "fcf8644f-7edd-4803-80d2-4cf300b32912" (UID: "fcf8644f-7edd-4803-80d2-4cf300b32912"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 13:48:27.663057 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:48:27.662769    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fcf8644f-7edd-4803-80d2-4cf300b32912-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "fcf8644f-7edd-4803-80d2-4cf300b32912" (UID: "fcf8644f-7edd-4803-80d2-4cf300b32912"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 13:48:27.663057 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:48:27.663032    2584 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fcf8644f-7edd-4803-80d2-4cf300b32912-istiod-ca-cert\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 20 13:48:27.663057 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:48:27.663039    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fcf8644f-7edd-4803-80d2-4cf300b32912-istio-data" (OuterVolumeSpecName: "istio-data") pod "fcf8644f-7edd-4803-80d2-4cf300b32912" (UID: "fcf8644f-7edd-4803-80d2-4cf300b32912"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 13:48:27.663057 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:48:27.663051    2584 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fcf8644f-7edd-4803-80d2-4cf300b32912-workload-certs\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 20 13:48:27.663273 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:48:27.663066    2584 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fcf8644f-7edd-4803-80d2-4cf300b32912-workload-socket\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 20 13:48:27.663273 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:48:27.663079    2584 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fcf8644f-7edd-4803-80d2-4cf300b32912-credential-socket\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 20 13:48:27.664725 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:48:27.664697    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fcf8644f-7edd-4803-80d2-4cf300b32912-kube-api-access-pmchd" (OuterVolumeSpecName: "kube-api-access-pmchd") pod "fcf8644f-7edd-4803-80d2-4cf300b32912" (UID: "fcf8644f-7edd-4803-80d2-4cf300b32912"). InnerVolumeSpecName "kube-api-access-pmchd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 13:48:27.664844 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:48:27.664733    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fcf8644f-7edd-4803-80d2-4cf300b32912-istio-token" (OuterVolumeSpecName: "istio-token") pod "fcf8644f-7edd-4803-80d2-4cf300b32912" (UID: "fcf8644f-7edd-4803-80d2-4cf300b32912"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 13:48:27.664911 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:48:27.664838    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fcf8644f-7edd-4803-80d2-4cf300b32912-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "fcf8644f-7edd-4803-80d2-4cf300b32912" (UID: "fcf8644f-7edd-4803-80d2-4cf300b32912"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 13:48:27.664911 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:48:27.664902    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/fcf8644f-7edd-4803-80d2-4cf300b32912-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "fcf8644f-7edd-4803-80d2-4cf300b32912" (UID: "fcf8644f-7edd-4803-80d2-4cf300b32912"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 20 13:48:27.686343 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:48:27.686321    2584 scope.go:117] "RemoveContainer" containerID="67ddbab1a8836d93154e64d3667910fde0cfb2c41200ab55330b089e01678304"
Jul 20 13:48:27.695258 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:48:27.695237    2584 scope.go:117] "RemoveContainer" containerID="dd91bde280e0e58b139054f4d50e213c0d0598ec94725c48724fb0416c865493"
Jul 20 13:48:27.695574 ip-10-0-134-121 kubenswrapper[2584]: E0720 13:48:27.695555    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dd91bde280e0e58b139054f4d50e213c0d0598ec94725c48724fb0416c865493\": container with ID starting with dd91bde280e0e58b139054f4d50e213c0d0598ec94725c48724fb0416c865493 not found: ID does not exist" containerID="dd91bde280e0e58b139054f4d50e213c0d0598ec94725c48724fb0416c865493"
Jul 20 13:48:27.695622 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:48:27.695585    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dd91bde280e0e58b139054f4d50e213c0d0598ec94725c48724fb0416c865493"} err="failed to get container status \"dd91bde280e0e58b139054f4d50e213c0d0598ec94725c48724fb0416c865493\": rpc error: code = NotFound desc = could not find container \"dd91bde280e0e58b139054f4d50e213c0d0598ec94725c48724fb0416c865493\": container with ID starting with dd91bde280e0e58b139054f4d50e213c0d0598ec94725c48724fb0416c865493 not found: ID does not exist"
Jul 20 13:48:27.695622 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:48:27.695607    2584 scope.go:117] "RemoveContainer" containerID="67ddbab1a8836d93154e64d3667910fde0cfb2c41200ab55330b089e01678304"
Jul 20 13:48:27.695874 ip-10-0-134-121 kubenswrapper[2584]: E0720 13:48:27.695856    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"67ddbab1a8836d93154e64d3667910fde0cfb2c41200ab55330b089e01678304\": container with ID starting with 67ddbab1a8836d93154e64d3667910fde0cfb2c41200ab55330b089e01678304 not found: ID does not exist" containerID="67ddbab1a8836d93154e64d3667910fde0cfb2c41200ab55330b089e01678304"
Jul 20 13:48:27.695931 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:48:27.695880    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"67ddbab1a8836d93154e64d3667910fde0cfb2c41200ab55330b089e01678304"} err="failed to get container status \"67ddbab1a8836d93154e64d3667910fde0cfb2c41200ab55330b089e01678304\": rpc error: code = NotFound desc = could not find container \"67ddbab1a8836d93154e64d3667910fde0cfb2c41200ab55330b089e01678304\": container with ID starting with 67ddbab1a8836d93154e64d3667910fde0cfb2c41200ab55330b089e01678304 not found: ID does not exist"
Jul 20 13:48:27.764133 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:48:27.764098    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pmchd\" (UniqueName: \"kubernetes.io/projected/fcf8644f-7edd-4803-80d2-4cf300b32912-kube-api-access-pmchd\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 20 13:48:27.764133 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:48:27.764126    2584 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fcf8644f-7edd-4803-80d2-4cf300b32912-istio-envoy\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 20 13:48:27.764133 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:48:27.764135    2584 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fcf8644f-7edd-4803-80d2-4cf300b32912-istio-podinfo\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 20 13:48:27.764133 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:48:27.764143    2584 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fcf8644f-7edd-4803-80d2-4cf300b32912-istio-token\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 20 13:48:27.764415 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:48:27.764151    2584 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fcf8644f-7edd-4803-80d2-4cf300b32912-istio-data\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 20 13:48:27.990747 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:48:27.990712    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-5e9fd6-openshift-default-84cbf7d455-r7bpf"]
Jul 20 13:48:27.998728 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:48:27.998696    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-5e9fd6-openshift-default-84cbf7d455-r7bpf"]
Jul 20 13:48:29.096020 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:48:29.095956    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fcf8644f-7edd-4803-80d2-4cf300b32912" path="/var/lib/kubelet/pods/fcf8644f-7edd-4803-80d2-4cf300b32912/volumes"
Jul 20 13:48:33.206607 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:48:33.206564    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-a69896-66969579f4-25lw9"]
Jul 20 13:48:33.207106 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:48:33.206829    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-a69896-66969579f4-25lw9" podUID="e9e96e68-82cf-4f77-8bff-9a06e5587b9b" containerName="maas-api" containerID="cri-o://966a525ab46020985d8341644663fe9671c8be534dfb513e0f4b6042706874ea" gracePeriod=30
Jul 20 13:48:33.474856 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:48:33.474827    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-a69896-66969579f4-25lw9"
Jul 20 13:48:33.626768 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:48:33.626732    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g5jhx\" (UniqueName: \"kubernetes.io/projected/e9e96e68-82cf-4f77-8bff-9a06e5587b9b-kube-api-access-g5jhx\") pod \"e9e96e68-82cf-4f77-8bff-9a06e5587b9b\" (UID: \"e9e96e68-82cf-4f77-8bff-9a06e5587b9b\") "
Jul 20 13:48:33.626977 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:48:33.626834    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e9e96e68-82cf-4f77-8bff-9a06e5587b9b-openshift-service-ca\") pod \"e9e96e68-82cf-4f77-8bff-9a06e5587b9b\" (UID: \"e9e96e68-82cf-4f77-8bff-9a06e5587b9b\") "
Jul 20 13:48:33.626977 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:48:33.626900    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e9e96e68-82cf-4f77-8bff-9a06e5587b9b-maas-api-tls\") pod \"e9e96e68-82cf-4f77-8bff-9a06e5587b9b\" (UID: \"e9e96e68-82cf-4f77-8bff-9a06e5587b9b\") "
Jul 20 13:48:33.627224 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:48:33.627199    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e9e96e68-82cf-4f77-8bff-9a06e5587b9b-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "e9e96e68-82cf-4f77-8bff-9a06e5587b9b" (UID: "e9e96e68-82cf-4f77-8bff-9a06e5587b9b"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 13:48:33.629028 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:48:33.628998    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e9e96e68-82cf-4f77-8bff-9a06e5587b9b-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "e9e96e68-82cf-4f77-8bff-9a06e5587b9b" (UID: "e9e96e68-82cf-4f77-8bff-9a06e5587b9b"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 13:48:33.629134 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:48:33.629002    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e9e96e68-82cf-4f77-8bff-9a06e5587b9b-kube-api-access-g5jhx" (OuterVolumeSpecName: "kube-api-access-g5jhx") pod "e9e96e68-82cf-4f77-8bff-9a06e5587b9b" (UID: "e9e96e68-82cf-4f77-8bff-9a06e5587b9b"). InnerVolumeSpecName "kube-api-access-g5jhx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 13:48:33.696753 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:48:33.696716    2584 generic.go:356] "Generic (PLEG): container finished" podID="e9e96e68-82cf-4f77-8bff-9a06e5587b9b" containerID="966a525ab46020985d8341644663fe9671c8be534dfb513e0f4b6042706874ea" exitCode=0
Jul 20 13:48:33.696931 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:48:33.696770    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-a69896-66969579f4-25lw9"
Jul 20 13:48:33.696931 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:48:33.696811    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-a69896-66969579f4-25lw9" event={"ID":"e9e96e68-82cf-4f77-8bff-9a06e5587b9b","Type":"ContainerDied","Data":"966a525ab46020985d8341644663fe9671c8be534dfb513e0f4b6042706874ea"}
Jul 20 13:48:33.696931 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:48:33.696865    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-a69896-66969579f4-25lw9" event={"ID":"e9e96e68-82cf-4f77-8bff-9a06e5587b9b","Type":"ContainerDied","Data":"7a6c4b488d3a30bde361e175e86c589635ffa4885c295741a8324d8af3e6ee78"}
Jul 20 13:48:33.696931 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:48:33.696891    2584 scope.go:117] "RemoveContainer" containerID="966a525ab46020985d8341644663fe9671c8be534dfb513e0f4b6042706874ea"
Jul 20 13:48:33.706937 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:48:33.706915    2584 scope.go:117] "RemoveContainer" containerID="966a525ab46020985d8341644663fe9671c8be534dfb513e0f4b6042706874ea"
Jul 20 13:48:33.707227 ip-10-0-134-121 kubenswrapper[2584]: E0720 13:48:33.707207    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"966a525ab46020985d8341644663fe9671c8be534dfb513e0f4b6042706874ea\": container with ID starting with 966a525ab46020985d8341644663fe9671c8be534dfb513e0f4b6042706874ea not found: ID does not exist" containerID="966a525ab46020985d8341644663fe9671c8be534dfb513e0f4b6042706874ea"
Jul 20 13:48:33.707277 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:48:33.707234    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"966a525ab46020985d8341644663fe9671c8be534dfb513e0f4b6042706874ea"} err="failed to get container status \"966a525ab46020985d8341644663fe9671c8be534dfb513e0f4b6042706874ea\": rpc error: code = NotFound desc = could not find container \"966a525ab46020985d8341644663fe9671c8be534dfb513e0f4b6042706874ea\": container with ID starting with 966a525ab46020985d8341644663fe9671c8be534dfb513e0f4b6042706874ea not found: ID does not exist"
Jul 20 13:48:33.719349 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:48:33.719265    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-a69896-66969579f4-25lw9"]
Jul 20 13:48:33.724501 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:48:33.724472    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-a69896-66969579f4-25lw9"]
Jul 20 13:48:33.728536 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:48:33.728515    2584 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e9e96e68-82cf-4f77-8bff-9a06e5587b9b-maas-api-tls\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 20 13:48:33.728536 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:48:33.728537    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g5jhx\" (UniqueName: \"kubernetes.io/projected/e9e96e68-82cf-4f77-8bff-9a06e5587b9b-kube-api-access-g5jhx\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 20 13:48:33.728681 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:48:33.728547    2584 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e9e96e68-82cf-4f77-8bff-9a06e5587b9b-openshift-service-ca\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 20 13:48:35.098713 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:48:35.098677    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e9e96e68-82cf-4f77-8bff-9a06e5587b9b" path="/var/lib/kubelet/pods/e9e96e68-82cf-4f77-8bff-9a06e5587b9b/volumes"
Jul 20 13:48:48.543581 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:48:48.543548    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-a69896-openshift-default-69f5488d99-b6cwh"]
Jul 20 13:48:48.544034 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:48:48.543762    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-a69896-openshift-default-69f5488d99-b6cwh" podUID="444f22c0-f5d6-4122-aba5-d8758f13fee2" containerName="istio-proxy" containerID="cri-o://d45613948e6cf0754d5052c31f3f714fb3d4115068f101b67e856dafbd5fbc88" gracePeriod=30
Jul 20 13:48:52.059908 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:48:52.059870    2584 patch_prober.go:28] interesting pod/e2e-shared-b-a69896-openshift-default-69f5488d99-b6cwh container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 20 13:48:52.060317 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:48:52.059936    2584 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-a69896-openshift-default-69f5488d99-b6cwh" podUID="444f22c0-f5d6-4122-aba5-d8758f13fee2" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 20 13:48:53.804434 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:48:53.804403    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-a69896-openshift-default-69f5488d99-b6cwh"
Jul 20 13:48:53.806033 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:48:53.805948    2584 generic.go:356] "Generic (PLEG): container finished" podID="444f22c0-f5d6-4122-aba5-d8758f13fee2" containerID="d45613948e6cf0754d5052c31f3f714fb3d4115068f101b67e856dafbd5fbc88" exitCode=0
Jul 20 13:48:53.806033 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:48:53.805998    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-a69896-openshift-default-69f5488d99-b6cwh" event={"ID":"444f22c0-f5d6-4122-aba5-d8758f13fee2","Type":"ContainerDied","Data":"d45613948e6cf0754d5052c31f3f714fb3d4115068f101b67e856dafbd5fbc88"}
Jul 20 13:48:53.806175 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:48:53.806054    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-a69896-openshift-default-69f5488d99-b6cwh" event={"ID":"444f22c0-f5d6-4122-aba5-d8758f13fee2","Type":"ContainerDied","Data":"b2027eab80765b443911ee02be902b44616f53b2a7086272d3407394addbe7e0"}
Jul 20 13:48:53.806175 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:48:53.806077    2584 scope.go:117] "RemoveContainer" containerID="d45613948e6cf0754d5052c31f3f714fb3d4115068f101b67e856dafbd5fbc88"
Jul 20 13:48:53.817820 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:48:53.817784    2584 scope.go:117] "RemoveContainer" containerID="6a63d1f5b76916118dc5bec0243c281e329f33230e03b044b12bffa1e85d40df"
Jul 20 13:48:53.826393 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:48:53.826372    2584 scope.go:117] "RemoveContainer" containerID="d45613948e6cf0754d5052c31f3f714fb3d4115068f101b67e856dafbd5fbc88"
Jul 20 13:48:53.826657 ip-10-0-134-121 kubenswrapper[2584]: E0720 13:48:53.826638    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d45613948e6cf0754d5052c31f3f714fb3d4115068f101b67e856dafbd5fbc88\": container with ID starting with d45613948e6cf0754d5052c31f3f714fb3d4115068f101b67e856dafbd5fbc88 not found: ID does not exist" containerID="d45613948e6cf0754d5052c31f3f714fb3d4115068f101b67e856dafbd5fbc88"
Jul 20 13:48:53.826741 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:48:53.826671    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d45613948e6cf0754d5052c31f3f714fb3d4115068f101b67e856dafbd5fbc88"} err="failed to get container status \"d45613948e6cf0754d5052c31f3f714fb3d4115068f101b67e856dafbd5fbc88\": rpc error: code = NotFound desc = could not find container \"d45613948e6cf0754d5052c31f3f714fb3d4115068f101b67e856dafbd5fbc88\": container with ID starting with d45613948e6cf0754d5052c31f3f714fb3d4115068f101b67e856dafbd5fbc88 not found: ID does not exist"
Jul 20 13:48:53.826741 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:48:53.826697    2584 scope.go:117] "RemoveContainer" containerID="6a63d1f5b76916118dc5bec0243c281e329f33230e03b044b12bffa1e85d40df"
Jul 20 13:48:53.826933 ip-10-0-134-121 kubenswrapper[2584]: E0720 13:48:53.826914    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6a63d1f5b76916118dc5bec0243c281e329f33230e03b044b12bffa1e85d40df\": container with ID starting with 6a63d1f5b76916118dc5bec0243c281e329f33230e03b044b12bffa1e85d40df not found: ID does not exist" containerID="6a63d1f5b76916118dc5bec0243c281e329f33230e03b044b12bffa1e85d40df"
Jul 20 13:48:53.826988 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:48:53.826940    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6a63d1f5b76916118dc5bec0243c281e329f33230e03b044b12bffa1e85d40df"} err="failed to get container status \"6a63d1f5b76916118dc5bec0243c281e329f33230e03b044b12bffa1e85d40df\": rpc error: code = NotFound desc = could not find container \"6a63d1f5b76916118dc5bec0243c281e329f33230e03b044b12bffa1e85d40df\": container with ID starting with 6a63d1f5b76916118dc5bec0243c281e329f33230e03b044b12bffa1e85d40df not found: ID does not exist"
Jul 20 13:48:53.830517 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:48:53.830461    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/444f22c0-f5d6-4122-aba5-d8758f13fee2-istio-envoy\") pod \"444f22c0-f5d6-4122-aba5-d8758f13fee2\" (UID: \"444f22c0-f5d6-4122-aba5-d8758f13fee2\") "
Jul 20 13:48:53.830657 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:48:53.830549    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/444f22c0-f5d6-4122-aba5-d8758f13fee2-istio-token\") pod \"444f22c0-f5d6-4122-aba5-d8758f13fee2\" (UID: \"444f22c0-f5d6-4122-aba5-d8758f13fee2\") "
Jul 20 13:48:53.830657 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:48:53.830632    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/444f22c0-f5d6-4122-aba5-d8758f13fee2-credential-socket\") pod \"444f22c0-f5d6-4122-aba5-d8758f13fee2\" (UID: \"444f22c0-f5d6-4122-aba5-d8758f13fee2\") "
Jul 20 13:48:53.830782 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:48:53.830664    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/444f22c0-f5d6-4122-aba5-d8758f13fee2-istio-podinfo\") pod \"444f22c0-f5d6-4122-aba5-d8758f13fee2\" (UID: \"444f22c0-f5d6-4122-aba5-d8758f13fee2\") "
Jul 20 13:48:53.830782 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:48:53.830694    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/444f22c0-f5d6-4122-aba5-d8758f13fee2-istio-data\") pod \"444f22c0-f5d6-4122-aba5-d8758f13fee2\" (UID: \"444f22c0-f5d6-4122-aba5-d8758f13fee2\") "
Jul 20 13:48:53.830782 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:48:53.830722    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/444f22c0-f5d6-4122-aba5-d8758f13fee2-workload-certs\") pod \"444f22c0-f5d6-4122-aba5-d8758f13fee2\" (UID: \"444f22c0-f5d6-4122-aba5-d8758f13fee2\") "
Jul 20 13:48:53.830782 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:48:53.830753    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/444f22c0-f5d6-4122-aba5-d8758f13fee2-istiod-ca-cert\") pod \"444f22c0-f5d6-4122-aba5-d8758f13fee2\" (UID: \"444f22c0-f5d6-4122-aba5-d8758f13fee2\") "
Jul 20 13:48:53.831003 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:48:53.830815    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/444f22c0-f5d6-4122-aba5-d8758f13fee2-workload-socket\") pod \"444f22c0-f5d6-4122-aba5-d8758f13fee2\" (UID: \"444f22c0-f5d6-4122-aba5-d8758f13fee2\") "
Jul 20 13:48:53.831003 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:48:53.830853    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jbbft\" (UniqueName: \"kubernetes.io/projected/444f22c0-f5d6-4122-aba5-d8758f13fee2-kube-api-access-jbbft\") pod \"444f22c0-f5d6-4122-aba5-d8758f13fee2\" (UID: \"444f22c0-f5d6-4122-aba5-d8758f13fee2\") "
Jul 20 13:48:53.832201 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:48:53.831255    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/444f22c0-f5d6-4122-aba5-d8758f13fee2-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "444f22c0-f5d6-4122-aba5-d8758f13fee2" (UID: "444f22c0-f5d6-4122-aba5-d8758f13fee2"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 13:48:53.832201 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:48:53.831450    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/444f22c0-f5d6-4122-aba5-d8758f13fee2-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "444f22c0-f5d6-4122-aba5-d8758f13fee2" (UID: "444f22c0-f5d6-4122-aba5-d8758f13fee2"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 13:48:53.832201 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:48:53.831533    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/444f22c0-f5d6-4122-aba5-d8758f13fee2-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "444f22c0-f5d6-4122-aba5-d8758f13fee2" (UID: "444f22c0-f5d6-4122-aba5-d8758f13fee2"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 13:48:53.832201 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:48:53.831698    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/444f22c0-f5d6-4122-aba5-d8758f13fee2-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "444f22c0-f5d6-4122-aba5-d8758f13fee2" (UID: "444f22c0-f5d6-4122-aba5-d8758f13fee2"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 13:48:53.832548 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:48:53.832305    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/444f22c0-f5d6-4122-aba5-d8758f13fee2-istio-data" (OuterVolumeSpecName: "istio-data") pod "444f22c0-f5d6-4122-aba5-d8758f13fee2" (UID: "444f22c0-f5d6-4122-aba5-d8758f13fee2"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 13:48:53.833366 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:48:53.833331    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/444f22c0-f5d6-4122-aba5-d8758f13fee2-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "444f22c0-f5d6-4122-aba5-d8758f13fee2" (UID: "444f22c0-f5d6-4122-aba5-d8758f13fee2"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 20 13:48:53.833634 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:48:53.833612    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/444f22c0-f5d6-4122-aba5-d8758f13fee2-kube-api-access-jbbft" (OuterVolumeSpecName: "kube-api-access-jbbft") pod "444f22c0-f5d6-4122-aba5-d8758f13fee2" (UID: "444f22c0-f5d6-4122-aba5-d8758f13fee2"). InnerVolumeSpecName "kube-api-access-jbbft". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 13:48:53.833881 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:48:53.833862    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/444f22c0-f5d6-4122-aba5-d8758f13fee2-istio-token" (OuterVolumeSpecName: "istio-token") pod "444f22c0-f5d6-4122-aba5-d8758f13fee2" (UID: "444f22c0-f5d6-4122-aba5-d8758f13fee2"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 13:48:53.834572 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:48:53.834547    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/444f22c0-f5d6-4122-aba5-d8758f13fee2-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "444f22c0-f5d6-4122-aba5-d8758f13fee2" (UID: "444f22c0-f5d6-4122-aba5-d8758f13fee2"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 13:48:53.932512 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:48:53.932464    2584 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/444f22c0-f5d6-4122-aba5-d8758f13fee2-istio-token\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 20 13:48:53.932512 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:48:53.932508    2584 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/444f22c0-f5d6-4122-aba5-d8758f13fee2-credential-socket\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 20 13:48:53.932512 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:48:53.932521    2584 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/444f22c0-f5d6-4122-aba5-d8758f13fee2-istio-podinfo\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 20 13:48:53.932512 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:48:53.932530    2584 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/444f22c0-f5d6-4122-aba5-d8758f13fee2-istio-data\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 20 13:48:53.932802 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:48:53.932538    2584 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/444f22c0-f5d6-4122-aba5-d8758f13fee2-workload-certs\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 20 13:48:53.932802 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:48:53.932545    2584 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/444f22c0-f5d6-4122-aba5-d8758f13fee2-istiod-ca-cert\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 20 13:48:53.932802 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:48:53.932553    2584 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/444f22c0-f5d6-4122-aba5-d8758f13fee2-workload-socket\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 20 13:48:53.932802 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:48:53.932562    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jbbft\" (UniqueName: \"kubernetes.io/projected/444f22c0-f5d6-4122-aba5-d8758f13fee2-kube-api-access-jbbft\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 20 13:48:53.932802 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:48:53.932570    2584 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/444f22c0-f5d6-4122-aba5-d8758f13fee2-istio-envoy\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 20 13:48:54.812106 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:48:54.812078    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-a69896-openshift-default-69f5488d99-b6cwh"
Jul 20 13:48:54.836903 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:48:54.836876    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-a69896-openshift-default-69f5488d99-b6cwh"]
Jul 20 13:48:54.840835 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:48:54.840815    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-a69896-openshift-default-69f5488d99-b6cwh"]
Jul 20 13:48:55.096294 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:48:55.096206    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="444f22c0-f5d6-4122-aba5-d8758f13fee2" path="/var/lib/kubelet/pods/444f22c0-f5d6-4122-aba5-d8758f13fee2/volumes"
Jul 20 13:48:55.197138 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:48:55.197100    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-bgjjs_3b6eeb61-e4af-47fa-8851-ee5f5dc9c802/manager/0.log"
Jul 20 13:48:55.445552 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:48:55.445479    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-78b9bfcd6-ztpbk_bf4a9a9d-ad38-43aa-87be-4818eabc0199/manager/0.log"
Jul 20 13:48:56.087410 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:48:56.087377    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-85766d874c-vmwmg_00f64fd0-e3e5-4da2-bf17-497e7521a6b6/copy-manifests/0.log"
Jul 20 13:48:56.100720 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:48:56.100680    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-85766d874c-vmwmg_00f64fd0-e3e5-4da2-bf17-497e7521a6b6/manager/0.log"
Jul 20 13:48:56.498355 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:48:56.498325    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-b896b746d-qzcqc_66d075e2-2f46-4e16-888b-fd322516c2b6/maas-api/0.log"
Jul 20 13:48:56.615638 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:48:56.615610    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29742555-dpmwc_dcd65622-d09b-438f-90bf-9a79360971b7/cleanup/0.log"
Jul 20 13:48:58.407525 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:48:58.407498    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-69fb4594cf-m8kjd_c477a836-5447-480a-ae37-ca61dd0cab85/postgres/0.log"
Jul 20 13:48:59.936161 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:48:59.936132    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-zpbpp_c71d47d7-dd2b-4439-9a99-5edf9b7a05cc/manager/1.log"
Jul 20 13:49:00.301582 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:49:00.301541    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-w2q5n_fdc3275b-0cbd-4433-8dce-1bfd7378e27b/registry-server/0.log"
Jul 20 13:49:01.027056 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:49:01.027025    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4xkqwv_0d945cc6-346b-4037-a971-2afe9b904532/istio-proxy/0.log"
Jul 20 13:49:01.508453 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:49:01.508425    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-669mt_d1f7d779-906f-40bb-945a-fae805b1d5f7/istio-proxy/1.log"
Jul 20 13:49:01.699893 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:49:01.699853    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-74584bb9f8-fkdl9_f9b38cd6-b909-4389-b30f-0a995edacec4/payload-pre-processing/0.log"
Jul 20 13:49:01.822249 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:49:01.822171    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-f9b8d9b9b-d5qcq_ba9fa0dd-9b78-428e-b33b-b6d75669f26c/payload-processing/0.log"
Jul 20 13:49:02.328631 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:49:02.328601    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-g2xqc_704381f3-0889-40ae-bc6a-f3efad70d6b0/main/0.log"
Jul 20 13:49:02.460034 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:49:02.460001    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-b5xwt_99071a2d-5375-4db0-ae41-1174b8c9c754/main/0.log"
Jul 20 13:49:12.150789 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:49:12.150755    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-4wwrh_f8c70e98-14ec-48d9-8c30-2d63fa95c04e/global-pull-secret-syncer/0.log"
Jul 20 13:49:12.328853 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:49:12.328818    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-ntcf5_678728d9-5d5d-4550-b8e4-4d88906baa98/konnectivity-agent/0.log"
Jul 20 13:49:12.412221 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:49:12.412138    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-134-121.ec2.internal_e39b9f23455a45c102012bdb6cd46aeb/haproxy/0.log"
Jul 20 13:49:18.118417 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:49:18.118384    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-zpbpp_c71d47d7-dd2b-4439-9a99-5edf9b7a05cc/manager/1.log"
Jul 20 13:49:18.121448 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:49:18.121430    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-zpbpp_c71d47d7-dd2b-4439-9a99-5edf9b7a05cc/manager/0.log"
Jul 20 13:49:18.349457 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:49:18.349365    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-w2q5n_fdc3275b-0cbd-4433-8dce-1bfd7378e27b/registry-server/0.log"
Jul 20 13:49:20.340206 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:49:20.340179    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_d63e2b67-c210-4dd5-b7a4-38d325a1ad31/alertmanager/0.log"
Jul 20 13:49:20.366113 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:49:20.366088    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_d63e2b67-c210-4dd5-b7a4-38d325a1ad31/config-reloader/0.log"
Jul 20 13:49:20.387888 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:49:20.387859    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_d63e2b67-c210-4dd5-b7a4-38d325a1ad31/kube-rbac-proxy-web/0.log"
Jul 20 13:49:20.409777 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:49:20.409747    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_d63e2b67-c210-4dd5-b7a4-38d325a1ad31/kube-rbac-proxy/0.log"
Jul 20 13:49:20.431187 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:49:20.431157    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_d63e2b67-c210-4dd5-b7a4-38d325a1ad31/kube-rbac-proxy-metric/0.log"
Jul 20 13:49:20.457906 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:49:20.457882    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_d63e2b67-c210-4dd5-b7a4-38d325a1ad31/prom-label-proxy/0.log"
Jul 20 13:49:20.481802 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:49:20.481776    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_d63e2b67-c210-4dd5-b7a4-38d325a1ad31/init-config-reloader/0.log"
Jul 20 13:49:20.545664 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:49:20.545638    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56c5594674-snpfl_02263690-62a5-457b-8b95-99d5500d9bad/kube-state-metrics/0.log"
Jul 20 13:49:20.565064 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:49:20.565041    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56c5594674-snpfl_02263690-62a5-457b-8b95-99d5500d9bad/kube-rbac-proxy-main/0.log"
Jul 20 13:49:20.586555 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:49:20.586531    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56c5594674-snpfl_02263690-62a5-457b-8b95-99d5500d9bad/kube-rbac-proxy-self/0.log"
Jul 20 13:49:20.616559 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:49:20.616494    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-99f7c65fb-drlms_8d8b5614-e433-4ea8-a62d-df0cce8ef3b5/metrics-server/0.log"
Jul 20 13:49:20.644759 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:49:20.644732    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-7b7b7bc8bf-g5s74_4b2de50d-d756-4967-97f4-c470056f4e1a/monitoring-plugin/0.log"
Jul 20 13:49:20.681714 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:49:20.681678    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-8v7s6_f7bb3088-03fd-4efb-996d-f52f6faad0bf/node-exporter/0.log"
Jul 20 13:49:20.704704 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:49:20.704678    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-8v7s6_f7bb3088-03fd-4efb-996d-f52f6faad0bf/kube-rbac-proxy/0.log"
Jul 20 13:49:20.729238 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:49:20.729215    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-8v7s6_f7bb3088-03fd-4efb-996d-f52f6faad0bf/init-textfile/0.log"
Jul 20 13:49:20.915640 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:49:20.915563    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-79f6958cdf-z7vtq_7eb8230a-fac0-4584-95ea-5c10947196da/kube-rbac-proxy-main/0.log"
Jul 20 13:49:20.948797 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:49:20.948769    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-79f6958cdf-z7vtq_7eb8230a-fac0-4584-95ea-5c10947196da/kube-rbac-proxy-self/0.log"
Jul 20 13:49:20.971059 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:49:20.971035    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-79f6958cdf-z7vtq_7eb8230a-fac0-4584-95ea-5c10947196da/openshift-state-metrics/0.log"
Jul 20 13:49:21.004774 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:49:21.004746    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_724334da-f6a6-44fd-a04b-971fffbb3149/prometheus/0.log"
Jul 20 13:49:21.024989 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:49:21.024955    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_724334da-f6a6-44fd-a04b-971fffbb3149/config-reloader/0.log"
Jul 20 13:49:21.046306 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:49:21.046280    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_724334da-f6a6-44fd-a04b-971fffbb3149/thanos-sidecar/0.log"
Jul 20 13:49:21.069151 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:49:21.069124    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_724334da-f6a6-44fd-a04b-971fffbb3149/kube-rbac-proxy-web/0.log"
Jul 20 13:49:21.098719 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:49:21.098697    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_724334da-f6a6-44fd-a04b-971fffbb3149/kube-rbac-proxy/0.log"
Jul 20 13:49:21.119209 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:49:21.119185    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_724334da-f6a6-44fd-a04b-971fffbb3149/kube-rbac-proxy-thanos/0.log"
Jul 20 13:49:21.140789 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:49:21.140769    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_724334da-f6a6-44fd-a04b-971fffbb3149/init-config-reloader/0.log"
Jul 20 13:49:21.168179 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:49:21.168115    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-5945b5cfd-p6cmm_0b8795ff-8508-4d6d-a37a-e4cd0512990e/prometheus-operator/0.log"
Jul 20 13:49:21.186239 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:49:21.186212    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-5945b5cfd-p6cmm_0b8795ff-8508-4d6d-a37a-e4cd0512990e/kube-rbac-proxy/0.log"
Jul 20 13:49:21.212476 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:49:21.212452    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-85574b5f49-fk6vk_f1a9360a-4165-4808-b9e2-3f92bff6d588/prometheus-operator-admission-webhook/0.log"
Jul 20 13:49:21.246912 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:49:21.246883    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-59488c66fc-577f4_1967b977-cf31-433a-b44d-b2ab3cda8912/telemeter-client/0.log"
Jul 20 13:49:21.281985 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:49:21.281942    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-59488c66fc-577f4_1967b977-cf31-433a-b44d-b2ab3cda8912/reload/0.log"
Jul 20 13:49:21.302842 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:49:21.302817    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-59488c66fc-577f4_1967b977-cf31-433a-b44d-b2ab3cda8912/kube-rbac-proxy/0.log"
Jul 20 13:49:21.330529 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:49:21.330503    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6c54f98c5d-9mmxz_7182f153-b087-40d6-9fe5-5f6262e5b8d5/thanos-query/0.log"
Jul 20 13:49:21.353309 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:49:21.353286    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6c54f98c5d-9mmxz_7182f153-b087-40d6-9fe5-5f6262e5b8d5/kube-rbac-proxy-web/0.log"
Jul 20 13:49:21.374506 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:49:21.374473    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6c54f98c5d-9mmxz_7182f153-b087-40d6-9fe5-5f6262e5b8d5/kube-rbac-proxy/0.log"
Jul 20 13:49:21.394621 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:49:21.394600    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6c54f98c5d-9mmxz_7182f153-b087-40d6-9fe5-5f6262e5b8d5/prom-label-proxy/0.log"
Jul 20 13:49:21.416104 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:49:21.416074    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6c54f98c5d-9mmxz_7182f153-b087-40d6-9fe5-5f6262e5b8d5/kube-rbac-proxy-rules/0.log"
Jul 20 13:49:21.445113 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:49:21.445042    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6c54f98c5d-9mmxz_7182f153-b087-40d6-9fe5-5f6262e5b8d5/kube-rbac-proxy-metrics/0.log"
Jul 20 13:49:21.946516 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:49:21.946480    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-rqnpn/perf-node-gather-daemonset-skvvd"]
Jul 20 13:49:21.946955 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:49:21.946931    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e9e96e68-82cf-4f77-8bff-9a06e5587b9b" containerName="maas-api"
Jul 20 13:49:21.946955 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:49:21.946952    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="e9e96e68-82cf-4f77-8bff-9a06e5587b9b" containerName="maas-api"
Jul 20 13:49:21.947186 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:49:21.946981    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fcf8644f-7edd-4803-80d2-4cf300b32912" containerName="istio-proxy"
Jul 20 13:49:21.947186 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:49:21.946989    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="fcf8644f-7edd-4803-80d2-4cf300b32912" containerName="istio-proxy"
Jul 20 13:49:21.947186 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:49:21.947002    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="444f22c0-f5d6-4122-aba5-d8758f13fee2" containerName="istio-proxy"
Jul 20 13:49:21.947186 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:49:21.947010    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="444f22c0-f5d6-4122-aba5-d8758f13fee2" containerName="istio-proxy"
Jul 20 13:49:21.947186 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:49:21.947047    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="27240daa-9832-4d48-88e4-207ee61b0e8e" containerName="maas-api"
Jul 20 13:49:21.947186 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:49:21.947055    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="27240daa-9832-4d48-88e4-207ee61b0e8e" containerName="maas-api"
Jul 20 13:49:21.947186 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:49:21.947158    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="e9e96e68-82cf-4f77-8bff-9a06e5587b9b" containerName="maas-api"
Jul 20 13:49:21.947186 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:49:21.947170    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="fcf8644f-7edd-4803-80d2-4cf300b32912" containerName="istio-proxy"
Jul 20 13:49:21.947186 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:49:21.947179    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="444f22c0-f5d6-4122-aba5-d8758f13fee2" containerName="istio-proxy"
Jul 20 13:49:21.947186 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:49:21.947186    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="27240daa-9832-4d48-88e4-207ee61b0e8e" containerName="maas-api"
Jul 20 13:49:21.947524 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:49:21.947193    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="fcf8644f-7edd-4803-80d2-4cf300b32912" containerName="istio-proxy"
Jul 20 13:49:21.950556 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:49:21.950539    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-rqnpn/perf-node-gather-daemonset-skvvd"
Jul 20 13:49:21.952653 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:49:21.952633    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-rqnpn\"/\"default-dockercfg-9dmdv\""
Jul 20 13:49:21.952952 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:49:21.952938    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-rqnpn\"/\"openshift-service-ca.crt\""
Jul 20 13:49:21.953083 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:49:21.952994    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-rqnpn\"/\"kube-root-ca.crt\""
Jul 20 13:49:21.959396 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:49:21.959376    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-rqnpn/perf-node-gather-daemonset-skvvd"]
Jul 20 13:49:22.105891 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:49:22.105863    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6zclt\" (UniqueName: \"kubernetes.io/projected/43dc6319-0f53-4ba7-88d5-a5b8325e1231-kube-api-access-6zclt\") pod \"perf-node-gather-daemonset-skvvd\" (UID: \"43dc6319-0f53-4ba7-88d5-a5b8325e1231\") " pod="openshift-must-gather-rqnpn/perf-node-gather-daemonset-skvvd"
Jul 20 13:49:22.106083 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:49:22.105910    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/43dc6319-0f53-4ba7-88d5-a5b8325e1231-lib-modules\") pod \"perf-node-gather-daemonset-skvvd\" (UID: \"43dc6319-0f53-4ba7-88d5-a5b8325e1231\") " pod="openshift-must-gather-rqnpn/perf-node-gather-daemonset-skvvd"
Jul 20 13:49:22.106083 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:49:22.105992    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/43dc6319-0f53-4ba7-88d5-a5b8325e1231-proc\") pod \"perf-node-gather-daemonset-skvvd\" (UID: \"43dc6319-0f53-4ba7-88d5-a5b8325e1231\") " pod="openshift-must-gather-rqnpn/perf-node-gather-daemonset-skvvd"
Jul 20 13:49:22.106083 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:49:22.106031    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/43dc6319-0f53-4ba7-88d5-a5b8325e1231-podres\") pod \"perf-node-gather-daemonset-skvvd\" (UID: \"43dc6319-0f53-4ba7-88d5-a5b8325e1231\") " pod="openshift-must-gather-rqnpn/perf-node-gather-daemonset-skvvd"
Jul 20 13:49:22.106083 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:49:22.106073    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/43dc6319-0f53-4ba7-88d5-a5b8325e1231-sys\") pod \"perf-node-gather-daemonset-skvvd\" (UID: \"43dc6319-0f53-4ba7-88d5-a5b8325e1231\") " pod="openshift-must-gather-rqnpn/perf-node-gather-daemonset-skvvd"
Jul 20 13:49:22.207502 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:49:22.207407    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/43dc6319-0f53-4ba7-88d5-a5b8325e1231-podres\") pod \"perf-node-gather-daemonset-skvvd\" (UID: \"43dc6319-0f53-4ba7-88d5-a5b8325e1231\") " pod="openshift-must-gather-rqnpn/perf-node-gather-daemonset-skvvd"
Jul 20 13:49:22.207502 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:49:22.207468    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/43dc6319-0f53-4ba7-88d5-a5b8325e1231-sys\") pod \"perf-node-gather-daemonset-skvvd\" (UID: \"43dc6319-0f53-4ba7-88d5-a5b8325e1231\") " pod="openshift-must-gather-rqnpn/perf-node-gather-daemonset-skvvd"
Jul 20 13:49:22.207725 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:49:22.207543    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/43dc6319-0f53-4ba7-88d5-a5b8325e1231-sys\") pod \"perf-node-gather-daemonset-skvvd\" (UID: \"43dc6319-0f53-4ba7-88d5-a5b8325e1231\") " pod="openshift-must-gather-rqnpn/perf-node-gather-daemonset-skvvd"
Jul 20 13:49:22.207725 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:49:22.207560    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6zclt\" (UniqueName: \"kubernetes.io/projected/43dc6319-0f53-4ba7-88d5-a5b8325e1231-kube-api-access-6zclt\") pod \"perf-node-gather-daemonset-skvvd\" (UID: \"43dc6319-0f53-4ba7-88d5-a5b8325e1231\") " pod="openshift-must-gather-rqnpn/perf-node-gather-daemonset-skvvd"
Jul 20 13:49:22.207725 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:49:22.207567    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/43dc6319-0f53-4ba7-88d5-a5b8325e1231-podres\") pod \"perf-node-gather-daemonset-skvvd\" (UID: \"43dc6319-0f53-4ba7-88d5-a5b8325e1231\") " pod="openshift-must-gather-rqnpn/perf-node-gather-daemonset-skvvd"
Jul 20 13:49:22.207725 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:49:22.207633    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/43dc6319-0f53-4ba7-88d5-a5b8325e1231-lib-modules\") pod \"perf-node-gather-daemonset-skvvd\" (UID: \"43dc6319-0f53-4ba7-88d5-a5b8325e1231\") " pod="openshift-must-gather-rqnpn/perf-node-gather-daemonset-skvvd"
Jul 20 13:49:22.207725 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:49:22.207676    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/43dc6319-0f53-4ba7-88d5-a5b8325e1231-proc\") pod \"perf-node-gather-daemonset-skvvd\" (UID: \"43dc6319-0f53-4ba7-88d5-a5b8325e1231\") " pod="openshift-must-gather-rqnpn/perf-node-gather-daemonset-skvvd"
Jul 20 13:49:22.207948 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:49:22.207779    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/43dc6319-0f53-4ba7-88d5-a5b8325e1231-proc\") pod \"perf-node-gather-daemonset-skvvd\" (UID: \"43dc6319-0f53-4ba7-88d5-a5b8325e1231\") " pod="openshift-must-gather-rqnpn/perf-node-gather-daemonset-skvvd"
Jul 20 13:49:22.207948 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:49:22.207794    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/43dc6319-0f53-4ba7-88d5-a5b8325e1231-lib-modules\") pod \"perf-node-gather-daemonset-skvvd\" (UID: \"43dc6319-0f53-4ba7-88d5-a5b8325e1231\") " pod="openshift-must-gather-rqnpn/perf-node-gather-daemonset-skvvd"
Jul 20 13:49:22.215208 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:49:22.215188    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6zclt\" (UniqueName: \"kubernetes.io/projected/43dc6319-0f53-4ba7-88d5-a5b8325e1231-kube-api-access-6zclt\") pod \"perf-node-gather-daemonset-skvvd\" (UID: \"43dc6319-0f53-4ba7-88d5-a5b8325e1231\") " pod="openshift-must-gather-rqnpn/perf-node-gather-daemonset-skvvd"
Jul 20 13:49:22.262350 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:49:22.262320    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-rqnpn/perf-node-gather-daemonset-skvvd"
Jul 20 13:49:22.393602 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:49:22.393577    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-rqnpn/perf-node-gather-daemonset-skvvd"]
Jul 20 13:49:22.395405 ip-10-0-134-121 kubenswrapper[2584]: W0720 13:49:22.395376    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod43dc6319_0f53_4ba7_88d5_a5b8325e1231.slice/crio-7d9f13c9882f27b3f8e528f60e645b4343d274597543f9ae0fd29f2c8309f79e WatchSource:0}: Error finding container 7d9f13c9882f27b3f8e528f60e645b4343d274597543f9ae0fd29f2c8309f79e: Status 404 returned error can't find the container with id 7d9f13c9882f27b3f8e528f60e645b4343d274597543f9ae0fd29f2c8309f79e
Jul 20 13:49:22.960034 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:49:22.959933    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-rqnpn/perf-node-gather-daemonset-skvvd" event={"ID":"43dc6319-0f53-4ba7-88d5-a5b8325e1231","Type":"ContainerStarted","Data":"7dd4d59d4b8d5b97b38e6b98e05b4a75fadbd2cc651bd4098fca44e49d73e9f2"}
Jul 20 13:49:22.960034 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:49:22.960004    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-rqnpn/perf-node-gather-daemonset-skvvd" event={"ID":"43dc6319-0f53-4ba7-88d5-a5b8325e1231","Type":"ContainerStarted","Data":"7d9f13c9882f27b3f8e528f60e645b4343d274597543f9ae0fd29f2c8309f79e"}
Jul 20 13:49:22.960252 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:49:22.960057    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-rqnpn/perf-node-gather-daemonset-skvvd"
Jul 20 13:49:22.978923 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:49:22.978872    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-rqnpn/perf-node-gather-daemonset-skvvd" podStartSLOduration=1.9788542059999998 podStartE2EDuration="1.978854206s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 13:49:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 13:49:22.977615556 +0000 UTC m=+2852.694162967" watchObservedRunningTime="2026-07-20 13:49:22.978854206 +0000 UTC m=+2852.695401619"
Jul 20 13:49:25.248792 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:49:25.248759    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-b4v89_665de046-e6ce-435b-acf0-64c86a9585f9/dns/0.log"
Jul 20 13:49:25.284082 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:49:25.284055    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-b4v89_665de046-e6ce-435b-acf0-64c86a9585f9/kube-rbac-proxy/0.log"
Jul 20 13:49:25.529032 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:49:25.528947    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-hgvl2_548d5005-1a66-4385-9ebc-6844b175673d/dns-node-resolver/0.log"
Jul 20 13:49:26.202751 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:49:26.202724    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-hsm2t_48cff737-3690-4df6-8e01-3b06c888f58f/node-ca/0.log"
Jul 20 13:49:27.111590 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:49:27.111563    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4xkqwv_0d945cc6-346b-4037-a971-2afe9b904532/istio-proxy/0.log"
Jul 20 13:49:27.338555 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:49:27.338526    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-669mt_d1f7d779-906f-40bb-945a-fae805b1d5f7/istio-proxy/0.log"
Jul 20 13:49:27.368357 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:49:27.368275    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-669mt_d1f7d779-906f-40bb-945a-fae805b1d5f7/istio-proxy/1.log"
Jul 20 13:49:27.396556 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:49:27.396530    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-74584bb9f8-fkdl9_f9b38cd6-b909-4389-b30f-0a995edacec4/payload-pre-processing/0.log"
Jul 20 13:49:27.433433 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:49:27.433405    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-f9b8d9b9b-d5qcq_ba9fa0dd-9b78-428e-b33b-b6d75669f26c/payload-processing/0.log"
Jul 20 13:49:28.231728 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:49:28.231698    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-l7t7v_4335d45c-7a98-4335-b4e6-1ca7356b69bf/serve-healthcheck-canary/0.log"
Jul 20 13:49:28.704414 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:49:28.704386    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-47dgd_d968a7e1-9b1f-4a71-ac30-3ddf7f7907bf/kube-rbac-proxy/0.log"
Jul 20 13:49:28.728348 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:49:28.728326    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-47dgd_d968a7e1-9b1f-4a71-ac30-3ddf7f7907bf/exporter/0.log"
Jul 20 13:49:28.751628 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:49:28.751604    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-47dgd_d968a7e1-9b1f-4a71-ac30-3ddf7f7907bf/extractor/0.log"
Jul 20 13:49:28.975548 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:49:28.975466    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-rqnpn/perf-node-gather-daemonset-skvvd"
Jul 20 13:49:31.174015 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:49:31.173988    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-bgjjs_3b6eeb61-e4af-47fa-8851-ee5f5dc9c802/manager/0.log"
Jul 20 13:49:31.477195 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:49:31.477110    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-78b9bfcd6-ztpbk_bf4a9a9d-ad38-43aa-87be-4818eabc0199/manager/0.log"
Jul 20 13:49:31.759247 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:49:31.759220    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-85766d874c-vmwmg_00f64fd0-e3e5-4da2-bf17-497e7521a6b6/manager/0.log"
Jul 20 13:49:31.778319 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:49:31.778289    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-85766d874c-vmwmg_00f64fd0-e3e5-4da2-bf17-497e7521a6b6/copy-manifests/0.log"
Jul 20 13:49:32.556927 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:49:32.556897    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4xkqwv_0d945cc6-346b-4037-a971-2afe9b904532/istio-proxy/0.log"
Jul 20 13:49:32.760290 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:49:32.760238    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-669mt_d1f7d779-906f-40bb-945a-fae805b1d5f7/istio-proxy/0.log"
Jul 20 13:49:32.786837 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:49:32.786804    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-669mt_d1f7d779-906f-40bb-945a-fae805b1d5f7/istio-proxy/1.log"
Jul 20 13:49:32.807317 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:49:32.807235    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-74584bb9f8-fkdl9_f9b38cd6-b909-4389-b30f-0a995edacec4/payload-pre-processing/0.log"
Jul 20 13:49:32.825428 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:49:32.825397    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-f9b8d9b9b-d5qcq_ba9fa0dd-9b78-428e-b33b-b6d75669f26c/payload-processing/0.log"
Jul 20 13:49:33.061899 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:49:33.061816    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-84676b455f-t69fl_6f891740-e814-48ff-8796-372afc6f1c2d/manager/0.log"
Jul 20 13:49:34.015978 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:49:34.015936    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4xkqwv_0d945cc6-346b-4037-a971-2afe9b904532/istio-proxy/0.log"
Jul 20 13:49:34.218500 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:49:34.218472    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-669mt_d1f7d779-906f-40bb-945a-fae805b1d5f7/istio-proxy/0.log"
Jul 20 13:49:34.256102 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:49:34.256066    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-669mt_d1f7d779-906f-40bb-945a-fae805b1d5f7/istio-proxy/1.log"
Jul 20 13:49:34.276436 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:49:34.276352    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-74584bb9f8-fkdl9_f9b38cd6-b909-4389-b30f-0a995edacec4/payload-pre-processing/0.log"
Jul 20 13:49:34.295562 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:49:34.295529    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-f9b8d9b9b-d5qcq_ba9fa0dd-9b78-428e-b33b-b6d75669f26c/payload-processing/0.log"
Jul 20 13:49:39.562263 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:49:39.562232    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-9l8sl_b5a49b2c-c21c-4600-adf6-dc15dda1ff06/kube-multus/0.log"
Jul 20 13:49:39.909139 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:49:39.909055    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-szpnb_95e88ecd-0ff4-4a0b-b8ef-b395ee2a78db/kube-multus-additional-cni-plugins/0.log"
Jul 20 13:49:39.933130 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:49:39.933103    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-szpnb_95e88ecd-0ff4-4a0b-b8ef-b395ee2a78db/egress-router-binary-copy/0.log"
Jul 20 13:49:39.956894 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:49:39.956864    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-szpnb_95e88ecd-0ff4-4a0b-b8ef-b395ee2a78db/cni-plugins/0.log"
Jul 20 13:49:39.982412 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:49:39.982391    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-szpnb_95e88ecd-0ff4-4a0b-b8ef-b395ee2a78db/bond-cni-plugin/0.log"
Jul 20 13:49:40.008204 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:49:40.008180    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-szpnb_95e88ecd-0ff4-4a0b-b8ef-b395ee2a78db/routeoverride-cni/0.log"
Jul 20 13:49:40.031802 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:49:40.031772    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-szpnb_95e88ecd-0ff4-4a0b-b8ef-b395ee2a78db/whereabouts-cni-bincopy/0.log"
Jul 20 13:49:40.055764 ip-10-0-134-121 kubenswrapper[2584]: I0720 13:49:40.055726    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-szpnb_95e88ecd-0ff4-4a0b-b8ef-b395ee2a78db/whereabouts-cni/0.log"