Jul 15 21:27:33.724949 ip-10-0-130-217 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Jul 15 21:27:33.724960 ip-10-0-130-217 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Jul 15 21:27:33.724970 ip-10-0-130-217 systemd[1]: kubelet.service: Failed with result 'resources'.
Jul 15 21:27:33.725378 ip-10-0-130-217 systemd[1]: Failed to start Kubernetes Kubelet.
Jul 15 21:27:42.109554 ip-10-0-130-217 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Jul 15 21:27:42.109567 ip-10-0-130-217 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 0b4f868e91674c05bd64fcdf1270eca8 --
Jul 15 21:29:10.171220 ip-10-0-130-217 systemd[1]: Starting Kubernetes Kubelet...
Jul 15 21:29:10.641392 ip-10-0-130-217 kubenswrapper[2563]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 15 21:29:10.641392 ip-10-0-130-217 kubenswrapper[2563]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 15 21:29:10.641392 ip-10-0-130-217 kubenswrapper[2563]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 15 21:29:10.641392 ip-10-0-130-217 kubenswrapper[2563]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 15 21:29:10.641392 ip-10-0-130-217 kubenswrapper[2563]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 15 21:29:10.641392 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:10.639199    2563 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 15 21:29:10.657557 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.644381    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 15 21:29:10.657557 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.644396    2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 15 21:29:10.657557 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.644402    2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 15 21:29:10.657557 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.644406    2563 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 15 21:29:10.657557 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.644409    2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 15 21:29:10.657557 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.644413    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 15 21:29:10.657557 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.644416    2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 15 21:29:10.657557 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.644419    2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 15 21:29:10.657557 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.644422    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 15 21:29:10.657557 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.644425    2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 15 21:29:10.657557 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.644428    2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 15 21:29:10.657557 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.644430    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 15 21:29:10.657557 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.644433    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 15 21:29:10.657557 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.644436    2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 15 21:29:10.657557 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.644444    2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 15 21:29:10.657557 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.644447    2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 15 21:29:10.657557 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.644450    2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 15 21:29:10.657557 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.644452    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 15 21:29:10.657557 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.644455    2563 feature_gate.go:328] unrecognized feature gate: Example2
Jul 15 21:29:10.671837 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.644458    2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 15 21:29:10.671837 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.644460    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 15 21:29:10.671837 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.644463    2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 15 21:29:10.671837 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.644465    2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 15 21:29:10.671837 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.644468    2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 15 21:29:10.671837 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.644470    2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 15 21:29:10.671837 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.644473    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 15 21:29:10.671837 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.644476    2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 15 21:29:10.671837 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.644479    2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 15 21:29:10.671837 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.644481    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 15 21:29:10.671837 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.644484    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 15 21:29:10.671837 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.644487    2563 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 15 21:29:10.671837 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.644489    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 15 21:29:10.671837 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.644492    2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 15 21:29:10.671837 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.644495    2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 15 21:29:10.671837 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.644498    2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 15 21:29:10.671837 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.644502    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 15 21:29:10.671837 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.644504    2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 15 21:29:10.671837 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.644508    2563 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 15 21:29:10.671837 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.644511    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 15 21:29:10.674067 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.644513    2563 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 15 21:29:10.674067 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.644516    2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 15 21:29:10.674067 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.644518    2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 15 21:29:10.674067 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.644521    2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 15 21:29:10.674067 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.644524    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 15 21:29:10.674067 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.644526    2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 15 21:29:10.674067 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.644529    2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 15 21:29:10.674067 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.644532    2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 15 21:29:10.674067 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.644534    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 15 21:29:10.674067 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.644537    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 15 21:29:10.674067 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.644540    2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 15 21:29:10.674067 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.644542    2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 15 21:29:10.674067 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.644545    2563 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 15 21:29:10.674067 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.644548    2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 15 21:29:10.674067 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.644551    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 15 21:29:10.674067 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.644553    2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 15 21:29:10.674067 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.644556    2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 15 21:29:10.674067 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.644559    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 15 21:29:10.674067 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.644561    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 15 21:29:10.674067 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.644564    2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 15 21:29:10.675853 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.644566    2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 15 21:29:10.675853 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.644569    2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 15 21:29:10.675853 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.644571    2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 15 21:29:10.675853 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.644574    2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 15 21:29:10.675853 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.644576    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 15 21:29:10.675853 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.644579    2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 15 21:29:10.675853 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.644582    2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 15 21:29:10.675853 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.644584    2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 15 21:29:10.675853 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.644587    2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 15 21:29:10.675853 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.644591    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 15 21:29:10.675853 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.644594    2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 15 21:29:10.675853 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.644597    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 15 21:29:10.675853 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.644600    2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 15 21:29:10.675853 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.644603    2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 15 21:29:10.675853 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.644605    2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 15 21:29:10.675853 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.644608    2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 15 21:29:10.675853 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.644610    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 15 21:29:10.675853 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.644613    2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 15 21:29:10.675853 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.644615    2563 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 15 21:29:10.678131 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.644619    2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 15 21:29:10.678131 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.644623    2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 15 21:29:10.678131 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.644625    2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 15 21:29:10.678131 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.644628    2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 15 21:29:10.678131 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.644630    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 15 21:29:10.678131 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.644633    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 15 21:29:10.678131 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.644635    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 15 21:29:10.678131 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.644639    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 15 21:29:10.678131 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.644642    2563 feature_gate.go:328] unrecognized feature gate: Example
Jul 15 21:29:10.678131 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.644644    2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 15 21:29:10.678131 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.644648    2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 15 21:29:10.678131 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.644651    2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 15 21:29:10.678131 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.644654    2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 15 21:29:10.678131 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.644657    2563 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 15 21:29:10.678131 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.644659    2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 15 21:29:10.678131 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.644662    2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 15 21:29:10.678131 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.644664    2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 15 21:29:10.678131 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.644667    2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 15 21:29:10.678131 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.644669    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 15 21:29:10.739885 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.644672    2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 15 21:29:10.739885 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.644675    2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 15 21:29:10.739885 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.645382    2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 15 21:29:10.739885 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.645391    2563 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 15 21:29:10.739885 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.645396    2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 15 21:29:10.739885 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.645400    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 15 21:29:10.739885 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.645403    2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 15 21:29:10.739885 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.645406    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 15 21:29:10.739885 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.645409    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 15 21:29:10.739885 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.645412    2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 15 21:29:10.739885 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.645415    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 15 21:29:10.739885 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.645417    2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 15 21:29:10.739885 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.645420    2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 15 21:29:10.739885 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.645423    2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 15 21:29:10.739885 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.645426    2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 15 21:29:10.739885 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.645429    2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 15 21:29:10.739885 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.645432    2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 15 21:29:10.739885 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.645434    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 15 21:29:10.739885 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.645437    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 15 21:29:10.739885 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.645440    2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 15 21:29:10.741676 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.645443    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 15 21:29:10.741676 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.645445    2563 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 15 21:29:10.741676 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.645448    2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 15 21:29:10.741676 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.645450    2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 15 21:29:10.741676 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.645453    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 15 21:29:10.741676 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.645456    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 15 21:29:10.741676 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.645459    2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 15 21:29:10.741676 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.645462    2563 feature_gate.go:328] unrecognized feature gate: Example
Jul 15 21:29:10.741676 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.645464    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 15 21:29:10.741676 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.645467    2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 15 21:29:10.741676 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.645469    2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 15 21:29:10.741676 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.645472    2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 15 21:29:10.741676 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.645475    2563 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 15 21:29:10.741676 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.645477    2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 15 21:29:10.741676 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.645481    2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 15 21:29:10.741676 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.645485    2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 15 21:29:10.741676 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.645489    2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 15 21:29:10.741676 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.645492    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 15 21:29:10.741676 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.645495    2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 15 21:29:10.722247 ip-10-0-130-217 systemd[1]: Started Kubernetes Kubelet.
Jul 15 21:29:10.971675 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.645498    2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 15 21:29:10.971675 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.645501    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 15 21:29:10.971675 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.645503    2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 15 21:29:10.971675 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.645506    2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 15 21:29:10.971675 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.645509    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 15 21:29:10.971675 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.645511    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 15 21:29:10.971675 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.645514    2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 15 21:29:10.971675 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.645517    2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 15 21:29:10.971675 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.645519    2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 15 21:29:10.971675 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.645523    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 15 21:29:10.971675 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.645526    2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 15 21:29:10.971675 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.645528    2563 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 15 21:29:10.971675 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.645532    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 15 21:29:10.971675 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.645535    2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 15 21:29:10.971675 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.645538    2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 15 21:29:10.971675 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.645540    2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 15 21:29:10.971675 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.645543    2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 15 21:29:10.971675 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.645546    2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 15 21:29:10.971675 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.645548    2563 feature_gate.go:328] unrecognized feature gate: Example2
Jul 15 21:29:10.971675 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.645552    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 15 21:29:10.988410 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.645554    2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 15 21:29:10.988410 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.645557    2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 15 21:29:10.988410 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.645560    2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 15 21:29:10.988410 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.645563    2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 15 21:29:10.988410 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.645565    2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 15 21:29:10.988410 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.645568    2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 15 21:29:10.988410 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.645570    2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 15 21:29:10.988410 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.645573    2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 15 21:29:10.988410 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.645576    2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 15 21:29:10.988410 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.645578    2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 15 21:29:10.988410 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.645581    2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 15 21:29:10.988410 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.645583    2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 15 21:29:10.988410 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.645586    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 15 21:29:10.988410 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.645589    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 15 21:29:10.988410 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.645592    2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 15 21:29:10.988410 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.645595    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 15 21:29:10.988410 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.645597    2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 15 21:29:10.988410 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.645600    2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 15 21:29:10.988410 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.645602    2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 15 21:29:10.988410 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.645605    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 15 21:29:10.989349 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.645609    2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 15 21:29:10.989349 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.645613    2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 15 21:29:10.989349 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.645617    2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 15 21:29:10.989349 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.645620    2563 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 15 21:29:10.989349 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.645623    2563 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 15 21:29:10.989349 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.645627    2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 15 21:29:10.989349 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.645629    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 15 21:29:10.989349 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.645632    2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 15 21:29:10.989349 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.645635    2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 15 21:29:10.989349 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.645637    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 15 21:29:10.989349 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.645640    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 15 21:29:10.989349 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.645643    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 15 21:29:10.989349 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.645646    2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 15 21:29:10.989349 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.645648    2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 15 21:29:10.989349 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.645651    2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 15 21:29:10.989349 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.645654    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 15 21:29:10.989349 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.645657    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 15 21:29:10.989349 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.645660    2563 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 15 21:29:10.989349 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.645662    2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 15 21:29:10.990048 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.645665    2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 15 21:29:10.990048 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.645668    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 15 21:29:10.990048 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.645674    2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 15 21:29:10.990048 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.646860    2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 15 21:29:10.990048 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.646867    2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 15 21:29:10.990048 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.646871    2563 feature_gate.go:328] unrecognized feature gate: Example
Jul 15 21:29:10.990048 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.646874    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 15 21:29:10.990048 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.646878    2563 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 15 21:29:10.990048 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.646880    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 15 21:29:10.990048 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.646884    2563 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 15 21:29:10.990048 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.646887    2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 15 21:29:10.990048 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.646889    2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 15 21:29:10.990048 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.646892    2563 feature_gate.go:328] unrecognized feature gate: Example2
Jul 15 21:29:10.990048 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.646895    2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 15 21:29:10.990048 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.646897    2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 15 21:29:10.990048 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.646900    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 15 21:29:10.990048 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.646904    2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 15 21:29:10.990048 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.646908    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 15 21:29:10.990048 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.646911    2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 15 21:29:10.990048 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.646914    2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 15 21:29:10.990637 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.646917    2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 15 21:29:10.990637 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.646920    2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 15 21:29:10.990637 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.646922    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 15 21:29:10.990637 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.646926    2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 15 21:29:10.990637 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.646929    2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 15 21:29:10.990637 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.646931    2563 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 15 21:29:10.990637 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.646946    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 15 21:29:10.990637 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.646949    2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 15 21:29:10.990637 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.646952    2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 15 21:29:10.990637 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.646954    2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 15 21:29:10.990637 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.646957    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 15 21:29:10.990637 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.646960    2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 15 21:29:10.990637 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.646962    2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 15 21:29:10.990637 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.646965    2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 15 21:29:10.990637 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.646970    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 15 21:29:10.990637 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.646973    2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 15 21:29:10.990637 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.646975    2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 15 21:29:10.990637 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.646979    2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 15 21:29:10.990637 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.646982    2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 15 21:29:10.990637 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.646985    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 15 21:29:10.991301 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.646988    2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 15 21:29:10.991301 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.646991    2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 15 21:29:10.991301 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.646994    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 15 21:29:10.991301 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.646997    2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 15 21:29:10.991301 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.646999    2563 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 15 21:29:10.991301 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.647002    2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 15 21:29:10.991301 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.647004    2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 15 21:29:10.991301 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.647007    2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 15 21:29:10.991301 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.647010    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 15 21:29:10.991301 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.647013    2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 15 21:29:10.991301 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.647015    2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 15 21:29:10.991301 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.647018    2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 15 21:29:10.991301 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.647020    2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 15 21:29:10.991301 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.647023    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 15 21:29:10.991301 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.647025    2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 15 21:29:10.991301 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.647028    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 15 21:29:10.991301 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.647032    2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 15 21:29:10.991301 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.647034    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 15 21:29:10.991301 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.647037    2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 15 21:29:10.991301 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.647039    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 15 21:29:10.991877 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.647042    2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 15 21:29:10.991877 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.647044    2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 15 21:29:10.991877 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.647047    2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 15 21:29:10.991877 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.647049    2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 15 21:29:10.991877 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.647052    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 15 21:29:10.991877 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.647055    2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 15 21:29:10.991877 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.647058    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 15 21:29:10.991877 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.647061    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 15 21:29:10.991877 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.647064    2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 15 21:29:10.991877 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.647068    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 15 21:29:10.991877 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.647071    2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 15 21:29:10.991877 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.647074    2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 15 21:29:10.991877 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.647076    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 15 21:29:10.991877 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.647080    2563 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 15 21:29:10.991877 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.647082    2563 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 15 21:29:10.991877 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.647086    2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 15 21:29:10.991877 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.647090    2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 15 21:29:10.991877 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.647093    2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 15 21:29:10.991877 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.647096    2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 15 21:29:10.992515 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.647099    2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 15 21:29:10.992515 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.647101    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 15 21:29:10.992515 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.647104    2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 15 21:29:10.992515 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.647107    2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 15 21:29:10.992515 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.647109    2563 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 15 21:29:10.992515 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.647112    2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 15 21:29:10.992515 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.647116    2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 15 21:29:10.992515 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.647118    2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 15 21:29:10.992515 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.647121    2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 15 21:29:10.992515 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.647124    2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 15 21:29:10.992515 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.647126    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 15 21:29:10.992515 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.647129    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 15 21:29:10.992515 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.647131    2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 15 21:29:10.992515 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.647134    2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 15 21:29:10.992515 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.647138    2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 15 21:29:10.992515 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.647141    2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 15 21:29:10.992515 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.647144    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 15 21:29:10.992515 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.647147    2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 15 21:29:10.992515 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.647150    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 15 21:29:10.993091 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.647158    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 15 21:29:10.993091 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.647161    2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 15 21:29:10.993091 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.647164    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 15 21:29:10.993091 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.647168    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 15 21:29:10.993091 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:10.647242    2563 flags.go:64] FLAG: --address="0.0.0.0"
Jul 15 21:29:10.993091 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:10.647249    2563 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 15 21:29:10.993091 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:10.647256    2563 flags.go:64] FLAG: --anonymous-auth="true"
Jul 15 21:29:10.993091 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:10.647260    2563 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 15 21:29:10.993091 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:10.647265    2563 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 15 21:29:10.993091 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:10.647268    2563 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 15 21:29:10.993091 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:10.647272    2563 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 15 21:29:10.993091 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:10.647276    2563 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 15 21:29:10.993091 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:10.647280    2563 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 15 21:29:10.993091 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:10.647283    2563 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 15 21:29:10.993091 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:10.647286    2563 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 15 21:29:10.993091 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:10.647290    2563 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 15 21:29:10.993091 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:10.647293    2563 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 15 21:29:10.993091 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:10.647296    2563 flags.go:64] FLAG: --cgroup-root=""
Jul 15 21:29:10.993091 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:10.647299    2563 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 15 21:29:10.993091 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:10.647302    2563 flags.go:64] FLAG: --client-ca-file=""
Jul 15 21:29:10.993091 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:10.647305    2563 flags.go:64] FLAG: --cloud-provider="external"
Jul 15 21:29:10.993091 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:10.647308    2563 flags.go:64] FLAG: --cluster-dns="[]"
Jul 15 21:29:10.993091 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:10.647312    2563 flags.go:64] FLAG: --cluster-domain=""
Jul 15 21:29:10.993091 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:10.647315    2563 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 15 21:29:10.993796 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:10.647318    2563 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 15 21:29:10.993796 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:10.647321    2563 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 15 21:29:10.993796 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:10.647324    2563 flags.go:64] FLAG: --container-log-max-files="5"
Jul 15 21:29:10.993796 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:10.647328    2563 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 15 21:29:10.993796 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:10.647331    2563 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 15 21:29:10.993796 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:10.647334    2563 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 15 21:29:10.993796 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:10.647337    2563 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 15 21:29:10.993796 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:10.647340    2563 flags.go:64] FLAG: --contention-profiling="false"
Jul 15 21:29:10.993796 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:10.647344    2563 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 15 21:29:10.993796 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:10.647347    2563 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 15 21:29:10.993796 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:10.647350    2563 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 15 21:29:10.993796 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:10.647355    2563 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 15 21:29:10.993796 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:10.647359    2563 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 15 21:29:10.993796 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:10.647362    2563 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 15 21:29:10.993796 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:10.647365    2563 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 15 21:29:10.993796 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:10.647368    2563 flags.go:64] FLAG: --enable-load-reader="false"
Jul 15 21:29:10.993796 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:10.647371    2563 flags.go:64] FLAG: --enable-server="true"
Jul 15 21:29:10.993796 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:10.647375    2563 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 15 21:29:10.993796 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:10.647379    2563 flags.go:64] FLAG: --event-burst="100"
Jul 15 21:29:10.993796 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:10.647382    2563 flags.go:64] FLAG: --event-qps="50"
Jul 15 21:29:10.993796 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:10.647385    2563 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 15 21:29:10.993796 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:10.647388    2563 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 15 21:29:10.993796 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:10.647391    2563 flags.go:64] FLAG: --eviction-hard=""
Jul 15 21:29:10.993796 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:10.647395    2563 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 15 21:29:10.994507 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:10.647397    2563 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 15 21:29:10.994507 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:10.647401    2563 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 15 21:29:10.994507 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:10.647403    2563 flags.go:64] FLAG: --eviction-soft=""
Jul 15 21:29:10.994507 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:10.647406    2563 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 15 21:29:10.994507 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:10.647409    2563 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 15 21:29:10.994507 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:10.647412    2563 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 15 21:29:10.994507 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:10.647415    2563 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 15 21:29:10.994507 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:10.647417    2563 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 15 21:29:10.994507 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:10.647420    2563 flags.go:64] FLAG: --fail-swap-on="true"
Jul 15 21:29:10.994507 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:10.647423    2563 flags.go:64] FLAG: --feature-gates=""
Jul 15 21:29:10.994507 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:10.647427    2563 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 15 21:29:10.994507 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:10.647430    2563 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 15 21:29:10.994507 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:10.647433    2563 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 15 21:29:10.994507 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:10.647436    2563 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 15 21:29:10.994507 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:10.647439    2563 flags.go:64] FLAG: --healthz-port="10248"
Jul 15 21:29:10.994507 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:10.647442    2563 flags.go:64] FLAG: --help="false"
Jul 15 21:29:10.994507 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:10.647446    2563 flags.go:64] FLAG: --hostname-override="ip-10-0-130-217.ec2.internal"
Jul 15 21:29:10.994507 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:10.647449    2563 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 15 21:29:10.994507 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:10.647452    2563 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 15 21:29:10.994507 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:10.647456    2563 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 15 21:29:10.994507 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:10.647459    2563 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 15 21:29:10.994507 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:10.647463    2563 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 15 21:29:10.994507 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:10.647466    2563 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 15 21:29:10.994507 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:10.647468    2563 flags.go:64] FLAG: --image-service-endpoint=""
Jul 15 21:29:10.995344 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:10.647471    2563 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 15 21:29:10.995344 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:10.647474    2563 flags.go:64] FLAG: --kube-api-burst="100"
Jul 15 21:29:10.995344 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:10.647480    2563 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 15 21:29:10.995344 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:10.647483    2563 flags.go:64] FLAG: --kube-api-qps="50"
Jul 15 21:29:10.995344 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:10.647486    2563 flags.go:64] FLAG: --kube-reserved=""
Jul 15 21:29:10.995344 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:10.647489    2563 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 15 21:29:10.995344 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:10.647492    2563 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 15 21:29:10.995344 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:10.647495    2563 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 15 21:29:10.995344 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:10.647498    2563 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 15 21:29:10.995344 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:10.647500    2563 flags.go:64] FLAG: --lock-file=""
Jul 15 21:29:10.995344 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:10.647503    2563 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 15 21:29:10.995344 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:10.647506    2563 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 15 21:29:10.995344 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:10.647509    2563 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 15 21:29:10.995344 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:10.647514    2563 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 15 21:29:10.995344 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:10.647517    2563 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 15 21:29:10.995344 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:10.647520    2563 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 15 21:29:10.995344 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:10.647523    2563 flags.go:64] FLAG: --logging-format="text"
Jul 15 21:29:10.995344 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:10.647526    2563 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 15 21:29:10.995344 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:10.647529    2563 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 15 21:29:10.995344 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:10.647532    2563 flags.go:64] FLAG: --manifest-url=""
Jul 15 21:29:10.995344 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:10.647534    2563 flags.go:64] FLAG: --manifest-url-header=""
Jul 15 21:29:10.995344 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:10.647539    2563 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 15 21:29:10.995344 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:10.647541    2563 flags.go:64] FLAG: --max-open-files="1000000"
Jul 15 21:29:10.995344 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:10.647545    2563 flags.go:64] FLAG: --max-pods="110"
Jul 15 21:29:10.995344 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:10.647550    2563 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 15 21:29:10.996017 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:10.647553    2563 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 15 21:29:10.996017 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:10.647555    2563 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 15 21:29:10.996017 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:10.647560    2563 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 15 21:29:10.996017 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:10.647563    2563 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 15 21:29:10.996017 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:10.647565    2563 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 15 21:29:10.996017 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:10.647568    2563 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 15 21:29:10.996017 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:10.647575    2563 flags.go:64] FLAG: --node-status-max-images="50"
Jul 15 21:29:10.996017 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:10.647578    2563 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 15 21:29:10.996017 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:10.647581    2563 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 15 21:29:10.996017 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:10.647584    2563 flags.go:64] FLAG: --pod-cidr=""
Jul 15 21:29:10.996017 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:10.647588    2563 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b04c0b1f73af4d021dd8f0b51bfeb302c24482c093de5f2c43654ab56c506926"
Jul 15 21:29:10.996017 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:10.647593    2563 flags.go:64] FLAG: --pod-manifest-path=""
Jul 15 21:29:10.996017 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:10.647596    2563 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 15 21:29:10.996017 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:10.647599    2563 flags.go:64] FLAG: --pods-per-core="0"
Jul 15 21:29:10.996017 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:10.647602    2563 flags.go:64] FLAG: --port="10250"
Jul 15 21:29:10.996017 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:10.647605    2563 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 15 21:29:10.996017 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:10.647608    2563 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0dadaef11f9c59763"
Jul 15 21:29:10.996017 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:10.647611    2563 flags.go:64] FLAG: --qos-reserved=""
Jul 15 21:29:10.996017 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:10.647614    2563 flags.go:64] FLAG: --read-only-port="10255"
Jul 15 21:29:10.996017 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:10.647617    2563 flags.go:64] FLAG: --register-node="true"
Jul 15 21:29:10.996017 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:10.647620    2563 flags.go:64] FLAG: --register-with-taints=""
Jul 15 21:29:10.996017 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:10.647624    2563 flags.go:64] FLAG: --registry-burst="10"
Jul 15 21:29:10.996017 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:10.647626    2563 flags.go:64] FLAG: --registry-qps="5"
Jul 15 21:29:10.996017 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:10.647629    2563 flags.go:64] FLAG: --reserved-cpus=""
Jul 15 21:29:10.996678 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:10.647632    2563 flags.go:64] FLAG: --reserved-memory=""
Jul 15 21:29:10.996678 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:10.647635    2563 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 15 21:29:10.996678 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:10.647638    2563 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 15 21:29:10.996678 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:10.647641    2563 flags.go:64] FLAG: --rotate-certificates="false"
Jul 15 21:29:10.996678 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:10.647644    2563 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 15 21:29:10.996678 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:10.647647    2563 flags.go:64] FLAG: --runonce="false"
Jul 15 21:29:10.996678 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:10.647650    2563 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 15 21:29:10.996678 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:10.647654    2563 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 15 21:29:10.996678 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:10.647657    2563 flags.go:64] FLAG: --seccomp-default="false"
Jul 15 21:29:10.996678 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:10.647660    2563 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 15 21:29:10.996678 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:10.647663    2563 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 15 21:29:10.996678 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:10.647667    2563 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 15 21:29:10.996678 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:10.647670    2563 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 15 21:29:10.996678 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:10.647680    2563 flags.go:64] FLAG: --storage-driver-password="root"
Jul 15 21:29:10.996678 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:10.647683    2563 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 15 21:29:10.996678 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:10.647686    2563 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 15 21:29:10.996678 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:10.647689    2563 flags.go:64] FLAG: --storage-driver-user="root"
Jul 15 21:29:10.996678 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:10.647692    2563 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 15 21:29:10.996678 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:10.647695    2563 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 15 21:29:10.996678 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:10.647699    2563 flags.go:64] FLAG: --system-cgroups=""
Jul 15 21:29:10.996678 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:10.647702    2563 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 15 21:29:10.996678 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:10.647707    2563 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 15 21:29:10.996678 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:10.647710    2563 flags.go:64] FLAG: --tls-cert-file=""
Jul 15 21:29:10.996678 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:10.647713    2563 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 15 21:29:10.996678 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:10.647717    2563 flags.go:64] FLAG: --tls-min-version=""
Jul 15 21:29:10.997360 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:10.647720    2563 flags.go:64] FLAG: --tls-private-key-file=""
Jul 15 21:29:10.997360 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:10.647722    2563 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 15 21:29:10.997360 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:10.647725    2563 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 15 21:29:10.997360 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:10.647728    2563 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 15 21:29:10.997360 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:10.647731    2563 flags.go:64] FLAG: --v="2"
Jul 15 21:29:10.997360 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:10.647735    2563 flags.go:64] FLAG: --version="false"
Jul 15 21:29:10.997360 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:10.647739    2563 flags.go:64] FLAG: --vmodule=""
Jul 15 21:29:10.997360 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:10.647742    2563 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 15 21:29:10.997360 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:10.647745    2563 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 15 21:29:10.997360 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.647881    2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 15 21:29:10.997360 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.647885    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 15 21:29:10.997360 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.647889    2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 15 21:29:10.997360 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.647891    2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 15 21:29:10.997360 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.647894    2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 15 21:29:10.997360 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.647898    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 15 21:29:10.997360 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.647901    2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 15 21:29:10.997360 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.647903    2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 15 21:29:10.997360 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.647906    2563 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 15 21:29:10.997360 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.647910    2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 15 21:29:10.997360 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.647912    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 15 21:29:10.997360 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.647916    2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 15 21:29:10.997982 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.647918    2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 15 21:29:10.997982 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.647921    2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 15 21:29:10.997982 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.647923    2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 15 21:29:10.997982 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.647926    2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 15 21:29:10.997982 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.647929    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 15 21:29:10.997982 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.647931    2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 15 21:29:10.997982 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.647950    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 15 21:29:10.997982 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.647953    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 15 21:29:10.997982 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.647957    2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 15 21:29:10.997982 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.647959    2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 15 21:29:10.997982 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.647962    2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 15 21:29:10.997982 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.647964    2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 15 21:29:10.997982 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.647967    2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 15 21:29:10.997982 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.647970    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 15 21:29:10.997982 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.647973    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 15 21:29:10.997982 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.647975    2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 15 21:29:10.997982 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.647978    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 15 21:29:10.997982 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.647981    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 15 21:29:10.997982 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.647983    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 15 21:29:10.997982 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.647986    2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 15 21:29:10.998523 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.647988    2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 15 21:29:10.998523 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.647991    2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 15 21:29:10.998523 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.647993    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 15 21:29:10.998523 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.647996    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 15 21:29:10.998523 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.647998    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 15 21:29:10.998523 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.648002    2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 15 21:29:10.998523 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.648006    2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 15 21:29:10.998523 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.648010    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 15 21:29:10.998523 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.648013    2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 15 21:29:10.998523 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.648017    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 15 21:29:10.998523 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.648020    2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 15 21:29:10.998523 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.648023    2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 15 21:29:10.998523 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.648027    2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 15 21:29:10.998523 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.648030    2563 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 15 21:29:10.998523 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.648034    2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 15 21:29:10.998523 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.648036    2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 15 21:29:10.998523 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.648039    2563 feature_gate.go:328] unrecognized feature gate: Example
Jul 15 21:29:10.998523 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.648042    2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 15 21:29:10.998523 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.648045    2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 15 21:29:10.999265 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.648048    2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 15 21:29:10.999265 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.648051    2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 15 21:29:10.999265 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.648054    2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 15 21:29:10.999265 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.648057    2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 15 21:29:10.999265 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.648059    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 15 21:29:10.999265 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.648062    2563 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 15 21:29:10.999265 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.648064    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 15 21:29:10.999265 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.648067    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 15 21:29:10.999265 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.648069    2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 15 21:29:10.999265 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.648072    2563 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 15 21:29:10.999265 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.648075    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 15 21:29:10.999265 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.648078    2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 15 21:29:10.999265 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.648080    2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 15 21:29:10.999265 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.648083    2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 15 21:29:10.999265 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.648085    2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 15 21:29:10.999265 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.648088    2563 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 15 21:29:10.999265 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.648090    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 15 21:29:10.999265 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.648093    2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 15 21:29:10.999265 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.648099    2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 15 21:29:10.999265 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.648102    2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 15 21:29:10.999893 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.648105    2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 15 21:29:10.999893 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.648108    2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 15 21:29:10.999893 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.648112    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 15 21:29:10.999893 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.648115    2563 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 15 21:29:10.999893 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.648117    2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 15 21:29:10.999893 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.648120    2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 15 21:29:10.999893 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.648122    2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 15 21:29:10.999893 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.648125    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 15 21:29:10.999893 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.648128    2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 15 21:29:10.999893 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.648130    2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 15 21:29:10.999893 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.648133    2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 15 21:29:10.999893 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.648136    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 15 21:29:10.999893 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.648138    2563 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 15 21:29:10.999893 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.648141    2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 15 21:29:10.999893 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.648144    2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 15 21:29:10.999893 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.648146    2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 15 21:29:10.999893 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.648149    2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 15 21:29:10.999893 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.648152    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 15 21:29:10.999893 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.648154    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 15 21:29:10.999893 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.648157    2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 15 21:29:11.000519 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.648159    2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 15 21:29:11.000519 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.648162    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 15 21:29:11.000519 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.648164    2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 15 21:29:11.000519 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.648167    2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 15 21:29:11.000519 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.648170    2563 feature_gate.go:328] unrecognized feature gate: Example2
Jul 15 21:29:11.000519 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.648172    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 15 21:29:11.000519 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.648175    2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 15 21:29:11.000519 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.648177    2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 15 21:29:11.000519 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:10.649109    2563 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 15 21:29:11.000519 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:10.655977    2563 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 15 21:29:11.000519 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:10.655992    2563 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 15 21:29:11.000519 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:10.656011    2563 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 15 21:29:11.000519 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:10.656017    2563 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 15 21:29:11.000519 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.656071    2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 15 21:29:11.000519 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.656076    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 15 21:29:11.002987 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.656080    2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 15 21:29:11.002987 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.656083    2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 15 21:29:11.002987 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.656087    2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 15 21:29:11.002987 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.656090    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 15 21:29:11.002987 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.656093    2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 15 21:29:11.002987 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.656096    2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 15 21:29:11.002987 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.656099    2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 15 21:29:11.002987 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.656102    2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 15 21:29:11.002987 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.656107    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 15 21:29:11.002987 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.656111    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 15 21:29:11.002987 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.656114    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 15 21:29:11.002987 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.656117    2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 15 21:29:11.002987 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.656120    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 15 21:29:11.002987 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.656123    2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 15 21:29:11.002987 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.656126    2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 15 21:29:11.002987 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.656129    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 15 21:29:11.002987 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.656131    2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 15 21:29:11.002987 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.656134    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 15 21:29:11.002987 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.656137    2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 15 21:29:11.003553 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.656141    2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 15 21:29:11.003553 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.656145    2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 15 21:29:11.003553 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.656148    2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 15 21:29:11.003553 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.656151    2563 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 15 21:29:11.003553 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.656154    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 15 21:29:11.003553 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.656157    2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 15 21:29:11.003553 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.656160    2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 15 21:29:11.003553 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.656163    2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 15 21:29:11.003553 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.656166    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 15 21:29:11.003553 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.656170    2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 15 21:29:11.003553 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.656173    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 15 21:29:11.003553 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.656175    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 15 21:29:11.003553 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.656178    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 15 21:29:11.003553 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.656181    2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 15 21:29:11.003553 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.656184    2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 15 21:29:11.003553 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.656186    2563 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 15 21:29:11.003553 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.656189    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 15 21:29:11.003553 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.656191    2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 15 21:29:11.003553 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.656194    2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 15 21:29:11.003553 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.656196    2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 15 21:29:11.174890 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.656201    2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 15 21:29:11.174890 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.656205    2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 15 21:29:11.174890 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.656208    2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 15 21:29:11.174890 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.656210    2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 15 21:29:11.174890 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.656213    2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 15 21:29:11.174890 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.656216    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 15 21:29:11.174890 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.656219    2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 15 21:29:11.174890 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.656221    2563 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 15 21:29:11.174890 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.656224    2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 15 21:29:11.174890 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.656228    2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 15 21:29:11.174890 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.656231    2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 15 21:29:11.174890 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.656234    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 15 21:29:11.174890 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.656237    2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 15 21:29:11.174890 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.656240    2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 15 21:29:11.174890 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.656242    2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 15 21:29:11.174890 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.656245    2563 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 15 21:29:11.174890 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.656248    2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 15 21:29:11.174890 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.656250    2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 15 21:29:11.174890 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.656253    2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 15 21:29:11.174890 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.656255    2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 15 21:29:11.175601 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.656257    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 15 21:29:11.175601 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.656260    2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 15 21:29:11.175601 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.656263    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 15 21:29:11.175601 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.656265    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 15 21:29:11.175601 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.656268    2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 15 21:29:11.175601 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.656270    2563 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 15 21:29:11.175601 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.656273    2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 15 21:29:11.175601 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.656276    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 15 21:29:11.175601 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.656279    2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 15 21:29:11.175601 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.656281    2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 15 21:29:11.175601 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.656284    2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 15 21:29:11.175601 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.656286    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 15 21:29:11.175601 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.656292    2563 feature_gate.go:328] unrecognized feature gate: Example2
Jul 15 21:29:11.175601 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.656296    2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 15 21:29:11.175601 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.656299    2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 15 21:29:11.175601 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.656301    2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 15 21:29:11.175601 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.656304    2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 15 21:29:11.175601 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.656307    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 15 21:29:11.175601 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.656310    2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 15 21:29:11.175601 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.656313    2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 15 21:29:11.176205 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.656315    2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 15 21:29:11.176205 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.656318    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 15 21:29:11.176205 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.656320    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 15 21:29:11.176205 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.656323    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 15 21:29:11.176205 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.656326    2563 feature_gate.go:328] unrecognized feature gate: Example
Jul 15 21:29:11.176205 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.656328    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 15 21:29:11.176205 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.656331    2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 15 21:29:11.176205 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.656334    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 15 21:29:11.176205 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.656338    2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 15 21:29:11.176205 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.656341    2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 15 21:29:11.176205 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.656344    2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 15 21:29:11.176205 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.656347    2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 15 21:29:11.176205 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.656350    2563 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 15 21:29:11.176205 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.656352    2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 15 21:29:11.176205 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.656355    2563 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 15 21:29:11.176205 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.656358    2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 15 21:29:11.176205 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.656361    2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 15 21:29:11.176205 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.656364    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 15 21:29:11.176734 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:10.656369    2563 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 15 21:29:11.176734 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.656511    2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 15 21:29:11.176734 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.656516    2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 15 21:29:11.176734 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.656519    2563 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 15 21:29:11.176734 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.656522    2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 15 21:29:11.176734 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.656524    2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 15 21:29:11.176734 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.656527    2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 15 21:29:11.176734 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.656532    2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 15 21:29:11.176734 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.656535    2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 15 21:29:11.176734 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.656538    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 15 21:29:11.176734 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.656541    2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 15 21:29:11.176734 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.656543    2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 15 21:29:11.176734 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.656546    2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 15 21:29:11.176734 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.656548    2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 15 21:29:11.176734 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.656551    2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 15 21:29:11.177188 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.656554    2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 15 21:29:11.177188 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.656556    2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 15 21:29:11.177188 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.656559    2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 15 21:29:11.177188 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.656562    2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 15 21:29:11.177188 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.656564    2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 15 21:29:11.177188 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.656567    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 15 21:29:11.177188 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.656570    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 15 21:29:11.177188 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.656572    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 15 21:29:11.177188 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.656575    2563 feature_gate.go:328] unrecognized feature gate: Example2
Jul 15 21:29:11.177188 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.656577    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 15 21:29:11.177188 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.656580    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 15 21:29:11.177188 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.656583    2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 15 21:29:11.177188 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.656585    2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 15 21:29:11.177188 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.656587    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 15 21:29:11.177188 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.656590    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 15 21:29:11.177188 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.656593    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 15 21:29:11.177188 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.656595    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 15 21:29:11.177188 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.656598    2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 15 21:29:11.177188 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.656600    2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 15 21:29:11.177718 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.656603    2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 15 21:29:11.177718 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.656606    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 15 21:29:11.177718 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.656609    2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 15 21:29:11.177718 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.656611    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 15 21:29:11.177718 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.656615    2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 15 21:29:11.177718 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.656621    2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 15 21:29:11.177718 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.656624    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 15 21:29:11.177718 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.656627    2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 15 21:29:11.177718 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.656630    2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 15 21:29:11.177718 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.656632    2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 15 21:29:11.177718 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.656635    2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 15 21:29:11.177718 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.656638    2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 15 21:29:11.177718 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.656641    2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 15 21:29:11.177718 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.656643    2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 15 21:29:11.177718 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.656646    2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 15 21:29:11.177718 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.656649    2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 15 21:29:11.177718 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.656651    2563 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 15 21:29:11.177718 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.656654    2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 15 21:29:11.177718 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.656656    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 15 21:29:11.177718 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.656659    2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 15 21:29:11.178275 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.656661    2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 15 21:29:11.178275 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.656663    2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 15 21:29:11.178275 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.656666    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 15 21:29:11.178275 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.656668    2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 15 21:29:11.178275 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.656671    2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 15 21:29:11.178275 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.656673    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 15 21:29:11.178275 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.656676    2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 15 21:29:11.178275 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.656678    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 15 21:29:11.178275 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.656681    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 15 21:29:11.178275 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.656683    2563 feature_gate.go:328] unrecognized feature gate: Example
Jul 15 21:29:11.178275 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.656686    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 15 21:29:11.178275 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.656688    2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 15 21:29:11.178275 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.656691    2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 15 21:29:11.178275 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.656694    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 15 21:29:11.178275 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.656696    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 15 21:29:11.178275 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.656698    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 15 21:29:11.178275 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.656701    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 15 21:29:11.178275 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.656706    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 15 21:29:11.178275 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.656708    2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 15 21:29:11.178275 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.656711    2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 15 21:29:11.178860 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.656714    2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 15 21:29:11.178860 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.656716    2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 15 21:29:11.178860 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.656719    2563 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 15 21:29:11.178860 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.656722    2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 15 21:29:11.178860 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.656725    2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 15 21:29:11.178860 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.656727    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 15 21:29:11.178860 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.656730    2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 15 21:29:11.178860 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.656732    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 15 21:29:11.178860 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.656735    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 15 21:29:11.178860 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.656737    2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 15 21:29:11.178860 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.656740    2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 15 21:29:11.178860 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.656744    2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 15 21:29:11.178860 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.656748    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 15 21:29:11.178860 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.656750    2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 15 21:29:11.178860 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.656753    2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 15 21:29:11.178860 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.656756    2563 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 15 21:29:11.178860 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.656758    2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 15 21:29:11.178860 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.656761    2563 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 15 21:29:11.178860 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.656763    2563 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 15 21:29:11.178860 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.656766    2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 15 21:29:11.179405 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.656768    2563 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 15 21:29:11.179405 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.656771    2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 15 21:29:11.179405 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.656774    2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 15 21:29:11.179405 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.656777    2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 15 21:29:11.179405 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.656781    2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 15 21:29:11.179405 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:10.656784    2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 15 21:29:11.179405 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:10.656788    2563 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 15 21:29:11.179405 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:10.656886    2563 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 15 21:29:11.179405 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:10.660096    2563 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 15 21:29:11.179405 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:10.661880    2563 server.go:1019] "Starting client certificate rotation"
Jul 15 21:29:11.179405 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:10.661965    2563 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 15 21:29:11.179405 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:10.662002    2563 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 15 21:29:11.179405 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:10.665476    2563 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 15 21:29:11.179807 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:10.666622    2563 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 15 21:29:11.179807 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:10.680967    2563 log.go:25] "Validated CRI v1 runtime API"
Jul 15 21:29:11.179807 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:10.683570    2563 log.go:25] "Validated CRI v1 image API"
Jul 15 21:29:11.179807 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:10.684377    2563 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 15 21:29:11.179807 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:10.688560    2563 fs.go:135] Filesystem UUIDs: map[45de2a65-a4d4-4a27-af64-a828eebd9c39:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 f72c2186-b3f0-4a3c-8a56-d4c55bc5e491:/dev/nvme0n1p4]
Jul 15 21:29:11.179807 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:10.688576    2563 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 15 21:29:11.179807 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:10.692012    2563 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 15 21:29:11.180124 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:10.695269    2563 manager.go:216] Machine: {Timestamp:2026-07-15 21:29:10.693792994 +0000 UTC m=+0.387720536 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3107016 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2b1d428de2299fdd999c9d6cc8eef5 SystemUUID:ec2b1d42-8de2-299f-dd99-9c9d6cc8eef5 BootID:0b4f868e-9167-4c05-bd64-fcdf1270eca8 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:56:58:70:96:13 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:56:58:70:96:13 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:5e:fc:88:a0:eb:97 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 15 21:29:11.180124 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:10.695373    2563 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 15 21:29:11.180124 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:10.695455    2563 manager.go:232] Version: {KernelVersion:5.14.0-570.126.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260702-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 15 21:29:11.180124 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:10.699262    2563 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 15 21:29:11.180124 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:10.699447    2563 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-130-217.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 15 21:29:11.180124 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:10.701041    2563 topology_manager.go:138] "Creating topology manager with none policy"
Jul 15 21:29:11.180124 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:10.701053    2563 container_manager_linux.go:309] "Creating device plugin manager"
Jul 15 21:29:11.180124 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:10.701060    2563 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 15 21:29:11.180124 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:10.701879    2563 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 15 21:29:11.180124 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:10.703804    2563 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 15 21:29:11.180124 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:10.708608    2563 state_mem.go:36] "Initialized new in-memory state store"
Jul 15 21:29:11.180124 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:10.708751    2563 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 15 21:29:11.180124 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:10.708782    2563 kubelet.go:486] "Attempting to sync node with API server"
Jul 15 21:29:11.180124 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:10.708795    2563 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 15 21:29:11.180124 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:10.708813    2563 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 15 21:29:11.180124 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:10.708823    2563 kubelet.go:398] "Adding apiserver pod source"
Jul 15 21:29:11.180124 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:10.708834    2563 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 15 21:29:11.180124 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:10.709245    2563 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 15 21:29:11.180641 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:10.709264    2563 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 15 21:29:11.180641 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:10.711551    2563 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 15 21:29:11.180641 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:10.714072    2563 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 15 21:29:11.180641 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:10.714100    2563 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 15 21:29:11.180641 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:10.714245    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 15 21:29:11.180641 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:10.714257    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 15 21:29:11.180641 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:10.714264    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 15 21:29:11.180641 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:10.714270    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 15 21:29:11.180641 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:10.714278    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 15 21:29:11.180641 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:10.714283    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 15 21:29:11.180641 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:10.715032    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 15 21:29:11.180641 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:10.715040    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 15 21:29:11.180641 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:10.715047    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 15 21:29:11.180641 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:10.715053    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 15 21:29:11.180641 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:10.715070    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 15 21:29:11.180641 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:10.715078    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 15 21:29:11.180641 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:10.715909    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 15 21:29:11.180641 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:10.715917    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 15 21:29:11.180641 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:10.721308    2563 server.go:1268] "Started kubelet"
Jul 15 21:29:11.180641 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:10.721400    2563 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 15 21:29:11.180641 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:10.721402    2563 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 15 21:29:11.180641 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:10.721686    2563 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 15 21:29:11.180641 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:10.723144    2563 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 15 21:29:11.180641 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:10.723727    2563 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-130-217.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 15 21:29:11.180641 ip-10-0-130-217 kubenswrapper[2563]: E0715 21:29:10.723730    2563 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-130-217.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 15 21:29:11.180641 ip-10-0-130-217 kubenswrapper[2563]: E0715 21:29:10.723783    2563 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 15 21:29:11.180641 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:10.724076    2563 server.go:310] "Adding debug handlers to kubelet server"
Jul 15 21:29:11.180641 ip-10-0-130-217 kubenswrapper[2563]: E0715 21:29:10.727503    2563 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 15 21:29:11.180641 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:10.732001    2563 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 15 21:29:11.180641 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:10.732012    2563 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 15 21:29:11.180641 ip-10-0-130-217 kubenswrapper[2563]: E0715 21:29:10.732093    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-217.ec2.internal\" not found"
Jul 15 21:29:11.180641 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:10.732727    2563 factory.go:55] Registering systemd factory
Jul 15 21:29:11.180641 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:10.732743    2563 factory.go:223] Registration of the systemd container factory successfully
Jul 15 21:29:11.180641 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:10.732813    2563 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 15 21:29:11.180641 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:10.732842    2563 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 15 21:29:11.180641 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:10.732857    2563 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 15 21:29:11.180641 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:10.732917    2563 reconstruct.go:97] "Volume reconstruction finished"
Jul 15 21:29:11.180641 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:10.732926    2563 reconciler.go:29] "Reconciler: start to sync state"
Jul 15 21:29:11.180641 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:10.732983    2563 factory.go:153] Registering CRI-O factory
Jul 15 21:29:11.180641 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:10.732997    2563 factory.go:223] Registration of the crio container factory successfully
Jul 15 21:29:11.180641 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:10.733044    2563 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 15 21:29:11.180641 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:10.733064    2563 factory.go:103] Registering Raw factory
Jul 15 21:29:11.180641 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:10.733076    2563 manager.go:1196] Started watching for new ooms in manager
Jul 15 21:29:11.180641 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:10.733557    2563 manager.go:349] Starting recovery of all containers
Jul 15 21:29:11.180641 ip-10-0-130-217 kubenswrapper[2563]: E0715 21:29:10.733650    2563 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-130-217.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 15 21:29:11.181886 ip-10-0-130-217 kubenswrapper[2563]: E0715 21:29:10.733410    2563 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-130-217.ec2.internal.18c293d63b6ac947  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-130-217.ec2.internal,UID:ip-10-0-130-217.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-130-217.ec2.internal,},FirstTimestamp:2026-07-15 21:29:10.721276231 +0000 UTC m=+0.415203774,LastTimestamp:2026-07-15 21:29:10.721276231 +0000 UTC m=+0.415203774,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-130-217.ec2.internal,}"
Jul 15 21:29:11.181886 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:10.737338    2563 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-f4lbs"
Jul 15 21:29:11.181886 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:10.742584    2563 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-f4lbs"
Jul 15 21:29:11.181886 ip-10-0-130-217 kubenswrapper[2563]: E0715 21:29:10.745359    2563 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 15 21:29:11.181886 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:10.745516    2563 manager.go:354] Recovery completed
Jul 15 21:29:11.181886 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:10.749558    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 15 21:29:11.181886 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:10.751298    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-217.ec2.internal" event="NodeHasSufficientMemory"
Jul 15 21:29:11.181886 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:10.751325    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-217.ec2.internal" event="NodeHasNoDiskPressure"
Jul 15 21:29:11.181886 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:10.751334    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-217.ec2.internal" event="NodeHasSufficientPID"
Jul 15 21:29:11.181886 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:10.751855    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 15 21:29:11.181886 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:10.751856    2563 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 15 21:29:11.181886 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:10.751882    2563 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 15 21:29:11.181886 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:10.751915    2563 state_mem.go:36] "Initialized new in-memory state store"
Jul 15 21:29:11.181886 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:10.752508    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-217.ec2.internal" event="NodeHasSufficientMemory"
Jul 15 21:29:11.181886 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:10.752532    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-217.ec2.internal" event="NodeHasNoDiskPressure"
Jul 15 21:29:11.181886 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:10.752541    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-217.ec2.internal" event="NodeHasSufficientPID"
Jul 15 21:29:11.181886 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:10.754019    2563 policy_none.go:49] "None policy: Start"
Jul 15 21:29:11.181886 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:10.754034    2563 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 15 21:29:11.181886 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:10.754044    2563 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 15 21:29:11.181886 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:10.756961    2563 policy_none.go:47] "Start"
Jul 15 21:29:11.181886 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:10.814459    2563 manager.go:337] "Starting Device Plugin manager"
Jul 15 21:29:11.181886 ip-10-0-130-217 kubenswrapper[2563]: E0715 21:29:10.814489    2563 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 15 21:29:11.181886 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:10.814500    2563 server.go:87] "Starting device plugin registration server"
Jul 15 21:29:11.181886 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:10.814709    2563 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 15 21:29:11.181886 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:10.814718    2563 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 15 21:29:11.181886 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:10.814828    2563 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 15 21:29:11.181886 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:10.814900    2563 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 15 21:29:11.181886 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:10.814908    2563 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 15 21:29:11.181886 ip-10-0-130-217 kubenswrapper[2563]: E0715 21:29:10.815432    2563 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 15 21:29:11.181886 ip-10-0-130-217 kubenswrapper[2563]: E0715 21:29:10.815489    2563 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-130-217.ec2.internal\" not found"
Jul 15 21:29:11.181886 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:10.915506    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 15 21:29:11.181886 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:10.916639    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-217.ec2.internal" event="NodeHasSufficientMemory"
Jul 15 21:29:11.181886 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:10.916676    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-217.ec2.internal" event="NodeHasNoDiskPressure"
Jul 15 21:29:11.181886 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:10.916690    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-217.ec2.internal" event="NodeHasSufficientPID"
Jul 15 21:29:11.181886 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:10.916718    2563 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-130-217.ec2.internal"
Jul 15 21:29:11.181886 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:10.925850    2563 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-130-217.ec2.internal"
Jul 15 21:29:11.181886 ip-10-0-130-217 kubenswrapper[2563]: E0715 21:29:10.925874    2563 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-130-217.ec2.internal\": node \"ip-10-0-130-217.ec2.internal\" not found"
Jul 15 21:29:11.181886 ip-10-0-130-217 kubenswrapper[2563]: E0715 21:29:10.948280    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-217.ec2.internal\" not found"
Jul 15 21:29:11.181886 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:10.980098    2563 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 15 21:29:11.182968 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:10.981427    2563 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 15 21:29:11.182968 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:10.981472    2563 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 15 21:29:11.182968 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:10.981506    2563 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 15 21:29:11.182968 ip-10-0-130-217 kubenswrapper[2563]: E0715 21:29:10.981547    2563 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 15 21:29:11.182968 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:10.984143    2563 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 15 21:29:11.182968 ip-10-0-130-217 kubenswrapper[2563]: E0715 21:29:11.048335    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-217.ec2.internal\" not found"
Jul 15 21:29:11.182968 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:11.082495    2563 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-217.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-130-217.ec2.internal"]
Jul 15 21:29:11.182968 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:11.082591    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 15 21:29:11.182968 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:11.083746    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-217.ec2.internal" event="NodeHasSufficientMemory"
Jul 15 21:29:11.182968 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:11.083772    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-217.ec2.internal" event="NodeHasNoDiskPressure"
Jul 15 21:29:11.182968 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:11.083781    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-217.ec2.internal" event="NodeHasSufficientPID"
Jul 15 21:29:11.182968 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:11.086136    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 15 21:29:11.182968 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:11.086266    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-217.ec2.internal"
Jul 15 21:29:11.182968 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:11.086295    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 15 21:29:11.182968 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:11.086962    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-217.ec2.internal" event="NodeHasSufficientMemory"
Jul 15 21:29:11.182968 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:11.086970    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-217.ec2.internal" event="NodeHasSufficientMemory"
Jul 15 21:29:11.182968 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:11.086984    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-217.ec2.internal" event="NodeHasNoDiskPressure"
Jul 15 21:29:11.182968 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:11.086994    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-217.ec2.internal" event="NodeHasNoDiskPressure"
Jul 15 21:29:11.182968 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:11.087012    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-217.ec2.internal" event="NodeHasSufficientPID"
Jul 15 21:29:11.182968 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:11.086996    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-217.ec2.internal" event="NodeHasSufficientPID"
Jul 15 21:29:11.182968 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:11.089296    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-217.ec2.internal"
Jul 15 21:29:11.182968 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:11.089316    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 15 21:29:11.182968 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:11.090009    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-217.ec2.internal" event="NodeHasSufficientMemory"
Jul 15 21:29:11.182968 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:11.090038    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-217.ec2.internal" event="NodeHasNoDiskPressure"
Jul 15 21:29:11.182968 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:11.090050    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-217.ec2.internal" event="NodeHasSufficientPID"
Jul 15 21:29:11.182968 ip-10-0-130-217 kubenswrapper[2563]: E0715 21:29:11.114627    2563 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-130-217.ec2.internal\" not found" node="ip-10-0-130-217.ec2.internal"
Jul 15 21:29:11.182968 ip-10-0-130-217 kubenswrapper[2563]: E0715 21:29:11.122682    2563 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-130-217.ec2.internal\" not found" node="ip-10-0-130-217.ec2.internal"
Jul 15 21:29:11.182968 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:11.134550    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/cdab13ce73e8fa92312341fdcfe1f88a-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-217.ec2.internal\" (UID: \"cdab13ce73e8fa92312341fdcfe1f88a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-217.ec2.internal"
Jul 15 21:29:11.182968 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:11.134575    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/cdab13ce73e8fa92312341fdcfe1f88a-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-217.ec2.internal\" (UID: \"cdab13ce73e8fa92312341fdcfe1f88a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-217.ec2.internal"
Jul 15 21:29:11.182968 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:11.134606    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/2041a50860cbd204c2d9aa835bb65766-config\") pod \"kube-apiserver-proxy-ip-10-0-130-217.ec2.internal\" (UID: \"2041a50860cbd204c2d9aa835bb65766\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-217.ec2.internal"
Jul 15 21:29:11.182968 ip-10-0-130-217 kubenswrapper[2563]: E0715 21:29:11.148688    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-217.ec2.internal\" not found"
Jul 15 21:29:11.377379 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:11.235446    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/cdab13ce73e8fa92312341fdcfe1f88a-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-217.ec2.internal\" (UID: \"cdab13ce73e8fa92312341fdcfe1f88a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-217.ec2.internal"
Jul 15 21:29:11.377379 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:11.235478    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/cdab13ce73e8fa92312341fdcfe1f88a-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-217.ec2.internal\" (UID: \"cdab13ce73e8fa92312341fdcfe1f88a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-217.ec2.internal"
Jul 15 21:29:11.377379 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:11.235496    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/2041a50860cbd204c2d9aa835bb65766-config\") pod \"kube-apiserver-proxy-ip-10-0-130-217.ec2.internal\" (UID: \"2041a50860cbd204c2d9aa835bb65766\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-217.ec2.internal"
Jul 15 21:29:11.377379 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:11.235555    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/2041a50860cbd204c2d9aa835bb65766-config\") pod \"kube-apiserver-proxy-ip-10-0-130-217.ec2.internal\" (UID: \"2041a50860cbd204c2d9aa835bb65766\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-217.ec2.internal"
Jul 15 21:29:11.377379 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:11.235557    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/cdab13ce73e8fa92312341fdcfe1f88a-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-217.ec2.internal\" (UID: \"cdab13ce73e8fa92312341fdcfe1f88a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-217.ec2.internal"
Jul 15 21:29:11.377379 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:11.235562    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/cdab13ce73e8fa92312341fdcfe1f88a-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-217.ec2.internal\" (UID: \"cdab13ce73e8fa92312341fdcfe1f88a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-217.ec2.internal"
Jul 15 21:29:11.377379 ip-10-0-130-217 kubenswrapper[2563]: E0715 21:29:11.249526    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-217.ec2.internal\" not found"
Jul 15 21:29:11.377379 ip-10-0-130-217 kubenswrapper[2563]: E0715 21:29:11.350583    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-217.ec2.internal\" not found"
Jul 15 21:29:11.594925 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:11.417779    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-217.ec2.internal"
Jul 15 21:29:11.594925 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:11.427895    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-217.ec2.internal"
Jul 15 21:29:11.594925 ip-10-0-130-217 kubenswrapper[2563]: E0715 21:29:11.451476    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-217.ec2.internal\" not found"
Jul 15 21:29:11.594925 ip-10-0-130-217 kubenswrapper[2563]: E0715 21:29:11.551959    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-217.ec2.internal\" not found"
Jul 15 21:29:11.810367 ip-10-0-130-217 kubenswrapper[2563]: E0715 21:29:11.652974    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-217.ec2.internal\" not found"
Jul 15 21:29:11.810367 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:11.660643    2563 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 15 21:29:11.810367 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:11.660833    2563 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 15 21:29:11.810367 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:11.735279    2563 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 15 21:29:11.810367 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:11.747184    2563 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-14 21:24:10 +0000 UTC" deadline="2028-02-22 05:40:12.064721724 +0000 UTC"
Jul 15 21:29:11.810367 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:11.747214    2563 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14072h11m0.317511126s"
Jul 15 21:29:11.810367 ip-10-0-130-217 kubenswrapper[2563]: E0715 21:29:11.753965    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-217.ec2.internal\" not found"
Jul 15 21:29:12.014145 ip-10-0-130-217 kubenswrapper[2563]: E0715 21:29:11.854670    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-217.ec2.internal\" not found"
Jul 15 21:29:12.014145 ip-10-0-130-217 kubenswrapper[2563]: E0715 21:29:11.955256    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-217.ec2.internal\" not found"
Jul 15 21:29:12.216550 ip-10-0-130-217 kubenswrapper[2563]: E0715 21:29:12.056231    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-217.ec2.internal\" not found"
Jul 15 21:29:12.216550 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:12.120040    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcdab13ce73e8fa92312341fdcfe1f88a.slice/crio-06cea2f0db8bc948a07ad0e20b34f543e7e848131c86cbecda1db207657d16a3 WatchSource:0}: Error finding container 06cea2f0db8bc948a07ad0e20b34f543e7e848131c86cbecda1db207657d16a3: Status 404 returned error can't find the container with id 06cea2f0db8bc948a07ad0e20b34f543e7e848131c86cbecda1db207657d16a3
Jul 15 21:29:12.216550 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:12.120314    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2041a50860cbd204c2d9aa835bb65766.slice/crio-d67cf62c106ddc01a952ffd717d9fbd62a0d446d5236373ec15499afd47d539f WatchSource:0}: Error finding container d67cf62c106ddc01a952ffd717d9fbd62a0d446d5236373ec15499afd47d539f: Status 404 returned error can't find the container with id d67cf62c106ddc01a952ffd717d9fbd62a0d446d5236373ec15499afd47d539f
Jul 15 21:29:12.216550 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:12.126804    2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 15 21:29:12.216550 ip-10-0-130-217 kubenswrapper[2563]: E0715 21:29:12.156542    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-217.ec2.internal\" not found"
Jul 15 21:29:12.438303 ip-10-0-130-217 kubenswrapper[2563]: E0715 21:29:12.257571    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-217.ec2.internal\" not found"
Jul 15 21:29:12.438303 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:12.316327    2563 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 15 21:29:12.438303 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:12.331594    2563 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 15 21:29:12.438303 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:12.333173    2563 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-217.ec2.internal"
Jul 15 21:29:12.438303 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:12.345721    2563 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 15 21:29:12.438303 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:12.347911    2563 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-217.ec2.internal"
Jul 15 21:29:12.438303 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:12.355374    2563 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 15 21:29:12.787926 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:12.712106    2563 apiserver.go:52] "Watching apiserver"
Jul 15 21:29:12.787926 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:12.718275    2563 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 15 21:29:12.787926 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:12.719575    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/network-metrics-daemon-6tbzj","openshift-network-diagnostics/network-check-target-dw6kh","kube-system/konnectivity-agent-rz4r6","kube-system/kube-apiserver-proxy-ip-10-0-130-217.ec2.internal","openshift-cluster-node-tuning-operator/tuned-zqgv4","openshift-multus/multus-dnzpf","openshift-network-operator/iptables-alerter-9t6s7","openshift-ovn-kubernetes/ovnkube-node-bp2vz","kube-system/global-pull-secret-syncer-sj7lm","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7n5gr","openshift-dns/node-resolver-tlrgr","openshift-image-registry/node-ca-9rlc4","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-217.ec2.internal","openshift-multus/multus-additional-cni-plugins-f2sjs"]
Jul 15 21:29:12.787926 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:12.722280    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7n5gr"
Jul 15 21:29:12.787926 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:12.724275    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 15 21:29:12.787926 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:12.724638    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 15 21:29:12.787926 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:12.724740    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-p2t5g\""
Jul 15 21:29:12.787926 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:12.724740    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-tlrgr"
Jul 15 21:29:12.787926 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:12.724799    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 15 21:29:12.787926 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:12.726945    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 15 21:29:12.787926 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:12.726974    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-96tz9\""
Jul 15 21:29:12.787926 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:12.726974    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 15 21:29:12.787926 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:12.727223    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-rz4r6"
Jul 15 21:29:12.787926 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:12.729204    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 15 21:29:12.787926 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:12.729291    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-m5jtd\""
Jul 15 21:29:12.787926 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:12.729496    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 15 21:29:12.787926 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:12.729582    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-f2sjs"
Jul 15 21:29:12.787926 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:12.731935    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-zqgv4"
Jul 15 21:29:12.787926 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:12.733086    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 15 21:29:12.787926 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:12.733360    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 15 21:29:12.787926 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:12.733537    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 15 21:29:12.787926 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:12.733581    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 15 21:29:12.787926 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:12.733726    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 15 21:29:12.787926 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:12.733789    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-dmhfn\""
Jul 15 21:29:12.787926 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:12.733895    2563 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 15 21:29:12.787926 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:12.734351    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-dnzpf"
Jul 15 21:29:12.787926 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:12.739285    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 15 21:29:12.787926 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:12.739491    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 15 21:29:12.787926 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:12.739739    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 15 21:29:12.787926 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:12.743427    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0a247377-2db3-4a4f-9faf-24b8cf6b2688-host-run-netns\") pod \"multus-dnzpf\" (UID: \"0a247377-2db3-4a4f-9faf-24b8cf6b2688\") " pod="openshift-multus/multus-dnzpf"
Jul 15 21:29:12.787926 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:12.743456    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/0a247377-2db3-4a4f-9faf-24b8cf6b2688-host-run-multus-certs\") pod \"multus-dnzpf\" (UID: \"0a247377-2db3-4a4f-9faf-24b8cf6b2688\") " pod="openshift-multus/multus-dnzpf"
Jul 15 21:29:12.787926 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:12.743487    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zm5db\" (UniqueName: \"kubernetes.io/projected/a8599815-6b89-4248-99de-f4a3ee849bf0-kube-api-access-zm5db\") pod \"node-resolver-tlrgr\" (UID: \"a8599815-6b89-4248-99de-f4a3ee849bf0\") " pod="openshift-dns/node-resolver-tlrgr"
Jul 15 21:29:12.789727 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:12.743510    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/cdc00ed8-331f-4ccc-9d0e-66e123a578eb-tuning-conf-dir\") pod \"multus-additional-cni-plugins-f2sjs\" (UID: \"cdc00ed8-331f-4ccc-9d0e-66e123a578eb\") " pod="openshift-multus/multus-additional-cni-plugins-f2sjs"
Jul 15 21:29:12.789727 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:12.743531    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/08a86ea6-a748-4395-8c19-d3df46a2d855-etc-sysctl-d\") pod \"tuned-zqgv4\" (UID: \"08a86ea6-a748-4395-8c19-d3df46a2d855\") " pod="openshift-cluster-node-tuning-operator/tuned-zqgv4"
Jul 15 21:29:12.789727 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:12.743553    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/08a86ea6-a748-4395-8c19-d3df46a2d855-lib-modules\") pod \"tuned-zqgv4\" (UID: \"08a86ea6-a748-4395-8c19-d3df46a2d855\") " pod="openshift-cluster-node-tuning-operator/tuned-zqgv4"
Jul 15 21:29:12.789727 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:12.743572    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/08a86ea6-a748-4395-8c19-d3df46a2d855-host\") pod \"tuned-zqgv4\" (UID: \"08a86ea6-a748-4395-8c19-d3df46a2d855\") " pod="openshift-cluster-node-tuning-operator/tuned-zqgv4"
Jul 15 21:29:12.789727 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:12.743591    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0a247377-2db3-4a4f-9faf-24b8cf6b2688-cnibin\") pod \"multus-dnzpf\" (UID: \"0a247377-2db3-4a4f-9faf-24b8cf6b2688\") " pod="openshift-multus/multus-dnzpf"
Jul 15 21:29:12.789727 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:12.743612    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/0a247377-2db3-4a4f-9faf-24b8cf6b2688-host-run-k8s-cni-cncf-io\") pod \"multus-dnzpf\" (UID: \"0a247377-2db3-4a4f-9faf-24b8cf6b2688\") " pod="openshift-multus/multus-dnzpf"
Jul 15 21:29:12.789727 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:12.743633    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/cdc00ed8-331f-4ccc-9d0e-66e123a578eb-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-f2sjs\" (UID: \"cdc00ed8-331f-4ccc-9d0e-66e123a578eb\") " pod="openshift-multus/multus-additional-cni-plugins-f2sjs"
Jul 15 21:29:12.789727 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:12.743655    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/0a247377-2db3-4a4f-9faf-24b8cf6b2688-multus-socket-dir-parent\") pod \"multus-dnzpf\" (UID: \"0a247377-2db3-4a4f-9faf-24b8cf6b2688\") " pod="openshift-multus/multus-dnzpf"
Jul 15 21:29:12.789727 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:12.743674    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/0a247377-2db3-4a4f-9faf-24b8cf6b2688-multus-daemon-config\") pod \"multus-dnzpf\" (UID: \"0a247377-2db3-4a4f-9faf-24b8cf6b2688\") " pod="openshift-multus/multus-dnzpf"
Jul 15 21:29:12.789727 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:12.743695    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0a247377-2db3-4a4f-9faf-24b8cf6b2688-etc-kubernetes\") pod \"multus-dnzpf\" (UID: \"0a247377-2db3-4a4f-9faf-24b8cf6b2688\") " pod="openshift-multus/multus-dnzpf"
Jul 15 21:29:12.789727 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:12.743717    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/f0419a71-4b27-477f-9aad-a068b50d814d-kubelet-dir\") pod \"aws-ebs-csi-driver-node-7n5gr\" (UID: \"f0419a71-4b27-477f-9aad-a068b50d814d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7n5gr"
Jul 15 21:29:12.789727 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:12.743736    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/f0419a71-4b27-477f-9aad-a068b50d814d-registration-dir\") pod \"aws-ebs-csi-driver-node-7n5gr\" (UID: \"f0419a71-4b27-477f-9aad-a068b50d814d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7n5gr"
Jul 15 21:29:12.789727 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:12.743762    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/6e450c81-34e8-4ad5-9939-56804ad78f86-agent-certs\") pod \"konnectivity-agent-rz4r6\" (UID: \"6e450c81-34e8-4ad5-9939-56804ad78f86\") " pod="kube-system/konnectivity-agent-rz4r6"
Jul 15 21:29:12.789727 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:12.743781    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/08a86ea6-a748-4395-8c19-d3df46a2d855-etc-sysctl-conf\") pod \"tuned-zqgv4\" (UID: \"08a86ea6-a748-4395-8c19-d3df46a2d855\") " pod="openshift-cluster-node-tuning-operator/tuned-zqgv4"
Jul 15 21:29:12.789727 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:12.743801    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/08a86ea6-a748-4395-8c19-d3df46a2d855-sys\") pod \"tuned-zqgv4\" (UID: \"08a86ea6-a748-4395-8c19-d3df46a2d855\") " pod="openshift-cluster-node-tuning-operator/tuned-zqgv4"
Jul 15 21:29:12.789727 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:12.743820    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0a247377-2db3-4a4f-9faf-24b8cf6b2688-multus-cni-dir\") pod \"multus-dnzpf\" (UID: \"0a247377-2db3-4a4f-9faf-24b8cf6b2688\") " pod="openshift-multus/multus-dnzpf"
Jul 15 21:29:12.790862 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:12.743840    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/f0419a71-4b27-477f-9aad-a068b50d814d-etc-selinux\") pod \"aws-ebs-csi-driver-node-7n5gr\" (UID: \"f0419a71-4b27-477f-9aad-a068b50d814d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7n5gr"
Jul 15 21:29:12.790862 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:12.748546    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/cdc00ed8-331f-4ccc-9d0e-66e123a578eb-system-cni-dir\") pod \"multus-additional-cni-plugins-f2sjs\" (UID: \"cdc00ed8-331f-4ccc-9d0e-66e123a578eb\") " pod="openshift-multus/multus-additional-cni-plugins-f2sjs"
Jul 15 21:29:12.790862 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:12.748568    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qlt6f\" (UniqueName: \"kubernetes.io/projected/cdc00ed8-331f-4ccc-9d0e-66e123a578eb-kube-api-access-qlt6f\") pod \"multus-additional-cni-plugins-f2sjs\" (UID: \"cdc00ed8-331f-4ccc-9d0e-66e123a578eb\") " pod="openshift-multus/multus-additional-cni-plugins-f2sjs"
Jul 15 21:29:12.790862 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:12.748589    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/08a86ea6-a748-4395-8c19-d3df46a2d855-etc-kubernetes\") pod \"tuned-zqgv4\" (UID: \"08a86ea6-a748-4395-8c19-d3df46a2d855\") " pod="openshift-cluster-node-tuning-operator/tuned-zqgv4"
Jul 15 21:29:12.790862 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:12.748609    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0a247377-2db3-4a4f-9faf-24b8cf6b2688-host-var-lib-cni-bin\") pod \"multus-dnzpf\" (UID: \"0a247377-2db3-4a4f-9faf-24b8cf6b2688\") " pod="openshift-multus/multus-dnzpf"
Jul 15 21:29:12.790862 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:12.748628    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/0a247377-2db3-4a4f-9faf-24b8cf6b2688-hostroot\") pod \"multus-dnzpf\" (UID: \"0a247377-2db3-4a4f-9faf-24b8cf6b2688\") " pod="openshift-multus/multus-dnzpf"
Jul 15 21:29:12.790862 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:12.750472    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-5zldt\""
Jul 15 21:29:12.790862 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:12.750677    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-svqdc\""
Jul 15 21:29:12.790862 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:12.750700    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0a247377-2db3-4a4f-9faf-24b8cf6b2688-multus-conf-dir\") pod \"multus-dnzpf\" (UID: \"0a247377-2db3-4a4f-9faf-24b8cf6b2688\") " pod="openshift-multus/multus-dnzpf"
Jul 15 21:29:12.790862 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:12.750745    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0a247377-2db3-4a4f-9faf-24b8cf6b2688-os-release\") pod \"multus-dnzpf\" (UID: \"0a247377-2db3-4a4f-9faf-24b8cf6b2688\") " pod="openshift-multus/multus-dnzpf"
Jul 15 21:29:12.790862 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:12.750774    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0a247377-2db3-4a4f-9faf-24b8cf6b2688-host-var-lib-kubelet\") pod \"multus-dnzpf\" (UID: \"0a247377-2db3-4a4f-9faf-24b8cf6b2688\") " pod="openshift-multus/multus-dnzpf"
Jul 15 21:29:12.790862 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:12.750796    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/f0419a71-4b27-477f-9aad-a068b50d814d-socket-dir\") pod \"aws-ebs-csi-driver-node-7n5gr\" (UID: \"f0419a71-4b27-477f-9aad-a068b50d814d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7n5gr"
Jul 15 21:29:12.790862 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:12.750816    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/f0419a71-4b27-477f-9aad-a068b50d814d-device-dir\") pod \"aws-ebs-csi-driver-node-7n5gr\" (UID: \"f0419a71-4b27-477f-9aad-a068b50d814d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7n5gr"
Jul 15 21:29:12.790862 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:12.750838    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a8599815-6b89-4248-99de-f4a3ee849bf0-tmp-dir\") pod \"node-resolver-tlrgr\" (UID: \"a8599815-6b89-4248-99de-f4a3ee849bf0\") " pod="openshift-dns/node-resolver-tlrgr"
Jul 15 21:29:12.790862 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:12.750858    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/6e450c81-34e8-4ad5-9939-56804ad78f86-konnectivity-ca\") pod \"konnectivity-agent-rz4r6\" (UID: \"6e450c81-34e8-4ad5-9939-56804ad78f86\") " pod="kube-system/konnectivity-agent-rz4r6"
Jul 15 21:29:12.790862 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:12.750879    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/cdc00ed8-331f-4ccc-9d0e-66e123a578eb-os-release\") pod \"multus-additional-cni-plugins-f2sjs\" (UID: \"cdc00ed8-331f-4ccc-9d0e-66e123a578eb\") " pod="openshift-multus/multus-additional-cni-plugins-f2sjs"
Jul 15 21:29:12.790862 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:12.750900    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/cdc00ed8-331f-4ccc-9d0e-66e123a578eb-cni-binary-copy\") pod \"multus-additional-cni-plugins-f2sjs\" (UID: \"cdc00ed8-331f-4ccc-9d0e-66e123a578eb\") " pod="openshift-multus/multus-additional-cni-plugins-f2sjs"
Jul 15 21:29:12.792764 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:12.750922    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/cdc00ed8-331f-4ccc-9d0e-66e123a578eb-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-f2sjs\" (UID: \"cdc00ed8-331f-4ccc-9d0e-66e123a578eb\") " pod="openshift-multus/multus-additional-cni-plugins-f2sjs"
Jul 15 21:29:12.792764 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:12.750945    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/08a86ea6-a748-4395-8c19-d3df46a2d855-etc-sysconfig\") pod \"tuned-zqgv4\" (UID: \"08a86ea6-a748-4395-8c19-d3df46a2d855\") " pod="openshift-cluster-node-tuning-operator/tuned-zqgv4"
Jul 15 21:29:12.792764 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:12.750981    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/08a86ea6-a748-4395-8c19-d3df46a2d855-etc-systemd\") pod \"tuned-zqgv4\" (UID: \"08a86ea6-a748-4395-8c19-d3df46a2d855\") " pod="openshift-cluster-node-tuning-operator/tuned-zqgv4"
Jul 15 21:29:12.792764 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:12.751001    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/08a86ea6-a748-4395-8c19-d3df46a2d855-tmp\") pod \"tuned-zqgv4\" (UID: \"08a86ea6-a748-4395-8c19-d3df46a2d855\") " pod="openshift-cluster-node-tuning-operator/tuned-zqgv4"
Jul 15 21:29:12.792764 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:12.751023    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/0a247377-2db3-4a4f-9faf-24b8cf6b2688-host-var-lib-cni-multus\") pod \"multus-dnzpf\" (UID: \"0a247377-2db3-4a4f-9faf-24b8cf6b2688\") " pod="openshift-multus/multus-dnzpf"
Jul 15 21:29:12.792764 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:12.751044    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/f0419a71-4b27-477f-9aad-a068b50d814d-sys-fs\") pod \"aws-ebs-csi-driver-node-7n5gr\" (UID: \"f0419a71-4b27-477f-9aad-a068b50d814d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7n5gr"
Jul 15 21:29:12.792764 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:12.751065    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/cdc00ed8-331f-4ccc-9d0e-66e123a578eb-cnibin\") pod \"multus-additional-cni-plugins-f2sjs\" (UID: \"cdc00ed8-331f-4ccc-9d0e-66e123a578eb\") " pod="openshift-multus/multus-additional-cni-plugins-f2sjs"
Jul 15 21:29:12.792764 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:12.751085    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/08a86ea6-a748-4395-8c19-d3df46a2d855-etc-modprobe-d\") pod \"tuned-zqgv4\" (UID: \"08a86ea6-a748-4395-8c19-d3df46a2d855\") " pod="openshift-cluster-node-tuning-operator/tuned-zqgv4"
Jul 15 21:29:12.792764 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:12.751106    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/08a86ea6-a748-4395-8c19-d3df46a2d855-var-lib-kubelet\") pod \"tuned-zqgv4\" (UID: \"08a86ea6-a748-4395-8c19-d3df46a2d855\") " pod="openshift-cluster-node-tuning-operator/tuned-zqgv4"
Jul 15 21:29:12.792764 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:12.751776    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ljpbj\" (UniqueName: \"kubernetes.io/projected/08a86ea6-a748-4395-8c19-d3df46a2d855-kube-api-access-ljpbj\") pod \"tuned-zqgv4\" (UID: \"08a86ea6-a748-4395-8c19-d3df46a2d855\") " pod="openshift-cluster-node-tuning-operator/tuned-zqgv4"
Jul 15 21:29:12.792764 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:12.751805    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0a247377-2db3-4a4f-9faf-24b8cf6b2688-cni-binary-copy\") pod \"multus-dnzpf\" (UID: \"0a247377-2db3-4a4f-9faf-24b8cf6b2688\") " pod="openshift-multus/multus-dnzpf"
Jul 15 21:29:12.792764 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:12.751829    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n587x\" (UniqueName: \"kubernetes.io/projected/0a247377-2db3-4a4f-9faf-24b8cf6b2688-kube-api-access-n587x\") pod \"multus-dnzpf\" (UID: \"0a247377-2db3-4a4f-9faf-24b8cf6b2688\") " pod="openshift-multus/multus-dnzpf"
Jul 15 21:29:12.792764 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:12.751873    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m6kxn\" (UniqueName: \"kubernetes.io/projected/f0419a71-4b27-477f-9aad-a068b50d814d-kube-api-access-m6kxn\") pod \"aws-ebs-csi-driver-node-7n5gr\" (UID: \"f0419a71-4b27-477f-9aad-a068b50d814d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7n5gr"
Jul 15 21:29:12.792764 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:12.751893    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/a8599815-6b89-4248-99de-f4a3ee849bf0-hosts-file\") pod \"node-resolver-tlrgr\" (UID: \"a8599815-6b89-4248-99de-f4a3ee849bf0\") " pod="openshift-dns/node-resolver-tlrgr"
Jul 15 21:29:12.792764 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:12.751913    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/08a86ea6-a748-4395-8c19-d3df46a2d855-run\") pod \"tuned-zqgv4\" (UID: \"08a86ea6-a748-4395-8c19-d3df46a2d855\") " pod="openshift-cluster-node-tuning-operator/tuned-zqgv4"
Jul 15 21:29:12.792764 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:12.751959    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/08a86ea6-a748-4395-8c19-d3df46a2d855-etc-tuned\") pod \"tuned-zqgv4\" (UID: \"08a86ea6-a748-4395-8c19-d3df46a2d855\") " pod="openshift-cluster-node-tuning-operator/tuned-zqgv4"
Jul 15 21:29:12.793901 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:12.753606    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0a247377-2db3-4a4f-9faf-24b8cf6b2688-system-cni-dir\") pod \"multus-dnzpf\" (UID: \"0a247377-2db3-4a4f-9faf-24b8cf6b2688\") " pod="openshift-multus/multus-dnzpf"
Jul 15 21:29:12.793901 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:12.754042    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sj7lm"
Jul 15 21:29:12.793901 ip-10-0-130-217 kubenswrapper[2563]: E0715 21:29:12.754144    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sj7lm" podUID="70c7abe7-c0b9-49bd-9ab9-a5db9117faa5"
Jul 15 21:29:12.793901 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:12.759266    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-bp2vz"
Jul 15 21:29:12.793901 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:12.761454    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 15 21:29:12.793901 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:12.761679    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 15 21:29:12.793901 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:12.761976    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 15 21:29:12.793901 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:12.762023    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-5jt85\""
Jul 15 21:29:12.793901 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:12.762079    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 15 21:29:12.793901 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:12.762133    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 15 21:29:12.793901 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:12.762474    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dw6kh"
Jul 15 21:29:12.793901 ip-10-0-130-217 kubenswrapper[2563]: E0715 21:29:12.762548    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dw6kh" podUID="50904bfc-f028-4def-b159-b24669cfde16"
Jul 15 21:29:12.793901 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:12.762705    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 15 21:29:12.793901 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:12.764436    2563 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 15 21:29:12.793901 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:12.765538    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6tbzj"
Jul 15 21:29:12.793901 ip-10-0-130-217 kubenswrapper[2563]: E0715 21:29:12.765603    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6tbzj" podUID="c4900b8a-d9f9-4926-8c67-62cd4a52ce9b"
Jul 15 21:29:12.793901 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:12.767692    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-9t6s7"
Jul 15 21:29:12.793901 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:12.769843    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-jlxr2\""
Jul 15 21:29:12.793901 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:12.769988    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 15 21:29:12.793901 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:12.770254    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 15 21:29:12.793901 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:12.770356    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 15 21:29:12.793901 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:12.770253    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-9rlc4"
Jul 15 21:29:12.793901 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:12.772762    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 15 21:29:12.793901 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:12.772819    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 15 21:29:12.793901 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:12.772837    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 15 21:29:12.793901 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:12.772884    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-lhxlv\""
Jul 15 21:29:12.793901 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:12.789697    2563 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-d8xn6"
Jul 15 21:29:12.799109 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:12.797721    2563 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-d8xn6"
Jul 15 21:29:12.864353 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:12.834242    2563 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 15 21:29:12.864353 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:12.853825    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/08a86ea6-a748-4395-8c19-d3df46a2d855-lib-modules\") pod \"tuned-zqgv4\" (UID: \"08a86ea6-a748-4395-8c19-d3df46a2d855\") " pod="openshift-cluster-node-tuning-operator/tuned-zqgv4"
Jul 15 21:29:12.864353 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:12.853867    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/08a86ea6-a748-4395-8c19-d3df46a2d855-host\") pod \"tuned-zqgv4\" (UID: \"08a86ea6-a748-4395-8c19-d3df46a2d855\") " pod="openshift-cluster-node-tuning-operator/tuned-zqgv4"
Jul 15 21:29:12.864353 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:12.853899    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/0a247377-2db3-4a4f-9faf-24b8cf6b2688-host-run-k8s-cni-cncf-io\") pod \"multus-dnzpf\" (UID: \"0a247377-2db3-4a4f-9faf-24b8cf6b2688\") " pod="openshift-multus/multus-dnzpf"
Jul 15 21:29:12.864353 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:12.853928    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/afc0fd53-3c5e-45f9-bf8d-7304a97d7d66-host-slash\") pod \"iptables-alerter-9t6s7\" (UID: \"afc0fd53-3c5e-45f9-bf8d-7304a97d7d66\") " pod="openshift-network-operator/iptables-alerter-9t6s7"
Jul 15 21:29:12.864353 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:12.853958    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7f43c078-b73a-4760-860b-e7f6e07afdbd-etc-openvswitch\") pod \"ovnkube-node-bp2vz\" (UID: \"7f43c078-b73a-4760-860b-e7f6e07afdbd\") " pod="openshift-ovn-kubernetes/ovnkube-node-bp2vz"
Jul 15 21:29:12.864353 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:12.853986    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/7f43c078-b73a-4760-860b-e7f6e07afdbd-ovnkube-script-lib\") pod \"ovnkube-node-bp2vz\" (UID: \"7f43c078-b73a-4760-860b-e7f6e07afdbd\") " pod="openshift-ovn-kubernetes/ovnkube-node-bp2vz"
Jul 15 21:29:12.864353 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:12.854013    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/08a86ea6-a748-4395-8c19-d3df46a2d855-lib-modules\") pod \"tuned-zqgv4\" (UID: \"08a86ea6-a748-4395-8c19-d3df46a2d855\") " pod="openshift-cluster-node-tuning-operator/tuned-zqgv4"
Jul 15 21:29:12.864353 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:12.854031    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/0a247377-2db3-4a4f-9faf-24b8cf6b2688-multus-socket-dir-parent\") pod \"multus-dnzpf\" (UID: \"0a247377-2db3-4a4f-9faf-24b8cf6b2688\") " pod="openshift-multus/multus-dnzpf"
Jul 15 21:29:12.864353 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:12.854078    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/f0419a71-4b27-477f-9aad-a068b50d814d-kubelet-dir\") pod \"aws-ebs-csi-driver-node-7n5gr\" (UID: \"f0419a71-4b27-477f-9aad-a068b50d814d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7n5gr"
Jul 15 21:29:12.864353 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:12.854161    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/f0419a71-4b27-477f-9aad-a068b50d814d-kubelet-dir\") pod \"aws-ebs-csi-driver-node-7n5gr\" (UID: \"f0419a71-4b27-477f-9aad-a068b50d814d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7n5gr"
Jul 15 21:29:12.864353 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:12.854177    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/0a247377-2db3-4a4f-9faf-24b8cf6b2688-host-run-k8s-cni-cncf-io\") pod \"multus-dnzpf\" (UID: \"0a247377-2db3-4a4f-9faf-24b8cf6b2688\") " pod="openshift-multus/multus-dnzpf"
Jul 15 21:29:12.864353 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:12.854210    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/08a86ea6-a748-4395-8c19-d3df46a2d855-host\") pod \"tuned-zqgv4\" (UID: \"08a86ea6-a748-4395-8c19-d3df46a2d855\") " pod="openshift-cluster-node-tuning-operator/tuned-zqgv4"
Jul 15 21:29:12.864353 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:12.854227    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/0a247377-2db3-4a4f-9faf-24b8cf6b2688-multus-socket-dir-parent\") pod \"multus-dnzpf\" (UID: \"0a247377-2db3-4a4f-9faf-24b8cf6b2688\") " pod="openshift-multus/multus-dnzpf"
Jul 15 21:29:12.864353 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:12.854254    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/f0419a71-4b27-477f-9aad-a068b50d814d-registration-dir\") pod \"aws-ebs-csi-driver-node-7n5gr\" (UID: \"f0419a71-4b27-477f-9aad-a068b50d814d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7n5gr"
Jul 15 21:29:12.864353 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:12.854313    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tc26f\" (UniqueName: \"kubernetes.io/projected/c4900b8a-d9f9-4926-8c67-62cd4a52ce9b-kube-api-access-tc26f\") pod \"network-metrics-daemon-6tbzj\" (UID: \"c4900b8a-d9f9-4926-8c67-62cd4a52ce9b\") " pod="openshift-multus/network-metrics-daemon-6tbzj"
Jul 15 21:29:12.864353 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:12.854342    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/f0419a71-4b27-477f-9aad-a068b50d814d-registration-dir\") pod \"aws-ebs-csi-driver-node-7n5gr\" (UID: \"f0419a71-4b27-477f-9aad-a068b50d814d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7n5gr"
Jul 15 21:29:12.864353 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:12.854374    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/08a86ea6-a748-4395-8c19-d3df46a2d855-etc-sysctl-conf\") pod \"tuned-zqgv4\" (UID: \"08a86ea6-a748-4395-8c19-d3df46a2d855\") " pod="openshift-cluster-node-tuning-operator/tuned-zqgv4"
Jul 15 21:29:12.865784 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:12.854416    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0a247377-2db3-4a4f-9faf-24b8cf6b2688-multus-cni-dir\") pod \"multus-dnzpf\" (UID: \"0a247377-2db3-4a4f-9faf-24b8cf6b2688\") " pod="openshift-multus/multus-dnzpf"
Jul 15 21:29:12.865784 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:12.854450    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/f0419a71-4b27-477f-9aad-a068b50d814d-etc-selinux\") pod \"aws-ebs-csi-driver-node-7n5gr\" (UID: \"f0419a71-4b27-477f-9aad-a068b50d814d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7n5gr"
Jul 15 21:29:12.865784 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:12.854506    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/7f43c078-b73a-4760-860b-e7f6e07afdbd-run-systemd\") pod \"ovnkube-node-bp2vz\" (UID: \"7f43c078-b73a-4760-860b-e7f6e07afdbd\") " pod="openshift-ovn-kubernetes/ovnkube-node-bp2vz"
Jul 15 21:29:12.865784 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:12.854539    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/08a86ea6-a748-4395-8c19-d3df46a2d855-etc-kubernetes\") pod \"tuned-zqgv4\" (UID: \"08a86ea6-a748-4395-8c19-d3df46a2d855\") " pod="openshift-cluster-node-tuning-operator/tuned-zqgv4"
Jul 15 21:29:12.865784 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:12.854553    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/f0419a71-4b27-477f-9aad-a068b50d814d-etc-selinux\") pod \"aws-ebs-csi-driver-node-7n5gr\" (UID: \"f0419a71-4b27-477f-9aad-a068b50d814d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7n5gr"
Jul 15 21:29:12.865784 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:12.854566    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a8599815-6b89-4248-99de-f4a3ee849bf0-tmp-dir\") pod \"node-resolver-tlrgr\" (UID: \"a8599815-6b89-4248-99de-f4a3ee849bf0\") " pod="openshift-dns/node-resolver-tlrgr"
Jul 15 21:29:12.865784 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:12.854601    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/6e450c81-34e8-4ad5-9939-56804ad78f86-konnectivity-ca\") pod \"konnectivity-agent-rz4r6\" (UID: \"6e450c81-34e8-4ad5-9939-56804ad78f86\") " pod="kube-system/konnectivity-agent-rz4r6"
Jul 15 21:29:12.865784 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:12.854642    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d27m5\" (UniqueName: \"kubernetes.io/projected/50904bfc-f028-4def-b159-b24669cfde16-kube-api-access-d27m5\") pod \"network-check-target-dw6kh\" (UID: \"50904bfc-f028-4def-b159-b24669cfde16\") " pod="openshift-network-diagnostics/network-check-target-dw6kh"
Jul 15 21:29:12.865784 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:12.854659    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0a247377-2db3-4a4f-9faf-24b8cf6b2688-multus-cni-dir\") pod \"multus-dnzpf\" (UID: \"0a247377-2db3-4a4f-9faf-24b8cf6b2688\") " pod="openshift-multus/multus-dnzpf"
Jul 15 21:29:12.865784 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:12.854762    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/08a86ea6-a748-4395-8c19-d3df46a2d855-etc-kubernetes\") pod \"tuned-zqgv4\" (UID: \"08a86ea6-a748-4395-8c19-d3df46a2d855\") " pod="openshift-cluster-node-tuning-operator/tuned-zqgv4"
Jul 15 21:29:12.865784 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:12.854809    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5r6ws\" (UniqueName: \"kubernetes.io/projected/7f43c078-b73a-4760-860b-e7f6e07afdbd-kube-api-access-5r6ws\") pod \"ovnkube-node-bp2vz\" (UID: \"7f43c078-b73a-4760-860b-e7f6e07afdbd\") " pod="openshift-ovn-kubernetes/ovnkube-node-bp2vz"
Jul 15 21:29:12.865784 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:12.854848    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/cdc00ed8-331f-4ccc-9d0e-66e123a578eb-os-release\") pod \"multus-additional-cni-plugins-f2sjs\" (UID: \"cdc00ed8-331f-4ccc-9d0e-66e123a578eb\") " pod="openshift-multus/multus-additional-cni-plugins-f2sjs"
Jul 15 21:29:12.865784 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:12.854906    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a8599815-6b89-4248-99de-f4a3ee849bf0-tmp-dir\") pod \"node-resolver-tlrgr\" (UID: \"a8599815-6b89-4248-99de-f4a3ee849bf0\") " pod="openshift-dns/node-resolver-tlrgr"
Jul 15 21:29:12.865784 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:12.854930    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/cdc00ed8-331f-4ccc-9d0e-66e123a578eb-cni-binary-copy\") pod \"multus-additional-cni-plugins-f2sjs\" (UID: \"cdc00ed8-331f-4ccc-9d0e-66e123a578eb\") " pod="openshift-multus/multus-additional-cni-plugins-f2sjs"
Jul 15 21:29:12.865784 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:12.854956    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/cdc00ed8-331f-4ccc-9d0e-66e123a578eb-os-release\") pod \"multus-additional-cni-plugins-f2sjs\" (UID: \"cdc00ed8-331f-4ccc-9d0e-66e123a578eb\") " pod="openshift-multus/multus-additional-cni-plugins-f2sjs"
Jul 15 21:29:12.865784 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:12.854974    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/cdc00ed8-331f-4ccc-9d0e-66e123a578eb-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-f2sjs\" (UID: \"cdc00ed8-331f-4ccc-9d0e-66e123a578eb\") " pod="openshift-multus/multus-additional-cni-plugins-f2sjs"
Jul 15 21:29:12.865784 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:12.855046    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/08a86ea6-a748-4395-8c19-d3df46a2d855-etc-sysctl-conf\") pod \"tuned-zqgv4\" (UID: \"08a86ea6-a748-4395-8c19-d3df46a2d855\") " pod="openshift-cluster-node-tuning-operator/tuned-zqgv4"
Jul 15 21:29:12.866780 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:12.855156    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/08a86ea6-a748-4395-8c19-d3df46a2d855-tmp\") pod \"tuned-zqgv4\" (UID: \"08a86ea6-a748-4395-8c19-d3df46a2d855\") " pod="openshift-cluster-node-tuning-operator/tuned-zqgv4"
Jul 15 21:29:12.866780 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:12.855285    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/afc0fd53-3c5e-45f9-bf8d-7304a97d7d66-iptables-alerter-script\") pod \"iptables-alerter-9t6s7\" (UID: \"afc0fd53-3c5e-45f9-bf8d-7304a97d7d66\") " pod="openshift-network-operator/iptables-alerter-9t6s7"
Jul 15 21:29:12.866780 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:12.855342    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/08a86ea6-a748-4395-8c19-d3df46a2d855-var-lib-kubelet\") pod \"tuned-zqgv4\" (UID: \"08a86ea6-a748-4395-8c19-d3df46a2d855\") " pod="openshift-cluster-node-tuning-operator/tuned-zqgv4"
Jul 15 21:29:12.866780 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:12.855340    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/6e450c81-34e8-4ad5-9939-56804ad78f86-konnectivity-ca\") pod \"konnectivity-agent-rz4r6\" (UID: \"6e450c81-34e8-4ad5-9939-56804ad78f86\") " pod="kube-system/konnectivity-agent-rz4r6"
Jul 15 21:29:12.866780 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:12.855433    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/08a86ea6-a748-4395-8c19-d3df46a2d855-var-lib-kubelet\") pod \"tuned-zqgv4\" (UID: \"08a86ea6-a748-4395-8c19-d3df46a2d855\") " pod="openshift-cluster-node-tuning-operator/tuned-zqgv4"
Jul 15 21:29:12.866780 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:12.855484    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ljpbj\" (UniqueName: \"kubernetes.io/projected/08a86ea6-a748-4395-8c19-d3df46a2d855-kube-api-access-ljpbj\") pod \"tuned-zqgv4\" (UID: \"08a86ea6-a748-4395-8c19-d3df46a2d855\") " pod="openshift-cluster-node-tuning-operator/tuned-zqgv4"
Jul 15 21:29:12.866780 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:12.855489    2563 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 15 21:29:12.866780 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:12.855512    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n587x\" (UniqueName: \"kubernetes.io/projected/0a247377-2db3-4a4f-9faf-24b8cf6b2688-kube-api-access-n587x\") pod \"multus-dnzpf\" (UID: \"0a247377-2db3-4a4f-9faf-24b8cf6b2688\") " pod="openshift-multus/multus-dnzpf"
Jul 15 21:29:12.866780 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:12.855533    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/a8599815-6b89-4248-99de-f4a3ee849bf0-hosts-file\") pod \"node-resolver-tlrgr\" (UID: \"a8599815-6b89-4248-99de-f4a3ee849bf0\") " pod="openshift-dns/node-resolver-tlrgr"
Jul 15 21:29:12.866780 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:12.855606    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7f43c078-b73a-4760-860b-e7f6e07afdbd-var-lib-openvswitch\") pod \"ovnkube-node-bp2vz\" (UID: \"7f43c078-b73a-4760-860b-e7f6e07afdbd\") " pod="openshift-ovn-kubernetes/ovnkube-node-bp2vz"
Jul 15 21:29:12.866780 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:12.855656    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/08a86ea6-a748-4395-8c19-d3df46a2d855-run\") pod \"tuned-zqgv4\" (UID: \"08a86ea6-a748-4395-8c19-d3df46a2d855\") " pod="openshift-cluster-node-tuning-operator/tuned-zqgv4"
Jul 15 21:29:12.866780 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:12.855696    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/a8599815-6b89-4248-99de-f4a3ee849bf0-hosts-file\") pod \"node-resolver-tlrgr\" (UID: \"a8599815-6b89-4248-99de-f4a3ee849bf0\") " pod="openshift-dns/node-resolver-tlrgr"
Jul 15 21:29:12.866780 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:12.855758    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/cdc00ed8-331f-4ccc-9d0e-66e123a578eb-cni-binary-copy\") pod \"multus-additional-cni-plugins-f2sjs\" (UID: \"cdc00ed8-331f-4ccc-9d0e-66e123a578eb\") " pod="openshift-multus/multus-additional-cni-plugins-f2sjs"
Jul 15 21:29:12.866780 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:12.855697    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/08a86ea6-a748-4395-8c19-d3df46a2d855-etc-tuned\") pod \"tuned-zqgv4\" (UID: \"08a86ea6-a748-4395-8c19-d3df46a2d855\") " pod="openshift-cluster-node-tuning-operator/tuned-zqgv4"
Jul 15 21:29:12.866780 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:12.855759    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/cdc00ed8-331f-4ccc-9d0e-66e123a578eb-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-f2sjs\" (UID: \"cdc00ed8-331f-4ccc-9d0e-66e123a578eb\") " pod="openshift-multus/multus-additional-cni-plugins-f2sjs"
Jul 15 21:29:12.866780 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:12.855804    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0a247377-2db3-4a4f-9faf-24b8cf6b2688-system-cni-dir\") pod \"multus-dnzpf\" (UID: \"0a247377-2db3-4a4f-9faf-24b8cf6b2688\") " pod="openshift-multus/multus-dnzpf"
Jul 15 21:29:12.866780 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:12.855836    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0a247377-2db3-4a4f-9faf-24b8cf6b2688-host-run-netns\") pod \"multus-dnzpf\" (UID: \"0a247377-2db3-4a4f-9faf-24b8cf6b2688\") " pod="openshift-multus/multus-dnzpf"
Jul 15 21:29:12.866780 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:12.855865    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/08a86ea6-a748-4395-8c19-d3df46a2d855-run\") pod \"tuned-zqgv4\" (UID: \"08a86ea6-a748-4395-8c19-d3df46a2d855\") " pod="openshift-cluster-node-tuning-operator/tuned-zqgv4"
Jul 15 21:29:12.867716 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:12.855871    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/0a247377-2db3-4a4f-9faf-24b8cf6b2688-host-run-multus-certs\") pod \"multus-dnzpf\" (UID: \"0a247377-2db3-4a4f-9faf-24b8cf6b2688\") " pod="openshift-multus/multus-dnzpf"
Jul 15 21:29:12.867716 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:12.855931    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0a247377-2db3-4a4f-9faf-24b8cf6b2688-system-cni-dir\") pod \"multus-dnzpf\" (UID: \"0a247377-2db3-4a4f-9faf-24b8cf6b2688\") " pod="openshift-multus/multus-dnzpf"
Jul 15 21:29:12.867716 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:12.855981    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0a247377-2db3-4a4f-9faf-24b8cf6b2688-host-run-netns\") pod \"multus-dnzpf\" (UID: \"0a247377-2db3-4a4f-9faf-24b8cf6b2688\") " pod="openshift-multus/multus-dnzpf"
Jul 15 21:29:12.867716 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:12.855909    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zm5db\" (UniqueName: \"kubernetes.io/projected/a8599815-6b89-4248-99de-f4a3ee849bf0-kube-api-access-zm5db\") pod \"node-resolver-tlrgr\" (UID: \"a8599815-6b89-4248-99de-f4a3ee849bf0\") " pod="openshift-dns/node-resolver-tlrgr"
Jul 15 21:29:12.867716 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:12.856049    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/0a247377-2db3-4a4f-9faf-24b8cf6b2688-host-run-multus-certs\") pod \"multus-dnzpf\" (UID: \"0a247377-2db3-4a4f-9faf-24b8cf6b2688\") " pod="openshift-multus/multus-dnzpf"
Jul 15 21:29:12.867716 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:12.856079    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/29df31ab-38b3-4cec-ab5e-013432132c57-host\") pod \"node-ca-9rlc4\" (UID: \"29df31ab-38b3-4cec-ab5e-013432132c57\") " pod="openshift-image-registry/node-ca-9rlc4"
Jul 15 21:29:12.867716 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:12.856121    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/70c7abe7-c0b9-49bd-9ab9-a5db9117faa5-original-pull-secret\") pod \"global-pull-secret-syncer-sj7lm\" (UID: \"70c7abe7-c0b9-49bd-9ab9-a5db9117faa5\") " pod="kube-system/global-pull-secret-syncer-sj7lm"
Jul 15 21:29:12.867716 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:12.856235    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/cdc00ed8-331f-4ccc-9d0e-66e123a578eb-tuning-conf-dir\") pod \"multus-additional-cni-plugins-f2sjs\" (UID: \"cdc00ed8-331f-4ccc-9d0e-66e123a578eb\") " pod="openshift-multus/multus-additional-cni-plugins-f2sjs"
Jul 15 21:29:12.867716 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:12.856279    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/08a86ea6-a748-4395-8c19-d3df46a2d855-etc-sysctl-d\") pod \"tuned-zqgv4\" (UID: \"08a86ea6-a748-4395-8c19-d3df46a2d855\") " pod="openshift-cluster-node-tuning-operator/tuned-zqgv4"
Jul 15 21:29:12.867716 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:12.856303    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0a247377-2db3-4a4f-9faf-24b8cf6b2688-cnibin\") pod \"multus-dnzpf\" (UID: \"0a247377-2db3-4a4f-9faf-24b8cf6b2688\") " pod="openshift-multus/multus-dnzpf"
Jul 15 21:29:12.867716 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:12.856334    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/70c7abe7-c0b9-49bd-9ab9-a5db9117faa5-dbus\") pod \"global-pull-secret-syncer-sj7lm\" (UID: \"70c7abe7-c0b9-49bd-9ab9-a5db9117faa5\") " pod="kube-system/global-pull-secret-syncer-sj7lm"
Jul 15 21:29:12.867716 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:12.856365    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/cdc00ed8-331f-4ccc-9d0e-66e123a578eb-tuning-conf-dir\") pod \"multus-additional-cni-plugins-f2sjs\" (UID: \"cdc00ed8-331f-4ccc-9d0e-66e123a578eb\") " pod="openshift-multus/multus-additional-cni-plugins-f2sjs"
Jul 15 21:29:12.867716 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:12.856367    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7f43c078-b73a-4760-860b-e7f6e07afdbd-host-run-netns\") pod \"ovnkube-node-bp2vz\" (UID: \"7f43c078-b73a-4760-860b-e7f6e07afdbd\") " pod="openshift-ovn-kubernetes/ovnkube-node-bp2vz"
Jul 15 21:29:12.867716 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:12.856823    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/7f43c078-b73a-4760-860b-e7f6e07afdbd-run-ovn\") pod \"ovnkube-node-bp2vz\" (UID: \"7f43c078-b73a-4760-860b-e7f6e07afdbd\") " pod="openshift-ovn-kubernetes/ovnkube-node-bp2vz"
Jul 15 21:29:12.867716 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:12.856852    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/7f43c078-b73a-4760-860b-e7f6e07afdbd-env-overrides\") pod \"ovnkube-node-bp2vz\" (UID: \"7f43c078-b73a-4760-860b-e7f6e07afdbd\") " pod="openshift-ovn-kubernetes/ovnkube-node-bp2vz"
Jul 15 21:29:12.867716 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:12.856883    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/cdc00ed8-331f-4ccc-9d0e-66e123a578eb-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-f2sjs\" (UID: \"cdc00ed8-331f-4ccc-9d0e-66e123a578eb\") " pod="openshift-multus/multus-additional-cni-plugins-f2sjs"
Jul 15 21:29:12.867716 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:12.856894    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/08a86ea6-a748-4395-8c19-d3df46a2d855-etc-sysctl-d\") pod \"tuned-zqgv4\" (UID: \"08a86ea6-a748-4395-8c19-d3df46a2d855\") " pod="openshift-cluster-node-tuning-operator/tuned-zqgv4"
Jul 15 21:29:12.868701 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:12.856910    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/0a247377-2db3-4a4f-9faf-24b8cf6b2688-multus-daemon-config\") pod \"multus-dnzpf\" (UID: \"0a247377-2db3-4a4f-9faf-24b8cf6b2688\") " pod="openshift-multus/multus-dnzpf"
Jul 15 21:29:12.868701 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:12.856778    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0a247377-2db3-4a4f-9faf-24b8cf6b2688-cnibin\") pod \"multus-dnzpf\" (UID: \"0a247377-2db3-4a4f-9faf-24b8cf6b2688\") " pod="openshift-multus/multus-dnzpf"
Jul 15 21:29:12.868701 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:12.856996    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0a247377-2db3-4a4f-9faf-24b8cf6b2688-etc-kubernetes\") pod \"multus-dnzpf\" (UID: \"0a247377-2db3-4a4f-9faf-24b8cf6b2688\") " pod="openshift-multus/multus-dnzpf"
Jul 15 21:29:12.868701 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:12.857025    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/6e450c81-34e8-4ad5-9939-56804ad78f86-agent-certs\") pod \"konnectivity-agent-rz4r6\" (UID: \"6e450c81-34e8-4ad5-9939-56804ad78f86\") " pod="kube-system/konnectivity-agent-rz4r6"
Jul 15 21:29:12.868701 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:12.857050    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/7f43c078-b73a-4760-860b-e7f6e07afdbd-node-log\") pod \"ovnkube-node-bp2vz\" (UID: \"7f43c078-b73a-4760-860b-e7f6e07afdbd\") " pod="openshift-ovn-kubernetes/ovnkube-node-bp2vz"
Jul 15 21:29:12.868701 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:12.857076    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7f43c078-b73a-4760-860b-e7f6e07afdbd-host-run-ovn-kubernetes\") pod \"ovnkube-node-bp2vz\" (UID: \"7f43c078-b73a-4760-860b-e7f6e07afdbd\") " pod="openshift-ovn-kubernetes/ovnkube-node-bp2vz"
Jul 15 21:29:12.868701 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:12.857098    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/7f43c078-b73a-4760-860b-e7f6e07afdbd-host-cni-netd\") pod \"ovnkube-node-bp2vz\" (UID: \"7f43c078-b73a-4760-860b-e7f6e07afdbd\") " pod="openshift-ovn-kubernetes/ovnkube-node-bp2vz"
Jul 15 21:29:12.868701 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:12.857123    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/08a86ea6-a748-4395-8c19-d3df46a2d855-sys\") pod \"tuned-zqgv4\" (UID: \"08a86ea6-a748-4395-8c19-d3df46a2d855\") " pod="openshift-cluster-node-tuning-operator/tuned-zqgv4"
Jul 15 21:29:12.868701 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:12.857145    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/29df31ab-38b3-4cec-ab5e-013432132c57-serviceca\") pod \"node-ca-9rlc4\" (UID: \"29df31ab-38b3-4cec-ab5e-013432132c57\") " pod="openshift-image-registry/node-ca-9rlc4"
Jul 15 21:29:12.868701 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:12.857166    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/7f43c078-b73a-4760-860b-e7f6e07afdbd-host-kubelet\") pod \"ovnkube-node-bp2vz\" (UID: \"7f43c078-b73a-4760-860b-e7f6e07afdbd\") " pod="openshift-ovn-kubernetes/ovnkube-node-bp2vz"
Jul 15 21:29:12.868701 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:12.857189    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/7f43c078-b73a-4760-860b-e7f6e07afdbd-systemd-units\") pod \"ovnkube-node-bp2vz\" (UID: \"7f43c078-b73a-4760-860b-e7f6e07afdbd\") " pod="openshift-ovn-kubernetes/ovnkube-node-bp2vz"
Jul 15 21:29:12.868701 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:12.857215    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/7f43c078-b73a-4760-860b-e7f6e07afdbd-log-socket\") pod \"ovnkube-node-bp2vz\" (UID: \"7f43c078-b73a-4760-860b-e7f6e07afdbd\") " pod="openshift-ovn-kubernetes/ovnkube-node-bp2vz"
Jul 15 21:29:12.868701 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:12.857244    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/cdc00ed8-331f-4ccc-9d0e-66e123a578eb-system-cni-dir\") pod \"multus-additional-cni-plugins-f2sjs\" (UID: \"cdc00ed8-331f-4ccc-9d0e-66e123a578eb\") " pod="openshift-multus/multus-additional-cni-plugins-f2sjs"
Jul 15 21:29:12.868701 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:12.857273    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qlt6f\" (UniqueName: \"kubernetes.io/projected/cdc00ed8-331f-4ccc-9d0e-66e123a578eb-kube-api-access-qlt6f\") pod \"multus-additional-cni-plugins-f2sjs\" (UID: \"cdc00ed8-331f-4ccc-9d0e-66e123a578eb\") " pod="openshift-multus/multus-additional-cni-plugins-f2sjs"
Jul 15 21:29:12.868701 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:12.857302    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0a247377-2db3-4a4f-9faf-24b8cf6b2688-host-var-lib-cni-bin\") pod \"multus-dnzpf\" (UID: \"0a247377-2db3-4a4f-9faf-24b8cf6b2688\") " pod="openshift-multus/multus-dnzpf"
Jul 15 21:29:12.868701 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:12.857327    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/0a247377-2db3-4a4f-9faf-24b8cf6b2688-hostroot\") pod \"multus-dnzpf\" (UID: \"0a247377-2db3-4a4f-9faf-24b8cf6b2688\") " pod="openshift-multus/multus-dnzpf"
Jul 15 21:29:12.868701 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:12.857354    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0a247377-2db3-4a4f-9faf-24b8cf6b2688-multus-conf-dir\") pod \"multus-dnzpf\" (UID: \"0a247377-2db3-4a4f-9faf-24b8cf6b2688\") " pod="openshift-multus/multus-dnzpf"
Jul 15 21:29:12.872363 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:12.857380    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/f0419a71-4b27-477f-9aad-a068b50d814d-socket-dir\") pod \"aws-ebs-csi-driver-node-7n5gr\" (UID: \"f0419a71-4b27-477f-9aad-a068b50d814d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7n5gr"
Jul 15 21:29:12.872363 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:12.857397    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/cdc00ed8-331f-4ccc-9d0e-66e123a578eb-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-f2sjs\" (UID: \"cdc00ed8-331f-4ccc-9d0e-66e123a578eb\") " pod="openshift-multus/multus-additional-cni-plugins-f2sjs"
Jul 15 21:29:12.872363 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:12.857407    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/f0419a71-4b27-477f-9aad-a068b50d814d-device-dir\") pod \"aws-ebs-csi-driver-node-7n5gr\" (UID: \"f0419a71-4b27-477f-9aad-a068b50d814d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7n5gr"
Jul 15 21:29:12.872363 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:12.857442    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0a247377-2db3-4a4f-9faf-24b8cf6b2688-os-release\") pod \"multus-dnzpf\" (UID: \"0a247377-2db3-4a4f-9faf-24b8cf6b2688\") " pod="openshift-multus/multus-dnzpf"
Jul 15 21:29:12.872363 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:12.857459    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/f0419a71-4b27-477f-9aad-a068b50d814d-device-dir\") pod \"aws-ebs-csi-driver-node-7n5gr\" (UID: \"f0419a71-4b27-477f-9aad-a068b50d814d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7n5gr"
Jul 15 21:29:12.872363 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:12.857467    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0a247377-2db3-4a4f-9faf-24b8cf6b2688-host-var-lib-kubelet\") pod \"multus-dnzpf\" (UID: \"0a247377-2db3-4a4f-9faf-24b8cf6b2688\") " pod="openshift-multus/multus-dnzpf"
Jul 15 21:29:12.872363 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:12.857501    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7f43c078-b73a-4760-860b-e7f6e07afdbd-host-cni-bin\") pod \"ovnkube-node-bp2vz\" (UID: \"7f43c078-b73a-4760-860b-e7f6e07afdbd\") " pod="openshift-ovn-kubernetes/ovnkube-node-bp2vz"
Jul 15 21:29:12.872363 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:12.857510    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0a247377-2db3-4a4f-9faf-24b8cf6b2688-host-var-lib-kubelet\") pod \"multus-dnzpf\" (UID: \"0a247377-2db3-4a4f-9faf-24b8cf6b2688\") " pod="openshift-multus/multus-dnzpf"
Jul 15 21:29:12.872363 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:12.857534    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/7f43c078-b73a-4760-860b-e7f6e07afdbd-ovn-node-metrics-cert\") pod \"ovnkube-node-bp2vz\" (UID: \"7f43c078-b73a-4760-860b-e7f6e07afdbd\") " pod="openshift-ovn-kubernetes/ovnkube-node-bp2vz"
Jul 15 21:29:12.872363 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:12.857560    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/08a86ea6-a748-4395-8c19-d3df46a2d855-etc-sysconfig\") pod \"tuned-zqgv4\" (UID: \"08a86ea6-a748-4395-8c19-d3df46a2d855\") " pod="openshift-cluster-node-tuning-operator/tuned-zqgv4"
Jul 15 21:29:12.872363 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:12.857585    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/08a86ea6-a748-4395-8c19-d3df46a2d855-etc-systemd\") pod \"tuned-zqgv4\" (UID: \"08a86ea6-a748-4395-8c19-d3df46a2d855\") " pod="openshift-cluster-node-tuning-operator/tuned-zqgv4"
Jul 15 21:29:12.872363 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:12.857611    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/0a247377-2db3-4a4f-9faf-24b8cf6b2688-host-var-lib-cni-multus\") pod \"multus-dnzpf\" (UID: \"0a247377-2db3-4a4f-9faf-24b8cf6b2688\") " pod="openshift-multus/multus-dnzpf"
Jul 15 21:29:12.872363 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:12.857637    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/f0419a71-4b27-477f-9aad-a068b50d814d-sys-fs\") pod \"aws-ebs-csi-driver-node-7n5gr\" (UID: \"f0419a71-4b27-477f-9aad-a068b50d814d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7n5gr"
Jul 15 21:29:12.872363 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:12.857696    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/7f43c078-b73a-4760-860b-e7f6e07afdbd-ovnkube-config\") pod \"ovnkube-node-bp2vz\" (UID: \"7f43c078-b73a-4760-860b-e7f6e07afdbd\") " pod="openshift-ovn-kubernetes/ovnkube-node-bp2vz"
Jul 15 21:29:12.872363 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:12.857727    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/cdc00ed8-331f-4ccc-9d0e-66e123a578eb-cnibin\") pod \"multus-additional-cni-plugins-f2sjs\" (UID: \"cdc00ed8-331f-4ccc-9d0e-66e123a578eb\") " pod="openshift-multus/multus-additional-cni-plugins-f2sjs"
Jul 15 21:29:12.872363 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:12.857754    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/08a86ea6-a748-4395-8c19-d3df46a2d855-etc-modprobe-d\") pod \"tuned-zqgv4\" (UID: \"08a86ea6-a748-4395-8c19-d3df46a2d855\") " pod="openshift-cluster-node-tuning-operator/tuned-zqgv4"
Jul 15 21:29:12.872363 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:12.857781    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0a247377-2db3-4a4f-9faf-24b8cf6b2688-cni-binary-copy\") pod \"multus-dnzpf\" (UID: \"0a247377-2db3-4a4f-9faf-24b8cf6b2688\") " pod="openshift-multus/multus-dnzpf"
Jul 15 21:29:12.873498 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:12.857810    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m6kxn\" (UniqueName: \"kubernetes.io/projected/f0419a71-4b27-477f-9aad-a068b50d814d-kube-api-access-m6kxn\") pod \"aws-ebs-csi-driver-node-7n5gr\" (UID: \"f0419a71-4b27-477f-9aad-a068b50d814d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7n5gr"
Jul 15 21:29:12.873498 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:12.857841    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ft8hm\" (UniqueName: \"kubernetes.io/projected/afc0fd53-3c5e-45f9-bf8d-7304a97d7d66-kube-api-access-ft8hm\") pod \"iptables-alerter-9t6s7\" (UID: \"afc0fd53-3c5e-45f9-bf8d-7304a97d7d66\") " pod="openshift-network-operator/iptables-alerter-9t6s7"
Jul 15 21:29:12.873498 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:12.857872    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c4900b8a-d9f9-4926-8c67-62cd4a52ce9b-metrics-certs\") pod \"network-metrics-daemon-6tbzj\" (UID: \"c4900b8a-d9f9-4926-8c67-62cd4a52ce9b\") " pod="openshift-multus/network-metrics-daemon-6tbzj"
Jul 15 21:29:12.873498 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:12.857902    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/70c7abe7-c0b9-49bd-9ab9-a5db9117faa5-kubelet-config\") pod \"global-pull-secret-syncer-sj7lm\" (UID: \"70c7abe7-c0b9-49bd-9ab9-a5db9117faa5\") " pod="kube-system/global-pull-secret-syncer-sj7lm"
Jul 15 21:29:12.873498 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:12.857928    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7f43c078-b73a-4760-860b-e7f6e07afdbd-run-openvswitch\") pod \"ovnkube-node-bp2vz\" (UID: \"7f43c078-b73a-4760-860b-e7f6e07afdbd\") " pod="openshift-ovn-kubernetes/ovnkube-node-bp2vz"
Jul 15 21:29:12.873498 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:12.857944    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/0a247377-2db3-4a4f-9faf-24b8cf6b2688-multus-daemon-config\") pod \"multus-dnzpf\" (UID: \"0a247377-2db3-4a4f-9faf-24b8cf6b2688\") " pod="openshift-multus/multus-dnzpf"
Jul 15 21:29:12.873498 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:12.857955    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pfbsv\" (UniqueName: \"kubernetes.io/projected/29df31ab-38b3-4cec-ab5e-013432132c57-kube-api-access-pfbsv\") pod \"node-ca-9rlc4\" (UID: \"29df31ab-38b3-4cec-ab5e-013432132c57\") " pod="openshift-image-registry/node-ca-9rlc4"
Jul 15 21:29:12.873498 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:12.857985    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7f43c078-b73a-4760-860b-e7f6e07afdbd-host-slash\") pod \"ovnkube-node-bp2vz\" (UID: \"7f43c078-b73a-4760-860b-e7f6e07afdbd\") " pod="openshift-ovn-kubernetes/ovnkube-node-bp2vz"
Jul 15 21:29:12.873498 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:12.858028    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7f43c078-b73a-4760-860b-e7f6e07afdbd-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-bp2vz\" (UID: \"7f43c078-b73a-4760-860b-e7f6e07afdbd\") " pod="openshift-ovn-kubernetes/ovnkube-node-bp2vz"
Jul 15 21:29:12.873498 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:12.858009    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0a247377-2db3-4a4f-9faf-24b8cf6b2688-os-release\") pod \"multus-dnzpf\" (UID: \"0a247377-2db3-4a4f-9faf-24b8cf6b2688\") " pod="openshift-multus/multus-dnzpf"
Jul 15 21:29:12.873498 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:12.858099    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0a247377-2db3-4a4f-9faf-24b8cf6b2688-etc-kubernetes\") pod \"multus-dnzpf\" (UID: \"0a247377-2db3-4a4f-9faf-24b8cf6b2688\") " pod="openshift-multus/multus-dnzpf"
Jul 15 21:29:12.873498 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:12.858137    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/08a86ea6-a748-4395-8c19-d3df46a2d855-etc-sysconfig\") pod \"tuned-zqgv4\" (UID: \"08a86ea6-a748-4395-8c19-d3df46a2d855\") " pod="openshift-cluster-node-tuning-operator/tuned-zqgv4"
Jul 15 21:29:12.873498 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:12.858206    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0a247377-2db3-4a4f-9faf-24b8cf6b2688-multus-conf-dir\") pod \"multus-dnzpf\" (UID: \"0a247377-2db3-4a4f-9faf-24b8cf6b2688\") " pod="openshift-multus/multus-dnzpf"
Jul 15 21:29:12.873498 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:12.858237    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/08a86ea6-a748-4395-8c19-d3df46a2d855-etc-systemd\") pod \"tuned-zqgv4\" (UID: \"08a86ea6-a748-4395-8c19-d3df46a2d855\") " pod="openshift-cluster-node-tuning-operator/tuned-zqgv4"
Jul 15 21:29:12.873498 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:12.858239    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/0a247377-2db3-4a4f-9faf-24b8cf6b2688-hostroot\") pod \"multus-dnzpf\" (UID: \"0a247377-2db3-4a4f-9faf-24b8cf6b2688\") " pod="openshift-multus/multus-dnzpf"
Jul 15 21:29:12.873498 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:12.858245    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/cdc00ed8-331f-4ccc-9d0e-66e123a578eb-system-cni-dir\") pod \"multus-additional-cni-plugins-f2sjs\" (UID: \"cdc00ed8-331f-4ccc-9d0e-66e123a578eb\") " pod="openshift-multus/multus-additional-cni-plugins-f2sjs"
Jul 15 21:29:12.873498 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:12.858270    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/08a86ea6-a748-4395-8c19-d3df46a2d855-sys\") pod \"tuned-zqgv4\" (UID: \"08a86ea6-a748-4395-8c19-d3df46a2d855\") " pod="openshift-cluster-node-tuning-operator/tuned-zqgv4"
Jul 15 21:29:12.874386 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:12.858291    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/f0419a71-4b27-477f-9aad-a068b50d814d-sys-fs\") pod \"aws-ebs-csi-driver-node-7n5gr\" (UID: \"f0419a71-4b27-477f-9aad-a068b50d814d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7n5gr"
Jul 15 21:29:12.874386 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:12.858298    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0a247377-2db3-4a4f-9faf-24b8cf6b2688-host-var-lib-cni-bin\") pod \"multus-dnzpf\" (UID: \"0a247377-2db3-4a4f-9faf-24b8cf6b2688\") " pod="openshift-multus/multus-dnzpf"
Jul 15 21:29:12.874386 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:12.858331    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/0a247377-2db3-4a4f-9faf-24b8cf6b2688-host-var-lib-cni-multus\") pod \"multus-dnzpf\" (UID: \"0a247377-2db3-4a4f-9faf-24b8cf6b2688\") " pod="openshift-multus/multus-dnzpf"
Jul 15 21:29:12.874386 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:12.858348    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/08a86ea6-a748-4395-8c19-d3df46a2d855-etc-modprobe-d\") pod \"tuned-zqgv4\" (UID: \"08a86ea6-a748-4395-8c19-d3df46a2d855\") " pod="openshift-cluster-node-tuning-operator/tuned-zqgv4"
Jul 15 21:29:12.874386 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:12.858387    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/cdc00ed8-331f-4ccc-9d0e-66e123a578eb-cnibin\") pod \"multus-additional-cni-plugins-f2sjs\" (UID: \"cdc00ed8-331f-4ccc-9d0e-66e123a578eb\") " pod="openshift-multus/multus-additional-cni-plugins-f2sjs"
Jul 15 21:29:12.874386 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:12.858713    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/f0419a71-4b27-477f-9aad-a068b50d814d-socket-dir\") pod \"aws-ebs-csi-driver-node-7n5gr\" (UID: \"f0419a71-4b27-477f-9aad-a068b50d814d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7n5gr"
Jul 15 21:29:12.874386 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:12.858900    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0a247377-2db3-4a4f-9faf-24b8cf6b2688-cni-binary-copy\") pod \"multus-dnzpf\" (UID: \"0a247377-2db3-4a4f-9faf-24b8cf6b2688\") " pod="openshift-multus/multus-dnzpf"
Jul 15 21:29:12.874386 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:12.859276    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/08a86ea6-a748-4395-8c19-d3df46a2d855-tmp\") pod \"tuned-zqgv4\" (UID: \"08a86ea6-a748-4395-8c19-d3df46a2d855\") " pod="openshift-cluster-node-tuning-operator/tuned-zqgv4"
Jul 15 21:29:12.874386 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:12.859328    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/08a86ea6-a748-4395-8c19-d3df46a2d855-etc-tuned\") pod \"tuned-zqgv4\" (UID: \"08a86ea6-a748-4395-8c19-d3df46a2d855\") " pod="openshift-cluster-node-tuning-operator/tuned-zqgv4"
Jul 15 21:29:12.874386 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:12.862519    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/6e450c81-34e8-4ad5-9939-56804ad78f86-agent-certs\") pod \"konnectivity-agent-rz4r6\" (UID: \"6e450c81-34e8-4ad5-9939-56804ad78f86\") " pod="kube-system/konnectivity-agent-rz4r6"
Jul 15 21:29:12.874386 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:12.863191    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ljpbj\" (UniqueName: \"kubernetes.io/projected/08a86ea6-a748-4395-8c19-d3df46a2d855-kube-api-access-ljpbj\") pod \"tuned-zqgv4\" (UID: \"08a86ea6-a748-4395-8c19-d3df46a2d855\") " pod="openshift-cluster-node-tuning-operator/tuned-zqgv4"
Jul 15 21:29:12.874386 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:12.863900    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n587x\" (UniqueName: \"kubernetes.io/projected/0a247377-2db3-4a4f-9faf-24b8cf6b2688-kube-api-access-n587x\") pod \"multus-dnzpf\" (UID: \"0a247377-2db3-4a4f-9faf-24b8cf6b2688\") " pod="openshift-multus/multus-dnzpf"
Jul 15 21:29:12.874386 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:12.863914    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zm5db\" (UniqueName: \"kubernetes.io/projected/a8599815-6b89-4248-99de-f4a3ee849bf0-kube-api-access-zm5db\") pod \"node-resolver-tlrgr\" (UID: \"a8599815-6b89-4248-99de-f4a3ee849bf0\") " pod="openshift-dns/node-resolver-tlrgr"
Jul 15 21:29:12.874386 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:12.869200    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m6kxn\" (UniqueName: \"kubernetes.io/projected/f0419a71-4b27-477f-9aad-a068b50d814d-kube-api-access-m6kxn\") pod \"aws-ebs-csi-driver-node-7n5gr\" (UID: \"f0419a71-4b27-477f-9aad-a068b50d814d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7n5gr"
Jul 15 21:29:12.874386 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:12.869262    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qlt6f\" (UniqueName: \"kubernetes.io/projected/cdc00ed8-331f-4ccc-9d0e-66e123a578eb-kube-api-access-qlt6f\") pod \"multus-additional-cni-plugins-f2sjs\" (UID: \"cdc00ed8-331f-4ccc-9d0e-66e123a578eb\") " pod="openshift-multus/multus-additional-cni-plugins-f2sjs"
Jul 15 21:29:13.009560 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:12.961364    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7f43c078-b73a-4760-860b-e7f6e07afdbd-host-slash\") pod \"ovnkube-node-bp2vz\" (UID: \"7f43c078-b73a-4760-860b-e7f6e07afdbd\") " pod="openshift-ovn-kubernetes/ovnkube-node-bp2vz"
Jul 15 21:29:13.009560 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:12.961392    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7f43c078-b73a-4760-860b-e7f6e07afdbd-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-bp2vz\" (UID: \"7f43c078-b73a-4760-860b-e7f6e07afdbd\") " pod="openshift-ovn-kubernetes/ovnkube-node-bp2vz"
Jul 15 21:29:13.009560 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:12.961412    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/afc0fd53-3c5e-45f9-bf8d-7304a97d7d66-host-slash\") pod \"iptables-alerter-9t6s7\" (UID: \"afc0fd53-3c5e-45f9-bf8d-7304a97d7d66\") " pod="openshift-network-operator/iptables-alerter-9t6s7"
Jul 15 21:29:13.009560 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:12.961430    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7f43c078-b73a-4760-860b-e7f6e07afdbd-etc-openvswitch\") pod \"ovnkube-node-bp2vz\" (UID: \"7f43c078-b73a-4760-860b-e7f6e07afdbd\") " pod="openshift-ovn-kubernetes/ovnkube-node-bp2vz"
Jul 15 21:29:13.009560 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:12.961479    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/afc0fd53-3c5e-45f9-bf8d-7304a97d7d66-host-slash\") pod \"iptables-alerter-9t6s7\" (UID: \"afc0fd53-3c5e-45f9-bf8d-7304a97d7d66\") " pod="openshift-network-operator/iptables-alerter-9t6s7"
Jul 15 21:29:13.009560 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:12.961486    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7f43c078-b73a-4760-860b-e7f6e07afdbd-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-bp2vz\" (UID: \"7f43c078-b73a-4760-860b-e7f6e07afdbd\") " pod="openshift-ovn-kubernetes/ovnkube-node-bp2vz"
Jul 15 21:29:13.009560 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:12.961494    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7f43c078-b73a-4760-860b-e7f6e07afdbd-host-slash\") pod \"ovnkube-node-bp2vz\" (UID: \"7f43c078-b73a-4760-860b-e7f6e07afdbd\") " pod="openshift-ovn-kubernetes/ovnkube-node-bp2vz"
Jul 15 21:29:13.009560 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:12.961522    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7f43c078-b73a-4760-860b-e7f6e07afdbd-etc-openvswitch\") pod \"ovnkube-node-bp2vz\" (UID: \"7f43c078-b73a-4760-860b-e7f6e07afdbd\") " pod="openshift-ovn-kubernetes/ovnkube-node-bp2vz"
Jul 15 21:29:13.009560 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:12.961484    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/7f43c078-b73a-4760-860b-e7f6e07afdbd-ovnkube-script-lib\") pod \"ovnkube-node-bp2vz\" (UID: \"7f43c078-b73a-4760-860b-e7f6e07afdbd\") " pod="openshift-ovn-kubernetes/ovnkube-node-bp2vz"
Jul 15 21:29:13.009560 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:12.961564    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tc26f\" (UniqueName: \"kubernetes.io/projected/c4900b8a-d9f9-4926-8c67-62cd4a52ce9b-kube-api-access-tc26f\") pod \"network-metrics-daemon-6tbzj\" (UID: \"c4900b8a-d9f9-4926-8c67-62cd4a52ce9b\") " pod="openshift-multus/network-metrics-daemon-6tbzj"
Jul 15 21:29:13.009560 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:12.961587    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/7f43c078-b73a-4760-860b-e7f6e07afdbd-run-systemd\") pod \"ovnkube-node-bp2vz\" (UID: \"7f43c078-b73a-4760-860b-e7f6e07afdbd\") " pod="openshift-ovn-kubernetes/ovnkube-node-bp2vz"
Jul 15 21:29:13.009560 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:12.961618    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d27m5\" (UniqueName: \"kubernetes.io/projected/50904bfc-f028-4def-b159-b24669cfde16-kube-api-access-d27m5\") pod \"network-check-target-dw6kh\" (UID: \"50904bfc-f028-4def-b159-b24669cfde16\") " pod="openshift-network-diagnostics/network-check-target-dw6kh"
Jul 15 21:29:13.009560 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:12.961643    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5r6ws\" (UniqueName: \"kubernetes.io/projected/7f43c078-b73a-4760-860b-e7f6e07afdbd-kube-api-access-5r6ws\") pod \"ovnkube-node-bp2vz\" (UID: \"7f43c078-b73a-4760-860b-e7f6e07afdbd\") " pod="openshift-ovn-kubernetes/ovnkube-node-bp2vz"
Jul 15 21:29:13.009560 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:12.961671    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/afc0fd53-3c5e-45f9-bf8d-7304a97d7d66-iptables-alerter-script\") pod \"iptables-alerter-9t6s7\" (UID: \"afc0fd53-3c5e-45f9-bf8d-7304a97d7d66\") " pod="openshift-network-operator/iptables-alerter-9t6s7"
Jul 15 21:29:13.009560 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:12.961676    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/7f43c078-b73a-4760-860b-e7f6e07afdbd-run-systemd\") pod \"ovnkube-node-bp2vz\" (UID: \"7f43c078-b73a-4760-860b-e7f6e07afdbd\") " pod="openshift-ovn-kubernetes/ovnkube-node-bp2vz"
Jul 15 21:29:13.009560 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:12.961711    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7f43c078-b73a-4760-860b-e7f6e07afdbd-var-lib-openvswitch\") pod \"ovnkube-node-bp2vz\" (UID: \"7f43c078-b73a-4760-860b-e7f6e07afdbd\") " pod="openshift-ovn-kubernetes/ovnkube-node-bp2vz"
Jul 15 21:29:13.009560 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:12.961743    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/29df31ab-38b3-4cec-ab5e-013432132c57-host\") pod \"node-ca-9rlc4\" (UID: \"29df31ab-38b3-4cec-ab5e-013432132c57\") " pod="openshift-image-registry/node-ca-9rlc4"
Jul 15 21:29:13.010396 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:12.961767    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/70c7abe7-c0b9-49bd-9ab9-a5db9117faa5-original-pull-secret\") pod \"global-pull-secret-syncer-sj7lm\" (UID: \"70c7abe7-c0b9-49bd-9ab9-a5db9117faa5\") " pod="kube-system/global-pull-secret-syncer-sj7lm"
Jul 15 21:29:13.010396 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:12.961795    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/70c7abe7-c0b9-49bd-9ab9-a5db9117faa5-dbus\") pod \"global-pull-secret-syncer-sj7lm\" (UID: \"70c7abe7-c0b9-49bd-9ab9-a5db9117faa5\") " pod="kube-system/global-pull-secret-syncer-sj7lm"
Jul 15 21:29:13.010396 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:12.961822    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7f43c078-b73a-4760-860b-e7f6e07afdbd-host-run-netns\") pod \"ovnkube-node-bp2vz\" (UID: \"7f43c078-b73a-4760-860b-e7f6e07afdbd\") " pod="openshift-ovn-kubernetes/ovnkube-node-bp2vz"
Jul 15 21:29:13.010396 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:12.961848    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/7f43c078-b73a-4760-860b-e7f6e07afdbd-run-ovn\") pod \"ovnkube-node-bp2vz\" (UID: \"7f43c078-b73a-4760-860b-e7f6e07afdbd\") " pod="openshift-ovn-kubernetes/ovnkube-node-bp2vz"
Jul 15 21:29:13.010396 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:12.961853    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7f43c078-b73a-4760-860b-e7f6e07afdbd-var-lib-openvswitch\") pod \"ovnkube-node-bp2vz\" (UID: \"7f43c078-b73a-4760-860b-e7f6e07afdbd\") " pod="openshift-ovn-kubernetes/ovnkube-node-bp2vz"
Jul 15 21:29:13.010396 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:12.961852    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/29df31ab-38b3-4cec-ab5e-013432132c57-host\") pod \"node-ca-9rlc4\" (UID: \"29df31ab-38b3-4cec-ab5e-013432132c57\") " pod="openshift-image-registry/node-ca-9rlc4"
Jul 15 21:29:13.010396 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:12.961874    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/7f43c078-b73a-4760-860b-e7f6e07afdbd-env-overrides\") pod \"ovnkube-node-bp2vz\" (UID: \"7f43c078-b73a-4760-860b-e7f6e07afdbd\") " pod="openshift-ovn-kubernetes/ovnkube-node-bp2vz"
Jul 15 21:29:13.010396 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:12.961903    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/7f43c078-b73a-4760-860b-e7f6e07afdbd-node-log\") pod \"ovnkube-node-bp2vz\" (UID: \"7f43c078-b73a-4760-860b-e7f6e07afdbd\") " pod="openshift-ovn-kubernetes/ovnkube-node-bp2vz"
Jul 15 21:29:13.010396 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:12.961919    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7f43c078-b73a-4760-860b-e7f6e07afdbd-host-run-netns\") pod \"ovnkube-node-bp2vz\" (UID: \"7f43c078-b73a-4760-860b-e7f6e07afdbd\") " pod="openshift-ovn-kubernetes/ovnkube-node-bp2vz"
Jul 15 21:29:13.010396 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:12.961929    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7f43c078-b73a-4760-860b-e7f6e07afdbd-host-run-ovn-kubernetes\") pod \"ovnkube-node-bp2vz\" (UID: \"7f43c078-b73a-4760-860b-e7f6e07afdbd\") " pod="openshift-ovn-kubernetes/ovnkube-node-bp2vz"
Jul 15 21:29:13.010396 ip-10-0-130-217 kubenswrapper[2563]: E0715 21:29:12.961941    2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 15 21:29:13.010396 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:12.961955    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/7f43c078-b73a-4760-860b-e7f6e07afdbd-host-cni-netd\") pod \"ovnkube-node-bp2vz\" (UID: \"7f43c078-b73a-4760-860b-e7f6e07afdbd\") " pod="openshift-ovn-kubernetes/ovnkube-node-bp2vz"
Jul 15 21:29:13.010396 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:12.962039    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/70c7abe7-c0b9-49bd-9ab9-a5db9117faa5-dbus\") pod \"global-pull-secret-syncer-sj7lm\" (UID: \"70c7abe7-c0b9-49bd-9ab9-a5db9117faa5\") " pod="kube-system/global-pull-secret-syncer-sj7lm"
Jul 15 21:29:13.010396 ip-10-0-130-217 kubenswrapper[2563]: E0715 21:29:12.962056    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/70c7abe7-c0b9-49bd-9ab9-a5db9117faa5-original-pull-secret podName:70c7abe7-c0b9-49bd-9ab9-a5db9117faa5 nodeName:}" failed. No retries permitted until 2026-07-15 21:29:13.462012805 +0000 UTC m=+3.155940352 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/70c7abe7-c0b9-49bd-9ab9-a5db9117faa5-original-pull-secret") pod "global-pull-secret-syncer-sj7lm" (UID: "70c7abe7-c0b9-49bd-9ab9-a5db9117faa5") : object "kube-system"/"original-pull-secret" not registered
Jul 15 21:29:13.010396 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:12.962081    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/29df31ab-38b3-4cec-ab5e-013432132c57-serviceca\") pod \"node-ca-9rlc4\" (UID: \"29df31ab-38b3-4cec-ab5e-013432132c57\") " pod="openshift-image-registry/node-ca-9rlc4"
Jul 15 21:29:13.010396 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:12.962088    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/7f43c078-b73a-4760-860b-e7f6e07afdbd-node-log\") pod \"ovnkube-node-bp2vz\" (UID: \"7f43c078-b73a-4760-860b-e7f6e07afdbd\") " pod="openshift-ovn-kubernetes/ovnkube-node-bp2vz"
Jul 15 21:29:13.010396 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:12.962113    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/7f43c078-b73a-4760-860b-e7f6e07afdbd-host-kubelet\") pod \"ovnkube-node-bp2vz\" (UID: \"7f43c078-b73a-4760-860b-e7f6e07afdbd\") " pod="openshift-ovn-kubernetes/ovnkube-node-bp2vz"
Jul 15 21:29:13.011555 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:12.962138    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7f43c078-b73a-4760-860b-e7f6e07afdbd-host-run-ovn-kubernetes\") pod \"ovnkube-node-bp2vz\" (UID: \"7f43c078-b73a-4760-860b-e7f6e07afdbd\") " pod="openshift-ovn-kubernetes/ovnkube-node-bp2vz"
Jul 15 21:29:13.011555 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:12.962140    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/7f43c078-b73a-4760-860b-e7f6e07afdbd-systemd-units\") pod \"ovnkube-node-bp2vz\" (UID: \"7f43c078-b73a-4760-860b-e7f6e07afdbd\") " pod="openshift-ovn-kubernetes/ovnkube-node-bp2vz"
Jul 15 21:29:13.011555 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:12.962176    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/7f43c078-b73a-4760-860b-e7f6e07afdbd-log-socket\") pod \"ovnkube-node-bp2vz\" (UID: \"7f43c078-b73a-4760-860b-e7f6e07afdbd\") " pod="openshift-ovn-kubernetes/ovnkube-node-bp2vz"
Jul 15 21:29:13.011555 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:12.962179    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/7f43c078-b73a-4760-860b-e7f6e07afdbd-systemd-units\") pod \"ovnkube-node-bp2vz\" (UID: \"7f43c078-b73a-4760-860b-e7f6e07afdbd\") " pod="openshift-ovn-kubernetes/ovnkube-node-bp2vz"
Jul 15 21:29:13.011555 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:12.962214    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/7f43c078-b73a-4760-860b-e7f6e07afdbd-ovnkube-script-lib\") pod \"ovnkube-node-bp2vz\" (UID: \"7f43c078-b73a-4760-860b-e7f6e07afdbd\") " pod="openshift-ovn-kubernetes/ovnkube-node-bp2vz"
Jul 15 21:29:13.011555 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:12.962220    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7f43c078-b73a-4760-860b-e7f6e07afdbd-host-cni-bin\") pod \"ovnkube-node-bp2vz\" (UID: \"7f43c078-b73a-4760-860b-e7f6e07afdbd\") " pod="openshift-ovn-kubernetes/ovnkube-node-bp2vz"
Jul 15 21:29:13.011555 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:12.962216    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/7f43c078-b73a-4760-860b-e7f6e07afdbd-log-socket\") pod \"ovnkube-node-bp2vz\" (UID: \"7f43c078-b73a-4760-860b-e7f6e07afdbd\") " pod="openshift-ovn-kubernetes/ovnkube-node-bp2vz"
Jul 15 21:29:13.011555 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:12.962053    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/7f43c078-b73a-4760-860b-e7f6e07afdbd-host-cni-netd\") pod \"ovnkube-node-bp2vz\" (UID: \"7f43c078-b73a-4760-860b-e7f6e07afdbd\") " pod="openshift-ovn-kubernetes/ovnkube-node-bp2vz"
Jul 15 21:29:13.011555 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:12.962250    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/7f43c078-b73a-4760-860b-e7f6e07afdbd-run-ovn\") pod \"ovnkube-node-bp2vz\" (UID: \"7f43c078-b73a-4760-860b-e7f6e07afdbd\") " pod="openshift-ovn-kubernetes/ovnkube-node-bp2vz"
Jul 15 21:29:13.011555 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:12.962265    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7f43c078-b73a-4760-860b-e7f6e07afdbd-host-cni-bin\") pod \"ovnkube-node-bp2vz\" (UID: \"7f43c078-b73a-4760-860b-e7f6e07afdbd\") " pod="openshift-ovn-kubernetes/ovnkube-node-bp2vz"
Jul 15 21:29:13.011555 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:12.962284    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/7f43c078-b73a-4760-860b-e7f6e07afdbd-host-kubelet\") pod \"ovnkube-node-bp2vz\" (UID: \"7f43c078-b73a-4760-860b-e7f6e07afdbd\") " pod="openshift-ovn-kubernetes/ovnkube-node-bp2vz"
Jul 15 21:29:13.011555 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:12.962311    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/7f43c078-b73a-4760-860b-e7f6e07afdbd-ovn-node-metrics-cert\") pod \"ovnkube-node-bp2vz\" (UID: \"7f43c078-b73a-4760-860b-e7f6e07afdbd\") " pod="openshift-ovn-kubernetes/ovnkube-node-bp2vz"
Jul 15 21:29:13.011555 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:12.962342    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/7f43c078-b73a-4760-860b-e7f6e07afdbd-ovnkube-config\") pod \"ovnkube-node-bp2vz\" (UID: \"7f43c078-b73a-4760-860b-e7f6e07afdbd\") " pod="openshift-ovn-kubernetes/ovnkube-node-bp2vz"
Jul 15 21:29:13.011555 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:12.962377    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ft8hm\" (UniqueName: \"kubernetes.io/projected/afc0fd53-3c5e-45f9-bf8d-7304a97d7d66-kube-api-access-ft8hm\") pod \"iptables-alerter-9t6s7\" (UID: \"afc0fd53-3c5e-45f9-bf8d-7304a97d7d66\") " pod="openshift-network-operator/iptables-alerter-9t6s7"
Jul 15 21:29:13.011555 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:12.962403    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c4900b8a-d9f9-4926-8c67-62cd4a52ce9b-metrics-certs\") pod \"network-metrics-daemon-6tbzj\" (UID: \"c4900b8a-d9f9-4926-8c67-62cd4a52ce9b\") " pod="openshift-multus/network-metrics-daemon-6tbzj"
Jul 15 21:29:13.011555 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:12.962428    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/70c7abe7-c0b9-49bd-9ab9-a5db9117faa5-kubelet-config\") pod \"global-pull-secret-syncer-sj7lm\" (UID: \"70c7abe7-c0b9-49bd-9ab9-a5db9117faa5\") " pod="kube-system/global-pull-secret-syncer-sj7lm"
Jul 15 21:29:13.011555 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:12.962455    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7f43c078-b73a-4760-860b-e7f6e07afdbd-run-openvswitch\") pod \"ovnkube-node-bp2vz\" (UID: \"7f43c078-b73a-4760-860b-e7f6e07afdbd\") " pod="openshift-ovn-kubernetes/ovnkube-node-bp2vz"
Jul 15 21:29:13.012438 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:12.962486    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pfbsv\" (UniqueName: \"kubernetes.io/projected/29df31ab-38b3-4cec-ab5e-013432132c57-kube-api-access-pfbsv\") pod \"node-ca-9rlc4\" (UID: \"29df31ab-38b3-4cec-ab5e-013432132c57\") " pod="openshift-image-registry/node-ca-9rlc4"
Jul 15 21:29:13.012438 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:12.962510    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/afc0fd53-3c5e-45f9-bf8d-7304a97d7d66-iptables-alerter-script\") pod \"iptables-alerter-9t6s7\" (UID: \"afc0fd53-3c5e-45f9-bf8d-7304a97d7d66\") " pod="openshift-network-operator/iptables-alerter-9t6s7"
Jul 15 21:29:13.012438 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:12.962590    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/70c7abe7-c0b9-49bd-9ab9-a5db9117faa5-kubelet-config\") pod \"global-pull-secret-syncer-sj7lm\" (UID: \"70c7abe7-c0b9-49bd-9ab9-a5db9117faa5\") " pod="kube-system/global-pull-secret-syncer-sj7lm"
Jul 15 21:29:13.012438 ip-10-0-130-217 kubenswrapper[2563]: E0715 21:29:12.962597    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 21:29:13.012438 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:12.962635    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/7f43c078-b73a-4760-860b-e7f6e07afdbd-env-overrides\") pod \"ovnkube-node-bp2vz\" (UID: \"7f43c078-b73a-4760-860b-e7f6e07afdbd\") " pod="openshift-ovn-kubernetes/ovnkube-node-bp2vz"
Jul 15 21:29:13.012438 ip-10-0-130-217 kubenswrapper[2563]: E0715 21:29:12.962654    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c4900b8a-d9f9-4926-8c67-62cd4a52ce9b-metrics-certs podName:c4900b8a-d9f9-4926-8c67-62cd4a52ce9b nodeName:}" failed. No retries permitted until 2026-07-15 21:29:13.462638318 +0000 UTC m=+3.156565861 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c4900b8a-d9f9-4926-8c67-62cd4a52ce9b-metrics-certs") pod "network-metrics-daemon-6tbzj" (UID: "c4900b8a-d9f9-4926-8c67-62cd4a52ce9b") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 21:29:13.012438 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:12.962637    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7f43c078-b73a-4760-860b-e7f6e07afdbd-run-openvswitch\") pod \"ovnkube-node-bp2vz\" (UID: \"7f43c078-b73a-4760-860b-e7f6e07afdbd\") " pod="openshift-ovn-kubernetes/ovnkube-node-bp2vz"
Jul 15 21:29:13.012438 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:12.962801    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/29df31ab-38b3-4cec-ab5e-013432132c57-serviceca\") pod \"node-ca-9rlc4\" (UID: \"29df31ab-38b3-4cec-ab5e-013432132c57\") " pod="openshift-image-registry/node-ca-9rlc4"
Jul 15 21:29:13.012438 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:12.963201    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/7f43c078-b73a-4760-860b-e7f6e07afdbd-ovnkube-config\") pod \"ovnkube-node-bp2vz\" (UID: \"7f43c078-b73a-4760-860b-e7f6e07afdbd\") " pod="openshift-ovn-kubernetes/ovnkube-node-bp2vz"
Jul 15 21:29:13.012438 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:12.965109    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/7f43c078-b73a-4760-860b-e7f6e07afdbd-ovn-node-metrics-cert\") pod \"ovnkube-node-bp2vz\" (UID: \"7f43c078-b73a-4760-860b-e7f6e07afdbd\") " pod="openshift-ovn-kubernetes/ovnkube-node-bp2vz"
Jul 15 21:29:13.012438 ip-10-0-130-217 kubenswrapper[2563]: E0715 21:29:12.968473    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 15 21:29:13.012438 ip-10-0-130-217 kubenswrapper[2563]: E0715 21:29:12.968495    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 15 21:29:13.012438 ip-10-0-130-217 kubenswrapper[2563]: E0715 21:29:12.968509    2563 projected.go:196] Error preparing data for projected volume kube-api-access-d27m5 for pod openshift-network-diagnostics/network-check-target-dw6kh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 21:29:13.012438 ip-10-0-130-217 kubenswrapper[2563]: E0715 21:29:12.968580    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/50904bfc-f028-4def-b159-b24669cfde16-kube-api-access-d27m5 podName:50904bfc-f028-4def-b159-b24669cfde16 nodeName:}" failed. No retries permitted until 2026-07-15 21:29:13.468561977 +0000 UTC m=+3.162489522 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-d27m5" (UniqueName: "kubernetes.io/projected/50904bfc-f028-4def-b159-b24669cfde16-kube-api-access-d27m5") pod "network-check-target-dw6kh" (UID: "50904bfc-f028-4def-b159-b24669cfde16") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 21:29:13.012438 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:12.969633    2563 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 15 21:29:13.012438 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:12.971384    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5r6ws\" (UniqueName: \"kubernetes.io/projected/7f43c078-b73a-4760-860b-e7f6e07afdbd-kube-api-access-5r6ws\") pod \"ovnkube-node-bp2vz\" (UID: \"7f43c078-b73a-4760-860b-e7f6e07afdbd\") " pod="openshift-ovn-kubernetes/ovnkube-node-bp2vz"
Jul 15 21:29:13.012438 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:12.971435    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tc26f\" (UniqueName: \"kubernetes.io/projected/c4900b8a-d9f9-4926-8c67-62cd4a52ce9b-kube-api-access-tc26f\") pod \"network-metrics-daemon-6tbzj\" (UID: \"c4900b8a-d9f9-4926-8c67-62cd4a52ce9b\") " pod="openshift-multus/network-metrics-daemon-6tbzj"
Jul 15 21:29:13.013120 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:12.971706    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ft8hm\" (UniqueName: \"kubernetes.io/projected/afc0fd53-3c5e-45f9-bf8d-7304a97d7d66-kube-api-access-ft8hm\") pod \"iptables-alerter-9t6s7\" (UID: \"afc0fd53-3c5e-45f9-bf8d-7304a97d7d66\") " pod="openshift-network-operator/iptables-alerter-9t6s7"
Jul 15 21:29:13.013120 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:12.971882    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pfbsv\" (UniqueName: \"kubernetes.io/projected/29df31ab-38b3-4cec-ab5e-013432132c57-kube-api-access-pfbsv\") pod \"node-ca-9rlc4\" (UID: \"29df31ab-38b3-4cec-ab5e-013432132c57\") " pod="openshift-image-registry/node-ca-9rlc4"
Jul 15 21:29:13.013120 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:12.989014    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-217.ec2.internal" event={"ID":"cdab13ce73e8fa92312341fdcfe1f88a","Type":"ContainerStarted","Data":"06cea2f0db8bc948a07ad0e20b34f543e7e848131c86cbecda1db207657d16a3"}
Jul 15 21:29:13.013120 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:12.990585    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-217.ec2.internal" event={"ID":"2041a50860cbd204c2d9aa835bb65766","Type":"ContainerStarted","Data":"d67cf62c106ddc01a952ffd717d9fbd62a0d446d5236373ec15499afd47d539f"}
Jul 15 21:29:13.110275 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:13.054557    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7n5gr"
Jul 15 21:29:13.110275 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:13.064005    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-tlrgr"
Jul 15 21:29:13.110275 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:13.072821    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-rz4r6"
Jul 15 21:29:13.110275 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:13.077550    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-f2sjs"
Jul 15 21:29:13.110275 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:13.087539    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-zqgv4"
Jul 15 21:29:13.110275 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:13.094874    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-dnzpf"
Jul 15 21:29:13.110275 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:13.101840    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-bp2vz"
Jul 15 21:29:13.262390 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:13.181590    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-9t6s7"
Jul 15 21:29:13.262390 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:13.201099    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-9rlc4"
Jul 15 21:29:13.504008 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:13.466008    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/70c7abe7-c0b9-49bd-9ab9-a5db9117faa5-original-pull-secret\") pod \"global-pull-secret-syncer-sj7lm\" (UID: \"70c7abe7-c0b9-49bd-9ab9-a5db9117faa5\") " pod="kube-system/global-pull-secret-syncer-sj7lm"
Jul 15 21:29:13.504008 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:13.466089    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c4900b8a-d9f9-4926-8c67-62cd4a52ce9b-metrics-certs\") pod \"network-metrics-daemon-6tbzj\" (UID: \"c4900b8a-d9f9-4926-8c67-62cd4a52ce9b\") " pod="openshift-multus/network-metrics-daemon-6tbzj"
Jul 15 21:29:13.504008 ip-10-0-130-217 kubenswrapper[2563]: E0715 21:29:13.466149    2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 15 21:29:13.504008 ip-10-0-130-217 kubenswrapper[2563]: E0715 21:29:13.466227    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 21:29:13.504008 ip-10-0-130-217 kubenswrapper[2563]: E0715 21:29:13.466236    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/70c7abe7-c0b9-49bd-9ab9-a5db9117faa5-original-pull-secret podName:70c7abe7-c0b9-49bd-9ab9-a5db9117faa5 nodeName:}" failed. No retries permitted until 2026-07-15 21:29:14.466215591 +0000 UTC m=+4.160143146 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/70c7abe7-c0b9-49bd-9ab9-a5db9117faa5-original-pull-secret") pod "global-pull-secret-syncer-sj7lm" (UID: "70c7abe7-c0b9-49bd-9ab9-a5db9117faa5") : object "kube-system"/"original-pull-secret" not registered
Jul 15 21:29:13.504008 ip-10-0-130-217 kubenswrapper[2563]: E0715 21:29:13.466280    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c4900b8a-d9f9-4926-8c67-62cd4a52ce9b-metrics-certs podName:c4900b8a-d9f9-4926-8c67-62cd4a52ce9b nodeName:}" failed. No retries permitted until 2026-07-15 21:29:14.466263716 +0000 UTC m=+4.160191265 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c4900b8a-d9f9-4926-8c67-62cd4a52ce9b-metrics-certs") pod "network-metrics-daemon-6tbzj" (UID: "c4900b8a-d9f9-4926-8c67-62cd4a52ce9b") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 21:29:13.504008 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:13.468691    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0a247377_2db3_4a4f_9faf_24b8cf6b2688.slice/crio-a06b3ff6c8bcf7c57fec4b26aac0008b5eb9b61a7a25a6234003d4362400f91d WatchSource:0}: Error finding container a06b3ff6c8bcf7c57fec4b26aac0008b5eb9b61a7a25a6234003d4362400f91d: Status 404 returned error can't find the container with id a06b3ff6c8bcf7c57fec4b26aac0008b5eb9b61a7a25a6234003d4362400f91d
Jul 15 21:29:13.504008 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:13.472616    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf0419a71_4b27_477f_9aad_a068b50d814d.slice/crio-f3cc5070b103fd8c7998317c81ffac8ce7b18fc76a98d8449502387a514fd3ee WatchSource:0}: Error finding container f3cc5070b103fd8c7998317c81ffac8ce7b18fc76a98d8449502387a514fd3ee: Status 404 returned error can't find the container with id f3cc5070b103fd8c7998317c81ffac8ce7b18fc76a98d8449502387a514fd3ee
Jul 15 21:29:13.504008 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:13.473961    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podafc0fd53_3c5e_45f9_bf8d_7304a97d7d66.slice/crio-0e8992838a746f5187c684d3768eab58ca8a1545d6c8557ced6bbd2ca12c8f0e WatchSource:0}: Error finding container 0e8992838a746f5187c684d3768eab58ca8a1545d6c8557ced6bbd2ca12c8f0e: Status 404 returned error can't find the container with id 0e8992838a746f5187c684d3768eab58ca8a1545d6c8557ced6bbd2ca12c8f0e
Jul 15 21:29:13.504008 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:13.498656    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod08a86ea6_a748_4395_8c19_d3df46a2d855.slice/crio-1c1f4533bd66220ab4108d655b460b5775d17415cfbf9d8f803f77281469c0fd WatchSource:0}: Error finding container 1c1f4533bd66220ab4108d655b460b5775d17415cfbf9d8f803f77281469c0fd: Status 404 returned error can't find the container with id 1c1f4533bd66220ab4108d655b460b5775d17415cfbf9d8f803f77281469c0fd
Jul 15 21:29:13.504008 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:13.500247    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcdc00ed8_331f_4ccc_9d0e_66e123a578eb.slice/crio-77889321887c9b4a559f0f4f37253da803d2292941a947fe674b1eecdd61fc14 WatchSource:0}: Error finding container 77889321887c9b4a559f0f4f37253da803d2292941a947fe674b1eecdd61fc14: Status 404 returned error can't find the container with id 77889321887c9b4a559f0f4f37253da803d2292941a947fe674b1eecdd61fc14
Jul 15 21:29:13.504008 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:13.500554    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6e450c81_34e8_4ad5_9939_56804ad78f86.slice/crio-fa018a55914c683c4f78ef7c9076c3e33e096a213ce3e7664f5c5a1f64874bc2 WatchSource:0}: Error finding container fa018a55914c683c4f78ef7c9076c3e33e096a213ce3e7664f5c5a1f64874bc2: Status 404 returned error can't find the container with id fa018a55914c683c4f78ef7c9076c3e33e096a213ce3e7664f5c5a1f64874bc2
Jul 15 21:29:13.506258 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:13.505816    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod29df31ab_38b3_4cec_ab5e_013432132c57.slice/crio-a16cc80d7ec9b256d088d6e1a2c72a6975fee6d439bd5c7a444da267157a16e8 WatchSource:0}: Error finding container a16cc80d7ec9b256d088d6e1a2c72a6975fee6d439bd5c7a444da267157a16e8: Status 404 returned error can't find the container with id a16cc80d7ec9b256d088d6e1a2c72a6975fee6d439bd5c7a444da267157a16e8
Jul 15 21:29:13.567178 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:13.567143    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d27m5\" (UniqueName: \"kubernetes.io/projected/50904bfc-f028-4def-b159-b24669cfde16-kube-api-access-d27m5\") pod \"network-check-target-dw6kh\" (UID: \"50904bfc-f028-4def-b159-b24669cfde16\") " pod="openshift-network-diagnostics/network-check-target-dw6kh"
Jul 15 21:29:13.567300 ip-10-0-130-217 kubenswrapper[2563]: E0715 21:29:13.567287    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 15 21:29:13.567350 ip-10-0-130-217 kubenswrapper[2563]: E0715 21:29:13.567307    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 15 21:29:13.567350 ip-10-0-130-217 kubenswrapper[2563]: E0715 21:29:13.567317    2563 projected.go:196] Error preparing data for projected volume kube-api-access-d27m5 for pod openshift-network-diagnostics/network-check-target-dw6kh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 21:29:13.567432 ip-10-0-130-217 kubenswrapper[2563]: E0715 21:29:13.567379    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/50904bfc-f028-4def-b159-b24669cfde16-kube-api-access-d27m5 podName:50904bfc-f028-4def-b159-b24669cfde16 nodeName:}" failed. No retries permitted until 2026-07-15 21:29:14.567364799 +0000 UTC m=+4.261292330 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-d27m5" (UniqueName: "kubernetes.io/projected/50904bfc-f028-4def-b159-b24669cfde16-kube-api-access-d27m5") pod "network-check-target-dw6kh" (UID: "50904bfc-f028-4def-b159-b24669cfde16") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 21:29:13.803510 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:13.803313    2563 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-14 21:24:12 +0000 UTC" deadline="2027-12-26 15:03:46.384656465 +0000 UTC"
Jul 15 21:29:13.803510 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:13.803501    2563 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12689h34m32.58115863s"
Jul 15 21:29:13.982214 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:13.982177    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6tbzj"
Jul 15 21:29:13.982760 ip-10-0-130-217 kubenswrapper[2563]: E0715 21:29:13.982391    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6tbzj" podUID="c4900b8a-d9f9-4926-8c67-62cd4a52ce9b"
Jul 15 21:29:13.982760 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:13.982466    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dw6kh"
Jul 15 21:29:13.982760 ip-10-0-130-217 kubenswrapper[2563]: E0715 21:29:13.982568    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dw6kh" podUID="50904bfc-f028-4def-b159-b24669cfde16"
Jul 15 21:29:13.994636 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:13.994553    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-zqgv4" event={"ID":"08a86ea6-a748-4395-8c19-d3df46a2d855","Type":"ContainerStarted","Data":"1c1f4533bd66220ab4108d655b460b5775d17415cfbf9d8f803f77281469c0fd"}
Jul 15 21:29:13.996737 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:13.996644    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7n5gr" event={"ID":"f0419a71-4b27-477f-9aad-a068b50d814d","Type":"ContainerStarted","Data":"f3cc5070b103fd8c7998317c81ffac8ce7b18fc76a98d8449502387a514fd3ee"}
Jul 15 21:29:13.998161 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:13.998066    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-dnzpf" event={"ID":"0a247377-2db3-4a4f-9faf-24b8cf6b2688","Type":"ContainerStarted","Data":"a06b3ff6c8bcf7c57fec4b26aac0008b5eb9b61a7a25a6234003d4362400f91d"}
Jul 15 21:29:14.000192 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:14.000166    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-tlrgr" event={"ID":"a8599815-6b89-4248-99de-f4a3ee849bf0","Type":"ContainerStarted","Data":"45da013c6a24b3ec72f4a99d7753944b61e075f295fbb12dd8b79462aad5ae7e"}
Jul 15 21:29:14.005118 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:14.005092    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-9rlc4" event={"ID":"29df31ab-38b3-4cec-ab5e-013432132c57","Type":"ContainerStarted","Data":"a16cc80d7ec9b256d088d6e1a2c72a6975fee6d439bd5c7a444da267157a16e8"}
Jul 15 21:29:14.009259 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:14.009214    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-9t6s7" event={"ID":"afc0fd53-3c5e-45f9-bf8d-7304a97d7d66","Type":"ContainerStarted","Data":"0e8992838a746f5187c684d3768eab58ca8a1545d6c8557ced6bbd2ca12c8f0e"}
Jul 15 21:29:14.012841 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:14.012811    2563 generic.go:356] "Generic (PLEG): container finished" podID="cdab13ce73e8fa92312341fdcfe1f88a" containerID="ca696315c0d10cd189d23fe953861f9ab51a2bc6ede67ca130786740c3949366" exitCode=0
Jul 15 21:29:14.013729 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:14.013692    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-217.ec2.internal" event={"ID":"cdab13ce73e8fa92312341fdcfe1f88a","Type":"ContainerDied","Data":"ca696315c0d10cd189d23fe953861f9ab51a2bc6ede67ca130786740c3949366"}
Jul 15 21:29:14.015633 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:14.015609    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bp2vz" event={"ID":"7f43c078-b73a-4760-860b-e7f6e07afdbd","Type":"ContainerStarted","Data":"bb3dae27e2a27300f1cb249c3da0f56d2f4512ca7faceea5160163abf7a591c6"}
Jul 15 21:29:14.018505 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:14.018482    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-rz4r6" event={"ID":"6e450c81-34e8-4ad5-9939-56804ad78f86","Type":"ContainerStarted","Data":"fa018a55914c683c4f78ef7c9076c3e33e096a213ce3e7664f5c5a1f64874bc2"}
Jul 15 21:29:14.023209 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:14.023185    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-f2sjs" event={"ID":"cdc00ed8-331f-4ccc-9d0e-66e123a578eb","Type":"ContainerStarted","Data":"77889321887c9b4a559f0f4f37253da803d2292941a947fe674b1eecdd61fc14"}
Jul 15 21:29:14.473832 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:14.473673    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/70c7abe7-c0b9-49bd-9ab9-a5db9117faa5-original-pull-secret\") pod \"global-pull-secret-syncer-sj7lm\" (UID: \"70c7abe7-c0b9-49bd-9ab9-a5db9117faa5\") " pod="kube-system/global-pull-secret-syncer-sj7lm"
Jul 15 21:29:14.474007 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:14.473858    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c4900b8a-d9f9-4926-8c67-62cd4a52ce9b-metrics-certs\") pod \"network-metrics-daemon-6tbzj\" (UID: \"c4900b8a-d9f9-4926-8c67-62cd4a52ce9b\") " pod="openshift-multus/network-metrics-daemon-6tbzj"
Jul 15 21:29:14.474007 ip-10-0-130-217 kubenswrapper[2563]: E0715 21:29:14.474014    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 21:29:14.474155 ip-10-0-130-217 kubenswrapper[2563]: E0715 21:29:14.474077    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c4900b8a-d9f9-4926-8c67-62cd4a52ce9b-metrics-certs podName:c4900b8a-d9f9-4926-8c67-62cd4a52ce9b nodeName:}" failed. No retries permitted until 2026-07-15 21:29:16.474058656 +0000 UTC m=+6.167986202 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c4900b8a-d9f9-4926-8c67-62cd4a52ce9b-metrics-certs") pod "network-metrics-daemon-6tbzj" (UID: "c4900b8a-d9f9-4926-8c67-62cd4a52ce9b") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 21:29:14.474155 ip-10-0-130-217 kubenswrapper[2563]: E0715 21:29:14.474144    2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 15 21:29:14.474260 ip-10-0-130-217 kubenswrapper[2563]: E0715 21:29:14.474180    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/70c7abe7-c0b9-49bd-9ab9-a5db9117faa5-original-pull-secret podName:70c7abe7-c0b9-49bd-9ab9-a5db9117faa5 nodeName:}" failed. No retries permitted until 2026-07-15 21:29:16.474168795 +0000 UTC m=+6.168096341 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/70c7abe7-c0b9-49bd-9ab9-a5db9117faa5-original-pull-secret") pod "global-pull-secret-syncer-sj7lm" (UID: "70c7abe7-c0b9-49bd-9ab9-a5db9117faa5") : object "kube-system"/"original-pull-secret" not registered
Jul 15 21:29:14.575126 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:14.575083    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d27m5\" (UniqueName: \"kubernetes.io/projected/50904bfc-f028-4def-b159-b24669cfde16-kube-api-access-d27m5\") pod \"network-check-target-dw6kh\" (UID: \"50904bfc-f028-4def-b159-b24669cfde16\") " pod="openshift-network-diagnostics/network-check-target-dw6kh"
Jul 15 21:29:14.575370 ip-10-0-130-217 kubenswrapper[2563]: E0715 21:29:14.575299    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 15 21:29:14.575370 ip-10-0-130-217 kubenswrapper[2563]: E0715 21:29:14.575322    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 15 21:29:14.575370 ip-10-0-130-217 kubenswrapper[2563]: E0715 21:29:14.575336    2563 projected.go:196] Error preparing data for projected volume kube-api-access-d27m5 for pod openshift-network-diagnostics/network-check-target-dw6kh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 21:29:14.575547 ip-10-0-130-217 kubenswrapper[2563]: E0715 21:29:14.575397    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/50904bfc-f028-4def-b159-b24669cfde16-kube-api-access-d27m5 podName:50904bfc-f028-4def-b159-b24669cfde16 nodeName:}" failed. No retries permitted until 2026-07-15 21:29:16.575379129 +0000 UTC m=+6.269306666 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-d27m5" (UniqueName: "kubernetes.io/projected/50904bfc-f028-4def-b159-b24669cfde16-kube-api-access-d27m5") pod "network-check-target-dw6kh" (UID: "50904bfc-f028-4def-b159-b24669cfde16") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 21:29:14.804576 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:14.804479    2563 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-14 21:24:12 +0000 UTC" deadline="2028-01-25 03:36:40.757130786 +0000 UTC"
Jul 15 21:29:14.804576 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:14.804525    2563 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13398h7m25.952611294s"
Jul 15 21:29:14.984563 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:14.984525    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sj7lm"
Jul 15 21:29:14.985012 ip-10-0-130-217 kubenswrapper[2563]: E0715 21:29:14.984658    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sj7lm" podUID="70c7abe7-c0b9-49bd-9ab9-a5db9117faa5"
Jul 15 21:29:15.049968 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:15.049239    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-217.ec2.internal" event={"ID":"cdab13ce73e8fa92312341fdcfe1f88a","Type":"ContainerStarted","Data":"72a8775ab4e46a3f29a796939386d71418af7cbbbd337427b9104329bfc222d6"}
Jul 15 21:29:15.063948 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:15.063831    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-217.ec2.internal" podStartSLOduration=3.063811907 podStartE2EDuration="3.063811907s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 21:29:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:29:15.06332564 +0000 UTC m=+4.757253196" watchObservedRunningTime="2026-07-15 21:29:15.063811907 +0000 UTC m=+4.757739460"
Jul 15 21:29:15.982550 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:15.982466    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6tbzj"
Jul 15 21:29:15.982705 ip-10-0-130-217 kubenswrapper[2563]: E0715 21:29:15.982623    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6tbzj" podUID="c4900b8a-d9f9-4926-8c67-62cd4a52ce9b"
Jul 15 21:29:15.983067 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:15.983046    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dw6kh"
Jul 15 21:29:15.983178 ip-10-0-130-217 kubenswrapper[2563]: E0715 21:29:15.983157    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dw6kh" podUID="50904bfc-f028-4def-b159-b24669cfde16"
Jul 15 21:29:16.493634 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:16.492827    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/70c7abe7-c0b9-49bd-9ab9-a5db9117faa5-original-pull-secret\") pod \"global-pull-secret-syncer-sj7lm\" (UID: \"70c7abe7-c0b9-49bd-9ab9-a5db9117faa5\") " pod="kube-system/global-pull-secret-syncer-sj7lm"
Jul 15 21:29:16.493634 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:16.492898    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c4900b8a-d9f9-4926-8c67-62cd4a52ce9b-metrics-certs\") pod \"network-metrics-daemon-6tbzj\" (UID: \"c4900b8a-d9f9-4926-8c67-62cd4a52ce9b\") " pod="openshift-multus/network-metrics-daemon-6tbzj"
Jul 15 21:29:16.493634 ip-10-0-130-217 kubenswrapper[2563]: E0715 21:29:16.493065    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 21:29:16.493634 ip-10-0-130-217 kubenswrapper[2563]: E0715 21:29:16.493131    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c4900b8a-d9f9-4926-8c67-62cd4a52ce9b-metrics-certs podName:c4900b8a-d9f9-4926-8c67-62cd4a52ce9b nodeName:}" failed. No retries permitted until 2026-07-15 21:29:20.493111133 +0000 UTC m=+10.187038664 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c4900b8a-d9f9-4926-8c67-62cd4a52ce9b-metrics-certs") pod "network-metrics-daemon-6tbzj" (UID: "c4900b8a-d9f9-4926-8c67-62cd4a52ce9b") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 21:29:16.493634 ip-10-0-130-217 kubenswrapper[2563]: E0715 21:29:16.493533    2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 15 21:29:16.493634 ip-10-0-130-217 kubenswrapper[2563]: E0715 21:29:16.493585    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/70c7abe7-c0b9-49bd-9ab9-a5db9117faa5-original-pull-secret podName:70c7abe7-c0b9-49bd-9ab9-a5db9117faa5 nodeName:}" failed. No retries permitted until 2026-07-15 21:29:20.49356929 +0000 UTC m=+10.187496836 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/70c7abe7-c0b9-49bd-9ab9-a5db9117faa5-original-pull-secret") pod "global-pull-secret-syncer-sj7lm" (UID: "70c7abe7-c0b9-49bd-9ab9-a5db9117faa5") : object "kube-system"/"original-pull-secret" not registered
Jul 15 21:29:16.593774 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:16.593733    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d27m5\" (UniqueName: \"kubernetes.io/projected/50904bfc-f028-4def-b159-b24669cfde16-kube-api-access-d27m5\") pod \"network-check-target-dw6kh\" (UID: \"50904bfc-f028-4def-b159-b24669cfde16\") " pod="openshift-network-diagnostics/network-check-target-dw6kh"
Jul 15 21:29:16.593992 ip-10-0-130-217 kubenswrapper[2563]: E0715 21:29:16.593972    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 15 21:29:16.594053 ip-10-0-130-217 kubenswrapper[2563]: E0715 21:29:16.594003    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 15 21:29:16.594053 ip-10-0-130-217 kubenswrapper[2563]: E0715 21:29:16.594016    2563 projected.go:196] Error preparing data for projected volume kube-api-access-d27m5 for pod openshift-network-diagnostics/network-check-target-dw6kh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 21:29:16.594156 ip-10-0-130-217 kubenswrapper[2563]: E0715 21:29:16.594077    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/50904bfc-f028-4def-b159-b24669cfde16-kube-api-access-d27m5 podName:50904bfc-f028-4def-b159-b24669cfde16 nodeName:}" failed. No retries permitted until 2026-07-15 21:29:20.594055358 +0000 UTC m=+10.287982910 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-d27m5" (UniqueName: "kubernetes.io/projected/50904bfc-f028-4def-b159-b24669cfde16-kube-api-access-d27m5") pod "network-check-target-dw6kh" (UID: "50904bfc-f028-4def-b159-b24669cfde16") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 21:29:16.983574 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:16.983015    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sj7lm"
Jul 15 21:29:16.983574 ip-10-0-130-217 kubenswrapper[2563]: E0715 21:29:16.983151    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sj7lm" podUID="70c7abe7-c0b9-49bd-9ab9-a5db9117faa5"
Jul 15 21:29:17.982296 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:17.982138    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dw6kh"
Jul 15 21:29:17.982296 ip-10-0-130-217 kubenswrapper[2563]: E0715 21:29:17.982258    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dw6kh" podUID="50904bfc-f028-4def-b159-b24669cfde16"
Jul 15 21:29:17.982818 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:17.982324    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6tbzj"
Jul 15 21:29:17.982818 ip-10-0-130-217 kubenswrapper[2563]: E0715 21:29:17.982406    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6tbzj" podUID="c4900b8a-d9f9-4926-8c67-62cd4a52ce9b"
Jul 15 21:29:18.983307 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:18.983122    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sj7lm"
Jul 15 21:29:18.983307 ip-10-0-130-217 kubenswrapper[2563]: E0715 21:29:18.983264    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sj7lm" podUID="70c7abe7-c0b9-49bd-9ab9-a5db9117faa5"
Jul 15 21:29:19.982452 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:19.982411    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6tbzj"
Jul 15 21:29:19.982648 ip-10-0-130-217 kubenswrapper[2563]: E0715 21:29:19.982558    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6tbzj" podUID="c4900b8a-d9f9-4926-8c67-62cd4a52ce9b"
Jul 15 21:29:19.982648 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:19.982614    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dw6kh"
Jul 15 21:29:19.982751 ip-10-0-130-217 kubenswrapper[2563]: E0715 21:29:19.982675    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dw6kh" podUID="50904bfc-f028-4def-b159-b24669cfde16"
Jul 15 21:29:20.527972 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:20.527920    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/70c7abe7-c0b9-49bd-9ab9-a5db9117faa5-original-pull-secret\") pod \"global-pull-secret-syncer-sj7lm\" (UID: \"70c7abe7-c0b9-49bd-9ab9-a5db9117faa5\") " pod="kube-system/global-pull-secret-syncer-sj7lm"
Jul 15 21:29:20.528385 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:20.528004    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c4900b8a-d9f9-4926-8c67-62cd4a52ce9b-metrics-certs\") pod \"network-metrics-daemon-6tbzj\" (UID: \"c4900b8a-d9f9-4926-8c67-62cd4a52ce9b\") " pod="openshift-multus/network-metrics-daemon-6tbzj"
Jul 15 21:29:20.528385 ip-10-0-130-217 kubenswrapper[2563]: E0715 21:29:20.528152    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 21:29:20.528385 ip-10-0-130-217 kubenswrapper[2563]: E0715 21:29:20.528217    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c4900b8a-d9f9-4926-8c67-62cd4a52ce9b-metrics-certs podName:c4900b8a-d9f9-4926-8c67-62cd4a52ce9b nodeName:}" failed. No retries permitted until 2026-07-15 21:29:28.528194017 +0000 UTC m=+18.222121546 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c4900b8a-d9f9-4926-8c67-62cd4a52ce9b-metrics-certs") pod "network-metrics-daemon-6tbzj" (UID: "c4900b8a-d9f9-4926-8c67-62cd4a52ce9b") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 21:29:20.528826 ip-10-0-130-217 kubenswrapper[2563]: E0715 21:29:20.528805    2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 15 21:29:20.528923 ip-10-0-130-217 kubenswrapper[2563]: E0715 21:29:20.528862    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/70c7abe7-c0b9-49bd-9ab9-a5db9117faa5-original-pull-secret podName:70c7abe7-c0b9-49bd-9ab9-a5db9117faa5 nodeName:}" failed. No retries permitted until 2026-07-15 21:29:28.528846977 +0000 UTC m=+18.222774511 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/70c7abe7-c0b9-49bd-9ab9-a5db9117faa5-original-pull-secret") pod "global-pull-secret-syncer-sj7lm" (UID: "70c7abe7-c0b9-49bd-9ab9-a5db9117faa5") : object "kube-system"/"original-pull-secret" not registered
Jul 15 21:29:20.629067 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:20.629032    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d27m5\" (UniqueName: \"kubernetes.io/projected/50904bfc-f028-4def-b159-b24669cfde16-kube-api-access-d27m5\") pod \"network-check-target-dw6kh\" (UID: \"50904bfc-f028-4def-b159-b24669cfde16\") " pod="openshift-network-diagnostics/network-check-target-dw6kh"
Jul 15 21:29:20.629248 ip-10-0-130-217 kubenswrapper[2563]: E0715 21:29:20.629166    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 15 21:29:20.629248 ip-10-0-130-217 kubenswrapper[2563]: E0715 21:29:20.629185    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 15 21:29:20.629248 ip-10-0-130-217 kubenswrapper[2563]: E0715 21:29:20.629194    2563 projected.go:196] Error preparing data for projected volume kube-api-access-d27m5 for pod openshift-network-diagnostics/network-check-target-dw6kh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 21:29:20.629366 ip-10-0-130-217 kubenswrapper[2563]: E0715 21:29:20.629253    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/50904bfc-f028-4def-b159-b24669cfde16-kube-api-access-d27m5 podName:50904bfc-f028-4def-b159-b24669cfde16 nodeName:}" failed. No retries permitted until 2026-07-15 21:29:28.629235061 +0000 UTC m=+18.323162595 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-d27m5" (UniqueName: "kubernetes.io/projected/50904bfc-f028-4def-b159-b24669cfde16-kube-api-access-d27m5") pod "network-check-target-dw6kh" (UID: "50904bfc-f028-4def-b159-b24669cfde16") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 21:29:20.983251 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:20.982672    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sj7lm"
Jul 15 21:29:20.983251 ip-10-0-130-217 kubenswrapper[2563]: E0715 21:29:20.982800    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sj7lm" podUID="70c7abe7-c0b9-49bd-9ab9-a5db9117faa5"
Jul 15 21:29:21.981980 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:21.981928    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6tbzj"
Jul 15 21:29:21.982405 ip-10-0-130-217 kubenswrapper[2563]: E0715 21:29:21.982088    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6tbzj" podUID="c4900b8a-d9f9-4926-8c67-62cd4a52ce9b"
Jul 15 21:29:21.982497 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:21.982473    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dw6kh"
Jul 15 21:29:21.982610 ip-10-0-130-217 kubenswrapper[2563]: E0715 21:29:21.982566    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dw6kh" podUID="50904bfc-f028-4def-b159-b24669cfde16"
Jul 15 21:29:22.982275 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:22.982244    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sj7lm"
Jul 15 21:29:22.982712 ip-10-0-130-217 kubenswrapper[2563]: E0715 21:29:22.982370    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sj7lm" podUID="70c7abe7-c0b9-49bd-9ab9-a5db9117faa5"
Jul 15 21:29:23.982113 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:23.982079    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6tbzj"
Jul 15 21:29:23.982277 ip-10-0-130-217 kubenswrapper[2563]: E0715 21:29:23.982195    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6tbzj" podUID="c4900b8a-d9f9-4926-8c67-62cd4a52ce9b"
Jul 15 21:29:23.982277 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:23.982250    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dw6kh"
Jul 15 21:29:23.982671 ip-10-0-130-217 kubenswrapper[2563]: E0715 21:29:23.982361    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dw6kh" podUID="50904bfc-f028-4def-b159-b24669cfde16"
Jul 15 21:29:24.982649 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:24.982617    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sj7lm"
Jul 15 21:29:24.983098 ip-10-0-130-217 kubenswrapper[2563]: E0715 21:29:24.982755    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sj7lm" podUID="70c7abe7-c0b9-49bd-9ab9-a5db9117faa5"
Jul 15 21:29:25.981930 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:25.981881    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6tbzj"
Jul 15 21:29:25.982115 ip-10-0-130-217 kubenswrapper[2563]: E0715 21:29:25.982040    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6tbzj" podUID="c4900b8a-d9f9-4926-8c67-62cd4a52ce9b"
Jul 15 21:29:25.982115 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:25.982089    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dw6kh"
Jul 15 21:29:25.982221 ip-10-0-130-217 kubenswrapper[2563]: E0715 21:29:25.982182    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dw6kh" podUID="50904bfc-f028-4def-b159-b24669cfde16"
Jul 15 21:29:26.982001 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:26.981922    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sj7lm"
Jul 15 21:29:26.982434 ip-10-0-130-217 kubenswrapper[2563]: E0715 21:29:26.982065    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sj7lm" podUID="70c7abe7-c0b9-49bd-9ab9-a5db9117faa5"
Jul 15 21:29:27.981845 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:27.981809    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dw6kh"
Jul 15 21:29:27.982056 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:27.981846    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6tbzj"
Jul 15 21:29:27.982056 ip-10-0-130-217 kubenswrapper[2563]: E0715 21:29:27.981920    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dw6kh" podUID="50904bfc-f028-4def-b159-b24669cfde16"
Jul 15 21:29:27.982365 ip-10-0-130-217 kubenswrapper[2563]: E0715 21:29:27.982073    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6tbzj" podUID="c4900b8a-d9f9-4926-8c67-62cd4a52ce9b"
Jul 15 21:29:28.588679 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:28.588648    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/70c7abe7-c0b9-49bd-9ab9-a5db9117faa5-original-pull-secret\") pod \"global-pull-secret-syncer-sj7lm\" (UID: \"70c7abe7-c0b9-49bd-9ab9-a5db9117faa5\") " pod="kube-system/global-pull-secret-syncer-sj7lm"
Jul 15 21:29:28.588845 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:28.588703    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c4900b8a-d9f9-4926-8c67-62cd4a52ce9b-metrics-certs\") pod \"network-metrics-daemon-6tbzj\" (UID: \"c4900b8a-d9f9-4926-8c67-62cd4a52ce9b\") " pod="openshift-multus/network-metrics-daemon-6tbzj"
Jul 15 21:29:28.588845 ip-10-0-130-217 kubenswrapper[2563]: E0715 21:29:28.588791    2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 15 21:29:28.588845 ip-10-0-130-217 kubenswrapper[2563]: E0715 21:29:28.588802    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 21:29:28.588987 ip-10-0-130-217 kubenswrapper[2563]: E0715 21:29:28.588851    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/70c7abe7-c0b9-49bd-9ab9-a5db9117faa5-original-pull-secret podName:70c7abe7-c0b9-49bd-9ab9-a5db9117faa5 nodeName:}" failed. No retries permitted until 2026-07-15 21:29:44.588836707 +0000 UTC m=+34.282764236 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/70c7abe7-c0b9-49bd-9ab9-a5db9117faa5-original-pull-secret") pod "global-pull-secret-syncer-sj7lm" (UID: "70c7abe7-c0b9-49bd-9ab9-a5db9117faa5") : object "kube-system"/"original-pull-secret" not registered
Jul 15 21:29:28.588987 ip-10-0-130-217 kubenswrapper[2563]: E0715 21:29:28.588867    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c4900b8a-d9f9-4926-8c67-62cd4a52ce9b-metrics-certs podName:c4900b8a-d9f9-4926-8c67-62cd4a52ce9b nodeName:}" failed. No retries permitted until 2026-07-15 21:29:44.588860159 +0000 UTC m=+34.282787688 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c4900b8a-d9f9-4926-8c67-62cd4a52ce9b-metrics-certs") pod "network-metrics-daemon-6tbzj" (UID: "c4900b8a-d9f9-4926-8c67-62cd4a52ce9b") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 21:29:28.689226 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:28.689192    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d27m5\" (UniqueName: \"kubernetes.io/projected/50904bfc-f028-4def-b159-b24669cfde16-kube-api-access-d27m5\") pod \"network-check-target-dw6kh\" (UID: \"50904bfc-f028-4def-b159-b24669cfde16\") " pod="openshift-network-diagnostics/network-check-target-dw6kh"
Jul 15 21:29:28.689353 ip-10-0-130-217 kubenswrapper[2563]: E0715 21:29:28.689342    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 15 21:29:28.689387 ip-10-0-130-217 kubenswrapper[2563]: E0715 21:29:28.689359    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 15 21:29:28.689387 ip-10-0-130-217 kubenswrapper[2563]: E0715 21:29:28.689367    2563 projected.go:196] Error preparing data for projected volume kube-api-access-d27m5 for pod openshift-network-diagnostics/network-check-target-dw6kh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 21:29:28.689493 ip-10-0-130-217 kubenswrapper[2563]: E0715 21:29:28.689410    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/50904bfc-f028-4def-b159-b24669cfde16-kube-api-access-d27m5 podName:50904bfc-f028-4def-b159-b24669cfde16 nodeName:}" failed. No retries permitted until 2026-07-15 21:29:44.689397908 +0000 UTC m=+34.383325442 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-d27m5" (UniqueName: "kubernetes.io/projected/50904bfc-f028-4def-b159-b24669cfde16-kube-api-access-d27m5") pod "network-check-target-dw6kh" (UID: "50904bfc-f028-4def-b159-b24669cfde16") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 21:29:28.981818 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:28.981737    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sj7lm"
Jul 15 21:29:28.981998 ip-10-0-130-217 kubenswrapper[2563]: E0715 21:29:28.981864    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sj7lm" podUID="70c7abe7-c0b9-49bd-9ab9-a5db9117faa5"
Jul 15 21:29:29.982485 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:29.982450    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dw6kh"
Jul 15 21:29:29.982961 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:29.982450    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6tbzj"
Jul 15 21:29:29.982961 ip-10-0-130-217 kubenswrapper[2563]: E0715 21:29:29.982572    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dw6kh" podUID="50904bfc-f028-4def-b159-b24669cfde16"
Jul 15 21:29:29.982961 ip-10-0-130-217 kubenswrapper[2563]: E0715 21:29:29.982650    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6tbzj" podUID="c4900b8a-d9f9-4926-8c67-62cd4a52ce9b"
Jul 15 21:29:30.984803 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:30.984772    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sj7lm"
Jul 15 21:29:30.985273 ip-10-0-130-217 kubenswrapper[2563]: E0715 21:29:30.984889    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sj7lm" podUID="70c7abe7-c0b9-49bd-9ab9-a5db9117faa5"
Jul 15 21:29:31.981841 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:31.981804    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6tbzj"
Jul 15 21:29:31.982058 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:31.981856    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dw6kh"
Jul 15 21:29:31.982058 ip-10-0-130-217 kubenswrapper[2563]: E0715 21:29:31.981961    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6tbzj" podUID="c4900b8a-d9f9-4926-8c67-62cd4a52ce9b"
Jul 15 21:29:31.982058 ip-10-0-130-217 kubenswrapper[2563]: E0715 21:29:31.982045    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dw6kh" podUID="50904bfc-f028-4def-b159-b24669cfde16"
Jul 15 21:29:32.982355 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:32.982328    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sj7lm"
Jul 15 21:29:32.982762 ip-10-0-130-217 kubenswrapper[2563]: E0715 21:29:32.982431    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sj7lm" podUID="70c7abe7-c0b9-49bd-9ab9-a5db9117faa5"
Jul 15 21:29:33.982380 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:33.982047    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6tbzj"
Jul 15 21:29:33.983237 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:33.982072    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dw6kh"
Jul 15 21:29:33.983237 ip-10-0-130-217 kubenswrapper[2563]: E0715 21:29:33.982488    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6tbzj" podUID="c4900b8a-d9f9-4926-8c67-62cd4a52ce9b"
Jul 15 21:29:33.983237 ip-10-0-130-217 kubenswrapper[2563]: E0715 21:29:33.982583    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dw6kh" podUID="50904bfc-f028-4def-b159-b24669cfde16"
Jul 15 21:29:34.096146 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:34.096084    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bp2vz_7f43c078-b73a-4760-860b-e7f6e07afdbd/ovn-acl-logging/0.log"
Jul 15 21:29:34.096410 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:34.096390    2563 generic.go:356] "Generic (PLEG): container finished" podID="7f43c078-b73a-4760-860b-e7f6e07afdbd" containerID="0ee4c208498eb64ab8297ec8b3e6efea8c642748ec8921c2ad89a21283fcd096" exitCode=1
Jul 15 21:29:34.096485 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:34.096466    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bp2vz" event={"ID":"7f43c078-b73a-4760-860b-e7f6e07afdbd","Type":"ContainerStarted","Data":"a779cda4f68c8014fac58fe4e282374dfce9d7130f8cfd0adba641bb48d0f669"}
Jul 15 21:29:34.096548 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:34.096534    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bp2vz" event={"ID":"7f43c078-b73a-4760-860b-e7f6e07afdbd","Type":"ContainerStarted","Data":"c175568653d14e6a8514bd1ec60e225157c0a0f06ca0c4384a48086862eabc62"}
Jul 15 21:29:34.096592 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:34.096580    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bp2vz" event={"ID":"7f43c078-b73a-4760-860b-e7f6e07afdbd","Type":"ContainerStarted","Data":"f39f48af9ff3b7c4061c2b42e806c9ca6bdba214182709912e3d72de2eb1174d"}
Jul 15 21:29:34.096637 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:34.096613    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bp2vz" event={"ID":"7f43c078-b73a-4760-860b-e7f6e07afdbd","Type":"ContainerStarted","Data":"6fda41fde88d37f0d0307ffbdbdf8a5f91a630b7ad418445eb1cffd8f4ae478f"}
Jul 15 21:29:34.096672 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:34.096649    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bp2vz" event={"ID":"7f43c078-b73a-4760-860b-e7f6e07afdbd","Type":"ContainerDied","Data":"0ee4c208498eb64ab8297ec8b3e6efea8c642748ec8921c2ad89a21283fcd096"}
Jul 15 21:29:34.096714 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:34.096693    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bp2vz" event={"ID":"7f43c078-b73a-4760-860b-e7f6e07afdbd","Type":"ContainerStarted","Data":"e505ec333aebd38a0f7f523e3080eaf24241fe288a3c40ddd72f9e74f1559acb"}
Jul 15 21:29:34.097838 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:34.097817    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-rz4r6" event={"ID":"6e450c81-34e8-4ad5-9939-56804ad78f86","Type":"ContainerStarted","Data":"acc2f6b9f95b199b5d2aebd88ddd57ef81daf6bdd10bd616aacc2904e34cec00"}
Jul 15 21:29:34.099170 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:34.099151    2563 generic.go:356] "Generic (PLEG): container finished" podID="cdc00ed8-331f-4ccc-9d0e-66e123a578eb" containerID="cae010587eca0f74fb8958188d9ecc311678871f8e243d936841221663d56c4b" exitCode=0
Jul 15 21:29:34.099258 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:34.099237    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-f2sjs" event={"ID":"cdc00ed8-331f-4ccc-9d0e-66e123a578eb","Type":"ContainerDied","Data":"cae010587eca0f74fb8958188d9ecc311678871f8e243d936841221663d56c4b"}
Jul 15 21:29:34.100608 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:34.100591    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-zqgv4" event={"ID":"08a86ea6-a748-4395-8c19-d3df46a2d855","Type":"ContainerStarted","Data":"b54479fd2affa3d5cb7698ff23524fbf0272a0a021d2e0efe651c160a05f01c5"}
Jul 15 21:29:34.102099 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:34.102075    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7n5gr" event={"ID":"f0419a71-4b27-477f-9aad-a068b50d814d","Type":"ContainerStarted","Data":"f87173d373f22a554d41afc868439db7480d29ab0436a15c8329772667fe9bdd"}
Jul 15 21:29:34.103401 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:34.103376    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-dnzpf" event={"ID":"0a247377-2db3-4a4f-9faf-24b8cf6b2688","Type":"ContainerStarted","Data":"8b5c604cd5fe1e89e86017f8464532d2f043c35656e320e1c0ab8796d6e1ec99"}
Jul 15 21:29:34.104681 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:34.104657    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-217.ec2.internal" event={"ID":"2041a50860cbd204c2d9aa835bb65766","Type":"ContainerStarted","Data":"0eea16c5546e06d6bd24462ec6539ef34600a6a2d7baf24b0c6a00eaf858ac1d"}
Jul 15 21:29:34.105858 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:34.105839    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-tlrgr" event={"ID":"a8599815-6b89-4248-99de-f4a3ee849bf0","Type":"ContainerStarted","Data":"29ff8fd011b7084ea0c5a9443d5fe5b92a2a6ef3982c5720ad57e2f525623fc8"}
Jul 15 21:29:34.107178 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:34.107160    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-9rlc4" event={"ID":"29df31ab-38b3-4cec-ab5e-013432132c57","Type":"ContainerStarted","Data":"314f93499659aeff32e8069d96e571971b32c267b64a304cdcb935c0594a50d2"}
Jul 15 21:29:34.111086 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:34.111050    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-rz4r6" podStartSLOduration=3.579459308 podStartE2EDuration="23.111040444s" totalImagesPullingTime="19.531581136s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:29:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:29:34.11078681 +0000 UTC m=+23.804714360" watchObservedRunningTime="2026-07-15 21:29:34.111040444 +0000 UTC m=+23.804967995"
Jul 15 21:29:34.124531 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:34.124495    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-tlrgr" podStartSLOduration=3.616924732 podStartE2EDuration="23.12448428s" totalImagesPullingTime="19.507559548s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 21:29:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:29:34.124095535 +0000 UTC m=+23.818023097" watchObservedRunningTime="2026-07-15 21:29:34.12448428 +0000 UTC m=+23.818411831"
Jul 15 21:29:34.157207 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:34.157165    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-zqgv4" podStartSLOduration=3.615606789 podStartE2EDuration="23.157152587s" totalImagesPullingTime="19.541545798s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 21:29:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:29:34.15678383 +0000 UTC m=+23.850711380" watchObservedRunningTime="2026-07-15 21:29:34.157152587 +0000 UTC m=+23.851080171"
Jul 15 21:29:34.180672 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:34.180632    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-dnzpf" podStartSLOduration=3.5656391039999997 podStartE2EDuration="23.180617998s" totalImagesPullingTime="19.614978894s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 21:29:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:29:34.180152572 +0000 UTC m=+23.874080135" watchObservedRunningTime="2026-07-15 21:29:34.180617998 +0000 UTC m=+23.874545550"
Jul 15 21:29:34.199770 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:34.199730    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-217.ec2.internal" podStartSLOduration=22.199718106 podStartE2EDuration="22.199718106s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 21:29:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:29:34.199374599 +0000 UTC m=+23.893302150" watchObservedRunningTime="2026-07-15 21:29:34.199718106 +0000 UTC m=+23.893645656"
Jul 15 21:29:34.215138 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:34.215092    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-9rlc4" podStartSLOduration=3.687578311 podStartE2EDuration="23.215080919s" totalImagesPullingTime="19.527502608s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 21:29:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:29:34.214610975 +0000 UTC m=+23.908538525" watchObservedRunningTime="2026-07-15 21:29:34.215080919 +0000 UTC m=+23.909008479"
Jul 15 21:29:34.488148 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:34.488124    2563 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 15 21:29:34.827129 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:34.826930    2563 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-15T21:29:34.488141697Z","UUID":"6bf0db72-5216-4a55-be56-205f86add6e7","Handler":null,"Name":"","Endpoint":""}
Jul 15 21:29:34.828294 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:34.828277    2563 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 15 21:29:34.828399 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:34.828311    2563 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 15 21:29:34.853204 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:34.853180    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-rz4r6"
Jul 15 21:29:34.982630 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:34.982519    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sj7lm"
Jul 15 21:29:34.983214 ip-10-0-130-217 kubenswrapper[2563]: E0715 21:29:34.983179    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sj7lm" podUID="70c7abe7-c0b9-49bd-9ab9-a5db9117faa5"
Jul 15 21:29:35.111953 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:35.111858    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7n5gr" event={"ID":"f0419a71-4b27-477f-9aad-a068b50d814d","Type":"ContainerStarted","Data":"3cf5d8ae68a62fb01d5b163ae33ed34980aebacf342296771efc4b64947e639a"}
Jul 15 21:29:35.113408 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:35.113361    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-9t6s7" event={"ID":"afc0fd53-3c5e-45f9-bf8d-7304a97d7d66","Type":"ContainerStarted","Data":"7a2fe88bfe2b9043773ce01829ef3896b35331fe678ef01455995c3335331148"}
Jul 15 21:29:35.127417 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:35.127372    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-9t6s7" podStartSLOduration=4.586040783 podStartE2EDuration="24.12735946s" totalImagesPullingTime="19.541318677s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 21:29:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:29:35.127095126 +0000 UTC m=+24.821022677" watchObservedRunningTime="2026-07-15 21:29:35.12735946 +0000 UTC m=+24.821287036"
Jul 15 21:29:35.981851 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:35.981825    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6tbzj"
Jul 15 21:29:35.981974 ip-10-0-130-217 kubenswrapper[2563]: E0715 21:29:35.981925    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6tbzj" podUID="c4900b8a-d9f9-4926-8c67-62cd4a52ce9b"
Jul 15 21:29:35.981974 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:35.981961    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dw6kh"
Jul 15 21:29:35.982097 ip-10-0-130-217 kubenswrapper[2563]: E0715 21:29:35.982068    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dw6kh" podUID="50904bfc-f028-4def-b159-b24669cfde16"
Jul 15 21:29:36.119816 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:36.119788    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bp2vz_7f43c078-b73a-4760-860b-e7f6e07afdbd/ovn-acl-logging/0.log"
Jul 15 21:29:36.120282 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:36.120260    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bp2vz" event={"ID":"7f43c078-b73a-4760-860b-e7f6e07afdbd","Type":"ContainerStarted","Data":"dac31b49323951751615ce3d2454826cc5ad7e0707dd36d606656bd84f37bc53"}
Jul 15 21:29:36.982632 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:36.982304    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sj7lm"
Jul 15 21:29:36.982823 ip-10-0-130-217 kubenswrapper[2563]: E0715 21:29:36.982703    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sj7lm" podUID="70c7abe7-c0b9-49bd-9ab9-a5db9117faa5"
Jul 15 21:29:37.124714 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:37.124677    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7n5gr" event={"ID":"f0419a71-4b27-477f-9aad-a068b50d814d","Type":"ContainerStarted","Data":"c8e6e66f471aea14d4a575958f232921b89817cafbb827777bc4b16a8c59c05f"}
Jul 15 21:29:37.140264 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:37.140206    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7n5gr" podStartSLOduration=3.300992512 podStartE2EDuration="26.140190267s" totalImagesPullingTime="22.839197755s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 21:29:11 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:29:37.139462353 +0000 UTC m=+26.833389904" watchObservedRunningTime="2026-07-15 21:29:37.140190267 +0000 UTC m=+26.834117818"
Jul 15 21:29:37.885683 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:37.885625    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-rz4r6"
Jul 15 21:29:37.886320 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:37.886297    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-rz4r6"
Jul 15 21:29:37.982274 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:37.982239    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6tbzj"
Jul 15 21:29:37.982434 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:37.982239    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dw6kh"
Jul 15 21:29:37.982434 ip-10-0-130-217 kubenswrapper[2563]: E0715 21:29:37.982363    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6tbzj" podUID="c4900b8a-d9f9-4926-8c67-62cd4a52ce9b"
Jul 15 21:29:37.982434 ip-10-0-130-217 kubenswrapper[2563]: E0715 21:29:37.982399    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dw6kh" podUID="50904bfc-f028-4def-b159-b24669cfde16"
Jul 15 21:29:38.127114 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:38.127086    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-rz4r6"
Jul 15 21:29:38.985190 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:38.985021    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sj7lm"
Jul 15 21:29:38.985330 ip-10-0-130-217 kubenswrapper[2563]: E0715 21:29:38.985259    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sj7lm" podUID="70c7abe7-c0b9-49bd-9ab9-a5db9117faa5"
Jul 15 21:29:39.131094 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:39.131030    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bp2vz_7f43c078-b73a-4760-860b-e7f6e07afdbd/ovn-acl-logging/0.log"
Jul 15 21:29:39.131809 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:39.131372    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bp2vz" event={"ID":"7f43c078-b73a-4760-860b-e7f6e07afdbd","Type":"ContainerStarted","Data":"b6457114da4e9f661b0ce72873c12860f17dd1d76389cd22f429a72927fb2b2a"}
Jul 15 21:29:39.131809 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:39.131591    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-bp2vz"
Jul 15 21:29:39.131809 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:39.131650    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-bp2vz"
Jul 15 21:29:39.131809 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:39.131800    2563 scope.go:117] "RemoveContainer" containerID="0ee4c208498eb64ab8297ec8b3e6efea8c642748ec8921c2ad89a21283fcd096"
Jul 15 21:29:39.133387 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:39.133366    2563 generic.go:356] "Generic (PLEG): container finished" podID="cdc00ed8-331f-4ccc-9d0e-66e123a578eb" containerID="8d6d9c5c0ad35300275cf3dd866614be318d38df9f50f80b4cbeb30c3e1a3af5" exitCode=0
Jul 15 21:29:39.133511 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:39.133451    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-f2sjs" event={"ID":"cdc00ed8-331f-4ccc-9d0e-66e123a578eb","Type":"ContainerDied","Data":"8d6d9c5c0ad35300275cf3dd866614be318d38df9f50f80b4cbeb30c3e1a3af5"}
Jul 15 21:29:39.147132 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:39.147110    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-bp2vz"
Jul 15 21:29:39.982687 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:39.982661    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6tbzj"
Jul 15 21:29:39.982687 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:39.982676    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dw6kh"
Jul 15 21:29:39.982962 ip-10-0-130-217 kubenswrapper[2563]: E0715 21:29:39.982768    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6tbzj" podUID="c4900b8a-d9f9-4926-8c67-62cd4a52ce9b"
Jul 15 21:29:39.982962 ip-10-0-130-217 kubenswrapper[2563]: E0715 21:29:39.982873    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dw6kh" podUID="50904bfc-f028-4def-b159-b24669cfde16"
Jul 15 21:29:40.138347 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:40.138324    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bp2vz_7f43c078-b73a-4760-860b-e7f6e07afdbd/ovn-acl-logging/0.log"
Jul 15 21:29:40.138821 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:40.138747    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bp2vz" event={"ID":"7f43c078-b73a-4760-860b-e7f6e07afdbd","Type":"ContainerStarted","Data":"33a0fdcba020db43418235d3c22e8dd614410484cd43b8fbf13f45ef710f5c58"}
Jul 15 21:29:40.139091 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:40.139035    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-bp2vz"
Jul 15 21:29:40.154454 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:40.154433    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-bp2vz"
Jul 15 21:29:40.169550 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:40.169502    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-bp2vz" podStartSLOduration=9.566976359 podStartE2EDuration="29.169488675s" totalImagesPullingTime="19.602512316s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 21:29:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:29:40.168087368 +0000 UTC m=+29.862014919" watchObservedRunningTime="2026-07-15 21:29:40.169488675 +0000 UTC m=+29.863416225"
Jul 15 21:29:40.470683 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:40.470655    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-sj7lm"]
Jul 15 21:29:40.470821 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:40.470766    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sj7lm"
Jul 15 21:29:40.470875 ip-10-0-130-217 kubenswrapper[2563]: E0715 21:29:40.470851    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sj7lm" podUID="70c7abe7-c0b9-49bd-9ab9-a5db9117faa5"
Jul 15 21:29:40.474083 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:40.474058    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-dw6kh"]
Jul 15 21:29:40.474207 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:40.474156    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dw6kh"
Jul 15 21:29:40.474278 ip-10-0-130-217 kubenswrapper[2563]: E0715 21:29:40.474255    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dw6kh" podUID="50904bfc-f028-4def-b159-b24669cfde16"
Jul 15 21:29:40.474683 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:40.474660    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-6tbzj"]
Jul 15 21:29:40.474783 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:40.474753    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6tbzj"
Jul 15 21:29:40.474885 ip-10-0-130-217 kubenswrapper[2563]: E0715 21:29:40.474839    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6tbzj" podUID="c4900b8a-d9f9-4926-8c67-62cd4a52ce9b"
Jul 15 21:29:41.143162 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:41.143132    2563 generic.go:356] "Generic (PLEG): container finished" podID="cdc00ed8-331f-4ccc-9d0e-66e123a578eb" containerID="fea661fa2452f21bc5b3a40bd09651367e0fd1c4d0a72a5bd6c27062dd985bfb" exitCode=0
Jul 15 21:29:41.143601 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:41.143220    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-f2sjs" event={"ID":"cdc00ed8-331f-4ccc-9d0e-66e123a578eb","Type":"ContainerDied","Data":"fea661fa2452f21bc5b3a40bd09651367e0fd1c4d0a72a5bd6c27062dd985bfb"}
Jul 15 21:29:41.982386 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:41.982356    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6tbzj"
Jul 15 21:29:41.982544 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:41.982356    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dw6kh"
Jul 15 21:29:41.982544 ip-10-0-130-217 kubenswrapper[2563]: E0715 21:29:41.982462    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6tbzj" podUID="c4900b8a-d9f9-4926-8c67-62cd4a52ce9b"
Jul 15 21:29:41.982544 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:41.982356    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sj7lm"
Jul 15 21:29:41.982661 ip-10-0-130-217 kubenswrapper[2563]: E0715 21:29:41.982517    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dw6kh" podUID="50904bfc-f028-4def-b159-b24669cfde16"
Jul 15 21:29:41.982661 ip-10-0-130-217 kubenswrapper[2563]: E0715 21:29:41.982603    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sj7lm" podUID="70c7abe7-c0b9-49bd-9ab9-a5db9117faa5"
Jul 15 21:29:43.150457 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:43.150277    2563 generic.go:356] "Generic (PLEG): container finished" podID="cdc00ed8-331f-4ccc-9d0e-66e123a578eb" containerID="8c9ae7f69a32de524df6e415cb0f9ad86f4ee20712079e24723c57a68caaa431" exitCode=0
Jul 15 21:29:43.151055 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:43.150353    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-f2sjs" event={"ID":"cdc00ed8-331f-4ccc-9d0e-66e123a578eb","Type":"ContainerDied","Data":"8c9ae7f69a32de524df6e415cb0f9ad86f4ee20712079e24723c57a68caaa431"}
Jul 15 21:29:43.982304 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:43.982272    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sj7lm"
Jul 15 21:29:43.982464 ip-10-0-130-217 kubenswrapper[2563]: E0715 21:29:43.982400    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sj7lm" podUID="70c7abe7-c0b9-49bd-9ab9-a5db9117faa5"
Jul 15 21:29:43.982464 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:43.982272    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6tbzj"
Jul 15 21:29:43.982588 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:43.982272    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dw6kh"
Jul 15 21:29:43.982588 ip-10-0-130-217 kubenswrapper[2563]: E0715 21:29:43.982502    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6tbzj" podUID="c4900b8a-d9f9-4926-8c67-62cd4a52ce9b"
Jul 15 21:29:43.982588 ip-10-0-130-217 kubenswrapper[2563]: E0715 21:29:43.982569    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dw6kh" podUID="50904bfc-f028-4def-b159-b24669cfde16"
Jul 15 21:29:44.607202 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:44.607172    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c4900b8a-d9f9-4926-8c67-62cd4a52ce9b-metrics-certs\") pod \"network-metrics-daemon-6tbzj\" (UID: \"c4900b8a-d9f9-4926-8c67-62cd4a52ce9b\") " pod="openshift-multus/network-metrics-daemon-6tbzj"
Jul 15 21:29:44.607752 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:44.607240    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/70c7abe7-c0b9-49bd-9ab9-a5db9117faa5-original-pull-secret\") pod \"global-pull-secret-syncer-sj7lm\" (UID: \"70c7abe7-c0b9-49bd-9ab9-a5db9117faa5\") " pod="kube-system/global-pull-secret-syncer-sj7lm"
Jul 15 21:29:44.607752 ip-10-0-130-217 kubenswrapper[2563]: E0715 21:29:44.607330    2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 15 21:29:44.607752 ip-10-0-130-217 kubenswrapper[2563]: E0715 21:29:44.607392    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/70c7abe7-c0b9-49bd-9ab9-a5db9117faa5-original-pull-secret podName:70c7abe7-c0b9-49bd-9ab9-a5db9117faa5 nodeName:}" failed. No retries permitted until 2026-07-15 21:30:16.607373439 +0000 UTC m=+66.301300967 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/70c7abe7-c0b9-49bd-9ab9-a5db9117faa5-original-pull-secret") pod "global-pull-secret-syncer-sj7lm" (UID: "70c7abe7-c0b9-49bd-9ab9-a5db9117faa5") : object "kube-system"/"original-pull-secret" not registered
Jul 15 21:29:44.607752 ip-10-0-130-217 kubenswrapper[2563]: E0715 21:29:44.607330    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 21:29:44.607752 ip-10-0-130-217 kubenswrapper[2563]: E0715 21:29:44.607562    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c4900b8a-d9f9-4926-8c67-62cd4a52ce9b-metrics-certs podName:c4900b8a-d9f9-4926-8c67-62cd4a52ce9b nodeName:}" failed. No retries permitted until 2026-07-15 21:30:16.607538003 +0000 UTC m=+66.301465535 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c4900b8a-d9f9-4926-8c67-62cd4a52ce9b-metrics-certs") pod "network-metrics-daemon-6tbzj" (UID: "c4900b8a-d9f9-4926-8c67-62cd4a52ce9b") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 21:29:44.708502 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:44.708420    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d27m5\" (UniqueName: \"kubernetes.io/projected/50904bfc-f028-4def-b159-b24669cfde16-kube-api-access-d27m5\") pod \"network-check-target-dw6kh\" (UID: \"50904bfc-f028-4def-b159-b24669cfde16\") " pod="openshift-network-diagnostics/network-check-target-dw6kh"
Jul 15 21:29:44.708644 ip-10-0-130-217 kubenswrapper[2563]: E0715 21:29:44.708590    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 15 21:29:44.708644 ip-10-0-130-217 kubenswrapper[2563]: E0715 21:29:44.708614    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 15 21:29:44.708644 ip-10-0-130-217 kubenswrapper[2563]: E0715 21:29:44.708624    2563 projected.go:196] Error preparing data for projected volume kube-api-access-d27m5 for pod openshift-network-diagnostics/network-check-target-dw6kh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 21:29:44.708897 ip-10-0-130-217 kubenswrapper[2563]: E0715 21:29:44.708679    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/50904bfc-f028-4def-b159-b24669cfde16-kube-api-access-d27m5 podName:50904bfc-f028-4def-b159-b24669cfde16 nodeName:}" failed. No retries permitted until 2026-07-15 21:30:16.708661345 +0000 UTC m=+66.402588881 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-d27m5" (UniqueName: "kubernetes.io/projected/50904bfc-f028-4def-b159-b24669cfde16-kube-api-access-d27m5") pod "network-check-target-dw6kh" (UID: "50904bfc-f028-4def-b159-b24669cfde16") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 21:29:45.982276 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:45.982192    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sj7lm"
Jul 15 21:29:45.982276 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:45.982214    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6tbzj"
Jul 15 21:29:45.982276 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:45.982222    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dw6kh"
Jul 15 21:29:45.982925 ip-10-0-130-217 kubenswrapper[2563]: E0715 21:29:45.982331    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sj7lm" podUID="70c7abe7-c0b9-49bd-9ab9-a5db9117faa5"
Jul 15 21:29:45.982925 ip-10-0-130-217 kubenswrapper[2563]: E0715 21:29:45.982370    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dw6kh" podUID="50904bfc-f028-4def-b159-b24669cfde16"
Jul 15 21:29:45.982925 ip-10-0-130-217 kubenswrapper[2563]: E0715 21:29:45.982465    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6tbzj" podUID="c4900b8a-d9f9-4926-8c67-62cd4a52ce9b"
Jul 15 21:29:46.135654 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:46.135630    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-217.ec2.internal" event="NodeReady"
Jul 15 21:29:46.135822 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:46.135776    2563 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 15 21:29:46.168128 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:46.168101    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-hgkh9"]
Jul 15 21:29:46.190154 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:46.190121    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-68d9dd94cf-j57mj"]
Jul 15 21:29:46.191836 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:46.190291    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-hgkh9"
Jul 15 21:29:46.194747 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:46.194675    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
Jul 15 21:29:46.194747 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:46.194675    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 15 21:29:46.194919 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:46.194771    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 15 21:29:46.195684 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:46.195655    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-7rbpw\""
Jul 15 21:29:46.195788 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:46.195725    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
Jul 15 21:29:46.204108 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:46.204079    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-jwp9w"]
Jul 15 21:29:46.204474 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:46.204308    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-68d9dd94cf-j57mj"
Jul 15 21:29:46.207134 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:46.207112    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 15 21:29:46.208302 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:46.208229    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-zgvvx\""
Jul 15 21:29:46.208302 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:46.208241    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
Jul 15 21:29:46.208464 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:46.208428    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
Jul 15 21:29:46.208542 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:46.208523    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 15 21:29:46.213676 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:46.213424    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
Jul 15 21:29:46.222138 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:46.222120    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-65db858894-dtcjn"]
Jul 15 21:29:46.222244 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:46.222224    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-jwp9w"
Jul 15 21:29:46.224038 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:46.224017    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-5psgz\""
Jul 15 21:29:46.224183 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:46.224162    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
Jul 15 21:29:46.224285 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:46.224170    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
Jul 15 21:29:46.248451 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:46.248387    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-7bc9859798-z9kjp"]
Jul 15 21:29:46.248542 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:46.248480    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-dtcjn"
Jul 15 21:29:46.250639 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:46.250611    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
Jul 15 21:29:46.250749 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:46.250716    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
Jul 15 21:29:46.250831 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:46.250770    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-ht74p\""
Jul 15 21:29:46.250892 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:46.250829    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
Jul 15 21:29:46.264397 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:46.264378    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-7bc9859798-z9kjp"
Jul 15 21:29:46.264586 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:46.264379    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-7866497494-zlsbs"]
Jul 15 21:29:46.266489 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:46.266293    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Jul 15 21:29:46.266489 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:46.266314    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Jul 15 21:29:46.266489 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:46.266362    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-2gmfn\""
Jul 15 21:29:46.266489 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:46.266400    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 15 21:29:46.266489 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:46.266407    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Jul 15 21:29:46.266805 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:46.266707    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 15 21:29:46.266805 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:46.266745    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Jul 15 21:29:46.280543 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:46.280526    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-2jn97"]
Jul 15 21:29:46.280660 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:46.280643    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-7866497494-zlsbs"
Jul 15 21:29:46.282548 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:46.282529    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-jj6v7\""
Jul 15 21:29:46.282818 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:46.282799    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
Jul 15 21:29:46.283083 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:46.283059    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
Jul 15 21:29:46.283195 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:46.283069    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
Jul 15 21:29:46.283294 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:46.283177    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
Jul 15 21:29:46.288324 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:46.288304    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
Jul 15 21:29:46.296652 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:46.296634    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7695fc6c8c-8dqhg"]
Jul 15 21:29:46.296748 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:46.296736    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-2jn97"
Jul 15 21:29:46.299098 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:46.299079    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
Jul 15 21:29:46.299193 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:46.299100    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
Jul 15 21:29:46.299193 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:46.299102    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
Jul 15 21:29:46.299295 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:46.299079    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-zhbxk\""
Jul 15 21:29:46.299451 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:46.299437    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
Jul 15 21:29:46.312739 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:46.312722    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-df786567c-xhldd"]
Jul 15 21:29:46.312867 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:46.312848    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-8dqhg"
Jul 15 21:29:46.314838 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:46.314820    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Jul 15 21:29:46.314967 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:46.314855    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Jul 15 21:29:46.314967 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:46.314868    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Jul 15 21:29:46.314967 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:46.314878    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Jul 15 21:29:46.315144 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:46.314882    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-56tlm\""
Jul 15 21:29:46.321201 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:46.321178    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/7c107438-4a43-49fe-9bcb-a9c114c05d85-snapshots\") pod \"insights-operator-68d9dd94cf-j57mj\" (UID: \"7c107438-4a43-49fe-9bcb-a9c114c05d85\") " pod="openshift-insights/insights-operator-68d9dd94cf-j57mj"
Jul 15 21:29:46.321302 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:46.321238    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7c107438-4a43-49fe-9bcb-a9c114c05d85-serving-cert\") pod \"insights-operator-68d9dd94cf-j57mj\" (UID: \"7c107438-4a43-49fe-9bcb-a9c114c05d85\") " pod="openshift-insights/insights-operator-68d9dd94cf-j57mj"
Jul 15 21:29:46.321370 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:46.321300    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7c107438-4a43-49fe-9bcb-a9c114c05d85-trusted-ca-bundle\") pod \"insights-operator-68d9dd94cf-j57mj\" (UID: \"7c107438-4a43-49fe-9bcb-a9c114c05d85\") " pod="openshift-insights/insights-operator-68d9dd94cf-j57mj"
Jul 15 21:29:46.321370 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:46.321337    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7c107438-4a43-49fe-9bcb-a9c114c05d85-tmp\") pod \"insights-operator-68d9dd94cf-j57mj\" (UID: \"7c107438-4a43-49fe-9bcb-a9c114c05d85\") " pod="openshift-insights/insights-operator-68d9dd94cf-j57mj"
Jul 15 21:29:46.321470 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:46.321371    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lq76z\" (UniqueName: \"kubernetes.io/projected/ec86bd51-57c3-469e-967d-851a42be041f-kube-api-access-lq76z\") pod \"volume-data-source-validator-78495597f6-jwp9w\" (UID: \"ec86bd51-57c3-469e-967d-851a42be041f\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-jwp9w"
Jul 15 21:29:46.321470 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:46.321427    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/43c5f71f-98e5-4ed1-aa69-bfb6a8815cae-telemetry-config\") pod \"cluster-monitoring-operator-5f7f494dd4-hgkh9\" (UID: \"43c5f71f-98e5-4ed1-aa69-bfb6a8815cae\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-hgkh9"
Jul 15 21:29:46.321573 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:46.321490    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xlcq2\" (UniqueName: \"kubernetes.io/projected/43c5f71f-98e5-4ed1-aa69-bfb6a8815cae-kube-api-access-xlcq2\") pod \"cluster-monitoring-operator-5f7f494dd4-hgkh9\" (UID: \"43c5f71f-98e5-4ed1-aa69-bfb6a8815cae\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-hgkh9"
Jul 15 21:29:46.321573 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:46.321522    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5kj79\" (UniqueName: \"kubernetes.io/projected/7c107438-4a43-49fe-9bcb-a9c114c05d85-kube-api-access-5kj79\") pod \"insights-operator-68d9dd94cf-j57mj\" (UID: \"7c107438-4a43-49fe-9bcb-a9c114c05d85\") " pod="openshift-insights/insights-operator-68d9dd94cf-j57mj"
Jul 15 21:29:46.321573 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:46.321546    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/43c5f71f-98e5-4ed1-aa69-bfb6a8815cae-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-hgkh9\" (UID: \"43c5f71f-98e5-4ed1-aa69-bfb6a8815cae\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-hgkh9"
Jul 15 21:29:46.321714 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:46.321588    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7c107438-4a43-49fe-9bcb-a9c114c05d85-service-ca-bundle\") pod \"insights-operator-68d9dd94cf-j57mj\" (UID: \"7c107438-4a43-49fe-9bcb-a9c114c05d85\") " pod="openshift-insights/insights-operator-68d9dd94cf-j57mj"
Jul 15 21:29:46.332881 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:46.332863    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-hgkh9"]
Jul 15 21:29:46.332990 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:46.332898    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-65db858894-dtcjn"]
Jul 15 21:29:46.332990 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:46.332923    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-68d9dd94cf-j57mj"]
Jul 15 21:29:46.332990 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:46.332957    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-7866497494-zlsbs"]
Jul 15 21:29:46.332990 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:46.332979    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-869dcfcdcd-hv4rg"]
Jul 15 21:29:46.333182 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:46.332998    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-df786567c-xhldd"
Jul 15 21:29:46.335234 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:46.335153    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 15 21:29:46.335234 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:46.335166    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 15 21:29:46.335234 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:46.335190    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 15 21:29:46.335234 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:46.335232    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-kpvhq\""
Jul 15 21:29:46.343632 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:46.343575    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 15 21:29:46.350998 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:46.350977    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-2jn97"]
Jul 15 21:29:46.351083 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:46.351004    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-7bc9859798-z9kjp"]
Jul 15 21:29:46.351083 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:46.351017    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-jwp9w"]
Jul 15 21:29:46.351083 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:46.351030    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-2jskd"]
Jul 15 21:29:46.351203 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:46.351112    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-hv4rg"
Jul 15 21:29:46.352898 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:46.352880    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 15 21:29:46.353247 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:46.353230    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 15 21:29:46.353351 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:46.353234    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-vfzvz\""
Jul 15 21:29:46.373115 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:46.373093    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-l8f7b"]
Jul 15 21:29:46.373244 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:46.373228    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-2jskd"
Jul 15 21:29:46.375353 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:46.375335    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 15 21:29:46.375453 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:46.375406    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 15 21:29:46.375515 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:46.375352    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 15 21:29:46.375515 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:46.375360    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-5mj78\""
Jul 15 21:29:46.385179 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:46.385159    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-869dcfcdcd-hv4rg"]
Jul 15 21:29:46.385320 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:46.385299    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-l8f7b"
Jul 15 21:29:46.385453 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:46.385318    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7695fc6c8c-8dqhg"]
Jul 15 21:29:46.385550 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:46.385470    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-df786567c-xhldd"]
Jul 15 21:29:46.385550 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:46.385503    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-2jskd"]
Jul 15 21:29:46.385550 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:46.385522    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-l8f7b"]
Jul 15 21:29:46.387382 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:46.387139    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-c96dg\""
Jul 15 21:29:46.387382 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:46.387173    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 15 21:29:46.387382 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:46.387317    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 15 21:29:46.422892 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:46.422861    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c6249c00-aa11-475f-a2a5-62cd7999fdd0-installation-pull-secrets\") pod \"image-registry-df786567c-xhldd\" (UID: \"c6249c00-aa11-475f-a2a5-62cd7999fdd0\") " pod="openshift-image-registry/image-registry-df786567c-xhldd"
Jul 15 21:29:46.423015 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:46.422895    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9b4bbb5d-a934-4ca1-807d-c760d336c01d-service-ca-bundle\") pod \"router-default-7bc9859798-z9kjp\" (UID: \"9b4bbb5d-a934-4ca1-807d-c760d336c01d\") " pod="openshift-ingress/router-default-7bc9859798-z9kjp"
Jul 15 21:29:46.423015 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:46.422919    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7c107438-4a43-49fe-9bcb-a9c114c05d85-service-ca-bundle\") pod \"insights-operator-68d9dd94cf-j57mj\" (UID: \"7c107438-4a43-49fe-9bcb-a9c114c05d85\") " pod="openshift-insights/insights-operator-68d9dd94cf-j57mj"
Jul 15 21:29:46.423015 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:46.422959    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d806e382-01da-4412-b627-a52c8b0da47e-config\") pod \"service-ca-operator-7695fc6c8c-8dqhg\" (UID: \"d806e382-01da-4412-b627-a52c8b0da47e\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-8dqhg"
Jul 15 21:29:46.423015 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:46.423008    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/7c107438-4a43-49fe-9bcb-a9c114c05d85-snapshots\") pod \"insights-operator-68d9dd94cf-j57mj\" (UID: \"7c107438-4a43-49fe-9bcb-a9c114c05d85\") " pod="openshift-insights/insights-operator-68d9dd94cf-j57mj"
Jul 15 21:29:46.423200 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:46.423033    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/9b97af79-5c4a-4622-8d74-04d470841a53-serving-cert\") pod \"console-operator-7866497494-zlsbs\" (UID: \"9b97af79-5c4a-4622-8d74-04d470841a53\") " pod="openshift-console-operator/console-operator-7866497494-zlsbs"
Jul 15 21:29:46.423200 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:46.423057    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9b4bbb5d-a934-4ca1-807d-c760d336c01d-metrics-certs\") pod \"router-default-7bc9859798-z9kjp\" (UID: \"9b4bbb5d-a934-4ca1-807d-c760d336c01d\") " pod="openshift-ingress/router-default-7bc9859798-z9kjp"
Jul 15 21:29:46.423200 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:46.423085    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7c107438-4a43-49fe-9bcb-a9c114c05d85-trusted-ca-bundle\") pod \"insights-operator-68d9dd94cf-j57mj\" (UID: \"7c107438-4a43-49fe-9bcb-a9c114c05d85\") " pod="openshift-insights/insights-operator-68d9dd94cf-j57mj"
Jul 15 21:29:46.423200 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:46.423145    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/9b97af79-5c4a-4622-8d74-04d470841a53-config\") pod \"console-operator-7866497494-zlsbs\" (UID: \"9b97af79-5c4a-4622-8d74-04d470841a53\") " pod="openshift-console-operator/console-operator-7866497494-zlsbs"
Jul 15 21:29:46.423200 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:46.423190    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d806e382-01da-4412-b627-a52c8b0da47e-serving-cert\") pod \"service-ca-operator-7695fc6c8c-8dqhg\" (UID: \"d806e382-01da-4412-b627-a52c8b0da47e\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-8dqhg"
Jul 15 21:29:46.423410 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:46.423223    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/43c5f71f-98e5-4ed1-aa69-bfb6a8815cae-telemetry-config\") pod \"cluster-monitoring-operator-5f7f494dd4-hgkh9\" (UID: \"43c5f71f-98e5-4ed1-aa69-bfb6a8815cae\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-hgkh9"
Jul 15 21:29:46.423410 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:46.423265    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c6249c00-aa11-475f-a2a5-62cd7999fdd0-trusted-ca\") pod \"image-registry-df786567c-xhldd\" (UID: \"c6249c00-aa11-475f-a2a5-62cd7999fdd0\") " pod="openshift-image-registry/image-registry-df786567c-xhldd"
Jul 15 21:29:46.423493 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:46.423398    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9xhvz\" (UniqueName: \"kubernetes.io/projected/9b4bbb5d-a934-4ca1-807d-c760d336c01d-kube-api-access-9xhvz\") pod \"router-default-7bc9859798-z9kjp\" (UID: \"9b4bbb5d-a934-4ca1-807d-c760d336c01d\") " pod="openshift-ingress/router-default-7bc9859798-z9kjp"
Jul 15 21:29:46.423493 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:46.423442    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/1683be20-36a0-4ca3-b861-972d9805c362-serving-cert\") pod \"kube-storage-version-migrator-operator-799cb7f958-2jn97\" (UID: \"1683be20-36a0-4ca3-b861-972d9805c362\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-2jn97"
Jul 15 21:29:46.423493 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:46.423483    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xlcq2\" (UniqueName: \"kubernetes.io/projected/43c5f71f-98e5-4ed1-aa69-bfb6a8815cae-kube-api-access-xlcq2\") pod \"cluster-monitoring-operator-5f7f494dd4-hgkh9\" (UID: \"43c5f71f-98e5-4ed1-aa69-bfb6a8815cae\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-hgkh9"
Jul 15 21:29:46.423642 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:46.423532    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d2dd5a89-4ca3-4790-aed4-a4f948651d72-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-dtcjn\" (UID: \"d2dd5a89-4ca3-4790-aed4-a4f948651d72\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-dtcjn"
Jul 15 21:29:46.423642 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:46.423551    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7c107438-4a43-49fe-9bcb-a9c114c05d85-service-ca-bundle\") pod \"insights-operator-68d9dd94cf-j57mj\" (UID: \"7c107438-4a43-49fe-9bcb-a9c114c05d85\") " pod="openshift-insights/insights-operator-68d9dd94cf-j57mj"
Jul 15 21:29:46.423642 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:46.423587    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c6249c00-aa11-475f-a2a5-62cd7999fdd0-bound-sa-token\") pod \"image-registry-df786567c-xhldd\" (UID: \"c6249c00-aa11-475f-a2a5-62cd7999fdd0\") " pod="openshift-image-registry/image-registry-df786567c-xhldd"
Jul 15 21:29:46.423792 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:46.423639    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c6249c00-aa11-475f-a2a5-62cd7999fdd0-ca-trust-extracted\") pod \"image-registry-df786567c-xhldd\" (UID: \"c6249c00-aa11-475f-a2a5-62cd7999fdd0\") " pod="openshift-image-registry/image-registry-df786567c-xhldd"
Jul 15 21:29:46.423792 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:46.423671    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/9b4bbb5d-a934-4ca1-807d-c760d336c01d-stats-auth\") pod \"router-default-7bc9859798-z9kjp\" (UID: \"9b4bbb5d-a934-4ca1-807d-c760d336c01d\") " pod="openshift-ingress/router-default-7bc9859798-z9kjp"
Jul 15 21:29:46.423792 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:46.423706    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9b97af79-5c4a-4622-8d74-04d470841a53-trusted-ca\") pod \"console-operator-7866497494-zlsbs\" (UID: \"9b97af79-5c4a-4622-8d74-04d470841a53\") " pod="openshift-console-operator/console-operator-7866497494-zlsbs"
Jul 15 21:29:46.423792 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:46.423739    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7c107438-4a43-49fe-9bcb-a9c114c05d85-serving-cert\") pod \"insights-operator-68d9dd94cf-j57mj\" (UID: \"7c107438-4a43-49fe-9bcb-a9c114c05d85\") " pod="openshift-insights/insights-operator-68d9dd94cf-j57mj"
Jul 15 21:29:46.423792 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:46.423771    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b9mqt\" (UniqueName: \"kubernetes.io/projected/d2dd5a89-4ca3-4790-aed4-a4f948651d72-kube-api-access-b9mqt\") pod \"cluster-samples-operator-65db858894-dtcjn\" (UID: \"d2dd5a89-4ca3-4790-aed4-a4f948651d72\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-dtcjn"
Jul 15 21:29:46.423792 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:46.423767    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/7c107438-4a43-49fe-9bcb-a9c114c05d85-snapshots\") pod \"insights-operator-68d9dd94cf-j57mj\" (UID: \"7c107438-4a43-49fe-9bcb-a9c114c05d85\") " pod="openshift-insights/insights-operator-68d9dd94cf-j57mj"
Jul 15 21:29:46.424086 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:46.423814    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9dk7g\" (UniqueName: \"kubernetes.io/projected/9b97af79-5c4a-4622-8d74-04d470841a53-kube-api-access-9dk7g\") pod \"console-operator-7866497494-zlsbs\" (UID: \"9b97af79-5c4a-4622-8d74-04d470841a53\") " pod="openshift-console-operator/console-operator-7866497494-zlsbs"
Jul 15 21:29:46.424086 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:46.423859    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g2zh9\" (UniqueName: \"kubernetes.io/projected/1683be20-36a0-4ca3-b861-972d9805c362-kube-api-access-g2zh9\") pod \"kube-storage-version-migrator-operator-799cb7f958-2jn97\" (UID: \"1683be20-36a0-4ca3-b861-972d9805c362\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-2jn97"
Jul 15 21:29:46.424086 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:46.423897    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7c107438-4a43-49fe-9bcb-a9c114c05d85-tmp\") pod \"insights-operator-68d9dd94cf-j57mj\" (UID: \"7c107438-4a43-49fe-9bcb-a9c114c05d85\") " pod="openshift-insights/insights-operator-68d9dd94cf-j57mj"
Jul 15 21:29:46.424086 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:46.423925    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bw6b5\" (UniqueName: \"kubernetes.io/projected/c6249c00-aa11-475f-a2a5-62cd7999fdd0-kube-api-access-bw6b5\") pod \"image-registry-df786567c-xhldd\" (UID: \"c6249c00-aa11-475f-a2a5-62cd7999fdd0\") " pod="openshift-image-registry/image-registry-df786567c-xhldd"
Jul 15 21:29:46.424086 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:46.423976    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lq76z\" (UniqueName: \"kubernetes.io/projected/ec86bd51-57c3-469e-967d-851a42be041f-kube-api-access-lq76z\") pod \"volume-data-source-validator-78495597f6-jwp9w\" (UID: \"ec86bd51-57c3-469e-967d-851a42be041f\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-jwp9w"
Jul 15 21:29:46.424086 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:46.424006    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/43c5f71f-98e5-4ed1-aa69-bfb6a8815cae-telemetry-config\") pod \"cluster-monitoring-operator-5f7f494dd4-hgkh9\" (UID: \"43c5f71f-98e5-4ed1-aa69-bfb6a8815cae\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-hgkh9"
Jul 15 21:29:46.424086 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:46.424017    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/1683be20-36a0-4ca3-b861-972d9805c362-config\") pod \"kube-storage-version-migrator-operator-799cb7f958-2jn97\" (UID: \"1683be20-36a0-4ca3-b861-972d9805c362\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-2jn97"
Jul 15 21:29:46.424423 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:46.424090    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5kj79\" (UniqueName: \"kubernetes.io/projected/7c107438-4a43-49fe-9bcb-a9c114c05d85-kube-api-access-5kj79\") pod \"insights-operator-68d9dd94cf-j57mj\" (UID: \"7c107438-4a43-49fe-9bcb-a9c114c05d85\") " pod="openshift-insights/insights-operator-68d9dd94cf-j57mj"
Jul 15 21:29:46.424423 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:46.424122    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/43c5f71f-98e5-4ed1-aa69-bfb6a8815cae-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-hgkh9\" (UID: \"43c5f71f-98e5-4ed1-aa69-bfb6a8815cae\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-hgkh9"
Jul 15 21:29:46.424423 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:46.424150    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c6249c00-aa11-475f-a2a5-62cd7999fdd0-image-registry-private-configuration\") pod \"image-registry-df786567c-xhldd\" (UID: \"c6249c00-aa11-475f-a2a5-62cd7999fdd0\") " pod="openshift-image-registry/image-registry-df786567c-xhldd"
Jul 15 21:29:46.424423 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:46.424175    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/9b4bbb5d-a934-4ca1-807d-c760d336c01d-default-certificate\") pod \"router-default-7bc9859798-z9kjp\" (UID: \"9b4bbb5d-a934-4ca1-807d-c760d336c01d\") " pod="openshift-ingress/router-default-7bc9859798-z9kjp"
Jul 15 21:29:46.424423 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:46.424176    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7c107438-4a43-49fe-9bcb-a9c114c05d85-tmp\") pod \"insights-operator-68d9dd94cf-j57mj\" (UID: \"7c107438-4a43-49fe-9bcb-a9c114c05d85\") " pod="openshift-insights/insights-operator-68d9dd94cf-j57mj"
Jul 15 21:29:46.424423 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:46.424214    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pzd6d\" (UniqueName: \"kubernetes.io/projected/d806e382-01da-4412-b627-a52c8b0da47e-kube-api-access-pzd6d\") pod \"service-ca-operator-7695fc6c8c-8dqhg\" (UID: \"d806e382-01da-4412-b627-a52c8b0da47e\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-8dqhg"
Jul 15 21:29:46.424423 ip-10-0-130-217 kubenswrapper[2563]: E0715 21:29:46.424257    2563 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 15 21:29:46.424423 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:46.424318    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c6249c00-aa11-475f-a2a5-62cd7999fdd0-registry-tls\") pod \"image-registry-df786567c-xhldd\" (UID: \"c6249c00-aa11-475f-a2a5-62cd7999fdd0\") " pod="openshift-image-registry/image-registry-df786567c-xhldd"
Jul 15 21:29:46.424423 ip-10-0-130-217 kubenswrapper[2563]: E0715 21:29:46.424354    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/43c5f71f-98e5-4ed1-aa69-bfb6a8815cae-cluster-monitoring-operator-tls podName:43c5f71f-98e5-4ed1-aa69-bfb6a8815cae nodeName:}" failed. No retries permitted until 2026-07-15 21:29:46.924337227 +0000 UTC m=+36.618264767 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/43c5f71f-98e5-4ed1-aa69-bfb6a8815cae-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-hgkh9" (UID: "43c5f71f-98e5-4ed1-aa69-bfb6a8815cae") : secret "cluster-monitoring-operator-tls" not found
Jul 15 21:29:46.424423 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:46.424370    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c6249c00-aa11-475f-a2a5-62cd7999fdd0-registry-certificates\") pod \"image-registry-df786567c-xhldd\" (UID: \"c6249c00-aa11-475f-a2a5-62cd7999fdd0\") " pod="openshift-image-registry/image-registry-df786567c-xhldd"
Jul 15 21:29:46.424813 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:46.424700    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7c107438-4a43-49fe-9bcb-a9c114c05d85-trusted-ca-bundle\") pod \"insights-operator-68d9dd94cf-j57mj\" (UID: \"7c107438-4a43-49fe-9bcb-a9c114c05d85\") " pod="openshift-insights/insights-operator-68d9dd94cf-j57mj"
Jul 15 21:29:46.428280 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:46.428259    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7c107438-4a43-49fe-9bcb-a9c114c05d85-serving-cert\") pod \"insights-operator-68d9dd94cf-j57mj\" (UID: \"7c107438-4a43-49fe-9bcb-a9c114c05d85\") " pod="openshift-insights/insights-operator-68d9dd94cf-j57mj"
Jul 15 21:29:46.432224 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:46.432180    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xlcq2\" (UniqueName: \"kubernetes.io/projected/43c5f71f-98e5-4ed1-aa69-bfb6a8815cae-kube-api-access-xlcq2\") pod \"cluster-monitoring-operator-5f7f494dd4-hgkh9\" (UID: \"43c5f71f-98e5-4ed1-aa69-bfb6a8815cae\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-hgkh9"
Jul 15 21:29:46.433146 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:46.433091    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lq76z\" (UniqueName: \"kubernetes.io/projected/ec86bd51-57c3-469e-967d-851a42be041f-kube-api-access-lq76z\") pod \"volume-data-source-validator-78495597f6-jwp9w\" (UID: \"ec86bd51-57c3-469e-967d-851a42be041f\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-jwp9w"
Jul 15 21:29:46.433256 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:46.433179    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5kj79\" (UniqueName: \"kubernetes.io/projected/7c107438-4a43-49fe-9bcb-a9c114c05d85-kube-api-access-5kj79\") pod \"insights-operator-68d9dd94cf-j57mj\" (UID: \"7c107438-4a43-49fe-9bcb-a9c114c05d85\") " pod="openshift-insights/insights-operator-68d9dd94cf-j57mj"
Jul 15 21:29:46.519988 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:46.519893    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-68d9dd94cf-j57mj"
Jul 15 21:29:46.525224 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:46.525198    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d2dd5a89-4ca3-4790-aed4-a4f948651d72-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-dtcjn\" (UID: \"d2dd5a89-4ca3-4790-aed4-a4f948651d72\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-dtcjn"
Jul 15 21:29:46.525348 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:46.525231    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c6249c00-aa11-475f-a2a5-62cd7999fdd0-bound-sa-token\") pod \"image-registry-df786567c-xhldd\" (UID: \"c6249c00-aa11-475f-a2a5-62cd7999fdd0\") " pod="openshift-image-registry/image-registry-df786567c-xhldd"
Jul 15 21:29:46.525348 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:46.525254    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c6249c00-aa11-475f-a2a5-62cd7999fdd0-ca-trust-extracted\") pod \"image-registry-df786567c-xhldd\" (UID: \"c6249c00-aa11-475f-a2a5-62cd7999fdd0\") " pod="openshift-image-registry/image-registry-df786567c-xhldd"
Jul 15 21:29:46.525348 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:46.525276    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/9b4bbb5d-a934-4ca1-807d-c760d336c01d-stats-auth\") pod \"router-default-7bc9859798-z9kjp\" (UID: \"9b4bbb5d-a934-4ca1-807d-c760d336c01d\") " pod="openshift-ingress/router-default-7bc9859798-z9kjp"
Jul 15 21:29:46.525348 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:46.525302    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9b97af79-5c4a-4622-8d74-04d470841a53-trusted-ca\") pod \"console-operator-7866497494-zlsbs\" (UID: \"9b97af79-5c4a-4622-8d74-04d470841a53\") " pod="openshift-console-operator/console-operator-7866497494-zlsbs"
Jul 15 21:29:46.525348 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:46.525329    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b9mqt\" (UniqueName: \"kubernetes.io/projected/d2dd5a89-4ca3-4790-aed4-a4f948651d72-kube-api-access-b9mqt\") pod \"cluster-samples-operator-65db858894-dtcjn\" (UID: \"d2dd5a89-4ca3-4790-aed4-a4f948651d72\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-dtcjn"
Jul 15 21:29:46.525619 ip-10-0-130-217 kubenswrapper[2563]: E0715 21:29:46.525368    2563 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 15 21:29:46.525619 ip-10-0-130-217 kubenswrapper[2563]: E0715 21:29:46.525571    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d2dd5a89-4ca3-4790-aed4-a4f948651d72-samples-operator-tls podName:d2dd5a89-4ca3-4790-aed4-a4f948651d72 nodeName:}" failed. No retries permitted until 2026-07-15 21:29:47.025545351 +0000 UTC m=+36.719472909 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/d2dd5a89-4ca3-4790-aed4-a4f948651d72-samples-operator-tls") pod "cluster-samples-operator-65db858894-dtcjn" (UID: "d2dd5a89-4ca3-4790-aed4-a4f948651d72") : secret "samples-operator-tls" not found
Jul 15 21:29:46.525721 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:46.525619    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/a2939e65-0409-4060-a51e-59bc7a1f6600-config-volume\") pod \"dns-default-l8f7b\" (UID: \"a2939e65-0409-4060-a51e-59bc7a1f6600\") " pod="openshift-dns/dns-default-l8f7b"
Jul 15 21:29:46.525721 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:46.525661    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4bz4f\" (UniqueName: \"kubernetes.io/projected/a2939e65-0409-4060-a51e-59bc7a1f6600-kube-api-access-4bz4f\") pod \"dns-default-l8f7b\" (UID: \"a2939e65-0409-4060-a51e-59bc7a1f6600\") " pod="openshift-dns/dns-default-l8f7b"
Jul 15 21:29:46.525721 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:46.525702    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9dk7g\" (UniqueName: \"kubernetes.io/projected/9b97af79-5c4a-4622-8d74-04d470841a53-kube-api-access-9dk7g\") pod \"console-operator-7866497494-zlsbs\" (UID: \"9b97af79-5c4a-4622-8d74-04d470841a53\") " pod="openshift-console-operator/console-operator-7866497494-zlsbs"
Jul 15 21:29:46.525721 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:46.525704    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c6249c00-aa11-475f-a2a5-62cd7999fdd0-ca-trust-extracted\") pod \"image-registry-df786567c-xhldd\" (UID: \"c6249c00-aa11-475f-a2a5-62cd7999fdd0\") " pod="openshift-image-registry/image-registry-df786567c-xhldd"
Jul 15 21:29:46.525997 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:46.525735    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g2zh9\" (UniqueName: \"kubernetes.io/projected/1683be20-36a0-4ca3-b861-972d9805c362-kube-api-access-g2zh9\") pod \"kube-storage-version-migrator-operator-799cb7f958-2jn97\" (UID: \"1683be20-36a0-4ca3-b861-972d9805c362\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-2jn97"
Jul 15 21:29:46.525997 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:46.525797    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bw6b5\" (UniqueName: \"kubernetes.io/projected/c6249c00-aa11-475f-a2a5-62cd7999fdd0-kube-api-access-bw6b5\") pod \"image-registry-df786567c-xhldd\" (UID: \"c6249c00-aa11-475f-a2a5-62cd7999fdd0\") " pod="openshift-image-registry/image-registry-df786567c-xhldd"
Jul 15 21:29:46.525997 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:46.525851    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/1683be20-36a0-4ca3-b861-972d9805c362-config\") pod \"kube-storage-version-migrator-operator-799cb7f958-2jn97\" (UID: \"1683be20-36a0-4ca3-b861-972d9805c362\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-2jn97"
Jul 15 21:29:46.525997 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:46.525897    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ckfm6\" (UniqueName: \"kubernetes.io/projected/0b013345-f721-445a-94cf-cad6851085c3-kube-api-access-ckfm6\") pod \"network-check-source-869dcfcdcd-hv4rg\" (UID: \"0b013345-f721-445a-94cf-cad6851085c3\") " pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-hv4rg"
Jul 15 21:29:46.525997 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:46.525973    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c6249c00-aa11-475f-a2a5-62cd7999fdd0-image-registry-private-configuration\") pod \"image-registry-df786567c-xhldd\" (UID: \"c6249c00-aa11-475f-a2a5-62cd7999fdd0\") " pod="openshift-image-registry/image-registry-df786567c-xhldd"
Jul 15 21:29:46.526229 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:46.526037    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/9b4bbb5d-a934-4ca1-807d-c760d336c01d-default-certificate\") pod \"router-default-7bc9859798-z9kjp\" (UID: \"9b4bbb5d-a934-4ca1-807d-c760d336c01d\") " pod="openshift-ingress/router-default-7bc9859798-z9kjp"
Jul 15 21:29:46.526229 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:46.526071    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d912f2b6-80b8-4639-be45-72e51e7b565f-cert\") pod \"ingress-canary-2jskd\" (UID: \"d912f2b6-80b8-4639-be45-72e51e7b565f\") " pod="openshift-ingress-canary/ingress-canary-2jskd"
Jul 15 21:29:46.526229 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:46.526096    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rn4lb\" (UniqueName: \"kubernetes.io/projected/d912f2b6-80b8-4639-be45-72e51e7b565f-kube-api-access-rn4lb\") pod \"ingress-canary-2jskd\" (UID: \"d912f2b6-80b8-4639-be45-72e51e7b565f\") " pod="openshift-ingress-canary/ingress-canary-2jskd"
Jul 15 21:29:46.526229 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:46.526145    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pzd6d\" (UniqueName: \"kubernetes.io/projected/d806e382-01da-4412-b627-a52c8b0da47e-kube-api-access-pzd6d\") pod \"service-ca-operator-7695fc6c8c-8dqhg\" (UID: \"d806e382-01da-4412-b627-a52c8b0da47e\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-8dqhg"
Jul 15 21:29:46.526414 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:46.526253    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c6249c00-aa11-475f-a2a5-62cd7999fdd0-registry-tls\") pod \"image-registry-df786567c-xhldd\" (UID: \"c6249c00-aa11-475f-a2a5-62cd7999fdd0\") " pod="openshift-image-registry/image-registry-df786567c-xhldd"
Jul 15 21:29:46.526414 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:46.526377    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c6249c00-aa11-475f-a2a5-62cd7999fdd0-registry-certificates\") pod \"image-registry-df786567c-xhldd\" (UID: \"c6249c00-aa11-475f-a2a5-62cd7999fdd0\") " pod="openshift-image-registry/image-registry-df786567c-xhldd"
Jul 15 21:29:46.526414 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:46.526408    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c6249c00-aa11-475f-a2a5-62cd7999fdd0-installation-pull-secrets\") pod \"image-registry-df786567c-xhldd\" (UID: \"c6249c00-aa11-475f-a2a5-62cd7999fdd0\") " pod="openshift-image-registry/image-registry-df786567c-xhldd"
Jul 15 21:29:46.526672 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:46.526647    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/1683be20-36a0-4ca3-b861-972d9805c362-config\") pod \"kube-storage-version-migrator-operator-799cb7f958-2jn97\" (UID: \"1683be20-36a0-4ca3-b861-972d9805c362\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-2jn97"
Jul 15 21:29:46.526750 ip-10-0-130-217 kubenswrapper[2563]: E0715 21:29:46.526733    2563 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 15 21:29:46.526803 ip-10-0-130-217 kubenswrapper[2563]: E0715 21:29:46.526777    2563 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-df786567c-xhldd: secret "image-registry-tls" not found
Jul 15 21:29:46.526854 ip-10-0-130-217 kubenswrapper[2563]: E0715 21:29:46.526825    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c6249c00-aa11-475f-a2a5-62cd7999fdd0-registry-tls podName:c6249c00-aa11-475f-a2a5-62cd7999fdd0 nodeName:}" failed. No retries permitted until 2026-07-15 21:29:47.026808854 +0000 UTC m=+36.720736387 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c6249c00-aa11-475f-a2a5-62cd7999fdd0-registry-tls") pod "image-registry-df786567c-xhldd" (UID: "c6249c00-aa11-475f-a2a5-62cd7999fdd0") : secret "image-registry-tls" not found
Jul 15 21:29:46.526911 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:46.526867    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9b4bbb5d-a934-4ca1-807d-c760d336c01d-service-ca-bundle\") pod \"router-default-7bc9859798-z9kjp\" (UID: \"9b4bbb5d-a934-4ca1-807d-c760d336c01d\") " pod="openshift-ingress/router-default-7bc9859798-z9kjp"
Jul 15 21:29:46.527009 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:46.526930    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c6249c00-aa11-475f-a2a5-62cd7999fdd0-registry-certificates\") pod \"image-registry-df786567c-xhldd\" (UID: \"c6249c00-aa11-475f-a2a5-62cd7999fdd0\") " pod="openshift-image-registry/image-registry-df786567c-xhldd"
Jul 15 21:29:46.527009 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:46.526970    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9b97af79-5c4a-4622-8d74-04d470841a53-trusted-ca\") pod \"console-operator-7866497494-zlsbs\" (UID: \"9b97af79-5c4a-4622-8d74-04d470841a53\") " pod="openshift-console-operator/console-operator-7866497494-zlsbs"
Jul 15 21:29:46.527117 ip-10-0-130-217 kubenswrapper[2563]: E0715 21:29:46.527017    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9b4bbb5d-a934-4ca1-807d-c760d336c01d-service-ca-bundle podName:9b4bbb5d-a934-4ca1-807d-c760d336c01d nodeName:}" failed. No retries permitted until 2026-07-15 21:29:47.026999465 +0000 UTC m=+36.720926994 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/9b4bbb5d-a934-4ca1-807d-c760d336c01d-service-ca-bundle") pod "router-default-7bc9859798-z9kjp" (UID: "9b4bbb5d-a934-4ca1-807d-c760d336c01d") : configmap references non-existent config key: service-ca.crt
Jul 15 21:29:46.527117 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:46.527038    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d806e382-01da-4412-b627-a52c8b0da47e-config\") pod \"service-ca-operator-7695fc6c8c-8dqhg\" (UID: \"d806e382-01da-4412-b627-a52c8b0da47e\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-8dqhg"
Jul 15 21:29:46.527117 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:46.527068    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a2939e65-0409-4060-a51e-59bc7a1f6600-metrics-tls\") pod \"dns-default-l8f7b\" (UID: \"a2939e65-0409-4060-a51e-59bc7a1f6600\") " pod="openshift-dns/dns-default-l8f7b"
Jul 15 21:29:46.527268 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:46.527151    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/9b97af79-5c4a-4622-8d74-04d470841a53-serving-cert\") pod \"console-operator-7866497494-zlsbs\" (UID: \"9b97af79-5c4a-4622-8d74-04d470841a53\") " pod="openshift-console-operator/console-operator-7866497494-zlsbs"
Jul 15 21:29:46.527268 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:46.527179    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9b4bbb5d-a934-4ca1-807d-c760d336c01d-metrics-certs\") pod \"router-default-7bc9859798-z9kjp\" (UID: \"9b4bbb5d-a934-4ca1-807d-c760d336c01d\") " pod="openshift-ingress/router-default-7bc9859798-z9kjp"
Jul 15 21:29:46.527268 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:46.527213    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/9b97af79-5c4a-4622-8d74-04d470841a53-config\") pod \"console-operator-7866497494-zlsbs\" (UID: \"9b97af79-5c4a-4622-8d74-04d470841a53\") " pod="openshift-console-operator/console-operator-7866497494-zlsbs"
Jul 15 21:29:46.527268 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:46.527249    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d806e382-01da-4412-b627-a52c8b0da47e-serving-cert\") pod \"service-ca-operator-7695fc6c8c-8dqhg\" (UID: \"d806e382-01da-4412-b627-a52c8b0da47e\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-8dqhg"
Jul 15 21:29:46.527469 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:46.527299    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c6249c00-aa11-475f-a2a5-62cd7999fdd0-trusted-ca\") pod \"image-registry-df786567c-xhldd\" (UID: \"c6249c00-aa11-475f-a2a5-62cd7999fdd0\") " pod="openshift-image-registry/image-registry-df786567c-xhldd"
Jul 15 21:29:46.527469 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:46.527335    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9xhvz\" (UniqueName: \"kubernetes.io/projected/9b4bbb5d-a934-4ca1-807d-c760d336c01d-kube-api-access-9xhvz\") pod \"router-default-7bc9859798-z9kjp\" (UID: \"9b4bbb5d-a934-4ca1-807d-c760d336c01d\") " pod="openshift-ingress/router-default-7bc9859798-z9kjp"
Jul 15 21:29:46.527469 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:46.527361    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/1683be20-36a0-4ca3-b861-972d9805c362-serving-cert\") pod \"kube-storage-version-migrator-operator-799cb7f958-2jn97\" (UID: \"1683be20-36a0-4ca3-b861-972d9805c362\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-2jn97"
Jul 15 21:29:46.527469 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:46.527386    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a2939e65-0409-4060-a51e-59bc7a1f6600-tmp-dir\") pod \"dns-default-l8f7b\" (UID: \"a2939e65-0409-4060-a51e-59bc7a1f6600\") " pod="openshift-dns/dns-default-l8f7b"
Jul 15 21:29:46.527667 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:46.527514    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d806e382-01da-4412-b627-a52c8b0da47e-config\") pod \"service-ca-operator-7695fc6c8c-8dqhg\" (UID: \"d806e382-01da-4412-b627-a52c8b0da47e\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-8dqhg"
Jul 15 21:29:46.527667 ip-10-0-130-217 kubenswrapper[2563]: E0715 21:29:46.527518    2563 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 15 21:29:46.527667 ip-10-0-130-217 kubenswrapper[2563]: E0715 21:29:46.527610    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9b4bbb5d-a934-4ca1-807d-c760d336c01d-metrics-certs podName:9b4bbb5d-a934-4ca1-807d-c760d336c01d nodeName:}" failed. No retries permitted until 2026-07-15 21:29:47.027592293 +0000 UTC m=+36.721519836 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9b4bbb5d-a934-4ca1-807d-c760d336c01d-metrics-certs") pod "router-default-7bc9859798-z9kjp" (UID: "9b4bbb5d-a934-4ca1-807d-c760d336c01d") : secret "router-metrics-certs-default" not found
Jul 15 21:29:46.529035 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:46.528703    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/9b4bbb5d-a934-4ca1-807d-c760d336c01d-stats-auth\") pod \"router-default-7bc9859798-z9kjp\" (UID: \"9b4bbb5d-a934-4ca1-807d-c760d336c01d\") " pod="openshift-ingress/router-default-7bc9859798-z9kjp"
Jul 15 21:29:46.529136 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:46.529093    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c6249c00-aa11-475f-a2a5-62cd7999fdd0-installation-pull-secrets\") pod \"image-registry-df786567c-xhldd\" (UID: \"c6249c00-aa11-475f-a2a5-62cd7999fdd0\") " pod="openshift-image-registry/image-registry-df786567c-xhldd"
Jul 15 21:29:46.529338 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:46.529273    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c6249c00-aa11-475f-a2a5-62cd7999fdd0-trusted-ca\") pod \"image-registry-df786567c-xhldd\" (UID: \"c6249c00-aa11-475f-a2a5-62cd7999fdd0\") " pod="openshift-image-registry/image-registry-df786567c-xhldd"
Jul 15 21:29:46.529783 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:46.529734    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/9b97af79-5c4a-4622-8d74-04d470841a53-config\") pod \"console-operator-7866497494-zlsbs\" (UID: \"9b97af79-5c4a-4622-8d74-04d470841a53\") " pod="openshift-console-operator/console-operator-7866497494-zlsbs"
Jul 15 21:29:46.529879 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:46.529832    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/9b97af79-5c4a-4622-8d74-04d470841a53-serving-cert\") pod \"console-operator-7866497494-zlsbs\" (UID: \"9b97af79-5c4a-4622-8d74-04d470841a53\") " pod="openshift-console-operator/console-operator-7866497494-zlsbs"
Jul 15 21:29:46.530512 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:46.530414    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/9b4bbb5d-a934-4ca1-807d-c760d336c01d-default-certificate\") pod \"router-default-7bc9859798-z9kjp\" (UID: \"9b4bbb5d-a934-4ca1-807d-c760d336c01d\") " pod="openshift-ingress/router-default-7bc9859798-z9kjp"
Jul 15 21:29:46.530512 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:46.530494    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-jwp9w"
Jul 15 21:29:46.531099 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:46.531078    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d806e382-01da-4412-b627-a52c8b0da47e-serving-cert\") pod \"service-ca-operator-7695fc6c8c-8dqhg\" (UID: \"d806e382-01da-4412-b627-a52c8b0da47e\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-8dqhg"
Jul 15 21:29:46.531194 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:46.531129    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/1683be20-36a0-4ca3-b861-972d9805c362-serving-cert\") pod \"kube-storage-version-migrator-operator-799cb7f958-2jn97\" (UID: \"1683be20-36a0-4ca3-b861-972d9805c362\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-2jn97"
Jul 15 21:29:46.531457 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:46.531440    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c6249c00-aa11-475f-a2a5-62cd7999fdd0-image-registry-private-configuration\") pod \"image-registry-df786567c-xhldd\" (UID: \"c6249c00-aa11-475f-a2a5-62cd7999fdd0\") " pod="openshift-image-registry/image-registry-df786567c-xhldd"
Jul 15 21:29:46.534122 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:46.534056    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c6249c00-aa11-475f-a2a5-62cd7999fdd0-bound-sa-token\") pod \"image-registry-df786567c-xhldd\" (UID: \"c6249c00-aa11-475f-a2a5-62cd7999fdd0\") " pod="openshift-image-registry/image-registry-df786567c-xhldd"
Jul 15 21:29:46.534445 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:46.534423    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9dk7g\" (UniqueName: \"kubernetes.io/projected/9b97af79-5c4a-4622-8d74-04d470841a53-kube-api-access-9dk7g\") pod \"console-operator-7866497494-zlsbs\" (UID: \"9b97af79-5c4a-4622-8d74-04d470841a53\") " pod="openshift-console-operator/console-operator-7866497494-zlsbs"
Jul 15 21:29:46.534527 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:46.534424    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bw6b5\" (UniqueName: \"kubernetes.io/projected/c6249c00-aa11-475f-a2a5-62cd7999fdd0-kube-api-access-bw6b5\") pod \"image-registry-df786567c-xhldd\" (UID: \"c6249c00-aa11-475f-a2a5-62cd7999fdd0\") " pod="openshift-image-registry/image-registry-df786567c-xhldd"
Jul 15 21:29:46.534768 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:46.534745    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pzd6d\" (UniqueName: \"kubernetes.io/projected/d806e382-01da-4412-b627-a52c8b0da47e-kube-api-access-pzd6d\") pod \"service-ca-operator-7695fc6c8c-8dqhg\" (UID: \"d806e382-01da-4412-b627-a52c8b0da47e\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-8dqhg"
Jul 15 21:29:46.535870 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:46.535822    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9xhvz\" (UniqueName: \"kubernetes.io/projected/9b4bbb5d-a934-4ca1-807d-c760d336c01d-kube-api-access-9xhvz\") pod \"router-default-7bc9859798-z9kjp\" (UID: \"9b4bbb5d-a934-4ca1-807d-c760d336c01d\") " pod="openshift-ingress/router-default-7bc9859798-z9kjp"
Jul 15 21:29:46.536272 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:46.536231    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g2zh9\" (UniqueName: \"kubernetes.io/projected/1683be20-36a0-4ca3-b861-972d9805c362-kube-api-access-g2zh9\") pod \"kube-storage-version-migrator-operator-799cb7f958-2jn97\" (UID: \"1683be20-36a0-4ca3-b861-972d9805c362\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-2jn97"
Jul 15 21:29:46.538820 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:46.538800    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b9mqt\" (UniqueName: \"kubernetes.io/projected/d2dd5a89-4ca3-4790-aed4-a4f948651d72-kube-api-access-b9mqt\") pod \"cluster-samples-operator-65db858894-dtcjn\" (UID: \"d2dd5a89-4ca3-4790-aed4-a4f948651d72\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-dtcjn"
Jul 15 21:29:46.590223 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:46.590050    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-7866497494-zlsbs"
Jul 15 21:29:46.607213 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:46.607186    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-2jn97"
Jul 15 21:29:46.621917 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:46.621894    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-8dqhg"
Jul 15 21:29:46.628177 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:46.628153    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ckfm6\" (UniqueName: \"kubernetes.io/projected/0b013345-f721-445a-94cf-cad6851085c3-kube-api-access-ckfm6\") pod \"network-check-source-869dcfcdcd-hv4rg\" (UID: \"0b013345-f721-445a-94cf-cad6851085c3\") " pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-hv4rg"
Jul 15 21:29:46.628288 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:46.628202    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d912f2b6-80b8-4639-be45-72e51e7b565f-cert\") pod \"ingress-canary-2jskd\" (UID: \"d912f2b6-80b8-4639-be45-72e51e7b565f\") " pod="openshift-ingress-canary/ingress-canary-2jskd"
Jul 15 21:29:46.628288 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:46.628223    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rn4lb\" (UniqueName: \"kubernetes.io/projected/d912f2b6-80b8-4639-be45-72e51e7b565f-kube-api-access-rn4lb\") pod \"ingress-canary-2jskd\" (UID: \"d912f2b6-80b8-4639-be45-72e51e7b565f\") " pod="openshift-ingress-canary/ingress-canary-2jskd"
Jul 15 21:29:46.628400 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:46.628323    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a2939e65-0409-4060-a51e-59bc7a1f6600-metrics-tls\") pod \"dns-default-l8f7b\" (UID: \"a2939e65-0409-4060-a51e-59bc7a1f6600\") " pod="openshift-dns/dns-default-l8f7b"
Jul 15 21:29:46.628444 ip-10-0-130-217 kubenswrapper[2563]: E0715 21:29:46.628419    2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 15 21:29:46.628502 ip-10-0-130-217 kubenswrapper[2563]: E0715 21:29:46.628488    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a2939e65-0409-4060-a51e-59bc7a1f6600-metrics-tls podName:a2939e65-0409-4060-a51e-59bc7a1f6600 nodeName:}" failed. No retries permitted until 2026-07-15 21:29:47.128469495 +0000 UTC m=+36.822397026 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a2939e65-0409-4060-a51e-59bc7a1f6600-metrics-tls") pod "dns-default-l8f7b" (UID: "a2939e65-0409-4060-a51e-59bc7a1f6600") : secret "dns-default-metrics-tls" not found
Jul 15 21:29:46.628605 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:46.628588    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a2939e65-0409-4060-a51e-59bc7a1f6600-tmp-dir\") pod \"dns-default-l8f7b\" (UID: \"a2939e65-0409-4060-a51e-59bc7a1f6600\") " pod="openshift-dns/dns-default-l8f7b"
Jul 15 21:29:46.628674 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:46.628657    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/a2939e65-0409-4060-a51e-59bc7a1f6600-config-volume\") pod \"dns-default-l8f7b\" (UID: \"a2939e65-0409-4060-a51e-59bc7a1f6600\") " pod="openshift-dns/dns-default-l8f7b"
Jul 15 21:29:46.628791 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:46.628689    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4bz4f\" (UniqueName: \"kubernetes.io/projected/a2939e65-0409-4060-a51e-59bc7a1f6600-kube-api-access-4bz4f\") pod \"dns-default-l8f7b\" (UID: \"a2939e65-0409-4060-a51e-59bc7a1f6600\") " pod="openshift-dns/dns-default-l8f7b"
Jul 15 21:29:46.629009 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:46.628981    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a2939e65-0409-4060-a51e-59bc7a1f6600-tmp-dir\") pod \"dns-default-l8f7b\" (UID: \"a2939e65-0409-4060-a51e-59bc7a1f6600\") " pod="openshift-dns/dns-default-l8f7b"
Jul 15 21:29:46.629247 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:46.629230    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/a2939e65-0409-4060-a51e-59bc7a1f6600-config-volume\") pod \"dns-default-l8f7b\" (UID: \"a2939e65-0409-4060-a51e-59bc7a1f6600\") " pod="openshift-dns/dns-default-l8f7b"
Jul 15 21:29:46.631052 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:46.631031    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d912f2b6-80b8-4639-be45-72e51e7b565f-cert\") pod \"ingress-canary-2jskd\" (UID: \"d912f2b6-80b8-4639-be45-72e51e7b565f\") " pod="openshift-ingress-canary/ingress-canary-2jskd"
Jul 15 21:29:46.638324 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:46.638300    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4bz4f\" (UniqueName: \"kubernetes.io/projected/a2939e65-0409-4060-a51e-59bc7a1f6600-kube-api-access-4bz4f\") pod \"dns-default-l8f7b\" (UID: \"a2939e65-0409-4060-a51e-59bc7a1f6600\") " pod="openshift-dns/dns-default-l8f7b"
Jul 15 21:29:46.638924 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:46.638897    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rn4lb\" (UniqueName: \"kubernetes.io/projected/d912f2b6-80b8-4639-be45-72e51e7b565f-kube-api-access-rn4lb\") pod \"ingress-canary-2jskd\" (UID: \"d912f2b6-80b8-4639-be45-72e51e7b565f\") " pod="openshift-ingress-canary/ingress-canary-2jskd"
Jul 15 21:29:46.639107 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:46.639081    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ckfm6\" (UniqueName: \"kubernetes.io/projected/0b013345-f721-445a-94cf-cad6851085c3-kube-api-access-ckfm6\") pod \"network-check-source-869dcfcdcd-hv4rg\" (UID: \"0b013345-f721-445a-94cf-cad6851085c3\") " pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-hv4rg"
Jul 15 21:29:46.661169 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:46.661144    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-hv4rg"
Jul 15 21:29:46.682492 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:46.682476    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-2jskd"
Jul 15 21:29:46.931185 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:46.931149    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/43c5f71f-98e5-4ed1-aa69-bfb6a8815cae-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-hgkh9\" (UID: \"43c5f71f-98e5-4ed1-aa69-bfb6a8815cae\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-hgkh9"
Jul 15 21:29:46.931367 ip-10-0-130-217 kubenswrapper[2563]: E0715 21:29:46.931295    2563 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 15 21:29:46.931421 ip-10-0-130-217 kubenswrapper[2563]: E0715 21:29:46.931376    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/43c5f71f-98e5-4ed1-aa69-bfb6a8815cae-cluster-monitoring-operator-tls podName:43c5f71f-98e5-4ed1-aa69-bfb6a8815cae nodeName:}" failed. No retries permitted until 2026-07-15 21:29:47.931356042 +0000 UTC m=+37.625283574 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/43c5f71f-98e5-4ed1-aa69-bfb6a8815cae-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-hgkh9" (UID: "43c5f71f-98e5-4ed1-aa69-bfb6a8815cae") : secret "cluster-monitoring-operator-tls" not found
Jul 15 21:29:47.032189 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:47.032151    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9b4bbb5d-a934-4ca1-807d-c760d336c01d-metrics-certs\") pod \"router-default-7bc9859798-z9kjp\" (UID: \"9b4bbb5d-a934-4ca1-807d-c760d336c01d\") " pod="openshift-ingress/router-default-7bc9859798-z9kjp"
Jul 15 21:29:47.032632 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:47.032219    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d2dd5a89-4ca3-4790-aed4-a4f948651d72-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-dtcjn\" (UID: \"d2dd5a89-4ca3-4790-aed4-a4f948651d72\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-dtcjn"
Jul 15 21:29:47.032632 ip-10-0-130-217 kubenswrapper[2563]: E0715 21:29:47.032312    2563 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 15 21:29:47.032632 ip-10-0-130-217 kubenswrapper[2563]: E0715 21:29:47.032340    2563 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 15 21:29:47.032632 ip-10-0-130-217 kubenswrapper[2563]: E0715 21:29:47.032382    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9b4bbb5d-a934-4ca1-807d-c760d336c01d-metrics-certs podName:9b4bbb5d-a934-4ca1-807d-c760d336c01d nodeName:}" failed. No retries permitted until 2026-07-15 21:29:48.032363911 +0000 UTC m=+37.726291461 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9b4bbb5d-a934-4ca1-807d-c760d336c01d-metrics-certs") pod "router-default-7bc9859798-z9kjp" (UID: "9b4bbb5d-a934-4ca1-807d-c760d336c01d") : secret "router-metrics-certs-default" not found
Jul 15 21:29:47.032632 ip-10-0-130-217 kubenswrapper[2563]: E0715 21:29:47.032403    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d2dd5a89-4ca3-4790-aed4-a4f948651d72-samples-operator-tls podName:d2dd5a89-4ca3-4790-aed4-a4f948651d72 nodeName:}" failed. No retries permitted until 2026-07-15 21:29:48.03239279 +0000 UTC m=+37.726320321 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/d2dd5a89-4ca3-4790-aed4-a4f948651d72-samples-operator-tls") pod "cluster-samples-operator-65db858894-dtcjn" (UID: "d2dd5a89-4ca3-4790-aed4-a4f948651d72") : secret "samples-operator-tls" not found
Jul 15 21:29:47.032632 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:47.032457    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c6249c00-aa11-475f-a2a5-62cd7999fdd0-registry-tls\") pod \"image-registry-df786567c-xhldd\" (UID: \"c6249c00-aa11-475f-a2a5-62cd7999fdd0\") " pod="openshift-image-registry/image-registry-df786567c-xhldd"
Jul 15 21:29:47.032632 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:47.032484    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9b4bbb5d-a934-4ca1-807d-c760d336c01d-service-ca-bundle\") pod \"router-default-7bc9859798-z9kjp\" (UID: \"9b4bbb5d-a934-4ca1-807d-c760d336c01d\") " pod="openshift-ingress/router-default-7bc9859798-z9kjp"
Jul 15 21:29:47.032632 ip-10-0-130-217 kubenswrapper[2563]: E0715 21:29:47.032585    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9b4bbb5d-a934-4ca1-807d-c760d336c01d-service-ca-bundle podName:9b4bbb5d-a934-4ca1-807d-c760d336c01d nodeName:}" failed. No retries permitted until 2026-07-15 21:29:48.032573303 +0000 UTC m=+37.726500850 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/9b4bbb5d-a934-4ca1-807d-c760d336c01d-service-ca-bundle") pod "router-default-7bc9859798-z9kjp" (UID: "9b4bbb5d-a934-4ca1-807d-c760d336c01d") : configmap references non-existent config key: service-ca.crt
Jul 15 21:29:47.032632 ip-10-0-130-217 kubenswrapper[2563]: E0715 21:29:47.032586    2563 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 15 21:29:47.032632 ip-10-0-130-217 kubenswrapper[2563]: E0715 21:29:47.032602    2563 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-df786567c-xhldd: secret "image-registry-tls" not found
Jul 15 21:29:47.033058 ip-10-0-130-217 kubenswrapper[2563]: E0715 21:29:47.032644    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c6249c00-aa11-475f-a2a5-62cd7999fdd0-registry-tls podName:c6249c00-aa11-475f-a2a5-62cd7999fdd0 nodeName:}" failed. No retries permitted until 2026-07-15 21:29:48.03262586 +0000 UTC m=+37.726553421 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c6249c00-aa11-475f-a2a5-62cd7999fdd0-registry-tls") pod "image-registry-df786567c-xhldd" (UID: "c6249c00-aa11-475f-a2a5-62cd7999fdd0") : secret "image-registry-tls" not found
Jul 15 21:29:47.133923 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:47.133878    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a2939e65-0409-4060-a51e-59bc7a1f6600-metrics-tls\") pod \"dns-default-l8f7b\" (UID: \"a2939e65-0409-4060-a51e-59bc7a1f6600\") " pod="openshift-dns/dns-default-l8f7b"
Jul 15 21:29:47.134114 ip-10-0-130-217 kubenswrapper[2563]: E0715 21:29:47.134063    2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 15 21:29:47.134178 ip-10-0-130-217 kubenswrapper[2563]: E0715 21:29:47.134144    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a2939e65-0409-4060-a51e-59bc7a1f6600-metrics-tls podName:a2939e65-0409-4060-a51e-59bc7a1f6600 nodeName:}" failed. No retries permitted until 2026-07-15 21:29:48.134122025 +0000 UTC m=+37.828049566 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a2939e65-0409-4060-a51e-59bc7a1f6600-metrics-tls") pod "dns-default-l8f7b" (UID: "a2939e65-0409-4060-a51e-59bc7a1f6600") : secret "dns-default-metrics-tls" not found
Jul 15 21:29:47.577978 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:47.577896    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-jwp9w"]
Jul 15 21:29:47.588911 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:47.588688    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-2jn97"]
Jul 15 21:29:47.590386 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:47.590313    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-2jskd"]
Jul 15 21:29:47.591185 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:47.591162    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-68d9dd94cf-j57mj"]
Jul 15 21:29:47.592065 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:47.592040    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd912f2b6_80b8_4639_be45_72e51e7b565f.slice/crio-a07a3e16c7e8770253133943b86295452c810fddaa88499c1eaf12ce5044fbd3 WatchSource:0}: Error finding container a07a3e16c7e8770253133943b86295452c810fddaa88499c1eaf12ce5044fbd3: Status 404 returned error can't find the container with id a07a3e16c7e8770253133943b86295452c810fddaa88499c1eaf12ce5044fbd3
Jul 15 21:29:47.597260 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:47.595629    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1683be20_36a0_4ca3_b861_972d9805c362.slice/crio-3272f1327a2c458432a270dc3cd12ee48560f9e3774161bee6bed089a6b705e7 WatchSource:0}: Error finding container 3272f1327a2c458432a270dc3cd12ee48560f9e3774161bee6bed089a6b705e7: Status 404 returned error can't find the container with id 3272f1327a2c458432a270dc3cd12ee48560f9e3774161bee6bed089a6b705e7
Jul 15 21:29:47.597260 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:47.596780    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7c107438_4a43_49fe_9bcb_a9c114c05d85.slice/crio-367223d4c906f67ebdd0349bb4053b3e0c9d6c4d0b9045882b4cc4f434c10c19 WatchSource:0}: Error finding container 367223d4c906f67ebdd0349bb4053b3e0c9d6c4d0b9045882b4cc4f434c10c19: Status 404 returned error can't find the container with id 367223d4c906f67ebdd0349bb4053b3e0c9d6c4d0b9045882b4cc4f434c10c19
Jul 15 21:29:47.598363 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:47.598337    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-869dcfcdcd-hv4rg"]
Jul 15 21:29:47.599290 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:47.599270    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7695fc6c8c-8dqhg"]
Jul 15 21:29:47.603651 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:47.602208    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-7866497494-zlsbs"]
Jul 15 21:29:47.605861 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:29:47.605775    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9b97af79_5c4a_4622_8d74_04d470841a53.slice/crio-b7c8593ea415bc138205a165b0b1182745fb9ebb2af93a081af7dccfc126afb7 WatchSource:0}: Error finding container b7c8593ea415bc138205a165b0b1182745fb9ebb2af93a081af7dccfc126afb7: Status 404 returned error can't find the container with id b7c8593ea415bc138205a165b0b1182745fb9ebb2af93a081af7dccfc126afb7
Jul 15 21:29:47.951080 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:47.951044    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/43c5f71f-98e5-4ed1-aa69-bfb6a8815cae-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-hgkh9\" (UID: \"43c5f71f-98e5-4ed1-aa69-bfb6a8815cae\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-hgkh9"
Jul 15 21:29:47.951249 ip-10-0-130-217 kubenswrapper[2563]: E0715 21:29:47.951197    2563 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 15 21:29:47.951291 ip-10-0-130-217 kubenswrapper[2563]: E0715 21:29:47.951262    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/43c5f71f-98e5-4ed1-aa69-bfb6a8815cae-cluster-monitoring-operator-tls podName:43c5f71f-98e5-4ed1-aa69-bfb6a8815cae nodeName:}" failed. No retries permitted until 2026-07-15 21:29:49.951246313 +0000 UTC m=+39.645173842 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/43c5f71f-98e5-4ed1-aa69-bfb6a8815cae-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-hgkh9" (UID: "43c5f71f-98e5-4ed1-aa69-bfb6a8815cae") : secret "cluster-monitoring-operator-tls" not found
Jul 15 21:29:47.982176 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:47.982147    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6tbzj"
Jul 15 21:29:47.982176 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:47.982159    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sj7lm"
Jul 15 21:29:47.982333 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:47.982257    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dw6kh"
Jul 15 21:29:47.984610 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:47.984593    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 15 21:29:47.984782 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:47.984767    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 15 21:29:47.985353 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:47.985337    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-8nwm9\""
Jul 15 21:29:47.985406 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:47.985337    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-75svw\""
Jul 15 21:29:48.051763 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:48.051730    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c6249c00-aa11-475f-a2a5-62cd7999fdd0-registry-tls\") pod \"image-registry-df786567c-xhldd\" (UID: \"c6249c00-aa11-475f-a2a5-62cd7999fdd0\") " pod="openshift-image-registry/image-registry-df786567c-xhldd"
Jul 15 21:29:48.051763 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:48.051763    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9b4bbb5d-a934-4ca1-807d-c760d336c01d-service-ca-bundle\") pod \"router-default-7bc9859798-z9kjp\" (UID: \"9b4bbb5d-a934-4ca1-807d-c760d336c01d\") " pod="openshift-ingress/router-default-7bc9859798-z9kjp"
Jul 15 21:29:48.052189 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:48.051804    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9b4bbb5d-a934-4ca1-807d-c760d336c01d-metrics-certs\") pod \"router-default-7bc9859798-z9kjp\" (UID: \"9b4bbb5d-a934-4ca1-807d-c760d336c01d\") " pod="openshift-ingress/router-default-7bc9859798-z9kjp"
Jul 15 21:29:48.052189 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:48.051843    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d2dd5a89-4ca3-4790-aed4-a4f948651d72-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-dtcjn\" (UID: \"d2dd5a89-4ca3-4790-aed4-a4f948651d72\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-dtcjn"
Jul 15 21:29:48.052189 ip-10-0-130-217 kubenswrapper[2563]: E0715 21:29:48.051918    2563 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 15 21:29:48.052189 ip-10-0-130-217 kubenswrapper[2563]: E0715 21:29:48.051959    2563 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 15 21:29:48.052189 ip-10-0-130-217 kubenswrapper[2563]: E0715 21:29:48.051968    2563 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 15 21:29:48.052189 ip-10-0-130-217 kubenswrapper[2563]: E0715 21:29:48.051960    2563 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-df786567c-xhldd: secret "image-registry-tls" not found
Jul 15 21:29:48.052189 ip-10-0-130-217 kubenswrapper[2563]: E0715 21:29:48.051922    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9b4bbb5d-a934-4ca1-807d-c760d336c01d-service-ca-bundle podName:9b4bbb5d-a934-4ca1-807d-c760d336c01d nodeName:}" failed. No retries permitted until 2026-07-15 21:29:50.051903398 +0000 UTC m=+39.745830932 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/9b4bbb5d-a934-4ca1-807d-c760d336c01d-service-ca-bundle") pod "router-default-7bc9859798-z9kjp" (UID: "9b4bbb5d-a934-4ca1-807d-c760d336c01d") : configmap references non-existent config key: service-ca.crt
Jul 15 21:29:48.052189 ip-10-0-130-217 kubenswrapper[2563]: E0715 21:29:48.052037    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d2dd5a89-4ca3-4790-aed4-a4f948651d72-samples-operator-tls podName:d2dd5a89-4ca3-4790-aed4-a4f948651d72 nodeName:}" failed. No retries permitted until 2026-07-15 21:29:50.052024776 +0000 UTC m=+39.745952308 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/d2dd5a89-4ca3-4790-aed4-a4f948651d72-samples-operator-tls") pod "cluster-samples-operator-65db858894-dtcjn" (UID: "d2dd5a89-4ca3-4790-aed4-a4f948651d72") : secret "samples-operator-tls" not found
Jul 15 21:29:48.052189 ip-10-0-130-217 kubenswrapper[2563]: E0715 21:29:48.052049    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9b4bbb5d-a934-4ca1-807d-c760d336c01d-metrics-certs podName:9b4bbb5d-a934-4ca1-807d-c760d336c01d nodeName:}" failed. No retries permitted until 2026-07-15 21:29:50.052042707 +0000 UTC m=+39.745970236 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9b4bbb5d-a934-4ca1-807d-c760d336c01d-metrics-certs") pod "router-default-7bc9859798-z9kjp" (UID: "9b4bbb5d-a934-4ca1-807d-c760d336c01d") : secret "router-metrics-certs-default" not found
Jul 15 21:29:48.052189 ip-10-0-130-217 kubenswrapper[2563]: E0715 21:29:48.052059    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c6249c00-aa11-475f-a2a5-62cd7999fdd0-registry-tls podName:c6249c00-aa11-475f-a2a5-62cd7999fdd0 nodeName:}" failed. No retries permitted until 2026-07-15 21:29:50.052052517 +0000 UTC m=+39.745980045 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c6249c00-aa11-475f-a2a5-62cd7999fdd0-registry-tls") pod "image-registry-df786567c-xhldd" (UID: "c6249c00-aa11-475f-a2a5-62cd7999fdd0") : secret "image-registry-tls" not found
Jul 15 21:29:48.153476 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:48.152714    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a2939e65-0409-4060-a51e-59bc7a1f6600-metrics-tls\") pod \"dns-default-l8f7b\" (UID: \"a2939e65-0409-4060-a51e-59bc7a1f6600\") " pod="openshift-dns/dns-default-l8f7b"
Jul 15 21:29:48.153670 ip-10-0-130-217 kubenswrapper[2563]: E0715 21:29:48.153648    2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 15 21:29:48.153777 ip-10-0-130-217 kubenswrapper[2563]: E0715 21:29:48.153722    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a2939e65-0409-4060-a51e-59bc7a1f6600-metrics-tls podName:a2939e65-0409-4060-a51e-59bc7a1f6600 nodeName:}" failed. No retries permitted until 2026-07-15 21:29:50.153701608 +0000 UTC m=+39.847629137 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a2939e65-0409-4060-a51e-59bc7a1f6600-metrics-tls") pod "dns-default-l8f7b" (UID: "a2939e65-0409-4060-a51e-59bc7a1f6600") : secret "dns-default-metrics-tls" not found
Jul 15 21:29:48.165855 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:48.165821    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-jwp9w" event={"ID":"ec86bd51-57c3-469e-967d-851a42be041f","Type":"ContainerStarted","Data":"32221e8ae756a3794af9f62b927ab29ec27e19eeacbc5badd2ba85840dc74ddc"}
Jul 15 21:29:48.169146 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:48.169113    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-zlsbs" event={"ID":"9b97af79-5c4a-4622-8d74-04d470841a53","Type":"ContainerStarted","Data":"b7c8593ea415bc138205a165b0b1182745fb9ebb2af93a081af7dccfc126afb7"}
Jul 15 21:29:48.172592 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:48.172392    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-2jskd" event={"ID":"d912f2b6-80b8-4639-be45-72e51e7b565f","Type":"ContainerStarted","Data":"a07a3e16c7e8770253133943b86295452c810fddaa88499c1eaf12ce5044fbd3"}
Jul 15 21:29:48.174258 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:48.174194    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-2jn97" event={"ID":"1683be20-36a0-4ca3-b861-972d9805c362","Type":"ContainerStarted","Data":"3272f1327a2c458432a270dc3cd12ee48560f9e3774161bee6bed089a6b705e7"}
Jul 15 21:29:48.175727 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:48.175556    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-j57mj" event={"ID":"7c107438-4a43-49fe-9bcb-a9c114c05d85","Type":"ContainerStarted","Data":"367223d4c906f67ebdd0349bb4053b3e0c9d6c4d0b9045882b4cc4f434c10c19"}
Jul 15 21:29:48.177478 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:48.177397    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-hv4rg" event={"ID":"0b013345-f721-445a-94cf-cad6851085c3","Type":"ContainerStarted","Data":"283fe24d38108fca6244cf897f1ba7a40f5156742bf4fc1fa4490278c35ceddf"}
Jul 15 21:29:48.181599 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:48.181569    2563 generic.go:356] "Generic (PLEG): container finished" podID="cdc00ed8-331f-4ccc-9d0e-66e123a578eb" containerID="41b6c2ea9b5d8a67a2c7bfae835f6f028313ebb5357bba8fba3ec5ba62046489" exitCode=0
Jul 15 21:29:48.181692 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:48.181666    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-f2sjs" event={"ID":"cdc00ed8-331f-4ccc-9d0e-66e123a578eb","Type":"ContainerDied","Data":"41b6c2ea9b5d8a67a2c7bfae835f6f028313ebb5357bba8fba3ec5ba62046489"}
Jul 15 21:29:48.183672 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:48.183617    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-8dqhg" event={"ID":"d806e382-01da-4412-b627-a52c8b0da47e","Type":"ContainerStarted","Data":"ac5b81a8c1b6921756c0b107bd29908a79c88badb7734bef93a826b9679c45a8"}
Jul 15 21:29:49.193175 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:49.192925    2563 generic.go:356] "Generic (PLEG): container finished" podID="cdc00ed8-331f-4ccc-9d0e-66e123a578eb" containerID="b3d0f7f45bc6f7169ccc1f5ef7fda5bcc9366b01e46ead6be11f21f35b548460" exitCode=0
Jul 15 21:29:49.193884 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:49.193111    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-f2sjs" event={"ID":"cdc00ed8-331f-4ccc-9d0e-66e123a578eb","Type":"ContainerDied","Data":"b3d0f7f45bc6f7169ccc1f5ef7fda5bcc9366b01e46ead6be11f21f35b548460"}
Jul 15 21:29:49.197741 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:49.197711    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-jwp9w" event={"ID":"ec86bd51-57c3-469e-967d-851a42be041f","Type":"ContainerStarted","Data":"a6cbb88701a6765651ace0ee745bef352c0939cd171cdf2e360bc055d63ff944"}
Jul 15 21:29:49.244480 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:49.244261    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-jwp9w" podStartSLOduration=25.825188769 podStartE2EDuration="27.244216247s" totalImagesPullingTime="1.419027478s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:29:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:29:49.242053284 +0000 UTC m=+38.935980837" watchObservedRunningTime="2026-07-15 21:29:49.244216247 +0000 UTC m=+38.938143782"
Jul 15 21:29:49.973539 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:49.973495    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/43c5f71f-98e5-4ed1-aa69-bfb6a8815cae-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-hgkh9\" (UID: \"43c5f71f-98e5-4ed1-aa69-bfb6a8815cae\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-hgkh9"
Jul 15 21:29:49.974279 ip-10-0-130-217 kubenswrapper[2563]: E0715 21:29:49.973827    2563 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 15 21:29:49.974279 ip-10-0-130-217 kubenswrapper[2563]: E0715 21:29:49.973897    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/43c5f71f-98e5-4ed1-aa69-bfb6a8815cae-cluster-monitoring-operator-tls podName:43c5f71f-98e5-4ed1-aa69-bfb6a8815cae nodeName:}" failed. No retries permitted until 2026-07-15 21:29:53.973877095 +0000 UTC m=+43.667804629 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/43c5f71f-98e5-4ed1-aa69-bfb6a8815cae-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-hgkh9" (UID: "43c5f71f-98e5-4ed1-aa69-bfb6a8815cae") : secret "cluster-monitoring-operator-tls" not found
Jul 15 21:29:50.075386 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:50.074327    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c6249c00-aa11-475f-a2a5-62cd7999fdd0-registry-tls\") pod \"image-registry-df786567c-xhldd\" (UID: \"c6249c00-aa11-475f-a2a5-62cd7999fdd0\") " pod="openshift-image-registry/image-registry-df786567c-xhldd"
Jul 15 21:29:50.075386 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:50.074382    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9b4bbb5d-a934-4ca1-807d-c760d336c01d-service-ca-bundle\") pod \"router-default-7bc9859798-z9kjp\" (UID: \"9b4bbb5d-a934-4ca1-807d-c760d336c01d\") " pod="openshift-ingress/router-default-7bc9859798-z9kjp"
Jul 15 21:29:50.075386 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:50.074441    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9b4bbb5d-a934-4ca1-807d-c760d336c01d-metrics-certs\") pod \"router-default-7bc9859798-z9kjp\" (UID: \"9b4bbb5d-a934-4ca1-807d-c760d336c01d\") " pod="openshift-ingress/router-default-7bc9859798-z9kjp"
Jul 15 21:29:50.075386 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:50.074485    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d2dd5a89-4ca3-4790-aed4-a4f948651d72-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-dtcjn\" (UID: \"d2dd5a89-4ca3-4790-aed4-a4f948651d72\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-dtcjn"
Jul 15 21:29:50.075386 ip-10-0-130-217 kubenswrapper[2563]: E0715 21:29:50.074635    2563 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 15 21:29:50.075386 ip-10-0-130-217 kubenswrapper[2563]: E0715 21:29:50.074704    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d2dd5a89-4ca3-4790-aed4-a4f948651d72-samples-operator-tls podName:d2dd5a89-4ca3-4790-aed4-a4f948651d72 nodeName:}" failed. No retries permitted until 2026-07-15 21:29:54.074683104 +0000 UTC m=+43.768610655 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/d2dd5a89-4ca3-4790-aed4-a4f948651d72-samples-operator-tls") pod "cluster-samples-operator-65db858894-dtcjn" (UID: "d2dd5a89-4ca3-4790-aed4-a4f948651d72") : secret "samples-operator-tls" not found
Jul 15 21:29:50.075386 ip-10-0-130-217 kubenswrapper[2563]: E0715 21:29:50.075135    2563 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 15 21:29:50.075386 ip-10-0-130-217 kubenswrapper[2563]: E0715 21:29:50.075150    2563 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-df786567c-xhldd: secret "image-registry-tls" not found
Jul 15 21:29:50.075386 ip-10-0-130-217 kubenswrapper[2563]: E0715 21:29:50.075196    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c6249c00-aa11-475f-a2a5-62cd7999fdd0-registry-tls podName:c6249c00-aa11-475f-a2a5-62cd7999fdd0 nodeName:}" failed. No retries permitted until 2026-07-15 21:29:54.075181327 +0000 UTC m=+43.769108858 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c6249c00-aa11-475f-a2a5-62cd7999fdd0-registry-tls") pod "image-registry-df786567c-xhldd" (UID: "c6249c00-aa11-475f-a2a5-62cd7999fdd0") : secret "image-registry-tls" not found
Jul 15 21:29:50.075386 ip-10-0-130-217 kubenswrapper[2563]: E0715 21:29:50.075261    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9b4bbb5d-a934-4ca1-807d-c760d336c01d-service-ca-bundle podName:9b4bbb5d-a934-4ca1-807d-c760d336c01d nodeName:}" failed. No retries permitted until 2026-07-15 21:29:54.075251719 +0000 UTC m=+43.769179249 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/9b4bbb5d-a934-4ca1-807d-c760d336c01d-service-ca-bundle") pod "router-default-7bc9859798-z9kjp" (UID: "9b4bbb5d-a934-4ca1-807d-c760d336c01d") : configmap references non-existent config key: service-ca.crt
Jul 15 21:29:50.075386 ip-10-0-130-217 kubenswrapper[2563]: E0715 21:29:50.075314    2563 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 15 21:29:50.075386 ip-10-0-130-217 kubenswrapper[2563]: E0715 21:29:50.075350    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9b4bbb5d-a934-4ca1-807d-c760d336c01d-metrics-certs podName:9b4bbb5d-a934-4ca1-807d-c760d336c01d nodeName:}" failed. No retries permitted until 2026-07-15 21:29:54.075340366 +0000 UTC m=+43.769267895 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9b4bbb5d-a934-4ca1-807d-c760d336c01d-metrics-certs") pod "router-default-7bc9859798-z9kjp" (UID: "9b4bbb5d-a934-4ca1-807d-c760d336c01d") : secret "router-metrics-certs-default" not found
Jul 15 21:29:50.176186 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:50.176149    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a2939e65-0409-4060-a51e-59bc7a1f6600-metrics-tls\") pod \"dns-default-l8f7b\" (UID: \"a2939e65-0409-4060-a51e-59bc7a1f6600\") " pod="openshift-dns/dns-default-l8f7b"
Jul 15 21:29:50.176360 ip-10-0-130-217 kubenswrapper[2563]: E0715 21:29:50.176299    2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 15 21:29:50.176442 ip-10-0-130-217 kubenswrapper[2563]: E0715 21:29:50.176362    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a2939e65-0409-4060-a51e-59bc7a1f6600-metrics-tls podName:a2939e65-0409-4060-a51e-59bc7a1f6600 nodeName:}" failed. No retries permitted until 2026-07-15 21:29:54.176343644 +0000 UTC m=+43.870271172 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a2939e65-0409-4060-a51e-59bc7a1f6600-metrics-tls") pod "dns-default-l8f7b" (UID: "a2939e65-0409-4060-a51e-59bc7a1f6600") : secret "dns-default-metrics-tls" not found
Jul 15 21:29:50.207451 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:50.207413    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-f2sjs" event={"ID":"cdc00ed8-331f-4ccc-9d0e-66e123a578eb","Type":"ContainerStarted","Data":"394200f37e9a7a7e21b90b108cb9ce082598ccb3605fc720de695d81840a5244"}
Jul 15 21:29:50.229038 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:50.228205    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-f2sjs" podStartSLOduration=8.415943687 podStartE2EDuration="39.228182856s" totalImagesPullingTime="30.812239169s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 21:29:11 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:29:50.226905792 +0000 UTC m=+39.920833343" watchObservedRunningTime="2026-07-15 21:29:50.228182856 +0000 UTC m=+39.922110410"
Jul 15 21:29:54.007953 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:54.007902    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/43c5f71f-98e5-4ed1-aa69-bfb6a8815cae-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-hgkh9\" (UID: \"43c5f71f-98e5-4ed1-aa69-bfb6a8815cae\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-hgkh9"
Jul 15 21:29:54.008435 ip-10-0-130-217 kubenswrapper[2563]: E0715 21:29:54.008057    2563 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 15 21:29:54.008435 ip-10-0-130-217 kubenswrapper[2563]: E0715 21:29:54.008140    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/43c5f71f-98e5-4ed1-aa69-bfb6a8815cae-cluster-monitoring-operator-tls podName:43c5f71f-98e5-4ed1-aa69-bfb6a8815cae nodeName:}" failed. No retries permitted until 2026-07-15 21:30:02.008125065 +0000 UTC m=+51.702052593 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/43c5f71f-98e5-4ed1-aa69-bfb6a8815cae-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-hgkh9" (UID: "43c5f71f-98e5-4ed1-aa69-bfb6a8815cae") : secret "cluster-monitoring-operator-tls" not found
Jul 15 21:29:54.109258 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:54.109190    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c6249c00-aa11-475f-a2a5-62cd7999fdd0-registry-tls\") pod \"image-registry-df786567c-xhldd\" (UID: \"c6249c00-aa11-475f-a2a5-62cd7999fdd0\") " pod="openshift-image-registry/image-registry-df786567c-xhldd"
Jul 15 21:29:54.109258 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:54.109240    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9b4bbb5d-a934-4ca1-807d-c760d336c01d-service-ca-bundle\") pod \"router-default-7bc9859798-z9kjp\" (UID: \"9b4bbb5d-a934-4ca1-807d-c760d336c01d\") " pod="openshift-ingress/router-default-7bc9859798-z9kjp"
Jul 15 21:29:54.109516 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:54.109300    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9b4bbb5d-a934-4ca1-807d-c760d336c01d-metrics-certs\") pod \"router-default-7bc9859798-z9kjp\" (UID: \"9b4bbb5d-a934-4ca1-807d-c760d336c01d\") " pod="openshift-ingress/router-default-7bc9859798-z9kjp"
Jul 15 21:29:54.109516 ip-10-0-130-217 kubenswrapper[2563]: E0715 21:29:54.109343    2563 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 15 21:29:54.109516 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:54.109350    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d2dd5a89-4ca3-4790-aed4-a4f948651d72-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-dtcjn\" (UID: \"d2dd5a89-4ca3-4790-aed4-a4f948651d72\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-dtcjn"
Jul 15 21:29:54.109516 ip-10-0-130-217 kubenswrapper[2563]: E0715 21:29:54.109360    2563 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-df786567c-xhldd: secret "image-registry-tls" not found
Jul 15 21:29:54.109516 ip-10-0-130-217 kubenswrapper[2563]: E0715 21:29:54.109404    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9b4bbb5d-a934-4ca1-807d-c760d336c01d-service-ca-bundle podName:9b4bbb5d-a934-4ca1-807d-c760d336c01d nodeName:}" failed. No retries permitted until 2026-07-15 21:30:02.10938204 +0000 UTC m=+51.803309572 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/9b4bbb5d-a934-4ca1-807d-c760d336c01d-service-ca-bundle") pod "router-default-7bc9859798-z9kjp" (UID: "9b4bbb5d-a934-4ca1-807d-c760d336c01d") : configmap references non-existent config key: service-ca.crt
Jul 15 21:29:54.109516 ip-10-0-130-217 kubenswrapper[2563]: E0715 21:29:54.109430    2563 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 15 21:29:54.109516 ip-10-0-130-217 kubenswrapper[2563]: E0715 21:29:54.109454    2563 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 15 21:29:54.109516 ip-10-0-130-217 kubenswrapper[2563]: E0715 21:29:54.109472    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c6249c00-aa11-475f-a2a5-62cd7999fdd0-registry-tls podName:c6249c00-aa11-475f-a2a5-62cd7999fdd0 nodeName:}" failed. No retries permitted until 2026-07-15 21:30:02.109443275 +0000 UTC m=+51.803370807 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c6249c00-aa11-475f-a2a5-62cd7999fdd0-registry-tls") pod "image-registry-df786567c-xhldd" (UID: "c6249c00-aa11-475f-a2a5-62cd7999fdd0") : secret "image-registry-tls" not found
Jul 15 21:29:54.109516 ip-10-0-130-217 kubenswrapper[2563]: E0715 21:29:54.109500    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d2dd5a89-4ca3-4790-aed4-a4f948651d72-samples-operator-tls podName:d2dd5a89-4ca3-4790-aed4-a4f948651d72 nodeName:}" failed. No retries permitted until 2026-07-15 21:30:02.109492805 +0000 UTC m=+51.803420334 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/d2dd5a89-4ca3-4790-aed4-a4f948651d72-samples-operator-tls") pod "cluster-samples-operator-65db858894-dtcjn" (UID: "d2dd5a89-4ca3-4790-aed4-a4f948651d72") : secret "samples-operator-tls" not found
Jul 15 21:29:54.109516 ip-10-0-130-217 kubenswrapper[2563]: E0715 21:29:54.109512    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9b4bbb5d-a934-4ca1-807d-c760d336c01d-metrics-certs podName:9b4bbb5d-a934-4ca1-807d-c760d336c01d nodeName:}" failed. No retries permitted until 2026-07-15 21:30:02.109506711 +0000 UTC m=+51.803434240 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9b4bbb5d-a934-4ca1-807d-c760d336c01d-metrics-certs") pod "router-default-7bc9859798-z9kjp" (UID: "9b4bbb5d-a934-4ca1-807d-c760d336c01d") : secret "router-metrics-certs-default" not found
Jul 15 21:29:54.210471 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:54.210432    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a2939e65-0409-4060-a51e-59bc7a1f6600-metrics-tls\") pod \"dns-default-l8f7b\" (UID: \"a2939e65-0409-4060-a51e-59bc7a1f6600\") " pod="openshift-dns/dns-default-l8f7b"
Jul 15 21:29:54.210642 ip-10-0-130-217 kubenswrapper[2563]: E0715 21:29:54.210551    2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 15 21:29:54.210642 ip-10-0-130-217 kubenswrapper[2563]: E0715 21:29:54.210610    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a2939e65-0409-4060-a51e-59bc7a1f6600-metrics-tls podName:a2939e65-0409-4060-a51e-59bc7a1f6600 nodeName:}" failed. No retries permitted until 2026-07-15 21:30:02.210592251 +0000 UTC m=+51.904519797 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a2939e65-0409-4060-a51e-59bc7a1f6600-metrics-tls") pod "dns-default-l8f7b" (UID: "a2939e65-0409-4060-a51e-59bc7a1f6600") : secret "dns-default-metrics-tls" not found
Jul 15 21:29:55.222582 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:55.222553    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-2jskd" event={"ID":"d912f2b6-80b8-4639-be45-72e51e7b565f","Type":"ContainerStarted","Data":"f81c24e89935bf8d71623b5c6bbca4e5c362c19054e2f0845fc6c420c3cb5057"}
Jul 15 21:29:55.224309 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:55.224286    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-8dqhg" event={"ID":"d806e382-01da-4412-b627-a52c8b0da47e","Type":"ContainerStarted","Data":"0769bba1adf1fcaaf846df8cf7b09fb7986cb08c98dd8a1f80b37248e360ed18"}
Jul 15 21:29:55.236680 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:55.236633    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-2jskd" podStartSLOduration=1.978019941 podStartE2EDuration="9.236620264s" totalImagesPullingTime="7.258600323s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:29:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:29:55.235711475 +0000 UTC m=+44.929639026" watchObservedRunningTime="2026-07-15 21:29:55.236620264 +0000 UTC m=+44.930547792"
Jul 15 21:29:55.250059 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:55.250012    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-8dqhg" podStartSLOduration=23.020023571 podStartE2EDuration="30.2499946s" totalImagesPullingTime="7.229971029s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:29:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:29:55.248743125 +0000 UTC m=+44.942670677" watchObservedRunningTime="2026-07-15 21:29:55.2499946 +0000 UTC m=+44.943922149"
Jul 15 21:29:56.229068 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:56.228985    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-zlsbs_9b97af79-5c4a-4622-8d74-04d470841a53/console-operator/0.log"
Jul 15 21:29:56.229068 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:56.229034    2563 generic.go:356] "Generic (PLEG): container finished" podID="9b97af79-5c4a-4622-8d74-04d470841a53" containerID="b1a87bd444dad7b4a9628f4eecba4cba9944c8bb636b01640b1fc7f7bd3fc761" exitCode=255
Jul 15 21:29:56.229543 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:56.229122    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-zlsbs" event={"ID":"9b97af79-5c4a-4622-8d74-04d470841a53","Type":"ContainerDied","Data":"b1a87bd444dad7b4a9628f4eecba4cba9944c8bb636b01640b1fc7f7bd3fc761"}
Jul 15 21:29:56.229543 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:56.229330    2563 scope.go:117] "RemoveContainer" containerID="b1a87bd444dad7b4a9628f4eecba4cba9944c8bb636b01640b1fc7f7bd3fc761"
Jul 15 21:29:56.235413 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:56.235374    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-2jn97" event={"ID":"1683be20-36a0-4ca3-b861-972d9805c362","Type":"ContainerStarted","Data":"bb131d9b893a72e237d2db0a65dce2c34af82602c69d84ad4da82749ba1ce1bb"}
Jul 15 21:29:56.237351 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:56.237290    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-j57mj" event={"ID":"7c107438-4a43-49fe-9bcb-a9c114c05d85","Type":"ContainerStarted","Data":"be4787e2dfbd43287d8b300edb185adab4afc3fbd8e95494dfcbf01da7f99eae"}
Jul 15 21:29:56.240839 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:56.240811    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-hv4rg" event={"ID":"0b013345-f721-445a-94cf-cad6851085c3","Type":"ContainerStarted","Data":"7995fca673dd28b5573c3cbf41ad5e59ba08ed0989041efa729311ffb0e9a881"}
Jul 15 21:29:56.265752 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:56.265694    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-2jn97" podStartSLOduration=24.003140956 podStartE2EDuration="31.265674532s" totalImagesPullingTime="7.262533576s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:29:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:29:56.265467132 +0000 UTC m=+45.959394688" watchObservedRunningTime="2026-07-15 21:29:56.265674532 +0000 UTC m=+45.959602081"
Jul 15 21:29:56.300171 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:56.299475    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-68d9dd94cf-j57mj" podStartSLOduration=28.043852726 podStartE2EDuration="35.29945351s" totalImagesPullingTime="7.255600784s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:29:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:29:56.282836005 +0000 UTC m=+45.976763556" watchObservedRunningTime="2026-07-15 21:29:56.29945351 +0000 UTC m=+45.993381042"
Jul 15 21:29:56.300924 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:56.300360    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-hv4rg" podStartSLOduration=19.751598678 podStartE2EDuration="27.30034502s" totalImagesPullingTime="7.548746342s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:29:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:29:56.29899271 +0000 UTC m=+45.992920262" watchObservedRunningTime="2026-07-15 21:29:56.30034502 +0000 UTC m=+45.994272571"
Jul 15 21:29:56.427500 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:56.427471    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-j4l5v"]
Jul 15 21:29:56.445886 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:56.445863    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-j4l5v"]
Jul 15 21:29:56.446035 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:56.446016    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-j4l5v"
Jul 15 21:29:56.448030 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:56.448006    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 15 21:29:56.448138 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:56.448027    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-w8f6x\""
Jul 15 21:29:56.448138 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:56.448093    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 15 21:29:56.530840 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:56.530810    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/6f7d5625-636f-4ee3-b08f-05a8822fbb9c-data-volume\") pod \"insights-runtime-extractor-j4l5v\" (UID: \"6f7d5625-636f-4ee3-b08f-05a8822fbb9c\") " pod="openshift-insights/insights-runtime-extractor-j4l5v"
Jul 15 21:29:56.530975 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:56.530861    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2ktdj\" (UniqueName: \"kubernetes.io/projected/6f7d5625-636f-4ee3-b08f-05a8822fbb9c-kube-api-access-2ktdj\") pod \"insights-runtime-extractor-j4l5v\" (UID: \"6f7d5625-636f-4ee3-b08f-05a8822fbb9c\") " pod="openshift-insights/insights-runtime-extractor-j4l5v"
Jul 15 21:29:56.530975 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:56.530885    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/6f7d5625-636f-4ee3-b08f-05a8822fbb9c-crio-socket\") pod \"insights-runtime-extractor-j4l5v\" (UID: \"6f7d5625-636f-4ee3-b08f-05a8822fbb9c\") " pod="openshift-insights/insights-runtime-extractor-j4l5v"
Jul 15 21:29:56.531049 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:56.530979    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6f7d5625-636f-4ee3-b08f-05a8822fbb9c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-j4l5v\" (UID: \"6f7d5625-636f-4ee3-b08f-05a8822fbb9c\") " pod="openshift-insights/insights-runtime-extractor-j4l5v"
Jul 15 21:29:56.531117 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:56.531098    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6f7d5625-636f-4ee3-b08f-05a8822fbb9c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-j4l5v\" (UID: \"6f7d5625-636f-4ee3-b08f-05a8822fbb9c\") " pod="openshift-insights/insights-runtime-extractor-j4l5v"
Jul 15 21:29:56.591000 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:56.590964    2563 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-7866497494-zlsbs"
Jul 15 21:29:56.591144 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:56.591018    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7866497494-zlsbs"
Jul 15 21:29:56.632681 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:56.631565    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6f7d5625-636f-4ee3-b08f-05a8822fbb9c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-j4l5v\" (UID: \"6f7d5625-636f-4ee3-b08f-05a8822fbb9c\") " pod="openshift-insights/insights-runtime-extractor-j4l5v"
Jul 15 21:29:56.632681 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:56.631634    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/6f7d5625-636f-4ee3-b08f-05a8822fbb9c-data-volume\") pod \"insights-runtime-extractor-j4l5v\" (UID: \"6f7d5625-636f-4ee3-b08f-05a8822fbb9c\") " pod="openshift-insights/insights-runtime-extractor-j4l5v"
Jul 15 21:29:56.632681 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:56.631682    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2ktdj\" (UniqueName: \"kubernetes.io/projected/6f7d5625-636f-4ee3-b08f-05a8822fbb9c-kube-api-access-2ktdj\") pod \"insights-runtime-extractor-j4l5v\" (UID: \"6f7d5625-636f-4ee3-b08f-05a8822fbb9c\") " pod="openshift-insights/insights-runtime-extractor-j4l5v"
Jul 15 21:29:56.632681 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:56.631718    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/6f7d5625-636f-4ee3-b08f-05a8822fbb9c-crio-socket\") pod \"insights-runtime-extractor-j4l5v\" (UID: \"6f7d5625-636f-4ee3-b08f-05a8822fbb9c\") " pod="openshift-insights/insights-runtime-extractor-j4l5v"
Jul 15 21:29:56.632681 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:56.631772    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6f7d5625-636f-4ee3-b08f-05a8822fbb9c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-j4l5v\" (UID: \"6f7d5625-636f-4ee3-b08f-05a8822fbb9c\") " pod="openshift-insights/insights-runtime-extractor-j4l5v"
Jul 15 21:29:56.632681 ip-10-0-130-217 kubenswrapper[2563]: E0715 21:29:56.631981    2563 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 15 21:29:56.632681 ip-10-0-130-217 kubenswrapper[2563]: E0715 21:29:56.632042    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6f7d5625-636f-4ee3-b08f-05a8822fbb9c-kube-rbac-proxy-cm podName:6f7d5625-636f-4ee3-b08f-05a8822fbb9c nodeName:}" failed. No retries permitted until 2026-07-15 21:29:57.132023596 +0000 UTC m=+46.825951127 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/6f7d5625-636f-4ee3-b08f-05a8822fbb9c-kube-rbac-proxy-cm") pod "insights-runtime-extractor-j4l5v" (UID: "6f7d5625-636f-4ee3-b08f-05a8822fbb9c") : configmap "kube-rbac-proxy" not found
Jul 15 21:29:56.632681 ip-10-0-130-217 kubenswrapper[2563]: E0715 21:29:56.632336    2563 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 15 21:29:56.632681 ip-10-0-130-217 kubenswrapper[2563]: E0715 21:29:56.632383    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6f7d5625-636f-4ee3-b08f-05a8822fbb9c-insights-runtime-extractor-tls podName:6f7d5625-636f-4ee3-b08f-05a8822fbb9c nodeName:}" failed. No retries permitted until 2026-07-15 21:29:57.132368535 +0000 UTC m=+46.826296067 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/6f7d5625-636f-4ee3-b08f-05a8822fbb9c-insights-runtime-extractor-tls") pod "insights-runtime-extractor-j4l5v" (UID: "6f7d5625-636f-4ee3-b08f-05a8822fbb9c") : secret "insights-runtime-extractor-tls" not found
Jul 15 21:29:56.633350 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:56.632700    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/6f7d5625-636f-4ee3-b08f-05a8822fbb9c-data-volume\") pod \"insights-runtime-extractor-j4l5v\" (UID: \"6f7d5625-636f-4ee3-b08f-05a8822fbb9c\") " pod="openshift-insights/insights-runtime-extractor-j4l5v"
Jul 15 21:29:56.633350 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:56.632880    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/6f7d5625-636f-4ee3-b08f-05a8822fbb9c-crio-socket\") pod \"insights-runtime-extractor-j4l5v\" (UID: \"6f7d5625-636f-4ee3-b08f-05a8822fbb9c\") " pod="openshift-insights/insights-runtime-extractor-j4l5v"
Jul 15 21:29:56.644912 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:56.644890    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2ktdj\" (UniqueName: \"kubernetes.io/projected/6f7d5625-636f-4ee3-b08f-05a8822fbb9c-kube-api-access-2ktdj\") pod \"insights-runtime-extractor-j4l5v\" (UID: \"6f7d5625-636f-4ee3-b08f-05a8822fbb9c\") " pod="openshift-insights/insights-runtime-extractor-j4l5v"
Jul 15 21:29:57.136419 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:57.136387    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6f7d5625-636f-4ee3-b08f-05a8822fbb9c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-j4l5v\" (UID: \"6f7d5625-636f-4ee3-b08f-05a8822fbb9c\") " pod="openshift-insights/insights-runtime-extractor-j4l5v"
Jul 15 21:29:57.136601 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:57.136472    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6f7d5625-636f-4ee3-b08f-05a8822fbb9c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-j4l5v\" (UID: \"6f7d5625-636f-4ee3-b08f-05a8822fbb9c\") " pod="openshift-insights/insights-runtime-extractor-j4l5v"
Jul 15 21:29:57.136601 ip-10-0-130-217 kubenswrapper[2563]: E0715 21:29:57.136556    2563 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 15 21:29:57.136601 ip-10-0-130-217 kubenswrapper[2563]: E0715 21:29:57.136585    2563 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 15 21:29:57.136696 ip-10-0-130-217 kubenswrapper[2563]: E0715 21:29:57.136622    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6f7d5625-636f-4ee3-b08f-05a8822fbb9c-insights-runtime-extractor-tls podName:6f7d5625-636f-4ee3-b08f-05a8822fbb9c nodeName:}" failed. No retries permitted until 2026-07-15 21:29:58.136606698 +0000 UTC m=+47.830534227 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/6f7d5625-636f-4ee3-b08f-05a8822fbb9c-insights-runtime-extractor-tls") pod "insights-runtime-extractor-j4l5v" (UID: "6f7d5625-636f-4ee3-b08f-05a8822fbb9c") : secret "insights-runtime-extractor-tls" not found
Jul 15 21:29:57.136696 ip-10-0-130-217 kubenswrapper[2563]: E0715 21:29:57.136643    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6f7d5625-636f-4ee3-b08f-05a8822fbb9c-kube-rbac-proxy-cm podName:6f7d5625-636f-4ee3-b08f-05a8822fbb9c nodeName:}" failed. No retries permitted until 2026-07-15 21:29:58.136630835 +0000 UTC m=+47.830558365 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/6f7d5625-636f-4ee3-b08f-05a8822fbb9c-kube-rbac-proxy-cm") pod "insights-runtime-extractor-j4l5v" (UID: "6f7d5625-636f-4ee3-b08f-05a8822fbb9c") : configmap "kube-rbac-proxy" not found
Jul 15 21:29:57.245912 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:57.245887    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-zlsbs_9b97af79-5c4a-4622-8d74-04d470841a53/console-operator/1.log"
Jul 15 21:29:57.246352 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:57.246326    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-zlsbs_9b97af79-5c4a-4622-8d74-04d470841a53/console-operator/0.log"
Jul 15 21:29:57.246410 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:57.246360    2563 generic.go:356] "Generic (PLEG): container finished" podID="9b97af79-5c4a-4622-8d74-04d470841a53" containerID="f2a92cb3f3c80b6de1fd2c8093cb2d23fdcdd8d1a7e34a8260ddc5310163ad6c" exitCode=255
Jul 15 21:29:57.246493 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:57.246467    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-zlsbs" event={"ID":"9b97af79-5c4a-4622-8d74-04d470841a53","Type":"ContainerDied","Data":"f2a92cb3f3c80b6de1fd2c8093cb2d23fdcdd8d1a7e34a8260ddc5310163ad6c"}
Jul 15 21:29:57.246548 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:57.246531    2563 scope.go:117] "RemoveContainer" containerID="b1a87bd444dad7b4a9628f4eecba4cba9944c8bb636b01640b1fc7f7bd3fc761"
Jul 15 21:29:57.246760 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:57.246742    2563 scope.go:117] "RemoveContainer" containerID="f2a92cb3f3c80b6de1fd2c8093cb2d23fdcdd8d1a7e34a8260ddc5310163ad6c"
Jul 15 21:29:57.246987 ip-10-0-130-217 kubenswrapper[2563]: E0715 21:29:57.246955    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7866497494-zlsbs_openshift-console-operator(9b97af79-5c4a-4622-8d74-04d470841a53)\"" pod="openshift-console-operator/console-operator-7866497494-zlsbs" podUID="9b97af79-5c4a-4622-8d74-04d470841a53"
Jul 15 21:29:57.985520 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:57.985491    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-tlrgr_a8599815-6b89-4248-99de-f4a3ee849bf0/dns-node-resolver/0.log"
Jul 15 21:29:58.146612 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:58.146572    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6f7d5625-636f-4ee3-b08f-05a8822fbb9c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-j4l5v\" (UID: \"6f7d5625-636f-4ee3-b08f-05a8822fbb9c\") " pod="openshift-insights/insights-runtime-extractor-j4l5v"
Jul 15 21:29:58.146758 ip-10-0-130-217 kubenswrapper[2563]: E0715 21:29:58.146699    2563 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 15 21:29:58.146758 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:58.146734    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6f7d5625-636f-4ee3-b08f-05a8822fbb9c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-j4l5v\" (UID: \"6f7d5625-636f-4ee3-b08f-05a8822fbb9c\") " pod="openshift-insights/insights-runtime-extractor-j4l5v"
Jul 15 21:29:58.146849 ip-10-0-130-217 kubenswrapper[2563]: E0715 21:29:58.146776    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6f7d5625-636f-4ee3-b08f-05a8822fbb9c-kube-rbac-proxy-cm podName:6f7d5625-636f-4ee3-b08f-05a8822fbb9c nodeName:}" failed. No retries permitted until 2026-07-15 21:30:00.1467597 +0000 UTC m=+49.840687232 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/6f7d5625-636f-4ee3-b08f-05a8822fbb9c-kube-rbac-proxy-cm") pod "insights-runtime-extractor-j4l5v" (UID: "6f7d5625-636f-4ee3-b08f-05a8822fbb9c") : configmap "kube-rbac-proxy" not found
Jul 15 21:29:58.146849 ip-10-0-130-217 kubenswrapper[2563]: E0715 21:29:58.146823    2563 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 15 21:29:58.146959 ip-10-0-130-217 kubenswrapper[2563]: E0715 21:29:58.146875    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6f7d5625-636f-4ee3-b08f-05a8822fbb9c-insights-runtime-extractor-tls podName:6f7d5625-636f-4ee3-b08f-05a8822fbb9c nodeName:}" failed. No retries permitted until 2026-07-15 21:30:00.146863533 +0000 UTC m=+49.840791062 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/6f7d5625-636f-4ee3-b08f-05a8822fbb9c-insights-runtime-extractor-tls") pod "insights-runtime-extractor-j4l5v" (UID: "6f7d5625-636f-4ee3-b08f-05a8822fbb9c") : secret "insights-runtime-extractor-tls" not found
Jul 15 21:29:58.250987 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:58.250860    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-zlsbs_9b97af79-5c4a-4622-8d74-04d470841a53/console-operator/1.log"
Jul 15 21:29:58.251420 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:58.251241    2563 scope.go:117] "RemoveContainer" containerID="f2a92cb3f3c80b6de1fd2c8093cb2d23fdcdd8d1a7e34a8260ddc5310163ad6c"
Jul 15 21:29:58.251493 ip-10-0-130-217 kubenswrapper[2563]: E0715 21:29:58.251443    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7866497494-zlsbs_openshift-console-operator(9b97af79-5c4a-4622-8d74-04d470841a53)\"" pod="openshift-console-operator/console-operator-7866497494-zlsbs" podUID="9b97af79-5c4a-4622-8d74-04d470841a53"
Jul 15 21:29:58.785386 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:58.785359    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-9rlc4_29df31ab-38b3-4cec-ab5e-013432132c57/node-ca/0.log"
Jul 15 21:29:59.185492 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:29:59.185463    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-2jskd_d912f2b6-80b8-4639-be45-72e51e7b565f/serve-healthcheck-canary/0.log"
Jul 15 21:30:00.164484 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:30:00.164454    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6f7d5625-636f-4ee3-b08f-05a8822fbb9c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-j4l5v\" (UID: \"6f7d5625-636f-4ee3-b08f-05a8822fbb9c\") " pod="openshift-insights/insights-runtime-extractor-j4l5v"
Jul 15 21:30:00.164825 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:30:00.164545    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6f7d5625-636f-4ee3-b08f-05a8822fbb9c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-j4l5v\" (UID: \"6f7d5625-636f-4ee3-b08f-05a8822fbb9c\") " pod="openshift-insights/insights-runtime-extractor-j4l5v"
Jul 15 21:30:00.164825 ip-10-0-130-217 kubenswrapper[2563]: E0715 21:30:00.164562    2563 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 15 21:30:00.164825 ip-10-0-130-217 kubenswrapper[2563]: E0715 21:30:00.164624    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6f7d5625-636f-4ee3-b08f-05a8822fbb9c-kube-rbac-proxy-cm podName:6f7d5625-636f-4ee3-b08f-05a8822fbb9c nodeName:}" failed. No retries permitted until 2026-07-15 21:30:04.164604953 +0000 UTC m=+53.858532483 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/6f7d5625-636f-4ee3-b08f-05a8822fbb9c-kube-rbac-proxy-cm") pod "insights-runtime-extractor-j4l5v" (UID: "6f7d5625-636f-4ee3-b08f-05a8822fbb9c") : configmap "kube-rbac-proxy" not found
Jul 15 21:30:00.164825 ip-10-0-130-217 kubenswrapper[2563]: E0715 21:30:00.164639    2563 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 15 21:30:00.164825 ip-10-0-130-217 kubenswrapper[2563]: E0715 21:30:00.164685    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6f7d5625-636f-4ee3-b08f-05a8822fbb9c-insights-runtime-extractor-tls podName:6f7d5625-636f-4ee3-b08f-05a8822fbb9c nodeName:}" failed. No retries permitted until 2026-07-15 21:30:04.164674367 +0000 UTC m=+53.858601896 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/6f7d5625-636f-4ee3-b08f-05a8822fbb9c-insights-runtime-extractor-tls") pod "insights-runtime-extractor-j4l5v" (UID: "6f7d5625-636f-4ee3-b08f-05a8822fbb9c") : secret "insights-runtime-extractor-tls" not found
Jul 15 21:30:02.081021 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:30:02.080980    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/43c5f71f-98e5-4ed1-aa69-bfb6a8815cae-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-hgkh9\" (UID: \"43c5f71f-98e5-4ed1-aa69-bfb6a8815cae\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-hgkh9"
Jul 15 21:30:02.081387 ip-10-0-130-217 kubenswrapper[2563]: E0715 21:30:02.081129    2563 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 15 21:30:02.081387 ip-10-0-130-217 kubenswrapper[2563]: E0715 21:30:02.081213    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/43c5f71f-98e5-4ed1-aa69-bfb6a8815cae-cluster-monitoring-operator-tls podName:43c5f71f-98e5-4ed1-aa69-bfb6a8815cae nodeName:}" failed. No retries permitted until 2026-07-15 21:30:18.081197049 +0000 UTC m=+67.775124578 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/43c5f71f-98e5-4ed1-aa69-bfb6a8815cae-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-hgkh9" (UID: "43c5f71f-98e5-4ed1-aa69-bfb6a8815cae") : secret "cluster-monitoring-operator-tls" not found
Jul 15 21:30:02.181619 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:30:02.181586    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c6249c00-aa11-475f-a2a5-62cd7999fdd0-registry-tls\") pod \"image-registry-df786567c-xhldd\" (UID: \"c6249c00-aa11-475f-a2a5-62cd7999fdd0\") " pod="openshift-image-registry/image-registry-df786567c-xhldd"
Jul 15 21:30:02.181619 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:30:02.181622    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9b4bbb5d-a934-4ca1-807d-c760d336c01d-service-ca-bundle\") pod \"router-default-7bc9859798-z9kjp\" (UID: \"9b4bbb5d-a934-4ca1-807d-c760d336c01d\") " pod="openshift-ingress/router-default-7bc9859798-z9kjp"
Jul 15 21:30:02.181855 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:30:02.181666    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9b4bbb5d-a934-4ca1-807d-c760d336c01d-metrics-certs\") pod \"router-default-7bc9859798-z9kjp\" (UID: \"9b4bbb5d-a934-4ca1-807d-c760d336c01d\") " pod="openshift-ingress/router-default-7bc9859798-z9kjp"
Jul 15 21:30:02.181855 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:30:02.181717    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d2dd5a89-4ca3-4790-aed4-a4f948651d72-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-dtcjn\" (UID: \"d2dd5a89-4ca3-4790-aed4-a4f948651d72\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-dtcjn"
Jul 15 21:30:02.181855 ip-10-0-130-217 kubenswrapper[2563]: E0715 21:30:02.181767    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9b4bbb5d-a934-4ca1-807d-c760d336c01d-service-ca-bundle podName:9b4bbb5d-a934-4ca1-807d-c760d336c01d nodeName:}" failed. No retries permitted until 2026-07-15 21:30:18.181749381 +0000 UTC m=+67.875676913 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/9b4bbb5d-a934-4ca1-807d-c760d336c01d-service-ca-bundle") pod "router-default-7bc9859798-z9kjp" (UID: "9b4bbb5d-a934-4ca1-807d-c760d336c01d") : configmap references non-existent config key: service-ca.crt
Jul 15 21:30:02.181855 ip-10-0-130-217 kubenswrapper[2563]: E0715 21:30:02.181816    2563 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 15 21:30:02.181855 ip-10-0-130-217 kubenswrapper[2563]: E0715 21:30:02.181859    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d2dd5a89-4ca3-4790-aed4-a4f948651d72-samples-operator-tls podName:d2dd5a89-4ca3-4790-aed4-a4f948651d72 nodeName:}" failed. No retries permitted until 2026-07-15 21:30:18.181848736 +0000 UTC m=+67.875776264 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/d2dd5a89-4ca3-4790-aed4-a4f948651d72-samples-operator-tls") pod "cluster-samples-operator-65db858894-dtcjn" (UID: "d2dd5a89-4ca3-4790-aed4-a4f948651d72") : secret "samples-operator-tls" not found
Jul 15 21:30:02.182081 ip-10-0-130-217 kubenswrapper[2563]: E0715 21:30:02.181816    2563 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 15 21:30:02.182081 ip-10-0-130-217 kubenswrapper[2563]: E0715 21:30:02.181866    2563 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 15 21:30:02.182081 ip-10-0-130-217 kubenswrapper[2563]: E0715 21:30:02.181888    2563 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-df786567c-xhldd: secret "image-registry-tls" not found
Jul 15 21:30:02.182081 ip-10-0-130-217 kubenswrapper[2563]: E0715 21:30:02.181894    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9b4bbb5d-a934-4ca1-807d-c760d336c01d-metrics-certs podName:9b4bbb5d-a934-4ca1-807d-c760d336c01d nodeName:}" failed. No retries permitted until 2026-07-15 21:30:18.181882759 +0000 UTC m=+67.875810291 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9b4bbb5d-a934-4ca1-807d-c760d336c01d-metrics-certs") pod "router-default-7bc9859798-z9kjp" (UID: "9b4bbb5d-a934-4ca1-807d-c760d336c01d") : secret "router-metrics-certs-default" not found
Jul 15 21:30:02.182081 ip-10-0-130-217 kubenswrapper[2563]: E0715 21:30:02.181931    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c6249c00-aa11-475f-a2a5-62cd7999fdd0-registry-tls podName:c6249c00-aa11-475f-a2a5-62cd7999fdd0 nodeName:}" failed. No retries permitted until 2026-07-15 21:30:18.181916881 +0000 UTC m=+67.875844424 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c6249c00-aa11-475f-a2a5-62cd7999fdd0-registry-tls") pod "image-registry-df786567c-xhldd" (UID: "c6249c00-aa11-475f-a2a5-62cd7999fdd0") : secret "image-registry-tls" not found
Jul 15 21:30:02.282253 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:30:02.282225    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a2939e65-0409-4060-a51e-59bc7a1f6600-metrics-tls\") pod \"dns-default-l8f7b\" (UID: \"a2939e65-0409-4060-a51e-59bc7a1f6600\") " pod="openshift-dns/dns-default-l8f7b"
Jul 15 21:30:02.282408 ip-10-0-130-217 kubenswrapper[2563]: E0715 21:30:02.282380    2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 15 21:30:02.282468 ip-10-0-130-217 kubenswrapper[2563]: E0715 21:30:02.282447    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a2939e65-0409-4060-a51e-59bc7a1f6600-metrics-tls podName:a2939e65-0409-4060-a51e-59bc7a1f6600 nodeName:}" failed. No retries permitted until 2026-07-15 21:30:18.282428072 +0000 UTC m=+67.976355611 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a2939e65-0409-4060-a51e-59bc7a1f6600-metrics-tls") pod "dns-default-l8f7b" (UID: "a2939e65-0409-4060-a51e-59bc7a1f6600") : secret "dns-default-metrics-tls" not found
Jul 15 21:30:04.197257 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:30:04.197218    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6f7d5625-636f-4ee3-b08f-05a8822fbb9c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-j4l5v\" (UID: \"6f7d5625-636f-4ee3-b08f-05a8822fbb9c\") " pod="openshift-insights/insights-runtime-extractor-j4l5v"
Jul 15 21:30:04.197676 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:30:04.197329    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6f7d5625-636f-4ee3-b08f-05a8822fbb9c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-j4l5v\" (UID: \"6f7d5625-636f-4ee3-b08f-05a8822fbb9c\") " pod="openshift-insights/insights-runtime-extractor-j4l5v"
Jul 15 21:30:04.197676 ip-10-0-130-217 kubenswrapper[2563]: E0715 21:30:04.197365    2563 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 15 21:30:04.197676 ip-10-0-130-217 kubenswrapper[2563]: E0715 21:30:04.197431    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6f7d5625-636f-4ee3-b08f-05a8822fbb9c-insights-runtime-extractor-tls podName:6f7d5625-636f-4ee3-b08f-05a8822fbb9c nodeName:}" failed. No retries permitted until 2026-07-15 21:30:12.197414568 +0000 UTC m=+61.891342100 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/6f7d5625-636f-4ee3-b08f-05a8822fbb9c-insights-runtime-extractor-tls") pod "insights-runtime-extractor-j4l5v" (UID: "6f7d5625-636f-4ee3-b08f-05a8822fbb9c") : secret "insights-runtime-extractor-tls" not found
Jul 15 21:30:04.197900 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:30:04.197880    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6f7d5625-636f-4ee3-b08f-05a8822fbb9c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-j4l5v\" (UID: \"6f7d5625-636f-4ee3-b08f-05a8822fbb9c\") " pod="openshift-insights/insights-runtime-extractor-j4l5v"
Jul 15 21:30:06.590719 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:30:06.590685    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7866497494-zlsbs"
Jul 15 21:30:06.591234 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:30:06.590733    2563 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-7866497494-zlsbs"
Jul 15 21:30:06.591234 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:30:06.591072    2563 scope.go:117] "RemoveContainer" containerID="f2a92cb3f3c80b6de1fd2c8093cb2d23fdcdd8d1a7e34a8260ddc5310163ad6c"
Jul 15 21:30:07.281005 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:30:07.280981    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-zlsbs_9b97af79-5c4a-4622-8d74-04d470841a53/console-operator/2.log"
Jul 15 21:30:07.281460 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:30:07.281444    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-zlsbs_9b97af79-5c4a-4622-8d74-04d470841a53/console-operator/1.log"
Jul 15 21:30:07.281541 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:30:07.281477    2563 generic.go:356] "Generic (PLEG): container finished" podID="9b97af79-5c4a-4622-8d74-04d470841a53" containerID="a1533bdaafcb563070c77e7a64f9dfbf21f6dda14758a3a5f7d7e5369f9d201a" exitCode=255
Jul 15 21:30:07.281541 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:30:07.281534    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-zlsbs" event={"ID":"9b97af79-5c4a-4622-8d74-04d470841a53","Type":"ContainerDied","Data":"a1533bdaafcb563070c77e7a64f9dfbf21f6dda14758a3a5f7d7e5369f9d201a"}
Jul 15 21:30:07.281605 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:30:07.281578    2563 scope.go:117] "RemoveContainer" containerID="f2a92cb3f3c80b6de1fd2c8093cb2d23fdcdd8d1a7e34a8260ddc5310163ad6c"
Jul 15 21:30:07.281878 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:30:07.281855    2563 scope.go:117] "RemoveContainer" containerID="a1533bdaafcb563070c77e7a64f9dfbf21f6dda14758a3a5f7d7e5369f9d201a"
Jul 15 21:30:07.282066 ip-10-0-130-217 kubenswrapper[2563]: E0715 21:30:07.282046    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-7866497494-zlsbs_openshift-console-operator(9b97af79-5c4a-4622-8d74-04d470841a53)\"" pod="openshift-console-operator/console-operator-7866497494-zlsbs" podUID="9b97af79-5c4a-4622-8d74-04d470841a53"
Jul 15 21:30:08.286508 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:30:08.286480    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-zlsbs_9b97af79-5c4a-4622-8d74-04d470841a53/console-operator/2.log"
Jul 15 21:30:12.156342 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:30:12.156315    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-bp2vz"
Jul 15 21:30:12.269879 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:30:12.269841    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6f7d5625-636f-4ee3-b08f-05a8822fbb9c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-j4l5v\" (UID: \"6f7d5625-636f-4ee3-b08f-05a8822fbb9c\") " pod="openshift-insights/insights-runtime-extractor-j4l5v"
Jul 15 21:30:12.272106 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:30:12.272079    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6f7d5625-636f-4ee3-b08f-05a8822fbb9c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-j4l5v\" (UID: \"6f7d5625-636f-4ee3-b08f-05a8822fbb9c\") " pod="openshift-insights/insights-runtime-extractor-j4l5v"
Jul 15 21:30:12.401140 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:30:12.401107    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-w8f6x\""
Jul 15 21:30:12.410359 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:30:12.410304    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-j4l5v"
Jul 15 21:30:12.531004 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:30:12.530974    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-j4l5v"]
Jul 15 21:30:12.533741 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:30:12.533714    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6f7d5625_636f_4ee3_b08f_05a8822fbb9c.slice/crio-e8c1ee487410caea81343fdf7f995106aa8a3170fe9e78a1163e5ee0def57846 WatchSource:0}: Error finding container e8c1ee487410caea81343fdf7f995106aa8a3170fe9e78a1163e5ee0def57846: Status 404 returned error can't find the container with id e8c1ee487410caea81343fdf7f995106aa8a3170fe9e78a1163e5ee0def57846
Jul 15 21:30:13.304723 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:30:13.304669    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-j4l5v" event={"ID":"6f7d5625-636f-4ee3-b08f-05a8822fbb9c","Type":"ContainerStarted","Data":"e8c1ee487410caea81343fdf7f995106aa8a3170fe9e78a1163e5ee0def57846"}
Jul 15 21:30:16.590776 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:30:16.590737    2563 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-7866497494-zlsbs"
Jul 15 21:30:16.591261 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:30:16.590810    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7866497494-zlsbs"
Jul 15 21:30:16.591261 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:30:16.591244    2563 scope.go:117] "RemoveContainer" containerID="a1533bdaafcb563070c77e7a64f9dfbf21f6dda14758a3a5f7d7e5369f9d201a"
Jul 15 21:30:16.591470 ip-10-0-130-217 kubenswrapper[2563]: E0715 21:30:16.591442    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-7866497494-zlsbs_openshift-console-operator(9b97af79-5c4a-4622-8d74-04d470841a53)\"" pod="openshift-console-operator/console-operator-7866497494-zlsbs" podUID="9b97af79-5c4a-4622-8d74-04d470841a53"
Jul 15 21:30:16.614599 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:30:16.614570    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c4900b8a-d9f9-4926-8c67-62cd4a52ce9b-metrics-certs\") pod \"network-metrics-daemon-6tbzj\" (UID: \"c4900b8a-d9f9-4926-8c67-62cd4a52ce9b\") " pod="openshift-multus/network-metrics-daemon-6tbzj"
Jul 15 21:30:16.614742 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:30:16.614656    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/70c7abe7-c0b9-49bd-9ab9-a5db9117faa5-original-pull-secret\") pod \"global-pull-secret-syncer-sj7lm\" (UID: \"70c7abe7-c0b9-49bd-9ab9-a5db9117faa5\") " pod="kube-system/global-pull-secret-syncer-sj7lm"
Jul 15 21:30:16.616706 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:30:16.616686    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 15 21:30:16.616706 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:30:16.616698    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 15 21:30:16.627507 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:30:16.627484    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/70c7abe7-c0b9-49bd-9ab9-a5db9117faa5-original-pull-secret\") pod \"global-pull-secret-syncer-sj7lm\" (UID: \"70c7abe7-c0b9-49bd-9ab9-a5db9117faa5\") " pod="kube-system/global-pull-secret-syncer-sj7lm"
Jul 15 21:30:16.627584 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:30:16.627528    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c4900b8a-d9f9-4926-8c67-62cd4a52ce9b-metrics-certs\") pod \"network-metrics-daemon-6tbzj\" (UID: \"c4900b8a-d9f9-4926-8c67-62cd4a52ce9b\") " pod="openshift-multus/network-metrics-daemon-6tbzj"
Jul 15 21:30:16.715197 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:30:16.715147    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d27m5\" (UniqueName: \"kubernetes.io/projected/50904bfc-f028-4def-b159-b24669cfde16-kube-api-access-d27m5\") pod \"network-check-target-dw6kh\" (UID: \"50904bfc-f028-4def-b159-b24669cfde16\") " pod="openshift-network-diagnostics/network-check-target-dw6kh"
Jul 15 21:30:16.717813 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:30:16.717784    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d27m5\" (UniqueName: \"kubernetes.io/projected/50904bfc-f028-4def-b159-b24669cfde16-kube-api-access-d27m5\") pod \"network-check-target-dw6kh\" (UID: \"50904bfc-f028-4def-b159-b24669cfde16\") " pod="openshift-network-diagnostics/network-check-target-dw6kh"
Jul 15 21:30:16.794198 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:30:16.794170    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-8nwm9\""
Jul 15 21:30:16.797846 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:30:16.797822    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sj7lm"
Jul 15 21:30:16.803337 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:30:16.803313    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6tbzj"
Jul 15 21:30:16.803634 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:30:16.803611    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-75svw\""
Jul 15 21:30:16.812200 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:30:16.812176    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dw6kh"
Jul 15 21:30:17.561995 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:30:17.561964    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-sj7lm"]
Jul 15 21:30:17.566041 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:30:17.566006    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod70c7abe7_c0b9_49bd_9ab9_a5db9117faa5.slice/crio-03ecdab926020e3d5f66e8f69d8de1d32f8e384938c62c260388ae7a93ac1896 WatchSource:0}: Error finding container 03ecdab926020e3d5f66e8f69d8de1d32f8e384938c62c260388ae7a93ac1896: Status 404 returned error can't find the container with id 03ecdab926020e3d5f66e8f69d8de1d32f8e384938c62c260388ae7a93ac1896
Jul 15 21:30:17.786621 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:30:17.786579    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-6tbzj"]
Jul 15 21:30:17.788073 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:30:17.788048    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-dw6kh"]
Jul 15 21:30:17.789120 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:30:17.789085    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc4900b8a_d9f9_4926_8c67_62cd4a52ce9b.slice/crio-25df1d5316eb38d1a63cb0f3224f3b09c9baea87802264702d1608c0ca7b3ea2 WatchSource:0}: Error finding container 25df1d5316eb38d1a63cb0f3224f3b09c9baea87802264702d1608c0ca7b3ea2: Status 404 returned error can't find the container with id 25df1d5316eb38d1a63cb0f3224f3b09c9baea87802264702d1608c0ca7b3ea2
Jul 15 21:30:17.789893 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:30:17.789857    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod50904bfc_f028_4def_b159_b24669cfde16.slice/crio-dfa4bd515e73d8fb313168d802a4bd75a92fe3d4f12893575fa540f3cf8c2f0f WatchSource:0}: Error finding container dfa4bd515e73d8fb313168d802a4bd75a92fe3d4f12893575fa540f3cf8c2f0f: Status 404 returned error can't find the container with id dfa4bd515e73d8fb313168d802a4bd75a92fe3d4f12893575fa540f3cf8c2f0f
Jul 15 21:30:18.126014 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:30:18.125977    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/43c5f71f-98e5-4ed1-aa69-bfb6a8815cae-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-hgkh9\" (UID: \"43c5f71f-98e5-4ed1-aa69-bfb6a8815cae\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-hgkh9"
Jul 15 21:30:18.128313 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:30:18.128290    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/43c5f71f-98e5-4ed1-aa69-bfb6a8815cae-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-hgkh9\" (UID: \"43c5f71f-98e5-4ed1-aa69-bfb6a8815cae\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-hgkh9"
Jul 15 21:30:18.226668 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:30:18.226628    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c6249c00-aa11-475f-a2a5-62cd7999fdd0-registry-tls\") pod \"image-registry-df786567c-xhldd\" (UID: \"c6249c00-aa11-475f-a2a5-62cd7999fdd0\") " pod="openshift-image-registry/image-registry-df786567c-xhldd"
Jul 15 21:30:18.226668 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:30:18.226669    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9b4bbb5d-a934-4ca1-807d-c760d336c01d-service-ca-bundle\") pod \"router-default-7bc9859798-z9kjp\" (UID: \"9b4bbb5d-a934-4ca1-807d-c760d336c01d\") " pod="openshift-ingress/router-default-7bc9859798-z9kjp"
Jul 15 21:30:18.226984 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:30:18.226702    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9b4bbb5d-a934-4ca1-807d-c760d336c01d-metrics-certs\") pod \"router-default-7bc9859798-z9kjp\" (UID: \"9b4bbb5d-a934-4ca1-807d-c760d336c01d\") " pod="openshift-ingress/router-default-7bc9859798-z9kjp"
Jul 15 21:30:18.226984 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:30:18.226734    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d2dd5a89-4ca3-4790-aed4-a4f948651d72-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-dtcjn\" (UID: \"d2dd5a89-4ca3-4790-aed4-a4f948651d72\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-dtcjn"
Jul 15 21:30:18.227353 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:30:18.227326    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9b4bbb5d-a934-4ca1-807d-c760d336c01d-service-ca-bundle\") pod \"router-default-7bc9859798-z9kjp\" (UID: \"9b4bbb5d-a934-4ca1-807d-c760d336c01d\") " pod="openshift-ingress/router-default-7bc9859798-z9kjp"
Jul 15 21:30:18.229078 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:30:18.229051    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9b4bbb5d-a934-4ca1-807d-c760d336c01d-metrics-certs\") pod \"router-default-7bc9859798-z9kjp\" (UID: \"9b4bbb5d-a934-4ca1-807d-c760d336c01d\") " pod="openshift-ingress/router-default-7bc9859798-z9kjp"
Jul 15 21:30:18.229177 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:30:18.229093    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d2dd5a89-4ca3-4790-aed4-a4f948651d72-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-dtcjn\" (UID: \"d2dd5a89-4ca3-4790-aed4-a4f948651d72\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-dtcjn"
Jul 15 21:30:18.229177 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:30:18.229121    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c6249c00-aa11-475f-a2a5-62cd7999fdd0-registry-tls\") pod \"image-registry-df786567c-xhldd\" (UID: \"c6249c00-aa11-475f-a2a5-62cd7999fdd0\") " pod="openshift-image-registry/image-registry-df786567c-xhldd"
Jul 15 21:30:18.308553 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:30:18.308522    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-7rbpw\""
Jul 15 21:30:18.317164 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:30:18.317142    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-hgkh9"
Jul 15 21:30:18.327086 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:30:18.327059    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a2939e65-0409-4060-a51e-59bc7a1f6600-metrics-tls\") pod \"dns-default-l8f7b\" (UID: \"a2939e65-0409-4060-a51e-59bc7a1f6600\") " pod="openshift-dns/dns-default-l8f7b"
Jul 15 21:30:18.328229 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:30:18.328201    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-6tbzj" event={"ID":"c4900b8a-d9f9-4926-8c67-62cd4a52ce9b","Type":"ContainerStarted","Data":"25df1d5316eb38d1a63cb0f3224f3b09c9baea87802264702d1608c0ca7b3ea2"}
Jul 15 21:30:18.329590 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:30:18.329566    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a2939e65-0409-4060-a51e-59bc7a1f6600-metrics-tls\") pod \"dns-default-l8f7b\" (UID: \"a2939e65-0409-4060-a51e-59bc7a1f6600\") " pod="openshift-dns/dns-default-l8f7b"
Jul 15 21:30:18.329698 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:30:18.329674    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-j4l5v" event={"ID":"6f7d5625-636f-4ee3-b08f-05a8822fbb9c","Type":"ContainerStarted","Data":"3d4d6a161c028d51514d0ac7c6f73e3cef3bdb963f7a0c71f92e6a202620c9e9"}
Jul 15 21:30:18.330669 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:30:18.330651    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-sj7lm" event={"ID":"70c7abe7-c0b9-49bd-9ab9-a5db9117faa5","Type":"ContainerStarted","Data":"03ecdab926020e3d5f66e8f69d8de1d32f8e384938c62c260388ae7a93ac1896"}
Jul 15 21:30:18.331823 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:30:18.331799    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-dw6kh" event={"ID":"50904bfc-f028-4def-b159-b24669cfde16","Type":"ContainerStarted","Data":"222a1bf31802dfeff8029718407df6a961c7859bab66aa593142e01c4abaecfe"}
Jul 15 21:30:18.331902 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:30:18.331829    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-dw6kh" event={"ID":"50904bfc-f028-4def-b159-b24669cfde16","Type":"ContainerStarted","Data":"dfa4bd515e73d8fb313168d802a4bd75a92fe3d4f12893575fa540f3cf8c2f0f"}
Jul 15 21:30:18.331965 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:30:18.331951    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-dw6kh"
Jul 15 21:30:18.345157 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:30:18.345120    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-dw6kh" podStartSLOduration=67.345108027 podStartE2EDuration="1m7.345108027s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:29:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:30:18.344375557 +0000 UTC m=+68.038303113" watchObservedRunningTime="2026-07-15 21:30:18.345108027 +0000 UTC m=+68.039035618"
Jul 15 21:30:18.375452 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:30:18.375429    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-ht74p\""
Jul 15 21:30:18.376975 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:30:18.376919    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-2gmfn\""
Jul 15 21:30:18.384422 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:30:18.384400    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-dtcjn"
Jul 15 21:30:18.385546 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:30:18.385529    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-7bc9859798-z9kjp"
Jul 15 21:30:18.447612 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:30:18.447586    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-kpvhq\""
Jul 15 21:30:18.456372 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:30:18.456323    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-df786567c-xhldd"
Jul 15 21:30:18.471443 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:30:18.471360    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-hgkh9"]
Jul 15 21:30:18.497857 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:30:18.497559    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-c96dg\""
Jul 15 21:30:18.508222 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:30:18.507876    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-l8f7b"
Jul 15 21:30:18.569307 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:30:18.569272    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-65db858894-dtcjn"]
Jul 15 21:30:18.612116 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:30:18.609829    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-7bc9859798-z9kjp"]
Jul 15 21:30:18.618381 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:30:18.618340    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9b4bbb5d_a934_4ca1_807d_c760d336c01d.slice/crio-1b117ca97354238987add73b543dcf2c1c43fd47d8ff516b600003ae8a58bd0b WatchSource:0}: Error finding container 1b117ca97354238987add73b543dcf2c1c43fd47d8ff516b600003ae8a58bd0b: Status 404 returned error can't find the container with id 1b117ca97354238987add73b543dcf2c1c43fd47d8ff516b600003ae8a58bd0b
Jul 15 21:30:18.649153 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:30:18.648744    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-df786567c-xhldd"]
Jul 15 21:30:18.654719 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:30:18.654591    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc6249c00_aa11_475f_a2a5_62cd7999fdd0.slice/crio-4fdb96cb5b6f804962d7a293fab33a710127be6e6cb27c626a8314a080f9b70b WatchSource:0}: Error finding container 4fdb96cb5b6f804962d7a293fab33a710127be6e6cb27c626a8314a080f9b70b: Status 404 returned error can't find the container with id 4fdb96cb5b6f804962d7a293fab33a710127be6e6cb27c626a8314a080f9b70b
Jul 15 21:30:18.698979 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:30:18.698923    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-l8f7b"]
Jul 15 21:30:18.704346 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:30:18.704256    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda2939e65_0409_4060_a51e_59bc7a1f6600.slice/crio-e016a17811052c3359434c57d0343b1b4373131b239e39a95445d118c2e6cae5 WatchSource:0}: Error finding container e016a17811052c3359434c57d0343b1b4373131b239e39a95445d118c2e6cae5: Status 404 returned error can't find the container with id e016a17811052c3359434c57d0343b1b4373131b239e39a95445d118c2e6cae5
Jul 15 21:30:19.339268 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:30:19.339216    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-7bc9859798-z9kjp" event={"ID":"9b4bbb5d-a934-4ca1-807d-c760d336c01d","Type":"ContainerStarted","Data":"c53e6a4f928ee7ae2c3dd0f5a23c077174ca8f48aa28c0b1c1305ca19a8adf73"}
Jul 15 21:30:19.339268 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:30:19.339272    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-7bc9859798-z9kjp" event={"ID":"9b4bbb5d-a934-4ca1-807d-c760d336c01d","Type":"ContainerStarted","Data":"1b117ca97354238987add73b543dcf2c1c43fd47d8ff516b600003ae8a58bd0b"}
Jul 15 21:30:19.343105 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:30:19.343070    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-dtcjn" event={"ID":"d2dd5a89-4ca3-4790-aed4-a4f948651d72","Type":"ContainerStarted","Data":"4ab076f40e54f83be87c7e0bfbb266779619ec20d9ba9b18cce1221e17530d71"}
Jul 15 21:30:19.344710 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:30:19.344680    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-l8f7b" event={"ID":"a2939e65-0409-4060-a51e-59bc7a1f6600","Type":"ContainerStarted","Data":"e016a17811052c3359434c57d0343b1b4373131b239e39a95445d118c2e6cae5"}
Jul 15 21:30:19.346644 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:30:19.346566    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-df786567c-xhldd" event={"ID":"c6249c00-aa11-475f-a2a5-62cd7999fdd0","Type":"ContainerStarted","Data":"b40cf69c580dc47ee3d4707bb160559908e41c6b22ca7c070aa9732f5fcf4086"}
Jul 15 21:30:19.346644 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:30:19.346607    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-df786567c-xhldd" event={"ID":"c6249c00-aa11-475f-a2a5-62cd7999fdd0","Type":"ContainerStarted","Data":"4fdb96cb5b6f804962d7a293fab33a710127be6e6cb27c626a8314a080f9b70b"}
Jul 15 21:30:19.346913 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:30:19.346876    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-df786567c-xhldd"
Jul 15 21:30:19.349163 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:30:19.349118    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-hgkh9" event={"ID":"43c5f71f-98e5-4ed1-aa69-bfb6a8815cae","Type":"ContainerStarted","Data":"2ad61046c8a77382536b5eaf05dd37bb65f24a460d0381cb087f35f7919e6525"}
Jul 15 21:30:19.357469 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:30:19.356444    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-7bc9859798-z9kjp" podStartSLOduration=64.356427204 podStartE2EDuration="1m4.356427204s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:29:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:30:19.355218089 +0000 UTC m=+69.049145653" watchObservedRunningTime="2026-07-15 21:30:19.356427204 +0000 UTC m=+69.050354757"
Jul 15 21:30:19.373696 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:30:19.372499    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-df786567c-xhldd" podStartSLOduration=68.37248447 podStartE2EDuration="1m8.37248447s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:29:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:30:19.371784485 +0000 UTC m=+69.065712036" watchObservedRunningTime="2026-07-15 21:30:19.37248447 +0000 UTC m=+69.066412021"
Jul 15 21:30:19.386288 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:30:19.386233    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-7bc9859798-z9kjp"
Jul 15 21:30:19.389292 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:30:19.389247    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-7bc9859798-z9kjp"
Jul 15 21:30:19.562216 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:30:19.562176    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84bcd7ffbb-2jfmr"]
Jul 15 21:30:19.568657 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:30:19.568624    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84bcd7ffbb-2jfmr"
Jul 15 21:30:19.572749 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:30:19.572723    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 15 21:30:19.572990 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:30:19.572970    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\""
Jul 15 21:30:19.573903 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:30:19.573868    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 15 21:30:19.574047 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:30:19.574010    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\""
Jul 15 21:30:19.574132 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:30:19.574101    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 15 21:30:19.574237 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:30:19.574219    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\""
Jul 15 21:30:19.574393 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:30:19.574373    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\""
Jul 15 21:30:19.594513 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:30:19.594420    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84bcd7ffbb-2jfmr"]
Jul 15 21:30:19.640703 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:30:19.640495    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/c838bcd5-478d-4b90-a356-f626c220f7de-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-84bcd7ffbb-2jfmr\" (UID: \"c838bcd5-478d-4b90-a356-f626c220f7de\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84bcd7ffbb-2jfmr"
Jul 15 21:30:19.640703 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:30:19.640545    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/c838bcd5-478d-4b90-a356-f626c220f7de-ca\") pod \"cluster-proxy-proxy-agent-84bcd7ffbb-2jfmr\" (UID: \"c838bcd5-478d-4b90-a356-f626c220f7de\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84bcd7ffbb-2jfmr"
Jul 15 21:30:19.640703 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:30:19.640579    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/c838bcd5-478d-4b90-a356-f626c220f7de-additional-service-ca\") pod \"cluster-proxy-proxy-agent-84bcd7ffbb-2jfmr\" (UID: \"c838bcd5-478d-4b90-a356-f626c220f7de\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84bcd7ffbb-2jfmr"
Jul 15 21:30:19.640703 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:30:19.640627    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/c838bcd5-478d-4b90-a356-f626c220f7de-hub\") pod \"cluster-proxy-proxy-agent-84bcd7ffbb-2jfmr\" (UID: \"c838bcd5-478d-4b90-a356-f626c220f7de\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84bcd7ffbb-2jfmr"
Jul 15 21:30:19.640703 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:30:19.640658    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7npww\" (UniqueName: \"kubernetes.io/projected/c838bcd5-478d-4b90-a356-f626c220f7de-kube-api-access-7npww\") pod \"cluster-proxy-proxy-agent-84bcd7ffbb-2jfmr\" (UID: \"c838bcd5-478d-4b90-a356-f626c220f7de\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84bcd7ffbb-2jfmr"
Jul 15 21:30:19.641159 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:30:19.640746    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/c838bcd5-478d-4b90-a356-f626c220f7de-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-84bcd7ffbb-2jfmr\" (UID: \"c838bcd5-478d-4b90-a356-f626c220f7de\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84bcd7ffbb-2jfmr"
Jul 15 21:30:19.742265 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:30:19.741293    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7npww\" (UniqueName: \"kubernetes.io/projected/c838bcd5-478d-4b90-a356-f626c220f7de-kube-api-access-7npww\") pod \"cluster-proxy-proxy-agent-84bcd7ffbb-2jfmr\" (UID: \"c838bcd5-478d-4b90-a356-f626c220f7de\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84bcd7ffbb-2jfmr"
Jul 15 21:30:19.742265 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:30:19.741365    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/c838bcd5-478d-4b90-a356-f626c220f7de-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-84bcd7ffbb-2jfmr\" (UID: \"c838bcd5-478d-4b90-a356-f626c220f7de\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84bcd7ffbb-2jfmr"
Jul 15 21:30:19.742265 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:30:19.741409    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/c838bcd5-478d-4b90-a356-f626c220f7de-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-84bcd7ffbb-2jfmr\" (UID: \"c838bcd5-478d-4b90-a356-f626c220f7de\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84bcd7ffbb-2jfmr"
Jul 15 21:30:19.742265 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:30:19.741440    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/c838bcd5-478d-4b90-a356-f626c220f7de-ca\") pod \"cluster-proxy-proxy-agent-84bcd7ffbb-2jfmr\" (UID: \"c838bcd5-478d-4b90-a356-f626c220f7de\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84bcd7ffbb-2jfmr"
Jul 15 21:30:19.742265 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:30:19.741472    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/c838bcd5-478d-4b90-a356-f626c220f7de-additional-service-ca\") pod \"cluster-proxy-proxy-agent-84bcd7ffbb-2jfmr\" (UID: \"c838bcd5-478d-4b90-a356-f626c220f7de\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84bcd7ffbb-2jfmr"
Jul 15 21:30:19.742265 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:30:19.741518    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/c838bcd5-478d-4b90-a356-f626c220f7de-hub\") pod \"cluster-proxy-proxy-agent-84bcd7ffbb-2jfmr\" (UID: \"c838bcd5-478d-4b90-a356-f626c220f7de\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84bcd7ffbb-2jfmr"
Jul 15 21:30:19.742848 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:30:19.742792    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/c838bcd5-478d-4b90-a356-f626c220f7de-additional-service-ca\") pod \"cluster-proxy-proxy-agent-84bcd7ffbb-2jfmr\" (UID: \"c838bcd5-478d-4b90-a356-f626c220f7de\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84bcd7ffbb-2jfmr"
Jul 15 21:30:19.745805 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:30:19.745711    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/c838bcd5-478d-4b90-a356-f626c220f7de-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-84bcd7ffbb-2jfmr\" (UID: \"c838bcd5-478d-4b90-a356-f626c220f7de\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84bcd7ffbb-2jfmr"
Jul 15 21:30:19.748094 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:30:19.746811    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/c838bcd5-478d-4b90-a356-f626c220f7de-hub\") pod \"cluster-proxy-proxy-agent-84bcd7ffbb-2jfmr\" (UID: \"c838bcd5-478d-4b90-a356-f626c220f7de\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84bcd7ffbb-2jfmr"
Jul 15 21:30:19.748094 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:30:19.747493    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/c838bcd5-478d-4b90-a356-f626c220f7de-ca\") pod \"cluster-proxy-proxy-agent-84bcd7ffbb-2jfmr\" (UID: \"c838bcd5-478d-4b90-a356-f626c220f7de\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84bcd7ffbb-2jfmr"
Jul 15 21:30:19.749552 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:30:19.749526    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/c838bcd5-478d-4b90-a356-f626c220f7de-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-84bcd7ffbb-2jfmr\" (UID: \"c838bcd5-478d-4b90-a356-f626c220f7de\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84bcd7ffbb-2jfmr"
Jul 15 21:30:19.750113 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:30:19.750093    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7npww\" (UniqueName: \"kubernetes.io/projected/c838bcd5-478d-4b90-a356-f626c220f7de-kube-api-access-7npww\") pod \"cluster-proxy-proxy-agent-84bcd7ffbb-2jfmr\" (UID: \"c838bcd5-478d-4b90-a356-f626c220f7de\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84bcd7ffbb-2jfmr"
Jul 15 21:30:19.890509 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:30:19.890117    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84bcd7ffbb-2jfmr"
Jul 15 21:30:20.186748 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:30:20.186714    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84bcd7ffbb-2jfmr"]
Jul 15 21:30:20.361593 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:30:20.361160    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-6tbzj" event={"ID":"c4900b8a-d9f9-4926-8c67-62cd4a52ce9b","Type":"ContainerStarted","Data":"1ad7309277891b12cc2e8d384a50df807cf87429e8dc1a915138827f92ad259b"}
Jul 15 21:30:20.362125 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:30:20.362078    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-7bc9859798-z9kjp"
Jul 15 21:30:20.363504 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:30:20.363477    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-7bc9859798-z9kjp"
Jul 15 21:30:23.261561 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:30:23.261524    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc838bcd5_478d_4b90_a356_f626c220f7de.slice/crio-edb6b8a7c0ec7d9f2f307eddb735549dc2b2b09ce1033b4c1609e28e450ca320 WatchSource:0}: Error finding container edb6b8a7c0ec7d9f2f307eddb735549dc2b2b09ce1033b4c1609e28e450ca320: Status 404 returned error can't find the container with id edb6b8a7c0ec7d9f2f307eddb735549dc2b2b09ce1033b4c1609e28e450ca320
Jul 15 21:30:23.378621 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:30:23.378563    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84bcd7ffbb-2jfmr" event={"ID":"c838bcd5-478d-4b90-a356-f626c220f7de","Type":"ContainerStarted","Data":"edb6b8a7c0ec7d9f2f307eddb735549dc2b2b09ce1033b4c1609e28e450ca320"}
Jul 15 21:30:26.393358 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:30:26.393316    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-j4l5v" event={"ID":"6f7d5625-636f-4ee3-b08f-05a8822fbb9c","Type":"ContainerStarted","Data":"44b1647cf309d815a2b231b9f025477b4153fe7f8dcf3aa2b4127fccbb6ba405"}
Jul 15 21:30:26.395284 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:30:26.395256    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-sj7lm" event={"ID":"70c7abe7-c0b9-49bd-9ab9-a5db9117faa5","Type":"ContainerStarted","Data":"cfcb23b36822307a74f903119ecf7d2171ae7e80d56d4ca3e1ae1eff26418ecd"}
Jul 15 21:30:26.398341 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:30:26.398051    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-hgkh9" event={"ID":"43c5f71f-98e5-4ed1-aa69-bfb6a8815cae","Type":"ContainerStarted","Data":"fe71bea27382fd697e860486f72683b34f661fe9ad721fb5ccbbc00ce399f73e"}
Jul 15 21:30:26.401653 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:30:26.401179    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-dtcjn" event={"ID":"d2dd5a89-4ca3-4790-aed4-a4f948651d72","Type":"ContainerStarted","Data":"1cd41fa07be54665db737f5f06fc5a43a985952e6785772fe0e566a74a25e608"}
Jul 15 21:30:26.401653 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:30:26.401224    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-dtcjn" event={"ID":"d2dd5a89-4ca3-4790-aed4-a4f948651d72","Type":"ContainerStarted","Data":"9b7062648315c0f5392ab3aa42935529f2e9fb120a6781de7a38c36c2a0cefd3"}
Jul 15 21:30:26.404729 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:30:26.404650    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-l8f7b" event={"ID":"a2939e65-0409-4060-a51e-59bc7a1f6600","Type":"ContainerStarted","Data":"2cb5b3d07db312e61a7c284251f90ea95e3c0701733d75088c619c5bd31886f4"}
Jul 15 21:30:26.404729 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:30:26.404697    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-l8f7b" event={"ID":"a2939e65-0409-4060-a51e-59bc7a1f6600","Type":"ContainerStarted","Data":"68780e8df5d3fd97b0c40593d86646fab8bc25fab4e19db357fe24bb7731afad"}
Jul 15 21:30:26.405086 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:30:26.404908    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-l8f7b"
Jul 15 21:30:26.407338 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:30:26.406876    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-6tbzj" event={"ID":"c4900b8a-d9f9-4926-8c67-62cd4a52ce9b","Type":"ContainerStarted","Data":"c04e9e590e8a80eb2c032877ae99e8ee14797bf224898ca9d4bf5e2382bc4a3d"}
Jul 15 21:30:26.428749 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:30:26.428694    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-hgkh9" podStartSLOduration=64.122910537 podStartE2EDuration="1m11.428652335s" totalImagesPullingTime="7.305741798s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:29:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:30:26.428180524 +0000 UTC m=+76.122108076" watchObservedRunningTime="2026-07-15 21:30:26.428652335 +0000 UTC m=+76.122579886"
Jul 15 21:30:26.430047 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:30:26.430002    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-sj7lm" podStartSLOduration=67.179077919 podStartE2EDuration="1m15.429985551s" totalImagesPullingTime="8.250907632s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 21:29:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:30:26.411052581 +0000 UTC m=+76.104980136" watchObservedRunningTime="2026-07-15 21:30:26.429985551 +0000 UTC m=+76.123913102"
Jul 15 21:30:26.450536 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:30:26.450028    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-dtcjn" podStartSLOduration=58.656125361 podStartE2EDuration="1m5.4500093s" totalImagesPullingTime="6.793883939s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:29:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:30:26.449281812 +0000 UTC m=+76.143209376" watchObservedRunningTime="2026-07-15 21:30:26.4500093 +0000 UTC m=+76.143936835"
Jul 15 21:30:26.474821 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:30:26.474530    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-6tbzj" podStartSLOduration=73.24150912 podStartE2EDuration="1m15.474512169s" totalImagesPullingTime="2.233003049s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:29:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:30:26.472544381 +0000 UTC m=+76.166471932" watchObservedRunningTime="2026-07-15 21:30:26.474512169 +0000 UTC m=+76.168439722"
Jul 15 21:30:28.982436 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:30:28.982403    2563 scope.go:117] "RemoveContainer" containerID="a1533bdaafcb563070c77e7a64f9dfbf21f6dda14758a3a5f7d7e5369f9d201a"
Jul 15 21:30:31.431251 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:30:31.431222    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-zlsbs_9b97af79-5c4a-4622-8d74-04d470841a53/console-operator/2.log"
Jul 15 21:30:31.431693 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:30:31.431305    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-zlsbs" event={"ID":"9b97af79-5c4a-4622-8d74-04d470841a53","Type":"ContainerStarted","Data":"4a5a9180f6e8e7a4d3e9f69fc4e33bd36675789f10c5ef3147b033004a160213"}
Jul 15 21:30:31.431693 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:30:31.431648    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7866497494-zlsbs"
Jul 15 21:30:31.433985 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:30:31.433708    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-j4l5v" event={"ID":"6f7d5625-636f-4ee3-b08f-05a8822fbb9c","Type":"ContainerStarted","Data":"df594a36fd130cb77996ff5e48292d7834a224f60a7adec71d1b9d132d4ae94f"}
Jul 15 21:30:31.436159 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:30:31.436124    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84bcd7ffbb-2jfmr" event={"ID":"c838bcd5-478d-4b90-a356-f626c220f7de","Type":"ContainerStarted","Data":"47ee07e97c49b5e647250592bf91d8165bef144438b07b0c755decee835a56fe"}
Jul 15 21:30:31.436292 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:30:31.436161    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84bcd7ffbb-2jfmr" event={"ID":"c838bcd5-478d-4b90-a356-f626c220f7de","Type":"ContainerStarted","Data":"e87fcd3f9cdf27e68b10942a2a4e685317e0b92179f6381c31a70a4c38904829"}
Jul 15 21:30:31.436292 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:30:31.436182    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84bcd7ffbb-2jfmr" event={"ID":"c838bcd5-478d-4b90-a356-f626c220f7de","Type":"ContainerStarted","Data":"1e97781028456223db4980e139ef9a967ce4c9d5f4d9928b43e18b585b729586"}
Jul 15 21:30:31.447550 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:30:31.447502    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-7866497494-zlsbs" podStartSLOduration=61.199576786 podStartE2EDuration="1m8.447486077s" totalImagesPullingTime="7.247909291s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:29:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:30:31.446822463 +0000 UTC m=+81.140750026" watchObservedRunningTime="2026-07-15 21:30:31.447486077 +0000 UTC m=+81.141413630"
Jul 15 21:30:31.448480 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:30:31.448446    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-l8f7b" podStartSLOduration=38.370233623 podStartE2EDuration="45.448438881s" totalImagesPullingTime="7.078205258s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:29:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:30:26.499960893 +0000 UTC m=+76.193888446" watchObservedRunningTime="2026-07-15 21:30:31.448438881 +0000 UTC m=+81.142366433"
Jul 15 21:30:31.462893 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:30:31.462692    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-j4l5v" podStartSLOduration=17.268012414 podStartE2EDuration="35.462679453s" totalImagesPullingTime="18.194667039s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 21:29:56 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:30:31.462135194 +0000 UTC m=+81.156062744" watchObservedRunningTime="2026-07-15 21:30:31.462679453 +0000 UTC m=+81.156607003"
Jul 15 21:30:31.478842 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:30:31.478768    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84bcd7ffbb-2jfmr" podStartSLOduration=4.682215945 podStartE2EDuration="12.478755184s" totalImagesPullingTime="7.796539239s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:30:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:30:31.478698044 +0000 UTC m=+81.172625596" watchObservedRunningTime="2026-07-15 21:30:31.478755184 +0000 UTC m=+81.172682734"
Jul 15 21:30:31.522168 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:30:31.522107    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-64785b6675-kvqlw"]
Jul 15 21:30:31.525319 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:30:31.525303    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-64785b6675-kvqlw"
Jul 15 21:30:31.527404 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:30:31.527377    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Jul 15 21:30:31.527404 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:30:31.527403    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Jul 15 21:30:31.527574 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:30:31.527405    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-bxzgv\""
Jul 15 21:30:31.527574 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:30:31.527554    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 15 21:30:31.533579 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:30:31.533559    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-64785b6675-kvqlw"]
Jul 15 21:30:31.556047 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:30:31.556022    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/73e59fbc-e033-4930-b2eb-fafc28445643-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-kvqlw\" (UID: \"73e59fbc-e033-4930-b2eb-fafc28445643\") " pod="openshift-monitoring/prometheus-operator-64785b6675-kvqlw"
Jul 15 21:30:31.556142 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:30:31.556051    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8h6qg\" (UniqueName: \"kubernetes.io/projected/73e59fbc-e033-4930-b2eb-fafc28445643-kube-api-access-8h6qg\") pod \"prometheus-operator-64785b6675-kvqlw\" (UID: \"73e59fbc-e033-4930-b2eb-fafc28445643\") " pod="openshift-monitoring/prometheus-operator-64785b6675-kvqlw"
Jul 15 21:30:31.556142 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:30:31.556106    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/73e59fbc-e033-4930-b2eb-fafc28445643-metrics-client-ca\") pod \"prometheus-operator-64785b6675-kvqlw\" (UID: \"73e59fbc-e033-4930-b2eb-fafc28445643\") " pod="openshift-monitoring/prometheus-operator-64785b6675-kvqlw"
Jul 15 21:30:31.556233 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:30:31.556198    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/73e59fbc-e033-4930-b2eb-fafc28445643-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-64785b6675-kvqlw\" (UID: \"73e59fbc-e033-4930-b2eb-fafc28445643\") " pod="openshift-monitoring/prometheus-operator-64785b6675-kvqlw"
Jul 15 21:30:31.657469 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:30:31.657433    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/73e59fbc-e033-4930-b2eb-fafc28445643-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-64785b6675-kvqlw\" (UID: \"73e59fbc-e033-4930-b2eb-fafc28445643\") " pod="openshift-monitoring/prometheus-operator-64785b6675-kvqlw"
Jul 15 21:30:31.657469 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:30:31.657480    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/73e59fbc-e033-4930-b2eb-fafc28445643-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-kvqlw\" (UID: \"73e59fbc-e033-4930-b2eb-fafc28445643\") " pod="openshift-monitoring/prometheus-operator-64785b6675-kvqlw"
Jul 15 21:30:31.657737 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:30:31.657499    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8h6qg\" (UniqueName: \"kubernetes.io/projected/73e59fbc-e033-4930-b2eb-fafc28445643-kube-api-access-8h6qg\") pod \"prometheus-operator-64785b6675-kvqlw\" (UID: \"73e59fbc-e033-4930-b2eb-fafc28445643\") " pod="openshift-monitoring/prometheus-operator-64785b6675-kvqlw"
Jul 15 21:30:31.657737 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:30:31.657537    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/73e59fbc-e033-4930-b2eb-fafc28445643-metrics-client-ca\") pod \"prometheus-operator-64785b6675-kvqlw\" (UID: \"73e59fbc-e033-4930-b2eb-fafc28445643\") " pod="openshift-monitoring/prometheus-operator-64785b6675-kvqlw"
Jul 15 21:30:31.658253 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:30:31.658226    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/73e59fbc-e033-4930-b2eb-fafc28445643-metrics-client-ca\") pod \"prometheus-operator-64785b6675-kvqlw\" (UID: \"73e59fbc-e033-4930-b2eb-fafc28445643\") " pod="openshift-monitoring/prometheus-operator-64785b6675-kvqlw"
Jul 15 21:30:31.659901 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:30:31.659871    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/73e59fbc-e033-4930-b2eb-fafc28445643-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-64785b6675-kvqlw\" (UID: \"73e59fbc-e033-4930-b2eb-fafc28445643\") " pod="openshift-monitoring/prometheus-operator-64785b6675-kvqlw"
Jul 15 21:30:31.660012 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:30:31.659967    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/73e59fbc-e033-4930-b2eb-fafc28445643-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-kvqlw\" (UID: \"73e59fbc-e033-4930-b2eb-fafc28445643\") " pod="openshift-monitoring/prometheus-operator-64785b6675-kvqlw"
Jul 15 21:30:31.664229 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:30:31.664210    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8h6qg\" (UniqueName: \"kubernetes.io/projected/73e59fbc-e033-4930-b2eb-fafc28445643-kube-api-access-8h6qg\") pod \"prometheus-operator-64785b6675-kvqlw\" (UID: \"73e59fbc-e033-4930-b2eb-fafc28445643\") " pod="openshift-monitoring/prometheus-operator-64785b6675-kvqlw"
Jul 15 21:30:31.709690 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:30:31.709654    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-7866497494-zlsbs"
Jul 15 21:30:31.834949 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:30:31.834911    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-64785b6675-kvqlw"
Jul 15 21:30:31.983411 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:30:31.983383    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-64785b6675-kvqlw"]
Jul 15 21:30:31.985846 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:30:31.985820    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod73e59fbc_e033_4930_b2eb_fafc28445643.slice/crio-022978bddf7506602b28c96a0121647fd06707ca73b8cc9160f90b775e5a5101 WatchSource:0}: Error finding container 022978bddf7506602b28c96a0121647fd06707ca73b8cc9160f90b775e5a5101: Status 404 returned error can't find the container with id 022978bddf7506602b28c96a0121647fd06707ca73b8cc9160f90b775e5a5101
Jul 15 21:30:32.441513 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:30:32.441477    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-64785b6675-kvqlw" event={"ID":"73e59fbc-e033-4930-b2eb-fafc28445643","Type":"ContainerStarted","Data":"022978bddf7506602b28c96a0121647fd06707ca73b8cc9160f90b775e5a5101"}
Jul 15 21:30:34.453794 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:30:34.453709    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-64785b6675-kvqlw" event={"ID":"73e59fbc-e033-4930-b2eb-fafc28445643","Type":"ContainerStarted","Data":"f04b79b8809c2d7b24f24eabce4fe21906a73ee85a20eb1d17cba8e87bed2777"}
Jul 15 21:30:34.453794 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:30:34.453763    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-64785b6675-kvqlw" event={"ID":"73e59fbc-e033-4930-b2eb-fafc28445643","Type":"ContainerStarted","Data":"27d3ddf588c0a080d36ea5a5ec24832f38b213867cb0a591bba3c44b8937b7ba"}
Jul 15 21:30:34.475955 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:30:34.473754    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-64785b6675-kvqlw" podStartSLOduration=1.3138283720000001 podStartE2EDuration="3.473735886s" totalImagesPullingTime="2.159907514s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:30:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:30:34.472353296 +0000 UTC m=+84.166280847" watchObservedRunningTime="2026-07-15 21:30:34.473735886 +0000 UTC m=+84.167663437"
Jul 15 21:30:35.896923 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:30:35.896889    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-f8bk7"]
Jul 15 21:30:35.900316 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:30:35.900295    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-f8bk7"
Jul 15 21:30:35.902542 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:30:35.902519    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 15 21:30:35.902646 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:30:35.902525    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 15 21:30:35.902871 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:30:35.902851    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 15 21:30:35.902930 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:30:35.902883    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-g2fkk\""
Jul 15 21:30:35.989133 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:30:35.989098    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fqx2p\" (UniqueName: \"kubernetes.io/projected/753537ce-5cee-496f-ac97-a6cf94a5e65e-kube-api-access-fqx2p\") pod \"node-exporter-f8bk7\" (UID: \"753537ce-5cee-496f-ac97-a6cf94a5e65e\") " pod="openshift-monitoring/node-exporter-f8bk7"
Jul 15 21:30:35.989285 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:30:35.989141    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/753537ce-5cee-496f-ac97-a6cf94a5e65e-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-f8bk7\" (UID: \"753537ce-5cee-496f-ac97-a6cf94a5e65e\") " pod="openshift-monitoring/node-exporter-f8bk7"
Jul 15 21:30:35.989285 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:30:35.989208    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/753537ce-5cee-496f-ac97-a6cf94a5e65e-metrics-client-ca\") pod \"node-exporter-f8bk7\" (UID: \"753537ce-5cee-496f-ac97-a6cf94a5e65e\") " pod="openshift-monitoring/node-exporter-f8bk7"
Jul 15 21:30:35.989285 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:30:35.989252    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/753537ce-5cee-496f-ac97-a6cf94a5e65e-node-exporter-accelerators-collector-config\") pod \"node-exporter-f8bk7\" (UID: \"753537ce-5cee-496f-ac97-a6cf94a5e65e\") " pod="openshift-monitoring/node-exporter-f8bk7"
Jul 15 21:30:35.989285 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:30:35.989273    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/753537ce-5cee-496f-ac97-a6cf94a5e65e-node-exporter-tls\") pod \"node-exporter-f8bk7\" (UID: \"753537ce-5cee-496f-ac97-a6cf94a5e65e\") " pod="openshift-monitoring/node-exporter-f8bk7"
Jul 15 21:30:35.989438 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:30:35.989292    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/753537ce-5cee-496f-ac97-a6cf94a5e65e-root\") pod \"node-exporter-f8bk7\" (UID: \"753537ce-5cee-496f-ac97-a6cf94a5e65e\") " pod="openshift-monitoring/node-exporter-f8bk7"
Jul 15 21:30:35.989438 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:30:35.989386    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/753537ce-5cee-496f-ac97-a6cf94a5e65e-sys\") pod \"node-exporter-f8bk7\" (UID: \"753537ce-5cee-496f-ac97-a6cf94a5e65e\") " pod="openshift-monitoring/node-exporter-f8bk7"
Jul 15 21:30:35.989438 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:30:35.989414    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/753537ce-5cee-496f-ac97-a6cf94a5e65e-node-exporter-wtmp\") pod \"node-exporter-f8bk7\" (UID: \"753537ce-5cee-496f-ac97-a6cf94a5e65e\") " pod="openshift-monitoring/node-exporter-f8bk7"
Jul 15 21:30:35.989438 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:30:35.989435    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/753537ce-5cee-496f-ac97-a6cf94a5e65e-node-exporter-textfile\") pod \"node-exporter-f8bk7\" (UID: \"753537ce-5cee-496f-ac97-a6cf94a5e65e\") " pod="openshift-monitoring/node-exporter-f8bk7"
Jul 15 21:30:36.089749 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:30:36.089707    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/753537ce-5cee-496f-ac97-a6cf94a5e65e-sys\") pod \"node-exporter-f8bk7\" (UID: \"753537ce-5cee-496f-ac97-a6cf94a5e65e\") " pod="openshift-monitoring/node-exporter-f8bk7"
Jul 15 21:30:36.089749 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:30:36.089751    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/753537ce-5cee-496f-ac97-a6cf94a5e65e-node-exporter-wtmp\") pod \"node-exporter-f8bk7\" (UID: \"753537ce-5cee-496f-ac97-a6cf94a5e65e\") " pod="openshift-monitoring/node-exporter-f8bk7"
Jul 15 21:30:36.090004 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:30:36.089774    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/753537ce-5cee-496f-ac97-a6cf94a5e65e-node-exporter-textfile\") pod \"node-exporter-f8bk7\" (UID: \"753537ce-5cee-496f-ac97-a6cf94a5e65e\") " pod="openshift-monitoring/node-exporter-f8bk7"
Jul 15 21:30:36.090004 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:30:36.089833    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/753537ce-5cee-496f-ac97-a6cf94a5e65e-sys\") pod \"node-exporter-f8bk7\" (UID: \"753537ce-5cee-496f-ac97-a6cf94a5e65e\") " pod="openshift-monitoring/node-exporter-f8bk7"
Jul 15 21:30:36.090004 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:30:36.089894    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fqx2p\" (UniqueName: \"kubernetes.io/projected/753537ce-5cee-496f-ac97-a6cf94a5e65e-kube-api-access-fqx2p\") pod \"node-exporter-f8bk7\" (UID: \"753537ce-5cee-496f-ac97-a6cf94a5e65e\") " pod="openshift-monitoring/node-exporter-f8bk7"
Jul 15 21:30:36.090004 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:30:36.089923    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/753537ce-5cee-496f-ac97-a6cf94a5e65e-node-exporter-wtmp\") pod \"node-exporter-f8bk7\" (UID: \"753537ce-5cee-496f-ac97-a6cf94a5e65e\") " pod="openshift-monitoring/node-exporter-f8bk7"
Jul 15 21:30:36.090004 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:30:36.089969    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/753537ce-5cee-496f-ac97-a6cf94a5e65e-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-f8bk7\" (UID: \"753537ce-5cee-496f-ac97-a6cf94a5e65e\") " pod="openshift-monitoring/node-exporter-f8bk7"
Jul 15 21:30:36.090245 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:30:36.090011    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/753537ce-5cee-496f-ac97-a6cf94a5e65e-metrics-client-ca\") pod \"node-exporter-f8bk7\" (UID: \"753537ce-5cee-496f-ac97-a6cf94a5e65e\") " pod="openshift-monitoring/node-exporter-f8bk7"
Jul 15 21:30:36.090245 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:30:36.090048    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/753537ce-5cee-496f-ac97-a6cf94a5e65e-node-exporter-accelerators-collector-config\") pod \"node-exporter-f8bk7\" (UID: \"753537ce-5cee-496f-ac97-a6cf94a5e65e\") " pod="openshift-monitoring/node-exporter-f8bk7"
Jul 15 21:30:36.090245 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:30:36.090077    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/753537ce-5cee-496f-ac97-a6cf94a5e65e-node-exporter-tls\") pod \"node-exporter-f8bk7\" (UID: \"753537ce-5cee-496f-ac97-a6cf94a5e65e\") " pod="openshift-monitoring/node-exporter-f8bk7"
Jul 15 21:30:36.090245 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:30:36.090105    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/753537ce-5cee-496f-ac97-a6cf94a5e65e-root\") pod \"node-exporter-f8bk7\" (UID: \"753537ce-5cee-496f-ac97-a6cf94a5e65e\") " pod="openshift-monitoring/node-exporter-f8bk7"
Jul 15 21:30:36.090245 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:30:36.090119    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/753537ce-5cee-496f-ac97-a6cf94a5e65e-node-exporter-textfile\") pod \"node-exporter-f8bk7\" (UID: \"753537ce-5cee-496f-ac97-a6cf94a5e65e\") " pod="openshift-monitoring/node-exporter-f8bk7"
Jul 15 21:30:36.090245 ip-10-0-130-217 kubenswrapper[2563]: E0715 21:30:36.090222    2563 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Jul 15 21:30:36.090538 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:30:36.090225    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/753537ce-5cee-496f-ac97-a6cf94a5e65e-root\") pod \"node-exporter-f8bk7\" (UID: \"753537ce-5cee-496f-ac97-a6cf94a5e65e\") " pod="openshift-monitoring/node-exporter-f8bk7"
Jul 15 21:30:36.090538 ip-10-0-130-217 kubenswrapper[2563]: E0715 21:30:36.090284    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/753537ce-5cee-496f-ac97-a6cf94a5e65e-node-exporter-tls podName:753537ce-5cee-496f-ac97-a6cf94a5e65e nodeName:}" failed. No retries permitted until 2026-07-15 21:30:36.590266806 +0000 UTC m=+86.284194340 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/753537ce-5cee-496f-ac97-a6cf94a5e65e-node-exporter-tls") pod "node-exporter-f8bk7" (UID: "753537ce-5cee-496f-ac97-a6cf94a5e65e") : secret "node-exporter-tls" not found
Jul 15 21:30:36.090660 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:30:36.090564    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/753537ce-5cee-496f-ac97-a6cf94a5e65e-node-exporter-accelerators-collector-config\") pod \"node-exporter-f8bk7\" (UID: \"753537ce-5cee-496f-ac97-a6cf94a5e65e\") " pod="openshift-monitoring/node-exporter-f8bk7"
Jul 15 21:30:36.090660 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:30:36.090611    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/753537ce-5cee-496f-ac97-a6cf94a5e65e-metrics-client-ca\") pod \"node-exporter-f8bk7\" (UID: \"753537ce-5cee-496f-ac97-a6cf94a5e65e\") " pod="openshift-monitoring/node-exporter-f8bk7"
Jul 15 21:30:36.092321 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:30:36.092298    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/753537ce-5cee-496f-ac97-a6cf94a5e65e-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-f8bk7\" (UID: \"753537ce-5cee-496f-ac97-a6cf94a5e65e\") " pod="openshift-monitoring/node-exporter-f8bk7"
Jul 15 21:30:36.100964 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:30:36.100926    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fqx2p\" (UniqueName: \"kubernetes.io/projected/753537ce-5cee-496f-ac97-a6cf94a5e65e-kube-api-access-fqx2p\") pod \"node-exporter-f8bk7\" (UID: \"753537ce-5cee-496f-ac97-a6cf94a5e65e\") " pod="openshift-monitoring/node-exporter-f8bk7"
Jul 15 21:30:36.416356 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:30:36.416329    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-l8f7b"
Jul 15 21:30:36.594128 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:30:36.594094    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/753537ce-5cee-496f-ac97-a6cf94a5e65e-node-exporter-tls\") pod \"node-exporter-f8bk7\" (UID: \"753537ce-5cee-496f-ac97-a6cf94a5e65e\") " pod="openshift-monitoring/node-exporter-f8bk7"
Jul 15 21:30:36.596452 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:30:36.596419    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/753537ce-5cee-496f-ac97-a6cf94a5e65e-node-exporter-tls\") pod \"node-exporter-f8bk7\" (UID: \"753537ce-5cee-496f-ac97-a6cf94a5e65e\") " pod="openshift-monitoring/node-exporter-f8bk7"
Jul 15 21:30:36.809744 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:30:36.809665    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-f8bk7"
Jul 15 21:30:36.821574 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:30:36.821547    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod753537ce_5cee_496f_ac97_a6cf94a5e65e.slice/crio-dd7d3f5b0b2c0b380031afbf3c0225260ce64390704cd4bd584d04fc7d5e93f6 WatchSource:0}: Error finding container dd7d3f5b0b2c0b380031afbf3c0225260ce64390704cd4bd584d04fc7d5e93f6: Status 404 returned error can't find the container with id dd7d3f5b0b2c0b380031afbf3c0225260ce64390704cd4bd584d04fc7d5e93f6
Jul 15 21:30:37.466927 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:30:37.466891    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-f8bk7" event={"ID":"753537ce-5cee-496f-ac97-a6cf94a5e65e","Type":"ContainerStarted","Data":"dd7d3f5b0b2c0b380031afbf3c0225260ce64390704cd4bd584d04fc7d5e93f6"}
Jul 15 21:30:38.473663 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:30:38.473582    2563 generic.go:356] "Generic (PLEG): container finished" podID="753537ce-5cee-496f-ac97-a6cf94a5e65e" containerID="557262429b9ae9a6d740d521d7a1869ab5f4df2d99e6a2ca93471c60bb504c82" exitCode=0
Jul 15 21:30:38.473663 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:30:38.473635    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-f8bk7" event={"ID":"753537ce-5cee-496f-ac97-a6cf94a5e65e","Type":"ContainerDied","Data":"557262429b9ae9a6d740d521d7a1869ab5f4df2d99e6a2ca93471c60bb504c82"}
Jul 15 21:30:39.480371 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:30:39.480337    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-f8bk7" event={"ID":"753537ce-5cee-496f-ac97-a6cf94a5e65e","Type":"ContainerStarted","Data":"3cc5b1413a029db9c4b6d6d36e2e0322e9a26d1e7d73dbec6f96c669186c63c5"}
Jul 15 21:30:39.480724 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:30:39.480387    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-f8bk7" event={"ID":"753537ce-5cee-496f-ac97-a6cf94a5e65e","Type":"ContainerStarted","Data":"56f5f50425597a102af32864c7bbbac87418e0bbc52667ba50d4f825d168f077"}
Jul 15 21:30:39.502124 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:30:39.502073    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-f8bk7" podStartSLOduration=3.170838088 podStartE2EDuration="4.502055365s" totalImagesPullingTime="1.267738442s" totalInitContainerRuntime="63.478835ms" isStatefulPod=true podCreationTimestamp="2026-07-15 21:30:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:30:39.500196037 +0000 UTC m=+89.194123611" watchObservedRunningTime="2026-07-15 21:30:39.502055365 +0000 UTC m=+89.195982916"
Jul 15 21:30:40.365768 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:30:40.365741    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-df786567c-xhldd"
Jul 15 21:30:41.098256 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:30:41.098222    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-8497cf4dff-564xl"]
Jul 15 21:30:41.101849 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:30:41.101825    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-8497cf4dff-564xl"
Jul 15 21:30:41.104326 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:30:41.104297    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
Jul 15 21:30:41.104428 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:30:41.104374    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
Jul 15 21:30:41.104692 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:30:41.104675    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-9d8wc\""
Jul 15 21:30:41.104771 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:30:41.104688    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
Jul 15 21:30:41.104814 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:30:41.104788    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
Jul 15 21:30:41.105039 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:30:41.105027    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
Jul 15 21:30:41.109998 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:30:41.109883    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\""
Jul 15 21:30:41.116174 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:30:41.116155    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-8497cf4dff-564xl"]
Jul 15 21:30:41.129067 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:30:41.129042    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/d227ddfd-f229-4676-b838-0395a21f7e2d-secret-telemeter-client\") pod \"telemeter-client-8497cf4dff-564xl\" (UID: \"d227ddfd-f229-4676-b838-0395a21f7e2d\") " pod="openshift-monitoring/telemeter-client-8497cf4dff-564xl"
Jul 15 21:30:41.129175 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:30:41.129076    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d227ddfd-f229-4676-b838-0395a21f7e2d-telemeter-trusted-ca-bundle\") pod \"telemeter-client-8497cf4dff-564xl\" (UID: \"d227ddfd-f229-4676-b838-0395a21f7e2d\") " pod="openshift-monitoring/telemeter-client-8497cf4dff-564xl"
Jul 15 21:30:41.129175 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:30:41.129101    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/d227ddfd-f229-4676-b838-0395a21f7e2d-federate-client-tls\") pod \"telemeter-client-8497cf4dff-564xl\" (UID: \"d227ddfd-f229-4676-b838-0395a21f7e2d\") " pod="openshift-monitoring/telemeter-client-8497cf4dff-564xl"
Jul 15 21:30:41.129175 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:30:41.129117    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d227ddfd-f229-4676-b838-0395a21f7e2d-metrics-client-ca\") pod \"telemeter-client-8497cf4dff-564xl\" (UID: \"d227ddfd-f229-4676-b838-0395a21f7e2d\") " pod="openshift-monitoring/telemeter-client-8497cf4dff-564xl"
Jul 15 21:30:41.129175 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:30:41.129136    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d227ddfd-f229-4676-b838-0395a21f7e2d-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-8497cf4dff-564xl\" (UID: \"d227ddfd-f229-4676-b838-0395a21f7e2d\") " pod="openshift-monitoring/telemeter-client-8497cf4dff-564xl"
Jul 15 21:30:41.129418 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:30:41.129240    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d227ddfd-f229-4676-b838-0395a21f7e2d-serving-certs-ca-bundle\") pod \"telemeter-client-8497cf4dff-564xl\" (UID: \"d227ddfd-f229-4676-b838-0395a21f7e2d\") " pod="openshift-monitoring/telemeter-client-8497cf4dff-564xl"
Jul 15 21:30:41.129418 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:30:41.129326    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/d227ddfd-f229-4676-b838-0395a21f7e2d-telemeter-client-tls\") pod \"telemeter-client-8497cf4dff-564xl\" (UID: \"d227ddfd-f229-4676-b838-0395a21f7e2d\") " pod="openshift-monitoring/telemeter-client-8497cf4dff-564xl"
Jul 15 21:30:41.129418 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:30:41.129353    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7sndg\" (UniqueName: \"kubernetes.io/projected/d227ddfd-f229-4676-b838-0395a21f7e2d-kube-api-access-7sndg\") pod \"telemeter-client-8497cf4dff-564xl\" (UID: \"d227ddfd-f229-4676-b838-0395a21f7e2d\") " pod="openshift-monitoring/telemeter-client-8497cf4dff-564xl"
Jul 15 21:30:41.230739 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:30:41.230709    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/d227ddfd-f229-4676-b838-0395a21f7e2d-telemeter-client-tls\") pod \"telemeter-client-8497cf4dff-564xl\" (UID: \"d227ddfd-f229-4676-b838-0395a21f7e2d\") " pod="openshift-monitoring/telemeter-client-8497cf4dff-564xl"
Jul 15 21:30:41.230739 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:30:41.230742    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7sndg\" (UniqueName: \"kubernetes.io/projected/d227ddfd-f229-4676-b838-0395a21f7e2d-kube-api-access-7sndg\") pod \"telemeter-client-8497cf4dff-564xl\" (UID: \"d227ddfd-f229-4676-b838-0395a21f7e2d\") " pod="openshift-monitoring/telemeter-client-8497cf4dff-564xl"
Jul 15 21:30:41.230921 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:30:41.230821    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/d227ddfd-f229-4676-b838-0395a21f7e2d-secret-telemeter-client\") pod \"telemeter-client-8497cf4dff-564xl\" (UID: \"d227ddfd-f229-4676-b838-0395a21f7e2d\") " pod="openshift-monitoring/telemeter-client-8497cf4dff-564xl"
Jul 15 21:30:41.230921 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:30:41.230855    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d227ddfd-f229-4676-b838-0395a21f7e2d-telemeter-trusted-ca-bundle\") pod \"telemeter-client-8497cf4dff-564xl\" (UID: \"d227ddfd-f229-4676-b838-0395a21f7e2d\") " pod="openshift-monitoring/telemeter-client-8497cf4dff-564xl"
Jul 15 21:30:41.230921 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:30:41.230886    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/d227ddfd-f229-4676-b838-0395a21f7e2d-federate-client-tls\") pod \"telemeter-client-8497cf4dff-564xl\" (UID: \"d227ddfd-f229-4676-b838-0395a21f7e2d\") " pod="openshift-monitoring/telemeter-client-8497cf4dff-564xl"
Jul 15 21:30:41.230921 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:30:41.230912    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d227ddfd-f229-4676-b838-0395a21f7e2d-metrics-client-ca\") pod \"telemeter-client-8497cf4dff-564xl\" (UID: \"d227ddfd-f229-4676-b838-0395a21f7e2d\") " pod="openshift-monitoring/telemeter-client-8497cf4dff-564xl"
Jul 15 21:30:41.231157 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:30:41.230961    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d227ddfd-f229-4676-b838-0395a21f7e2d-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-8497cf4dff-564xl\" (UID: \"d227ddfd-f229-4676-b838-0395a21f7e2d\") " pod="openshift-monitoring/telemeter-client-8497cf4dff-564xl"
Jul 15 21:30:41.231157 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:30:41.231030    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d227ddfd-f229-4676-b838-0395a21f7e2d-serving-certs-ca-bundle\") pod \"telemeter-client-8497cf4dff-564xl\" (UID: \"d227ddfd-f229-4676-b838-0395a21f7e2d\") " pod="openshift-monitoring/telemeter-client-8497cf4dff-564xl"
Jul 15 21:30:41.231795 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:30:41.231767    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d227ddfd-f229-4676-b838-0395a21f7e2d-metrics-client-ca\") pod \"telemeter-client-8497cf4dff-564xl\" (UID: \"d227ddfd-f229-4676-b838-0395a21f7e2d\") " pod="openshift-monitoring/telemeter-client-8497cf4dff-564xl"
Jul 15 21:30:41.231924 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:30:41.231829    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d227ddfd-f229-4676-b838-0395a21f7e2d-serving-certs-ca-bundle\") pod \"telemeter-client-8497cf4dff-564xl\" (UID: \"d227ddfd-f229-4676-b838-0395a21f7e2d\") " pod="openshift-monitoring/telemeter-client-8497cf4dff-564xl"
Jul 15 21:30:41.232024 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:30:41.231930    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d227ddfd-f229-4676-b838-0395a21f7e2d-telemeter-trusted-ca-bundle\") pod \"telemeter-client-8497cf4dff-564xl\" (UID: \"d227ddfd-f229-4676-b838-0395a21f7e2d\") " pod="openshift-monitoring/telemeter-client-8497cf4dff-564xl"
Jul 15 21:30:41.233565 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:30:41.233538    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d227ddfd-f229-4676-b838-0395a21f7e2d-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-8497cf4dff-564xl\" (UID: \"d227ddfd-f229-4676-b838-0395a21f7e2d\") " pod="openshift-monitoring/telemeter-client-8497cf4dff-564xl"
Jul 15 21:30:41.233678 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:30:41.233543    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/d227ddfd-f229-4676-b838-0395a21f7e2d-secret-telemeter-client\") pod \"telemeter-client-8497cf4dff-564xl\" (UID: \"d227ddfd-f229-4676-b838-0395a21f7e2d\") " pod="openshift-monitoring/telemeter-client-8497cf4dff-564xl"
Jul 15 21:30:41.233858 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:30:41.233841    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/d227ddfd-f229-4676-b838-0395a21f7e2d-federate-client-tls\") pod \"telemeter-client-8497cf4dff-564xl\" (UID: \"d227ddfd-f229-4676-b838-0395a21f7e2d\") " pod="openshift-monitoring/telemeter-client-8497cf4dff-564xl"
Jul 15 21:30:41.233916 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:30:41.233879    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/d227ddfd-f229-4676-b838-0395a21f7e2d-telemeter-client-tls\") pod \"telemeter-client-8497cf4dff-564xl\" (UID: \"d227ddfd-f229-4676-b838-0395a21f7e2d\") " pod="openshift-monitoring/telemeter-client-8497cf4dff-564xl"
Jul 15 21:30:41.238385 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:30:41.238362    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7sndg\" (UniqueName: \"kubernetes.io/projected/d227ddfd-f229-4676-b838-0395a21f7e2d-kube-api-access-7sndg\") pod \"telemeter-client-8497cf4dff-564xl\" (UID: \"d227ddfd-f229-4676-b838-0395a21f7e2d\") " pod="openshift-monitoring/telemeter-client-8497cf4dff-564xl"
Jul 15 21:30:41.381329 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:30:41.381256    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-df786567c-xhldd"]
Jul 15 21:30:41.412498 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:30:41.412471    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-8497cf4dff-564xl"
Jul 15 21:30:41.552833 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:30:41.552798    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-8497cf4dff-564xl"]
Jul 15 21:30:41.555976 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:30:41.555917    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd227ddfd_f229_4676_b838_0395a21f7e2d.slice/crio-30dacfc8260b42970fd591b115bdc460c39e265032e9eb60ab154687acf6464d WatchSource:0}: Error finding container 30dacfc8260b42970fd591b115bdc460c39e265032e9eb60ab154687acf6464d: Status 404 returned error can't find the container with id 30dacfc8260b42970fd591b115bdc460c39e265032e9eb60ab154687acf6464d
Jul 15 21:30:42.496108 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:30:42.496065    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-8497cf4dff-564xl" event={"ID":"d227ddfd-f229-4676-b838-0395a21f7e2d","Type":"ContainerStarted","Data":"30dacfc8260b42970fd591b115bdc460c39e265032e9eb60ab154687acf6464d"}
Jul 15 21:30:43.502266 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:30:43.502229    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-8497cf4dff-564xl" event={"ID":"d227ddfd-f229-4676-b838-0395a21f7e2d","Type":"ContainerStarted","Data":"b0073a725f110d0d3fe0ad68b0636da2aa90c3972dbe4dc77fe0aa22ef8d6e72"}
Jul 15 21:30:44.069355 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:30:44.069318    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-78d89969b6-98r5z"]
Jul 15 21:30:44.072563 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:30:44.072541    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-78d89969b6-98r5z"
Jul 15 21:30:44.074868 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:30:44.074845    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 15 21:30:44.075008 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:30:44.074843    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 15 21:30:44.075879 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:30:44.075779    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-rzqvv\""
Jul 15 21:30:44.075879 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:30:44.075779    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 15 21:30:44.075879 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:30:44.075829    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 15 21:30:44.075879 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:30:44.075857    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 15 21:30:44.076118 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:30:44.075882    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 15 21:30:44.076118 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:30:44.075903    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 15 21:30:44.082420 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:30:44.082400    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-78d89969b6-98r5z"]
Jul 15 21:30:44.154074 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:30:44.154042    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c4177e0f-389c-4b50-a08c-756660dc7844-console-oauth-config\") pod \"console-78d89969b6-98r5z\" (UID: \"c4177e0f-389c-4b50-a08c-756660dc7844\") " pod="openshift-console/console-78d89969b6-98r5z"
Jul 15 21:30:44.154235 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:30:44.154081    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c4177e0f-389c-4b50-a08c-756660dc7844-console-config\") pod \"console-78d89969b6-98r5z\" (UID: \"c4177e0f-389c-4b50-a08c-756660dc7844\") " pod="openshift-console/console-78d89969b6-98r5z"
Jul 15 21:30:44.154235 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:30:44.154103    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c4177e0f-389c-4b50-a08c-756660dc7844-service-ca\") pod \"console-78d89969b6-98r5z\" (UID: \"c4177e0f-389c-4b50-a08c-756660dc7844\") " pod="openshift-console/console-78d89969b6-98r5z"
Jul 15 21:30:44.154235 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:30:44.154121    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c4177e0f-389c-4b50-a08c-756660dc7844-oauth-serving-cert\") pod \"console-78d89969b6-98r5z\" (UID: \"c4177e0f-389c-4b50-a08c-756660dc7844\") " pod="openshift-console/console-78d89969b6-98r5z"
Jul 15 21:30:44.154235 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:30:44.154179    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pxvf6\" (UniqueName: \"kubernetes.io/projected/c4177e0f-389c-4b50-a08c-756660dc7844-kube-api-access-pxvf6\") pod \"console-78d89969b6-98r5z\" (UID: \"c4177e0f-389c-4b50-a08c-756660dc7844\") " pod="openshift-console/console-78d89969b6-98r5z"
Jul 15 21:30:44.154358 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:30:44.154240    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c4177e0f-389c-4b50-a08c-756660dc7844-console-serving-cert\") pod \"console-78d89969b6-98r5z\" (UID: \"c4177e0f-389c-4b50-a08c-756660dc7844\") " pod="openshift-console/console-78d89969b6-98r5z"
Jul 15 21:30:44.254794 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:30:44.254749    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c4177e0f-389c-4b50-a08c-756660dc7844-console-oauth-config\") pod \"console-78d89969b6-98r5z\" (UID: \"c4177e0f-389c-4b50-a08c-756660dc7844\") " pod="openshift-console/console-78d89969b6-98r5z"
Jul 15 21:30:44.255000 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:30:44.254803    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c4177e0f-389c-4b50-a08c-756660dc7844-console-config\") pod \"console-78d89969b6-98r5z\" (UID: \"c4177e0f-389c-4b50-a08c-756660dc7844\") " pod="openshift-console/console-78d89969b6-98r5z"
Jul 15 21:30:44.255000 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:30:44.254887    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c4177e0f-389c-4b50-a08c-756660dc7844-service-ca\") pod \"console-78d89969b6-98r5z\" (UID: \"c4177e0f-389c-4b50-a08c-756660dc7844\") " pod="openshift-console/console-78d89969b6-98r5z"
Jul 15 21:30:44.255000 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:30:44.254930    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c4177e0f-389c-4b50-a08c-756660dc7844-oauth-serving-cert\") pod \"console-78d89969b6-98r5z\" (UID: \"c4177e0f-389c-4b50-a08c-756660dc7844\") " pod="openshift-console/console-78d89969b6-98r5z"
Jul 15 21:30:44.255000 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:30:44.254983    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pxvf6\" (UniqueName: \"kubernetes.io/projected/c4177e0f-389c-4b50-a08c-756660dc7844-kube-api-access-pxvf6\") pod \"console-78d89969b6-98r5z\" (UID: \"c4177e0f-389c-4b50-a08c-756660dc7844\") " pod="openshift-console/console-78d89969b6-98r5z"
Jul 15 21:30:44.255347 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:30:44.255042    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c4177e0f-389c-4b50-a08c-756660dc7844-console-serving-cert\") pod \"console-78d89969b6-98r5z\" (UID: \"c4177e0f-389c-4b50-a08c-756660dc7844\") " pod="openshift-console/console-78d89969b6-98r5z"
Jul 15 21:30:44.256748 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:30:44.255743    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c4177e0f-389c-4b50-a08c-756660dc7844-console-config\") pod \"console-78d89969b6-98r5z\" (UID: \"c4177e0f-389c-4b50-a08c-756660dc7844\") " pod="openshift-console/console-78d89969b6-98r5z"
Jul 15 21:30:44.256748 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:30:44.256007    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c4177e0f-389c-4b50-a08c-756660dc7844-service-ca\") pod \"console-78d89969b6-98r5z\" (UID: \"c4177e0f-389c-4b50-a08c-756660dc7844\") " pod="openshift-console/console-78d89969b6-98r5z"
Jul 15 21:30:44.256748 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:30:44.256474    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c4177e0f-389c-4b50-a08c-756660dc7844-oauth-serving-cert\") pod \"console-78d89969b6-98r5z\" (UID: \"c4177e0f-389c-4b50-a08c-756660dc7844\") " pod="openshift-console/console-78d89969b6-98r5z"
Jul 15 21:30:44.258000 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:30:44.257980    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c4177e0f-389c-4b50-a08c-756660dc7844-console-oauth-config\") pod \"console-78d89969b6-98r5z\" (UID: \"c4177e0f-389c-4b50-a08c-756660dc7844\") " pod="openshift-console/console-78d89969b6-98r5z"
Jul 15 21:30:44.258670 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:30:44.258425    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c4177e0f-389c-4b50-a08c-756660dc7844-console-serving-cert\") pod \"console-78d89969b6-98r5z\" (UID: \"c4177e0f-389c-4b50-a08c-756660dc7844\") " pod="openshift-console/console-78d89969b6-98r5z"
Jul 15 21:30:44.263580 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:30:44.263559    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pxvf6\" (UniqueName: \"kubernetes.io/projected/c4177e0f-389c-4b50-a08c-756660dc7844-kube-api-access-pxvf6\") pod \"console-78d89969b6-98r5z\" (UID: \"c4177e0f-389c-4b50-a08c-756660dc7844\") " pod="openshift-console/console-78d89969b6-98r5z"
Jul 15 21:30:44.383065 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:30:44.383012    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-78d89969b6-98r5z"
Jul 15 21:30:44.523479 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:30:44.523446    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-78d89969b6-98r5z"]
Jul 15 21:30:44.692598 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:30:44.692524    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc4177e0f_389c_4b50_a08c_756660dc7844.slice/crio-2666fc14e59e7d86cf55f9b190ff9f9b2c7f72e1807ee134c45bc9f93ca8bd61 WatchSource:0}: Error finding container 2666fc14e59e7d86cf55f9b190ff9f9b2c7f72e1807ee134c45bc9f93ca8bd61: Status 404 returned error can't find the container with id 2666fc14e59e7d86cf55f9b190ff9f9b2c7f72e1807ee134c45bc9f93ca8bd61
Jul 15 21:30:45.515004 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:30:45.514966    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-8497cf4dff-564xl" event={"ID":"d227ddfd-f229-4676-b838-0395a21f7e2d","Type":"ContainerStarted","Data":"b4081f0aeed4decb1e492258a44cef2e53445d6ac76070f09b95367c0818e811"}
Jul 15 21:30:45.515180 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:30:45.515034    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-8497cf4dff-564xl" event={"ID":"d227ddfd-f229-4676-b838-0395a21f7e2d","Type":"ContainerStarted","Data":"77bf8f96810d9fc9bda005833e7d30c45a4cfcf4ce255a90d0fc79093a83c7b7"}
Jul 15 21:30:45.516453 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:30:45.516423    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-78d89969b6-98r5z" event={"ID":"c4177e0f-389c-4b50-a08c-756660dc7844","Type":"ContainerStarted","Data":"2666fc14e59e7d86cf55f9b190ff9f9b2c7f72e1807ee134c45bc9f93ca8bd61"}
Jul 15 21:30:45.534576 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:30:45.534528    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-8497cf4dff-564xl" podStartSLOduration=1.424748194 podStartE2EDuration="4.534500669s" totalImagesPullingTime="3.109752475s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:30:41 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:30:45.532970265 +0000 UTC m=+95.226897817" watchObservedRunningTime="2026-07-15 21:30:45.534500669 +0000 UTC m=+95.228428219"
Jul 15 21:30:48.538645 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:30:48.538602    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-78d89969b6-98r5z" event={"ID":"c4177e0f-389c-4b50-a08c-756660dc7844","Type":"ContainerStarted","Data":"d0eddfcd84799f922f5bb70b1b3cb8184391b80ede59c1db11630595698f5cac"}
Jul 15 21:30:48.555849 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:30:48.555800    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-78d89969b6-98r5z" podStartSLOduration=1.247114822 podStartE2EDuration="4.555784577s" totalImagesPullingTime="3.308669755s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:30:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:30:48.554996842 +0000 UTC m=+98.248924394" watchObservedRunningTime="2026-07-15 21:30:48.555784577 +0000 UTC m=+98.249712128"
Jul 15 21:30:49.352082 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:30:49.352051    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-dw6kh"
Jul 15 21:30:53.912409 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:30:53.912368    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-689f4555c4-2zvnb"]
Jul 15 21:30:53.918846 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:30:53.918818    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-689f4555c4-2zvnb"
Jul 15 21:30:53.925947 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:30:53.925903    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 15 21:30:53.926845 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:30:53.926813    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-689f4555c4-2zvnb"]
Jul 15 21:30:54.044143 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:30:54.044109    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2ee8019b-8450-483d-9181-1140ecc08ab6-oauth-serving-cert\") pod \"console-689f4555c4-2zvnb\" (UID: \"2ee8019b-8450-483d-9181-1140ecc08ab6\") " pod="openshift-console/console-689f4555c4-2zvnb"
Jul 15 21:30:54.044314 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:30:54.044160    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2ee8019b-8450-483d-9181-1140ecc08ab6-console-config\") pod \"console-689f4555c4-2zvnb\" (UID: \"2ee8019b-8450-483d-9181-1140ecc08ab6\") " pod="openshift-console/console-689f4555c4-2zvnb"
Jul 15 21:30:54.044314 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:30:54.044178    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2ee8019b-8450-483d-9181-1140ecc08ab6-console-serving-cert\") pod \"console-689f4555c4-2zvnb\" (UID: \"2ee8019b-8450-483d-9181-1140ecc08ab6\") " pod="openshift-console/console-689f4555c4-2zvnb"
Jul 15 21:30:54.044314 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:30:54.044220    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2ee8019b-8450-483d-9181-1140ecc08ab6-trusted-ca-bundle\") pod \"console-689f4555c4-2zvnb\" (UID: \"2ee8019b-8450-483d-9181-1140ecc08ab6\") " pod="openshift-console/console-689f4555c4-2zvnb"
Jul 15 21:30:54.044487 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:30:54.044356    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xd9vw\" (UniqueName: \"kubernetes.io/projected/2ee8019b-8450-483d-9181-1140ecc08ab6-kube-api-access-xd9vw\") pod \"console-689f4555c4-2zvnb\" (UID: \"2ee8019b-8450-483d-9181-1140ecc08ab6\") " pod="openshift-console/console-689f4555c4-2zvnb"
Jul 15 21:30:54.044487 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:30:54.044410    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2ee8019b-8450-483d-9181-1140ecc08ab6-service-ca\") pod \"console-689f4555c4-2zvnb\" (UID: \"2ee8019b-8450-483d-9181-1140ecc08ab6\") " pod="openshift-console/console-689f4555c4-2zvnb"
Jul 15 21:30:54.044487 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:30:54.044459    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2ee8019b-8450-483d-9181-1140ecc08ab6-console-oauth-config\") pod \"console-689f4555c4-2zvnb\" (UID: \"2ee8019b-8450-483d-9181-1140ecc08ab6\") " pod="openshift-console/console-689f4555c4-2zvnb"
Jul 15 21:30:54.145294 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:30:54.145248    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2ee8019b-8450-483d-9181-1140ecc08ab6-service-ca\") pod \"console-689f4555c4-2zvnb\" (UID: \"2ee8019b-8450-483d-9181-1140ecc08ab6\") " pod="openshift-console/console-689f4555c4-2zvnb"
Jul 15 21:30:54.145493 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:30:54.145307    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2ee8019b-8450-483d-9181-1140ecc08ab6-console-oauth-config\") pod \"console-689f4555c4-2zvnb\" (UID: \"2ee8019b-8450-483d-9181-1140ecc08ab6\") " pod="openshift-console/console-689f4555c4-2zvnb"
Jul 15 21:30:54.145493 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:30:54.145345    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2ee8019b-8450-483d-9181-1140ecc08ab6-oauth-serving-cert\") pod \"console-689f4555c4-2zvnb\" (UID: \"2ee8019b-8450-483d-9181-1140ecc08ab6\") " pod="openshift-console/console-689f4555c4-2zvnb"
Jul 15 21:30:54.145493 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:30:54.145384    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2ee8019b-8450-483d-9181-1140ecc08ab6-console-config\") pod \"console-689f4555c4-2zvnb\" (UID: \"2ee8019b-8450-483d-9181-1140ecc08ab6\") " pod="openshift-console/console-689f4555c4-2zvnb"
Jul 15 21:30:54.145493 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:30:54.145408    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2ee8019b-8450-483d-9181-1140ecc08ab6-console-serving-cert\") pod \"console-689f4555c4-2zvnb\" (UID: \"2ee8019b-8450-483d-9181-1140ecc08ab6\") " pod="openshift-console/console-689f4555c4-2zvnb"
Jul 15 21:30:54.145704 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:30:54.145547    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2ee8019b-8450-483d-9181-1140ecc08ab6-trusted-ca-bundle\") pod \"console-689f4555c4-2zvnb\" (UID: \"2ee8019b-8450-483d-9181-1140ecc08ab6\") " pod="openshift-console/console-689f4555c4-2zvnb"
Jul 15 21:30:54.145704 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:30:54.145625    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xd9vw\" (UniqueName: \"kubernetes.io/projected/2ee8019b-8450-483d-9181-1140ecc08ab6-kube-api-access-xd9vw\") pod \"console-689f4555c4-2zvnb\" (UID: \"2ee8019b-8450-483d-9181-1140ecc08ab6\") " pod="openshift-console/console-689f4555c4-2zvnb"
Jul 15 21:30:54.146145 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:30:54.146118    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2ee8019b-8450-483d-9181-1140ecc08ab6-oauth-serving-cert\") pod \"console-689f4555c4-2zvnb\" (UID: \"2ee8019b-8450-483d-9181-1140ecc08ab6\") " pod="openshift-console/console-689f4555c4-2zvnb"
Jul 15 21:30:54.146265 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:30:54.146118    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2ee8019b-8450-483d-9181-1140ecc08ab6-service-ca\") pod \"console-689f4555c4-2zvnb\" (UID: \"2ee8019b-8450-483d-9181-1140ecc08ab6\") " pod="openshift-console/console-689f4555c4-2zvnb"
Jul 15 21:30:54.146508 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:30:54.146477    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2ee8019b-8450-483d-9181-1140ecc08ab6-trusted-ca-bundle\") pod \"console-689f4555c4-2zvnb\" (UID: \"2ee8019b-8450-483d-9181-1140ecc08ab6\") " pod="openshift-console/console-689f4555c4-2zvnb"
Jul 15 21:30:54.146916 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:30:54.146896    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2ee8019b-8450-483d-9181-1140ecc08ab6-console-config\") pod \"console-689f4555c4-2zvnb\" (UID: \"2ee8019b-8450-483d-9181-1140ecc08ab6\") " pod="openshift-console/console-689f4555c4-2zvnb"
Jul 15 21:30:54.147927 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:30:54.147908    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2ee8019b-8450-483d-9181-1140ecc08ab6-console-oauth-config\") pod \"console-689f4555c4-2zvnb\" (UID: \"2ee8019b-8450-483d-9181-1140ecc08ab6\") " pod="openshift-console/console-689f4555c4-2zvnb"
Jul 15 21:30:54.148050 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:30:54.148032    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2ee8019b-8450-483d-9181-1140ecc08ab6-console-serving-cert\") pod \"console-689f4555c4-2zvnb\" (UID: \"2ee8019b-8450-483d-9181-1140ecc08ab6\") " pod="openshift-console/console-689f4555c4-2zvnb"
Jul 15 21:30:54.153169 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:30:54.153145    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xd9vw\" (UniqueName: \"kubernetes.io/projected/2ee8019b-8450-483d-9181-1140ecc08ab6-kube-api-access-xd9vw\") pod \"console-689f4555c4-2zvnb\" (UID: \"2ee8019b-8450-483d-9181-1140ecc08ab6\") " pod="openshift-console/console-689f4555c4-2zvnb"
Jul 15 21:30:54.229724 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:30:54.229631    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-689f4555c4-2zvnb"
Jul 15 21:30:54.383214 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:30:54.383164    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-78d89969b6-98r5z"
Jul 15 21:30:54.383400 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:30:54.383249    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-78d89969b6-98r5z"
Jul 15 21:30:54.389555 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:30:54.389448    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-78d89969b6-98r5z"
Jul 15 21:30:54.409583 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:30:54.409503    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-689f4555c4-2zvnb"]
Jul 15 21:30:54.414508 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:30:54.414473    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2ee8019b_8450_483d_9181_1140ecc08ab6.slice/crio-0a0bf54560b9775173a3247cf5ef6eb3fefef7bebcaa923771f5a65637651f90 WatchSource:0}: Error finding container 0a0bf54560b9775173a3247cf5ef6eb3fefef7bebcaa923771f5a65637651f90: Status 404 returned error can't find the container with id 0a0bf54560b9775173a3247cf5ef6eb3fefef7bebcaa923771f5a65637651f90
Jul 15 21:30:54.566648 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:30:54.566606    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-689f4555c4-2zvnb" event={"ID":"2ee8019b-8450-483d-9181-1140ecc08ab6","Type":"ContainerStarted","Data":"8a41280a64d9d7c4d6c3164546e49544f2550c093e73aa0cde865ab608c22f8c"}
Jul 15 21:30:54.567306 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:30:54.567279    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-689f4555c4-2zvnb" event={"ID":"2ee8019b-8450-483d-9181-1140ecc08ab6","Type":"ContainerStarted","Data":"0a0bf54560b9775173a3247cf5ef6eb3fefef7bebcaa923771f5a65637651f90"}
Jul 15 21:30:54.571200 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:30:54.571167    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-78d89969b6-98r5z"
Jul 15 21:30:55.585729 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:30:55.585673    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-689f4555c4-2zvnb" podStartSLOduration=2.5856565849999997 podStartE2EDuration="2.585656585s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:30:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:30:55.584519521 +0000 UTC m=+105.278447072" watchObservedRunningTime="2026-07-15 21:30:55.585656585 +0000 UTC m=+105.279584136"
Jul 15 21:31:04.229855 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:31:04.229815    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-689f4555c4-2zvnb"
Jul 15 21:31:04.230283 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:31:04.229899    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-689f4555c4-2zvnb"
Jul 15 21:31:04.234985 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:31:04.234963    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-689f4555c4-2zvnb"
Jul 15 21:31:04.611403 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:31:04.611361    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-689f4555c4-2zvnb"
Jul 15 21:31:04.658036 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:31:04.657997    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-78d89969b6-98r5z"]
Jul 15 21:31:06.401745 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:31:06.401682    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-df786567c-xhldd" podUID="c6249c00-aa11-475f-a2a5-62cd7999fdd0" containerName="registry" containerID="cri-o://b40cf69c580dc47ee3d4707bb160559908e41c6b22ca7c070aa9732f5fcf4086" gracePeriod=30
Jul 15 21:31:06.637727 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:31:06.637688    2563 generic.go:356] "Generic (PLEG): container finished" podID="c6249c00-aa11-475f-a2a5-62cd7999fdd0" containerID="b40cf69c580dc47ee3d4707bb160559908e41c6b22ca7c070aa9732f5fcf4086" exitCode=0
Jul 15 21:31:06.637727 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:31:06.637719    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-df786567c-xhldd" event={"ID":"c6249c00-aa11-475f-a2a5-62cd7999fdd0","Type":"ContainerDied","Data":"b40cf69c580dc47ee3d4707bb160559908e41c6b22ca7c070aa9732f5fcf4086"}
Jul 15 21:31:06.639647 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:31:06.639625    2563 generic.go:356] "Generic (PLEG): container finished" podID="7c107438-4a43-49fe-9bcb-a9c114c05d85" containerID="be4787e2dfbd43287d8b300edb185adab4afc3fbd8e95494dfcbf01da7f99eae" exitCode=0
Jul 15 21:31:06.639776 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:31:06.639712    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-j57mj" event={"ID":"7c107438-4a43-49fe-9bcb-a9c114c05d85","Type":"ContainerDied","Data":"be4787e2dfbd43287d8b300edb185adab4afc3fbd8e95494dfcbf01da7f99eae"}
Jul 15 21:31:06.640230 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:31:06.640213    2563 scope.go:117] "RemoveContainer" containerID="be4787e2dfbd43287d8b300edb185adab4afc3fbd8e95494dfcbf01da7f99eae"
Jul 15 21:31:06.686326 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:31:06.686292    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-df786567c-xhldd"
Jul 15 21:31:06.751668 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:31:06.751635    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c6249c00-aa11-475f-a2a5-62cd7999fdd0-ca-trust-extracted\") pod \"c6249c00-aa11-475f-a2a5-62cd7999fdd0\" (UID: \"c6249c00-aa11-475f-a2a5-62cd7999fdd0\") "
Jul 15 21:31:06.751847 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:31:06.751683    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c6249c00-aa11-475f-a2a5-62cd7999fdd0-registry-tls\") pod \"c6249c00-aa11-475f-a2a5-62cd7999fdd0\" (UID: \"c6249c00-aa11-475f-a2a5-62cd7999fdd0\") "
Jul 15 21:31:06.751847 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:31:06.751710    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c6249c00-aa11-475f-a2a5-62cd7999fdd0-installation-pull-secrets\") pod \"c6249c00-aa11-475f-a2a5-62cd7999fdd0\" (UID: \"c6249c00-aa11-475f-a2a5-62cd7999fdd0\") "
Jul 15 21:31:06.751847 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:31:06.751734    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c6249c00-aa11-475f-a2a5-62cd7999fdd0-trusted-ca\") pod \"c6249c00-aa11-475f-a2a5-62cd7999fdd0\" (UID: \"c6249c00-aa11-475f-a2a5-62cd7999fdd0\") "
Jul 15 21:31:06.751847 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:31:06.751791    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c6249c00-aa11-475f-a2a5-62cd7999fdd0-image-registry-private-configuration\") pod \"c6249c00-aa11-475f-a2a5-62cd7999fdd0\" (UID: \"c6249c00-aa11-475f-a2a5-62cd7999fdd0\") "
Jul 15 21:31:06.751847 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:31:06.751827    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c6249c00-aa11-475f-a2a5-62cd7999fdd0-bound-sa-token\") pod \"c6249c00-aa11-475f-a2a5-62cd7999fdd0\" (UID: \"c6249c00-aa11-475f-a2a5-62cd7999fdd0\") "
Jul 15 21:31:06.752128 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:31:06.751855    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c6249c00-aa11-475f-a2a5-62cd7999fdd0-registry-certificates\") pod \"c6249c00-aa11-475f-a2a5-62cd7999fdd0\" (UID: \"c6249c00-aa11-475f-a2a5-62cd7999fdd0\") "
Jul 15 21:31:06.752128 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:31:06.751884    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bw6b5\" (UniqueName: \"kubernetes.io/projected/c6249c00-aa11-475f-a2a5-62cd7999fdd0-kube-api-access-bw6b5\") pod \"c6249c00-aa11-475f-a2a5-62cd7999fdd0\" (UID: \"c6249c00-aa11-475f-a2a5-62cd7999fdd0\") "
Jul 15 21:31:06.752238 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:31:06.752192    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c6249c00-aa11-475f-a2a5-62cd7999fdd0-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "c6249c00-aa11-475f-a2a5-62cd7999fdd0" (UID: "c6249c00-aa11-475f-a2a5-62cd7999fdd0"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 21:31:06.752868 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:31:06.752343    2563 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c6249c00-aa11-475f-a2a5-62cd7999fdd0-trusted-ca\") on node \"ip-10-0-130-217.ec2.internal\" DevicePath \"\""
Jul 15 21:31:06.752868 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:31:06.752419    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c6249c00-aa11-475f-a2a5-62cd7999fdd0-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "c6249c00-aa11-475f-a2a5-62cd7999fdd0" (UID: "c6249c00-aa11-475f-a2a5-62cd7999fdd0"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 21:31:06.754755 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:31:06.754729    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c6249c00-aa11-475f-a2a5-62cd7999fdd0-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "c6249c00-aa11-475f-a2a5-62cd7999fdd0" (UID: "c6249c00-aa11-475f-a2a5-62cd7999fdd0"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 21:31:06.754870 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:31:06.754804    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c6249c00-aa11-475f-a2a5-62cd7999fdd0-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "c6249c00-aa11-475f-a2a5-62cd7999fdd0" (UID: "c6249c00-aa11-475f-a2a5-62cd7999fdd0"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 21:31:06.755248 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:31:06.755216    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c6249c00-aa11-475f-a2a5-62cd7999fdd0-kube-api-access-bw6b5" (OuterVolumeSpecName: "kube-api-access-bw6b5") pod "c6249c00-aa11-475f-a2a5-62cd7999fdd0" (UID: "c6249c00-aa11-475f-a2a5-62cd7999fdd0"). InnerVolumeSpecName "kube-api-access-bw6b5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 21:31:06.755347 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:31:06.755291    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c6249c00-aa11-475f-a2a5-62cd7999fdd0-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "c6249c00-aa11-475f-a2a5-62cd7999fdd0" (UID: "c6249c00-aa11-475f-a2a5-62cd7999fdd0"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 21:31:06.755347 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:31:06.755325    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c6249c00-aa11-475f-a2a5-62cd7999fdd0-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "c6249c00-aa11-475f-a2a5-62cd7999fdd0" (UID: "c6249c00-aa11-475f-a2a5-62cd7999fdd0"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 21:31:06.763607 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:31:06.763581    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c6249c00-aa11-475f-a2a5-62cd7999fdd0-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "c6249c00-aa11-475f-a2a5-62cd7999fdd0" (UID: "c6249c00-aa11-475f-a2a5-62cd7999fdd0"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 21:31:06.853166 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:31:06.853112    2563 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c6249c00-aa11-475f-a2a5-62cd7999fdd0-image-registry-private-configuration\") on node \"ip-10-0-130-217.ec2.internal\" DevicePath \"\""
Jul 15 21:31:06.853166 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:31:06.853159    2563 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c6249c00-aa11-475f-a2a5-62cd7999fdd0-bound-sa-token\") on node \"ip-10-0-130-217.ec2.internal\" DevicePath \"\""
Jul 15 21:31:06.853166 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:31:06.853172    2563 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c6249c00-aa11-475f-a2a5-62cd7999fdd0-registry-certificates\") on node \"ip-10-0-130-217.ec2.internal\" DevicePath \"\""
Jul 15 21:31:06.853404 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:31:06.853189    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bw6b5\" (UniqueName: \"kubernetes.io/projected/c6249c00-aa11-475f-a2a5-62cd7999fdd0-kube-api-access-bw6b5\") on node \"ip-10-0-130-217.ec2.internal\" DevicePath \"\""
Jul 15 21:31:06.853404 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:31:06.853201    2563 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c6249c00-aa11-475f-a2a5-62cd7999fdd0-ca-trust-extracted\") on node \"ip-10-0-130-217.ec2.internal\" DevicePath \"\""
Jul 15 21:31:06.853404 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:31:06.853212    2563 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c6249c00-aa11-475f-a2a5-62cd7999fdd0-registry-tls\") on node \"ip-10-0-130-217.ec2.internal\" DevicePath \"\""
Jul 15 21:31:06.853404 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:31:06.853224    2563 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c6249c00-aa11-475f-a2a5-62cd7999fdd0-installation-pull-secrets\") on node \"ip-10-0-130-217.ec2.internal\" DevicePath \"\""
Jul 15 21:31:07.644995 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:31:07.644962    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-df786567c-xhldd"
Jul 15 21:31:07.645428 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:31:07.644961    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-df786567c-xhldd" event={"ID":"c6249c00-aa11-475f-a2a5-62cd7999fdd0","Type":"ContainerDied","Data":"4fdb96cb5b6f804962d7a293fab33a710127be6e6cb27c626a8314a080f9b70b"}
Jul 15 21:31:07.645428 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:31:07.645151    2563 scope.go:117] "RemoveContainer" containerID="b40cf69c580dc47ee3d4707bb160559908e41c6b22ca7c070aa9732f5fcf4086"
Jul 15 21:31:07.647058 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:31:07.647033    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-j57mj" event={"ID":"7c107438-4a43-49fe-9bcb-a9c114c05d85","Type":"ContainerStarted","Data":"ee428021841a47c84505b0cf9ec274c5617eb7a487c1dd80cd41a852bc32bc39"}
Jul 15 21:31:07.677853 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:31:07.677822    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-df786567c-xhldd"]
Jul 15 21:31:07.682580 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:31:07.682557    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-df786567c-xhldd"]
Jul 15 21:31:08.987216 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:31:08.987184    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c6249c00-aa11-475f-a2a5-62cd7999fdd0" path="/var/lib/kubelet/pods/c6249c00-aa11-475f-a2a5-62cd7999fdd0/volumes"
Jul 15 21:31:16.683738 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:31:16.683701    2563 generic.go:356] "Generic (PLEG): container finished" podID="1683be20-36a0-4ca3-b861-972d9805c362" containerID="bb131d9b893a72e237d2db0a65dce2c34af82602c69d84ad4da82749ba1ce1bb" exitCode=0
Jul 15 21:31:16.684181 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:31:16.683752    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-2jn97" event={"ID":"1683be20-36a0-4ca3-b861-972d9805c362","Type":"ContainerDied","Data":"bb131d9b893a72e237d2db0a65dce2c34af82602c69d84ad4da82749ba1ce1bb"}
Jul 15 21:31:16.684181 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:31:16.684081    2563 scope.go:117] "RemoveContainer" containerID="bb131d9b893a72e237d2db0a65dce2c34af82602c69d84ad4da82749ba1ce1bb"
Jul 15 21:31:17.690112 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:31:17.690074    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-2jn97" event={"ID":"1683be20-36a0-4ca3-b861-972d9805c362","Type":"ContainerStarted","Data":"0f1ff534dcebf3163ac58a906bbf2bc3c4c05451a58597fe6475b5559bf1eddd"}
Jul 15 21:31:20.713538 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:31:20.713504    2563 generic.go:356] "Generic (PLEG): container finished" podID="d806e382-01da-4412-b627-a52c8b0da47e" containerID="0769bba1adf1fcaaf846df8cf7b09fb7986cb08c98dd8a1f80b37248e360ed18" exitCode=0
Jul 15 21:31:20.713888 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:31:20.713558    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-8dqhg" event={"ID":"d806e382-01da-4412-b627-a52c8b0da47e","Type":"ContainerDied","Data":"0769bba1adf1fcaaf846df8cf7b09fb7986cb08c98dd8a1f80b37248e360ed18"}
Jul 15 21:31:20.713888 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:31:20.713867    2563 scope.go:117] "RemoveContainer" containerID="0769bba1adf1fcaaf846df8cf7b09fb7986cb08c98dd8a1f80b37248e360ed18"
Jul 15 21:31:21.720726 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:31:21.720692    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-8dqhg" event={"ID":"d806e382-01da-4412-b627-a52c8b0da47e","Type":"ContainerStarted","Data":"b8b470262746a2ca3047cc2c32b6d403a9c683bc03730705aaf20a22974f3e7d"}
Jul 15 21:31:29.683888 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:31:29.683821    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-78d89969b6-98r5z" podUID="c4177e0f-389c-4b50-a08c-756660dc7844" containerName="console" containerID="cri-o://d0eddfcd84799f922f5bb70b1b3cb8184391b80ede59c1db11630595698f5cac" gracePeriod=15
Jul 15 21:31:29.937578 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:31:29.937513    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-78d89969b6-98r5z"
Jul 15 21:31:30.051797 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:31:30.051755    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c4177e0f-389c-4b50-a08c-756660dc7844-console-oauth-config\") pod \"c4177e0f-389c-4b50-a08c-756660dc7844\" (UID: \"c4177e0f-389c-4b50-a08c-756660dc7844\") "
Jul 15 21:31:30.051797 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:31:30.051806    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pxvf6\" (UniqueName: \"kubernetes.io/projected/c4177e0f-389c-4b50-a08c-756660dc7844-kube-api-access-pxvf6\") pod \"c4177e0f-389c-4b50-a08c-756660dc7844\" (UID: \"c4177e0f-389c-4b50-a08c-756660dc7844\") "
Jul 15 21:31:30.052076 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:31:30.051839    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c4177e0f-389c-4b50-a08c-756660dc7844-console-serving-cert\") pod \"c4177e0f-389c-4b50-a08c-756660dc7844\" (UID: \"c4177e0f-389c-4b50-a08c-756660dc7844\") "
Jul 15 21:31:30.052076 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:31:30.051907    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c4177e0f-389c-4b50-a08c-756660dc7844-oauth-serving-cert\") pod \"c4177e0f-389c-4b50-a08c-756660dc7844\" (UID: \"c4177e0f-389c-4b50-a08c-756660dc7844\") "
Jul 15 21:31:30.052076 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:31:30.051991    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c4177e0f-389c-4b50-a08c-756660dc7844-service-ca\") pod \"c4177e0f-389c-4b50-a08c-756660dc7844\" (UID: \"c4177e0f-389c-4b50-a08c-756660dc7844\") "
Jul 15 21:31:30.052076 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:31:30.052020    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c4177e0f-389c-4b50-a08c-756660dc7844-console-config\") pod \"c4177e0f-389c-4b50-a08c-756660dc7844\" (UID: \"c4177e0f-389c-4b50-a08c-756660dc7844\") "
Jul 15 21:31:30.052423 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:31:30.052389    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c4177e0f-389c-4b50-a08c-756660dc7844-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "c4177e0f-389c-4b50-a08c-756660dc7844" (UID: "c4177e0f-389c-4b50-a08c-756660dc7844"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 21:31:30.052505 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:31:30.052392    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c4177e0f-389c-4b50-a08c-756660dc7844-service-ca" (OuterVolumeSpecName: "service-ca") pod "c4177e0f-389c-4b50-a08c-756660dc7844" (UID: "c4177e0f-389c-4b50-a08c-756660dc7844"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 21:31:30.052505 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:31:30.052399    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c4177e0f-389c-4b50-a08c-756660dc7844-console-config" (OuterVolumeSpecName: "console-config") pod "c4177e0f-389c-4b50-a08c-756660dc7844" (UID: "c4177e0f-389c-4b50-a08c-756660dc7844"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 21:31:30.054183 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:31:30.054159    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c4177e0f-389c-4b50-a08c-756660dc7844-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "c4177e0f-389c-4b50-a08c-756660dc7844" (UID: "c4177e0f-389c-4b50-a08c-756660dc7844"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 21:31:30.054481 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:31:30.054454    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c4177e0f-389c-4b50-a08c-756660dc7844-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "c4177e0f-389c-4b50-a08c-756660dc7844" (UID: "c4177e0f-389c-4b50-a08c-756660dc7844"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 21:31:30.054481 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:31:30.054465    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c4177e0f-389c-4b50-a08c-756660dc7844-kube-api-access-pxvf6" (OuterVolumeSpecName: "kube-api-access-pxvf6") pod "c4177e0f-389c-4b50-a08c-756660dc7844" (UID: "c4177e0f-389c-4b50-a08c-756660dc7844"). InnerVolumeSpecName "kube-api-access-pxvf6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 21:31:30.153201 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:31:30.153160    2563 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c4177e0f-389c-4b50-a08c-756660dc7844-console-oauth-config\") on node \"ip-10-0-130-217.ec2.internal\" DevicePath \"\""
Jul 15 21:31:30.153201 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:31:30.153192    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pxvf6\" (UniqueName: \"kubernetes.io/projected/c4177e0f-389c-4b50-a08c-756660dc7844-kube-api-access-pxvf6\") on node \"ip-10-0-130-217.ec2.internal\" DevicePath \"\""
Jul 15 21:31:30.153201 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:31:30.153209    2563 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c4177e0f-389c-4b50-a08c-756660dc7844-console-serving-cert\") on node \"ip-10-0-130-217.ec2.internal\" DevicePath \"\""
Jul 15 21:31:30.153493 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:31:30.153223    2563 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c4177e0f-389c-4b50-a08c-756660dc7844-oauth-serving-cert\") on node \"ip-10-0-130-217.ec2.internal\" DevicePath \"\""
Jul 15 21:31:30.153493 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:31:30.153238    2563 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c4177e0f-389c-4b50-a08c-756660dc7844-service-ca\") on node \"ip-10-0-130-217.ec2.internal\" DevicePath \"\""
Jul 15 21:31:30.153493 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:31:30.153253    2563 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c4177e0f-389c-4b50-a08c-756660dc7844-console-config\") on node \"ip-10-0-130-217.ec2.internal\" DevicePath \"\""
Jul 15 21:31:30.757457 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:31:30.757426    2563 generic.go:356] "Generic (PLEG): container finished" podID="c4177e0f-389c-4b50-a08c-756660dc7844" containerID="d0eddfcd84799f922f5bb70b1b3cb8184391b80ede59c1db11630595698f5cac" exitCode=0
Jul 15 21:31:30.757837 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:31:30.757477    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-78d89969b6-98r5z"
Jul 15 21:31:30.757837 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:31:30.757508    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-78d89969b6-98r5z" event={"ID":"c4177e0f-389c-4b50-a08c-756660dc7844","Type":"ContainerDied","Data":"d0eddfcd84799f922f5bb70b1b3cb8184391b80ede59c1db11630595698f5cac"}
Jul 15 21:31:30.757837 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:31:30.757565    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-78d89969b6-98r5z" event={"ID":"c4177e0f-389c-4b50-a08c-756660dc7844","Type":"ContainerDied","Data":"2666fc14e59e7d86cf55f9b190ff9f9b2c7f72e1807ee134c45bc9f93ca8bd61"}
Jul 15 21:31:30.757837 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:31:30.757596    2563 scope.go:117] "RemoveContainer" containerID="d0eddfcd84799f922f5bb70b1b3cb8184391b80ede59c1db11630595698f5cac"
Jul 15 21:31:30.766124 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:31:30.766075    2563 scope.go:117] "RemoveContainer" containerID="d0eddfcd84799f922f5bb70b1b3cb8184391b80ede59c1db11630595698f5cac"
Jul 15 21:31:30.766357 ip-10-0-130-217 kubenswrapper[2563]: E0715 21:31:30.766335    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d0eddfcd84799f922f5bb70b1b3cb8184391b80ede59c1db11630595698f5cac\": container with ID starting with d0eddfcd84799f922f5bb70b1b3cb8184391b80ede59c1db11630595698f5cac not found: ID does not exist" containerID="d0eddfcd84799f922f5bb70b1b3cb8184391b80ede59c1db11630595698f5cac"
Jul 15 21:31:30.766407 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:31:30.766367    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d0eddfcd84799f922f5bb70b1b3cb8184391b80ede59c1db11630595698f5cac"} err="failed to get container status \"d0eddfcd84799f922f5bb70b1b3cb8184391b80ede59c1db11630595698f5cac\": rpc error: code = NotFound desc = could not find container \"d0eddfcd84799f922f5bb70b1b3cb8184391b80ede59c1db11630595698f5cac\": container with ID starting with d0eddfcd84799f922f5bb70b1b3cb8184391b80ede59c1db11630595698f5cac not found: ID does not exist"
Jul 15 21:31:30.777339 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:31:30.777314    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-78d89969b6-98r5z"]
Jul 15 21:31:30.780841 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:31:30.780820    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-78d89969b6-98r5z"]
Jul 15 21:31:30.987000 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:31:30.986963    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c4177e0f-389c-4b50-a08c-756660dc7844" path="/var/lib/kubelet/pods/c4177e0f-389c-4b50-a08c-756660dc7844/volumes"
Jul 15 21:32:15.345641 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:32:15.345608    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-69669b887f-kvxlp"]
Jul 15 21:32:15.346558 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:32:15.346519    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c6249c00-aa11-475f-a2a5-62cd7999fdd0" containerName="registry"
Jul 15 21:32:15.346558 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:32:15.346553    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="c6249c00-aa11-475f-a2a5-62cd7999fdd0" containerName="registry"
Jul 15 21:32:15.346720 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:32:15.346581    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c4177e0f-389c-4b50-a08c-756660dc7844" containerName="console"
Jul 15 21:32:15.346720 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:32:15.346590    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="c4177e0f-389c-4b50-a08c-756660dc7844" containerName="console"
Jul 15 21:32:15.346720 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:32:15.346694    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="c6249c00-aa11-475f-a2a5-62cd7999fdd0" containerName="registry"
Jul 15 21:32:15.346720 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:32:15.346704    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="c4177e0f-389c-4b50-a08c-756660dc7844" containerName="console"
Jul 15 21:32:15.351089 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:32:15.351066    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-69669b887f-kvxlp"
Jul 15 21:32:15.360802 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:32:15.360782    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-69669b887f-kvxlp"]
Jul 15 21:32:15.435869 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:32:15.435833    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2fd2c4f6-a181-41df-9e04-566177dc371a-service-ca\") pod \"console-69669b887f-kvxlp\" (UID: \"2fd2c4f6-a181-41df-9e04-566177dc371a\") " pod="openshift-console/console-69669b887f-kvxlp"
Jul 15 21:32:15.435869 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:32:15.435875    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2fd2c4f6-a181-41df-9e04-566177dc371a-console-oauth-config\") pod \"console-69669b887f-kvxlp\" (UID: \"2fd2c4f6-a181-41df-9e04-566177dc371a\") " pod="openshift-console/console-69669b887f-kvxlp"
Jul 15 21:32:15.436110 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:32:15.435899    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7jhpf\" (UniqueName: \"kubernetes.io/projected/2fd2c4f6-a181-41df-9e04-566177dc371a-kube-api-access-7jhpf\") pod \"console-69669b887f-kvxlp\" (UID: \"2fd2c4f6-a181-41df-9e04-566177dc371a\") " pod="openshift-console/console-69669b887f-kvxlp"
Jul 15 21:32:15.436110 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:32:15.436028    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2fd2c4f6-a181-41df-9e04-566177dc371a-trusted-ca-bundle\") pod \"console-69669b887f-kvxlp\" (UID: \"2fd2c4f6-a181-41df-9e04-566177dc371a\") " pod="openshift-console/console-69669b887f-kvxlp"
Jul 15 21:32:15.436110 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:32:15.436061    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2fd2c4f6-a181-41df-9e04-566177dc371a-console-config\") pod \"console-69669b887f-kvxlp\" (UID: \"2fd2c4f6-a181-41df-9e04-566177dc371a\") " pod="openshift-console/console-69669b887f-kvxlp"
Jul 15 21:32:15.436110 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:32:15.436079    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2fd2c4f6-a181-41df-9e04-566177dc371a-console-serving-cert\") pod \"console-69669b887f-kvxlp\" (UID: \"2fd2c4f6-a181-41df-9e04-566177dc371a\") " pod="openshift-console/console-69669b887f-kvxlp"
Jul 15 21:32:15.436110 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:32:15.436104    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2fd2c4f6-a181-41df-9e04-566177dc371a-oauth-serving-cert\") pod \"console-69669b887f-kvxlp\" (UID: \"2fd2c4f6-a181-41df-9e04-566177dc371a\") " pod="openshift-console/console-69669b887f-kvxlp"
Jul 15 21:32:15.537376 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:32:15.537333    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2fd2c4f6-a181-41df-9e04-566177dc371a-service-ca\") pod \"console-69669b887f-kvxlp\" (UID: \"2fd2c4f6-a181-41df-9e04-566177dc371a\") " pod="openshift-console/console-69669b887f-kvxlp"
Jul 15 21:32:15.537376 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:32:15.537381    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2fd2c4f6-a181-41df-9e04-566177dc371a-console-oauth-config\") pod \"console-69669b887f-kvxlp\" (UID: \"2fd2c4f6-a181-41df-9e04-566177dc371a\") " pod="openshift-console/console-69669b887f-kvxlp"
Jul 15 21:32:15.537619 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:32:15.537414    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7jhpf\" (UniqueName: \"kubernetes.io/projected/2fd2c4f6-a181-41df-9e04-566177dc371a-kube-api-access-7jhpf\") pod \"console-69669b887f-kvxlp\" (UID: \"2fd2c4f6-a181-41df-9e04-566177dc371a\") " pod="openshift-console/console-69669b887f-kvxlp"
Jul 15 21:32:15.537619 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:32:15.537483    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2fd2c4f6-a181-41df-9e04-566177dc371a-trusted-ca-bundle\") pod \"console-69669b887f-kvxlp\" (UID: \"2fd2c4f6-a181-41df-9e04-566177dc371a\") " pod="openshift-console/console-69669b887f-kvxlp"
Jul 15 21:32:15.537619 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:32:15.537510    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2fd2c4f6-a181-41df-9e04-566177dc371a-console-config\") pod \"console-69669b887f-kvxlp\" (UID: \"2fd2c4f6-a181-41df-9e04-566177dc371a\") " pod="openshift-console/console-69669b887f-kvxlp"
Jul 15 21:32:15.537619 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:32:15.537535    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2fd2c4f6-a181-41df-9e04-566177dc371a-console-serving-cert\") pod \"console-69669b887f-kvxlp\" (UID: \"2fd2c4f6-a181-41df-9e04-566177dc371a\") " pod="openshift-console/console-69669b887f-kvxlp"
Jul 15 21:32:15.537619 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:32:15.537559    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2fd2c4f6-a181-41df-9e04-566177dc371a-oauth-serving-cert\") pod \"console-69669b887f-kvxlp\" (UID: \"2fd2c4f6-a181-41df-9e04-566177dc371a\") " pod="openshift-console/console-69669b887f-kvxlp"
Jul 15 21:32:15.538231 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:32:15.538198    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2fd2c4f6-a181-41df-9e04-566177dc371a-console-config\") pod \"console-69669b887f-kvxlp\" (UID: \"2fd2c4f6-a181-41df-9e04-566177dc371a\") " pod="openshift-console/console-69669b887f-kvxlp"
Jul 15 21:32:15.538367 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:32:15.538203    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2fd2c4f6-a181-41df-9e04-566177dc371a-service-ca\") pod \"console-69669b887f-kvxlp\" (UID: \"2fd2c4f6-a181-41df-9e04-566177dc371a\") " pod="openshift-console/console-69669b887f-kvxlp"
Jul 15 21:32:15.538489 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:32:15.538453    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2fd2c4f6-a181-41df-9e04-566177dc371a-trusted-ca-bundle\") pod \"console-69669b887f-kvxlp\" (UID: \"2fd2c4f6-a181-41df-9e04-566177dc371a\") " pod="openshift-console/console-69669b887f-kvxlp"
Jul 15 21:32:15.538580 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:32:15.538461    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2fd2c4f6-a181-41df-9e04-566177dc371a-oauth-serving-cert\") pod \"console-69669b887f-kvxlp\" (UID: \"2fd2c4f6-a181-41df-9e04-566177dc371a\") " pod="openshift-console/console-69669b887f-kvxlp"
Jul 15 21:32:15.540591 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:32:15.540569    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2fd2c4f6-a181-41df-9e04-566177dc371a-console-oauth-config\") pod \"console-69669b887f-kvxlp\" (UID: \"2fd2c4f6-a181-41df-9e04-566177dc371a\") " pod="openshift-console/console-69669b887f-kvxlp"
Jul 15 21:32:15.540752 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:32:15.540731    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2fd2c4f6-a181-41df-9e04-566177dc371a-console-serving-cert\") pod \"console-69669b887f-kvxlp\" (UID: \"2fd2c4f6-a181-41df-9e04-566177dc371a\") " pod="openshift-console/console-69669b887f-kvxlp"
Jul 15 21:32:15.544720 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:32:15.544697    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7jhpf\" (UniqueName: \"kubernetes.io/projected/2fd2c4f6-a181-41df-9e04-566177dc371a-kube-api-access-7jhpf\") pod \"console-69669b887f-kvxlp\" (UID: \"2fd2c4f6-a181-41df-9e04-566177dc371a\") " pod="openshift-console/console-69669b887f-kvxlp"
Jul 15 21:32:15.662743 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:32:15.662657    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-69669b887f-kvxlp"
Jul 15 21:32:15.802534 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:32:15.802505    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-69669b887f-kvxlp"]
Jul 15 21:32:15.805286 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:32:15.805226    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2fd2c4f6_a181_41df_9e04_566177dc371a.slice/crio-8d1d3b27fd3d68e58c077463df70da67eb29e67235404b578b00f81aaa3ac4a2 WatchSource:0}: Error finding container 8d1d3b27fd3d68e58c077463df70da67eb29e67235404b578b00f81aaa3ac4a2: Status 404 returned error can't find the container with id 8d1d3b27fd3d68e58c077463df70da67eb29e67235404b578b00f81aaa3ac4a2
Jul 15 21:32:15.933754 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:32:15.933662    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-69669b887f-kvxlp" event={"ID":"2fd2c4f6-a181-41df-9e04-566177dc371a","Type":"ContainerStarted","Data":"86f15d916ac0e9a73fd00cde88280df190517166877e3bf9cd25f6b84ab759d6"}
Jul 15 21:32:15.933754 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:32:15.933727    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-69669b887f-kvxlp" event={"ID":"2fd2c4f6-a181-41df-9e04-566177dc371a","Type":"ContainerStarted","Data":"8d1d3b27fd3d68e58c077463df70da67eb29e67235404b578b00f81aaa3ac4a2"}
Jul 15 21:32:15.950073 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:32:15.949862    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-69669b887f-kvxlp" podStartSLOduration=0.949840422 podStartE2EDuration="949.840422ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:32:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:32:15.949217087 +0000 UTC m=+185.643144696" watchObservedRunningTime="2026-07-15 21:32:15.949840422 +0000 UTC m=+185.643767974"
Jul 15 21:32:25.663596 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:32:25.663556    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-69669b887f-kvxlp"
Jul 15 21:32:25.664064 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:32:25.663643    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-69669b887f-kvxlp"
Jul 15 21:32:25.668659 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:32:25.668628    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-69669b887f-kvxlp"
Jul 15 21:32:25.976067 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:32:25.975983    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-69669b887f-kvxlp"
Jul 15 21:32:26.017222 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:32:26.017187    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-689f4555c4-2zvnb"]
Jul 15 21:32:51.046104 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:32:51.046030    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-689f4555c4-2zvnb" podUID="2ee8019b-8450-483d-9181-1140ecc08ab6" containerName="console" containerID="cri-o://8a41280a64d9d7c4d6c3164546e49544f2550c093e73aa0cde865ab608c22f8c" gracePeriod=15
Jul 15 21:32:51.296280 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:32:51.296212    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-689f4555c4-2zvnb"
Jul 15 21:32:51.450081 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:32:51.450045    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2ee8019b-8450-483d-9181-1140ecc08ab6-trusted-ca-bundle\") pod \"2ee8019b-8450-483d-9181-1140ecc08ab6\" (UID: \"2ee8019b-8450-483d-9181-1140ecc08ab6\") "
Jul 15 21:32:51.450081 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:32:51.450079    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2ee8019b-8450-483d-9181-1140ecc08ab6-console-oauth-config\") pod \"2ee8019b-8450-483d-9181-1140ecc08ab6\" (UID: \"2ee8019b-8450-483d-9181-1140ecc08ab6\") "
Jul 15 21:32:51.450289 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:32:51.450107    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2ee8019b-8450-483d-9181-1140ecc08ab6-console-serving-cert\") pod \"2ee8019b-8450-483d-9181-1140ecc08ab6\" (UID: \"2ee8019b-8450-483d-9181-1140ecc08ab6\") "
Jul 15 21:32:51.450289 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:32:51.450200    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xd9vw\" (UniqueName: \"kubernetes.io/projected/2ee8019b-8450-483d-9181-1140ecc08ab6-kube-api-access-xd9vw\") pod \"2ee8019b-8450-483d-9181-1140ecc08ab6\" (UID: \"2ee8019b-8450-483d-9181-1140ecc08ab6\") "
Jul 15 21:32:51.450289 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:32:51.450230    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2ee8019b-8450-483d-9181-1140ecc08ab6-oauth-serving-cert\") pod \"2ee8019b-8450-483d-9181-1140ecc08ab6\" (UID: \"2ee8019b-8450-483d-9181-1140ecc08ab6\") "
Jul 15 21:32:51.450289 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:32:51.450265    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2ee8019b-8450-483d-9181-1140ecc08ab6-service-ca\") pod \"2ee8019b-8450-483d-9181-1140ecc08ab6\" (UID: \"2ee8019b-8450-483d-9181-1140ecc08ab6\") "
Jul 15 21:32:51.450289 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:32:51.450289    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2ee8019b-8450-483d-9181-1140ecc08ab6-console-config\") pod \"2ee8019b-8450-483d-9181-1140ecc08ab6\" (UID: \"2ee8019b-8450-483d-9181-1140ecc08ab6\") "
Jul 15 21:32:51.450692 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:32:51.450606    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2ee8019b-8450-483d-9181-1140ecc08ab6-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "2ee8019b-8450-483d-9181-1140ecc08ab6" (UID: "2ee8019b-8450-483d-9181-1140ecc08ab6"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 21:32:51.450692 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:32:51.450638    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2ee8019b-8450-483d-9181-1140ecc08ab6-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "2ee8019b-8450-483d-9181-1140ecc08ab6" (UID: "2ee8019b-8450-483d-9181-1140ecc08ab6"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 21:32:51.450809 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:32:51.450760    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2ee8019b-8450-483d-9181-1140ecc08ab6-service-ca" (OuterVolumeSpecName: "service-ca") pod "2ee8019b-8450-483d-9181-1140ecc08ab6" (UID: "2ee8019b-8450-483d-9181-1140ecc08ab6"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 21:32:51.450905 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:32:51.450877    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2ee8019b-8450-483d-9181-1140ecc08ab6-console-config" (OuterVolumeSpecName: "console-config") pod "2ee8019b-8450-483d-9181-1140ecc08ab6" (UID: "2ee8019b-8450-483d-9181-1140ecc08ab6"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 21:32:51.452298 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:32:51.452275    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2ee8019b-8450-483d-9181-1140ecc08ab6-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "2ee8019b-8450-483d-9181-1140ecc08ab6" (UID: "2ee8019b-8450-483d-9181-1140ecc08ab6"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 21:32:51.452370 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:32:51.452326    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2ee8019b-8450-483d-9181-1140ecc08ab6-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "2ee8019b-8450-483d-9181-1140ecc08ab6" (UID: "2ee8019b-8450-483d-9181-1140ecc08ab6"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 21:32:51.452428 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:32:51.452412    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2ee8019b-8450-483d-9181-1140ecc08ab6-kube-api-access-xd9vw" (OuterVolumeSpecName: "kube-api-access-xd9vw") pod "2ee8019b-8450-483d-9181-1140ecc08ab6" (UID: "2ee8019b-8450-483d-9181-1140ecc08ab6"). InnerVolumeSpecName "kube-api-access-xd9vw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 21:32:51.551310 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:32:51.551233    2563 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2ee8019b-8450-483d-9181-1140ecc08ab6-trusted-ca-bundle\") on node \"ip-10-0-130-217.ec2.internal\" DevicePath \"\""
Jul 15 21:32:51.551310 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:32:51.551261    2563 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2ee8019b-8450-483d-9181-1140ecc08ab6-console-oauth-config\") on node \"ip-10-0-130-217.ec2.internal\" DevicePath \"\""
Jul 15 21:32:51.551310 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:32:51.551270    2563 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2ee8019b-8450-483d-9181-1140ecc08ab6-console-serving-cert\") on node \"ip-10-0-130-217.ec2.internal\" DevicePath \"\""
Jul 15 21:32:51.551310 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:32:51.551280    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xd9vw\" (UniqueName: \"kubernetes.io/projected/2ee8019b-8450-483d-9181-1140ecc08ab6-kube-api-access-xd9vw\") on node \"ip-10-0-130-217.ec2.internal\" DevicePath \"\""
Jul 15 21:32:51.551310 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:32:51.551288    2563 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2ee8019b-8450-483d-9181-1140ecc08ab6-oauth-serving-cert\") on node \"ip-10-0-130-217.ec2.internal\" DevicePath \"\""
Jul 15 21:32:51.551310 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:32:51.551297    2563 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2ee8019b-8450-483d-9181-1140ecc08ab6-service-ca\") on node \"ip-10-0-130-217.ec2.internal\" DevicePath \"\""
Jul 15 21:32:51.551310 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:32:51.551305    2563 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2ee8019b-8450-483d-9181-1140ecc08ab6-console-config\") on node \"ip-10-0-130-217.ec2.internal\" DevicePath \"\""
Jul 15 21:32:52.068636 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:32:52.068597    2563 generic.go:356] "Generic (PLEG): container finished" podID="2ee8019b-8450-483d-9181-1140ecc08ab6" containerID="8a41280a64d9d7c4d6c3164546e49544f2550c093e73aa0cde865ab608c22f8c" exitCode=0
Jul 15 21:32:52.069087 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:32:52.068662    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-689f4555c4-2zvnb"
Jul 15 21:32:52.069087 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:32:52.068689    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-689f4555c4-2zvnb" event={"ID":"2ee8019b-8450-483d-9181-1140ecc08ab6","Type":"ContainerDied","Data":"8a41280a64d9d7c4d6c3164546e49544f2550c093e73aa0cde865ab608c22f8c"}
Jul 15 21:32:52.069087 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:32:52.068753    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-689f4555c4-2zvnb" event={"ID":"2ee8019b-8450-483d-9181-1140ecc08ab6","Type":"ContainerDied","Data":"0a0bf54560b9775173a3247cf5ef6eb3fefef7bebcaa923771f5a65637651f90"}
Jul 15 21:32:52.069087 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:32:52.068784    2563 scope.go:117] "RemoveContainer" containerID="8a41280a64d9d7c4d6c3164546e49544f2550c093e73aa0cde865ab608c22f8c"
Jul 15 21:32:52.077074 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:32:52.077057    2563 scope.go:117] "RemoveContainer" containerID="8a41280a64d9d7c4d6c3164546e49544f2550c093e73aa0cde865ab608c22f8c"
Jul 15 21:32:52.077358 ip-10-0-130-217 kubenswrapper[2563]: E0715 21:32:52.077341    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8a41280a64d9d7c4d6c3164546e49544f2550c093e73aa0cde865ab608c22f8c\": container with ID starting with 8a41280a64d9d7c4d6c3164546e49544f2550c093e73aa0cde865ab608c22f8c not found: ID does not exist" containerID="8a41280a64d9d7c4d6c3164546e49544f2550c093e73aa0cde865ab608c22f8c"
Jul 15 21:32:52.077413 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:32:52.077367    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8a41280a64d9d7c4d6c3164546e49544f2550c093e73aa0cde865ab608c22f8c"} err="failed to get container status \"8a41280a64d9d7c4d6c3164546e49544f2550c093e73aa0cde865ab608c22f8c\": rpc error: code = NotFound desc = could not find container \"8a41280a64d9d7c4d6c3164546e49544f2550c093e73aa0cde865ab608c22f8c\": container with ID starting with 8a41280a64d9d7c4d6c3164546e49544f2550c093e73aa0cde865ab608c22f8c not found: ID does not exist"
Jul 15 21:32:52.087508 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:32:52.087487    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-689f4555c4-2zvnb"]
Jul 15 21:32:52.090766 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:32:52.090747    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-689f4555c4-2zvnb"]
Jul 15 21:32:52.986875 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:32:52.986846    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2ee8019b-8450-483d-9181-1140ecc08ab6" path="/var/lib/kubelet/pods/2ee8019b-8450-483d-9181-1140ecc08ab6/volumes"
Jul 15 21:34:10.741242 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:34:10.741211    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-zlsbs_9b97af79-5c4a-4622-8d74-04d470841a53/console-operator/2.log"
Jul 15 21:34:10.745016 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:34:10.744991    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bp2vz_7f43c078-b73a-4760-860b-e7f6e07afdbd/ovn-acl-logging/0.log"
Jul 15 21:34:10.746286 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:34:10.746264    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-zlsbs_9b97af79-5c4a-4622-8d74-04d470841a53/console-operator/2.log"
Jul 15 21:34:10.750485 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:34:10.750465    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bp2vz_7f43c078-b73a-4760-860b-e7f6e07afdbd/ovn-acl-logging/0.log"
Jul 15 21:34:10.752338 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:34:10.752322    2563 kubelet.go:1648] "Image garbage collection succeeded"
Jul 15 21:34:48.721192 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:34:48.721153    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-56fdfd95c4-9knb4"]
Jul 15 21:34:48.723543 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:34:48.721584    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2ee8019b-8450-483d-9181-1140ecc08ab6" containerName="console"
Jul 15 21:34:48.723543 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:34:48.721600    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="2ee8019b-8450-483d-9181-1140ecc08ab6" containerName="console"
Jul 15 21:34:48.723543 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:34:48.721655    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="2ee8019b-8450-483d-9181-1140ecc08ab6" containerName="console"
Jul 15 21:34:48.724711 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:34:48.724693    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-56fdfd95c4-9knb4"
Jul 15 21:34:48.726870 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:34:48.726848    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 15 21:34:48.727001 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:34:48.726905    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 15 21:34:48.727058 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:34:48.727028    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-tt66b\""
Jul 15 21:34:48.727095 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:34:48.727075    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 15 21:34:48.727159 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:34:48.727139    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 15 21:34:48.739825 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:34:48.739802    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-56fdfd95c4-9knb4"]
Jul 15 21:34:48.796755 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:34:48.796722    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3eef3ee1-117c-444d-823b-a2bebe05e65b-tmp\") pod \"opendatahub-operator-controller-manager-56fdfd95c4-9knb4\" (UID: \"3eef3ee1-117c-444d-823b-a2bebe05e65b\") " pod="opendatahub/opendatahub-operator-controller-manager-56fdfd95c4-9knb4"
Jul 15 21:34:48.796755 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:34:48.796756    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3eef3ee1-117c-444d-823b-a2bebe05e65b-webhook-cert\") pod \"opendatahub-operator-controller-manager-56fdfd95c4-9knb4\" (UID: \"3eef3ee1-117c-444d-823b-a2bebe05e65b\") " pod="opendatahub/opendatahub-operator-controller-manager-56fdfd95c4-9knb4"
Jul 15 21:34:48.796954 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:34:48.796810    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/3eef3ee1-117c-444d-823b-a2bebe05e65b-manifests\") pod \"opendatahub-operator-controller-manager-56fdfd95c4-9knb4\" (UID: \"3eef3ee1-117c-444d-823b-a2bebe05e65b\") " pod="opendatahub/opendatahub-operator-controller-manager-56fdfd95c4-9knb4"
Jul 15 21:34:48.796954 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:34:48.796887    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/3eef3ee1-117c-444d-823b-a2bebe05e65b-apiservice-cert\") pod \"opendatahub-operator-controller-manager-56fdfd95c4-9knb4\" (UID: \"3eef3ee1-117c-444d-823b-a2bebe05e65b\") " pod="opendatahub/opendatahub-operator-controller-manager-56fdfd95c4-9knb4"
Jul 15 21:34:48.796954 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:34:48.796921    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jzggc\" (UniqueName: \"kubernetes.io/projected/3eef3ee1-117c-444d-823b-a2bebe05e65b-kube-api-access-jzggc\") pod \"opendatahub-operator-controller-manager-56fdfd95c4-9knb4\" (UID: \"3eef3ee1-117c-444d-823b-a2bebe05e65b\") " pod="opendatahub/opendatahub-operator-controller-manager-56fdfd95c4-9knb4"
Jul 15 21:34:48.898182 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:34:48.898138    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/3eef3ee1-117c-444d-823b-a2bebe05e65b-apiservice-cert\") pod \"opendatahub-operator-controller-manager-56fdfd95c4-9knb4\" (UID: \"3eef3ee1-117c-444d-823b-a2bebe05e65b\") " pod="opendatahub/opendatahub-operator-controller-manager-56fdfd95c4-9knb4"
Jul 15 21:34:48.898368 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:34:48.898193    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jzggc\" (UniqueName: \"kubernetes.io/projected/3eef3ee1-117c-444d-823b-a2bebe05e65b-kube-api-access-jzggc\") pod \"opendatahub-operator-controller-manager-56fdfd95c4-9knb4\" (UID: \"3eef3ee1-117c-444d-823b-a2bebe05e65b\") " pod="opendatahub/opendatahub-operator-controller-manager-56fdfd95c4-9knb4"
Jul 15 21:34:48.898368 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:34:48.898221    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3eef3ee1-117c-444d-823b-a2bebe05e65b-tmp\") pod \"opendatahub-operator-controller-manager-56fdfd95c4-9knb4\" (UID: \"3eef3ee1-117c-444d-823b-a2bebe05e65b\") " pod="opendatahub/opendatahub-operator-controller-manager-56fdfd95c4-9knb4"
Jul 15 21:34:48.898368 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:34:48.898240    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3eef3ee1-117c-444d-823b-a2bebe05e65b-webhook-cert\") pod \"opendatahub-operator-controller-manager-56fdfd95c4-9knb4\" (UID: \"3eef3ee1-117c-444d-823b-a2bebe05e65b\") " pod="opendatahub/opendatahub-operator-controller-manager-56fdfd95c4-9knb4"
Jul 15 21:34:48.898368 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:34:48.898264    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/3eef3ee1-117c-444d-823b-a2bebe05e65b-manifests\") pod \"opendatahub-operator-controller-manager-56fdfd95c4-9knb4\" (UID: \"3eef3ee1-117c-444d-823b-a2bebe05e65b\") " pod="opendatahub/opendatahub-operator-controller-manager-56fdfd95c4-9knb4"
Jul 15 21:34:48.898687 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:34:48.898663    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/3eef3ee1-117c-444d-823b-a2bebe05e65b-manifests\") pod \"opendatahub-operator-controller-manager-56fdfd95c4-9knb4\" (UID: \"3eef3ee1-117c-444d-823b-a2bebe05e65b\") " pod="opendatahub/opendatahub-operator-controller-manager-56fdfd95c4-9knb4"
Jul 15 21:34:48.900732 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:34:48.900708    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3eef3ee1-117c-444d-823b-a2bebe05e65b-tmp\") pod \"opendatahub-operator-controller-manager-56fdfd95c4-9knb4\" (UID: \"3eef3ee1-117c-444d-823b-a2bebe05e65b\") " pod="opendatahub/opendatahub-operator-controller-manager-56fdfd95c4-9knb4"
Jul 15 21:34:48.900839 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:34:48.900778    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3eef3ee1-117c-444d-823b-a2bebe05e65b-webhook-cert\") pod \"opendatahub-operator-controller-manager-56fdfd95c4-9knb4\" (UID: \"3eef3ee1-117c-444d-823b-a2bebe05e65b\") " pod="opendatahub/opendatahub-operator-controller-manager-56fdfd95c4-9knb4"
Jul 15 21:34:48.900895 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:34:48.900867    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/3eef3ee1-117c-444d-823b-a2bebe05e65b-apiservice-cert\") pod \"opendatahub-operator-controller-manager-56fdfd95c4-9knb4\" (UID: \"3eef3ee1-117c-444d-823b-a2bebe05e65b\") " pod="opendatahub/opendatahub-operator-controller-manager-56fdfd95c4-9knb4"
Jul 15 21:34:48.905206 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:34:48.905184    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jzggc\" (UniqueName: \"kubernetes.io/projected/3eef3ee1-117c-444d-823b-a2bebe05e65b-kube-api-access-jzggc\") pod \"opendatahub-operator-controller-manager-56fdfd95c4-9knb4\" (UID: \"3eef3ee1-117c-444d-823b-a2bebe05e65b\") " pod="opendatahub/opendatahub-operator-controller-manager-56fdfd95c4-9knb4"
Jul 15 21:34:49.034336 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:34:49.034239    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-56fdfd95c4-9knb4"
Jul 15 21:34:49.169012 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:34:49.168988    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-56fdfd95c4-9knb4"]
Jul 15 21:34:49.171815 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:34:49.171789    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3eef3ee1_117c_444d_823b_a2bebe05e65b.slice/crio-e58de9b8dcec0c5572a8af19905fa5808e3a1bf1e6cba599e767344d3ec81589 WatchSource:0}: Error finding container e58de9b8dcec0c5572a8af19905fa5808e3a1bf1e6cba599e767344d3ec81589: Status 404 returned error can't find the container with id e58de9b8dcec0c5572a8af19905fa5808e3a1bf1e6cba599e767344d3ec81589
Jul 15 21:34:49.176422 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:34:49.176400    2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 15 21:34:49.504372 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:34:49.504333    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-56fdfd95c4-9knb4" event={"ID":"3eef3ee1-117c-444d-823b-a2bebe05e65b","Type":"ContainerStarted","Data":"e58de9b8dcec0c5572a8af19905fa5808e3a1bf1e6cba599e767344d3ec81589"}
Jul 15 21:34:52.519117 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:34:52.519081    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-56fdfd95c4-9knb4" event={"ID":"3eef3ee1-117c-444d-823b-a2bebe05e65b","Type":"ContainerStarted","Data":"c901da845ce61b0d90f8e62b218c181079e211826ee4bd9fa363dab89e125821"}
Jul 15 21:34:53.524924 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:34:53.524887    2563 generic.go:356] "Generic (PLEG): container finished" podID="3eef3ee1-117c-444d-823b-a2bebe05e65b" containerID="c901da845ce61b0d90f8e62b218c181079e211826ee4bd9fa363dab89e125821" exitCode=0
Jul 15 21:34:53.525287 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:34:53.524953    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-56fdfd95c4-9knb4" event={"ID":"3eef3ee1-117c-444d-823b-a2bebe05e65b","Type":"ContainerDied","Data":"c901da845ce61b0d90f8e62b218c181079e211826ee4bd9fa363dab89e125821"}
Jul 15 21:34:54.530744 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:34:54.530706    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-56fdfd95c4-9knb4" event={"ID":"3eef3ee1-117c-444d-823b-a2bebe05e65b","Type":"ContainerStarted","Data":"28c3ceacc4e036e84249efed2516b509a86d1e29a969116eec406fb6ee2b6c53"}
Jul 15 21:34:54.531186 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:34:54.530815    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-56fdfd95c4-9knb4"
Jul 15 21:34:54.552865 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:34:54.552810    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-56fdfd95c4-9knb4" podStartSLOduration=1.909389661 podStartE2EDuration="6.552791246s" totalImagesPullingTime="3.571794544s" totalInitContainerRuntime="1.071607041s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:34:48 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:34:54.551247115 +0000 UTC m=+344.245174667" watchObservedRunningTime="2026-07-15 21:34:54.552791246 +0000 UTC m=+344.246718799"
Jul 15 21:35:05.536968 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:35:05.536868    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-56fdfd95c4-9knb4"
Jul 15 21:35:09.764335 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:35:09.764300    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-9bff-7sssg"]
Jul 15 21:35:09.770698 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:35:09.770670    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-9bff-7sssg"
Jul 15 21:35:09.773674 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:35:09.773644    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 15 21:35:09.773819 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:35:09.773673    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-bfplq\""
Jul 15 21:35:09.773819 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:35:09.773693    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 15 21:35:09.775265 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:35:09.775225    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sfx4g\" (UniqueName: \"kubernetes.io/projected/24903fdf-bd7f-4ea7-bb88-3785f0a0791a-kube-api-access-sfx4g\") pod \"kube-auth-proxy-9bff-7sssg\" (UID: \"24903fdf-bd7f-4ea7-bb88-3785f0a0791a\") " pod="openshift-ingress/kube-auth-proxy-9bff-7sssg"
Jul 15 21:35:09.775392 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:35:09.775320    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/24903fdf-bd7f-4ea7-bb88-3785f0a0791a-tls-certs\") pod \"kube-auth-proxy-9bff-7sssg\" (UID: \"24903fdf-bd7f-4ea7-bb88-3785f0a0791a\") " pod="openshift-ingress/kube-auth-proxy-9bff-7sssg"
Jul 15 21:35:09.775464 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:35:09.775420    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/24903fdf-bd7f-4ea7-bb88-3785f0a0791a-tmp\") pod \"kube-auth-proxy-9bff-7sssg\" (UID: \"24903fdf-bd7f-4ea7-bb88-3785f0a0791a\") " pod="openshift-ingress/kube-auth-proxy-9bff-7sssg"
Jul 15 21:35:09.776513 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:35:09.776490    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-9bff-7sssg"]
Jul 15 21:35:09.876285 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:35:09.876244    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sfx4g\" (UniqueName: \"kubernetes.io/projected/24903fdf-bd7f-4ea7-bb88-3785f0a0791a-kube-api-access-sfx4g\") pod \"kube-auth-proxy-9bff-7sssg\" (UID: \"24903fdf-bd7f-4ea7-bb88-3785f0a0791a\") " pod="openshift-ingress/kube-auth-proxy-9bff-7sssg"
Jul 15 21:35:09.876452 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:35:09.876305    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/24903fdf-bd7f-4ea7-bb88-3785f0a0791a-tls-certs\") pod \"kube-auth-proxy-9bff-7sssg\" (UID: \"24903fdf-bd7f-4ea7-bb88-3785f0a0791a\") " pod="openshift-ingress/kube-auth-proxy-9bff-7sssg"
Jul 15 21:35:09.876452 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:35:09.876341    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/24903fdf-bd7f-4ea7-bb88-3785f0a0791a-tmp\") pod \"kube-auth-proxy-9bff-7sssg\" (UID: \"24903fdf-bd7f-4ea7-bb88-3785f0a0791a\") " pod="openshift-ingress/kube-auth-proxy-9bff-7sssg"
Jul 15 21:35:09.879117 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:35:09.879078    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/24903fdf-bd7f-4ea7-bb88-3785f0a0791a-tmp\") pod \"kube-auth-proxy-9bff-7sssg\" (UID: \"24903fdf-bd7f-4ea7-bb88-3785f0a0791a\") " pod="openshift-ingress/kube-auth-proxy-9bff-7sssg"
Jul 15 21:35:09.879372 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:35:09.879355    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/24903fdf-bd7f-4ea7-bb88-3785f0a0791a-tls-certs\") pod \"kube-auth-proxy-9bff-7sssg\" (UID: \"24903fdf-bd7f-4ea7-bb88-3785f0a0791a\") " pod="openshift-ingress/kube-auth-proxy-9bff-7sssg"
Jul 15 21:35:09.893117 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:35:09.893091    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sfx4g\" (UniqueName: \"kubernetes.io/projected/24903fdf-bd7f-4ea7-bb88-3785f0a0791a-kube-api-access-sfx4g\") pod \"kube-auth-proxy-9bff-7sssg\" (UID: \"24903fdf-bd7f-4ea7-bb88-3785f0a0791a\") " pod="openshift-ingress/kube-auth-proxy-9bff-7sssg"
Jul 15 21:35:10.082244 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:35:10.082210    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-9bff-7sssg"
Jul 15 21:35:10.227296 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:35:10.227267    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-9bff-7sssg"]
Jul 15 21:35:10.229656 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:35:10.229621    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod24903fdf_bd7f_4ea7_bb88_3785f0a0791a.slice/crio-fda45c5ef6ae286bf8f5cc16142c3d3c1e018a348f02fe9d19e29eaf2315ceec WatchSource:0}: Error finding container fda45c5ef6ae286bf8f5cc16142c3d3c1e018a348f02fe9d19e29eaf2315ceec: Status 404 returned error can't find the container with id fda45c5ef6ae286bf8f5cc16142c3d3c1e018a348f02fe9d19e29eaf2315ceec
Jul 15 21:35:10.600671 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:35:10.600626    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-9bff-7sssg" event={"ID":"24903fdf-bd7f-4ea7-bb88-3785f0a0791a","Type":"ContainerStarted","Data":"fda45c5ef6ae286bf8f5cc16142c3d3c1e018a348f02fe9d19e29eaf2315ceec"}
Jul 15 21:35:13.341102 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:35:13.341076    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 15 21:35:13.616837 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:35:13.616735    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-9bff-7sssg" event={"ID":"24903fdf-bd7f-4ea7-bb88-3785f0a0791a","Type":"ContainerStarted","Data":"d977d86bb5f968ac03015fe46c192f81ce96c5882f7e0eed4bd42b1da4d4d5c9"}
Jul 15 21:35:13.630830 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:35:13.630769    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-9bff-7sssg" podStartSLOduration=1.523462274 podStartE2EDuration="4.630748499s" totalImagesPullingTime="3.107286225s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:35:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:35:13.630364034 +0000 UTC m=+363.324291584" watchObservedRunningTime="2026-07-15 21:35:13.630748499 +0000 UTC m=+363.324676044"
Jul 15 21:35:17.399815 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:35:17.399776    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-kfxkz"]
Jul 15 21:35:17.403101 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:35:17.403082    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-kfxkz"
Jul 15 21:35:17.405332 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:35:17.405308    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Jul 15 21:35:17.405443 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:35:17.405357    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-b5szw\""
Jul 15 21:35:17.405443 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:35:17.405377    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Jul 15 21:35:17.405443 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:35:17.405382    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Jul 15 21:35:17.405443 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:35:17.405363    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 15 21:35:17.414761 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:35:17.414734    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-kfxkz"]
Jul 15 21:35:17.441730 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:35:17.441699    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/985eca68-8ec9-4636-8dfd-07c84778365a-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-kfxkz\" (UID: \"985eca68-8ec9-4636-8dfd-07c84778365a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-kfxkz"
Jul 15 21:35:17.441881 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:35:17.441804    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/985eca68-8ec9-4636-8dfd-07c84778365a-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-kfxkz\" (UID: \"985eca68-8ec9-4636-8dfd-07c84778365a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-kfxkz"
Jul 15 21:35:17.441970 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:35:17.441867    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/985eca68-8ec9-4636-8dfd-07c84778365a-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-kfxkz\" (UID: \"985eca68-8ec9-4636-8dfd-07c84778365a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-kfxkz"
Jul 15 21:35:17.441970 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:35:17.441917    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p44sg\" (UniqueName: \"kubernetes.io/projected/985eca68-8ec9-4636-8dfd-07c84778365a-kube-api-access-p44sg\") pod \"istiod-openshift-gateway-94bb8fbfd-kfxkz\" (UID: \"985eca68-8ec9-4636-8dfd-07c84778365a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-kfxkz"
Jul 15 21:35:17.442087 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:35:17.442000    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/985eca68-8ec9-4636-8dfd-07c84778365a-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-kfxkz\" (UID: \"985eca68-8ec9-4636-8dfd-07c84778365a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-kfxkz"
Jul 15 21:35:17.442087 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:35:17.442044    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/985eca68-8ec9-4636-8dfd-07c84778365a-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-kfxkz\" (UID: \"985eca68-8ec9-4636-8dfd-07c84778365a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-kfxkz"
Jul 15 21:35:17.442177 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:35:17.442083    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/985eca68-8ec9-4636-8dfd-07c84778365a-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-kfxkz\" (UID: \"985eca68-8ec9-4636-8dfd-07c84778365a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-kfxkz"
Jul 15 21:35:17.542677 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:35:17.542634    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/985eca68-8ec9-4636-8dfd-07c84778365a-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-kfxkz\" (UID: \"985eca68-8ec9-4636-8dfd-07c84778365a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-kfxkz"
Jul 15 21:35:17.542677 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:35:17.542679    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/985eca68-8ec9-4636-8dfd-07c84778365a-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-kfxkz\" (UID: \"985eca68-8ec9-4636-8dfd-07c84778365a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-kfxkz"
Jul 15 21:35:17.542920 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:35:17.542732    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/985eca68-8ec9-4636-8dfd-07c84778365a-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-kfxkz\" (UID: \"985eca68-8ec9-4636-8dfd-07c84778365a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-kfxkz"
Jul 15 21:35:17.542920 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:35:17.542749    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/985eca68-8ec9-4636-8dfd-07c84778365a-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-kfxkz\" (UID: \"985eca68-8ec9-4636-8dfd-07c84778365a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-kfxkz"
Jul 15 21:35:17.542920 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:35:17.542767    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p44sg\" (UniqueName: \"kubernetes.io/projected/985eca68-8ec9-4636-8dfd-07c84778365a-kube-api-access-p44sg\") pod \"istiod-openshift-gateway-94bb8fbfd-kfxkz\" (UID: \"985eca68-8ec9-4636-8dfd-07c84778365a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-kfxkz"
Jul 15 21:35:17.542920 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:35:17.542790    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/985eca68-8ec9-4636-8dfd-07c84778365a-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-kfxkz\" (UID: \"985eca68-8ec9-4636-8dfd-07c84778365a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-kfxkz"
Jul 15 21:35:17.542920 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:35:17.542816    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/985eca68-8ec9-4636-8dfd-07c84778365a-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-kfxkz\" (UID: \"985eca68-8ec9-4636-8dfd-07c84778365a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-kfxkz"
Jul 15 21:35:17.543659 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:35:17.543623    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/985eca68-8ec9-4636-8dfd-07c84778365a-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-kfxkz\" (UID: \"985eca68-8ec9-4636-8dfd-07c84778365a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-kfxkz"
Jul 15 21:35:17.545166 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:35:17.545136    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/985eca68-8ec9-4636-8dfd-07c84778365a-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-kfxkz\" (UID: \"985eca68-8ec9-4636-8dfd-07c84778365a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-kfxkz"
Jul 15 21:35:17.545342 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:35:17.545323    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/985eca68-8ec9-4636-8dfd-07c84778365a-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-kfxkz\" (UID: \"985eca68-8ec9-4636-8dfd-07c84778365a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-kfxkz"
Jul 15 21:35:17.545404 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:35:17.545373    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/985eca68-8ec9-4636-8dfd-07c84778365a-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-kfxkz\" (UID: \"985eca68-8ec9-4636-8dfd-07c84778365a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-kfxkz"
Jul 15 21:35:17.545637 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:35:17.545618    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/985eca68-8ec9-4636-8dfd-07c84778365a-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-kfxkz\" (UID: \"985eca68-8ec9-4636-8dfd-07c84778365a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-kfxkz"
Jul 15 21:35:17.556554 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:35:17.556528    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p44sg\" (UniqueName: \"kubernetes.io/projected/985eca68-8ec9-4636-8dfd-07c84778365a-kube-api-access-p44sg\") pod \"istiod-openshift-gateway-94bb8fbfd-kfxkz\" (UID: \"985eca68-8ec9-4636-8dfd-07c84778365a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-kfxkz"
Jul 15 21:35:17.557211 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:35:17.557189    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/985eca68-8ec9-4636-8dfd-07c84778365a-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-kfxkz\" (UID: \"985eca68-8ec9-4636-8dfd-07c84778365a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-kfxkz"
Jul 15 21:35:17.712926 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:35:17.712833    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-kfxkz"
Jul 15 21:35:17.849400 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:35:17.849365    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-kfxkz"]
Jul 15 21:35:17.853117 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:35:17.853084    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod985eca68_8ec9_4636_8dfd_07c84778365a.slice/crio-929ef25518c652d5571e19663a3afb83af9b156512882f0bae8ffee66ebcac1d WatchSource:0}: Error finding container 929ef25518c652d5571e19663a3afb83af9b156512882f0bae8ffee66ebcac1d: Status 404 returned error can't find the container with id 929ef25518c652d5571e19663a3afb83af9b156512882f0bae8ffee66ebcac1d
Jul 15 21:35:18.641068 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:35:18.641024    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-kfxkz" event={"ID":"985eca68-8ec9-4636-8dfd-07c84778365a","Type":"ContainerStarted","Data":"929ef25518c652d5571e19663a3afb83af9b156512882f0bae8ffee66ebcac1d"}
Jul 15 21:35:20.075949 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:35:20.075900    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 15 21:35:20.076387 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:35:20.076012    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 15 21:35:20.651767 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:35:20.651716    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-kfxkz" event={"ID":"985eca68-8ec9-4636-8dfd-07c84778365a","Type":"ContainerStarted","Data":"abd7331b6bc723a23b2ad728750dd4ce6d1d169d17fdcd142f18697842ff3367"}
Jul 15 21:35:20.651981 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:35:20.651860    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-kfxkz"
Jul 15 21:35:20.680671 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:35:20.680596    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-kfxkz" podStartSLOduration=1.460086757 podStartE2EDuration="3.68057196s" totalImagesPullingTime="2.220485203s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:35:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:35:20.678623179 +0000 UTC m=+370.372550731" watchObservedRunningTime="2026-07-15 21:35:20.68057196 +0000 UTC m=+370.374499512"
Jul 15 21:35:21.657122 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:35:21.657093    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-kfxkz"
Jul 15 21:35:58.440727 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:35:58.440691    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-58f795db5f-x87hj"]
Jul 15 21:35:58.449426 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:35:58.449399    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-58f795db5f-x87hj"
Jul 15 21:35:58.455873 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:35:58.455844    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-58f795db5f-x87hj"]
Jul 15 21:35:58.604599 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:35:58.604562    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b5hmz\" (UniqueName: \"kubernetes.io/projected/4f959056-8782-42a6-aa16-2119afa5362e-kube-api-access-b5hmz\") pod \"console-58f795db5f-x87hj\" (UID: \"4f959056-8782-42a6-aa16-2119afa5362e\") " pod="openshift-console/console-58f795db5f-x87hj"
Jul 15 21:35:58.604773 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:35:58.604614    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4f959056-8782-42a6-aa16-2119afa5362e-console-config\") pod \"console-58f795db5f-x87hj\" (UID: \"4f959056-8782-42a6-aa16-2119afa5362e\") " pod="openshift-console/console-58f795db5f-x87hj"
Jul 15 21:35:58.604773 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:35:58.604686    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4f959056-8782-42a6-aa16-2119afa5362e-oauth-serving-cert\") pod \"console-58f795db5f-x87hj\" (UID: \"4f959056-8782-42a6-aa16-2119afa5362e\") " pod="openshift-console/console-58f795db5f-x87hj"
Jul 15 21:35:58.604773 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:35:58.604738    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4f959056-8782-42a6-aa16-2119afa5362e-console-oauth-config\") pod \"console-58f795db5f-x87hj\" (UID: \"4f959056-8782-42a6-aa16-2119afa5362e\") " pod="openshift-console/console-58f795db5f-x87hj"
Jul 15 21:35:58.604773 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:35:58.604755    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4f959056-8782-42a6-aa16-2119afa5362e-service-ca\") pod \"console-58f795db5f-x87hj\" (UID: \"4f959056-8782-42a6-aa16-2119afa5362e\") " pod="openshift-console/console-58f795db5f-x87hj"
Jul 15 21:35:58.604954 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:35:58.604851    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4f959056-8782-42a6-aa16-2119afa5362e-trusted-ca-bundle\") pod \"console-58f795db5f-x87hj\" (UID: \"4f959056-8782-42a6-aa16-2119afa5362e\") " pod="openshift-console/console-58f795db5f-x87hj"
Jul 15 21:35:58.604954 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:35:58.604892    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4f959056-8782-42a6-aa16-2119afa5362e-console-serving-cert\") pod \"console-58f795db5f-x87hj\" (UID: \"4f959056-8782-42a6-aa16-2119afa5362e\") " pod="openshift-console/console-58f795db5f-x87hj"
Jul 15 21:35:58.706140 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:35:58.706048    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4f959056-8782-42a6-aa16-2119afa5362e-console-config\") pod \"console-58f795db5f-x87hj\" (UID: \"4f959056-8782-42a6-aa16-2119afa5362e\") " pod="openshift-console/console-58f795db5f-x87hj"
Jul 15 21:35:58.706140 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:35:58.706090    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4f959056-8782-42a6-aa16-2119afa5362e-oauth-serving-cert\") pod \"console-58f795db5f-x87hj\" (UID: \"4f959056-8782-42a6-aa16-2119afa5362e\") " pod="openshift-console/console-58f795db5f-x87hj"
Jul 15 21:35:58.706140 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:35:58.706117    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4f959056-8782-42a6-aa16-2119afa5362e-console-oauth-config\") pod \"console-58f795db5f-x87hj\" (UID: \"4f959056-8782-42a6-aa16-2119afa5362e\") " pod="openshift-console/console-58f795db5f-x87hj"
Jul 15 21:35:58.706140 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:35:58.706133    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4f959056-8782-42a6-aa16-2119afa5362e-service-ca\") pod \"console-58f795db5f-x87hj\" (UID: \"4f959056-8782-42a6-aa16-2119afa5362e\") " pod="openshift-console/console-58f795db5f-x87hj"
Jul 15 21:35:58.706524 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:35:58.706186    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4f959056-8782-42a6-aa16-2119afa5362e-trusted-ca-bundle\") pod \"console-58f795db5f-x87hj\" (UID: \"4f959056-8782-42a6-aa16-2119afa5362e\") " pod="openshift-console/console-58f795db5f-x87hj"
Jul 15 21:35:58.706524 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:35:58.706209    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4f959056-8782-42a6-aa16-2119afa5362e-console-serving-cert\") pod \"console-58f795db5f-x87hj\" (UID: \"4f959056-8782-42a6-aa16-2119afa5362e\") " pod="openshift-console/console-58f795db5f-x87hj"
Jul 15 21:35:58.706524 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:35:58.706240    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b5hmz\" (UniqueName: \"kubernetes.io/projected/4f959056-8782-42a6-aa16-2119afa5362e-kube-api-access-b5hmz\") pod \"console-58f795db5f-x87hj\" (UID: \"4f959056-8782-42a6-aa16-2119afa5362e\") " pod="openshift-console/console-58f795db5f-x87hj"
Jul 15 21:35:58.706927 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:35:58.706899    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4f959056-8782-42a6-aa16-2119afa5362e-console-config\") pod \"console-58f795db5f-x87hj\" (UID: \"4f959056-8782-42a6-aa16-2119afa5362e\") " pod="openshift-console/console-58f795db5f-x87hj"
Jul 15 21:35:58.707062 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:35:58.706973    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4f959056-8782-42a6-aa16-2119afa5362e-oauth-serving-cert\") pod \"console-58f795db5f-x87hj\" (UID: \"4f959056-8782-42a6-aa16-2119afa5362e\") " pod="openshift-console/console-58f795db5f-x87hj"
Jul 15 21:35:58.707062 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:35:58.707027    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4f959056-8782-42a6-aa16-2119afa5362e-service-ca\") pod \"console-58f795db5f-x87hj\" (UID: \"4f959056-8782-42a6-aa16-2119afa5362e\") " pod="openshift-console/console-58f795db5f-x87hj"
Jul 15 21:35:58.707062 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:35:58.707043    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4f959056-8782-42a6-aa16-2119afa5362e-trusted-ca-bundle\") pod \"console-58f795db5f-x87hj\" (UID: \"4f959056-8782-42a6-aa16-2119afa5362e\") " pod="openshift-console/console-58f795db5f-x87hj"
Jul 15 21:35:58.709123 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:35:58.709101    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4f959056-8782-42a6-aa16-2119afa5362e-console-serving-cert\") pod \"console-58f795db5f-x87hj\" (UID: \"4f959056-8782-42a6-aa16-2119afa5362e\") " pod="openshift-console/console-58f795db5f-x87hj"
Jul 15 21:35:58.709228 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:35:58.709206    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4f959056-8782-42a6-aa16-2119afa5362e-console-oauth-config\") pod \"console-58f795db5f-x87hj\" (UID: \"4f959056-8782-42a6-aa16-2119afa5362e\") " pod="openshift-console/console-58f795db5f-x87hj"
Jul 15 21:35:58.713892 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:35:58.713875    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b5hmz\" (UniqueName: \"kubernetes.io/projected/4f959056-8782-42a6-aa16-2119afa5362e-kube-api-access-b5hmz\") pod \"console-58f795db5f-x87hj\" (UID: \"4f959056-8782-42a6-aa16-2119afa5362e\") " pod="openshift-console/console-58f795db5f-x87hj"
Jul 15 21:35:58.760957 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:35:58.760906    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-58f795db5f-x87hj"
Jul 15 21:35:58.907655 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:35:58.907623    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-58f795db5f-x87hj"]
Jul 15 21:35:58.909801 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:35:58.909774    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4f959056_8782_42a6_aa16_2119afa5362e.slice/crio-4106d3abdc1ae4008304cbdde3d12016e87f96cb34dc036de6528f979644320e WatchSource:0}: Error finding container 4106d3abdc1ae4008304cbdde3d12016e87f96cb34dc036de6528f979644320e: Status 404 returned error can't find the container with id 4106d3abdc1ae4008304cbdde3d12016e87f96cb34dc036de6528f979644320e
Jul 15 21:35:59.818350 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:35:59.818310    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-58f795db5f-x87hj" event={"ID":"4f959056-8782-42a6-aa16-2119afa5362e","Type":"ContainerStarted","Data":"cf2f6fdafafff651dbf8617d1bdbb914e022b39c32fa2c12597cf705f34ba531"}
Jul 15 21:35:59.818830 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:35:59.818369    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-58f795db5f-x87hj" event={"ID":"4f959056-8782-42a6-aa16-2119afa5362e","Type":"ContainerStarted","Data":"4106d3abdc1ae4008304cbdde3d12016e87f96cb34dc036de6528f979644320e"}
Jul 15 21:35:59.833628 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:35:59.833581    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-58f795db5f-x87hj" podStartSLOduration=1.8335662080000001 podStartE2EDuration="1.833566208s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:35:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:35:59.832502204 +0000 UTC m=+409.526429752" watchObservedRunningTime="2026-07-15 21:35:59.833566208 +0000 UTC m=+409.527493758"
Jul 15 21:36:08.761566 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:36:08.761525    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-58f795db5f-x87hj"
Jul 15 21:36:08.761977 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:36:08.761608    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-58f795db5f-x87hj"
Jul 15 21:36:08.766392 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:36:08.766369    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-58f795db5f-x87hj"
Jul 15 21:36:08.862984 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:36:08.862959    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-58f795db5f-x87hj"
Jul 15 21:36:08.898035 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:36:08.898002    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-69669b887f-kvxlp"]
Jul 15 21:36:10.826388 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:36:10.826358    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-d8wj8"]
Jul 15 21:36:10.829853 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:36:10.829829    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-d8wj8"
Jul 15 21:36:10.831878 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:36:10.831854    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 15 21:36:10.832037 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:36:10.831966    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-59z66\""
Jul 15 21:36:10.832141 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:36:10.832122    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 15 21:36:10.836163 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:36:10.836137    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-d8wj8"]
Jul 15 21:36:10.905176 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:36:10.905141    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h55dd\" (UniqueName: \"kubernetes.io/projected/c8c588c7-3634-43a3-a028-9034c43bccc9-kube-api-access-h55dd\") pod \"kuadrant-operator-catalog-d8wj8\" (UID: \"c8c588c7-3634-43a3-a028-9034c43bccc9\") " pod="kuadrant-system/kuadrant-operator-catalog-d8wj8"
Jul 15 21:36:11.006261 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:36:11.006232    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h55dd\" (UniqueName: \"kubernetes.io/projected/c8c588c7-3634-43a3-a028-9034c43bccc9-kube-api-access-h55dd\") pod \"kuadrant-operator-catalog-d8wj8\" (UID: \"c8c588c7-3634-43a3-a028-9034c43bccc9\") " pod="kuadrant-system/kuadrant-operator-catalog-d8wj8"
Jul 15 21:36:11.013612 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:36:11.013585    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h55dd\" (UniqueName: \"kubernetes.io/projected/c8c588c7-3634-43a3-a028-9034c43bccc9-kube-api-access-h55dd\") pod \"kuadrant-operator-catalog-d8wj8\" (UID: \"c8c588c7-3634-43a3-a028-9034c43bccc9\") " pod="kuadrant-system/kuadrant-operator-catalog-d8wj8"
Jul 15 21:36:11.141066 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:36:11.141018    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-d8wj8"
Jul 15 21:36:11.205053 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:36:11.205011    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-d8wj8"]
Jul 15 21:36:11.268110 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:36:11.268085    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-d8wj8"]
Jul 15 21:36:11.271005 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:36:11.270978    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc8c588c7_3634_43a3_a028_9034c43bccc9.slice/crio-01fe14c207ef1542184983a4f8b46e30a93553b14dceb06f2534ad7db2e250c8 WatchSource:0}: Error finding container 01fe14c207ef1542184983a4f8b46e30a93553b14dceb06f2534ad7db2e250c8: Status 404 returned error can't find the container with id 01fe14c207ef1542184983a4f8b46e30a93553b14dceb06f2534ad7db2e250c8
Jul 15 21:36:11.410106 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:36:11.410020    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-crnb5"]
Jul 15 21:36:11.414309 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:36:11.414292    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-crnb5"
Jul 15 21:36:11.418641 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:36:11.418613    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-crnb5"]
Jul 15 21:36:11.509711 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:36:11.509676    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wgp4w\" (UniqueName: \"kubernetes.io/projected/c3304f3c-de45-48af-9327-61f838ab6854-kube-api-access-wgp4w\") pod \"kuadrant-operator-catalog-crnb5\" (UID: \"c3304f3c-de45-48af-9327-61f838ab6854\") " pod="kuadrant-system/kuadrant-operator-catalog-crnb5"
Jul 15 21:36:11.610776 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:36:11.610729    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wgp4w\" (UniqueName: \"kubernetes.io/projected/c3304f3c-de45-48af-9327-61f838ab6854-kube-api-access-wgp4w\") pod \"kuadrant-operator-catalog-crnb5\" (UID: \"c3304f3c-de45-48af-9327-61f838ab6854\") " pod="kuadrant-system/kuadrant-operator-catalog-crnb5"
Jul 15 21:36:11.617907 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:36:11.617882    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wgp4w\" (UniqueName: \"kubernetes.io/projected/c3304f3c-de45-48af-9327-61f838ab6854-kube-api-access-wgp4w\") pod \"kuadrant-operator-catalog-crnb5\" (UID: \"c3304f3c-de45-48af-9327-61f838ab6854\") " pod="kuadrant-system/kuadrant-operator-catalog-crnb5"
Jul 15 21:36:11.724323 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:36:11.724247    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-crnb5"
Jul 15 21:36:11.852505 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:36:11.852481    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-crnb5"]
Jul 15 21:36:11.854846 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:36:11.854819    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc3304f3c_de45_48af_9327_61f838ab6854.slice/crio-3c377b4e595ab4a7053b20dc0de2f24904a57f652f619bdb26e25e5f20006c07 WatchSource:0}: Error finding container 3c377b4e595ab4a7053b20dc0de2f24904a57f652f619bdb26e25e5f20006c07: Status 404 returned error can't find the container with id 3c377b4e595ab4a7053b20dc0de2f24904a57f652f619bdb26e25e5f20006c07
Jul 15 21:36:11.872555 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:36:11.872527    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-d8wj8" event={"ID":"c8c588c7-3634-43a3-a028-9034c43bccc9","Type":"ContainerStarted","Data":"01fe14c207ef1542184983a4f8b46e30a93553b14dceb06f2534ad7db2e250c8"}
Jul 15 21:36:11.873594 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:36:11.873570    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-crnb5" event={"ID":"c3304f3c-de45-48af-9327-61f838ab6854","Type":"ContainerStarted","Data":"3c377b4e595ab4a7053b20dc0de2f24904a57f652f619bdb26e25e5f20006c07"}
Jul 15 21:36:13.885628 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:36:13.885541    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-crnb5" event={"ID":"c3304f3c-de45-48af-9327-61f838ab6854","Type":"ContainerStarted","Data":"6fa7844ec9e7239ac7c84b5ebff87f8a309b9f883562e37073f9c55b2ac62950"}
Jul 15 21:36:13.887207 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:36:13.887180    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-d8wj8" event={"ID":"c8c588c7-3634-43a3-a028-9034c43bccc9","Type":"ContainerStarted","Data":"a5fa4df049a91f287ed2854d906aee864aa3a7c60f041b811c2b503847328499"}
Jul 15 21:36:13.887318 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:36:13.887228    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-d8wj8" podUID="c8c588c7-3634-43a3-a028-9034c43bccc9" containerName="registry-server" containerID="cri-o://a5fa4df049a91f287ed2854d906aee864aa3a7c60f041b811c2b503847328499" gracePeriod=2
Jul 15 21:36:13.902536 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:36:13.902486    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-crnb5" podStartSLOduration=1.050347706 podStartE2EDuration="2.90246739s" totalImagesPullingTime="1.852119684s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:36:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:36:13.90179957 +0000 UTC m=+423.595727140" watchObservedRunningTime="2026-07-15 21:36:13.90246739 +0000 UTC m=+423.596394944"
Jul 15 21:36:13.918573 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:36:13.918526    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-d8wj8" podStartSLOduration=1.5999087520000002 podStartE2EDuration="3.918512089s" totalImagesPullingTime="2.318603337s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:36:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:36:13.917174994 +0000 UTC m=+423.611102546" watchObservedRunningTime="2026-07-15 21:36:13.918512089 +0000 UTC m=+423.612439640"
Jul 15 21:36:14.140512 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:36:14.140441    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-d8wj8"
Jul 15 21:36:14.233411 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:36:14.233377    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h55dd\" (UniqueName: \"kubernetes.io/projected/c8c588c7-3634-43a3-a028-9034c43bccc9-kube-api-access-h55dd\") pod \"c8c588c7-3634-43a3-a028-9034c43bccc9\" (UID: \"c8c588c7-3634-43a3-a028-9034c43bccc9\") "
Jul 15 21:36:14.235520 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:36:14.235489    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c8c588c7-3634-43a3-a028-9034c43bccc9-kube-api-access-h55dd" (OuterVolumeSpecName: "kube-api-access-h55dd") pod "c8c588c7-3634-43a3-a028-9034c43bccc9" (UID: "c8c588c7-3634-43a3-a028-9034c43bccc9"). InnerVolumeSpecName "kube-api-access-h55dd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 21:36:14.334617 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:36:14.334578    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h55dd\" (UniqueName: \"kubernetes.io/projected/c8c588c7-3634-43a3-a028-9034c43bccc9-kube-api-access-h55dd\") on node \"ip-10-0-130-217.ec2.internal\" DevicePath \"\""
Jul 15 21:36:14.892608 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:36:14.892516    2563 generic.go:356] "Generic (PLEG): container finished" podID="c8c588c7-3634-43a3-a028-9034c43bccc9" containerID="a5fa4df049a91f287ed2854d906aee864aa3a7c60f041b811c2b503847328499" exitCode=0
Jul 15 21:36:14.892608 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:36:14.892565    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-d8wj8"
Jul 15 21:36:14.893090 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:36:14.892599    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-d8wj8" event={"ID":"c8c588c7-3634-43a3-a028-9034c43bccc9","Type":"ContainerDied","Data":"a5fa4df049a91f287ed2854d906aee864aa3a7c60f041b811c2b503847328499"}
Jul 15 21:36:14.893090 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:36:14.892649    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-d8wj8" event={"ID":"c8c588c7-3634-43a3-a028-9034c43bccc9","Type":"ContainerDied","Data":"01fe14c207ef1542184983a4f8b46e30a93553b14dceb06f2534ad7db2e250c8"}
Jul 15 21:36:14.893090 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:36:14.892668    2563 scope.go:117] "RemoveContainer" containerID="a5fa4df049a91f287ed2854d906aee864aa3a7c60f041b811c2b503847328499"
Jul 15 21:36:14.902284 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:36:14.902263    2563 scope.go:117] "RemoveContainer" containerID="a5fa4df049a91f287ed2854d906aee864aa3a7c60f041b811c2b503847328499"
Jul 15 21:36:14.902553 ip-10-0-130-217 kubenswrapper[2563]: E0715 21:36:14.902535    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a5fa4df049a91f287ed2854d906aee864aa3a7c60f041b811c2b503847328499\": container with ID starting with a5fa4df049a91f287ed2854d906aee864aa3a7c60f041b811c2b503847328499 not found: ID does not exist" containerID="a5fa4df049a91f287ed2854d906aee864aa3a7c60f041b811c2b503847328499"
Jul 15 21:36:14.902613 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:36:14.902562    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a5fa4df049a91f287ed2854d906aee864aa3a7c60f041b811c2b503847328499"} err="failed to get container status \"a5fa4df049a91f287ed2854d906aee864aa3a7c60f041b811c2b503847328499\": rpc error: code = NotFound desc = could not find container \"a5fa4df049a91f287ed2854d906aee864aa3a7c60f041b811c2b503847328499\": container with ID starting with a5fa4df049a91f287ed2854d906aee864aa3a7c60f041b811c2b503847328499 not found: ID does not exist"
Jul 15 21:36:14.911644 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:36:14.911622    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-d8wj8"]
Jul 15 21:36:14.915549 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:36:14.915529    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-d8wj8"]
Jul 15 21:36:14.987154 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:36:14.987120    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c8c588c7-3634-43a3-a028-9034c43bccc9" path="/var/lib/kubelet/pods/c8c588c7-3634-43a3-a028-9034c43bccc9/volumes"
Jul 15 21:36:21.724643 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:36:21.724593    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-crnb5"
Jul 15 21:36:21.725059 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:36:21.724670    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-crnb5"
Jul 15 21:36:21.746888 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:36:21.746863    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-crnb5"
Jul 15 21:36:21.946105 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:36:21.946078    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-crnb5"
Jul 15 21:36:33.925164 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:36:33.925078    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-69669b887f-kvxlp" podUID="2fd2c4f6-a181-41df-9e04-566177dc371a" containerName="console" containerID="cri-o://86f15d916ac0e9a73fd00cde88280df190517166877e3bf9cd25f6b84ab759d6" gracePeriod=15
Jul 15 21:36:34.166623 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:36:34.166601    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-69669b887f-kvxlp"
Jul 15 21:36:34.308909 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:36:34.308824    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2fd2c4f6-a181-41df-9e04-566177dc371a-trusted-ca-bundle\") pod \"2fd2c4f6-a181-41df-9e04-566177dc371a\" (UID: \"2fd2c4f6-a181-41df-9e04-566177dc371a\") "
Jul 15 21:36:34.308909 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:36:34.308881    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2fd2c4f6-a181-41df-9e04-566177dc371a-service-ca\") pod \"2fd2c4f6-a181-41df-9e04-566177dc371a\" (UID: \"2fd2c4f6-a181-41df-9e04-566177dc371a\") "
Jul 15 21:36:34.309144 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:36:34.309006    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2fd2c4f6-a181-41df-9e04-566177dc371a-console-serving-cert\") pod \"2fd2c4f6-a181-41df-9e04-566177dc371a\" (UID: \"2fd2c4f6-a181-41df-9e04-566177dc371a\") "
Jul 15 21:36:34.309144 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:36:34.309071    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2fd2c4f6-a181-41df-9e04-566177dc371a-console-oauth-config\") pod \"2fd2c4f6-a181-41df-9e04-566177dc371a\" (UID: \"2fd2c4f6-a181-41df-9e04-566177dc371a\") "
Jul 15 21:36:34.309144 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:36:34.309102    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7jhpf\" (UniqueName: \"kubernetes.io/projected/2fd2c4f6-a181-41df-9e04-566177dc371a-kube-api-access-7jhpf\") pod \"2fd2c4f6-a181-41df-9e04-566177dc371a\" (UID: \"2fd2c4f6-a181-41df-9e04-566177dc371a\") "
Jul 15 21:36:34.309306 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:36:34.309123    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2fd2c4f6-a181-41df-9e04-566177dc371a-console-config\") pod \"2fd2c4f6-a181-41df-9e04-566177dc371a\" (UID: \"2fd2c4f6-a181-41df-9e04-566177dc371a\") "
Jul 15 21:36:34.309306 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:36:34.309176    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2fd2c4f6-a181-41df-9e04-566177dc371a-oauth-serving-cert\") pod \"2fd2c4f6-a181-41df-9e04-566177dc371a\" (UID: \"2fd2c4f6-a181-41df-9e04-566177dc371a\") "
Jul 15 21:36:34.309306 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:36:34.309245    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2fd2c4f6-a181-41df-9e04-566177dc371a-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "2fd2c4f6-a181-41df-9e04-566177dc371a" (UID: "2fd2c4f6-a181-41df-9e04-566177dc371a"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 21:36:34.309448 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:36:34.309330    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2fd2c4f6-a181-41df-9e04-566177dc371a-service-ca" (OuterVolumeSpecName: "service-ca") pod "2fd2c4f6-a181-41df-9e04-566177dc371a" (UID: "2fd2c4f6-a181-41df-9e04-566177dc371a"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 21:36:34.309609 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:36:34.309583    2563 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2fd2c4f6-a181-41df-9e04-566177dc371a-trusted-ca-bundle\") on node \"ip-10-0-130-217.ec2.internal\" DevicePath \"\""
Jul 15 21:36:34.309609 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:36:34.309609    2563 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2fd2c4f6-a181-41df-9e04-566177dc371a-service-ca\") on node \"ip-10-0-130-217.ec2.internal\" DevicePath \"\""
Jul 15 21:36:34.309789 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:36:34.309608    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2fd2c4f6-a181-41df-9e04-566177dc371a-console-config" (OuterVolumeSpecName: "console-config") pod "2fd2c4f6-a181-41df-9e04-566177dc371a" (UID: "2fd2c4f6-a181-41df-9e04-566177dc371a"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 21:36:34.309789 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:36:34.309620    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2fd2c4f6-a181-41df-9e04-566177dc371a-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "2fd2c4f6-a181-41df-9e04-566177dc371a" (UID: "2fd2c4f6-a181-41df-9e04-566177dc371a"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 21:36:34.311211 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:36:34.311184    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2fd2c4f6-a181-41df-9e04-566177dc371a-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "2fd2c4f6-a181-41df-9e04-566177dc371a" (UID: "2fd2c4f6-a181-41df-9e04-566177dc371a"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 21:36:34.311309 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:36:34.311229    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2fd2c4f6-a181-41df-9e04-566177dc371a-kube-api-access-7jhpf" (OuterVolumeSpecName: "kube-api-access-7jhpf") pod "2fd2c4f6-a181-41df-9e04-566177dc371a" (UID: "2fd2c4f6-a181-41df-9e04-566177dc371a"). InnerVolumeSpecName "kube-api-access-7jhpf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 21:36:34.311309 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:36:34.311247    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2fd2c4f6-a181-41df-9e04-566177dc371a-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "2fd2c4f6-a181-41df-9e04-566177dc371a" (UID: "2fd2c4f6-a181-41df-9e04-566177dc371a"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 21:36:34.410166 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:36:34.410135    2563 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2fd2c4f6-a181-41df-9e04-566177dc371a-console-serving-cert\") on node \"ip-10-0-130-217.ec2.internal\" DevicePath \"\""
Jul 15 21:36:34.410166 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:36:34.410165    2563 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2fd2c4f6-a181-41df-9e04-566177dc371a-console-oauth-config\") on node \"ip-10-0-130-217.ec2.internal\" DevicePath \"\""
Jul 15 21:36:34.410166 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:36:34.410176    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7jhpf\" (UniqueName: \"kubernetes.io/projected/2fd2c4f6-a181-41df-9e04-566177dc371a-kube-api-access-7jhpf\") on node \"ip-10-0-130-217.ec2.internal\" DevicePath \"\""
Jul 15 21:36:34.410383 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:36:34.410185    2563 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2fd2c4f6-a181-41df-9e04-566177dc371a-console-config\") on node \"ip-10-0-130-217.ec2.internal\" DevicePath \"\""
Jul 15 21:36:34.410383 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:36:34.410194    2563 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2fd2c4f6-a181-41df-9e04-566177dc371a-oauth-serving-cert\") on node \"ip-10-0-130-217.ec2.internal\" DevicePath \"\""
Jul 15 21:36:34.981263 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:36:34.981219    2563 generic.go:356] "Generic (PLEG): container finished" podID="2fd2c4f6-a181-41df-9e04-566177dc371a" containerID="86f15d916ac0e9a73fd00cde88280df190517166877e3bf9cd25f6b84ab759d6" exitCode=0
Jul 15 21:36:34.981728 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:36:34.981285    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-69669b887f-kvxlp"
Jul 15 21:36:34.981728 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:36:34.981305    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-69669b887f-kvxlp" event={"ID":"2fd2c4f6-a181-41df-9e04-566177dc371a","Type":"ContainerDied","Data":"86f15d916ac0e9a73fd00cde88280df190517166877e3bf9cd25f6b84ab759d6"}
Jul 15 21:36:34.981728 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:36:34.981392    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-69669b887f-kvxlp" event={"ID":"2fd2c4f6-a181-41df-9e04-566177dc371a","Type":"ContainerDied","Data":"8d1d3b27fd3d68e58c077463df70da67eb29e67235404b578b00f81aaa3ac4a2"}
Jul 15 21:36:34.981728 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:36:34.981415    2563 scope.go:117] "RemoveContainer" containerID="86f15d916ac0e9a73fd00cde88280df190517166877e3bf9cd25f6b84ab759d6"
Jul 15 21:36:34.991828 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:36:34.991801    2563 scope.go:117] "RemoveContainer" containerID="86f15d916ac0e9a73fd00cde88280df190517166877e3bf9cd25f6b84ab759d6"
Jul 15 21:36:34.992172 ip-10-0-130-217 kubenswrapper[2563]: E0715 21:36:34.992146    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"86f15d916ac0e9a73fd00cde88280df190517166877e3bf9cd25f6b84ab759d6\": container with ID starting with 86f15d916ac0e9a73fd00cde88280df190517166877e3bf9cd25f6b84ab759d6 not found: ID does not exist" containerID="86f15d916ac0e9a73fd00cde88280df190517166877e3bf9cd25f6b84ab759d6"
Jul 15 21:36:34.992269 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:36:34.992180    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"86f15d916ac0e9a73fd00cde88280df190517166877e3bf9cd25f6b84ab759d6"} err="failed to get container status \"86f15d916ac0e9a73fd00cde88280df190517166877e3bf9cd25f6b84ab759d6\": rpc error: code = NotFound desc = could not find container \"86f15d916ac0e9a73fd00cde88280df190517166877e3bf9cd25f6b84ab759d6\": container with ID starting with 86f15d916ac0e9a73fd00cde88280df190517166877e3bf9cd25f6b84ab759d6 not found: ID does not exist"
Jul 15 21:36:35.005143 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:36:35.005115    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-69669b887f-kvxlp"]
Jul 15 21:36:35.008609 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:36:35.008586    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-69669b887f-kvxlp"]
Jul 15 21:36:36.987023 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:36:36.986986    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2fd2c4f6-a181-41df-9e04-566177dc371a" path="/var/lib/kubelet/pods/2fd2c4f6-a181-41df-9e04-566177dc371a/volumes"
Jul 15 21:36:42.830269 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:36:42.830234    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-98kcj"]
Jul 15 21:36:42.830655 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:36:42.830573    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2fd2c4f6-a181-41df-9e04-566177dc371a" containerName="console"
Jul 15 21:36:42.830655 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:36:42.830585    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="2fd2c4f6-a181-41df-9e04-566177dc371a" containerName="console"
Jul 15 21:36:42.830655 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:36:42.830592    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c8c588c7-3634-43a3-a028-9034c43bccc9" containerName="registry-server"
Jul 15 21:36:42.830655 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:36:42.830599    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="c8c588c7-3634-43a3-a028-9034c43bccc9" containerName="registry-server"
Jul 15 21:36:42.830655 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:36:42.830653    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="2fd2c4f6-a181-41df-9e04-566177dc371a" containerName="console"
Jul 15 21:36:42.830809 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:36:42.830665    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="c8c588c7-3634-43a3-a028-9034c43bccc9" containerName="registry-server"
Jul 15 21:36:42.835281 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:36:42.835258    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-98kcj"
Jul 15 21:36:42.837375 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:36:42.837344    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
Jul 15 21:36:42.837496 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:36:42.837449    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-mnhsg\""
Jul 15 21:36:42.844051 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:36:42.844016    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-98kcj"]
Jul 15 21:36:42.982530 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:36:42.982497    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gbsv2\" (UniqueName: \"kubernetes.io/projected/f51f71f9-17f6-4f13-bd94-d3ab2c910871-kube-api-access-gbsv2\") pod \"dns-operator-controller-manager-864dd78c4c-98kcj\" (UID: \"f51f71f9-17f6-4f13-bd94-d3ab2c910871\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-98kcj"
Jul 15 21:36:43.083085 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:36:43.082998    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gbsv2\" (UniqueName: \"kubernetes.io/projected/f51f71f9-17f6-4f13-bd94-d3ab2c910871-kube-api-access-gbsv2\") pod \"dns-operator-controller-manager-864dd78c4c-98kcj\" (UID: \"f51f71f9-17f6-4f13-bd94-d3ab2c910871\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-98kcj"
Jul 15 21:36:43.091161 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:36:43.091130    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gbsv2\" (UniqueName: \"kubernetes.io/projected/f51f71f9-17f6-4f13-bd94-d3ab2c910871-kube-api-access-gbsv2\") pod \"dns-operator-controller-manager-864dd78c4c-98kcj\" (UID: \"f51f71f9-17f6-4f13-bd94-d3ab2c910871\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-98kcj"
Jul 15 21:36:43.145621 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:36:43.145584    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-98kcj"
Jul 15 21:36:43.276372 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:36:43.276323    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-98kcj"]
Jul 15 21:36:43.279062 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:36:43.279035    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf51f71f9_17f6_4f13_bd94_d3ab2c910871.slice/crio-cb03b67174fd4a7dec30c336178988447c4383055772e5599f3f7c8e4e7080d2 WatchSource:0}: Error finding container cb03b67174fd4a7dec30c336178988447c4383055772e5599f3f7c8e4e7080d2: Status 404 returned error can't find the container with id cb03b67174fd4a7dec30c336178988447c4383055772e5599f3f7c8e4e7080d2
Jul 15 21:36:44.021754 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:36:44.021723    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-98kcj" event={"ID":"f51f71f9-17f6-4f13-bd94-d3ab2c910871","Type":"ContainerStarted","Data":"cb03b67174fd4a7dec30c336178988447c4383055772e5599f3f7c8e4e7080d2"}
Jul 15 21:36:46.031386 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:36:46.031289    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-98kcj" event={"ID":"f51f71f9-17f6-4f13-bd94-d3ab2c910871","Type":"ContainerStarted","Data":"025a5fb5367fd486109724e7f042f4040c3bddb77ca487b84a07ff68a7708adb"}
Jul 15 21:36:46.031779 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:36:46.031420    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-98kcj"
Jul 15 21:36:46.049799 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:36:46.049747    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-98kcj" podStartSLOduration=1.7393992200000001 podStartE2EDuration="4.049731908s" totalImagesPullingTime="2.310332688s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:36:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:36:46.047649284 +0000 UTC m=+455.741576829" watchObservedRunningTime="2026-07-15 21:36:46.049731908 +0000 UTC m=+455.743659456"
Jul 15 21:36:46.205298 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:36:46.205262    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8h65s"]
Jul 15 21:36:46.208870 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:36:46.208847    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8h65s"
Jul 15 21:36:46.211338 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:36:46.211313    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-5pcnt\""
Jul 15 21:36:46.218756 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:36:46.218733    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8h65s"]
Jul 15 21:36:46.310542 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:36:46.310461    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xhpzc\" (UniqueName: \"kubernetes.io/projected/206d2d27-cf3a-4954-8372-4d8eede32cea-kube-api-access-xhpzc\") pod \"limitador-operator-controller-manager-859d7b78bd-8h65s\" (UID: \"206d2d27-cf3a-4954-8372-4d8eede32cea\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8h65s"
Jul 15 21:36:46.411423 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:36:46.411383    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xhpzc\" (UniqueName: \"kubernetes.io/projected/206d2d27-cf3a-4954-8372-4d8eede32cea-kube-api-access-xhpzc\") pod \"limitador-operator-controller-manager-859d7b78bd-8h65s\" (UID: \"206d2d27-cf3a-4954-8372-4d8eede32cea\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8h65s"
Jul 15 21:36:46.419376 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:36:46.419349    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xhpzc\" (UniqueName: \"kubernetes.io/projected/206d2d27-cf3a-4954-8372-4d8eede32cea-kube-api-access-xhpzc\") pod \"limitador-operator-controller-manager-859d7b78bd-8h65s\" (UID: \"206d2d27-cf3a-4954-8372-4d8eede32cea\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8h65s"
Jul 15 21:36:46.519446 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:36:46.519402    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8h65s"
Jul 15 21:36:46.656951 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:36:46.656902    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8h65s"]
Jul 15 21:36:46.659904 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:36:46.659878    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod206d2d27_cf3a_4954_8372_4d8eede32cea.slice/crio-1953d4872eaf3d56746e07dd8ca2e9f85aa8e4ee5716ac9a4f6a656a3cf7c597 WatchSource:0}: Error finding container 1953d4872eaf3d56746e07dd8ca2e9f85aa8e4ee5716ac9a4f6a656a3cf7c597: Status 404 returned error can't find the container with id 1953d4872eaf3d56746e07dd8ca2e9f85aa8e4ee5716ac9a4f6a656a3cf7c597
Jul 15 21:36:47.036634 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:36:47.036594    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8h65s" event={"ID":"206d2d27-cf3a-4954-8372-4d8eede32cea","Type":"ContainerStarted","Data":"1953d4872eaf3d56746e07dd8ca2e9f85aa8e4ee5716ac9a4f6a656a3cf7c597"}
Jul 15 21:36:49.047179 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:36:49.047091    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8h65s" event={"ID":"206d2d27-cf3a-4954-8372-4d8eede32cea","Type":"ContainerStarted","Data":"ff7e21da92797b41a9fe84aa07a3b05b28a9beeb6c8f33d1909ee250ae2ea604"}
Jul 15 21:36:49.047596 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:36:49.047250    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8h65s"
Jul 15 21:36:49.063254 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:36:49.063200    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8h65s" podStartSLOduration=1.045945258 podStartE2EDuration="3.063184513s" totalImagesPullingTime="2.017239255s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:36:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:36:49.062521165 +0000 UTC m=+458.756448717" watchObservedRunningTime="2026-07-15 21:36:49.063184513 +0000 UTC m=+458.757112064"
Jul 15 21:36:54.947849 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:36:54.947810    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-k4cxc"]
Jul 15 21:36:54.951328 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:36:54.951311    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-k4cxc"
Jul 15 21:36:54.953629 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:36:54.953609    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-cf92g\""
Jul 15 21:36:54.969280 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:36:54.969259    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-k4cxc"]
Jul 15 21:36:55.085590 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:36:55.085552    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wlntt\" (UniqueName: \"kubernetes.io/projected/4d040ace-574c-4e7c-9922-95451249a5d6-kube-api-access-wlntt\") pod \"kuadrant-operator-controller-manager-8684c9ff49-k4cxc\" (UID: \"4d040ace-574c-4e7c-9922-95451249a5d6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-k4cxc"
Jul 15 21:36:55.085788 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:36:55.085723    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4d040ace-574c-4e7c-9922-95451249a5d6-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-k4cxc\" (UID: \"4d040ace-574c-4e7c-9922-95451249a5d6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-k4cxc"
Jul 15 21:36:55.186513 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:36:55.186466    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4d040ace-574c-4e7c-9922-95451249a5d6-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-k4cxc\" (UID: \"4d040ace-574c-4e7c-9922-95451249a5d6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-k4cxc"
Jul 15 21:36:55.186513 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:36:55.186519    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wlntt\" (UniqueName: \"kubernetes.io/projected/4d040ace-574c-4e7c-9922-95451249a5d6-kube-api-access-wlntt\") pod \"kuadrant-operator-controller-manager-8684c9ff49-k4cxc\" (UID: \"4d040ace-574c-4e7c-9922-95451249a5d6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-k4cxc"
Jul 15 21:36:55.186960 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:36:55.186916    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4d040ace-574c-4e7c-9922-95451249a5d6-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-k4cxc\" (UID: \"4d040ace-574c-4e7c-9922-95451249a5d6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-k4cxc"
Jul 15 21:36:55.194989 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:36:55.194968    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wlntt\" (UniqueName: \"kubernetes.io/projected/4d040ace-574c-4e7c-9922-95451249a5d6-kube-api-access-wlntt\") pod \"kuadrant-operator-controller-manager-8684c9ff49-k4cxc\" (UID: \"4d040ace-574c-4e7c-9922-95451249a5d6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-k4cxc"
Jul 15 21:36:55.261170 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:36:55.261109    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-k4cxc"
Jul 15 21:36:55.423751 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:36:55.423711    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-k4cxc"]
Jul 15 21:36:55.428226 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:36:55.428196    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4d040ace_574c_4e7c_9922_95451249a5d6.slice/crio-3d7b4d7ee8a610aa4432d4066cb331d2c373988374c30056f92e5d036256e0b1 WatchSource:0}: Error finding container 3d7b4d7ee8a610aa4432d4066cb331d2c373988374c30056f92e5d036256e0b1: Status 404 returned error can't find the container with id 3d7b4d7ee8a610aa4432d4066cb331d2c373988374c30056f92e5d036256e0b1
Jul 15 21:36:56.077748 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:36:56.077707    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-k4cxc" event={"ID":"4d040ace-574c-4e7c-9922-95451249a5d6","Type":"ContainerStarted","Data":"3d7b4d7ee8a610aa4432d4066cb331d2c373988374c30056f92e5d036256e0b1"}
Jul 15 21:36:57.039129 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:36:57.039098    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-98kcj"
Jul 15 21:37:00.053505 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:37:00.053468    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8h65s"
Jul 15 21:37:01.104688 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:37:01.104649    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-k4cxc" event={"ID":"4d040ace-574c-4e7c-9922-95451249a5d6","Type":"ContainerStarted","Data":"0511a368f154ee900ef8443693cbebac425d075aaf5cd6096e05a567198150af"}
Jul 15 21:37:01.105163 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:37:01.104725    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-k4cxc"
Jul 15 21:37:01.123552 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:37:01.123456    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-k4cxc" podStartSLOduration=1.647416169 podStartE2EDuration="7.123441733s" totalImagesPullingTime="5.476025564s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:36:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:37:01.121693876 +0000 UTC m=+470.815621427" watchObservedRunningTime="2026-07-15 21:37:01.123441733 +0000 UTC m=+470.817369283"
Jul 15 21:37:12.112579 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:37:12.112539    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-k4cxc"
Jul 15 21:37:13.000315 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:37:13.000282    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-hckjb"]
Jul 15 21:37:13.004927 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:37:13.004909    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-hckjb"
Jul 15 21:37:13.015822 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:37:13.015793    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-hckjb"]
Jul 15 21:37:13.039740 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:37:13.039704    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/bf7c22d7-e6f7-420d-90ef-64a76a745e0d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-hckjb\" (UID: \"bf7c22d7-e6f7-420d-90ef-64a76a745e0d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-hckjb"
Jul 15 21:37:13.039740 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:37:13.039744    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9r7jc\" (UniqueName: \"kubernetes.io/projected/bf7c22d7-e6f7-420d-90ef-64a76a745e0d-kube-api-access-9r7jc\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-hckjb\" (UID: \"bf7c22d7-e6f7-420d-90ef-64a76a745e0d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-hckjb"
Jul 15 21:37:13.140908 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:37:13.140862    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/bf7c22d7-e6f7-420d-90ef-64a76a745e0d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-hckjb\" (UID: \"bf7c22d7-e6f7-420d-90ef-64a76a745e0d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-hckjb"
Jul 15 21:37:13.140908 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:37:13.140914    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9r7jc\" (UniqueName: \"kubernetes.io/projected/bf7c22d7-e6f7-420d-90ef-64a76a745e0d-kube-api-access-9r7jc\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-hckjb\" (UID: \"bf7c22d7-e6f7-420d-90ef-64a76a745e0d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-hckjb"
Jul 15 21:37:13.141343 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:37:13.141257    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/bf7c22d7-e6f7-420d-90ef-64a76a745e0d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-hckjb\" (UID: \"bf7c22d7-e6f7-420d-90ef-64a76a745e0d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-hckjb"
Jul 15 21:37:13.151773 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:37:13.151744    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9r7jc\" (UniqueName: \"kubernetes.io/projected/bf7c22d7-e6f7-420d-90ef-64a76a745e0d-kube-api-access-9r7jc\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-hckjb\" (UID: \"bf7c22d7-e6f7-420d-90ef-64a76a745e0d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-hckjb"
Jul 15 21:37:13.316497 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:37:13.316408    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-hckjb"
Jul 15 21:37:13.456983 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:37:13.456959    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-hckjb"]
Jul 15 21:37:13.458959 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:37:13.458916    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbf7c22d7_e6f7_420d_90ef_64a76a745e0d.slice/crio-fe8ede583a8bc39377d86f65ae016c20c33ed7e899d75de425a064b9f130338a WatchSource:0}: Error finding container fe8ede583a8bc39377d86f65ae016c20c33ed7e899d75de425a064b9f130338a: Status 404 returned error can't find the container with id fe8ede583a8bc39377d86f65ae016c20c33ed7e899d75de425a064b9f130338a
Jul 15 21:37:13.739797 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:37:13.739755    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-hckjb"]
Jul 15 21:37:13.746828 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:37:13.746788    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-hckjb"]
Jul 15 21:37:13.757441 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:37:13.757412    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-k4cxc"]
Jul 15 21:37:13.757633 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:37:13.757580    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-k4cxc" podUID="4d040ace-574c-4e7c-9922-95451249a5d6" containerName="manager" containerID="cri-o://0511a368f154ee900ef8443693cbebac425d075aaf5cd6096e05a567198150af" gracePeriod=2
Jul 15 21:37:13.761349 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:37:13.761322    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-swb2q"]
Jul 15 21:37:13.761845 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:37:13.761826    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bf7c22d7-e6f7-420d-90ef-64a76a745e0d" containerName="manager"
Jul 15 21:37:13.761845 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:37:13.761847    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="bf7c22d7-e6f7-420d-90ef-64a76a745e0d" containerName="manager"
Jul 15 21:37:13.761999 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:37:13.761957    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="bf7c22d7-e6f7-420d-90ef-64a76a745e0d" containerName="manager"
Jul 15 21:37:13.765422 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:37:13.765396    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-swb2q"
Jul 15 21:37:13.771468 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:37:13.771269    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-k4cxc"]
Jul 15 21:37:13.786253 ip-10-0-130-217 kubenswrapper[2563]: E0715 21:37:13.786202    2563 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"4d040ace-574c-4e7c-9922-95451249a5d6\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"kuadrant-operator-controller-manager-8684c9ff49-k4cxc\": pods \"kuadrant-operator-controller-manager-8684c9ff49-k4cxc\" not found" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-k4cxc"
Jul 15 21:37:13.786594 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:37:13.786573    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-swb2q"]
Jul 15 21:37:13.788047 ip-10-0-130-217 kubenswrapper[2563]: E0715 21:37:13.788017    2563 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-k4cxc\" is forbidden: User \"system:node:ip-10-0-130-217.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-217.ec2.internal' and this object" podUID="4d040ace-574c-4e7c-9922-95451249a5d6" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-k4cxc"
Jul 15 21:37:13.792049 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:37:13.792025    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8h65s"]
Jul 15 21:37:13.792257 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:37:13.792233    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8h65s" podUID="206d2d27-cf3a-4954-8372-4d8eede32cea" containerName="manager" containerID="cri-o://ff7e21da92797b41a9fe84aa07a3b05b28a9beeb6c8f33d1909ee250ae2ea604" gracePeriod=2
Jul 15 21:37:13.795688 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:37:13.795658    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rtjl2"]
Jul 15 21:37:13.796098 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:37:13.796083    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4d040ace-574c-4e7c-9922-95451249a5d6" containerName="manager"
Jul 15 21:37:13.796173 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:37:13.796101    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="4d040ace-574c-4e7c-9922-95451249a5d6" containerName="manager"
Jul 15 21:37:13.796229 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:37:13.796176    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="4d040ace-574c-4e7c-9922-95451249a5d6" containerName="manager"
Jul 15 21:37:13.799313 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:37:13.799011    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rtjl2"
Jul 15 21:37:13.804338 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:37:13.804311    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8h65s"]
Jul 15 21:37:13.813578 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:37:13.813552    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rtjl2"]
Jul 15 21:37:13.819679 ip-10-0-130-217 kubenswrapper[2563]: E0715 21:37:13.819648    2563 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-k4cxc\" is forbidden: User \"system:node:ip-10-0-130-217.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-217.ec2.internal' and this object" podUID="4d040ace-574c-4e7c-9922-95451249a5d6" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-k4cxc"
Jul 15 21:37:13.821422 ip-10-0-130-217 kubenswrapper[2563]: E0715 21:37:13.821395    2563 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-8h65s\" is forbidden: User \"system:node:ip-10-0-130-217.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-217.ec2.internal' and this object" podUID="206d2d27-cf3a-4954-8372-4d8eede32cea" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8h65s"
Jul 15 21:37:13.847621 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:37:13.847584    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2f4cac0e-7554-4240-b12a-37fe7aee5d9e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-swb2q\" (UID: \"2f4cac0e-7554-4240-b12a-37fe7aee5d9e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-swb2q"
Jul 15 21:37:13.847779 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:37:13.847705    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dglx6\" (UniqueName: \"kubernetes.io/projected/2f4cac0e-7554-4240-b12a-37fe7aee5d9e-kube-api-access-dglx6\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-swb2q\" (UID: \"2f4cac0e-7554-4240-b12a-37fe7aee5d9e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-swb2q"
Jul 15 21:37:13.847841 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:37:13.847799    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/24a0ec03-1bca-4905-b93c-1a6060493499-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-rtjl2\" (UID: \"24a0ec03-1bca-4905-b93c-1a6060493499\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rtjl2"
Jul 15 21:37:13.847901 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:37:13.847840    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t88l9\" (UniqueName: \"kubernetes.io/projected/24a0ec03-1bca-4905-b93c-1a6060493499-kube-api-access-t88l9\") pod \"kuadrant-operator-controller-manager-8684c9ff49-rtjl2\" (UID: \"24a0ec03-1bca-4905-b93c-1a6060493499\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rtjl2"
Jul 15 21:37:13.948608 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:37:13.948563    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dglx6\" (UniqueName: \"kubernetes.io/projected/2f4cac0e-7554-4240-b12a-37fe7aee5d9e-kube-api-access-dglx6\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-swb2q\" (UID: \"2f4cac0e-7554-4240-b12a-37fe7aee5d9e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-swb2q"
Jul 15 21:37:13.948782 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:37:13.948762    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/24a0ec03-1bca-4905-b93c-1a6060493499-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-rtjl2\" (UID: \"24a0ec03-1bca-4905-b93c-1a6060493499\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rtjl2"
Jul 15 21:37:13.948827 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:37:13.948801    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t88l9\" (UniqueName: \"kubernetes.io/projected/24a0ec03-1bca-4905-b93c-1a6060493499-kube-api-access-t88l9\") pod \"kuadrant-operator-controller-manager-8684c9ff49-rtjl2\" (UID: \"24a0ec03-1bca-4905-b93c-1a6060493499\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rtjl2"
Jul 15 21:37:13.948865 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:37:13.948852    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2f4cac0e-7554-4240-b12a-37fe7aee5d9e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-swb2q\" (UID: \"2f4cac0e-7554-4240-b12a-37fe7aee5d9e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-swb2q"
Jul 15 21:37:13.949276 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:37:13.949251    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/24a0ec03-1bca-4905-b93c-1a6060493499-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-rtjl2\" (UID: \"24a0ec03-1bca-4905-b93c-1a6060493499\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rtjl2"
Jul 15 21:37:13.949375 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:37:13.949251    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2f4cac0e-7554-4240-b12a-37fe7aee5d9e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-swb2q\" (UID: \"2f4cac0e-7554-4240-b12a-37fe7aee5d9e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-swb2q"
Jul 15 21:37:13.957854 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:37:13.957829    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t88l9\" (UniqueName: \"kubernetes.io/projected/24a0ec03-1bca-4905-b93c-1a6060493499-kube-api-access-t88l9\") pod \"kuadrant-operator-controller-manager-8684c9ff49-rtjl2\" (UID: \"24a0ec03-1bca-4905-b93c-1a6060493499\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rtjl2"
Jul 15 21:37:13.958601 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:37:13.958579    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dglx6\" (UniqueName: \"kubernetes.io/projected/2f4cac0e-7554-4240-b12a-37fe7aee5d9e-kube-api-access-dglx6\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-swb2q\" (UID: \"2f4cac0e-7554-4240-b12a-37fe7aee5d9e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-swb2q"
Jul 15 21:37:14.021689 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:37:14.021662    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-k4cxc"
Jul 15 21:37:14.023746 ip-10-0-130-217 kubenswrapper[2563]: E0715 21:37:14.023711    2563 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-k4cxc\" is forbidden: User \"system:node:ip-10-0-130-217.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-217.ec2.internal' and this object" podUID="4d040ace-574c-4e7c-9922-95451249a5d6" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-k4cxc"
Jul 15 21:37:14.025525 ip-10-0-130-217 kubenswrapper[2563]: E0715 21:37:14.025497    2563 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-8h65s\" is forbidden: User \"system:node:ip-10-0-130-217.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-217.ec2.internal' and this object" podUID="206d2d27-cf3a-4954-8372-4d8eede32cea" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8h65s"
Jul 15 21:37:14.026546 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:37:14.026531    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8h65s"
Jul 15 21:37:14.028278 ip-10-0-130-217 kubenswrapper[2563]: E0715 21:37:14.028253    2563 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-8h65s\" is forbidden: User \"system:node:ip-10-0-130-217.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-217.ec2.internal' and this object" podUID="206d2d27-cf3a-4954-8372-4d8eede32cea" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8h65s"
Jul 15 21:37:14.030117 ip-10-0-130-217 kubenswrapper[2563]: E0715 21:37:14.030094    2563 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-k4cxc\" is forbidden: User \"system:node:ip-10-0-130-217.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-217.ec2.internal' and this object" podUID="4d040ace-574c-4e7c-9922-95451249a5d6" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-k4cxc"
Jul 15 21:37:14.049534 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:37:14.049511    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wlntt\" (UniqueName: \"kubernetes.io/projected/4d040ace-574c-4e7c-9922-95451249a5d6-kube-api-access-wlntt\") pod \"4d040ace-574c-4e7c-9922-95451249a5d6\" (UID: \"4d040ace-574c-4e7c-9922-95451249a5d6\") "
Jul 15 21:37:14.049612 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:37:14.049589    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4d040ace-574c-4e7c-9922-95451249a5d6-extensions-socket-volume\") pod \"4d040ace-574c-4e7c-9922-95451249a5d6\" (UID: \"4d040ace-574c-4e7c-9922-95451249a5d6\") "
Jul 15 21:37:14.049656 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:37:14.049634    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xhpzc\" (UniqueName: \"kubernetes.io/projected/206d2d27-cf3a-4954-8372-4d8eede32cea-kube-api-access-xhpzc\") pod \"206d2d27-cf3a-4954-8372-4d8eede32cea\" (UID: \"206d2d27-cf3a-4954-8372-4d8eede32cea\") "
Jul 15 21:37:14.049960 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:37:14.049912    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4d040ace-574c-4e7c-9922-95451249a5d6-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "4d040ace-574c-4e7c-9922-95451249a5d6" (UID: "4d040ace-574c-4e7c-9922-95451249a5d6"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 21:37:14.051684 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:37:14.051660    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/206d2d27-cf3a-4954-8372-4d8eede32cea-kube-api-access-xhpzc" (OuterVolumeSpecName: "kube-api-access-xhpzc") pod "206d2d27-cf3a-4954-8372-4d8eede32cea" (UID: "206d2d27-cf3a-4954-8372-4d8eede32cea"). InnerVolumeSpecName "kube-api-access-xhpzc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 21:37:14.051684 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:37:14.051669    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4d040ace-574c-4e7c-9922-95451249a5d6-kube-api-access-wlntt" (OuterVolumeSpecName: "kube-api-access-wlntt") pod "4d040ace-574c-4e7c-9922-95451249a5d6" (UID: "4d040ace-574c-4e7c-9922-95451249a5d6"). InnerVolumeSpecName "kube-api-access-wlntt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 21:37:14.151242 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:37:14.151206    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wlntt\" (UniqueName: \"kubernetes.io/projected/4d040ace-574c-4e7c-9922-95451249a5d6-kube-api-access-wlntt\") on node \"ip-10-0-130-217.ec2.internal\" DevicePath \"\""
Jul 15 21:37:14.151242 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:37:14.151237    2563 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4d040ace-574c-4e7c-9922-95451249a5d6-extensions-socket-volume\") on node \"ip-10-0-130-217.ec2.internal\" DevicePath \"\""
Jul 15 21:37:14.151242 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:37:14.151248    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xhpzc\" (UniqueName: \"kubernetes.io/projected/206d2d27-cf3a-4954-8372-4d8eede32cea-kube-api-access-xhpzc\") on node \"ip-10-0-130-217.ec2.internal\" DevicePath \"\""
Jul 15 21:37:14.168322 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:37:14.168284    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-swb2q"
Jul 15 21:37:14.171416 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:37:14.171278    2563 generic.go:356] "Generic (PLEG): container finished" podID="4d040ace-574c-4e7c-9922-95451249a5d6" containerID="0511a368f154ee900ef8443693cbebac425d075aaf5cd6096e05a567198150af" exitCode=0
Jul 15 21:37:14.171416 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:37:14.171327    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-k4cxc"
Jul 15 21:37:14.171416 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:37:14.171385    2563 scope.go:117] "RemoveContainer" containerID="0511a368f154ee900ef8443693cbebac425d075aaf5cd6096e05a567198150af"
Jul 15 21:37:14.180223 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:37:14.180193    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rtjl2"
Jul 15 21:37:14.180791 ip-10-0-130-217 kubenswrapper[2563]: E0715 21:37:14.180731    2563 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-k4cxc\" is forbidden: User \"system:node:ip-10-0-130-217.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-217.ec2.internal' and this object" podUID="4d040ace-574c-4e7c-9922-95451249a5d6" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-k4cxc"
Jul 15 21:37:14.182416 ip-10-0-130-217 kubenswrapper[2563]: E0715 21:37:14.182398    2563 kuberuntime_manager.go:649] "Missing actuated resource record" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-hckjb" container="manager"
Jul 15 21:37:14.184143 ip-10-0-130-217 kubenswrapper[2563]: E0715 21:37:14.183876    2563 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-8h65s\" is forbidden: User \"system:node:ip-10-0-130-217.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-217.ec2.internal' and this object" podUID="206d2d27-cf3a-4954-8372-4d8eede32cea" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8h65s"
Jul 15 21:37:14.184698 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:37:14.184408    2563 generic.go:356] "Generic (PLEG): container finished" podID="206d2d27-cf3a-4954-8372-4d8eede32cea" containerID="ff7e21da92797b41a9fe84aa07a3b05b28a9beeb6c8f33d1909ee250ae2ea604" exitCode=0
Jul 15 21:37:14.184698 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:37:14.184462    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8h65s"
Jul 15 21:37:14.186537 ip-10-0-130-217 kubenswrapper[2563]: E0715 21:37:14.186496    2563 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-hckjb\" is forbidden: User \"system:node:ip-10-0-130-217.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-217.ec2.internal' and this object" podUID="bf7c22d7-e6f7-420d-90ef-64a76a745e0d" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-hckjb"
Jul 15 21:37:14.188841 ip-10-0-130-217 kubenswrapper[2563]: E0715 21:37:14.188812    2563 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-8h65s\" is forbidden: User \"system:node:ip-10-0-130-217.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-217.ec2.internal' and this object" podUID="206d2d27-cf3a-4954-8372-4d8eede32cea" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8h65s"
Jul 15 21:37:14.191145 ip-10-0-130-217 kubenswrapper[2563]: E0715 21:37:14.191117    2563 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-k4cxc\" is forbidden: User \"system:node:ip-10-0-130-217.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-217.ec2.internal' and this object" podUID="4d040ace-574c-4e7c-9922-95451249a5d6" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-k4cxc"
Jul 15 21:37:14.193465 ip-10-0-130-217 kubenswrapper[2563]: E0715 21:37:14.193437    2563 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-k4cxc\" is forbidden: User \"system:node:ip-10-0-130-217.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-217.ec2.internal' and this object" podUID="4d040ace-574c-4e7c-9922-95451249a5d6" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-k4cxc"
Jul 15 21:37:14.195638 ip-10-0-130-217 kubenswrapper[2563]: E0715 21:37:14.195601    2563 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-hckjb\" is forbidden: User \"system:node:ip-10-0-130-217.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-217.ec2.internal' and this object" podUID="bf7c22d7-e6f7-420d-90ef-64a76a745e0d" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-hckjb"
Jul 15 21:37:14.199386 ip-10-0-130-217 kubenswrapper[2563]: E0715 21:37:14.199340    2563 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-8h65s\" is forbidden: User \"system:node:ip-10-0-130-217.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-217.ec2.internal' and this object" podUID="206d2d27-cf3a-4954-8372-4d8eede32cea" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8h65s"
Jul 15 21:37:14.209353 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:37:14.209300    2563 scope.go:117] "RemoveContainer" containerID="0511a368f154ee900ef8443693cbebac425d075aaf5cd6096e05a567198150af"
Jul 15 21:37:14.209780 ip-10-0-130-217 kubenswrapper[2563]: E0715 21:37:14.209755    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0511a368f154ee900ef8443693cbebac425d075aaf5cd6096e05a567198150af\": container with ID starting with 0511a368f154ee900ef8443693cbebac425d075aaf5cd6096e05a567198150af not found: ID does not exist" containerID="0511a368f154ee900ef8443693cbebac425d075aaf5cd6096e05a567198150af"
Jul 15 21:37:14.209899 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:37:14.209793    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0511a368f154ee900ef8443693cbebac425d075aaf5cd6096e05a567198150af"} err="failed to get container status \"0511a368f154ee900ef8443693cbebac425d075aaf5cd6096e05a567198150af\": rpc error: code = NotFound desc = could not find container \"0511a368f154ee900ef8443693cbebac425d075aaf5cd6096e05a567198150af\": container with ID starting with 0511a368f154ee900ef8443693cbebac425d075aaf5cd6096e05a567198150af not found: ID does not exist"
Jul 15 21:37:14.209899 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:37:14.209818    2563 scope.go:117] "RemoveContainer" containerID="ff7e21da92797b41a9fe84aa07a3b05b28a9beeb6c8f33d1909ee250ae2ea604"
Jul 15 21:37:14.211811 ip-10-0-130-217 kubenswrapper[2563]: E0715 21:37:14.211786    2563 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-8h65s\" is forbidden: User \"system:node:ip-10-0-130-217.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-217.ec2.internal' and this object" podUID="206d2d27-cf3a-4954-8372-4d8eede32cea" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8h65s"
Jul 15 21:37:14.213874 ip-10-0-130-217 kubenswrapper[2563]: E0715 21:37:14.213844    2563 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-k4cxc\" is forbidden: User \"system:node:ip-10-0-130-217.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-217.ec2.internal' and this object" podUID="4d040ace-574c-4e7c-9922-95451249a5d6" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-k4cxc"
Jul 15 21:37:14.216403 ip-10-0-130-217 kubenswrapper[2563]: E0715 21:37:14.216367    2563 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-hckjb\" is forbidden: User \"system:node:ip-10-0-130-217.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-217.ec2.internal' and this object" podUID="bf7c22d7-e6f7-420d-90ef-64a76a745e0d" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-hckjb"
Jul 15 21:37:14.218618 ip-10-0-130-217 kubenswrapper[2563]: E0715 21:37:14.218565    2563 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-hckjb\" is forbidden: User \"system:node:ip-10-0-130-217.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-217.ec2.internal' and this object" podUID="bf7c22d7-e6f7-420d-90ef-64a76a745e0d" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-hckjb"
Jul 15 21:37:14.221222 ip-10-0-130-217 kubenswrapper[2563]: E0715 21:37:14.221147    2563 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-8h65s\" is forbidden: User \"system:node:ip-10-0-130-217.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-217.ec2.internal' and this object" podUID="206d2d27-cf3a-4954-8372-4d8eede32cea" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8h65s"
Jul 15 21:37:14.221397 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:37:14.221351    2563 scope.go:117] "RemoveContainer" containerID="ff7e21da92797b41a9fe84aa07a3b05b28a9beeb6c8f33d1909ee250ae2ea604"
Jul 15 21:37:14.221713 ip-10-0-130-217 kubenswrapper[2563]: E0715 21:37:14.221686    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ff7e21da92797b41a9fe84aa07a3b05b28a9beeb6c8f33d1909ee250ae2ea604\": container with ID starting with ff7e21da92797b41a9fe84aa07a3b05b28a9beeb6c8f33d1909ee250ae2ea604 not found: ID does not exist" containerID="ff7e21da92797b41a9fe84aa07a3b05b28a9beeb6c8f33d1909ee250ae2ea604"
Jul 15 21:37:14.221786 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:37:14.221725    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ff7e21da92797b41a9fe84aa07a3b05b28a9beeb6c8f33d1909ee250ae2ea604"} err="failed to get container status \"ff7e21da92797b41a9fe84aa07a3b05b28a9beeb6c8f33d1909ee250ae2ea604\": rpc error: code = NotFound desc = could not find container \"ff7e21da92797b41a9fe84aa07a3b05b28a9beeb6c8f33d1909ee250ae2ea604\": container with ID starting with ff7e21da92797b41a9fe84aa07a3b05b28a9beeb6c8f33d1909ee250ae2ea604 not found: ID does not exist"
Jul 15 21:37:14.223179 ip-10-0-130-217 kubenswrapper[2563]: E0715 21:37:14.223148    2563 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-k4cxc\" is forbidden: User \"system:node:ip-10-0-130-217.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-217.ec2.internal' and this object" podUID="4d040ace-574c-4e7c-9922-95451249a5d6" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-k4cxc"
Jul 15 21:37:14.335669 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:37:14.335644    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-swb2q"]
Jul 15 21:37:14.338101 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:37:14.338074    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2f4cac0e_7554_4240_b12a_37fe7aee5d9e.slice/crio-0e87fd6431839d45af35b097eeaab24c72b995cd50c43700cc8eb5f2657bb7d9 WatchSource:0}: Error finding container 0e87fd6431839d45af35b097eeaab24c72b995cd50c43700cc8eb5f2657bb7d9: Status 404 returned error can't find the container with id 0e87fd6431839d45af35b097eeaab24c72b995cd50c43700cc8eb5f2657bb7d9
Jul 15 21:37:14.354424 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:37:14.354396    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rtjl2"]
Jul 15 21:37:14.356712 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:37:14.356686    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod24a0ec03_1bca_4905_b93c_1a6060493499.slice/crio-39ff574f76bb99923c102e10c48a987267c795c5159fcef892b4b2b8246f065b WatchSource:0}: Error finding container 39ff574f76bb99923c102e10c48a987267c795c5159fcef892b4b2b8246f065b: Status 404 returned error can't find the container with id 39ff574f76bb99923c102e10c48a987267c795c5159fcef892b4b2b8246f065b
Jul 15 21:37:14.988001 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:37:14.987969    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="206d2d27-cf3a-4954-8372-4d8eede32cea" path="/var/lib/kubelet/pods/206d2d27-cf3a-4954-8372-4d8eede32cea/volumes"
Jul 15 21:37:14.988342 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:37:14.988329    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4d040ace-574c-4e7c-9922-95451249a5d6" path="/var/lib/kubelet/pods/4d040ace-574c-4e7c-9922-95451249a5d6/volumes"
Jul 15 21:37:15.192202 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:37:15.192169    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rtjl2" event={"ID":"24a0ec03-1bca-4905-b93c-1a6060493499","Type":"ContainerStarted","Data":"83794b62b9125361d3cb1e937aa14ae31a400f3ba24314b1ab2ffef1b007cac3"}
Jul 15 21:37:15.192629 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:37:15.192224    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rtjl2" event={"ID":"24a0ec03-1bca-4905-b93c-1a6060493499","Type":"ContainerStarted","Data":"39ff574f76bb99923c102e10c48a987267c795c5159fcef892b4b2b8246f065b"}
Jul 15 21:37:15.192629 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:37:15.192256    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rtjl2"
Jul 15 21:37:15.193784 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:37:15.193761    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-swb2q" event={"ID":"2f4cac0e-7554-4240-b12a-37fe7aee5d9e","Type":"ContainerStarted","Data":"1c2dd241881d2d93ebf96f6956fe0460ed2563d95d7476e326a6dc6f30e79abd"}
Jul 15 21:37:15.193885 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:37:15.193806    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-swb2q" event={"ID":"2f4cac0e-7554-4240-b12a-37fe7aee5d9e","Type":"ContainerStarted","Data":"0e87fd6431839d45af35b097eeaab24c72b995cd50c43700cc8eb5f2657bb7d9"}
Jul 15 21:37:15.193885 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:37:15.193849    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-swb2q"
Jul 15 21:37:15.196210 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:37:15.196185    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-hckjb" podUID="bf7c22d7-e6f7-420d-90ef-64a76a745e0d" containerName="manager" containerID="cri-o://86d08fc7240958be01b69c3b318c08a26088302c23ddfe65266cb070f4011793" gracePeriod=2
Jul 15 21:37:15.213450 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:37:15.213410    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rtjl2" podStartSLOduration=2.213394859 podStartE2EDuration="2.213394859s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:37:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:37:15.21110509 +0000 UTC m=+484.905032643" watchObservedRunningTime="2026-07-15 21:37:15.213394859 +0000 UTC m=+484.907322410"
Jul 15 21:37:15.229518 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:37:15.229480    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-swb2q" podStartSLOduration=2.229470158 podStartE2EDuration="2.229470158s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:37:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:37:15.228374987 +0000 UTC m=+484.922302537" watchObservedRunningTime="2026-07-15 21:37:15.229470158 +0000 UTC m=+484.923397705"
Jul 15 21:37:15.436486 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:37:15.436458    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-hckjb"
Jul 15 21:37:15.438458 ip-10-0-130-217 kubenswrapper[2563]: E0715 21:37:15.438432    2563 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-hckjb\" is forbidden: User \"system:node:ip-10-0-130-217.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-217.ec2.internal' and this object" podUID="bf7c22d7-e6f7-420d-90ef-64a76a745e0d" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-hckjb"
Jul 15 21:37:15.463881 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:37:15.463857    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9r7jc\" (UniqueName: \"kubernetes.io/projected/bf7c22d7-e6f7-420d-90ef-64a76a745e0d-kube-api-access-9r7jc\") pod \"bf7c22d7-e6f7-420d-90ef-64a76a745e0d\" (UID: \"bf7c22d7-e6f7-420d-90ef-64a76a745e0d\") "
Jul 15 21:37:15.463963 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:37:15.463918    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/bf7c22d7-e6f7-420d-90ef-64a76a745e0d-extensions-socket-volume\") pod \"bf7c22d7-e6f7-420d-90ef-64a76a745e0d\" (UID: \"bf7c22d7-e6f7-420d-90ef-64a76a745e0d\") "
Jul 15 21:37:15.464179 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:37:15.464157    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bf7c22d7-e6f7-420d-90ef-64a76a745e0d-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "bf7c22d7-e6f7-420d-90ef-64a76a745e0d" (UID: "bf7c22d7-e6f7-420d-90ef-64a76a745e0d"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 21:37:15.465898 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:37:15.465870    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bf7c22d7-e6f7-420d-90ef-64a76a745e0d-kube-api-access-9r7jc" (OuterVolumeSpecName: "kube-api-access-9r7jc") pod "bf7c22d7-e6f7-420d-90ef-64a76a745e0d" (UID: "bf7c22d7-e6f7-420d-90ef-64a76a745e0d"). InnerVolumeSpecName "kube-api-access-9r7jc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 21:37:15.565185 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:37:15.565087    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9r7jc\" (UniqueName: \"kubernetes.io/projected/bf7c22d7-e6f7-420d-90ef-64a76a745e0d-kube-api-access-9r7jc\") on node \"ip-10-0-130-217.ec2.internal\" DevicePath \"\""
Jul 15 21:37:15.565185 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:37:15.565122    2563 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/bf7c22d7-e6f7-420d-90ef-64a76a745e0d-extensions-socket-volume\") on node \"ip-10-0-130-217.ec2.internal\" DevicePath \"\""
Jul 15 21:37:16.202402 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:37:16.202367    2563 generic.go:356] "Generic (PLEG): container finished" podID="bf7c22d7-e6f7-420d-90ef-64a76a745e0d" containerID="86d08fc7240958be01b69c3b318c08a26088302c23ddfe65266cb070f4011793" exitCode=2
Jul 15 21:37:16.202834 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:37:16.202408    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-hckjb"
Jul 15 21:37:16.202834 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:37:16.202462    2563 scope.go:117] "RemoveContainer" containerID="86d08fc7240958be01b69c3b318c08a26088302c23ddfe65266cb070f4011793"
Jul 15 21:37:16.204681 ip-10-0-130-217 kubenswrapper[2563]: E0715 21:37:16.204648    2563 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-hckjb\" is forbidden: User \"system:node:ip-10-0-130-217.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-217.ec2.internal' and this object" podUID="bf7c22d7-e6f7-420d-90ef-64a76a745e0d" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-hckjb"
Jul 15 21:37:16.212166 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:37:16.212151    2563 scope.go:117] "RemoveContainer" containerID="86d08fc7240958be01b69c3b318c08a26088302c23ddfe65266cb070f4011793"
Jul 15 21:37:16.212412 ip-10-0-130-217 kubenswrapper[2563]: E0715 21:37:16.212395    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"86d08fc7240958be01b69c3b318c08a26088302c23ddfe65266cb070f4011793\": container with ID starting with 86d08fc7240958be01b69c3b318c08a26088302c23ddfe65266cb070f4011793 not found: ID does not exist" containerID="86d08fc7240958be01b69c3b318c08a26088302c23ddfe65266cb070f4011793"
Jul 15 21:37:16.212451 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:37:16.212422    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"86d08fc7240958be01b69c3b318c08a26088302c23ddfe65266cb070f4011793"} err="failed to get container status \"86d08fc7240958be01b69c3b318c08a26088302c23ddfe65266cb070f4011793\": rpc error: code = NotFound desc = could not find container \"86d08fc7240958be01b69c3b318c08a26088302c23ddfe65266cb070f4011793\": container with ID starting with 86d08fc7240958be01b69c3b318c08a26088302c23ddfe65266cb070f4011793 not found: ID does not exist"
Jul 15 21:37:16.213529 ip-10-0-130-217 kubenswrapper[2563]: E0715 21:37:16.213506    2563 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-hckjb\" is forbidden: User \"system:node:ip-10-0-130-217.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-217.ec2.internal' and this object" podUID="bf7c22d7-e6f7-420d-90ef-64a76a745e0d" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-hckjb"
Jul 15 21:37:16.987527 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:37:16.987492    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bf7c22d7-e6f7-420d-90ef-64a76a745e0d" path="/var/lib/kubelet/pods/bf7c22d7-e6f7-420d-90ef-64a76a745e0d/volumes"
Jul 15 21:37:26.205287 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:37:26.205253    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-swb2q"
Jul 15 21:37:26.205824 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:37:26.205323    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rtjl2"
Jul 15 21:37:26.268457 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:37:26.268425    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rtjl2"]
Jul 15 21:37:26.268671 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:37:26.268611    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rtjl2" podUID="24a0ec03-1bca-4905-b93c-1a6060493499" containerName="manager" containerID="cri-o://83794b62b9125361d3cb1e937aa14ae31a400f3ba24314b1ab2ffef1b007cac3" gracePeriod=10
Jul 15 21:37:26.453571 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:37:26.453538    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-b8z2f"]
Jul 15 21:37:26.453974 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:37:26.453957    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="206d2d27-cf3a-4954-8372-4d8eede32cea" containerName="manager"
Jul 15 21:37:26.454067 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:37:26.453977    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="206d2d27-cf3a-4954-8372-4d8eede32cea" containerName="manager"
Jul 15 21:37:26.454127 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:37:26.454071    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="206d2d27-cf3a-4954-8372-4d8eede32cea" containerName="manager"
Jul 15 21:37:26.456334 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:37:26.456271    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-b8z2f"
Jul 15 21:37:26.470716 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:37:26.470690    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-b8z2f"]
Jul 15 21:37:26.521032 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:37:26.521008    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rtjl2"
Jul 15 21:37:26.554151 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:37:26.554123    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t88l9\" (UniqueName: \"kubernetes.io/projected/24a0ec03-1bca-4905-b93c-1a6060493499-kube-api-access-t88l9\") pod \"24a0ec03-1bca-4905-b93c-1a6060493499\" (UID: \"24a0ec03-1bca-4905-b93c-1a6060493499\") "
Jul 15 21:37:26.554316 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:37:26.554222    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/24a0ec03-1bca-4905-b93c-1a6060493499-extensions-socket-volume\") pod \"24a0ec03-1bca-4905-b93c-1a6060493499\" (UID: \"24a0ec03-1bca-4905-b93c-1a6060493499\") "
Jul 15 21:37:26.554534 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:37:26.554411    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/17e966e3-39e9-4272-8fe0-9891e31a1d4e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-b8z2f\" (UID: \"17e966e3-39e9-4272-8fe0-9891e31a1d4e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-b8z2f"
Jul 15 21:37:26.554534 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:37:26.554485    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8mwkc\" (UniqueName: \"kubernetes.io/projected/17e966e3-39e9-4272-8fe0-9891e31a1d4e-kube-api-access-8mwkc\") pod \"kuadrant-operator-controller-manager-86878c769f-b8z2f\" (UID: \"17e966e3-39e9-4272-8fe0-9891e31a1d4e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-b8z2f"
Jul 15 21:37:26.554718 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:37:26.554641    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/24a0ec03-1bca-4905-b93c-1a6060493499-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "24a0ec03-1bca-4905-b93c-1a6060493499" (UID: "24a0ec03-1bca-4905-b93c-1a6060493499"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 21:37:26.556146 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:37:26.556115    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/24a0ec03-1bca-4905-b93c-1a6060493499-kube-api-access-t88l9" (OuterVolumeSpecName: "kube-api-access-t88l9") pod "24a0ec03-1bca-4905-b93c-1a6060493499" (UID: "24a0ec03-1bca-4905-b93c-1a6060493499"). InnerVolumeSpecName "kube-api-access-t88l9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 21:37:26.655721 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:37:26.655689    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/17e966e3-39e9-4272-8fe0-9891e31a1d4e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-b8z2f\" (UID: \"17e966e3-39e9-4272-8fe0-9891e31a1d4e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-b8z2f"
Jul 15 21:37:26.655891 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:37:26.655729    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8mwkc\" (UniqueName: \"kubernetes.io/projected/17e966e3-39e9-4272-8fe0-9891e31a1d4e-kube-api-access-8mwkc\") pod \"kuadrant-operator-controller-manager-86878c769f-b8z2f\" (UID: \"17e966e3-39e9-4272-8fe0-9891e31a1d4e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-b8z2f"
Jul 15 21:37:26.655891 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:37:26.655781    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t88l9\" (UniqueName: \"kubernetes.io/projected/24a0ec03-1bca-4905-b93c-1a6060493499-kube-api-access-t88l9\") on node \"ip-10-0-130-217.ec2.internal\" DevicePath \"\""
Jul 15 21:37:26.655891 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:37:26.655791    2563 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/24a0ec03-1bca-4905-b93c-1a6060493499-extensions-socket-volume\") on node \"ip-10-0-130-217.ec2.internal\" DevicePath \"\""
Jul 15 21:37:26.656104 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:37:26.656082    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/17e966e3-39e9-4272-8fe0-9891e31a1d4e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-b8z2f\" (UID: \"17e966e3-39e9-4272-8fe0-9891e31a1d4e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-b8z2f"
Jul 15 21:37:26.666377 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:37:26.666350    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8mwkc\" (UniqueName: \"kubernetes.io/projected/17e966e3-39e9-4272-8fe0-9891e31a1d4e-kube-api-access-8mwkc\") pod \"kuadrant-operator-controller-manager-86878c769f-b8z2f\" (UID: \"17e966e3-39e9-4272-8fe0-9891e31a1d4e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-b8z2f"
Jul 15 21:37:26.770509 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:37:26.770421    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-b8z2f"
Jul 15 21:37:26.901539 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:37:26.901514    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-b8z2f"]
Jul 15 21:37:26.903751 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:37:26.903719    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod17e966e3_39e9_4272_8fe0_9891e31a1d4e.slice/crio-586ab7b57855db2e0730662cf84ea6e4ed9c1223174e7209a8ccc8a788150b54 WatchSource:0}: Error finding container 586ab7b57855db2e0730662cf84ea6e4ed9c1223174e7209a8ccc8a788150b54: Status 404 returned error can't find the container with id 586ab7b57855db2e0730662cf84ea6e4ed9c1223174e7209a8ccc8a788150b54
Jul 15 21:37:27.258300 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:37:27.258255    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-b8z2f" event={"ID":"17e966e3-39e9-4272-8fe0-9891e31a1d4e","Type":"ContainerStarted","Data":"57350838bdd49d41414714bf4433cddfb1bd29de562fadb1ca60e9fc940ef9c9"}
Jul 15 21:37:27.258720 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:37:27.258320    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-b8z2f"
Jul 15 21:37:27.258720 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:37:27.258344    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-b8z2f" event={"ID":"17e966e3-39e9-4272-8fe0-9891e31a1d4e","Type":"ContainerStarted","Data":"586ab7b57855db2e0730662cf84ea6e4ed9c1223174e7209a8ccc8a788150b54"}
Jul 15 21:37:27.259651 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:37:27.259625    2563 generic.go:356] "Generic (PLEG): container finished" podID="24a0ec03-1bca-4905-b93c-1a6060493499" containerID="83794b62b9125361d3cb1e937aa14ae31a400f3ba24314b1ab2ffef1b007cac3" exitCode=0
Jul 15 21:37:27.259730 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:37:27.259660    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rtjl2"
Jul 15 21:37:27.259771 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:37:27.259657    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rtjl2" event={"ID":"24a0ec03-1bca-4905-b93c-1a6060493499","Type":"ContainerDied","Data":"83794b62b9125361d3cb1e937aa14ae31a400f3ba24314b1ab2ffef1b007cac3"}
Jul 15 21:37:27.259813 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:37:27.259798    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rtjl2" event={"ID":"24a0ec03-1bca-4905-b93c-1a6060493499","Type":"ContainerDied","Data":"39ff574f76bb99923c102e10c48a987267c795c5159fcef892b4b2b8246f065b"}
Jul 15 21:37:27.259848 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:37:27.259829    2563 scope.go:117] "RemoveContainer" containerID="83794b62b9125361d3cb1e937aa14ae31a400f3ba24314b1ab2ffef1b007cac3"
Jul 15 21:37:27.268462 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:37:27.268449    2563 scope.go:117] "RemoveContainer" containerID="83794b62b9125361d3cb1e937aa14ae31a400f3ba24314b1ab2ffef1b007cac3"
Jul 15 21:37:27.268690 ip-10-0-130-217 kubenswrapper[2563]: E0715 21:37:27.268672    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"83794b62b9125361d3cb1e937aa14ae31a400f3ba24314b1ab2ffef1b007cac3\": container with ID starting with 83794b62b9125361d3cb1e937aa14ae31a400f3ba24314b1ab2ffef1b007cac3 not found: ID does not exist" containerID="83794b62b9125361d3cb1e937aa14ae31a400f3ba24314b1ab2ffef1b007cac3"
Jul 15 21:37:27.268734 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:37:27.268698    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"83794b62b9125361d3cb1e937aa14ae31a400f3ba24314b1ab2ffef1b007cac3"} err="failed to get container status \"83794b62b9125361d3cb1e937aa14ae31a400f3ba24314b1ab2ffef1b007cac3\": rpc error: code = NotFound desc = could not find container \"83794b62b9125361d3cb1e937aa14ae31a400f3ba24314b1ab2ffef1b007cac3\": container with ID starting with 83794b62b9125361d3cb1e937aa14ae31a400f3ba24314b1ab2ffef1b007cac3 not found: ID does not exist"
Jul 15 21:37:27.278407 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:37:27.278358    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-b8z2f" podStartSLOduration=1.278340375 podStartE2EDuration="1.278340375s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:37:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:37:27.275835668 +0000 UTC m=+496.969763224" watchObservedRunningTime="2026-07-15 21:37:27.278340375 +0000 UTC m=+496.972267927"
Jul 15 21:37:27.296075 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:37:27.296048    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rtjl2"]
Jul 15 21:37:27.302543 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:37:27.302519    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rtjl2"]
Jul 15 21:37:28.987722 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:37:28.987687    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="24a0ec03-1bca-4905-b93c-1a6060493499" path="/var/lib/kubelet/pods/24a0ec03-1bca-4905-b93c-1a6060493499/volumes"
Jul 15 21:37:38.268814 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:37:38.268783    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-b8z2f"
Jul 15 21:37:38.314238 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:37:38.314203    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-swb2q"]
Jul 15 21:37:38.314415 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:37:38.314376    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-swb2q" podUID="2f4cac0e-7554-4240-b12a-37fe7aee5d9e" containerName="manager" containerID="cri-o://1c2dd241881d2d93ebf96f6956fe0460ed2563d95d7476e326a6dc6f30e79abd" gracePeriod=10
Jul 15 21:37:38.562433 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:37:38.562411    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-swb2q"
Jul 15 21:37:38.665595 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:37:38.665551    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2f4cac0e-7554-4240-b12a-37fe7aee5d9e-extensions-socket-volume\") pod \"2f4cac0e-7554-4240-b12a-37fe7aee5d9e\" (UID: \"2f4cac0e-7554-4240-b12a-37fe7aee5d9e\") "
Jul 15 21:37:38.665789 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:37:38.665612    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dglx6\" (UniqueName: \"kubernetes.io/projected/2f4cac0e-7554-4240-b12a-37fe7aee5d9e-kube-api-access-dglx6\") pod \"2f4cac0e-7554-4240-b12a-37fe7aee5d9e\" (UID: \"2f4cac0e-7554-4240-b12a-37fe7aee5d9e\") "
Jul 15 21:37:38.665922 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:37:38.665895    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2f4cac0e-7554-4240-b12a-37fe7aee5d9e-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "2f4cac0e-7554-4240-b12a-37fe7aee5d9e" (UID: "2f4cac0e-7554-4240-b12a-37fe7aee5d9e"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 21:37:38.667896 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:37:38.667873    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2f4cac0e-7554-4240-b12a-37fe7aee5d9e-kube-api-access-dglx6" (OuterVolumeSpecName: "kube-api-access-dglx6") pod "2f4cac0e-7554-4240-b12a-37fe7aee5d9e" (UID: "2f4cac0e-7554-4240-b12a-37fe7aee5d9e"). InnerVolumeSpecName "kube-api-access-dglx6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 21:37:38.766430 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:37:38.766398    2563 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2f4cac0e-7554-4240-b12a-37fe7aee5d9e-extensions-socket-volume\") on node \"ip-10-0-130-217.ec2.internal\" DevicePath \"\""
Jul 15 21:37:38.766430 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:37:38.766423    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dglx6\" (UniqueName: \"kubernetes.io/projected/2f4cac0e-7554-4240-b12a-37fe7aee5d9e-kube-api-access-dglx6\") on node \"ip-10-0-130-217.ec2.internal\" DevicePath \"\""
Jul 15 21:37:39.319187 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:37:39.319105    2563 generic.go:356] "Generic (PLEG): container finished" podID="2f4cac0e-7554-4240-b12a-37fe7aee5d9e" containerID="1c2dd241881d2d93ebf96f6956fe0460ed2563d95d7476e326a6dc6f30e79abd" exitCode=0
Jul 15 21:37:39.319187 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:37:39.319150    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-swb2q"
Jul 15 21:37:39.319630 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:37:39.319191    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-swb2q" event={"ID":"2f4cac0e-7554-4240-b12a-37fe7aee5d9e","Type":"ContainerDied","Data":"1c2dd241881d2d93ebf96f6956fe0460ed2563d95d7476e326a6dc6f30e79abd"}
Jul 15 21:37:39.319630 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:37:39.319249    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-swb2q" event={"ID":"2f4cac0e-7554-4240-b12a-37fe7aee5d9e","Type":"ContainerDied","Data":"0e87fd6431839d45af35b097eeaab24c72b995cd50c43700cc8eb5f2657bb7d9"}
Jul 15 21:37:39.319630 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:37:39.319275    2563 scope.go:117] "RemoveContainer" containerID="1c2dd241881d2d93ebf96f6956fe0460ed2563d95d7476e326a6dc6f30e79abd"
Jul 15 21:37:39.328523 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:37:39.328505    2563 scope.go:117] "RemoveContainer" containerID="1c2dd241881d2d93ebf96f6956fe0460ed2563d95d7476e326a6dc6f30e79abd"
Jul 15 21:37:39.328765 ip-10-0-130-217 kubenswrapper[2563]: E0715 21:37:39.328748    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1c2dd241881d2d93ebf96f6956fe0460ed2563d95d7476e326a6dc6f30e79abd\": container with ID starting with 1c2dd241881d2d93ebf96f6956fe0460ed2563d95d7476e326a6dc6f30e79abd not found: ID does not exist" containerID="1c2dd241881d2d93ebf96f6956fe0460ed2563d95d7476e326a6dc6f30e79abd"
Jul 15 21:37:39.328806 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:37:39.328772    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1c2dd241881d2d93ebf96f6956fe0460ed2563d95d7476e326a6dc6f30e79abd"} err="failed to get container status \"1c2dd241881d2d93ebf96f6956fe0460ed2563d95d7476e326a6dc6f30e79abd\": rpc error: code = NotFound desc = could not find container \"1c2dd241881d2d93ebf96f6956fe0460ed2563d95d7476e326a6dc6f30e79abd\": container with ID starting with 1c2dd241881d2d93ebf96f6956fe0460ed2563d95d7476e326a6dc6f30e79abd not found: ID does not exist"
Jul 15 21:37:39.337496 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:37:39.337472    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-swb2q"]
Jul 15 21:37:39.341187 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:37:39.341166    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-swb2q"]
Jul 15 21:37:40.988253 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:37:40.988219    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2f4cac0e-7554-4240-b12a-37fe7aee5d9e" path="/var/lib/kubelet/pods/2f4cac0e-7554-4240-b12a-37fe7aee5d9e/volumes"
Jul 15 21:37:42.647484 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:37:42.647427    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-g9cv6"]
Jul 15 21:37:42.647818 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:37:42.647782    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="24a0ec03-1bca-4905-b93c-1a6060493499" containerName="manager"
Jul 15 21:37:42.647818 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:37:42.647793    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="24a0ec03-1bca-4905-b93c-1a6060493499" containerName="manager"
Jul 15 21:37:42.647818 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:37:42.647817    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2f4cac0e-7554-4240-b12a-37fe7aee5d9e" containerName="manager"
Jul 15 21:37:42.647923 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:37:42.647822    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="2f4cac0e-7554-4240-b12a-37fe7aee5d9e" containerName="manager"
Jul 15 21:37:42.647923 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:37:42.647888    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="2f4cac0e-7554-4240-b12a-37fe7aee5d9e" containerName="manager"
Jul 15 21:37:42.647923 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:37:42.647900    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="24a0ec03-1bca-4905-b93c-1a6060493499" containerName="manager"
Jul 15 21:37:42.652137 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:37:42.652120    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-g9cv6"
Jul 15 21:37:42.654649 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:37:42.654628    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-clltl\""
Jul 15 21:37:42.675954 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:37:42.668174    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-g9cv6"]
Jul 15 21:37:42.805364 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:37:42.805327    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4a9ce1d9-cd12-4bde-b4af-171e9e9b8e65-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-g9cv6\" (UID: \"4a9ce1d9-cd12-4bde-b4af-171e9e9b8e65\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-g9cv6"
Jul 15 21:37:42.805528 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:37:42.805371    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4a9ce1d9-cd12-4bde-b4af-171e9e9b8e65-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-g9cv6\" (UID: \"4a9ce1d9-cd12-4bde-b4af-171e9e9b8e65\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-g9cv6"
Jul 15 21:37:42.805528 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:37:42.805444    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4a9ce1d9-cd12-4bde-b4af-171e9e9b8e65-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-g9cv6\" (UID: \"4a9ce1d9-cd12-4bde-b4af-171e9e9b8e65\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-g9cv6"
Jul 15 21:37:42.805528 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:37:42.805468    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4a9ce1d9-cd12-4bde-b4af-171e9e9b8e65-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-g9cv6\" (UID: \"4a9ce1d9-cd12-4bde-b4af-171e9e9b8e65\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-g9cv6"
Jul 15 21:37:42.805528 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:37:42.805504    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4a9ce1d9-cd12-4bde-b4af-171e9e9b8e65-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-g9cv6\" (UID: \"4a9ce1d9-cd12-4bde-b4af-171e9e9b8e65\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-g9cv6"
Jul 15 21:37:42.805528 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:37:42.805521    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4a9ce1d9-cd12-4bde-b4af-171e9e9b8e65-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-g9cv6\" (UID: \"4a9ce1d9-cd12-4bde-b4af-171e9e9b8e65\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-g9cv6"
Jul 15 21:37:42.805711 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:37:42.805535    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j5d92\" (UniqueName: \"kubernetes.io/projected/4a9ce1d9-cd12-4bde-b4af-171e9e9b8e65-kube-api-access-j5d92\") pod \"maas-default-gateway-openshift-default-56654dcf7-g9cv6\" (UID: \"4a9ce1d9-cd12-4bde-b4af-171e9e9b8e65\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-g9cv6"
Jul 15 21:37:42.805711 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:37:42.805572    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4a9ce1d9-cd12-4bde-b4af-171e9e9b8e65-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-g9cv6\" (UID: \"4a9ce1d9-cd12-4bde-b4af-171e9e9b8e65\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-g9cv6"
Jul 15 21:37:42.805711 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:37:42.805612    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4a9ce1d9-cd12-4bde-b4af-171e9e9b8e65-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-g9cv6\" (UID: \"4a9ce1d9-cd12-4bde-b4af-171e9e9b8e65\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-g9cv6"
Jul 15 21:37:42.906632 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:37:42.906535    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4a9ce1d9-cd12-4bde-b4af-171e9e9b8e65-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-g9cv6\" (UID: \"4a9ce1d9-cd12-4bde-b4af-171e9e9b8e65\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-g9cv6"
Jul 15 21:37:42.906632 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:37:42.906585    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4a9ce1d9-cd12-4bde-b4af-171e9e9b8e65-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-g9cv6\" (UID: \"4a9ce1d9-cd12-4bde-b4af-171e9e9b8e65\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-g9cv6"
Jul 15 21:37:42.906632 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:37:42.906623    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4a9ce1d9-cd12-4bde-b4af-171e9e9b8e65-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-g9cv6\" (UID: \"4a9ce1d9-cd12-4bde-b4af-171e9e9b8e65\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-g9cv6"
Jul 15 21:37:42.906902 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:37:42.906640    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4a9ce1d9-cd12-4bde-b4af-171e9e9b8e65-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-g9cv6\" (UID: \"4a9ce1d9-cd12-4bde-b4af-171e9e9b8e65\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-g9cv6"
Jul 15 21:37:42.906902 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:37:42.906664    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4a9ce1d9-cd12-4bde-b4af-171e9e9b8e65-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-g9cv6\" (UID: \"4a9ce1d9-cd12-4bde-b4af-171e9e9b8e65\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-g9cv6"
Jul 15 21:37:42.906902 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:37:42.906683    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4a9ce1d9-cd12-4bde-b4af-171e9e9b8e65-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-g9cv6\" (UID: \"4a9ce1d9-cd12-4bde-b4af-171e9e9b8e65\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-g9cv6"
Jul 15 21:37:42.906902 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:37:42.906827    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j5d92\" (UniqueName: \"kubernetes.io/projected/4a9ce1d9-cd12-4bde-b4af-171e9e9b8e65-kube-api-access-j5d92\") pod \"maas-default-gateway-openshift-default-56654dcf7-g9cv6\" (UID: \"4a9ce1d9-cd12-4bde-b4af-171e9e9b8e65\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-g9cv6"
Jul 15 21:37:42.906902 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:37:42.906879    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4a9ce1d9-cd12-4bde-b4af-171e9e9b8e65-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-g9cv6\" (UID: \"4a9ce1d9-cd12-4bde-b4af-171e9e9b8e65\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-g9cv6"
Jul 15 21:37:42.907165 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:37:42.906973    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4a9ce1d9-cd12-4bde-b4af-171e9e9b8e65-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-g9cv6\" (UID: \"4a9ce1d9-cd12-4bde-b4af-171e9e9b8e65\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-g9cv6"
Jul 15 21:37:42.907165 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:37:42.907041    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4a9ce1d9-cd12-4bde-b4af-171e9e9b8e65-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-g9cv6\" (UID: \"4a9ce1d9-cd12-4bde-b4af-171e9e9b8e65\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-g9cv6"
Jul 15 21:37:42.907165 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:37:42.907082    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4a9ce1d9-cd12-4bde-b4af-171e9e9b8e65-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-g9cv6\" (UID: \"4a9ce1d9-cd12-4bde-b4af-171e9e9b8e65\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-g9cv6"
Jul 15 21:37:42.907345 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:37:42.907324    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4a9ce1d9-cd12-4bde-b4af-171e9e9b8e65-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-g9cv6\" (UID: \"4a9ce1d9-cd12-4bde-b4af-171e9e9b8e65\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-g9cv6"
Jul 15 21:37:42.907393 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:37:42.907347    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4a9ce1d9-cd12-4bde-b4af-171e9e9b8e65-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-g9cv6\" (UID: \"4a9ce1d9-cd12-4bde-b4af-171e9e9b8e65\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-g9cv6"
Jul 15 21:37:42.907524 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:37:42.907495    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4a9ce1d9-cd12-4bde-b4af-171e9e9b8e65-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-g9cv6\" (UID: \"4a9ce1d9-cd12-4bde-b4af-171e9e9b8e65\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-g9cv6"
Jul 15 21:37:42.909195 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:37:42.909170    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4a9ce1d9-cd12-4bde-b4af-171e9e9b8e65-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-g9cv6\" (UID: \"4a9ce1d9-cd12-4bde-b4af-171e9e9b8e65\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-g9cv6"
Jul 15 21:37:42.909274 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:37:42.909259    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4a9ce1d9-cd12-4bde-b4af-171e9e9b8e65-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-g9cv6\" (UID: \"4a9ce1d9-cd12-4bde-b4af-171e9e9b8e65\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-g9cv6"
Jul 15 21:37:42.915523 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:37:42.915498    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4a9ce1d9-cd12-4bde-b4af-171e9e9b8e65-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-g9cv6\" (UID: \"4a9ce1d9-cd12-4bde-b4af-171e9e9b8e65\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-g9cv6"
Jul 15 21:37:42.915626 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:37:42.915562    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j5d92\" (UniqueName: \"kubernetes.io/projected/4a9ce1d9-cd12-4bde-b4af-171e9e9b8e65-kube-api-access-j5d92\") pod \"maas-default-gateway-openshift-default-56654dcf7-g9cv6\" (UID: \"4a9ce1d9-cd12-4bde-b4af-171e9e9b8e65\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-g9cv6"
Jul 15 21:37:42.962544 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:37:42.962509    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-g9cv6"
Jul 15 21:37:43.093978 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:37:43.093951    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-g9cv6"]
Jul 15 21:37:43.096163 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:37:43.096133    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4a9ce1d9_cd12_4bde_b4af_171e9e9b8e65.slice/crio-5c9ad47bad5631072b5d3d6aab7372bea2f2222cb3291bb1f0829f0c50154208 WatchSource:0}: Error finding container 5c9ad47bad5631072b5d3d6aab7372bea2f2222cb3291bb1f0829f0c50154208: Status 404 returned error can't find the container with id 5c9ad47bad5631072b5d3d6aab7372bea2f2222cb3291bb1f0829f0c50154208
Jul 15 21:37:43.339892 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:37:43.339857    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-g9cv6" event={"ID":"4a9ce1d9-cd12-4bde-b4af-171e9e9b8e65","Type":"ContainerStarted","Data":"5c9ad47bad5631072b5d3d6aab7372bea2f2222cb3291bb1f0829f0c50154208"}
Jul 15 21:37:45.635822 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:37:45.635775    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 15 21:37:45.636246 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:37:45.635880    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 15 21:37:45.636246 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:37:45.635981    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 15 21:37:46.357387 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:37:46.357346    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-g9cv6" event={"ID":"4a9ce1d9-cd12-4bde-b4af-171e9e9b8e65","Type":"ContainerStarted","Data":"3593a4a3c9b72724e079bbe9c0e67cb41ef2b5dc6098863df3ca34ce9041c542"}
Jul 15 21:37:46.375831 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:37:46.375779    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-g9cv6" podStartSLOduration=1.83841168 podStartE2EDuration="4.375764231s" totalImagesPullingTime="2.537352551s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:37:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:37:46.374573079 +0000 UTC m=+516.068500630" watchObservedRunningTime="2026-07-15 21:37:46.375764231 +0000 UTC m=+516.069691783"
Jul 15 21:37:46.963364 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:37:46.963322    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-g9cv6"
Jul 15 21:37:46.968932 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:37:46.968904    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-g9cv6"
Jul 15 21:37:47.362314 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:37:47.362280    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-g9cv6"
Jul 15 21:37:47.363186 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:37:47.363164    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-g9cv6"
Jul 15 21:37:53.792020 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:37:53.791980    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-tkz55"]
Jul 15 21:37:53.795558 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:37:53.795535    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-tkz55"
Jul 15 21:37:53.799483 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:37:53.799465    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-89klg\""
Jul 15 21:37:53.799577 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:37:53.799468    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 15 21:37:53.805041 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:37:53.805003    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-tkz55"]
Jul 15 21:37:53.889078 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:37:53.889037    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-tkz55"]
Jul 15 21:37:53.906626 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:37:53.906595    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/2a604a14-f11f-43cd-bbf0-f6c8a7b55c2f-config-file\") pod \"limitador-limitador-64c94fd64f-tkz55\" (UID: \"2a604a14-f11f-43cd-bbf0-f6c8a7b55c2f\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-tkz55"
Jul 15 21:37:53.906792 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:37:53.906642    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-djcbj\" (UniqueName: \"kubernetes.io/projected/2a604a14-f11f-43cd-bbf0-f6c8a7b55c2f-kube-api-access-djcbj\") pod \"limitador-limitador-64c94fd64f-tkz55\" (UID: \"2a604a14-f11f-43cd-bbf0-f6c8a7b55c2f\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-tkz55"
Jul 15 21:37:54.007842 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:37:54.007806    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/2a604a14-f11f-43cd-bbf0-f6c8a7b55c2f-config-file\") pod \"limitador-limitador-64c94fd64f-tkz55\" (UID: \"2a604a14-f11f-43cd-bbf0-f6c8a7b55c2f\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-tkz55"
Jul 15 21:37:54.007842 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:37:54.007847    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-djcbj\" (UniqueName: \"kubernetes.io/projected/2a604a14-f11f-43cd-bbf0-f6c8a7b55c2f-kube-api-access-djcbj\") pod \"limitador-limitador-64c94fd64f-tkz55\" (UID: \"2a604a14-f11f-43cd-bbf0-f6c8a7b55c2f\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-tkz55"
Jul 15 21:37:54.008462 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:37:54.008441    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/2a604a14-f11f-43cd-bbf0-f6c8a7b55c2f-config-file\") pod \"limitador-limitador-64c94fd64f-tkz55\" (UID: \"2a604a14-f11f-43cd-bbf0-f6c8a7b55c2f\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-tkz55"
Jul 15 21:37:54.018778 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:37:54.018744    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-djcbj\" (UniqueName: \"kubernetes.io/projected/2a604a14-f11f-43cd-bbf0-f6c8a7b55c2f-kube-api-access-djcbj\") pod \"limitador-limitador-64c94fd64f-tkz55\" (UID: \"2a604a14-f11f-43cd-bbf0-f6c8a7b55c2f\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-tkz55"
Jul 15 21:37:54.106641 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:37:54.106608    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-tkz55"
Jul 15 21:37:54.244060 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:37:54.243894    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-tkz55"]
Jul 15 21:37:54.246800 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:37:54.246771    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2a604a14_f11f_43cd_bbf0_f6c8a7b55c2f.slice/crio-2f9c3ef06fa04a51e388fe5ab1e4a39522810ee59f3d3273acde5cbd76073047 WatchSource:0}: Error finding container 2f9c3ef06fa04a51e388fe5ab1e4a39522810ee59f3d3273acde5cbd76073047: Status 404 returned error can't find the container with id 2f9c3ef06fa04a51e388fe5ab1e4a39522810ee59f3d3273acde5cbd76073047
Jul 15 21:37:54.397974 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:37:54.397856    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-tkz55" event={"ID":"2a604a14-f11f-43cd-bbf0-f6c8a7b55c2f","Type":"ContainerStarted","Data":"2f9c3ef06fa04a51e388fe5ab1e4a39522810ee59f3d3273acde5cbd76073047"}
Jul 15 21:37:57.421471 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:37:57.421429    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-tkz55" event={"ID":"2a604a14-f11f-43cd-bbf0-f6c8a7b55c2f","Type":"ContainerStarted","Data":"8c50711e7153ac6b193f571574bf8ab2f877f1a4b517b53937b4dd3edd219c8b"}
Jul 15 21:37:57.421879 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:37:57.421562    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-tkz55"
Jul 15 21:37:57.437040 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:37:57.436994    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-tkz55" podStartSLOduration=1.476735297 podStartE2EDuration="4.43698075s" totalImagesPullingTime="2.960245453s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:37:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:37:57.435461165 +0000 UTC m=+527.129388715" watchObservedRunningTime="2026-07-15 21:37:57.43698075 +0000 UTC m=+527.130908301"
Jul 15 21:38:08.428392 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:38:08.428319    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-tkz55"
Jul 15 21:38:12.123399 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:38:12.123354    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-tkz55"]
Jul 15 21:38:12.123825 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:38:12.123579    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-tkz55" podUID="2a604a14-f11f-43cd-bbf0-f6c8a7b55c2f" containerName="limitador" containerID="cri-o://8c50711e7153ac6b193f571574bf8ab2f877f1a4b517b53937b4dd3edd219c8b" gracePeriod=30
Jul 15 21:38:12.668856 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:38:12.668830    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-tkz55"
Jul 15 21:38:12.768438 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:38:12.768348    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-djcbj\" (UniqueName: \"kubernetes.io/projected/2a604a14-f11f-43cd-bbf0-f6c8a7b55c2f-kube-api-access-djcbj\") pod \"2a604a14-f11f-43cd-bbf0-f6c8a7b55c2f\" (UID: \"2a604a14-f11f-43cd-bbf0-f6c8a7b55c2f\") "
Jul 15 21:38:12.768438 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:38:12.768431    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/2a604a14-f11f-43cd-bbf0-f6c8a7b55c2f-config-file\") pod \"2a604a14-f11f-43cd-bbf0-f6c8a7b55c2f\" (UID: \"2a604a14-f11f-43cd-bbf0-f6c8a7b55c2f\") "
Jul 15 21:38:12.768777 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:38:12.768754    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2a604a14-f11f-43cd-bbf0-f6c8a7b55c2f-config-file" (OuterVolumeSpecName: "config-file") pod "2a604a14-f11f-43cd-bbf0-f6c8a7b55c2f" (UID: "2a604a14-f11f-43cd-bbf0-f6c8a7b55c2f"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 21:38:12.770427 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:38:12.770406    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2a604a14-f11f-43cd-bbf0-f6c8a7b55c2f-kube-api-access-djcbj" (OuterVolumeSpecName: "kube-api-access-djcbj") pod "2a604a14-f11f-43cd-bbf0-f6c8a7b55c2f" (UID: "2a604a14-f11f-43cd-bbf0-f6c8a7b55c2f"). InnerVolumeSpecName "kube-api-access-djcbj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 21:38:12.869032 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:38:12.868992    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-djcbj\" (UniqueName: \"kubernetes.io/projected/2a604a14-f11f-43cd-bbf0-f6c8a7b55c2f-kube-api-access-djcbj\") on node \"ip-10-0-130-217.ec2.internal\" DevicePath \"\""
Jul 15 21:38:12.869032 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:38:12.869026    2563 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/2a604a14-f11f-43cd-bbf0-f6c8a7b55c2f-config-file\") on node \"ip-10-0-130-217.ec2.internal\" DevicePath \"\""
Jul 15 21:38:13.499334 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:38:13.499302    2563 generic.go:356] "Generic (PLEG): container finished" podID="2a604a14-f11f-43cd-bbf0-f6c8a7b55c2f" containerID="8c50711e7153ac6b193f571574bf8ab2f877f1a4b517b53937b4dd3edd219c8b" exitCode=0
Jul 15 21:38:13.499754 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:38:13.499358    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-tkz55" event={"ID":"2a604a14-f11f-43cd-bbf0-f6c8a7b55c2f","Type":"ContainerDied","Data":"8c50711e7153ac6b193f571574bf8ab2f877f1a4b517b53937b4dd3edd219c8b"}
Jul 15 21:38:13.499754 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:38:13.499411    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-tkz55" event={"ID":"2a604a14-f11f-43cd-bbf0-f6c8a7b55c2f","Type":"ContainerDied","Data":"2f9c3ef06fa04a51e388fe5ab1e4a39522810ee59f3d3273acde5cbd76073047"}
Jul 15 21:38:13.499754 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:38:13.499435    2563 scope.go:117] "RemoveContainer" containerID="8c50711e7153ac6b193f571574bf8ab2f877f1a4b517b53937b4dd3edd219c8b"
Jul 15 21:38:13.499754 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:38:13.499361    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-tkz55"
Jul 15 21:38:13.507883 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:38:13.507861    2563 scope.go:117] "RemoveContainer" containerID="8c50711e7153ac6b193f571574bf8ab2f877f1a4b517b53937b4dd3edd219c8b"
Jul 15 21:38:13.508132 ip-10-0-130-217 kubenswrapper[2563]: E0715 21:38:13.508114    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8c50711e7153ac6b193f571574bf8ab2f877f1a4b517b53937b4dd3edd219c8b\": container with ID starting with 8c50711e7153ac6b193f571574bf8ab2f877f1a4b517b53937b4dd3edd219c8b not found: ID does not exist" containerID="8c50711e7153ac6b193f571574bf8ab2f877f1a4b517b53937b4dd3edd219c8b"
Jul 15 21:38:13.508181 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:38:13.508139    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8c50711e7153ac6b193f571574bf8ab2f877f1a4b517b53937b4dd3edd219c8b"} err="failed to get container status \"8c50711e7153ac6b193f571574bf8ab2f877f1a4b517b53937b4dd3edd219c8b\": rpc error: code = NotFound desc = could not find container \"8c50711e7153ac6b193f571574bf8ab2f877f1a4b517b53937b4dd3edd219c8b\": container with ID starting with 8c50711e7153ac6b193f571574bf8ab2f877f1a4b517b53937b4dd3edd219c8b not found: ID does not exist"
Jul 15 21:38:13.516544 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:38:13.516518    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-tkz55"]
Jul 15 21:38:13.520305 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:38:13.520278    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-tkz55"]
Jul 15 21:38:14.214417 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:38:14.214385    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-9cls9"]
Jul 15 21:38:14.214719 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:38:14.214707    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2a604a14-f11f-43cd-bbf0-f6c8a7b55c2f" containerName="limitador"
Jul 15 21:38:14.214759 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:38:14.214720    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="2a604a14-f11f-43cd-bbf0-f6c8a7b55c2f" containerName="limitador"
Jul 15 21:38:14.214799 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:38:14.214790    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="2a604a14-f11f-43cd-bbf0-f6c8a7b55c2f" containerName="limitador"
Jul 15 21:38:14.219175 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:38:14.219153    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-9cls9"
Jul 15 21:38:14.223663 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:38:14.223638    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\""
Jul 15 21:38:14.223773 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:38:14.223673    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 15 21:38:14.223773 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:38:14.223722    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 15 21:38:14.223998 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:38:14.223981    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-tlht5\""
Jul 15 21:38:14.228969 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:38:14.228928    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-9cls9"]
Jul 15 21:38:14.282123 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:38:14.282091    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sx5sr\" (UniqueName: \"kubernetes.io/projected/18f9dd0c-2e90-4783-9f3f-fbd2ea324296-kube-api-access-sx5sr\") pod \"postgres-69fb4594cf-9cls9\" (UID: \"18f9dd0c-2e90-4783-9f3f-fbd2ea324296\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-9cls9"
Jul 15 21:38:14.282123 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:38:14.282125    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/18f9dd0c-2e90-4783-9f3f-fbd2ea324296-data\") pod \"postgres-69fb4594cf-9cls9\" (UID: \"18f9dd0c-2e90-4783-9f3f-fbd2ea324296\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-9cls9"
Jul 15 21:38:14.383402 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:38:14.383354    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sx5sr\" (UniqueName: \"kubernetes.io/projected/18f9dd0c-2e90-4783-9f3f-fbd2ea324296-kube-api-access-sx5sr\") pod \"postgres-69fb4594cf-9cls9\" (UID: \"18f9dd0c-2e90-4783-9f3f-fbd2ea324296\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-9cls9"
Jul 15 21:38:14.383597 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:38:14.383410    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/18f9dd0c-2e90-4783-9f3f-fbd2ea324296-data\") pod \"postgres-69fb4594cf-9cls9\" (UID: \"18f9dd0c-2e90-4783-9f3f-fbd2ea324296\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-9cls9"
Jul 15 21:38:14.383855 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:38:14.383832    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/18f9dd0c-2e90-4783-9f3f-fbd2ea324296-data\") pod \"postgres-69fb4594cf-9cls9\" (UID: \"18f9dd0c-2e90-4783-9f3f-fbd2ea324296\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-9cls9"
Jul 15 21:38:14.394047 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:38:14.394015    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sx5sr\" (UniqueName: \"kubernetes.io/projected/18f9dd0c-2e90-4783-9f3f-fbd2ea324296-kube-api-access-sx5sr\") pod \"postgres-69fb4594cf-9cls9\" (UID: \"18f9dd0c-2e90-4783-9f3f-fbd2ea324296\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-9cls9"
Jul 15 21:38:14.530530 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:38:14.530442    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-9cls9"
Jul 15 21:38:14.660706 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:38:14.660624    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-9cls9"]
Jul 15 21:38:14.662789 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:38:14.662761    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod18f9dd0c_2e90_4783_9f3f_fbd2ea324296.slice/crio-697bb73165504c45a6b7dc1f3a0b2eff63e3f019777f88dd31d5164519b551fa WatchSource:0}: Error finding container 697bb73165504c45a6b7dc1f3a0b2eff63e3f019777f88dd31d5164519b551fa: Status 404 returned error can't find the container with id 697bb73165504c45a6b7dc1f3a0b2eff63e3f019777f88dd31d5164519b551fa
Jul 15 21:38:14.988113 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:38:14.988073    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2a604a14-f11f-43cd-bbf0-f6c8a7b55c2f" path="/var/lib/kubelet/pods/2a604a14-f11f-43cd-bbf0-f6c8a7b55c2f/volumes"
Jul 15 21:38:15.527629 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:38:15.527550    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-9cls9" event={"ID":"18f9dd0c-2e90-4783-9f3f-fbd2ea324296","Type":"ContainerStarted","Data":"697bb73165504c45a6b7dc1f3a0b2eff63e3f019777f88dd31d5164519b551fa"}
Jul 15 21:38:20.554352 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:38:20.554314    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-9cls9" event={"ID":"18f9dd0c-2e90-4783-9f3f-fbd2ea324296","Type":"ContainerStarted","Data":"253825af596c9589308255c808d2d131bb60c80a0d6e6fbaef9c4f72e499618a"}
Jul 15 21:38:20.554832 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:38:20.554419    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-9cls9"
Jul 15 21:38:20.569235 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:38:20.569179    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-9cls9" podStartSLOduration=1.672140954 podStartE2EDuration="6.569162791s" totalImagesPullingTime="4.897021837s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:38:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:38:20.567139987 +0000 UTC m=+550.261067539" watchObservedRunningTime="2026-07-15 21:38:20.569162791 +0000 UTC m=+550.263090386"
Jul 15 21:38:26.588630 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:38:26.588601    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-9cls9"
Jul 15 21:38:27.130666 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:38:27.130630    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-n5pr8"]
Jul 15 21:38:27.135971 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:38:27.135926    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-n5pr8"
Jul 15 21:38:27.138084 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:38:27.138064    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-z8cx5\""
Jul 15 21:38:27.141158 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:38:27.141133    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-n5pr8"]
Jul 15 21:38:27.194507 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:38:27.194462    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mtlnp\" (UniqueName: \"kubernetes.io/projected/08747d77-61fa-4c5f-89f2-b8550411e2f2-kube-api-access-mtlnp\") pod \"authorino-5d4b67c446-n5pr8\" (UID: \"08747d77-61fa-4c5f-89f2-b8550411e2f2\") " pod="kuadrant-system/authorino-5d4b67c446-n5pr8"
Jul 15 21:38:27.295737 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:38:27.295701    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mtlnp\" (UniqueName: \"kubernetes.io/projected/08747d77-61fa-4c5f-89f2-b8550411e2f2-kube-api-access-mtlnp\") pod \"authorino-5d4b67c446-n5pr8\" (UID: \"08747d77-61fa-4c5f-89f2-b8550411e2f2\") " pod="kuadrant-system/authorino-5d4b67c446-n5pr8"
Jul 15 21:38:27.296576 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:38:27.296556    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-n5pr8"]
Jul 15 21:38:27.296791 ip-10-0-130-217 kubenswrapper[2563]: E0715 21:38:27.296772    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-mtlnp], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-5d4b67c446-n5pr8" podUID="08747d77-61fa-4c5f-89f2-b8550411e2f2"
Jul 15 21:38:27.307793 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:38:27.307760    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mtlnp\" (UniqueName: \"kubernetes.io/projected/08747d77-61fa-4c5f-89f2-b8550411e2f2-kube-api-access-mtlnp\") pod \"authorino-5d4b67c446-n5pr8\" (UID: \"08747d77-61fa-4c5f-89f2-b8550411e2f2\") " pod="kuadrant-system/authorino-5d4b67c446-n5pr8"
Jul 15 21:38:27.586663 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:38:27.586630    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-n5pr8"
Jul 15 21:38:27.594227 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:38:27.594200    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-n5pr8"
Jul 15 21:38:27.699669 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:38:27.699635    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mtlnp\" (UniqueName: \"kubernetes.io/projected/08747d77-61fa-4c5f-89f2-b8550411e2f2-kube-api-access-mtlnp\") pod \"08747d77-61fa-4c5f-89f2-b8550411e2f2\" (UID: \"08747d77-61fa-4c5f-89f2-b8550411e2f2\") "
Jul 15 21:38:27.701754 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:38:27.701726    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/08747d77-61fa-4c5f-89f2-b8550411e2f2-kube-api-access-mtlnp" (OuterVolumeSpecName: "kube-api-access-mtlnp") pod "08747d77-61fa-4c5f-89f2-b8550411e2f2" (UID: "08747d77-61fa-4c5f-89f2-b8550411e2f2"). InnerVolumeSpecName "kube-api-access-mtlnp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 21:38:27.800503 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:38:27.800467    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mtlnp\" (UniqueName: \"kubernetes.io/projected/08747d77-61fa-4c5f-89f2-b8550411e2f2-kube-api-access-mtlnp\") on node \"ip-10-0-130-217.ec2.internal\" DevicePath \"\""
Jul 15 21:38:28.590802 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:38:28.590771    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-n5pr8"
Jul 15 21:38:28.617180 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:38:28.617143    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-n5pr8"]
Jul 15 21:38:28.621176 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:38:28.621149    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-n5pr8"]
Jul 15 21:38:28.988250 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:38:28.988170    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="08747d77-61fa-4c5f-89f2-b8550411e2f2" path="/var/lib/kubelet/pods/08747d77-61fa-4c5f-89f2-b8550411e2f2/volumes"
Jul 15 21:38:32.937221 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:38:32.937181    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-5b8fdfb54d-qnvvh"]
Jul 15 21:38:32.946023 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:38:32.945997    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5b8fdfb54d-qnvvh"
Jul 15 21:38:32.948619 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:38:32.948589    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-vvd5w\""
Jul 15 21:38:32.948862 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:38:32.948845    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 15 21:38:32.949097 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:38:32.949065    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 15 21:38:32.950103 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:38:32.950082    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5b8fdfb54d-qnvvh"]
Jul 15 21:38:33.049177 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:38:33.049146    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8671edde-abe9-4311-b8b9-1b8055c3bc7e-webhook-cert\") pod \"maas-controller-5b8fdfb54d-qnvvh\" (UID: \"8671edde-abe9-4311-b8b9-1b8055c3bc7e\") " pod="opendatahub/maas-controller-5b8fdfb54d-qnvvh"
Jul 15 21:38:33.049335 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:38:33.049277    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wgr7t\" (UniqueName: \"kubernetes.io/projected/8671edde-abe9-4311-b8b9-1b8055c3bc7e-kube-api-access-wgr7t\") pod \"maas-controller-5b8fdfb54d-qnvvh\" (UID: \"8671edde-abe9-4311-b8b9-1b8055c3bc7e\") " pod="opendatahub/maas-controller-5b8fdfb54d-qnvvh"
Jul 15 21:38:33.095137 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:38:33.095100    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-75b45fb47d-2l8sf"]
Jul 15 21:38:33.098999 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:38:33.098981    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-75b45fb47d-2l8sf"
Jul 15 21:38:33.106975 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:38:33.106952    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-75b45fb47d-2l8sf"]
Jul 15 21:38:33.150483 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:38:33.150453    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wgr7t\" (UniqueName: \"kubernetes.io/projected/8671edde-abe9-4311-b8b9-1b8055c3bc7e-kube-api-access-wgr7t\") pod \"maas-controller-5b8fdfb54d-qnvvh\" (UID: \"8671edde-abe9-4311-b8b9-1b8055c3bc7e\") " pod="opendatahub/maas-controller-5b8fdfb54d-qnvvh"
Jul 15 21:38:33.150638 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:38:33.150495    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/dd87bb29-413d-46ac-8a7b-9ce4c408a7a6-webhook-cert\") pod \"maas-controller-75b45fb47d-2l8sf\" (UID: \"dd87bb29-413d-46ac-8a7b-9ce4c408a7a6\") " pod="opendatahub/maas-controller-75b45fb47d-2l8sf"
Jul 15 21:38:33.150638 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:38:33.150520    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8671edde-abe9-4311-b8b9-1b8055c3bc7e-webhook-cert\") pod \"maas-controller-5b8fdfb54d-qnvvh\" (UID: \"8671edde-abe9-4311-b8b9-1b8055c3bc7e\") " pod="opendatahub/maas-controller-5b8fdfb54d-qnvvh"
Jul 15 21:38:33.150638 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:38:33.150567    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2lwtw\" (UniqueName: \"kubernetes.io/projected/dd87bb29-413d-46ac-8a7b-9ce4c408a7a6-kube-api-access-2lwtw\") pod \"maas-controller-75b45fb47d-2l8sf\" (UID: \"dd87bb29-413d-46ac-8a7b-9ce4c408a7a6\") " pod="opendatahub/maas-controller-75b45fb47d-2l8sf"
Jul 15 21:38:33.153018 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:38:33.152994    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8671edde-abe9-4311-b8b9-1b8055c3bc7e-webhook-cert\") pod \"maas-controller-5b8fdfb54d-qnvvh\" (UID: \"8671edde-abe9-4311-b8b9-1b8055c3bc7e\") " pod="opendatahub/maas-controller-5b8fdfb54d-qnvvh"
Jul 15 21:38:33.157670 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:38:33.157646    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wgr7t\" (UniqueName: \"kubernetes.io/projected/8671edde-abe9-4311-b8b9-1b8055c3bc7e-kube-api-access-wgr7t\") pod \"maas-controller-5b8fdfb54d-qnvvh\" (UID: \"8671edde-abe9-4311-b8b9-1b8055c3bc7e\") " pod="opendatahub/maas-controller-5b8fdfb54d-qnvvh"
Jul 15 21:38:33.251333 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:38:33.251251    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/dd87bb29-413d-46ac-8a7b-9ce4c408a7a6-webhook-cert\") pod \"maas-controller-75b45fb47d-2l8sf\" (UID: \"dd87bb29-413d-46ac-8a7b-9ce4c408a7a6\") " pod="opendatahub/maas-controller-75b45fb47d-2l8sf"
Jul 15 21:38:33.251333 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:38:33.251311    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2lwtw\" (UniqueName: \"kubernetes.io/projected/dd87bb29-413d-46ac-8a7b-9ce4c408a7a6-kube-api-access-2lwtw\") pod \"maas-controller-75b45fb47d-2l8sf\" (UID: \"dd87bb29-413d-46ac-8a7b-9ce4c408a7a6\") " pod="opendatahub/maas-controller-75b45fb47d-2l8sf"
Jul 15 21:38:33.253784 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:38:33.253756    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/dd87bb29-413d-46ac-8a7b-9ce4c408a7a6-webhook-cert\") pod \"maas-controller-75b45fb47d-2l8sf\" (UID: \"dd87bb29-413d-46ac-8a7b-9ce4c408a7a6\") " pod="opendatahub/maas-controller-75b45fb47d-2l8sf"
Jul 15 21:38:33.257794 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:38:33.257768    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5b8fdfb54d-qnvvh"
Jul 15 21:38:33.258604 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:38:33.258572    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2lwtw\" (UniqueName: \"kubernetes.io/projected/dd87bb29-413d-46ac-8a7b-9ce4c408a7a6-kube-api-access-2lwtw\") pod \"maas-controller-75b45fb47d-2l8sf\" (UID: \"dd87bb29-413d-46ac-8a7b-9ce4c408a7a6\") " pod="opendatahub/maas-controller-75b45fb47d-2l8sf"
Jul 15 21:38:33.389748 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:38:33.389720    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5b8fdfb54d-qnvvh"]
Jul 15 21:38:33.391420 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:38:33.391389    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8671edde_abe9_4311_b8b9_1b8055c3bc7e.slice/crio-caf11435a9f901b739fef6381433836e2e1e352a7294967c7d8c2906226049c2 WatchSource:0}: Error finding container caf11435a9f901b739fef6381433836e2e1e352a7294967c7d8c2906226049c2: Status 404 returned error can't find the container with id caf11435a9f901b739fef6381433836e2e1e352a7294967c7d8c2906226049c2
Jul 15 21:38:33.410286 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:38:33.410257    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-75b45fb47d-2l8sf"
Jul 15 21:38:33.545696 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:38:33.545663    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-75b45fb47d-2l8sf"]
Jul 15 21:38:33.548019 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:38:33.547990    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddd87bb29_413d_46ac_8a7b_9ce4c408a7a6.slice/crio-076e6891236ff5942f3051dcba25b6713db7f3f0d57de30bc2bc015475ec30cf WatchSource:0}: Error finding container 076e6891236ff5942f3051dcba25b6713db7f3f0d57de30bc2bc015475ec30cf: Status 404 returned error can't find the container with id 076e6891236ff5942f3051dcba25b6713db7f3f0d57de30bc2bc015475ec30cf
Jul 15 21:38:33.615904 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:38:33.615872    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5b8fdfb54d-qnvvh" event={"ID":"8671edde-abe9-4311-b8b9-1b8055c3bc7e","Type":"ContainerStarted","Data":"caf11435a9f901b739fef6381433836e2e1e352a7294967c7d8c2906226049c2"}
Jul 15 21:38:33.617000 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:38:33.616972    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-75b45fb47d-2l8sf" event={"ID":"dd87bb29-413d-46ac-8a7b-9ce4c408a7a6","Type":"ContainerStarted","Data":"076e6891236ff5942f3051dcba25b6713db7f3f0d57de30bc2bc015475ec30cf"}
Jul 15 21:38:36.638028 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:38:36.637975    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5b8fdfb54d-qnvvh" event={"ID":"8671edde-abe9-4311-b8b9-1b8055c3bc7e","Type":"ContainerStarted","Data":"8e7989156e155f99fa1b5a94e7d500dba6feff0a3af3e8db228691186d6094ea"}
Jul 15 21:38:36.638452 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:38:36.638054    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-5b8fdfb54d-qnvvh"
Jul 15 21:38:36.639398 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:38:36.639360    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-75b45fb47d-2l8sf" event={"ID":"dd87bb29-413d-46ac-8a7b-9ce4c408a7a6","Type":"ContainerStarted","Data":"8a3260e851ddb82b703ccc0370a7f985b4fbf8cd0f5c573fdd95af1a02bbfeb1"}
Jul 15 21:38:36.639535 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:38:36.639502    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-75b45fb47d-2l8sf"
Jul 15 21:38:36.654448 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:38:36.654395    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-5b8fdfb54d-qnvvh" podStartSLOduration=1.8561437650000001 podStartE2EDuration="4.654378434s" totalImagesPullingTime="2.798234669s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:38:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:38:36.653776618 +0000 UTC m=+566.347704168" watchObservedRunningTime="2026-07-15 21:38:36.654378434 +0000 UTC m=+566.348305986"
Jul 15 21:38:36.671077 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:38:36.671028    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-75b45fb47d-2l8sf" podStartSLOduration=1.018835143 podStartE2EDuration="3.67101406s" totalImagesPullingTime="2.652178917s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:38:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:38:36.669707705 +0000 UTC m=+566.363635258" watchObservedRunningTime="2026-07-15 21:38:36.67101406 +0000 UTC m=+566.364941628"
Jul 15 21:38:47.645904 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:38:47.645874    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-5b8fdfb54d-qnvvh"
Jul 15 21:38:47.646318 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:38:47.645963    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-75b45fb47d-2l8sf"
Jul 15 21:38:47.705332 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:38:47.705302    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5b8fdfb54d-qnvvh"]
Jul 15 21:38:47.705553 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:38:47.705510    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-5b8fdfb54d-qnvvh" podUID="8671edde-abe9-4311-b8b9-1b8055c3bc7e" containerName="manager" containerID="cri-o://8e7989156e155f99fa1b5a94e7d500dba6feff0a3af3e8db228691186d6094ea" gracePeriod=30
Jul 15 21:38:47.952339 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:38:47.952307    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5b8fdfb54d-qnvvh"
Jul 15 21:38:48.087862 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:38:48.087829    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8671edde-abe9-4311-b8b9-1b8055c3bc7e-webhook-cert\") pod \"8671edde-abe9-4311-b8b9-1b8055c3bc7e\" (UID: \"8671edde-abe9-4311-b8b9-1b8055c3bc7e\") "
Jul 15 21:38:48.088048 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:38:48.087931    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wgr7t\" (UniqueName: \"kubernetes.io/projected/8671edde-abe9-4311-b8b9-1b8055c3bc7e-kube-api-access-wgr7t\") pod \"8671edde-abe9-4311-b8b9-1b8055c3bc7e\" (UID: \"8671edde-abe9-4311-b8b9-1b8055c3bc7e\") "
Jul 15 21:38:48.090098 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:38:48.090071    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8671edde-abe9-4311-b8b9-1b8055c3bc7e-kube-api-access-wgr7t" (OuterVolumeSpecName: "kube-api-access-wgr7t") pod "8671edde-abe9-4311-b8b9-1b8055c3bc7e" (UID: "8671edde-abe9-4311-b8b9-1b8055c3bc7e"). InnerVolumeSpecName "kube-api-access-wgr7t". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 21:38:48.090098 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:38:48.090070    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8671edde-abe9-4311-b8b9-1b8055c3bc7e-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "8671edde-abe9-4311-b8b9-1b8055c3bc7e" (UID: "8671edde-abe9-4311-b8b9-1b8055c3bc7e"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 21:38:48.188773 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:38:48.188682    2563 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8671edde-abe9-4311-b8b9-1b8055c3bc7e-webhook-cert\") on node \"ip-10-0-130-217.ec2.internal\" DevicePath \"\""
Jul 15 21:38:48.188773 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:38:48.188720    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wgr7t\" (UniqueName: \"kubernetes.io/projected/8671edde-abe9-4311-b8b9-1b8055c3bc7e-kube-api-access-wgr7t\") on node \"ip-10-0-130-217.ec2.internal\" DevicePath \"\""
Jul 15 21:38:48.696879 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:38:48.696843    2563 generic.go:356] "Generic (PLEG): container finished" podID="8671edde-abe9-4311-b8b9-1b8055c3bc7e" containerID="8e7989156e155f99fa1b5a94e7d500dba6feff0a3af3e8db228691186d6094ea" exitCode=0
Jul 15 21:38:48.697321 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:38:48.696885    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5b8fdfb54d-qnvvh"
Jul 15 21:38:48.697321 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:38:48.696927    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5b8fdfb54d-qnvvh" event={"ID":"8671edde-abe9-4311-b8b9-1b8055c3bc7e","Type":"ContainerDied","Data":"8e7989156e155f99fa1b5a94e7d500dba6feff0a3af3e8db228691186d6094ea"}
Jul 15 21:38:48.697321 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:38:48.696993    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5b8fdfb54d-qnvvh" event={"ID":"8671edde-abe9-4311-b8b9-1b8055c3bc7e","Type":"ContainerDied","Data":"caf11435a9f901b739fef6381433836e2e1e352a7294967c7d8c2906226049c2"}
Jul 15 21:38:48.697321 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:38:48.697016    2563 scope.go:117] "RemoveContainer" containerID="8e7989156e155f99fa1b5a94e7d500dba6feff0a3af3e8db228691186d6094ea"
Jul 15 21:38:48.705608 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:38:48.705591    2563 scope.go:117] "RemoveContainer" containerID="8e7989156e155f99fa1b5a94e7d500dba6feff0a3af3e8db228691186d6094ea"
Jul 15 21:38:48.705867 ip-10-0-130-217 kubenswrapper[2563]: E0715 21:38:48.705850    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8e7989156e155f99fa1b5a94e7d500dba6feff0a3af3e8db228691186d6094ea\": container with ID starting with 8e7989156e155f99fa1b5a94e7d500dba6feff0a3af3e8db228691186d6094ea not found: ID does not exist" containerID="8e7989156e155f99fa1b5a94e7d500dba6feff0a3af3e8db228691186d6094ea"
Jul 15 21:38:48.705910 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:38:48.705876    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8e7989156e155f99fa1b5a94e7d500dba6feff0a3af3e8db228691186d6094ea"} err="failed to get container status \"8e7989156e155f99fa1b5a94e7d500dba6feff0a3af3e8db228691186d6094ea\": rpc error: code = NotFound desc = could not find container \"8e7989156e155f99fa1b5a94e7d500dba6feff0a3af3e8db228691186d6094ea\": container with ID starting with 8e7989156e155f99fa1b5a94e7d500dba6feff0a3af3e8db228691186d6094ea not found: ID does not exist"
Jul 15 21:38:48.717426 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:38:48.717403    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5b8fdfb54d-qnvvh"]
Jul 15 21:38:48.722365 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:38:48.722344    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-5b8fdfb54d-qnvvh"]
Jul 15 21:38:48.988412 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:38:48.988330    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8671edde-abe9-4311-b8b9-1b8055c3bc7e" path="/var/lib/kubelet/pods/8671edde-abe9-4311-b8b9-1b8055c3bc7e/volumes"
Jul 15 21:39:08.601218 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:39:08.601181    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-68b767c759-bk6c9"]
Jul 15 21:39:08.601659 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:39:08.601541    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8671edde-abe9-4311-b8b9-1b8055c3bc7e" containerName="manager"
Jul 15 21:39:08.601659 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:39:08.601553    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="8671edde-abe9-4311-b8b9-1b8055c3bc7e" containerName="manager"
Jul 15 21:39:08.601659 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:39:08.601615    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="8671edde-abe9-4311-b8b9-1b8055c3bc7e" containerName="manager"
Jul 15 21:39:08.604668 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:39:08.604646    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-68b767c759-bk6c9"
Jul 15 21:39:08.606585 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:39:08.606556    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Jul 15 21:39:08.606706 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:39:08.606646    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-728hq\""
Jul 15 21:39:08.614068 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:39:08.614041    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-68b767c759-bk6c9"]
Jul 15 21:39:08.649206 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:39:08.649171    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2p5kp\" (UniqueName: \"kubernetes.io/projected/3bd879ab-a43e-4133-b25c-47df3119c12a-kube-api-access-2p5kp\") pod \"maas-api-68b767c759-bk6c9\" (UID: \"3bd879ab-a43e-4133-b25c-47df3119c12a\") " pod="odh-ai-gateway-infra/maas-api-68b767c759-bk6c9"
Jul 15 21:39:08.649356 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:39:08.649211    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3bd879ab-a43e-4133-b25c-47df3119c12a-openshift-service-ca\") pod \"maas-api-68b767c759-bk6c9\" (UID: \"3bd879ab-a43e-4133-b25c-47df3119c12a\") " pod="odh-ai-gateway-infra/maas-api-68b767c759-bk6c9"
Jul 15 21:39:08.649356 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:39:08.649311    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3bd879ab-a43e-4133-b25c-47df3119c12a-maas-api-tls\") pod \"maas-api-68b767c759-bk6c9\" (UID: \"3bd879ab-a43e-4133-b25c-47df3119c12a\") " pod="odh-ai-gateway-infra/maas-api-68b767c759-bk6c9"
Jul 15 21:39:08.750193 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:39:08.750161    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3bd879ab-a43e-4133-b25c-47df3119c12a-maas-api-tls\") pod \"maas-api-68b767c759-bk6c9\" (UID: \"3bd879ab-a43e-4133-b25c-47df3119c12a\") " pod="odh-ai-gateway-infra/maas-api-68b767c759-bk6c9"
Jul 15 21:39:08.750357 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:39:08.750211    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2p5kp\" (UniqueName: \"kubernetes.io/projected/3bd879ab-a43e-4133-b25c-47df3119c12a-kube-api-access-2p5kp\") pod \"maas-api-68b767c759-bk6c9\" (UID: \"3bd879ab-a43e-4133-b25c-47df3119c12a\") " pod="odh-ai-gateway-infra/maas-api-68b767c759-bk6c9"
Jul 15 21:39:08.750357 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:39:08.750235    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3bd879ab-a43e-4133-b25c-47df3119c12a-openshift-service-ca\") pod \"maas-api-68b767c759-bk6c9\" (UID: \"3bd879ab-a43e-4133-b25c-47df3119c12a\") " pod="odh-ai-gateway-infra/maas-api-68b767c759-bk6c9"
Jul 15 21:39:08.750357 ip-10-0-130-217 kubenswrapper[2563]: E0715 21:39:08.750312    2563 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-serving-cert: secret "maas-api-serving-cert" not found
Jul 15 21:39:08.750462 ip-10-0-130-217 kubenswrapper[2563]: E0715 21:39:08.750385    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3bd879ab-a43e-4133-b25c-47df3119c12a-maas-api-tls podName:3bd879ab-a43e-4133-b25c-47df3119c12a nodeName:}" failed. No retries permitted until 2026-07-15 21:39:09.25036942 +0000 UTC m=+598.944296954 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/3bd879ab-a43e-4133-b25c-47df3119c12a-maas-api-tls") pod "maas-api-68b767c759-bk6c9" (UID: "3bd879ab-a43e-4133-b25c-47df3119c12a") : secret "maas-api-serving-cert" not found
Jul 15 21:39:08.750822 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:39:08.750805    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3bd879ab-a43e-4133-b25c-47df3119c12a-openshift-service-ca\") pod \"maas-api-68b767c759-bk6c9\" (UID: \"3bd879ab-a43e-4133-b25c-47df3119c12a\") " pod="odh-ai-gateway-infra/maas-api-68b767c759-bk6c9"
Jul 15 21:39:08.764808 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:39:08.764785    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2p5kp\" (UniqueName: \"kubernetes.io/projected/3bd879ab-a43e-4133-b25c-47df3119c12a-kube-api-access-2p5kp\") pod \"maas-api-68b767c759-bk6c9\" (UID: \"3bd879ab-a43e-4133-b25c-47df3119c12a\") " pod="odh-ai-gateway-infra/maas-api-68b767c759-bk6c9"
Jul 15 21:39:09.105480 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:39:09.105434    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-74584bb9f8-jsfdn"]
Jul 15 21:39:09.112577 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:39:09.112537    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-74584bb9f8-jsfdn"
Jul 15 21:39:09.114514 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:39:09.114487    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Jul 15 21:39:09.118748 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:39:09.118720    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-74584bb9f8-jsfdn"]
Jul 15 21:39:09.142906 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:39:09.142875    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-f9b8d9b9b-9btmw"]
Jul 15 21:39:09.146518 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:39:09.146406    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-f9b8d9b9b-9btmw"
Jul 15 21:39:09.149104 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:39:09.149022    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-dgf4k\""
Jul 15 21:39:09.154666 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:39:09.154505    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dzhbv\" (UniqueName: \"kubernetes.io/projected/2ce2c6c0-0890-4e5d-975b-fac0b8554085-kube-api-access-dzhbv\") pod \"payload-pre-processing-74584bb9f8-jsfdn\" (UID: \"2ce2c6c0-0890-4e5d-975b-fac0b8554085\") " pod="openshift-ingress/payload-pre-processing-74584bb9f8-jsfdn"
Jul 15 21:39:09.154929 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:39:09.154753    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2ce2c6c0-0890-4e5d-975b-fac0b8554085-plugins-config-volume\") pod \"payload-pre-processing-74584bb9f8-jsfdn\" (UID: \"2ce2c6c0-0890-4e5d-975b-fac0b8554085\") " pod="openshift-ingress/payload-pre-processing-74584bb9f8-jsfdn"
Jul 15 21:39:09.155317 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:39:09.155293    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-f9b8d9b9b-9btmw"]
Jul 15 21:39:09.256108 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:39:09.256076    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dzhbv\" (UniqueName: \"kubernetes.io/projected/2ce2c6c0-0890-4e5d-975b-fac0b8554085-kube-api-access-dzhbv\") pod \"payload-pre-processing-74584bb9f8-jsfdn\" (UID: \"2ce2c6c0-0890-4e5d-975b-fac0b8554085\") " pod="openshift-ingress/payload-pre-processing-74584bb9f8-jsfdn"
Jul 15 21:39:09.256263 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:39:09.256120    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fm2cn\" (UniqueName: \"kubernetes.io/projected/53898b8a-82af-4e21-b825-9646371ffd92-kube-api-access-fm2cn\") pod \"payload-processing-f9b8d9b9b-9btmw\" (UID: \"53898b8a-82af-4e21-b825-9646371ffd92\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-9btmw"
Jul 15 21:39:09.256321 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:39:09.256303    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3bd879ab-a43e-4133-b25c-47df3119c12a-maas-api-tls\") pod \"maas-api-68b767c759-bk6c9\" (UID: \"3bd879ab-a43e-4133-b25c-47df3119c12a\") " pod="odh-ai-gateway-infra/maas-api-68b767c759-bk6c9"
Jul 15 21:39:09.256399 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:39:09.256384    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2ce2c6c0-0890-4e5d-975b-fac0b8554085-plugins-config-volume\") pod \"payload-pre-processing-74584bb9f8-jsfdn\" (UID: \"2ce2c6c0-0890-4e5d-975b-fac0b8554085\") " pod="openshift-ingress/payload-pre-processing-74584bb9f8-jsfdn"
Jul 15 21:39:09.256454 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:39:09.256428    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/53898b8a-82af-4e21-b825-9646371ffd92-plugins-config-volume\") pod \"payload-processing-f9b8d9b9b-9btmw\" (UID: \"53898b8a-82af-4e21-b825-9646371ffd92\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-9btmw"
Jul 15 21:39:09.257111 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:39:09.257088    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2ce2c6c0-0890-4e5d-975b-fac0b8554085-plugins-config-volume\") pod \"payload-pre-processing-74584bb9f8-jsfdn\" (UID: \"2ce2c6c0-0890-4e5d-975b-fac0b8554085\") " pod="openshift-ingress/payload-pre-processing-74584bb9f8-jsfdn"
Jul 15 21:39:09.258744 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:39:09.258714    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3bd879ab-a43e-4133-b25c-47df3119c12a-maas-api-tls\") pod \"maas-api-68b767c759-bk6c9\" (UID: \"3bd879ab-a43e-4133-b25c-47df3119c12a\") " pod="odh-ai-gateway-infra/maas-api-68b767c759-bk6c9"
Jul 15 21:39:09.263443 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:39:09.263418    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dzhbv\" (UniqueName: \"kubernetes.io/projected/2ce2c6c0-0890-4e5d-975b-fac0b8554085-kube-api-access-dzhbv\") pod \"payload-pre-processing-74584bb9f8-jsfdn\" (UID: \"2ce2c6c0-0890-4e5d-975b-fac0b8554085\") " pod="openshift-ingress/payload-pre-processing-74584bb9f8-jsfdn"
Jul 15 21:39:09.357364 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:39:09.357266    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fm2cn\" (UniqueName: \"kubernetes.io/projected/53898b8a-82af-4e21-b825-9646371ffd92-kube-api-access-fm2cn\") pod \"payload-processing-f9b8d9b9b-9btmw\" (UID: \"53898b8a-82af-4e21-b825-9646371ffd92\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-9btmw"
Jul 15 21:39:09.357503 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:39:09.357406    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/53898b8a-82af-4e21-b825-9646371ffd92-plugins-config-volume\") pod \"payload-processing-f9b8d9b9b-9btmw\" (UID: \"53898b8a-82af-4e21-b825-9646371ffd92\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-9btmw"
Jul 15 21:39:09.358108 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:39:09.358087    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/53898b8a-82af-4e21-b825-9646371ffd92-plugins-config-volume\") pod \"payload-processing-f9b8d9b9b-9btmw\" (UID: \"53898b8a-82af-4e21-b825-9646371ffd92\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-9btmw"
Jul 15 21:39:09.364704 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:39:09.364673    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fm2cn\" (UniqueName: \"kubernetes.io/projected/53898b8a-82af-4e21-b825-9646371ffd92-kube-api-access-fm2cn\") pod \"payload-processing-f9b8d9b9b-9btmw\" (UID: \"53898b8a-82af-4e21-b825-9646371ffd92\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-9btmw"
Jul 15 21:39:09.425015 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:39:09.424980    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-74584bb9f8-jsfdn"
Jul 15 21:39:09.458543 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:39:09.458514    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-f9b8d9b9b-9btmw"
Jul 15 21:39:09.516634 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:39:09.516274    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-68b767c759-bk6c9"
Jul 15 21:39:09.595818 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:39:09.595723    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-74584bb9f8-jsfdn"]
Jul 15 21:39:09.605978 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:39:09.602246    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2ce2c6c0_0890_4e5d_975b_fac0b8554085.slice/crio-c7dda3a402e3255a0681d2b4624287ae11d404adbf3e22b48887a98d784c371c WatchSource:0}: Error finding container c7dda3a402e3255a0681d2b4624287ae11d404adbf3e22b48887a98d784c371c: Status 404 returned error can't find the container with id c7dda3a402e3255a0681d2b4624287ae11d404adbf3e22b48887a98d784c371c
Jul 15 21:39:09.636796 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:39:09.636764    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-f9b8d9b9b-9btmw"]
Jul 15 21:39:09.646200 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:39:09.646168    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod53898b8a_82af_4e21_b825_9646371ffd92.slice/crio-6f162b9f1e5ec75a2c698620f680d24590b2586ff526a7c226ec1936f138ef75 WatchSource:0}: Error finding container 6f162b9f1e5ec75a2c698620f680d24590b2586ff526a7c226ec1936f138ef75: Status 404 returned error can't find the container with id 6f162b9f1e5ec75a2c698620f680d24590b2586ff526a7c226ec1936f138ef75
Jul 15 21:39:09.690569 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:39:09.690247    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-68b767c759-bk6c9"]
Jul 15 21:39:09.695237 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:39:09.695208    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3bd879ab_a43e_4133_b25c_47df3119c12a.slice/crio-265e8a6817824c80879d6fc04b5315ad542cc40a0d3016dfd122fbdcdf8befec WatchSource:0}: Error finding container 265e8a6817824c80879d6fc04b5315ad542cc40a0d3016dfd122fbdcdf8befec: Status 404 returned error can't find the container with id 265e8a6817824c80879d6fc04b5315ad542cc40a0d3016dfd122fbdcdf8befec
Jul 15 21:39:09.810461 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:39:09.810421    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-74584bb9f8-jsfdn" event={"ID":"2ce2c6c0-0890-4e5d-975b-fac0b8554085","Type":"ContainerStarted","Data":"c7dda3a402e3255a0681d2b4624287ae11d404adbf3e22b48887a98d784c371c"}
Jul 15 21:39:09.811885 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:39:09.811859    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-f9b8d9b9b-9btmw" event={"ID":"53898b8a-82af-4e21-b825-9646371ffd92","Type":"ContainerStarted","Data":"6f162b9f1e5ec75a2c698620f680d24590b2586ff526a7c226ec1936f138ef75"}
Jul 15 21:39:09.813105 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:39:09.813081    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-68b767c759-bk6c9" event={"ID":"3bd879ab-a43e-4133-b25c-47df3119c12a","Type":"ContainerStarted","Data":"265e8a6817824c80879d6fc04b5315ad542cc40a0d3016dfd122fbdcdf8befec"}
Jul 15 21:39:10.816089 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:39:10.815959    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-zlsbs_9b97af79-5c4a-4622-8d74-04d470841a53/console-operator/2.log"
Jul 15 21:39:10.823790 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:39:10.823755    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-zlsbs_9b97af79-5c4a-4622-8d74-04d470841a53/console-operator/2.log"
Jul 15 21:39:10.831954 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:39:10.831908    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bp2vz_7f43c078-b73a-4760-860b-e7f6e07afdbd/ovn-acl-logging/0.log"
Jul 15 21:39:10.839883 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:39:10.839848    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bp2vz_7f43c078-b73a-4760-860b-e7f6e07afdbd/ovn-acl-logging/0.log"
Jul 15 21:39:12.836830 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:39:12.836794    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-f9b8d9b9b-9btmw" event={"ID":"53898b8a-82af-4e21-b825-9646371ffd92","Type":"ContainerStarted","Data":"716c79562490220247d3d86c65ea5740d54e82df49134c9c531872134ab1a56a"}
Jul 15 21:39:12.837328 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:39:12.836893    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-f9b8d9b9b-9btmw"
Jul 15 21:39:12.838483 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:39:12.838451    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-68b767c759-bk6c9" event={"ID":"3bd879ab-a43e-4133-b25c-47df3119c12a","Type":"ContainerStarted","Data":"333402b7e4c8b8eae75bbac1576a6caed74c40ff741ddcb61ad2a180ceb5424f"}
Jul 15 21:39:12.838587 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:39:12.838503    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-68b767c759-bk6c9"
Jul 15 21:39:12.839858 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:39:12.839821    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-74584bb9f8-jsfdn" event={"ID":"2ce2c6c0-0890-4e5d-975b-fac0b8554085","Type":"ContainerStarted","Data":"86588e5ce883cc1dc8d5e42f74128294e8397f62331bed781a8df34bc316a686"}
Jul 15 21:39:12.839998 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:39:12.839870    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-74584bb9f8-jsfdn"
Jul 15 21:39:12.852042 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:39:12.852002    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-f9b8d9b9b-9btmw" podStartSLOduration=1.568242003 podStartE2EDuration="3.851987482s" totalImagesPullingTime="2.283745479s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:39:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:39:12.850450577 +0000 UTC m=+602.544378128" watchObservedRunningTime="2026-07-15 21:39:12.851987482 +0000 UTC m=+602.545915032"
Jul 15 21:39:12.865663 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:39:12.865610    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-74584bb9f8-jsfdn" podStartSLOduration=1.543689675 podStartE2EDuration="3.865594569s" totalImagesPullingTime="2.321904894s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:39:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:39:12.863293115 +0000 UTC m=+602.557220666" watchObservedRunningTime="2026-07-15 21:39:12.865594569 +0000 UTC m=+602.559522119"
Jul 15 21:39:12.881413 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:39:12.881345    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-68b767c759-bk6c9" podStartSLOduration=2.647448972 podStartE2EDuration="4.881323913s" totalImagesPullingTime="2.233874941s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:39:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:39:12.879266443 +0000 UTC m=+602.573193997" watchObservedRunningTime="2026-07-15 21:39:12.881323913 +0000 UTC m=+602.575251465"
Jul 15 21:39:16.859505 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:39:16.859424    2563 generic.go:356] "Generic (PLEG): container finished" podID="4a9ce1d9-cd12-4bde-b4af-171e9e9b8e65" containerID="3593a4a3c9b72724e079bbe9c0e67cb41ef2b5dc6098863df3ca34ce9041c542" exitCode=0
Jul 15 21:39:16.860290 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:39:16.859500    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-g9cv6" event={"ID":"4a9ce1d9-cd12-4bde-b4af-171e9e9b8e65","Type":"ContainerDied","Data":"3593a4a3c9b72724e079bbe9c0e67cb41ef2b5dc6098863df3ca34ce9041c542"}
Jul 15 21:39:16.860290 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:39:16.859876    2563 scope.go:117] "RemoveContainer" containerID="3593a4a3c9b72724e079bbe9c0e67cb41ef2b5dc6098863df3ca34ce9041c542"
Jul 15 21:39:16.860982 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:39:16.860932    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 15 21:39:16.861042 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:39:16.861023    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 15 21:39:16.861089 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:39:16.861057    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 15 21:39:17.366400 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:39:17.366360    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-g9cv6"
Jul 15 21:39:17.865768 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:39:17.865731    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-g9cv6" event={"ID":"4a9ce1d9-cd12-4bde-b4af-171e9e9b8e65","Type":"ContainerStarted","Data":"d804e9ef36a21801c5d42cb504c43b9e8fec574b5e8809791b177fc24aa606bc"}
Jul 15 21:39:17.963687 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:39:17.963645    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-g9cv6"
Jul 15 21:39:17.964792 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:39:17.964762    2563 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-g9cv6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.38:15021/healthz/ready\": dial tcp 10.132.0.38:15021: connect: connection refused" start-of-body=
Jul 15 21:39:17.964951 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:39:17.964823    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-g9cv6" podUID="4a9ce1d9-cd12-4bde-b4af-171e9e9b8e65" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.38:15021/healthz/ready\": dial tcp 10.132.0.38:15021: connect: connection refused"
Jul 15 21:39:18.850172 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:39:18.850136    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-68b767c759-bk6c9"
Jul 15 21:39:18.962901 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:39:18.962863    2563 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-g9cv6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.38:15021/healthz/ready\": dial tcp 10.132.0.38:15021: connect: connection refused" start-of-body=
Jul 15 21:39:18.963263 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:39:18.962920    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-g9cv6" podUID="4a9ce1d9-cd12-4bde-b4af-171e9e9b8e65" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.38:15021/healthz/ready\": dial tcp 10.132.0.38:15021: connect: connection refused"
Jul 15 21:39:19.963388 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:39:19.963351    2563 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-g9cv6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.38:15021/healthz/ready\": dial tcp 10.132.0.38:15021: connect: connection refused" start-of-body=
Jul 15 21:39:19.963861 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:39:19.963425    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-g9cv6" podUID="4a9ce1d9-cd12-4bde-b4af-171e9e9b8e65" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.38:15021/healthz/ready\": dial tcp 10.132.0.38:15021: connect: connection refused"
Jul 15 21:39:20.962973 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:39:20.962925    2563 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-g9cv6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.38:15021/healthz/ready\": dial tcp 10.132.0.38:15021: connect: connection refused" start-of-body=
Jul 15 21:39:20.963169 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:39:20.963007    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-g9cv6" podUID="4a9ce1d9-cd12-4bde-b4af-171e9e9b8e65" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.38:15021/healthz/ready\": dial tcp 10.132.0.38:15021: connect: connection refused"
Jul 15 21:39:21.967373 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:39:21.967339    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-g9cv6"
Jul 15 21:39:21.967730 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:39:21.967688    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-g9cv6"
Jul 15 21:39:21.968431 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:39:21.968411    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-g9cv6"
Jul 15 21:39:23.847301 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:39:23.847267    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-f9b8d9b9b-9btmw"
Jul 15 21:39:23.847782 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:39:23.847350    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-74584bb9f8-jsfdn"
Jul 15 21:39:38.692154 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:39:38.692067    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-6j8zd"]
Jul 15 21:39:38.702804 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:39:38.702779    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-6j8zd"
Jul 15 21:39:38.706176 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:39:38.706147    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-6j8zd"]
Jul 15 21:39:38.706452 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:39:38.706431    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 15 21:39:38.707037 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:39:38.707020    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 15 21:39:38.707161 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:39:38.707125    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-kpcw4\""
Jul 15 21:39:38.707218 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:39:38.707162    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
Jul 15 21:39:38.749773 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:39:38.749740    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4bb8afb9-4b27-484a-b1c1-bfc765843821-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-6j8zd\" (UID: \"4bb8afb9-4b27-484a-b1c1-bfc765843821\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-6j8zd"
Jul 15 21:39:38.749773 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:39:38.749772    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4bb8afb9-4b27-484a-b1c1-bfc765843821-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-6j8zd\" (UID: \"4bb8afb9-4b27-484a-b1c1-bfc765843821\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-6j8zd"
Jul 15 21:39:38.750039 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:39:38.749797    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c7twp\" (UniqueName: \"kubernetes.io/projected/4bb8afb9-4b27-484a-b1c1-bfc765843821-kube-api-access-c7twp\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-6j8zd\" (UID: \"4bb8afb9-4b27-484a-b1c1-bfc765843821\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-6j8zd"
Jul 15 21:39:38.750039 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:39:38.749908    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4bb8afb9-4b27-484a-b1c1-bfc765843821-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-6j8zd\" (UID: \"4bb8afb9-4b27-484a-b1c1-bfc765843821\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-6j8zd"
Jul 15 21:39:38.750039 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:39:38.749977    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4bb8afb9-4b27-484a-b1c1-bfc765843821-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-6j8zd\" (UID: \"4bb8afb9-4b27-484a-b1c1-bfc765843821\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-6j8zd"
Jul 15 21:39:38.750039 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:39:38.750012    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4bb8afb9-4b27-484a-b1c1-bfc765843821-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-6j8zd\" (UID: \"4bb8afb9-4b27-484a-b1c1-bfc765843821\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-6j8zd"
Jul 15 21:39:38.850966 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:39:38.850911    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4bb8afb9-4b27-484a-b1c1-bfc765843821-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-6j8zd\" (UID: \"4bb8afb9-4b27-484a-b1c1-bfc765843821\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-6j8zd"
Jul 15 21:39:38.851133 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:39:38.850996    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4bb8afb9-4b27-484a-b1c1-bfc765843821-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-6j8zd\" (UID: \"4bb8afb9-4b27-484a-b1c1-bfc765843821\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-6j8zd"
Jul 15 21:39:38.851133 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:39:38.851094    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4bb8afb9-4b27-484a-b1c1-bfc765843821-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-6j8zd\" (UID: \"4bb8afb9-4b27-484a-b1c1-bfc765843821\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-6j8zd"
Jul 15 21:39:38.851133 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:39:38.851118    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4bb8afb9-4b27-484a-b1c1-bfc765843821-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-6j8zd\" (UID: \"4bb8afb9-4b27-484a-b1c1-bfc765843821\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-6j8zd"
Jul 15 21:39:38.851267 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:39:38.851145    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c7twp\" (UniqueName: \"kubernetes.io/projected/4bb8afb9-4b27-484a-b1c1-bfc765843821-kube-api-access-c7twp\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-6j8zd\" (UID: \"4bb8afb9-4b27-484a-b1c1-bfc765843821\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-6j8zd"
Jul 15 21:39:38.851267 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:39:38.851220    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4bb8afb9-4b27-484a-b1c1-bfc765843821-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-6j8zd\" (UID: \"4bb8afb9-4b27-484a-b1c1-bfc765843821\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-6j8zd"
Jul 15 21:39:38.851532 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:39:38.851485    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4bb8afb9-4b27-484a-b1c1-bfc765843821-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-6j8zd\" (UID: \"4bb8afb9-4b27-484a-b1c1-bfc765843821\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-6j8zd"
Jul 15 21:39:38.851532 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:39:38.851498    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4bb8afb9-4b27-484a-b1c1-bfc765843821-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-6j8zd\" (UID: \"4bb8afb9-4b27-484a-b1c1-bfc765843821\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-6j8zd"
Jul 15 21:39:38.851658 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:39:38.851569    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4bb8afb9-4b27-484a-b1c1-bfc765843821-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-6j8zd\" (UID: \"4bb8afb9-4b27-484a-b1c1-bfc765843821\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-6j8zd"
Jul 15 21:39:38.853595 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:39:38.853531    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4bb8afb9-4b27-484a-b1c1-bfc765843821-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-6j8zd\" (UID: \"4bb8afb9-4b27-484a-b1c1-bfc765843821\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-6j8zd"
Jul 15 21:39:38.853775 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:39:38.853755    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4bb8afb9-4b27-484a-b1c1-bfc765843821-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-6j8zd\" (UID: \"4bb8afb9-4b27-484a-b1c1-bfc765843821\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-6j8zd"
Jul 15 21:39:38.858271 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:39:38.858252    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c7twp\" (UniqueName: \"kubernetes.io/projected/4bb8afb9-4b27-484a-b1c1-bfc765843821-kube-api-access-c7twp\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-6j8zd\" (UID: \"4bb8afb9-4b27-484a-b1c1-bfc765843821\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-6j8zd"
Jul 15 21:39:39.017066 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:39:39.016962    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-6j8zd"
Jul 15 21:39:39.154160 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:39:39.154128    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-6j8zd"]
Jul 15 21:39:39.156617 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:39:39.156585    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4bb8afb9_4b27_484a_b1c1_bfc765843821.slice/crio-9212cc329c06fc788c0589d462af91ec5b45706fa3f1efa0d95101b29fdc892c WatchSource:0}: Error finding container 9212cc329c06fc788c0589d462af91ec5b45706fa3f1efa0d95101b29fdc892c: Status 404 returned error can't find the container with id 9212cc329c06fc788c0589d462af91ec5b45706fa3f1efa0d95101b29fdc892c
Jul 15 21:39:39.974009 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:39:39.973973    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-6j8zd" event={"ID":"4bb8afb9-4b27-484a-b1c1-bfc765843821","Type":"ContainerStarted","Data":"9212cc329c06fc788c0589d462af91ec5b45706fa3f1efa0d95101b29fdc892c"}
Jul 15 21:39:40.980339 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:39:40.980300    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-6j8zd" event={"ID":"4bb8afb9-4b27-484a-b1c1-bfc765843821","Type":"ContainerStarted","Data":"8bfa6367ba8e4eddbe1233eb59d6eef8115fc434edad80922d52d7dcbc5f5d6f"}
Jul 15 21:39:40.996408 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:39:40.996340    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-6j8zd" podStartSLOduration=1.845550193 podStartE2EDuration="2.996325625s" totalImagesPullingTime="1.150775432s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:39:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:39:40.994438742 +0000 UTC m=+630.688366293" watchObservedRunningTime="2026-07-15 21:39:40.996325625 +0000 UTC m=+630.690253229"
Jul 15 21:39:49.017988 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:39:49.017952    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-6j8zd"
Jul 15 21:39:49.018411 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:39:49.018006    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-6j8zd"
Jul 15 21:39:49.031289 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:39:49.031258    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-6j8zd"
Jul 15 21:39:49.042852 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:39:49.042827    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-6j8zd"
Jul 15 21:39:49.881729 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:39:49.881686    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-km59b"]
Jul 15 21:39:49.887892 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:39:49.887868    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-km59b"
Jul 15 21:39:49.890308 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:39:49.890287    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\""
Jul 15 21:39:49.894740 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:39:49.894711    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-km59b"]
Jul 15 21:39:49.949768 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:39:49.949711    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rpc5c\" (UniqueName: \"kubernetes.io/projected/a8de4782-ea5a-4e34-8534-981cee53dbc0-kube-api-access-rpc5c\") pod \"e2e-trlp-test-simulated-kserve-598466548d-km59b\" (UID: \"a8de4782-ea5a-4e34-8534-981cee53dbc0\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-km59b"
Jul 15 21:39:49.949768 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:39:49.949765    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a8de4782-ea5a-4e34-8534-981cee53dbc0-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-km59b\" (UID: \"a8de4782-ea5a-4e34-8534-981cee53dbc0\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-km59b"
Jul 15 21:39:49.950029 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:39:49.949796    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a8de4782-ea5a-4e34-8534-981cee53dbc0-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-km59b\" (UID: \"a8de4782-ea5a-4e34-8534-981cee53dbc0\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-km59b"
Jul 15 21:39:49.950029 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:39:49.949846    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a8de4782-ea5a-4e34-8534-981cee53dbc0-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-km59b\" (UID: \"a8de4782-ea5a-4e34-8534-981cee53dbc0\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-km59b"
Jul 15 21:39:49.950029 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:39:49.949903    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a8de4782-ea5a-4e34-8534-981cee53dbc0-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-km59b\" (UID: \"a8de4782-ea5a-4e34-8534-981cee53dbc0\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-km59b"
Jul 15 21:39:49.950029 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:39:49.949962    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a8de4782-ea5a-4e34-8534-981cee53dbc0-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-km59b\" (UID: \"a8de4782-ea5a-4e34-8534-981cee53dbc0\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-km59b"
Jul 15 21:39:50.050792 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:39:50.050755    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a8de4782-ea5a-4e34-8534-981cee53dbc0-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-km59b\" (UID: \"a8de4782-ea5a-4e34-8534-981cee53dbc0\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-km59b"
Jul 15 21:39:50.050792 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:39:50.050798    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a8de4782-ea5a-4e34-8534-981cee53dbc0-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-km59b\" (UID: \"a8de4782-ea5a-4e34-8534-981cee53dbc0\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-km59b"
Jul 15 21:39:50.051457 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:39:50.050861    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rpc5c\" (UniqueName: \"kubernetes.io/projected/a8de4782-ea5a-4e34-8534-981cee53dbc0-kube-api-access-rpc5c\") pod \"e2e-trlp-test-simulated-kserve-598466548d-km59b\" (UID: \"a8de4782-ea5a-4e34-8534-981cee53dbc0\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-km59b"
Jul 15 21:39:50.051457 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:39:50.050882    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a8de4782-ea5a-4e34-8534-981cee53dbc0-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-km59b\" (UID: \"a8de4782-ea5a-4e34-8534-981cee53dbc0\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-km59b"
Jul 15 21:39:50.051457 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:39:50.050998    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a8de4782-ea5a-4e34-8534-981cee53dbc0-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-km59b\" (UID: \"a8de4782-ea5a-4e34-8534-981cee53dbc0\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-km59b"
Jul 15 21:39:50.051457 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:39:50.051078    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a8de4782-ea5a-4e34-8534-981cee53dbc0-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-km59b\" (UID: \"a8de4782-ea5a-4e34-8534-981cee53dbc0\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-km59b"
Jul 15 21:39:50.051457 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:39:50.051314    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a8de4782-ea5a-4e34-8534-981cee53dbc0-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-km59b\" (UID: \"a8de4782-ea5a-4e34-8534-981cee53dbc0\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-km59b"
Jul 15 21:39:50.051457 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:39:50.051376    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a8de4782-ea5a-4e34-8534-981cee53dbc0-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-km59b\" (UID: \"a8de4782-ea5a-4e34-8534-981cee53dbc0\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-km59b"
Jul 15 21:39:50.051457 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:39:50.051433    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a8de4782-ea5a-4e34-8534-981cee53dbc0-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-km59b\" (UID: \"a8de4782-ea5a-4e34-8534-981cee53dbc0\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-km59b"
Jul 15 21:39:50.053425 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:39:50.053401    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a8de4782-ea5a-4e34-8534-981cee53dbc0-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-km59b\" (UID: \"a8de4782-ea5a-4e34-8534-981cee53dbc0\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-km59b"
Jul 15 21:39:50.053637 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:39:50.053619    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a8de4782-ea5a-4e34-8534-981cee53dbc0-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-km59b\" (UID: \"a8de4782-ea5a-4e34-8534-981cee53dbc0\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-km59b"
Jul 15 21:39:50.058126 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:39:50.058103    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rpc5c\" (UniqueName: \"kubernetes.io/projected/a8de4782-ea5a-4e34-8534-981cee53dbc0-kube-api-access-rpc5c\") pod \"e2e-trlp-test-simulated-kserve-598466548d-km59b\" (UID: \"a8de4782-ea5a-4e34-8534-981cee53dbc0\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-km59b"
Jul 15 21:39:50.200901 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:39:50.200806    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-km59b"
Jul 15 21:39:50.340511 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:39:50.340462    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-km59b"]
Jul 15 21:39:50.343133 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:39:50.343106    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda8de4782_ea5a_4e34_8534_981cee53dbc0.slice/crio-aa165d65277c6b673105e70d465e2694dbea1acc510551cbf11bdd591098b205 WatchSource:0}: Error finding container aa165d65277c6b673105e70d465e2694dbea1acc510551cbf11bdd591098b205: Status 404 returned error can't find the container with id aa165d65277c6b673105e70d465e2694dbea1acc510551cbf11bdd591098b205
Jul 15 21:39:50.344482 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:39:50.344459    2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 15 21:39:51.039466 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:39:51.039429    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-km59b" event={"ID":"a8de4782-ea5a-4e34-8534-981cee53dbc0","Type":"ContainerStarted","Data":"d56c6958ba483b0e0e8081114323df04f7bf44ffd50b9477c40a37422b5581cf"}
Jul 15 21:39:51.039645 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:39:51.039485    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-km59b" event={"ID":"a8de4782-ea5a-4e34-8534-981cee53dbc0","Type":"ContainerStarted","Data":"aa165d65277c6b673105e70d465e2694dbea1acc510551cbf11bdd591098b205"}
Jul 15 21:39:51.055109 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:39:51.055063    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-km59b" podStartSLOduration=1.8769946640000001 podStartE2EDuration="2.055048249s" totalImagesPullingTime="178.053585ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:39:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:39:51.054031803 +0000 UTC m=+640.747959367" watchObservedRunningTime="2026-07-15 21:39:51.055048249 +0000 UTC m=+640.748975800"
Jul 15 21:40:00.202093 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:40:00.202053    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-km59b"
Jul 15 21:40:00.202507 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:40:00.202123    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-km59b"
Jul 15 21:40:00.214670 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:40:00.214647    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-km59b"
Jul 15 21:40:01.098769 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:40:01.098734    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-km59b"
Jul 15 21:42:10.602806 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:42:10.602770    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-75b45fb47d-2l8sf"]
Jul 15 21:42:10.603351 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:42:10.602979    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-75b45fb47d-2l8sf" podUID="dd87bb29-413d-46ac-8a7b-9ce4c408a7a6" containerName="manager" containerID="cri-o://8a3260e851ddb82b703ccc0370a7f985b4fbf8cd0f5c573fdd95af1a02bbfeb1" gracePeriod=30
Jul 15 21:42:10.866035 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:42:10.865969    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-75b45fb47d-2l8sf"
Jul 15 21:42:10.968651 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:42:10.968619    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2lwtw\" (UniqueName: \"kubernetes.io/projected/dd87bb29-413d-46ac-8a7b-9ce4c408a7a6-kube-api-access-2lwtw\") pod \"dd87bb29-413d-46ac-8a7b-9ce4c408a7a6\" (UID: \"dd87bb29-413d-46ac-8a7b-9ce4c408a7a6\") "
Jul 15 21:42:10.968819 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:42:10.968677    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/dd87bb29-413d-46ac-8a7b-9ce4c408a7a6-webhook-cert\") pod \"dd87bb29-413d-46ac-8a7b-9ce4c408a7a6\" (UID: \"dd87bb29-413d-46ac-8a7b-9ce4c408a7a6\") "
Jul 15 21:42:10.970671 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:42:10.970637    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dd87bb29-413d-46ac-8a7b-9ce4c408a7a6-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "dd87bb29-413d-46ac-8a7b-9ce4c408a7a6" (UID: "dd87bb29-413d-46ac-8a7b-9ce4c408a7a6"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 21:42:10.970795 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:42:10.970755    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dd87bb29-413d-46ac-8a7b-9ce4c408a7a6-kube-api-access-2lwtw" (OuterVolumeSpecName: "kube-api-access-2lwtw") pod "dd87bb29-413d-46ac-8a7b-9ce4c408a7a6" (UID: "dd87bb29-413d-46ac-8a7b-9ce4c408a7a6"). InnerVolumeSpecName "kube-api-access-2lwtw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 21:42:11.070515 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:42:11.070485    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2lwtw\" (UniqueName: \"kubernetes.io/projected/dd87bb29-413d-46ac-8a7b-9ce4c408a7a6-kube-api-access-2lwtw\") on node \"ip-10-0-130-217.ec2.internal\" DevicePath \"\""
Jul 15 21:42:11.070515 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:42:11.070511    2563 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/dd87bb29-413d-46ac-8a7b-9ce4c408a7a6-webhook-cert\") on node \"ip-10-0-130-217.ec2.internal\" DevicePath \"\""
Jul 15 21:42:11.718825 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:42:11.718786    2563 generic.go:356] "Generic (PLEG): container finished" podID="dd87bb29-413d-46ac-8a7b-9ce4c408a7a6" containerID="8a3260e851ddb82b703ccc0370a7f985b4fbf8cd0f5c573fdd95af1a02bbfeb1" exitCode=0
Jul 15 21:42:11.719239 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:42:11.718836    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-75b45fb47d-2l8sf"
Jul 15 21:42:11.719239 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:42:11.718851    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-75b45fb47d-2l8sf" event={"ID":"dd87bb29-413d-46ac-8a7b-9ce4c408a7a6","Type":"ContainerDied","Data":"8a3260e851ddb82b703ccc0370a7f985b4fbf8cd0f5c573fdd95af1a02bbfeb1"}
Jul 15 21:42:11.719239 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:42:11.718906    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-75b45fb47d-2l8sf" event={"ID":"dd87bb29-413d-46ac-8a7b-9ce4c408a7a6","Type":"ContainerDied","Data":"076e6891236ff5942f3051dcba25b6713db7f3f0d57de30bc2bc015475ec30cf"}
Jul 15 21:42:11.719239 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:42:11.718954    2563 scope.go:117] "RemoveContainer" containerID="8a3260e851ddb82b703ccc0370a7f985b4fbf8cd0f5c573fdd95af1a02bbfeb1"
Jul 15 21:42:11.728056 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:42:11.728037    2563 scope.go:117] "RemoveContainer" containerID="8a3260e851ddb82b703ccc0370a7f985b4fbf8cd0f5c573fdd95af1a02bbfeb1"
Jul 15 21:42:11.728347 ip-10-0-130-217 kubenswrapper[2563]: E0715 21:42:11.728329    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8a3260e851ddb82b703ccc0370a7f985b4fbf8cd0f5c573fdd95af1a02bbfeb1\": container with ID starting with 8a3260e851ddb82b703ccc0370a7f985b4fbf8cd0f5c573fdd95af1a02bbfeb1 not found: ID does not exist" containerID="8a3260e851ddb82b703ccc0370a7f985b4fbf8cd0f5c573fdd95af1a02bbfeb1"
Jul 15 21:42:11.728418 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:42:11.728355    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8a3260e851ddb82b703ccc0370a7f985b4fbf8cd0f5c573fdd95af1a02bbfeb1"} err="failed to get container status \"8a3260e851ddb82b703ccc0370a7f985b4fbf8cd0f5c573fdd95af1a02bbfeb1\": rpc error: code = NotFound desc = could not find container \"8a3260e851ddb82b703ccc0370a7f985b4fbf8cd0f5c573fdd95af1a02bbfeb1\": container with ID starting with 8a3260e851ddb82b703ccc0370a7f985b4fbf8cd0f5c573fdd95af1a02bbfeb1 not found: ID does not exist"
Jul 15 21:42:11.735123 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:42:11.735100    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-75b45fb47d-2l8sf"]
Jul 15 21:42:11.737322 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:42:11.737300    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-75b45fb47d-2l8sf"]
Jul 15 21:42:12.540954 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:42:12.540904    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-75b45fb47d-pf94n"]
Jul 15 21:42:12.541361 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:42:12.541345    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dd87bb29-413d-46ac-8a7b-9ce4c408a7a6" containerName="manager"
Jul 15 21:42:12.541406 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:42:12.541363    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="dd87bb29-413d-46ac-8a7b-9ce4c408a7a6" containerName="manager"
Jul 15 21:42:12.541450 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:42:12.541440    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="dd87bb29-413d-46ac-8a7b-9ce4c408a7a6" containerName="manager"
Jul 15 21:42:12.545802 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:42:12.545779    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-75b45fb47d-pf94n"
Jul 15 21:42:12.548816 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:42:12.548791    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-vvd5w\""
Jul 15 21:42:12.548816 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:42:12.548807    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 15 21:42:12.549001 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:42:12.548807    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 15 21:42:12.552149 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:42:12.552128    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-75b45fb47d-pf94n"]
Jul 15 21:42:12.684759 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:42:12.684718    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k4c6p\" (UniqueName: \"kubernetes.io/projected/1efb696c-a59d-4df6-9961-ecd82f93bbb1-kube-api-access-k4c6p\") pod \"maas-controller-75b45fb47d-pf94n\" (UID: \"1efb696c-a59d-4df6-9961-ecd82f93bbb1\") " pod="opendatahub/maas-controller-75b45fb47d-pf94n"
Jul 15 21:42:12.684965 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:42:12.684853    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1efb696c-a59d-4df6-9961-ecd82f93bbb1-webhook-cert\") pod \"maas-controller-75b45fb47d-pf94n\" (UID: \"1efb696c-a59d-4df6-9961-ecd82f93bbb1\") " pod="opendatahub/maas-controller-75b45fb47d-pf94n"
Jul 15 21:42:12.785564 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:42:12.785518    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1efb696c-a59d-4df6-9961-ecd82f93bbb1-webhook-cert\") pod \"maas-controller-75b45fb47d-pf94n\" (UID: \"1efb696c-a59d-4df6-9961-ecd82f93bbb1\") " pod="opendatahub/maas-controller-75b45fb47d-pf94n"
Jul 15 21:42:12.786082 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:42:12.785601    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k4c6p\" (UniqueName: \"kubernetes.io/projected/1efb696c-a59d-4df6-9961-ecd82f93bbb1-kube-api-access-k4c6p\") pod \"maas-controller-75b45fb47d-pf94n\" (UID: \"1efb696c-a59d-4df6-9961-ecd82f93bbb1\") " pod="opendatahub/maas-controller-75b45fb47d-pf94n"
Jul 15 21:42:12.788056 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:42:12.788035    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1efb696c-a59d-4df6-9961-ecd82f93bbb1-webhook-cert\") pod \"maas-controller-75b45fb47d-pf94n\" (UID: \"1efb696c-a59d-4df6-9961-ecd82f93bbb1\") " pod="opendatahub/maas-controller-75b45fb47d-pf94n"
Jul 15 21:42:12.793004 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:42:12.792928    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k4c6p\" (UniqueName: \"kubernetes.io/projected/1efb696c-a59d-4df6-9961-ecd82f93bbb1-kube-api-access-k4c6p\") pod \"maas-controller-75b45fb47d-pf94n\" (UID: \"1efb696c-a59d-4df6-9961-ecd82f93bbb1\") " pod="opendatahub/maas-controller-75b45fb47d-pf94n"
Jul 15 21:42:12.857518 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:42:12.857487    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-75b45fb47d-pf94n"
Jul 15 21:42:12.990467 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:42:12.990441    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dd87bb29-413d-46ac-8a7b-9ce4c408a7a6" path="/var/lib/kubelet/pods/dd87bb29-413d-46ac-8a7b-9ce4c408a7a6/volumes"
Jul 15 21:42:12.991303 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:42:12.991273    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-75b45fb47d-pf94n"]
Jul 15 21:42:12.992956 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:42:12.992914    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1efb696c_a59d_4df6_9961_ecd82f93bbb1.slice/crio-b2ac38db5d97bd908af5d488fee3a6cefb7f0e01fb08f0e7c56702f725a6888b WatchSource:0}: Error finding container b2ac38db5d97bd908af5d488fee3a6cefb7f0e01fb08f0e7c56702f725a6888b: Status 404 returned error can't find the container with id b2ac38db5d97bd908af5d488fee3a6cefb7f0e01fb08f0e7c56702f725a6888b
Jul 15 21:42:13.729974 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:42:13.729924    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-75b45fb47d-pf94n" event={"ID":"1efb696c-a59d-4df6-9961-ecd82f93bbb1","Type":"ContainerStarted","Data":"b2ac38db5d97bd908af5d488fee3a6cefb7f0e01fb08f0e7c56702f725a6888b"}
Jul 15 21:42:14.736293 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:42:14.736255    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-75b45fb47d-pf94n" event={"ID":"1efb696c-a59d-4df6-9961-ecd82f93bbb1","Type":"ContainerStarted","Data":"1a2ae1a8a8917fe43e1c6b3856319289a4da93baa21b44dbf805ce9ed7f02ba2"}
Jul 15 21:42:14.736756 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:42:14.736317    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-75b45fb47d-pf94n"
Jul 15 21:42:14.754494 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:42:14.754448    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-75b45fb47d-pf94n" podStartSLOduration=1.828434354 podStartE2EDuration="2.754434097s" totalImagesPullingTime="925.999743ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:42:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:42:14.753437583 +0000 UTC m=+784.447365136" watchObservedRunningTime="2026-07-15 21:42:14.754434097 +0000 UTC m=+784.448361647"
Jul 15 21:42:25.743710 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:42:25.743679    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-75b45fb47d-pf94n"
Jul 15 21:44:10.866670 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:44:10.866600    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-zlsbs_9b97af79-5c4a-4622-8d74-04d470841a53/console-operator/2.log"
Jul 15 21:44:10.870686 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:44:10.870661    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-zlsbs_9b97af79-5c4a-4622-8d74-04d470841a53/console-operator/2.log"
Jul 15 21:44:10.870854 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:44:10.870836    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bp2vz_7f43c078-b73a-4760-860b-e7f6e07afdbd/ovn-acl-logging/0.log"
Jul 15 21:44:10.874244 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:44:10.874222    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bp2vz_7f43c078-b73a-4760-860b-e7f6e07afdbd/ovn-acl-logging/0.log"
Jul 15 21:45:00.138119 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:45:00.138070    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29735865-mgw5h"]
Jul 15 21:45:00.145321 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:45:00.145291    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735865-mgw5h"
Jul 15 21:45:00.148351 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:45:00.148326    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-zx6nf\""
Jul 15 21:45:00.156176 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:45:00.156153    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735865-mgw5h"
Jul 15 21:45:00.178607 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:45:00.178559    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29735865-mgw5h"]
Jul 15 21:45:00.295596 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:45:00.295406    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29735865-mgw5h"]
Jul 15 21:45:00.301848 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:45:00.301826    2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 15 21:45:00.540688 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:45:00.540598    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735865-mgw5h" event={"ID":"ccfaf994-a80a-469c-ba11-7906926060fc","Type":"ContainerStarted","Data":"50bdcea88a284b5835e202b40e42ae6ff7a2808b1051525d335bf316ac121bde"}
Jul 15 21:45:03.558142 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:45:03.558105    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735865-mgw5h" event={"ID":"ccfaf994-a80a-469c-ba11-7906926060fc","Type":"ContainerStarted","Data":"18374cb5bc75819d5bd1680d0dc3cfb29228fd40461f7aab84701a659c382a5d"}
Jul 15 21:45:03.574676 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:45:03.574629    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735865-mgw5h" podStartSLOduration=1.301873939 podStartE2EDuration="3.574612532s" totalImagesPullingTime="2.272738593s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:45:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:45:03.572562553 +0000 UTC m=+953.266490107" watchObservedRunningTime="2026-07-15 21:45:03.574612532 +0000 UTC m=+953.268540083"
Jul 15 21:45:04.564137 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:45:04.564103    2563 generic.go:356] "Generic (PLEG): container finished" podID="ccfaf994-a80a-469c-ba11-7906926060fc" containerID="18374cb5bc75819d5bd1680d0dc3cfb29228fd40461f7aab84701a659c382a5d" exitCode=0
Jul 15 21:45:04.564537 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:45:04.564173    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735865-mgw5h" event={"ID":"ccfaf994-a80a-469c-ba11-7906926060fc","Type":"ContainerDied","Data":"18374cb5bc75819d5bd1680d0dc3cfb29228fd40461f7aab84701a659c382a5d"}
Jul 15 21:45:05.709001 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:45:05.708973    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735865-mgw5h"
Jul 15 21:45:06.576658 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:45:06.576629    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735865-mgw5h"
Jul 15 21:45:06.576658 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:45:06.576644    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735865-mgw5h" event={"ID":"ccfaf994-a80a-469c-ba11-7906926060fc","Type":"ContainerDied","Data":"50bdcea88a284b5835e202b40e42ae6ff7a2808b1051525d335bf316ac121bde"}
Jul 15 21:45:06.576913 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:45:06.576690    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="50bdcea88a284b5835e202b40e42ae6ff7a2808b1051525d335bf316ac121bde"
Jul 15 21:47:00.436314 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:47:00.436280    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-b8z2f"]
Jul 15 21:47:00.436971 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:47:00.436648    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-b8z2f" podUID="17e966e3-39e9-4272-8fe0-9891e31a1d4e" containerName="manager" containerID="cri-o://57350838bdd49d41414714bf4433cddfb1bd29de562fadb1ca60e9fc940ef9c9" gracePeriod=10
Jul 15 21:47:03.794403 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:47:03.794374    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-b8z2f"
Jul 15 21:47:03.875199 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:47:03.875164    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8mwkc\" (UniqueName: \"kubernetes.io/projected/17e966e3-39e9-4272-8fe0-9891e31a1d4e-kube-api-access-8mwkc\") pod \"17e966e3-39e9-4272-8fe0-9891e31a1d4e\" (UID: \"17e966e3-39e9-4272-8fe0-9891e31a1d4e\") "
Jul 15 21:47:03.875360 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:47:03.875264    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/17e966e3-39e9-4272-8fe0-9891e31a1d4e-extensions-socket-volume\") pod \"17e966e3-39e9-4272-8fe0-9891e31a1d4e\" (UID: \"17e966e3-39e9-4272-8fe0-9891e31a1d4e\") "
Jul 15 21:47:03.875615 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:47:03.875589    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/17e966e3-39e9-4272-8fe0-9891e31a1d4e-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "17e966e3-39e9-4272-8fe0-9891e31a1d4e" (UID: "17e966e3-39e9-4272-8fe0-9891e31a1d4e"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 21:47:03.877204 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:47:03.877179    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/17e966e3-39e9-4272-8fe0-9891e31a1d4e-kube-api-access-8mwkc" (OuterVolumeSpecName: "kube-api-access-8mwkc") pod "17e966e3-39e9-4272-8fe0-9891e31a1d4e" (UID: "17e966e3-39e9-4272-8fe0-9891e31a1d4e"). InnerVolumeSpecName "kube-api-access-8mwkc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 21:47:03.976849 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:47:03.976753    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8mwkc\" (UniqueName: \"kubernetes.io/projected/17e966e3-39e9-4272-8fe0-9891e31a1d4e-kube-api-access-8mwkc\") on node \"ip-10-0-130-217.ec2.internal\" DevicePath \"\""
Jul 15 21:47:03.976849 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:47:03.976790    2563 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/17e966e3-39e9-4272-8fe0-9891e31a1d4e-extensions-socket-volume\") on node \"ip-10-0-130-217.ec2.internal\" DevicePath \"\""
Jul 15 21:47:04.174863 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:47:04.174828    2563 generic.go:356] "Generic (PLEG): container finished" podID="17e966e3-39e9-4272-8fe0-9891e31a1d4e" containerID="57350838bdd49d41414714bf4433cddfb1bd29de562fadb1ca60e9fc940ef9c9" exitCode=0
Jul 15 21:47:04.175077 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:47:04.174877    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-b8z2f"
Jul 15 21:47:04.175077 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:47:04.174898    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-b8z2f" event={"ID":"17e966e3-39e9-4272-8fe0-9891e31a1d4e","Type":"ContainerDied","Data":"57350838bdd49d41414714bf4433cddfb1bd29de562fadb1ca60e9fc940ef9c9"}
Jul 15 21:47:04.175077 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:47:04.174956    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-b8z2f" event={"ID":"17e966e3-39e9-4272-8fe0-9891e31a1d4e","Type":"ContainerDied","Data":"586ab7b57855db2e0730662cf84ea6e4ed9c1223174e7209a8ccc8a788150b54"}
Jul 15 21:47:04.175077 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:47:04.174978    2563 scope.go:117] "RemoveContainer" containerID="57350838bdd49d41414714bf4433cddfb1bd29de562fadb1ca60e9fc940ef9c9"
Jul 15 21:47:04.187093 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:47:04.186153    2563 scope.go:117] "RemoveContainer" containerID="57350838bdd49d41414714bf4433cddfb1bd29de562fadb1ca60e9fc940ef9c9"
Jul 15 21:47:04.187409 ip-10-0-130-217 kubenswrapper[2563]: E0715 21:47:04.187378    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"57350838bdd49d41414714bf4433cddfb1bd29de562fadb1ca60e9fc940ef9c9\": container with ID starting with 57350838bdd49d41414714bf4433cddfb1bd29de562fadb1ca60e9fc940ef9c9 not found: ID does not exist" containerID="57350838bdd49d41414714bf4433cddfb1bd29de562fadb1ca60e9fc940ef9c9"
Jul 15 21:47:04.187482 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:47:04.187418    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"57350838bdd49d41414714bf4433cddfb1bd29de562fadb1ca60e9fc940ef9c9"} err="failed to get container status \"57350838bdd49d41414714bf4433cddfb1bd29de562fadb1ca60e9fc940ef9c9\": rpc error: code = NotFound desc = could not find container \"57350838bdd49d41414714bf4433cddfb1bd29de562fadb1ca60e9fc940ef9c9\": container with ID starting with 57350838bdd49d41414714bf4433cddfb1bd29de562fadb1ca60e9fc940ef9c9 not found: ID does not exist"
Jul 15 21:47:04.196384 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:47:04.196352    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-b8z2f"]
Jul 15 21:47:04.200044 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:47:04.200023    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-b8z2f"]
Jul 15 21:47:04.989062 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:47:04.989021    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="17e966e3-39e9-4272-8fe0-9891e31a1d4e" path="/var/lib/kubelet/pods/17e966e3-39e9-4272-8fe0-9891e31a1d4e/volumes"
Jul 15 21:48:01.629083 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:48:01.629052    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qv8cl"]
Jul 15 21:48:01.629552 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:48:01.629412    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ccfaf994-a80a-469c-ba11-7906926060fc" containerName="cleanup"
Jul 15 21:48:01.629552 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:48:01.629423    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="ccfaf994-a80a-469c-ba11-7906926060fc" containerName="cleanup"
Jul 15 21:48:01.629552 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:48:01.629445    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="17e966e3-39e9-4272-8fe0-9891e31a1d4e" containerName="manager"
Jul 15 21:48:01.629552 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:48:01.629450    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="17e966e3-39e9-4272-8fe0-9891e31a1d4e" containerName="manager"
Jul 15 21:48:01.629552 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:48:01.629511    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="ccfaf994-a80a-469c-ba11-7906926060fc" containerName="cleanup"
Jul 15 21:48:01.629552 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:48:01.629519    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="17e966e3-39e9-4272-8fe0-9891e31a1d4e" containerName="manager"
Jul 15 21:48:01.632659 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:48:01.632641    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qv8cl"
Jul 15 21:48:01.635135 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:48:01.635116    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-cf92g\""
Jul 15 21:48:01.643571 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:48:01.643547    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qv8cl"]
Jul 15 21:48:01.801523 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:48:01.801483    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d3fc3361-e4a1-4004-a32f-0f502e7b289c-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-qv8cl\" (UID: \"d3fc3361-e4a1-4004-a32f-0f502e7b289c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qv8cl"
Jul 15 21:48:01.801681 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:48:01.801609    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-77b76\" (UniqueName: \"kubernetes.io/projected/d3fc3361-e4a1-4004-a32f-0f502e7b289c-kube-api-access-77b76\") pod \"kuadrant-operator-controller-manager-86878c769f-qv8cl\" (UID: \"d3fc3361-e4a1-4004-a32f-0f502e7b289c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qv8cl"
Jul 15 21:48:01.902392 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:48:01.902310    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d3fc3361-e4a1-4004-a32f-0f502e7b289c-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-qv8cl\" (UID: \"d3fc3361-e4a1-4004-a32f-0f502e7b289c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qv8cl"
Jul 15 21:48:01.902536 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:48:01.902401    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-77b76\" (UniqueName: \"kubernetes.io/projected/d3fc3361-e4a1-4004-a32f-0f502e7b289c-kube-api-access-77b76\") pod \"kuadrant-operator-controller-manager-86878c769f-qv8cl\" (UID: \"d3fc3361-e4a1-4004-a32f-0f502e7b289c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qv8cl"
Jul 15 21:48:01.902721 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:48:01.902703    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d3fc3361-e4a1-4004-a32f-0f502e7b289c-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-qv8cl\" (UID: \"d3fc3361-e4a1-4004-a32f-0f502e7b289c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qv8cl"
Jul 15 21:48:01.914630 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:48:01.914603    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-77b76\" (UniqueName: \"kubernetes.io/projected/d3fc3361-e4a1-4004-a32f-0f502e7b289c-kube-api-access-77b76\") pod \"kuadrant-operator-controller-manager-86878c769f-qv8cl\" (UID: \"d3fc3361-e4a1-4004-a32f-0f502e7b289c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qv8cl"
Jul 15 21:48:01.943993 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:48:01.943962    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qv8cl"
Jul 15 21:48:02.078772 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:48:02.078744    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qv8cl"]
Jul 15 21:48:02.080989 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:48:02.080905    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd3fc3361_e4a1_4004_a32f_0f502e7b289c.slice/crio-c27d5027832e04414c098e959fc6e7c684817a274fce535ca6c29b33fe3f9c54 WatchSource:0}: Error finding container c27d5027832e04414c098e959fc6e7c684817a274fce535ca6c29b33fe3f9c54: Status 404 returned error can't find the container with id c27d5027832e04414c098e959fc6e7c684817a274fce535ca6c29b33fe3f9c54
Jul 15 21:48:02.452986 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:48:02.452922    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qv8cl" event={"ID":"d3fc3361-e4a1-4004-a32f-0f502e7b289c","Type":"ContainerStarted","Data":"b216a275388e21b3fee8f7a1b8f25c200b850d846711716a70445136b1ac8b03"}
Jul 15 21:48:02.453174 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:48:02.453034    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qv8cl"
Jul 15 21:48:02.453174 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:48:02.453053    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qv8cl" event={"ID":"d3fc3361-e4a1-4004-a32f-0f502e7b289c","Type":"ContainerStarted","Data":"c27d5027832e04414c098e959fc6e7c684817a274fce535ca6c29b33fe3f9c54"}
Jul 15 21:48:02.474463 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:48:02.474418    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qv8cl" podStartSLOduration=1.4744037890000001 podStartE2EDuration="1.474403789s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:48:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:48:02.472016613 +0000 UTC m=+1132.165944164" watchObservedRunningTime="2026-07-15 21:48:02.474403789 +0000 UTC m=+1132.168331339"
Jul 15 21:48:13.463616 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:48:13.463583    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qv8cl"
Jul 15 21:49:10.907799 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:49:10.907771    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-zlsbs_9b97af79-5c4a-4622-8d74-04d470841a53/console-operator/2.log"
Jul 15 21:49:10.908377 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:49:10.907776    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-zlsbs_9b97af79-5c4a-4622-8d74-04d470841a53/console-operator/2.log"
Jul 15 21:49:10.911813 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:49:10.911794    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bp2vz_7f43c078-b73a-4760-860b-e7f6e07afdbd/ovn-acl-logging/0.log"
Jul 15 21:49:10.911813 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:49:10.911809    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bp2vz_7f43c078-b73a-4760-860b-e7f6e07afdbd/ovn-acl-logging/0.log"
Jul 15 21:54:10.939532 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:54:10.939505    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-zlsbs_9b97af79-5c4a-4622-8d74-04d470841a53/console-operator/2.log"
Jul 15 21:54:10.939532 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:54:10.939519    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-zlsbs_9b97af79-5c4a-4622-8d74-04d470841a53/console-operator/2.log"
Jul 15 21:54:10.943128 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:54:10.943105    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bp2vz_7f43c078-b73a-4760-860b-e7f6e07afdbd/ovn-acl-logging/0.log"
Jul 15 21:54:10.943255 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:54:10.943237    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bp2vz_7f43c078-b73a-4760-860b-e7f6e07afdbd/ovn-acl-logging/0.log"
Jul 15 21:54:19.545571 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:54:19.545521    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-a41b0fdd-openshift-default-5755c7985f-6lxdj"]
Jul 15 21:54:19.549247 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:54:19.549225    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-a41b0fdd-openshift-default-5755c7985f-6lxdj"
Jul 15 21:54:19.551252 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:54:19.551228    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-a41b0fdd-openshift-default-dockercfg-ls4x5\""
Jul 15 21:54:19.565319 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:54:19.565291    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-a41b0fdd-openshift-default-5755c7985f-6lxdj"]
Jul 15 21:54:19.611839 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:54:19.611802    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/de412610-9b3f-4b81-9655-c1b7c9597696-istiod-ca-cert\") pod \"e2e-ait-a41b0fdd-openshift-default-5755c7985f-6lxdj\" (UID: \"de412610-9b3f-4b81-9655-c1b7c9597696\") " pod="openshift-ingress/e2e-ait-a41b0fdd-openshift-default-5755c7985f-6lxdj"
Jul 15 21:54:19.611839 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:54:19.611839    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/de412610-9b3f-4b81-9655-c1b7c9597696-istio-podinfo\") pod \"e2e-ait-a41b0fdd-openshift-default-5755c7985f-6lxdj\" (UID: \"de412610-9b3f-4b81-9655-c1b7c9597696\") " pod="openshift-ingress/e2e-ait-a41b0fdd-openshift-default-5755c7985f-6lxdj"
Jul 15 21:54:19.612104 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:54:19.611864    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/de412610-9b3f-4b81-9655-c1b7c9597696-credential-socket\") pod \"e2e-ait-a41b0fdd-openshift-default-5755c7985f-6lxdj\" (UID: \"de412610-9b3f-4b81-9655-c1b7c9597696\") " pod="openshift-ingress/e2e-ait-a41b0fdd-openshift-default-5755c7985f-6lxdj"
Jul 15 21:54:19.612104 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:54:19.611931    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/de412610-9b3f-4b81-9655-c1b7c9597696-istio-envoy\") pod \"e2e-ait-a41b0fdd-openshift-default-5755c7985f-6lxdj\" (UID: \"de412610-9b3f-4b81-9655-c1b7c9597696\") " pod="openshift-ingress/e2e-ait-a41b0fdd-openshift-default-5755c7985f-6lxdj"
Jul 15 21:54:19.612104 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:54:19.611993    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/de412610-9b3f-4b81-9655-c1b7c9597696-istio-token\") pod \"e2e-ait-a41b0fdd-openshift-default-5755c7985f-6lxdj\" (UID: \"de412610-9b3f-4b81-9655-c1b7c9597696\") " pod="openshift-ingress/e2e-ait-a41b0fdd-openshift-default-5755c7985f-6lxdj"
Jul 15 21:54:19.612104 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:54:19.612037    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-krrrs\" (UniqueName: \"kubernetes.io/projected/de412610-9b3f-4b81-9655-c1b7c9597696-kube-api-access-krrrs\") pod \"e2e-ait-a41b0fdd-openshift-default-5755c7985f-6lxdj\" (UID: \"de412610-9b3f-4b81-9655-c1b7c9597696\") " pod="openshift-ingress/e2e-ait-a41b0fdd-openshift-default-5755c7985f-6lxdj"
Jul 15 21:54:19.612296 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:54:19.612118    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/de412610-9b3f-4b81-9655-c1b7c9597696-workload-certs\") pod \"e2e-ait-a41b0fdd-openshift-default-5755c7985f-6lxdj\" (UID: \"de412610-9b3f-4b81-9655-c1b7c9597696\") " pod="openshift-ingress/e2e-ait-a41b0fdd-openshift-default-5755c7985f-6lxdj"
Jul 15 21:54:19.612296 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:54:19.612148    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/de412610-9b3f-4b81-9655-c1b7c9597696-istio-data\") pod \"e2e-ait-a41b0fdd-openshift-default-5755c7985f-6lxdj\" (UID: \"de412610-9b3f-4b81-9655-c1b7c9597696\") " pod="openshift-ingress/e2e-ait-a41b0fdd-openshift-default-5755c7985f-6lxdj"
Jul 15 21:54:19.612296 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:54:19.612182    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/de412610-9b3f-4b81-9655-c1b7c9597696-workload-socket\") pod \"e2e-ait-a41b0fdd-openshift-default-5755c7985f-6lxdj\" (UID: \"de412610-9b3f-4b81-9655-c1b7c9597696\") " pod="openshift-ingress/e2e-ait-a41b0fdd-openshift-default-5755c7985f-6lxdj"
Jul 15 21:54:19.713159 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:54:19.713125    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/de412610-9b3f-4b81-9655-c1b7c9597696-istiod-ca-cert\") pod \"e2e-ait-a41b0fdd-openshift-default-5755c7985f-6lxdj\" (UID: \"de412610-9b3f-4b81-9655-c1b7c9597696\") " pod="openshift-ingress/e2e-ait-a41b0fdd-openshift-default-5755c7985f-6lxdj"
Jul 15 21:54:19.713353 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:54:19.713169    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/de412610-9b3f-4b81-9655-c1b7c9597696-istio-podinfo\") pod \"e2e-ait-a41b0fdd-openshift-default-5755c7985f-6lxdj\" (UID: \"de412610-9b3f-4b81-9655-c1b7c9597696\") " pod="openshift-ingress/e2e-ait-a41b0fdd-openshift-default-5755c7985f-6lxdj"
Jul 15 21:54:19.713353 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:54:19.713206    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/de412610-9b3f-4b81-9655-c1b7c9597696-credential-socket\") pod \"e2e-ait-a41b0fdd-openshift-default-5755c7985f-6lxdj\" (UID: \"de412610-9b3f-4b81-9655-c1b7c9597696\") " pod="openshift-ingress/e2e-ait-a41b0fdd-openshift-default-5755c7985f-6lxdj"
Jul 15 21:54:19.713353 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:54:19.713235    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/de412610-9b3f-4b81-9655-c1b7c9597696-istio-envoy\") pod \"e2e-ait-a41b0fdd-openshift-default-5755c7985f-6lxdj\" (UID: \"de412610-9b3f-4b81-9655-c1b7c9597696\") " pod="openshift-ingress/e2e-ait-a41b0fdd-openshift-default-5755c7985f-6lxdj"
Jul 15 21:54:19.713353 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:54:19.713253    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/de412610-9b3f-4b81-9655-c1b7c9597696-istio-token\") pod \"e2e-ait-a41b0fdd-openshift-default-5755c7985f-6lxdj\" (UID: \"de412610-9b3f-4b81-9655-c1b7c9597696\") " pod="openshift-ingress/e2e-ait-a41b0fdd-openshift-default-5755c7985f-6lxdj"
Jul 15 21:54:19.713353 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:54:19.713289    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-krrrs\" (UniqueName: \"kubernetes.io/projected/de412610-9b3f-4b81-9655-c1b7c9597696-kube-api-access-krrrs\") pod \"e2e-ait-a41b0fdd-openshift-default-5755c7985f-6lxdj\" (UID: \"de412610-9b3f-4b81-9655-c1b7c9597696\") " pod="openshift-ingress/e2e-ait-a41b0fdd-openshift-default-5755c7985f-6lxdj"
Jul 15 21:54:19.713353 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:54:19.713350    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/de412610-9b3f-4b81-9655-c1b7c9597696-workload-certs\") pod \"e2e-ait-a41b0fdd-openshift-default-5755c7985f-6lxdj\" (UID: \"de412610-9b3f-4b81-9655-c1b7c9597696\") " pod="openshift-ingress/e2e-ait-a41b0fdd-openshift-default-5755c7985f-6lxdj"
Jul 15 21:54:19.713667 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:54:19.713375    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/de412610-9b3f-4b81-9655-c1b7c9597696-istio-data\") pod \"e2e-ait-a41b0fdd-openshift-default-5755c7985f-6lxdj\" (UID: \"de412610-9b3f-4b81-9655-c1b7c9597696\") " pod="openshift-ingress/e2e-ait-a41b0fdd-openshift-default-5755c7985f-6lxdj"
Jul 15 21:54:19.713667 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:54:19.713411    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/de412610-9b3f-4b81-9655-c1b7c9597696-workload-socket\") pod \"e2e-ait-a41b0fdd-openshift-default-5755c7985f-6lxdj\" (UID: \"de412610-9b3f-4b81-9655-c1b7c9597696\") " pod="openshift-ingress/e2e-ait-a41b0fdd-openshift-default-5755c7985f-6lxdj"
Jul 15 21:54:19.713811 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:54:19.713786    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/de412610-9b3f-4b81-9655-c1b7c9597696-workload-socket\") pod \"e2e-ait-a41b0fdd-openshift-default-5755c7985f-6lxdj\" (UID: \"de412610-9b3f-4b81-9655-c1b7c9597696\") " pod="openshift-ingress/e2e-ait-a41b0fdd-openshift-default-5755c7985f-6lxdj"
Jul 15 21:54:19.713897 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:54:19.713872    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/de412610-9b3f-4b81-9655-c1b7c9597696-workload-certs\") pod \"e2e-ait-a41b0fdd-openshift-default-5755c7985f-6lxdj\" (UID: \"de412610-9b3f-4b81-9655-c1b7c9597696\") " pod="openshift-ingress/e2e-ait-a41b0fdd-openshift-default-5755c7985f-6lxdj"
Jul 15 21:54:19.714009 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:54:19.713989    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/de412610-9b3f-4b81-9655-c1b7c9597696-istio-data\") pod \"e2e-ait-a41b0fdd-openshift-default-5755c7985f-6lxdj\" (UID: \"de412610-9b3f-4b81-9655-c1b7c9597696\") " pod="openshift-ingress/e2e-ait-a41b0fdd-openshift-default-5755c7985f-6lxdj"
Jul 15 21:54:19.714068 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:54:19.714004    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/de412610-9b3f-4b81-9655-c1b7c9597696-istiod-ca-cert\") pod \"e2e-ait-a41b0fdd-openshift-default-5755c7985f-6lxdj\" (UID: \"de412610-9b3f-4b81-9655-c1b7c9597696\") " pod="openshift-ingress/e2e-ait-a41b0fdd-openshift-default-5755c7985f-6lxdj"
Jul 15 21:54:19.714068 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:54:19.714048    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/de412610-9b3f-4b81-9655-c1b7c9597696-credential-socket\") pod \"e2e-ait-a41b0fdd-openshift-default-5755c7985f-6lxdj\" (UID: \"de412610-9b3f-4b81-9655-c1b7c9597696\") " pod="openshift-ingress/e2e-ait-a41b0fdd-openshift-default-5755c7985f-6lxdj"
Jul 15 21:54:19.715616 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:54:19.715583    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/de412610-9b3f-4b81-9655-c1b7c9597696-istio-envoy\") pod \"e2e-ait-a41b0fdd-openshift-default-5755c7985f-6lxdj\" (UID: \"de412610-9b3f-4b81-9655-c1b7c9597696\") " pod="openshift-ingress/e2e-ait-a41b0fdd-openshift-default-5755c7985f-6lxdj"
Jul 15 21:54:19.715716 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:54:19.715694    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/de412610-9b3f-4b81-9655-c1b7c9597696-istio-podinfo\") pod \"e2e-ait-a41b0fdd-openshift-default-5755c7985f-6lxdj\" (UID: \"de412610-9b3f-4b81-9655-c1b7c9597696\") " pod="openshift-ingress/e2e-ait-a41b0fdd-openshift-default-5755c7985f-6lxdj"
Jul 15 21:54:19.720459 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:54:19.720437    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/de412610-9b3f-4b81-9655-c1b7c9597696-istio-token\") pod \"e2e-ait-a41b0fdd-openshift-default-5755c7985f-6lxdj\" (UID: \"de412610-9b3f-4b81-9655-c1b7c9597696\") " pod="openshift-ingress/e2e-ait-a41b0fdd-openshift-default-5755c7985f-6lxdj"
Jul 15 21:54:19.720793 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:54:19.720772    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-krrrs\" (UniqueName: \"kubernetes.io/projected/de412610-9b3f-4b81-9655-c1b7c9597696-kube-api-access-krrrs\") pod \"e2e-ait-a41b0fdd-openshift-default-5755c7985f-6lxdj\" (UID: \"de412610-9b3f-4b81-9655-c1b7c9597696\") " pod="openshift-ingress/e2e-ait-a41b0fdd-openshift-default-5755c7985f-6lxdj"
Jul 15 21:54:19.859452 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:54:19.859417    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-a41b0fdd-openshift-default-5755c7985f-6lxdj"
Jul 15 21:54:19.999396 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:54:19.999369    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-a41b0fdd-openshift-default-5755c7985f-6lxdj"]
Jul 15 21:54:20.001526 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:54:20.001505    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podde412610_9b3f_4b81_9655_c1b7c9597696.slice/crio-2bd11668d414f7ee9ab3924066e591d70a8ec1eeec32c57620aa65ad73e3da08 WatchSource:0}: Error finding container 2bd11668d414f7ee9ab3924066e591d70a8ec1eeec32c57620aa65ad73e3da08: Status 404 returned error can't find the container with id 2bd11668d414f7ee9ab3924066e591d70a8ec1eeec32c57620aa65ad73e3da08
Jul 15 21:54:20.003637 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:54:20.003605    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 15 21:54:20.003701 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:54:20.003671    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 15 21:54:20.003738 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:54:20.003701    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 15 21:54:20.316603 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:54:20.316505    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-a41b0fdd-openshift-default-5755c7985f-6lxdj" event={"ID":"de412610-9b3f-4b81-9655-c1b7c9597696","Type":"ContainerStarted","Data":"17c3c3e4e9b83d780b869f23341ef5e2198eb4190a8f78fa2fccf37bba04fa78"}
Jul 15 21:54:20.316603 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:54:20.316556    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-a41b0fdd-openshift-default-5755c7985f-6lxdj" event={"ID":"de412610-9b3f-4b81-9655-c1b7c9597696","Type":"ContainerStarted","Data":"2bd11668d414f7ee9ab3924066e591d70a8ec1eeec32c57620aa65ad73e3da08"}
Jul 15 21:54:20.336089 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:54:20.336042    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-a41b0fdd-openshift-default-5755c7985f-6lxdj" podStartSLOduration=1.336027707 podStartE2EDuration="1.336027707s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:54:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:54:20.334601371 +0000 UTC m=+1510.028528922" watchObservedRunningTime="2026-07-15 21:54:20.336027707 +0000 UTC m=+1510.029955325"
Jul 15 21:54:20.821483 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:54:20.821442    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-a41b0fdd-ddffb7568-4srdv"]
Jul 15 21:54:20.830972 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:54:20.830924    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a41b0fdd-ddffb7568-4srdv"
Jul 15 21:54:20.831854 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:54:20.831824    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-a41b0fdd-ddffb7568-4srdv"]
Jul 15 21:54:20.833896 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:54:20.833873    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-a41b0fdd-serving-cert\""
Jul 15 21:54:20.860339 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:54:20.860311    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-a41b0fdd-openshift-default-5755c7985f-6lxdj"
Jul 15 21:54:20.928712 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:54:20.928675    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fb332863-ffb2-4ea3-aba3-f75ff97f41e2-openshift-service-ca\") pod \"maas-api-e2e-ait-a41b0fdd-ddffb7568-4srdv\" (UID: \"fb332863-ffb2-4ea3-aba3-f75ff97f41e2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-a41b0fdd-ddffb7568-4srdv"
Jul 15 21:54:20.928962 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:54:20.928725    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fb332863-ffb2-4ea3-aba3-f75ff97f41e2-maas-api-tls\") pod \"maas-api-e2e-ait-a41b0fdd-ddffb7568-4srdv\" (UID: \"fb332863-ffb2-4ea3-aba3-f75ff97f41e2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-a41b0fdd-ddffb7568-4srdv"
Jul 15 21:54:20.928962 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:54:20.928860    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7xbsn\" (UniqueName: \"kubernetes.io/projected/fb332863-ffb2-4ea3-aba3-f75ff97f41e2-kube-api-access-7xbsn\") pod \"maas-api-e2e-ait-a41b0fdd-ddffb7568-4srdv\" (UID: \"fb332863-ffb2-4ea3-aba3-f75ff97f41e2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-a41b0fdd-ddffb7568-4srdv"
Jul 15 21:54:21.029683 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:54:21.029641    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7xbsn\" (UniqueName: \"kubernetes.io/projected/fb332863-ffb2-4ea3-aba3-f75ff97f41e2-kube-api-access-7xbsn\") pod \"maas-api-e2e-ait-a41b0fdd-ddffb7568-4srdv\" (UID: \"fb332863-ffb2-4ea3-aba3-f75ff97f41e2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-a41b0fdd-ddffb7568-4srdv"
Jul 15 21:54:21.029859 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:54:21.029739    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fb332863-ffb2-4ea3-aba3-f75ff97f41e2-openshift-service-ca\") pod \"maas-api-e2e-ait-a41b0fdd-ddffb7568-4srdv\" (UID: \"fb332863-ffb2-4ea3-aba3-f75ff97f41e2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-a41b0fdd-ddffb7568-4srdv"
Jul 15 21:54:21.029859 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:54:21.029768    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fb332863-ffb2-4ea3-aba3-f75ff97f41e2-maas-api-tls\") pod \"maas-api-e2e-ait-a41b0fdd-ddffb7568-4srdv\" (UID: \"fb332863-ffb2-4ea3-aba3-f75ff97f41e2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-a41b0fdd-ddffb7568-4srdv"
Jul 15 21:54:21.029953 ip-10-0-130-217 kubenswrapper[2563]: E0715 21:54:21.029914    2563 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-a41b0fdd-serving-cert: secret "maas-api-e2e-ait-a41b0fdd-serving-cert" not found
Jul 15 21:54:21.030024 ip-10-0-130-217 kubenswrapper[2563]: E0715 21:54:21.030011    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fb332863-ffb2-4ea3-aba3-f75ff97f41e2-maas-api-tls podName:fb332863-ffb2-4ea3-aba3-f75ff97f41e2 nodeName:}" failed. No retries permitted until 2026-07-15 21:54:21.529989497 +0000 UTC m=+1511.223917027 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/fb332863-ffb2-4ea3-aba3-f75ff97f41e2-maas-api-tls") pod "maas-api-e2e-ait-a41b0fdd-ddffb7568-4srdv" (UID: "fb332863-ffb2-4ea3-aba3-f75ff97f41e2") : secret "maas-api-e2e-ait-a41b0fdd-serving-cert" not found
Jul 15 21:54:21.030443 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:54:21.030423    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fb332863-ffb2-4ea3-aba3-f75ff97f41e2-openshift-service-ca\") pod \"maas-api-e2e-ait-a41b0fdd-ddffb7568-4srdv\" (UID: \"fb332863-ffb2-4ea3-aba3-f75ff97f41e2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-a41b0fdd-ddffb7568-4srdv"
Jul 15 21:54:21.038726 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:54:21.038686    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7xbsn\" (UniqueName: \"kubernetes.io/projected/fb332863-ffb2-4ea3-aba3-f75ff97f41e2-kube-api-access-7xbsn\") pod \"maas-api-e2e-ait-a41b0fdd-ddffb7568-4srdv\" (UID: \"fb332863-ffb2-4ea3-aba3-f75ff97f41e2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-a41b0fdd-ddffb7568-4srdv"
Jul 15 21:54:21.534158 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:54:21.534116    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fb332863-ffb2-4ea3-aba3-f75ff97f41e2-maas-api-tls\") pod \"maas-api-e2e-ait-a41b0fdd-ddffb7568-4srdv\" (UID: \"fb332863-ffb2-4ea3-aba3-f75ff97f41e2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-a41b0fdd-ddffb7568-4srdv"
Jul 15 21:54:21.536874 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:54:21.536837    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fb332863-ffb2-4ea3-aba3-f75ff97f41e2-maas-api-tls\") pod \"maas-api-e2e-ait-a41b0fdd-ddffb7568-4srdv\" (UID: \"fb332863-ffb2-4ea3-aba3-f75ff97f41e2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-a41b0fdd-ddffb7568-4srdv"
Jul 15 21:54:21.743267 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:54:21.743232    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a41b0fdd-ddffb7568-4srdv"
Jul 15 21:54:21.866176 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:54:21.866141    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-a41b0fdd-openshift-default-5755c7985f-6lxdj"
Jul 15 21:54:21.886767 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:54:21.886685    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-a41b0fdd-ddffb7568-4srdv"]
Jul 15 21:54:21.890916 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:54:21.890888    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfb332863_ffb2_4ea3_aba3_f75ff97f41e2.slice/crio-2a4b52082d14e0a197f54f9b216487c38209fd15997f36bd8a28c529cb64b00b WatchSource:0}: Error finding container 2a4b52082d14e0a197f54f9b216487c38209fd15997f36bd8a28c529cb64b00b: Status 404 returned error can't find the container with id 2a4b52082d14e0a197f54f9b216487c38209fd15997f36bd8a28c529cb64b00b
Jul 15 21:54:21.892776 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:54:21.892756    2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 15 21:54:22.328545 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:54:22.328505    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a41b0fdd-ddffb7568-4srdv" event={"ID":"fb332863-ffb2-4ea3-aba3-f75ff97f41e2","Type":"ContainerStarted","Data":"2a4b52082d14e0a197f54f9b216487c38209fd15997f36bd8a28c529cb64b00b"}
Jul 15 21:54:22.328815 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:54:22.328796    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-a41b0fdd-openshift-default-5755c7985f-6lxdj"
Jul 15 21:54:22.329833 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:54:22.329811    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-a41b0fdd-openshift-default-5755c7985f-6lxdj"
Jul 15 21:54:23.335336 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:54:23.335296    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a41b0fdd-ddffb7568-4srdv" event={"ID":"fb332863-ffb2-4ea3-aba3-f75ff97f41e2","Type":"ContainerStarted","Data":"7b36de0e462c86fee499aa32326d087691c78676f660abde3819a6ab428d7d46"}
Jul 15 21:54:23.352580 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:54:23.352518    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a41b0fdd-ddffb7568-4srdv" podStartSLOduration=2.485447035 podStartE2EDuration="3.352498768s" totalImagesPullingTime="867.051733ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:54:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:54:23.351103655 +0000 UTC m=+1513.045031205" watchObservedRunningTime="2026-07-15 21:54:23.352498768 +0000 UTC m=+1513.046426323"
Jul 15 21:54:24.340387 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:54:24.340354    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a41b0fdd-ddffb7568-4srdv"
Jul 15 21:54:25.834258 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:54:25.834226    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a41b0fdd-92hzv"]
Jul 15 21:54:25.838503 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:54:25.838477    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a41b0fdd-92hzv"
Jul 15 21:54:25.840602 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:54:25.840568    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-zx6nf\""
Jul 15 21:54:25.845355 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:54:25.845322    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a41b0fdd-92hzv"]
Jul 15 21:54:25.980166 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:54:25.980131    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/28668c9c-4419-4b48-8e6f-a683698b7ba0-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-a41b0fdd-92hzv\" (UID: \"28668c9c-4419-4b48-8e6f-a683698b7ba0\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a41b0fdd-92hzv"
Jul 15 21:54:26.080901 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:54:26.080858    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/28668c9c-4419-4b48-8e6f-a683698b7ba0-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-a41b0fdd-92hzv\" (UID: \"28668c9c-4419-4b48-8e6f-a683698b7ba0\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a41b0fdd-92hzv"
Jul 15 21:54:26.081644 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:54:26.081623    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/28668c9c-4419-4b48-8e6f-a683698b7ba0-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-a41b0fdd-92hzv\" (UID: \"28668c9c-4419-4b48-8e6f-a683698b7ba0\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a41b0fdd-92hzv"
Jul 15 21:54:26.151913 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:54:26.151833    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a41b0fdd-92hzv"
Jul 15 21:54:26.288645 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:54:26.288610    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a41b0fdd-92hzv"]
Jul 15 21:54:26.290376 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:54:26.290345    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod28668c9c_4419_4b48_8e6f_a683698b7ba0.slice/crio-45bac4651704261e6fa49d00006a4bdfe4070b48cfd85a3295837f92ccff953a WatchSource:0}: Error finding container 45bac4651704261e6fa49d00006a4bdfe4070b48cfd85a3295837f92ccff953a: Status 404 returned error can't find the container with id 45bac4651704261e6fa49d00006a4bdfe4070b48cfd85a3295837f92ccff953a
Jul 15 21:54:26.351323 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:54:26.351291    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a41b0fdd-92hzv" event={"ID":"28668c9c-4419-4b48-8e6f-a683698b7ba0","Type":"ContainerStarted","Data":"45bac4651704261e6fa49d00006a4bdfe4070b48cfd85a3295837f92ccff953a"}
Jul 15 21:54:27.359646 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:54:27.359608    2563 generic.go:356] "Generic (PLEG): container finished" podID="28668c9c-4419-4b48-8e6f-a683698b7ba0" containerID="a6604b15f4e3987a2b54855ff9531dced551435262f65180d08e81153f4ce547" exitCode=7
Jul 15 21:54:27.360107 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:54:27.359673    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a41b0fdd-92hzv" event={"ID":"28668c9c-4419-4b48-8e6f-a683698b7ba0","Type":"ContainerDied","Data":"a6604b15f4e3987a2b54855ff9531dced551435262f65180d08e81153f4ce547"}
Jul 15 21:54:27.360107 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:54:27.359893    2563 scope.go:117] "RemoveContainer" containerID="a6604b15f4e3987a2b54855ff9531dced551435262f65180d08e81153f4ce547"
Jul 15 21:54:28.367250 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:54:28.367212    2563 generic.go:356] "Generic (PLEG): container finished" podID="28668c9c-4419-4b48-8e6f-a683698b7ba0" containerID="b43074ddd15ea57952fdb6b8cdb9d8b06ad26f6d96df3b654444d41aa6b0cbc5" exitCode=7
Jul 15 21:54:28.367631 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:54:28.367300    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a41b0fdd-92hzv" event={"ID":"28668c9c-4419-4b48-8e6f-a683698b7ba0","Type":"ContainerDied","Data":"b43074ddd15ea57952fdb6b8cdb9d8b06ad26f6d96df3b654444d41aa6b0cbc5"}
Jul 15 21:54:28.367631 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:54:28.367366    2563 scope.go:117] "RemoveContainer" containerID="a6604b15f4e3987a2b54855ff9531dced551435262f65180d08e81153f4ce547"
Jul 15 21:54:28.367631 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:54:28.367597    2563 scope.go:117] "RemoveContainer" containerID="b43074ddd15ea57952fdb6b8cdb9d8b06ad26f6d96df3b654444d41aa6b0cbc5"
Jul 15 21:54:28.367852 ip-10-0-130-217 kubenswrapper[2563]: E0715 21:54:28.367833    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-a41b0fdd-92hzv_odh-ai-gateway-infra(28668c9c-4419-4b48-8e6f-a683698b7ba0)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a41b0fdd-92hzv" podUID="28668c9c-4419-4b48-8e6f-a683698b7ba0"
Jul 15 21:54:29.373742 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:54:29.373710    2563 scope.go:117] "RemoveContainer" containerID="b43074ddd15ea57952fdb6b8cdb9d8b06ad26f6d96df3b654444d41aa6b0cbc5"
Jul 15 21:54:29.374165 ip-10-0-130-217 kubenswrapper[2563]: E0715 21:54:29.373904    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-a41b0fdd-92hzv_odh-ai-gateway-infra(28668c9c-4419-4b48-8e6f-a683698b7ba0)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a41b0fdd-92hzv" podUID="28668c9c-4419-4b48-8e6f-a683698b7ba0"
Jul 15 21:54:30.351287 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:54:30.351257    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a41b0fdd-ddffb7568-4srdv"
Jul 15 21:54:34.408223 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:54:34.408184    2563 generic.go:356] "Generic (PLEG): container finished" podID="de412610-9b3f-4b81-9655-c1b7c9597696" containerID="17c3c3e4e9b83d780b869f23341ef5e2198eb4190a8f78fa2fccf37bba04fa78" exitCode=0
Jul 15 21:54:34.408653 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:54:34.408256    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-a41b0fdd-openshift-default-5755c7985f-6lxdj" event={"ID":"de412610-9b3f-4b81-9655-c1b7c9597696","Type":"ContainerDied","Data":"17c3c3e4e9b83d780b869f23341ef5e2198eb4190a8f78fa2fccf37bba04fa78"}
Jul 15 21:54:34.408698 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:54:34.408679    2563 scope.go:117] "RemoveContainer" containerID="17c3c3e4e9b83d780b869f23341ef5e2198eb4190a8f78fa2fccf37bba04fa78"
Jul 15 21:54:34.409778 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:54:34.409750    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 15 21:54:34.409852 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:54:34.409834    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 15 21:54:34.409896 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:54:34.409882    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 15 21:54:35.415406 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:54:35.415370    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-a41b0fdd-openshift-default-5755c7985f-6lxdj" event={"ID":"de412610-9b3f-4b81-9655-c1b7c9597696","Type":"ContainerStarted","Data":"348010a207b902b621391040482130a373ba19673176624f0deb1aea2a5e322d"}
Jul 15 21:54:35.860119 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:54:35.860083    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-a41b0fdd-openshift-default-5755c7985f-6lxdj"
Jul 15 21:54:35.861378 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:54:35.861344    2563 patch_prober.go:28] interesting pod/e2e-ait-a41b0fdd-openshift-default-5755c7985f-6lxdj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" start-of-body=
Jul 15 21:54:35.861512 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:54:35.861398    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-a41b0fdd-openshift-default-5755c7985f-6lxdj" podUID="de412610-9b3f-4b81-9655-c1b7c9597696" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused"
Jul 15 21:54:36.860757 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:54:36.860722    2563 patch_prober.go:28] interesting pod/e2e-ait-a41b0fdd-openshift-default-5755c7985f-6lxdj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" start-of-body=
Jul 15 21:54:36.861163 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:54:36.860778    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-a41b0fdd-openshift-default-5755c7985f-6lxdj" podUID="de412610-9b3f-4b81-9655-c1b7c9597696" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused"
Jul 15 21:54:37.329242 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:54:37.329209    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-a41b0fdd-openshift-default-5755c7985f-6lxdj"
Jul 15 21:54:37.860435 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:54:37.860403    2563 patch_prober.go:28] interesting pod/e2e-ait-a41b0fdd-openshift-default-5755c7985f-6lxdj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" start-of-body=
Jul 15 21:54:37.860607 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:54:37.860464    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-a41b0fdd-openshift-default-5755c7985f-6lxdj" podUID="de412610-9b3f-4b81-9655-c1b7c9597696" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused"
Jul 15 21:54:38.859922 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:54:38.859880    2563 patch_prober.go:28] interesting pod/e2e-ait-a41b0fdd-openshift-default-5755c7985f-6lxdj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" start-of-body=
Jul 15 21:54:38.860335 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:54:38.859970    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-a41b0fdd-openshift-default-5755c7985f-6lxdj" podUID="de412610-9b3f-4b81-9655-c1b7c9597696" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused"
Jul 15 21:54:39.863914 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:54:39.863881    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-a41b0fdd-openshift-default-5755c7985f-6lxdj"
Jul 15 21:54:39.864826 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:54:39.864801    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-a41b0fdd-openshift-default-5755c7985f-6lxdj"
Jul 15 21:54:41.983005 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:54:41.982969    2563 scope.go:117] "RemoveContainer" containerID="b43074ddd15ea57952fdb6b8cdb9d8b06ad26f6d96df3b654444d41aa6b0cbc5"
Jul 15 21:54:42.450573 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:54:42.450541    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a41b0fdd-92hzv" event={"ID":"28668c9c-4419-4b48-8e6f-a683698b7ba0","Type":"ContainerStarted","Data":"d5dfc76c886a82c65658800161190407dbcbfb470afde51d3a8d843cf52d93e5"}
Jul 15 21:54:42.464703 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:54:42.464646    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a41b0fdd-92hzv" podStartSLOduration=17.464630207 podStartE2EDuration="17.464630207s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:54:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:54:42.463891394 +0000 UTC m=+1532.157818945" watchObservedRunningTime="2026-07-15 21:54:42.464630207 +0000 UTC m=+1532.158557757"
Jul 15 21:54:43.457039 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:54:43.457007    2563 generic.go:356] "Generic (PLEG): container finished" podID="28668c9c-4419-4b48-8e6f-a683698b7ba0" containerID="d5dfc76c886a82c65658800161190407dbcbfb470afde51d3a8d843cf52d93e5" exitCode=0
Jul 15 21:54:43.457445 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:54:43.457085    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a41b0fdd-92hzv" event={"ID":"28668c9c-4419-4b48-8e6f-a683698b7ba0","Type":"ContainerDied","Data":"d5dfc76c886a82c65658800161190407dbcbfb470afde51d3a8d843cf52d93e5"}
Jul 15 21:54:43.457445 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:54:43.457151    2563 scope.go:117] "RemoveContainer" containerID="b43074ddd15ea57952fdb6b8cdb9d8b06ad26f6d96df3b654444d41aa6b0cbc5"
Jul 15 21:54:43.481299 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:54:43.481269    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a41b0fdd-92hzv"]
Jul 15 21:54:44.608048 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:54:44.608015    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a41b0fdd-92hzv"
Jul 15 21:54:44.677258 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:54:44.677224    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/28668c9c-4419-4b48-8e6f-a683698b7ba0-maas-api-service-ca\") pod \"28668c9c-4419-4b48-8e6f-a683698b7ba0\" (UID: \"28668c9c-4419-4b48-8e6f-a683698b7ba0\") "
Jul 15 21:54:44.677616 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:54:44.677589    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/28668c9c-4419-4b48-8e6f-a683698b7ba0-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "28668c9c-4419-4b48-8e6f-a683698b7ba0" (UID: "28668c9c-4419-4b48-8e6f-a683698b7ba0"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 21:54:44.778928 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:54:44.778839    2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/28668c9c-4419-4b48-8e6f-a683698b7ba0-maas-api-service-ca\") on node \"ip-10-0-130-217.ec2.internal\" DevicePath \"\""
Jul 15 21:54:45.469776 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:54:45.469740    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a41b0fdd-92hzv" event={"ID":"28668c9c-4419-4b48-8e6f-a683698b7ba0","Type":"ContainerDied","Data":"45bac4651704261e6fa49d00006a4bdfe4070b48cfd85a3295837f92ccff953a"}
Jul 15 21:54:45.469776 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:54:45.469763    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a41b0fdd-92hzv"
Jul 15 21:54:45.470032 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:54:45.469791    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="45bac4651704261e6fa49d00006a4bdfe4070b48cfd85a3295837f92ccff953a"
Jul 15 21:54:45.496657 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:54:45.496628    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a41b0fdd-92hzv"]
Jul 15 21:54:45.500270 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:54:45.500248    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a41b0fdd-92hzv"]
Jul 15 21:54:46.988415 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:54:46.988383    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="28668c9c-4419-4b48-8e6f-a683698b7ba0" path="/var/lib/kubelet/pods/28668c9c-4419-4b48-8e6f-a683698b7ba0/volumes"
Jul 15 21:55:15.879434 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:55:15.879389    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a41b0fdd-s7h7f"]
Jul 15 21:55:15.880072 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:55:15.879796    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="28668c9c-4419-4b48-8e6f-a683698b7ba0" containerName="revoke-keys"
Jul 15 21:55:15.880072 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:55:15.879808    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="28668c9c-4419-4b48-8e6f-a683698b7ba0" containerName="revoke-keys"
Jul 15 21:55:15.880072 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:55:15.879819    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="28668c9c-4419-4b48-8e6f-a683698b7ba0" containerName="revoke-keys"
Jul 15 21:55:15.880072 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:55:15.879825    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="28668c9c-4419-4b48-8e6f-a683698b7ba0" containerName="revoke-keys"
Jul 15 21:55:15.880072 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:55:15.879831    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="28668c9c-4419-4b48-8e6f-a683698b7ba0" containerName="revoke-keys"
Jul 15 21:55:15.880072 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:55:15.879837    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="28668c9c-4419-4b48-8e6f-a683698b7ba0" containerName="revoke-keys"
Jul 15 21:55:15.880072 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:55:15.879897    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="28668c9c-4419-4b48-8e6f-a683698b7ba0" containerName="revoke-keys"
Jul 15 21:55:15.880072 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:55:15.879906    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="28668c9c-4419-4b48-8e6f-a683698b7ba0" containerName="revoke-keys"
Jul 15 21:55:15.883076 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:55:15.883052    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a41b0fdd-s7h7f"
Jul 15 21:55:15.885197 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:55:15.885170    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-zx6nf\""
Jul 15 21:55:15.889670 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:55:15.889645    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a41b0fdd-s7h7f"]
Jul 15 21:55:15.980142 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:55:15.980102    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/13303763-e6f0-4e52-8bd2-e2abd426321a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-a41b0fdd-s7h7f\" (UID: \"13303763-e6f0-4e52-8bd2-e2abd426321a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a41b0fdd-s7h7f"
Jul 15 21:55:16.081455 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:55:16.081418    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/13303763-e6f0-4e52-8bd2-e2abd426321a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-a41b0fdd-s7h7f\" (UID: \"13303763-e6f0-4e52-8bd2-e2abd426321a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a41b0fdd-s7h7f"
Jul 15 21:55:16.082046 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:55:16.082026    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/13303763-e6f0-4e52-8bd2-e2abd426321a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-a41b0fdd-s7h7f\" (UID: \"13303763-e6f0-4e52-8bd2-e2abd426321a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a41b0fdd-s7h7f"
Jul 15 21:55:16.197703 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:55:16.197615    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a41b0fdd-s7h7f"
Jul 15 21:55:16.331465 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:55:16.331439    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a41b0fdd-s7h7f"]
Jul 15 21:55:16.333507 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:55:16.333467    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod13303763_e6f0_4e52_8bd2_e2abd426321a.slice/crio-8329974a958425a0402c73fe43dc27410b50a584d7962986827126a74d111c58 WatchSource:0}: Error finding container 8329974a958425a0402c73fe43dc27410b50a584d7962986827126a74d111c58: Status 404 returned error can't find the container with id 8329974a958425a0402c73fe43dc27410b50a584d7962986827126a74d111c58
Jul 15 21:55:16.637205 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:55:16.637163    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a41b0fdd-s7h7f" event={"ID":"13303763-e6f0-4e52-8bd2-e2abd426321a","Type":"ContainerStarted","Data":"73a531af786290591988223ad8a4d212261d732793836e676a3aba96aa2267e8"}
Jul 15 21:55:16.637401 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:55:16.637226    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a41b0fdd-s7h7f" event={"ID":"13303763-e6f0-4e52-8bd2-e2abd426321a","Type":"ContainerStarted","Data":"8329974a958425a0402c73fe43dc27410b50a584d7962986827126a74d111c58"}
Jul 15 21:55:16.652479 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:55:16.652431    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a41b0fdd-s7h7f" podStartSLOduration=1.6524166139999998 podStartE2EDuration="1.652416614s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:55:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:55:16.649932053 +0000 UTC m=+1566.343859614" watchObservedRunningTime="2026-07-15 21:55:16.652416614 +0000 UTC m=+1566.346344165"
Jul 15 21:55:17.643264 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:55:17.643230    2563 generic.go:356] "Generic (PLEG): container finished" podID="13303763-e6f0-4e52-8bd2-e2abd426321a" containerID="73a531af786290591988223ad8a4d212261d732793836e676a3aba96aa2267e8" exitCode=0
Jul 15 21:55:17.643667 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:55:17.643290    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a41b0fdd-s7h7f" event={"ID":"13303763-e6f0-4e52-8bd2-e2abd426321a","Type":"ContainerDied","Data":"73a531af786290591988223ad8a4d212261d732793836e676a3aba96aa2267e8"}
Jul 15 21:55:18.778067 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:55:18.778040    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a41b0fdd-s7h7f"
Jul 15 21:55:18.808771 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:55:18.808742    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/13303763-e6f0-4e52-8bd2-e2abd426321a-maas-api-service-ca\") pod \"13303763-e6f0-4e52-8bd2-e2abd426321a\" (UID: \"13303763-e6f0-4e52-8bd2-e2abd426321a\") "
Jul 15 21:55:18.809074 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:55:18.809054    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/13303763-e6f0-4e52-8bd2-e2abd426321a-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "13303763-e6f0-4e52-8bd2-e2abd426321a" (UID: "13303763-e6f0-4e52-8bd2-e2abd426321a"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 21:55:18.909923 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:55:18.909838    2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/13303763-e6f0-4e52-8bd2-e2abd426321a-maas-api-service-ca\") on node \"ip-10-0-130-217.ec2.internal\" DevicePath \"\""
Jul 15 21:55:19.653875 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:55:19.653846    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a41b0fdd-s7h7f"
Jul 15 21:55:19.654074 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:55:19.653890    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a41b0fdd-s7h7f" event={"ID":"13303763-e6f0-4e52-8bd2-e2abd426321a","Type":"ContainerDied","Data":"8329974a958425a0402c73fe43dc27410b50a584d7962986827126a74d111c58"}
Jul 15 21:55:19.654074 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:55:19.653969    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8329974a958425a0402c73fe43dc27410b50a584d7962986827126a74d111c58"
Jul 15 21:55:26.458138 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:55:26.458097    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-a41b0fdd-ddffb7568-4srdv"]
Jul 15 21:55:26.458736 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:55:26.458443    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a41b0fdd-ddffb7568-4srdv" podUID="fb332863-ffb2-4ea3-aba3-f75ff97f41e2" containerName="maas-api" containerID="cri-o://7b36de0e462c86fee499aa32326d087691c78676f660abde3819a6ab428d7d46" gracePeriod=30
Jul 15 21:55:26.691694 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:55:26.691658    2563 generic.go:356] "Generic (PLEG): container finished" podID="fb332863-ffb2-4ea3-aba3-f75ff97f41e2" containerID="7b36de0e462c86fee499aa32326d087691c78676f660abde3819a6ab428d7d46" exitCode=0
Jul 15 21:55:26.691694 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:55:26.691684    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a41b0fdd-ddffb7568-4srdv" event={"ID":"fb332863-ffb2-4ea3-aba3-f75ff97f41e2","Type":"ContainerDied","Data":"7b36de0e462c86fee499aa32326d087691c78676f660abde3819a6ab428d7d46"}
Jul 15 21:55:26.724134 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:55:26.724111    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a41b0fdd-ddffb7568-4srdv"
Jul 15 21:55:26.791755 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:55:26.791725    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7xbsn\" (UniqueName: \"kubernetes.io/projected/fb332863-ffb2-4ea3-aba3-f75ff97f41e2-kube-api-access-7xbsn\") pod \"fb332863-ffb2-4ea3-aba3-f75ff97f41e2\" (UID: \"fb332863-ffb2-4ea3-aba3-f75ff97f41e2\") "
Jul 15 21:55:26.791917 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:55:26.791775    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fb332863-ffb2-4ea3-aba3-f75ff97f41e2-maas-api-tls\") pod \"fb332863-ffb2-4ea3-aba3-f75ff97f41e2\" (UID: \"fb332863-ffb2-4ea3-aba3-f75ff97f41e2\") "
Jul 15 21:55:26.791917 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:55:26.791885    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fb332863-ffb2-4ea3-aba3-f75ff97f41e2-openshift-service-ca\") pod \"fb332863-ffb2-4ea3-aba3-f75ff97f41e2\" (UID: \"fb332863-ffb2-4ea3-aba3-f75ff97f41e2\") "
Jul 15 21:55:26.792246 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:55:26.792224    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fb332863-ffb2-4ea3-aba3-f75ff97f41e2-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "fb332863-ffb2-4ea3-aba3-f75ff97f41e2" (UID: "fb332863-ffb2-4ea3-aba3-f75ff97f41e2"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 21:55:26.794001 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:55:26.793972    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fb332863-ffb2-4ea3-aba3-f75ff97f41e2-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "fb332863-ffb2-4ea3-aba3-f75ff97f41e2" (UID: "fb332863-ffb2-4ea3-aba3-f75ff97f41e2"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 21:55:26.794126 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:55:26.794078    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fb332863-ffb2-4ea3-aba3-f75ff97f41e2-kube-api-access-7xbsn" (OuterVolumeSpecName: "kube-api-access-7xbsn") pod "fb332863-ffb2-4ea3-aba3-f75ff97f41e2" (UID: "fb332863-ffb2-4ea3-aba3-f75ff97f41e2"). InnerVolumeSpecName "kube-api-access-7xbsn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 21:55:26.892923 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:55:26.892882    2563 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fb332863-ffb2-4ea3-aba3-f75ff97f41e2-openshift-service-ca\") on node \"ip-10-0-130-217.ec2.internal\" DevicePath \"\""
Jul 15 21:55:26.892923 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:55:26.892915    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7xbsn\" (UniqueName: \"kubernetes.io/projected/fb332863-ffb2-4ea3-aba3-f75ff97f41e2-kube-api-access-7xbsn\") on node \"ip-10-0-130-217.ec2.internal\" DevicePath \"\""
Jul 15 21:55:26.892923 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:55:26.892926    2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fb332863-ffb2-4ea3-aba3-f75ff97f41e2-maas-api-tls\") on node \"ip-10-0-130-217.ec2.internal\" DevicePath \"\""
Jul 15 21:55:27.698559 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:55:27.698526    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a41b0fdd-ddffb7568-4srdv"
Jul 15 21:55:27.699051 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:55:27.698559    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a41b0fdd-ddffb7568-4srdv" event={"ID":"fb332863-ffb2-4ea3-aba3-f75ff97f41e2","Type":"ContainerDied","Data":"2a4b52082d14e0a197f54f9b216487c38209fd15997f36bd8a28c529cb64b00b"}
Jul 15 21:55:27.699051 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:55:27.698617    2563 scope.go:117] "RemoveContainer" containerID="7b36de0e462c86fee499aa32326d087691c78676f660abde3819a6ab428d7d46"
Jul 15 21:55:27.712914 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:55:27.712866    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-a41b0fdd-ddffb7568-4srdv"]
Jul 15 21:55:27.715141 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:55:27.715119    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-a41b0fdd-ddffb7568-4srdv"]
Jul 15 21:55:28.989268 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:55:28.989234    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fb332863-ffb2-4ea3-aba3-f75ff97f41e2" path="/var/lib/kubelet/pods/fb332863-ffb2-4ea3-aba3-f75ff97f41e2/volumes"
Jul 15 21:55:41.138729 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:55:41.138691    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-a41b0fdd-openshift-default-5755c7985f-6lxdj"]
Jul 15 21:55:41.139195 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:55:41.138897    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-a41b0fdd-openshift-default-5755c7985f-6lxdj" podUID="de412610-9b3f-4b81-9655-c1b7c9597696" containerName="istio-proxy" containerID="cri-o://348010a207b902b621391040482130a373ba19673176624f0deb1aea2a5e322d" gracePeriod=30
Jul 15 21:55:41.697316 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:55:41.697278    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-migrate-02eac3fc-gw-openshift-default-6b7675c4f5-l8588"]
Jul 15 21:55:41.697786 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:55:41.697761    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fb332863-ffb2-4ea3-aba3-f75ff97f41e2" containerName="maas-api"
Jul 15 21:55:41.697786 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:55:41.697780    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="fb332863-ffb2-4ea3-aba3-f75ff97f41e2" containerName="maas-api"
Jul 15 21:55:41.697786 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:55:41.697793    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="13303763-e6f0-4e52-8bd2-e2abd426321a" containerName="revoke-keys"
Jul 15 21:55:41.697786 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:55:41.697801    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="13303763-e6f0-4e52-8bd2-e2abd426321a" containerName="revoke-keys"
Jul 15 21:55:41.698103 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:55:41.697890    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="13303763-e6f0-4e52-8bd2-e2abd426321a" containerName="revoke-keys"
Jul 15 21:55:41.698103 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:55:41.697901    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="fb332863-ffb2-4ea3-aba3-f75ff97f41e2" containerName="maas-api"
Jul 15 21:55:41.698103 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:55:41.697909    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="28668c9c-4419-4b48-8e6f-a683698b7ba0" containerName="revoke-keys"
Jul 15 21:55:41.701261 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:55:41.701242    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-02eac3fc-gw-openshift-default-6b7675c4f5-l8588"
Jul 15 21:55:41.703322 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:55:41.703298    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-migrate-02eac3fc-gw-openshift-default-dockercfg-6rvt8\""
Jul 15 21:55:41.712136 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:55:41.712112    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-02eac3fc-gw-openshift-default-6b7675c4f5-l8588"]
Jul 15 21:55:41.841830 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:55:41.841798    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9578b013-22fc-48eb-987a-5adcf641a800-istio-envoy\") pod \"e2e-migrate-02eac3fc-gw-openshift-default-6b7675c4f5-l8588\" (UID: \"9578b013-22fc-48eb-987a-5adcf641a800\") " pod="openshift-ingress/e2e-migrate-02eac3fc-gw-openshift-default-6b7675c4f5-l8588"
Jul 15 21:55:41.841830 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:55:41.841832    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9578b013-22fc-48eb-987a-5adcf641a800-istio-data\") pod \"e2e-migrate-02eac3fc-gw-openshift-default-6b7675c4f5-l8588\" (UID: \"9578b013-22fc-48eb-987a-5adcf641a800\") " pod="openshift-ingress/e2e-migrate-02eac3fc-gw-openshift-default-6b7675c4f5-l8588"
Jul 15 21:55:41.842094 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:55:41.841864    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9578b013-22fc-48eb-987a-5adcf641a800-workload-certs\") pod \"e2e-migrate-02eac3fc-gw-openshift-default-6b7675c4f5-l8588\" (UID: \"9578b013-22fc-48eb-987a-5adcf641a800\") " pod="openshift-ingress/e2e-migrate-02eac3fc-gw-openshift-default-6b7675c4f5-l8588"
Jul 15 21:55:41.842094 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:55:41.842007    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9578b013-22fc-48eb-987a-5adcf641a800-istiod-ca-cert\") pod \"e2e-migrate-02eac3fc-gw-openshift-default-6b7675c4f5-l8588\" (UID: \"9578b013-22fc-48eb-987a-5adcf641a800\") " pod="openshift-ingress/e2e-migrate-02eac3fc-gw-openshift-default-6b7675c4f5-l8588"
Jul 15 21:55:41.842094 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:55:41.842048    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9578b013-22fc-48eb-987a-5adcf641a800-workload-socket\") pod \"e2e-migrate-02eac3fc-gw-openshift-default-6b7675c4f5-l8588\" (UID: \"9578b013-22fc-48eb-987a-5adcf641a800\") " pod="openshift-ingress/e2e-migrate-02eac3fc-gw-openshift-default-6b7675c4f5-l8588"
Jul 15 21:55:41.842094 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:55:41.842067    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9578b013-22fc-48eb-987a-5adcf641a800-istio-token\") pod \"e2e-migrate-02eac3fc-gw-openshift-default-6b7675c4f5-l8588\" (UID: \"9578b013-22fc-48eb-987a-5adcf641a800\") " pod="openshift-ingress/e2e-migrate-02eac3fc-gw-openshift-default-6b7675c4f5-l8588"
Jul 15 21:55:41.842094 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:55:41.842093    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9578b013-22fc-48eb-987a-5adcf641a800-credential-socket\") pod \"e2e-migrate-02eac3fc-gw-openshift-default-6b7675c4f5-l8588\" (UID: \"9578b013-22fc-48eb-987a-5adcf641a800\") " pod="openshift-ingress/e2e-migrate-02eac3fc-gw-openshift-default-6b7675c4f5-l8588"
Jul 15 21:55:41.842277 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:55:41.842112    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9578b013-22fc-48eb-987a-5adcf641a800-istio-podinfo\") pod \"e2e-migrate-02eac3fc-gw-openshift-default-6b7675c4f5-l8588\" (UID: \"9578b013-22fc-48eb-987a-5adcf641a800\") " pod="openshift-ingress/e2e-migrate-02eac3fc-gw-openshift-default-6b7675c4f5-l8588"
Jul 15 21:55:41.842277 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:55:41.842179    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rflnm\" (UniqueName: \"kubernetes.io/projected/9578b013-22fc-48eb-987a-5adcf641a800-kube-api-access-rflnm\") pod \"e2e-migrate-02eac3fc-gw-openshift-default-6b7675c4f5-l8588\" (UID: \"9578b013-22fc-48eb-987a-5adcf641a800\") " pod="openshift-ingress/e2e-migrate-02eac3fc-gw-openshift-default-6b7675c4f5-l8588"
Jul 15 21:55:41.943392 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:55:41.943340    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9578b013-22fc-48eb-987a-5adcf641a800-istiod-ca-cert\") pod \"e2e-migrate-02eac3fc-gw-openshift-default-6b7675c4f5-l8588\" (UID: \"9578b013-22fc-48eb-987a-5adcf641a800\") " pod="openshift-ingress/e2e-migrate-02eac3fc-gw-openshift-default-6b7675c4f5-l8588"
Jul 15 21:55:41.943392 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:55:41.943397    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9578b013-22fc-48eb-987a-5adcf641a800-workload-socket\") pod \"e2e-migrate-02eac3fc-gw-openshift-default-6b7675c4f5-l8588\" (UID: \"9578b013-22fc-48eb-987a-5adcf641a800\") " pod="openshift-ingress/e2e-migrate-02eac3fc-gw-openshift-default-6b7675c4f5-l8588"
Jul 15 21:55:41.943647 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:55:41.943417    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9578b013-22fc-48eb-987a-5adcf641a800-istio-token\") pod \"e2e-migrate-02eac3fc-gw-openshift-default-6b7675c4f5-l8588\" (UID: \"9578b013-22fc-48eb-987a-5adcf641a800\") " pod="openshift-ingress/e2e-migrate-02eac3fc-gw-openshift-default-6b7675c4f5-l8588"
Jul 15 21:55:41.943647 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:55:41.943447    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9578b013-22fc-48eb-987a-5adcf641a800-credential-socket\") pod \"e2e-migrate-02eac3fc-gw-openshift-default-6b7675c4f5-l8588\" (UID: \"9578b013-22fc-48eb-987a-5adcf641a800\") " pod="openshift-ingress/e2e-migrate-02eac3fc-gw-openshift-default-6b7675c4f5-l8588"
Jul 15 21:55:41.943647 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:55:41.943466    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9578b013-22fc-48eb-987a-5adcf641a800-istio-podinfo\") pod \"e2e-migrate-02eac3fc-gw-openshift-default-6b7675c4f5-l8588\" (UID: \"9578b013-22fc-48eb-987a-5adcf641a800\") " pod="openshift-ingress/e2e-migrate-02eac3fc-gw-openshift-default-6b7675c4f5-l8588"
Jul 15 21:55:41.943647 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:55:41.943512    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rflnm\" (UniqueName: \"kubernetes.io/projected/9578b013-22fc-48eb-987a-5adcf641a800-kube-api-access-rflnm\") pod \"e2e-migrate-02eac3fc-gw-openshift-default-6b7675c4f5-l8588\" (UID: \"9578b013-22fc-48eb-987a-5adcf641a800\") " pod="openshift-ingress/e2e-migrate-02eac3fc-gw-openshift-default-6b7675c4f5-l8588"
Jul 15 21:55:41.943876 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:55:41.943842    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9578b013-22fc-48eb-987a-5adcf641a800-istio-envoy\") pod \"e2e-migrate-02eac3fc-gw-openshift-default-6b7675c4f5-l8588\" (UID: \"9578b013-22fc-48eb-987a-5adcf641a800\") " pod="openshift-ingress/e2e-migrate-02eac3fc-gw-openshift-default-6b7675c4f5-l8588"
Jul 15 21:55:41.944038 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:55:41.943895    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9578b013-22fc-48eb-987a-5adcf641a800-istio-data\") pod \"e2e-migrate-02eac3fc-gw-openshift-default-6b7675c4f5-l8588\" (UID: \"9578b013-22fc-48eb-987a-5adcf641a800\") " pod="openshift-ingress/e2e-migrate-02eac3fc-gw-openshift-default-6b7675c4f5-l8588"
Jul 15 21:55:41.944038 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:55:41.943956    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9578b013-22fc-48eb-987a-5adcf641a800-workload-certs\") pod \"e2e-migrate-02eac3fc-gw-openshift-default-6b7675c4f5-l8588\" (UID: \"9578b013-22fc-48eb-987a-5adcf641a800\") " pod="openshift-ingress/e2e-migrate-02eac3fc-gw-openshift-default-6b7675c4f5-l8588"
Jul 15 21:55:41.944038 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:55:41.943964    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9578b013-22fc-48eb-987a-5adcf641a800-credential-socket\") pod \"e2e-migrate-02eac3fc-gw-openshift-default-6b7675c4f5-l8588\" (UID: \"9578b013-22fc-48eb-987a-5adcf641a800\") " pod="openshift-ingress/e2e-migrate-02eac3fc-gw-openshift-default-6b7675c4f5-l8588"
Jul 15 21:55:41.944215 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:55:41.943897    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9578b013-22fc-48eb-987a-5adcf641a800-workload-socket\") pod \"e2e-migrate-02eac3fc-gw-openshift-default-6b7675c4f5-l8588\" (UID: \"9578b013-22fc-48eb-987a-5adcf641a800\") " pod="openshift-ingress/e2e-migrate-02eac3fc-gw-openshift-default-6b7675c4f5-l8588"
Jul 15 21:55:41.944317 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:55:41.944293    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9578b013-22fc-48eb-987a-5adcf641a800-workload-certs\") pod \"e2e-migrate-02eac3fc-gw-openshift-default-6b7675c4f5-l8588\" (UID: \"9578b013-22fc-48eb-987a-5adcf641a800\") " pod="openshift-ingress/e2e-migrate-02eac3fc-gw-openshift-default-6b7675c4f5-l8588"
Jul 15 21:55:41.944387 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:55:41.944216    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9578b013-22fc-48eb-987a-5adcf641a800-istiod-ca-cert\") pod \"e2e-migrate-02eac3fc-gw-openshift-default-6b7675c4f5-l8588\" (UID: \"9578b013-22fc-48eb-987a-5adcf641a800\") " pod="openshift-ingress/e2e-migrate-02eac3fc-gw-openshift-default-6b7675c4f5-l8588"
Jul 15 21:55:41.944387 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:55:41.944347    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9578b013-22fc-48eb-987a-5adcf641a800-istio-data\") pod \"e2e-migrate-02eac3fc-gw-openshift-default-6b7675c4f5-l8588\" (UID: \"9578b013-22fc-48eb-987a-5adcf641a800\") " pod="openshift-ingress/e2e-migrate-02eac3fc-gw-openshift-default-6b7675c4f5-l8588"
Jul 15 21:55:41.946311 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:55:41.946285    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9578b013-22fc-48eb-987a-5adcf641a800-istio-podinfo\") pod \"e2e-migrate-02eac3fc-gw-openshift-default-6b7675c4f5-l8588\" (UID: \"9578b013-22fc-48eb-987a-5adcf641a800\") " pod="openshift-ingress/e2e-migrate-02eac3fc-gw-openshift-default-6b7675c4f5-l8588"
Jul 15 21:55:41.946311 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:55:41.946299    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9578b013-22fc-48eb-987a-5adcf641a800-istio-envoy\") pod \"e2e-migrate-02eac3fc-gw-openshift-default-6b7675c4f5-l8588\" (UID: \"9578b013-22fc-48eb-987a-5adcf641a800\") " pod="openshift-ingress/e2e-migrate-02eac3fc-gw-openshift-default-6b7675c4f5-l8588"
Jul 15 21:55:41.951162 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:55:41.951104    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9578b013-22fc-48eb-987a-5adcf641a800-istio-token\") pod \"e2e-migrate-02eac3fc-gw-openshift-default-6b7675c4f5-l8588\" (UID: \"9578b013-22fc-48eb-987a-5adcf641a800\") " pod="openshift-ingress/e2e-migrate-02eac3fc-gw-openshift-default-6b7675c4f5-l8588"
Jul 15 21:55:41.951414 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:55:41.951397    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rflnm\" (UniqueName: \"kubernetes.io/projected/9578b013-22fc-48eb-987a-5adcf641a800-kube-api-access-rflnm\") pod \"e2e-migrate-02eac3fc-gw-openshift-default-6b7675c4f5-l8588\" (UID: \"9578b013-22fc-48eb-987a-5adcf641a800\") " pod="openshift-ingress/e2e-migrate-02eac3fc-gw-openshift-default-6b7675c4f5-l8588"
Jul 15 21:55:42.014742 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:55:42.014706    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-02eac3fc-gw-openshift-default-6b7675c4f5-l8588"
Jul 15 21:55:42.163602 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:55:42.163576    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-02eac3fc-gw-openshift-default-6b7675c4f5-l8588"]
Jul 15 21:55:42.165192 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:55:42.165165    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9578b013_22fc_48eb_987a_5adcf641a800.slice/crio-91202e5c91ddc633201c96836e2ac5c459346e55a212ef32274ad477b5c6e3d0 WatchSource:0}: Error finding container 91202e5c91ddc633201c96836e2ac5c459346e55a212ef32274ad477b5c6e3d0: Status 404 returned error can't find the container with id 91202e5c91ddc633201c96836e2ac5c459346e55a212ef32274ad477b5c6e3d0
Jul 15 21:55:42.167446 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:55:42.167414    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 15 21:55:42.167527 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:55:42.167482    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 15 21:55:42.167527 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:55:42.167514    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 15 21:55:42.775736 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:55:42.775696    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-02eac3fc-gw-openshift-default-6b7675c4f5-l8588" event={"ID":"9578b013-22fc-48eb-987a-5adcf641a800","Type":"ContainerStarted","Data":"25a056abf9e87743c6040d13607c7029ab43e04b82356020aaebfa035ff542d4"}
Jul 15 21:55:42.775925 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:55:42.775762    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-02eac3fc-gw-openshift-default-6b7675c4f5-l8588" event={"ID":"9578b013-22fc-48eb-987a-5adcf641a800","Type":"ContainerStarted","Data":"91202e5c91ddc633201c96836e2ac5c459346e55a212ef32274ad477b5c6e3d0"}
Jul 15 21:55:42.797158 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:55:42.797108    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-migrate-02eac3fc-gw-openshift-default-6b7675c4f5-l8588" podStartSLOduration=1.797091799 podStartE2EDuration="1.797091799s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:55:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:55:42.79619295 +0000 UTC m=+1592.490120501" watchObservedRunningTime="2026-07-15 21:55:42.797091799 +0000 UTC m=+1592.491019350"
Jul 15 21:55:43.015110 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:55:43.015066    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-02eac3fc-gw-openshift-default-6b7675c4f5-l8588"
Jul 15 21:55:43.020435 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:55:43.020407    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-02eac3fc-gw-openshift-default-6b7675c4f5-l8588"
Jul 15 21:55:43.078597 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:55:43.078553    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-02eac3fc-585fd5f878-52pz7"]
Jul 15 21:55:43.082835 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:55:43.082812    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-02eac3fc-585fd5f878-52pz7"
Jul 15 21:55:43.084732 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:55:43.084711    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-migrate-02eac3fc-serving-cert\""
Jul 15 21:55:43.093240 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:55:43.092180    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-02eac3fc-585fd5f878-52pz7"]
Jul 15 21:55:43.258136 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:55:43.258104    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4gqkk\" (UniqueName: \"kubernetes.io/projected/84c7ba00-138f-4d58-a923-397c39564ca5-kube-api-access-4gqkk\") pod \"maas-api-e2e-migrate-02eac3fc-585fd5f878-52pz7\" (UID: \"84c7ba00-138f-4d58-a923-397c39564ca5\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-02eac3fc-585fd5f878-52pz7"
Jul 15 21:55:43.258508 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:55:43.258200    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/84c7ba00-138f-4d58-a923-397c39564ca5-maas-api-tls\") pod \"maas-api-e2e-migrate-02eac3fc-585fd5f878-52pz7\" (UID: \"84c7ba00-138f-4d58-a923-397c39564ca5\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-02eac3fc-585fd5f878-52pz7"
Jul 15 21:55:43.258508 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:55:43.258240    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/84c7ba00-138f-4d58-a923-397c39564ca5-openshift-service-ca\") pod \"maas-api-e2e-migrate-02eac3fc-585fd5f878-52pz7\" (UID: \"84c7ba00-138f-4d58-a923-397c39564ca5\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-02eac3fc-585fd5f878-52pz7"
Jul 15 21:55:43.359520 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:55:43.359429    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/84c7ba00-138f-4d58-a923-397c39564ca5-maas-api-tls\") pod \"maas-api-e2e-migrate-02eac3fc-585fd5f878-52pz7\" (UID: \"84c7ba00-138f-4d58-a923-397c39564ca5\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-02eac3fc-585fd5f878-52pz7"
Jul 15 21:55:43.359520 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:55:43.359498    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/84c7ba00-138f-4d58-a923-397c39564ca5-openshift-service-ca\") pod \"maas-api-e2e-migrate-02eac3fc-585fd5f878-52pz7\" (UID: \"84c7ba00-138f-4d58-a923-397c39564ca5\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-02eac3fc-585fd5f878-52pz7"
Jul 15 21:55:43.359703 ip-10-0-130-217 kubenswrapper[2563]: E0715 21:55:43.359585    2563 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-migrate-02eac3fc-serving-cert: secret "maas-api-e2e-migrate-02eac3fc-serving-cert" not found
Jul 15 21:55:43.359703 ip-10-0-130-217 kubenswrapper[2563]: E0715 21:55:43.359650    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/84c7ba00-138f-4d58-a923-397c39564ca5-maas-api-tls podName:84c7ba00-138f-4d58-a923-397c39564ca5 nodeName:}" failed. No retries permitted until 2026-07-15 21:55:43.859629031 +0000 UTC m=+1593.553556563 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/84c7ba00-138f-4d58-a923-397c39564ca5-maas-api-tls") pod "maas-api-e2e-migrate-02eac3fc-585fd5f878-52pz7" (UID: "84c7ba00-138f-4d58-a923-397c39564ca5") : secret "maas-api-e2e-migrate-02eac3fc-serving-cert" not found
Jul 15 21:55:43.359703 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:55:43.359667    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4gqkk\" (UniqueName: \"kubernetes.io/projected/84c7ba00-138f-4d58-a923-397c39564ca5-kube-api-access-4gqkk\") pod \"maas-api-e2e-migrate-02eac3fc-585fd5f878-52pz7\" (UID: \"84c7ba00-138f-4d58-a923-397c39564ca5\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-02eac3fc-585fd5f878-52pz7"
Jul 15 21:55:43.360256 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:55:43.360234    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/84c7ba00-138f-4d58-a923-397c39564ca5-openshift-service-ca\") pod \"maas-api-e2e-migrate-02eac3fc-585fd5f878-52pz7\" (UID: \"84c7ba00-138f-4d58-a923-397c39564ca5\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-02eac3fc-585fd5f878-52pz7"
Jul 15 21:55:43.367471 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:55:43.367437    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4gqkk\" (UniqueName: \"kubernetes.io/projected/84c7ba00-138f-4d58-a923-397c39564ca5-kube-api-access-4gqkk\") pod \"maas-api-e2e-migrate-02eac3fc-585fd5f878-52pz7\" (UID: \"84c7ba00-138f-4d58-a923-397c39564ca5\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-02eac3fc-585fd5f878-52pz7"
Jul 15 21:55:43.780986 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:55:43.780864    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-02eac3fc-gw-openshift-default-6b7675c4f5-l8588"
Jul 15 21:55:43.781780 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:55:43.781759    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-02eac3fc-gw-openshift-default-6b7675c4f5-l8588"
Jul 15 21:55:43.865024 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:55:43.864986    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/84c7ba00-138f-4d58-a923-397c39564ca5-maas-api-tls\") pod \"maas-api-e2e-migrate-02eac3fc-585fd5f878-52pz7\" (UID: \"84c7ba00-138f-4d58-a923-397c39564ca5\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-02eac3fc-585fd5f878-52pz7"
Jul 15 21:55:43.867503 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:55:43.867468    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/84c7ba00-138f-4d58-a923-397c39564ca5-maas-api-tls\") pod \"maas-api-e2e-migrate-02eac3fc-585fd5f878-52pz7\" (UID: \"84c7ba00-138f-4d58-a923-397c39564ca5\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-02eac3fc-585fd5f878-52pz7"
Jul 15 21:55:43.998100 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:55:43.998063    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-02eac3fc-585fd5f878-52pz7"
Jul 15 21:55:44.345880 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:55:44.345853    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-02eac3fc-585fd5f878-52pz7"]
Jul 15 21:55:44.347575 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:55:44.347546    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod84c7ba00_138f_4d58_a923_397c39564ca5.slice/crio-ef91a22f85ac20d7712be0e951e60c12b51b4d55ee2be3e5024de92151904b19 WatchSource:0}: Error finding container ef91a22f85ac20d7712be0e951e60c12b51b4d55ee2be3e5024de92151904b19: Status 404 returned error can't find the container with id ef91a22f85ac20d7712be0e951e60c12b51b4d55ee2be3e5024de92151904b19
Jul 15 21:55:44.788829 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:55:44.788795    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-02eac3fc-585fd5f878-52pz7" event={"ID":"84c7ba00-138f-4d58-a923-397c39564ca5","Type":"ContainerStarted","Data":"ef91a22f85ac20d7712be0e951e60c12b51b4d55ee2be3e5024de92151904b19"}
Jul 15 21:55:45.795201 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:55:45.795163    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-02eac3fc-585fd5f878-52pz7" event={"ID":"84c7ba00-138f-4d58-a923-397c39564ca5","Type":"ContainerStarted","Data":"4358e6d3b5c3b7b09b8168ba2a8eee658b2b6eec701521cc6a7780f12554f437"}
Jul 15 21:55:45.795633 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:55:45.795261    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-02eac3fc-585fd5f878-52pz7"
Jul 15 21:55:45.813679 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:55:45.813632    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-02eac3fc-585fd5f878-52pz7" podStartSLOduration=2.395070697 podStartE2EDuration="2.813617681s" totalImagesPullingTime="418.546984ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:55:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:55:45.811676443 +0000 UTC m=+1595.505603990" watchObservedRunningTime="2026-07-15 21:55:45.813617681 +0000 UTC m=+1595.507545232"
Jul 15 21:55:46.442469 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:55:46.442442    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-a41b0fdd-openshift-default-5755c7985f-6lxdj"
Jul 15 21:55:46.601960 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:55:46.598970    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/de412610-9b3f-4b81-9655-c1b7c9597696-istio-podinfo\") pod \"de412610-9b3f-4b81-9655-c1b7c9597696\" (UID: \"de412610-9b3f-4b81-9655-c1b7c9597696\") "
Jul 15 21:55:46.601960 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:55:46.599031    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/de412610-9b3f-4b81-9655-c1b7c9597696-credential-socket\") pod \"de412610-9b3f-4b81-9655-c1b7c9597696\" (UID: \"de412610-9b3f-4b81-9655-c1b7c9597696\") "
Jul 15 21:55:46.601960 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:55:46.599089    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/de412610-9b3f-4b81-9655-c1b7c9597696-istio-envoy\") pod \"de412610-9b3f-4b81-9655-c1b7c9597696\" (UID: \"de412610-9b3f-4b81-9655-c1b7c9597696\") "
Jul 15 21:55:46.601960 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:55:46.599116    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-krrrs\" (UniqueName: \"kubernetes.io/projected/de412610-9b3f-4b81-9655-c1b7c9597696-kube-api-access-krrrs\") pod \"de412610-9b3f-4b81-9655-c1b7c9597696\" (UID: \"de412610-9b3f-4b81-9655-c1b7c9597696\") "
Jul 15 21:55:46.601960 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:55:46.599192    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/de412610-9b3f-4b81-9655-c1b7c9597696-istio-data\") pod \"de412610-9b3f-4b81-9655-c1b7c9597696\" (UID: \"de412610-9b3f-4b81-9655-c1b7c9597696\") "
Jul 15 21:55:46.601960 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:55:46.599228    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/de412610-9b3f-4b81-9655-c1b7c9597696-workload-certs\") pod \"de412610-9b3f-4b81-9655-c1b7c9597696\" (UID: \"de412610-9b3f-4b81-9655-c1b7c9597696\") "
Jul 15 21:55:46.601960 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:55:46.599285    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/de412610-9b3f-4b81-9655-c1b7c9597696-workload-socket\") pod \"de412610-9b3f-4b81-9655-c1b7c9597696\" (UID: \"de412610-9b3f-4b81-9655-c1b7c9597696\") "
Jul 15 21:55:46.601960 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:55:46.599319    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/de412610-9b3f-4b81-9655-c1b7c9597696-istio-token\") pod \"de412610-9b3f-4b81-9655-c1b7c9597696\" (UID: \"de412610-9b3f-4b81-9655-c1b7c9597696\") "
Jul 15 21:55:46.601960 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:55:46.599407    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/de412610-9b3f-4b81-9655-c1b7c9597696-istiod-ca-cert\") pod \"de412610-9b3f-4b81-9655-c1b7c9597696\" (UID: \"de412610-9b3f-4b81-9655-c1b7c9597696\") "
Jul 15 21:55:46.603643 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:55:46.602737    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/de412610-9b3f-4b81-9655-c1b7c9597696-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "de412610-9b3f-4b81-9655-c1b7c9597696" (UID: "de412610-9b3f-4b81-9655-c1b7c9597696"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 21:55:46.603643 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:55:46.603262    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/de412610-9b3f-4b81-9655-c1b7c9597696-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "de412610-9b3f-4b81-9655-c1b7c9597696" (UID: "de412610-9b3f-4b81-9655-c1b7c9597696"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 21:55:46.604344 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:55:46.604252    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/de412610-9b3f-4b81-9655-c1b7c9597696-istio-data" (OuterVolumeSpecName: "istio-data") pod "de412610-9b3f-4b81-9655-c1b7c9597696" (UID: "de412610-9b3f-4b81-9655-c1b7c9597696"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 21:55:46.607156 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:55:46.607115    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/de412610-9b3f-4b81-9655-c1b7c9597696-istio-token" (OuterVolumeSpecName: "istio-token") pod "de412610-9b3f-4b81-9655-c1b7c9597696" (UID: "de412610-9b3f-4b81-9655-c1b7c9597696"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 21:55:46.607156 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:55:46.607137    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/de412610-9b3f-4b81-9655-c1b7c9597696-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "de412610-9b3f-4b81-9655-c1b7c9597696" (UID: "de412610-9b3f-4b81-9655-c1b7c9597696"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 15 21:55:46.607319 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:55:46.607183    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/de412610-9b3f-4b81-9655-c1b7c9597696-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "de412610-9b3f-4b81-9655-c1b7c9597696" (UID: "de412610-9b3f-4b81-9655-c1b7c9597696"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 21:55:46.607445 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:55:46.607418    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/de412610-9b3f-4b81-9655-c1b7c9597696-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "de412610-9b3f-4b81-9655-c1b7c9597696" (UID: "de412610-9b3f-4b81-9655-c1b7c9597696"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 21:55:46.607558 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:55:46.607538    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/de412610-9b3f-4b81-9655-c1b7c9597696-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "de412610-9b3f-4b81-9655-c1b7c9597696" (UID: "de412610-9b3f-4b81-9655-c1b7c9597696"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 21:55:46.607730 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:55:46.607706    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/de412610-9b3f-4b81-9655-c1b7c9597696-kube-api-access-krrrs" (OuterVolumeSpecName: "kube-api-access-krrrs") pod "de412610-9b3f-4b81-9655-c1b7c9597696" (UID: "de412610-9b3f-4b81-9655-c1b7c9597696"). InnerVolumeSpecName "kube-api-access-krrrs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 21:55:46.700635 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:55:46.700518    2563 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/de412610-9b3f-4b81-9655-c1b7c9597696-istiod-ca-cert\") on node \"ip-10-0-130-217.ec2.internal\" DevicePath \"\""
Jul 15 21:55:46.700635 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:55:46.700560    2563 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/de412610-9b3f-4b81-9655-c1b7c9597696-istio-podinfo\") on node \"ip-10-0-130-217.ec2.internal\" DevicePath \"\""
Jul 15 21:55:46.700635 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:55:46.700575    2563 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/de412610-9b3f-4b81-9655-c1b7c9597696-credential-socket\") on node \"ip-10-0-130-217.ec2.internal\" DevicePath \"\""
Jul 15 21:55:46.700635 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:55:46.700589    2563 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/de412610-9b3f-4b81-9655-c1b7c9597696-istio-envoy\") on node \"ip-10-0-130-217.ec2.internal\" DevicePath \"\""
Jul 15 21:55:46.700635 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:55:46.700602    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-krrrs\" (UniqueName: \"kubernetes.io/projected/de412610-9b3f-4b81-9655-c1b7c9597696-kube-api-access-krrrs\") on node \"ip-10-0-130-217.ec2.internal\" DevicePath \"\""
Jul 15 21:55:46.700635 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:55:46.700616    2563 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/de412610-9b3f-4b81-9655-c1b7c9597696-istio-data\") on node \"ip-10-0-130-217.ec2.internal\" DevicePath \"\""
Jul 15 21:55:46.700635 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:55:46.700629    2563 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/de412610-9b3f-4b81-9655-c1b7c9597696-workload-certs\") on node \"ip-10-0-130-217.ec2.internal\" DevicePath \"\""
Jul 15 21:55:46.700635 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:55:46.700644    2563 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/de412610-9b3f-4b81-9655-c1b7c9597696-workload-socket\") on node \"ip-10-0-130-217.ec2.internal\" DevicePath \"\""
Jul 15 21:55:46.701194 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:55:46.700657    2563 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/de412610-9b3f-4b81-9655-c1b7c9597696-istio-token\") on node \"ip-10-0-130-217.ec2.internal\" DevicePath \"\""
Jul 15 21:55:46.806714 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:55:46.806678    2563 generic.go:356] "Generic (PLEG): container finished" podID="de412610-9b3f-4b81-9655-c1b7c9597696" containerID="348010a207b902b621391040482130a373ba19673176624f0deb1aea2a5e322d" exitCode=0
Jul 15 21:55:46.807211 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:55:46.806736    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-a41b0fdd-openshift-default-5755c7985f-6lxdj"
Jul 15 21:55:46.807211 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:55:46.806766    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-a41b0fdd-openshift-default-5755c7985f-6lxdj" event={"ID":"de412610-9b3f-4b81-9655-c1b7c9597696","Type":"ContainerDied","Data":"348010a207b902b621391040482130a373ba19673176624f0deb1aea2a5e322d"}
Jul 15 21:55:46.807211 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:55:46.806841    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-a41b0fdd-openshift-default-5755c7985f-6lxdj" event={"ID":"de412610-9b3f-4b81-9655-c1b7c9597696","Type":"ContainerDied","Data":"2bd11668d414f7ee9ab3924066e591d70a8ec1eeec32c57620aa65ad73e3da08"}
Jul 15 21:55:46.807211 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:55:46.806873    2563 scope.go:117] "RemoveContainer" containerID="348010a207b902b621391040482130a373ba19673176624f0deb1aea2a5e322d"
Jul 15 21:55:46.816237 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:55:46.816222    2563 scope.go:117] "RemoveContainer" containerID="17c3c3e4e9b83d780b869f23341ef5e2198eb4190a8f78fa2fccf37bba04fa78"
Jul 15 21:55:46.824877 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:55:46.824858    2563 scope.go:117] "RemoveContainer" containerID="348010a207b902b621391040482130a373ba19673176624f0deb1aea2a5e322d"
Jul 15 21:55:46.825260 ip-10-0-130-217 kubenswrapper[2563]: E0715 21:55:46.825233    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"348010a207b902b621391040482130a373ba19673176624f0deb1aea2a5e322d\": container with ID starting with 348010a207b902b621391040482130a373ba19673176624f0deb1aea2a5e322d not found: ID does not exist" containerID="348010a207b902b621391040482130a373ba19673176624f0deb1aea2a5e322d"
Jul 15 21:55:46.825351 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:55:46.825274    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"348010a207b902b621391040482130a373ba19673176624f0deb1aea2a5e322d"} err="failed to get container status \"348010a207b902b621391040482130a373ba19673176624f0deb1aea2a5e322d\": rpc error: code = NotFound desc = could not find container \"348010a207b902b621391040482130a373ba19673176624f0deb1aea2a5e322d\": container with ID starting with 348010a207b902b621391040482130a373ba19673176624f0deb1aea2a5e322d not found: ID does not exist"
Jul 15 21:55:46.825351 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:55:46.825298    2563 scope.go:117] "RemoveContainer" containerID="17c3c3e4e9b83d780b869f23341ef5e2198eb4190a8f78fa2fccf37bba04fa78"
Jul 15 21:55:46.825728 ip-10-0-130-217 kubenswrapper[2563]: E0715 21:55:46.825635    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"17c3c3e4e9b83d780b869f23341ef5e2198eb4190a8f78fa2fccf37bba04fa78\": container with ID starting with 17c3c3e4e9b83d780b869f23341ef5e2198eb4190a8f78fa2fccf37bba04fa78 not found: ID does not exist" containerID="17c3c3e4e9b83d780b869f23341ef5e2198eb4190a8f78fa2fccf37bba04fa78"
Jul 15 21:55:46.825728 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:55:46.825672    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"17c3c3e4e9b83d780b869f23341ef5e2198eb4190a8f78fa2fccf37bba04fa78"} err="failed to get container status \"17c3c3e4e9b83d780b869f23341ef5e2198eb4190a8f78fa2fccf37bba04fa78\": rpc error: code = NotFound desc = could not find container \"17c3c3e4e9b83d780b869f23341ef5e2198eb4190a8f78fa2fccf37bba04fa78\": container with ID starting with 17c3c3e4e9b83d780b869f23341ef5e2198eb4190a8f78fa2fccf37bba04fa78 not found: ID does not exist"
Jul 15 21:55:46.828078 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:55:46.828057    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-a41b0fdd-openshift-default-5755c7985f-6lxdj"]
Jul 15 21:55:46.831648 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:55:46.831625    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-a41b0fdd-openshift-default-5755c7985f-6lxdj"]
Jul 15 21:55:46.992600 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:55:46.992496    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="de412610-9b3f-4b81-9655-c1b7c9597696" path="/var/lib/kubelet/pods/de412610-9b3f-4b81-9655-c1b7c9597696/volumes"
Jul 15 21:55:47.558358 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:55:47.558328    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-02eac3fc-pthkt"]
Jul 15 21:55:47.558790 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:55:47.558758    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="de412610-9b3f-4b81-9655-c1b7c9597696" containerName="istio-proxy"
Jul 15 21:55:47.558844 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:55:47.558793    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="de412610-9b3f-4b81-9655-c1b7c9597696" containerName="istio-proxy"
Jul 15 21:55:47.558844 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:55:47.558811    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="de412610-9b3f-4b81-9655-c1b7c9597696" containerName="istio-proxy"
Jul 15 21:55:47.558844 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:55:47.558820    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="de412610-9b3f-4b81-9655-c1b7c9597696" containerName="istio-proxy"
Jul 15 21:55:47.558951 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:55:47.558897    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="de412610-9b3f-4b81-9655-c1b7c9597696" containerName="istio-proxy"
Jul 15 21:55:47.558951 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:55:47.558909    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="de412610-9b3f-4b81-9655-c1b7c9597696" containerName="istio-proxy"
Jul 15 21:55:47.563895 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:55:47.563872    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-02eac3fc-pthkt"
Jul 15 21:55:47.566647 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:55:47.566545    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-zx6nf\""
Jul 15 21:55:47.568563 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:55:47.568534    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-02eac3fc-pthkt"]
Jul 15 21:55:47.711739 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:55:47.711697    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9c800d1f-d678-4a22-8fd5-31f81784f935-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-02eac3fc-pthkt\" (UID: \"9c800d1f-d678-4a22-8fd5-31f81784f935\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-02eac3fc-pthkt"
Jul 15 21:55:47.812354 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:55:47.812237    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9c800d1f-d678-4a22-8fd5-31f81784f935-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-02eac3fc-pthkt\" (UID: \"9c800d1f-d678-4a22-8fd5-31f81784f935\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-02eac3fc-pthkt"
Jul 15 21:55:47.812919 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:55:47.812901    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9c800d1f-d678-4a22-8fd5-31f81784f935-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-02eac3fc-pthkt\" (UID: \"9c800d1f-d678-4a22-8fd5-31f81784f935\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-02eac3fc-pthkt"
Jul 15 21:55:47.899566 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:55:47.899528    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-02eac3fc-pthkt"
Jul 15 21:55:48.065811 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:55:48.065782    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-02eac3fc-pthkt"]
Jul 15 21:55:48.068721 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:55:48.068677    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9c800d1f_d678_4a22_8fd5_31f81784f935.slice/crio-b5e51bacd8c7ea53ae0bada4ab89666e1793433d0e0be01b9beefd5a381e0dc7 WatchSource:0}: Error finding container b5e51bacd8c7ea53ae0bada4ab89666e1793433d0e0be01b9beefd5a381e0dc7: Status 404 returned error can't find the container with id b5e51bacd8c7ea53ae0bada4ab89666e1793433d0e0be01b9beefd5a381e0dc7
Jul 15 21:55:48.819466 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:55:48.819378    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-02eac3fc-pthkt" event={"ID":"9c800d1f-d678-4a22-8fd5-31f81784f935","Type":"ContainerStarted","Data":"3f78f0b043ecbe4ff94287c4333ded8aa57ad8131b5d91cf7d8dcf13cfaeb804"}
Jul 15 21:55:48.819466 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:55:48.819431    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-02eac3fc-pthkt" event={"ID":"9c800d1f-d678-4a22-8fd5-31f81784f935","Type":"ContainerStarted","Data":"b5e51bacd8c7ea53ae0bada4ab89666e1793433d0e0be01b9beefd5a381e0dc7"}
Jul 15 21:55:48.833006 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:55:48.832926    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-02eac3fc-pthkt" podStartSLOduration=1.8329083019999999 podStartE2EDuration="1.832908302s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:55:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:55:48.832050593 +0000 UTC m=+1598.525978143" watchObservedRunningTime="2026-07-15 21:55:48.832908302 +0000 UTC m=+1598.526835856"
Jul 15 21:55:49.826514 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:55:49.826474    2563 generic.go:356] "Generic (PLEG): container finished" podID="9c800d1f-d678-4a22-8fd5-31f81784f935" containerID="3f78f0b043ecbe4ff94287c4333ded8aa57ad8131b5d91cf7d8dcf13cfaeb804" exitCode=7
Jul 15 21:55:49.827002 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:55:49.826563    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-02eac3fc-pthkt" event={"ID":"9c800d1f-d678-4a22-8fd5-31f81784f935","Type":"ContainerDied","Data":"3f78f0b043ecbe4ff94287c4333ded8aa57ad8131b5d91cf7d8dcf13cfaeb804"}
Jul 15 21:55:49.827002 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:55:49.826783    2563 scope.go:117] "RemoveContainer" containerID="3f78f0b043ecbe4ff94287c4333ded8aa57ad8131b5d91cf7d8dcf13cfaeb804"
Jul 15 21:55:50.834169 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:55:50.834133    2563 generic.go:356] "Generic (PLEG): container finished" podID="9c800d1f-d678-4a22-8fd5-31f81784f935" containerID="f33e53eaeb14fc9c26cbaf87848ed8764527ea214cbcfa21d7599d3e93484b41" exitCode=7
Jul 15 21:55:50.834656 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:55:50.834226    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-02eac3fc-pthkt" event={"ID":"9c800d1f-d678-4a22-8fd5-31f81784f935","Type":"ContainerDied","Data":"f33e53eaeb14fc9c26cbaf87848ed8764527ea214cbcfa21d7599d3e93484b41"}
Jul 15 21:55:50.834656 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:55:50.834350    2563 scope.go:117] "RemoveContainer" containerID="3f78f0b043ecbe4ff94287c4333ded8aa57ad8131b5d91cf7d8dcf13cfaeb804"
Jul 15 21:55:50.834656 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:55:50.834551    2563 scope.go:117] "RemoveContainer" containerID="f33e53eaeb14fc9c26cbaf87848ed8764527ea214cbcfa21d7599d3e93484b41"
Jul 15 21:55:50.834826 ip-10-0-130-217 kubenswrapper[2563]: E0715 21:55:50.834807    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-migrate-02eac3fc-pthkt_odh-ai-gateway-infra(9c800d1f-d678-4a22-8fd5-31f81784f935)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-02eac3fc-pthkt" podUID="9c800d1f-d678-4a22-8fd5-31f81784f935"
Jul 15 21:55:51.813072 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:55:51.813038    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-02eac3fc-585fd5f878-52pz7"
Jul 15 21:55:51.843386 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:55:51.843347    2563 scope.go:117] "RemoveContainer" containerID="f33e53eaeb14fc9c26cbaf87848ed8764527ea214cbcfa21d7599d3e93484b41"
Jul 15 21:55:51.843820 ip-10-0-130-217 kubenswrapper[2563]: E0715 21:55:51.843651    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-migrate-02eac3fc-pthkt_odh-ai-gateway-infra(9c800d1f-d678-4a22-8fd5-31f81784f935)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-02eac3fc-pthkt" podUID="9c800d1f-d678-4a22-8fd5-31f81784f935"
Jul 15 21:55:53.854730 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:55:53.854699    2563 generic.go:356] "Generic (PLEG): container finished" podID="9578b013-22fc-48eb-987a-5adcf641a800" containerID="25a056abf9e87743c6040d13607c7029ab43e04b82356020aaebfa035ff542d4" exitCode=0
Jul 15 21:55:53.855194 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:55:53.854772    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-02eac3fc-gw-openshift-default-6b7675c4f5-l8588" event={"ID":"9578b013-22fc-48eb-987a-5adcf641a800","Type":"ContainerDied","Data":"25a056abf9e87743c6040d13607c7029ab43e04b82356020aaebfa035ff542d4"}
Jul 15 21:55:53.855194 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:55:53.855183    2563 scope.go:117] "RemoveContainer" containerID="25a056abf9e87743c6040d13607c7029ab43e04b82356020aaebfa035ff542d4"
Jul 15 21:55:53.856195 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:55:53.856171    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 15 21:55:53.856267 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:55:53.856254    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 15 21:55:53.856305 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:55:53.856287    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 15 21:55:54.861876 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:55:54.861840    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-02eac3fc-gw-openshift-default-6b7675c4f5-l8588" event={"ID":"9578b013-22fc-48eb-987a-5adcf641a800","Type":"ContainerStarted","Data":"25e22508eab40061ca08856f392e306fd00ee6e76dd41bb2a4fe1f6d39c88e5b"}
Jul 15 21:55:55.015201 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:55:55.015163    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-02eac3fc-gw-openshift-default-6b7675c4f5-l8588"
Jul 15 21:55:55.016397 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:55:55.016369    2563 patch_prober.go:28] interesting pod/e2e-migrate-02eac3fc-gw-openshift-default-6b7675c4f5-l8588 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" start-of-body=
Jul 15 21:55:55.016513 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:55:55.016419    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-02eac3fc-gw-openshift-default-6b7675c4f5-l8588" podUID="9578b013-22fc-48eb-987a-5adcf641a800" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused"
Jul 15 21:55:56.015712 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:55:56.015669    2563 patch_prober.go:28] interesting pod/e2e-migrate-02eac3fc-gw-openshift-default-6b7675c4f5-l8588 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" start-of-body=
Jul 15 21:55:56.016223 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:55:56.015738    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-02eac3fc-gw-openshift-default-6b7675c4f5-l8588" podUID="9578b013-22fc-48eb-987a-5adcf641a800" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused"
Jul 15 21:55:57.015808 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:55:57.015771    2563 patch_prober.go:28] interesting pod/e2e-migrate-02eac3fc-gw-openshift-default-6b7675c4f5-l8588 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" start-of-body=
Jul 15 21:55:57.016227 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:55:57.015823    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-02eac3fc-gw-openshift-default-6b7675c4f5-l8588" podUID="9578b013-22fc-48eb-987a-5adcf641a800" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused"
Jul 15 21:55:58.015456 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:55:58.015422    2563 patch_prober.go:28] interesting pod/e2e-migrate-02eac3fc-gw-openshift-default-6b7675c4f5-l8588 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" start-of-body=
Jul 15 21:55:58.015716 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:55:58.015477    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-02eac3fc-gw-openshift-default-6b7675c4f5-l8588" podUID="9578b013-22fc-48eb-987a-5adcf641a800" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused"
Jul 15 21:55:58.781599 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:55:58.781556    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-02eac3fc-gw-openshift-default-6b7675c4f5-l8588"
Jul 15 21:55:59.019839 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:55:59.019798    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-02eac3fc-gw-openshift-default-6b7675c4f5-l8588"
Jul 15 21:55:59.020966 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:55:59.020923    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-02eac3fc-gw-openshift-default-6b7675c4f5-l8588"
Jul 15 21:56:03.982339 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:56:03.982239    2563 scope.go:117] "RemoveContainer" containerID="f33e53eaeb14fc9c26cbaf87848ed8764527ea214cbcfa21d7599d3e93484b41"
Jul 15 21:56:04.918321 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:56:04.918288    2563 generic.go:356] "Generic (PLEG): container finished" podID="9c800d1f-d678-4a22-8fd5-31f81784f935" containerID="9e24453f9ded903cfa4b098bc3c08dade18ba205a4d5540ae01a6c823b761e2c" exitCode=0
Jul 15 21:56:04.918485 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:56:04.918346    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-02eac3fc-pthkt" event={"ID":"9c800d1f-d678-4a22-8fd5-31f81784f935","Type":"ContainerDied","Data":"9e24453f9ded903cfa4b098bc3c08dade18ba205a4d5540ae01a6c823b761e2c"}
Jul 15 21:56:04.918485 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:56:04.918395    2563 scope.go:117] "RemoveContainer" containerID="f33e53eaeb14fc9c26cbaf87848ed8764527ea214cbcfa21d7599d3e93484b41"
Jul 15 21:56:05.948530 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:56:05.948501    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-02eac3fc-pthkt"]
Jul 15 21:56:06.068135 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:56:06.068109    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-02eac3fc-pthkt"
Jul 15 21:56:06.202450 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:56:06.202370    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9c800d1f-d678-4a22-8fd5-31f81784f935-maas-api-service-ca\") pod \"9c800d1f-d678-4a22-8fd5-31f81784f935\" (UID: \"9c800d1f-d678-4a22-8fd5-31f81784f935\") "
Jul 15 21:56:06.202717 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:56:06.202695    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9c800d1f-d678-4a22-8fd5-31f81784f935-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "9c800d1f-d678-4a22-8fd5-31f81784f935" (UID: "9c800d1f-d678-4a22-8fd5-31f81784f935"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 21:56:06.303989 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:56:06.303923    2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9c800d1f-d678-4a22-8fd5-31f81784f935-maas-api-service-ca\") on node \"ip-10-0-130-217.ec2.internal\" DevicePath \"\""
Jul 15 21:56:06.932144 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:56:06.932114    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-02eac3fc-pthkt"
Jul 15 21:56:06.932144 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:56:06.932124    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-02eac3fc-pthkt" event={"ID":"9c800d1f-d678-4a22-8fd5-31f81784f935","Type":"ContainerDied","Data":"b5e51bacd8c7ea53ae0bada4ab89666e1793433d0e0be01b9beefd5a381e0dc7"}
Jul 15 21:56:06.932350 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:56:06.932170    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b5e51bacd8c7ea53ae0bada4ab89666e1793433d0e0be01b9beefd5a381e0dc7"
Jul 15 21:56:06.957759 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:56:06.957724    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-02eac3fc-pthkt"]
Jul 15 21:56:06.963070 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:56:06.963043    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-02eac3fc-pthkt"]
Jul 15 21:56:06.988566 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:56:06.988534    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9c800d1f-d678-4a22-8fd5-31f81784f935" path="/var/lib/kubelet/pods/9c800d1f-d678-4a22-8fd5-31f81784f935/volumes"
Jul 15 21:56:37.599482 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:56:37.599438    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-02eac3fc-vm8r9"]
Jul 15 21:56:37.600055 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:56:37.599966    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9c800d1f-d678-4a22-8fd5-31f81784f935" containerName="revoke-keys"
Jul 15 21:56:37.600055 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:56:37.599988    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="9c800d1f-d678-4a22-8fd5-31f81784f935" containerName="revoke-keys"
Jul 15 21:56:37.600055 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:56:37.600007    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9c800d1f-d678-4a22-8fd5-31f81784f935" containerName="revoke-keys"
Jul 15 21:56:37.600055 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:56:37.600016    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="9c800d1f-d678-4a22-8fd5-31f81784f935" containerName="revoke-keys"
Jul 15 21:56:37.600055 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:56:37.600031    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9c800d1f-d678-4a22-8fd5-31f81784f935" containerName="revoke-keys"
Jul 15 21:56:37.600055 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:56:37.600039    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="9c800d1f-d678-4a22-8fd5-31f81784f935" containerName="revoke-keys"
Jul 15 21:56:37.600404 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:56:37.600173    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="9c800d1f-d678-4a22-8fd5-31f81784f935" containerName="revoke-keys"
Jul 15 21:56:37.600404 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:56:37.600188    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="9c800d1f-d678-4a22-8fd5-31f81784f935" containerName="revoke-keys"
Jul 15 21:56:37.603689 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:56:37.603665    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-02eac3fc-vm8r9"
Jul 15 21:56:37.605754 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:56:37.605727    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-zx6nf\""
Jul 15 21:56:37.608978 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:56:37.608956    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-02eac3fc-vm8r9"]
Jul 15 21:56:37.684223 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:56:37.684182    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a39f4975-01af-449b-b706-7e3909ce7ed4-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-02eac3fc-vm8r9\" (UID: \"a39f4975-01af-449b-b706-7e3909ce7ed4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-02eac3fc-vm8r9"
Jul 15 21:56:37.785515 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:56:37.785479    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a39f4975-01af-449b-b706-7e3909ce7ed4-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-02eac3fc-vm8r9\" (UID: \"a39f4975-01af-449b-b706-7e3909ce7ed4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-02eac3fc-vm8r9"
Jul 15 21:56:37.786171 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:56:37.786151    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a39f4975-01af-449b-b706-7e3909ce7ed4-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-02eac3fc-vm8r9\" (UID: \"a39f4975-01af-449b-b706-7e3909ce7ed4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-02eac3fc-vm8r9"
Jul 15 21:56:37.914924 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:56:37.914844    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-02eac3fc-vm8r9"
Jul 15 21:56:38.058297 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:56:38.058268    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-02eac3fc-vm8r9"]
Jul 15 21:56:38.061786 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:56:38.061757    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda39f4975_01af_449b_b706_7e3909ce7ed4.slice/crio-fa1fa1b3708f2a9d5b6e25716d3254f953696c4c90535d76390b9bfbf22c096e WatchSource:0}: Error finding container fa1fa1b3708f2a9d5b6e25716d3254f953696c4c90535d76390b9bfbf22c096e: Status 404 returned error can't find the container with id fa1fa1b3708f2a9d5b6e25716d3254f953696c4c90535d76390b9bfbf22c096e
Jul 15 21:56:38.093653 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:56:38.093613    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-02eac3fc-vm8r9" event={"ID":"a39f4975-01af-449b-b706-7e3909ce7ed4","Type":"ContainerStarted","Data":"fa1fa1b3708f2a9d5b6e25716d3254f953696c4c90535d76390b9bfbf22c096e"}
Jul 15 21:56:39.099742 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:56:39.099706    2563 generic.go:356] "Generic (PLEG): container finished" podID="a39f4975-01af-449b-b706-7e3909ce7ed4" containerID="7ecaa7b9d86f92b14d6ddc851a122d231ee5a9e6abd2f929c8bc18bc2dc36f49" exitCode=0
Jul 15 21:56:39.100158 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:56:39.099790    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-02eac3fc-vm8r9" event={"ID":"a39f4975-01af-449b-b706-7e3909ce7ed4","Type":"ContainerDied","Data":"7ecaa7b9d86f92b14d6ddc851a122d231ee5a9e6abd2f929c8bc18bc2dc36f49"}
Jul 15 21:56:40.255366 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:56:40.255337    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-02eac3fc-vm8r9"
Jul 15 21:56:40.305309 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:56:40.305280    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a39f4975-01af-449b-b706-7e3909ce7ed4-maas-api-service-ca\") pod \"a39f4975-01af-449b-b706-7e3909ce7ed4\" (UID: \"a39f4975-01af-449b-b706-7e3909ce7ed4\") "
Jul 15 21:56:40.305668 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:56:40.305644    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a39f4975-01af-449b-b706-7e3909ce7ed4-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "a39f4975-01af-449b-b706-7e3909ce7ed4" (UID: "a39f4975-01af-449b-b706-7e3909ce7ed4"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 21:56:40.406564 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:56:40.406490    2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a39f4975-01af-449b-b706-7e3909ce7ed4-maas-api-service-ca\") on node \"ip-10-0-130-217.ec2.internal\" DevicePath \"\""
Jul 15 21:56:41.111237 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:56:41.111202    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-02eac3fc-vm8r9"
Jul 15 21:56:41.111413 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:56:41.111235    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-02eac3fc-vm8r9" event={"ID":"a39f4975-01af-449b-b706-7e3909ce7ed4","Type":"ContainerDied","Data":"fa1fa1b3708f2a9d5b6e25716d3254f953696c4c90535d76390b9bfbf22c096e"}
Jul 15 21:56:41.111413 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:56:41.111280    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="fa1fa1b3708f2a9d5b6e25716d3254f953696c4c90535d76390b9bfbf22c096e"
Jul 15 21:56:47.674418 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:56:47.674381    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-02eac3fc-gw-openshift-default-6b7675c4f5-l8588"]
Jul 15 21:56:47.674880 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:56:47.674638    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-migrate-02eac3fc-gw-openshift-default-6b7675c4f5-l8588" podUID="9578b013-22fc-48eb-987a-5adcf641a800" containerName="istio-proxy" containerID="cri-o://25e22508eab40061ca08856f392e306fd00ee6e76dd41bb2a4fe1f6d39c88e5b" gracePeriod=30
Jul 15 21:56:48.038338 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:56:48.038250    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-02eac3fc-585fd5f878-52pz7"]
Jul 15 21:56:48.038754 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:56:48.038722    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-02eac3fc-585fd5f878-52pz7" podUID="84c7ba00-138f-4d58-a923-397c39564ca5" containerName="maas-api" containerID="cri-o://4358e6d3b5c3b7b09b8168ba2a8eee658b2b6eec701521cc6a7780f12554f437" gracePeriod=30
Jul 15 21:56:48.298776 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:56:48.298718    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-02eac3fc-585fd5f878-52pz7"
Jul 15 21:56:48.374215 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:56:48.374186    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/84c7ba00-138f-4d58-a923-397c39564ca5-maas-api-tls\") pod \"84c7ba00-138f-4d58-a923-397c39564ca5\" (UID: \"84c7ba00-138f-4d58-a923-397c39564ca5\") "
Jul 15 21:56:48.374368 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:56:48.374284    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/84c7ba00-138f-4d58-a923-397c39564ca5-openshift-service-ca\") pod \"84c7ba00-138f-4d58-a923-397c39564ca5\" (UID: \"84c7ba00-138f-4d58-a923-397c39564ca5\") "
Jul 15 21:56:48.374368 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:56:48.374316    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4gqkk\" (UniqueName: \"kubernetes.io/projected/84c7ba00-138f-4d58-a923-397c39564ca5-kube-api-access-4gqkk\") pod \"84c7ba00-138f-4d58-a923-397c39564ca5\" (UID: \"84c7ba00-138f-4d58-a923-397c39564ca5\") "
Jul 15 21:56:48.374686 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:56:48.374662    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/84c7ba00-138f-4d58-a923-397c39564ca5-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "84c7ba00-138f-4d58-a923-397c39564ca5" (UID: "84c7ba00-138f-4d58-a923-397c39564ca5"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 21:56:48.376466 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:56:48.376430    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/84c7ba00-138f-4d58-a923-397c39564ca5-kube-api-access-4gqkk" (OuterVolumeSpecName: "kube-api-access-4gqkk") pod "84c7ba00-138f-4d58-a923-397c39564ca5" (UID: "84c7ba00-138f-4d58-a923-397c39564ca5"). InnerVolumeSpecName "kube-api-access-4gqkk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 21:56:48.376466 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:56:48.376438    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/84c7ba00-138f-4d58-a923-397c39564ca5-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "84c7ba00-138f-4d58-a923-397c39564ca5" (UID: "84c7ba00-138f-4d58-a923-397c39564ca5"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 21:56:48.475786 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:56:48.475746    2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/84c7ba00-138f-4d58-a923-397c39564ca5-maas-api-tls\") on node \"ip-10-0-130-217.ec2.internal\" DevicePath \"\""
Jul 15 21:56:48.475786 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:56:48.475782    2563 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/84c7ba00-138f-4d58-a923-397c39564ca5-openshift-service-ca\") on node \"ip-10-0-130-217.ec2.internal\" DevicePath \"\""
Jul 15 21:56:48.476022 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:56:48.475817    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4gqkk\" (UniqueName: \"kubernetes.io/projected/84c7ba00-138f-4d58-a923-397c39564ca5-kube-api-access-4gqkk\") on node \"ip-10-0-130-217.ec2.internal\" DevicePath \"\""
Jul 15 21:56:49.153414 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:56:49.153378    2563 generic.go:356] "Generic (PLEG): container finished" podID="84c7ba00-138f-4d58-a923-397c39564ca5" containerID="4358e6d3b5c3b7b09b8168ba2a8eee658b2b6eec701521cc6a7780f12554f437" exitCode=0
Jul 15 21:56:49.153788 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:56:49.153418    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-02eac3fc-585fd5f878-52pz7"
Jul 15 21:56:49.153788 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:56:49.153418    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-02eac3fc-585fd5f878-52pz7" event={"ID":"84c7ba00-138f-4d58-a923-397c39564ca5","Type":"ContainerDied","Data":"4358e6d3b5c3b7b09b8168ba2a8eee658b2b6eec701521cc6a7780f12554f437"}
Jul 15 21:56:49.153788 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:56:49.153476    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-02eac3fc-585fd5f878-52pz7" event={"ID":"84c7ba00-138f-4d58-a923-397c39564ca5","Type":"ContainerDied","Data":"ef91a22f85ac20d7712be0e951e60c12b51b4d55ee2be3e5024de92151904b19"}
Jul 15 21:56:49.153788 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:56:49.153500    2563 scope.go:117] "RemoveContainer" containerID="4358e6d3b5c3b7b09b8168ba2a8eee658b2b6eec701521cc6a7780f12554f437"
Jul 15 21:56:49.162243 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:56:49.162227    2563 scope.go:117] "RemoveContainer" containerID="4358e6d3b5c3b7b09b8168ba2a8eee658b2b6eec701521cc6a7780f12554f437"
Jul 15 21:56:49.162494 ip-10-0-130-217 kubenswrapper[2563]: E0715 21:56:49.162477    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4358e6d3b5c3b7b09b8168ba2a8eee658b2b6eec701521cc6a7780f12554f437\": container with ID starting with 4358e6d3b5c3b7b09b8168ba2a8eee658b2b6eec701521cc6a7780f12554f437 not found: ID does not exist" containerID="4358e6d3b5c3b7b09b8168ba2a8eee658b2b6eec701521cc6a7780f12554f437"
Jul 15 21:56:49.162565 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:56:49.162501    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4358e6d3b5c3b7b09b8168ba2a8eee658b2b6eec701521cc6a7780f12554f437"} err="failed to get container status \"4358e6d3b5c3b7b09b8168ba2a8eee658b2b6eec701521cc6a7780f12554f437\": rpc error: code = NotFound desc = could not find container \"4358e6d3b5c3b7b09b8168ba2a8eee658b2b6eec701521cc6a7780f12554f437\": container with ID starting with 4358e6d3b5c3b7b09b8168ba2a8eee658b2b6eec701521cc6a7780f12554f437 not found: ID does not exist"
Jul 15 21:56:49.170409 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:56:49.170386    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-02eac3fc-585fd5f878-52pz7"]
Jul 15 21:56:49.176270 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:56:49.176246    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-02eac3fc-585fd5f878-52pz7"]
Jul 15 21:56:50.990816 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:56:50.990774    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="84c7ba00-138f-4d58-a923-397c39564ca5" path="/var/lib/kubelet/pods/84c7ba00-138f-4d58-a923-397c39564ca5/volumes"
Jul 15 21:56:52.922417 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:56:52.922390    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-02eac3fc-gw-openshift-default-6b7675c4f5-l8588"
Jul 15 21:56:53.017836 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:56:53.017807    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9578b013-22fc-48eb-987a-5adcf641a800-istio-data\") pod \"9578b013-22fc-48eb-987a-5adcf641a800\" (UID: \"9578b013-22fc-48eb-987a-5adcf641a800\") "
Jul 15 21:56:53.017991 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:56:53.017847    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9578b013-22fc-48eb-987a-5adcf641a800-istiod-ca-cert\") pod \"9578b013-22fc-48eb-987a-5adcf641a800\" (UID: \"9578b013-22fc-48eb-987a-5adcf641a800\") "
Jul 15 21:56:53.017991 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:56:53.017886    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9578b013-22fc-48eb-987a-5adcf641a800-credential-socket\") pod \"9578b013-22fc-48eb-987a-5adcf641a800\" (UID: \"9578b013-22fc-48eb-987a-5adcf641a800\") "
Jul 15 21:56:53.017991 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:56:53.017921    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rflnm\" (UniqueName: \"kubernetes.io/projected/9578b013-22fc-48eb-987a-5adcf641a800-kube-api-access-rflnm\") pod \"9578b013-22fc-48eb-987a-5adcf641a800\" (UID: \"9578b013-22fc-48eb-987a-5adcf641a800\") "
Jul 15 21:56:53.017991 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:56:53.017955    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9578b013-22fc-48eb-987a-5adcf641a800-workload-certs\") pod \"9578b013-22fc-48eb-987a-5adcf641a800\" (UID: \"9578b013-22fc-48eb-987a-5adcf641a800\") "
Jul 15 21:56:53.018194 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:56:53.017995    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9578b013-22fc-48eb-987a-5adcf641a800-istio-podinfo\") pod \"9578b013-22fc-48eb-987a-5adcf641a800\" (UID: \"9578b013-22fc-48eb-987a-5adcf641a800\") "
Jul 15 21:56:53.018194 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:56:53.018171    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9578b013-22fc-48eb-987a-5adcf641a800-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "9578b013-22fc-48eb-987a-5adcf641a800" (UID: "9578b013-22fc-48eb-987a-5adcf641a800"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 21:56:53.018305 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:56:53.018218    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9578b013-22fc-48eb-987a-5adcf641a800-istio-token\") pod \"9578b013-22fc-48eb-987a-5adcf641a800\" (UID: \"9578b013-22fc-48eb-987a-5adcf641a800\") "
Jul 15 21:56:53.018305 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:56:53.018279    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9578b013-22fc-48eb-987a-5adcf641a800-workload-socket\") pod \"9578b013-22fc-48eb-987a-5adcf641a800\" (UID: \"9578b013-22fc-48eb-987a-5adcf641a800\") "
Jul 15 21:56:53.018420 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:56:53.018311    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9578b013-22fc-48eb-987a-5adcf641a800-istio-envoy\") pod \"9578b013-22fc-48eb-987a-5adcf641a800\" (UID: \"9578b013-22fc-48eb-987a-5adcf641a800\") "
Jul 15 21:56:53.018420 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:56:53.018322    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9578b013-22fc-48eb-987a-5adcf641a800-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "9578b013-22fc-48eb-987a-5adcf641a800" (UID: "9578b013-22fc-48eb-987a-5adcf641a800"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 21:56:53.018420 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:56:53.018388    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9578b013-22fc-48eb-987a-5adcf641a800-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "9578b013-22fc-48eb-987a-5adcf641a800" (UID: "9578b013-22fc-48eb-987a-5adcf641a800"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 21:56:53.018654 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:56:53.018595    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9578b013-22fc-48eb-987a-5adcf641a800-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "9578b013-22fc-48eb-987a-5adcf641a800" (UID: "9578b013-22fc-48eb-987a-5adcf641a800"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 21:56:53.018654 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:56:53.018610    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9578b013-22fc-48eb-987a-5adcf641a800-istio-data" (OuterVolumeSpecName: "istio-data") pod "9578b013-22fc-48eb-987a-5adcf641a800" (UID: "9578b013-22fc-48eb-987a-5adcf641a800"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 21:56:53.018801 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:56:53.018720    2563 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9578b013-22fc-48eb-987a-5adcf641a800-istiod-ca-cert\") on node \"ip-10-0-130-217.ec2.internal\" DevicePath \"\""
Jul 15 21:56:53.018801 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:56:53.018742    2563 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9578b013-22fc-48eb-987a-5adcf641a800-credential-socket\") on node \"ip-10-0-130-217.ec2.internal\" DevicePath \"\""
Jul 15 21:56:53.018801 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:56:53.018774    2563 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9578b013-22fc-48eb-987a-5adcf641a800-workload-certs\") on node \"ip-10-0-130-217.ec2.internal\" DevicePath \"\""
Jul 15 21:56:53.020377 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:56:53.020350    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/9578b013-22fc-48eb-987a-5adcf641a800-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "9578b013-22fc-48eb-987a-5adcf641a800" (UID: "9578b013-22fc-48eb-987a-5adcf641a800"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 15 21:56:53.020516 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:56:53.020439    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9578b013-22fc-48eb-987a-5adcf641a800-istio-token" (OuterVolumeSpecName: "istio-token") pod "9578b013-22fc-48eb-987a-5adcf641a800" (UID: "9578b013-22fc-48eb-987a-5adcf641a800"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 21:56:53.020516 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:56:53.020448    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9578b013-22fc-48eb-987a-5adcf641a800-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "9578b013-22fc-48eb-987a-5adcf641a800" (UID: "9578b013-22fc-48eb-987a-5adcf641a800"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 21:56:53.020644 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:56:53.020621    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9578b013-22fc-48eb-987a-5adcf641a800-kube-api-access-rflnm" (OuterVolumeSpecName: "kube-api-access-rflnm") pod "9578b013-22fc-48eb-987a-5adcf641a800" (UID: "9578b013-22fc-48eb-987a-5adcf641a800"). InnerVolumeSpecName "kube-api-access-rflnm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 21:56:53.120008 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:56:53.119973    2563 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9578b013-22fc-48eb-987a-5adcf641a800-istio-data\") on node \"ip-10-0-130-217.ec2.internal\" DevicePath \"\""
Jul 15 21:56:53.120008 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:56:53.120002    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rflnm\" (UniqueName: \"kubernetes.io/projected/9578b013-22fc-48eb-987a-5adcf641a800-kube-api-access-rflnm\") on node \"ip-10-0-130-217.ec2.internal\" DevicePath \"\""
Jul 15 21:56:53.120008 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:56:53.120013    2563 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9578b013-22fc-48eb-987a-5adcf641a800-istio-podinfo\") on node \"ip-10-0-130-217.ec2.internal\" DevicePath \"\""
Jul 15 21:56:53.120244 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:56:53.120024    2563 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9578b013-22fc-48eb-987a-5adcf641a800-istio-token\") on node \"ip-10-0-130-217.ec2.internal\" DevicePath \"\""
Jul 15 21:56:53.120244 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:56:53.120033    2563 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9578b013-22fc-48eb-987a-5adcf641a800-workload-socket\") on node \"ip-10-0-130-217.ec2.internal\" DevicePath \"\""
Jul 15 21:56:53.120244 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:56:53.120041    2563 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9578b013-22fc-48eb-987a-5adcf641a800-istio-envoy\") on node \"ip-10-0-130-217.ec2.internal\" DevicePath \"\""
Jul 15 21:56:53.178436 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:56:53.178398    2563 generic.go:356] "Generic (PLEG): container finished" podID="9578b013-22fc-48eb-987a-5adcf641a800" containerID="25e22508eab40061ca08856f392e306fd00ee6e76dd41bb2a4fe1f6d39c88e5b" exitCode=0
Jul 15 21:56:53.178613 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:56:53.178448    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-02eac3fc-gw-openshift-default-6b7675c4f5-l8588"
Jul 15 21:56:53.178613 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:56:53.178505    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-02eac3fc-gw-openshift-default-6b7675c4f5-l8588" event={"ID":"9578b013-22fc-48eb-987a-5adcf641a800","Type":"ContainerDied","Data":"25e22508eab40061ca08856f392e306fd00ee6e76dd41bb2a4fe1f6d39c88e5b"}
Jul 15 21:56:53.178613 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:56:53.178564    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-02eac3fc-gw-openshift-default-6b7675c4f5-l8588" event={"ID":"9578b013-22fc-48eb-987a-5adcf641a800","Type":"ContainerDied","Data":"91202e5c91ddc633201c96836e2ac5c459346e55a212ef32274ad477b5c6e3d0"}
Jul 15 21:56:53.178613 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:56:53.178591    2563 scope.go:117] "RemoveContainer" containerID="25e22508eab40061ca08856f392e306fd00ee6e76dd41bb2a4fe1f6d39c88e5b"
Jul 15 21:56:53.188325 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:56:53.188305    2563 scope.go:117] "RemoveContainer" containerID="25a056abf9e87743c6040d13607c7029ab43e04b82356020aaebfa035ff542d4"
Jul 15 21:56:53.198107 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:56:53.197372    2563 scope.go:117] "RemoveContainer" containerID="25e22508eab40061ca08856f392e306fd00ee6e76dd41bb2a4fe1f6d39c88e5b"
Jul 15 21:56:53.198337 ip-10-0-130-217 kubenswrapper[2563]: E0715 21:56:53.198317    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"25e22508eab40061ca08856f392e306fd00ee6e76dd41bb2a4fe1f6d39c88e5b\": container with ID starting with 25e22508eab40061ca08856f392e306fd00ee6e76dd41bb2a4fe1f6d39c88e5b not found: ID does not exist" containerID="25e22508eab40061ca08856f392e306fd00ee6e76dd41bb2a4fe1f6d39c88e5b"
Jul 15 21:56:53.198456 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:56:53.198349    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"25e22508eab40061ca08856f392e306fd00ee6e76dd41bb2a4fe1f6d39c88e5b"} err="failed to get container status \"25e22508eab40061ca08856f392e306fd00ee6e76dd41bb2a4fe1f6d39c88e5b\": rpc error: code = NotFound desc = could not find container \"25e22508eab40061ca08856f392e306fd00ee6e76dd41bb2a4fe1f6d39c88e5b\": container with ID starting with 25e22508eab40061ca08856f392e306fd00ee6e76dd41bb2a4fe1f6d39c88e5b not found: ID does not exist"
Jul 15 21:56:53.198456 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:56:53.198375    2563 scope.go:117] "RemoveContainer" containerID="25a056abf9e87743c6040d13607c7029ab43e04b82356020aaebfa035ff542d4"
Jul 15 21:56:53.198699 ip-10-0-130-217 kubenswrapper[2563]: E0715 21:56:53.198676    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"25a056abf9e87743c6040d13607c7029ab43e04b82356020aaebfa035ff542d4\": container with ID starting with 25a056abf9e87743c6040d13607c7029ab43e04b82356020aaebfa035ff542d4 not found: ID does not exist" containerID="25a056abf9e87743c6040d13607c7029ab43e04b82356020aaebfa035ff542d4"
Jul 15 21:56:53.198743 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:56:53.198710    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"25a056abf9e87743c6040d13607c7029ab43e04b82356020aaebfa035ff542d4"} err="failed to get container status \"25a056abf9e87743c6040d13607c7029ab43e04b82356020aaebfa035ff542d4\": rpc error: code = NotFound desc = could not find container \"25a056abf9e87743c6040d13607c7029ab43e04b82356020aaebfa035ff542d4\": container with ID starting with 25a056abf9e87743c6040d13607c7029ab43e04b82356020aaebfa035ff542d4 not found: ID does not exist"
Jul 15 21:56:53.200031 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:56:53.200011    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-02eac3fc-gw-openshift-default-6b7675c4f5-l8588"]
Jul 15 21:56:53.204232 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:56:53.204212    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-migrate-02eac3fc-gw-openshift-default-6b7675c4f5-l8588"]
Jul 15 21:56:53.837414 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:56:53.837376    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-c0ed16b0-openshift-default-595d7f46bc-n2q8h"]
Jul 15 21:56:53.837883 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:56:53.837862    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="84c7ba00-138f-4d58-a923-397c39564ca5" containerName="maas-api"
Jul 15 21:56:53.837883 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:56:53.837885    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="84c7ba00-138f-4d58-a923-397c39564ca5" containerName="maas-api"
Jul 15 21:56:53.838098 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:56:53.837903    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9578b013-22fc-48eb-987a-5adcf641a800" containerName="istio-proxy"
Jul 15 21:56:53.838098 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:56:53.837912    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="9578b013-22fc-48eb-987a-5adcf641a800" containerName="istio-proxy"
Jul 15 21:56:53.838098 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:56:53.837925    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9578b013-22fc-48eb-987a-5adcf641a800" containerName="istio-proxy"
Jul 15 21:56:53.838098 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:56:53.837947    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="9578b013-22fc-48eb-987a-5adcf641a800" containerName="istio-proxy"
Jul 15 21:56:53.838098 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:56:53.837963    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a39f4975-01af-449b-b706-7e3909ce7ed4" containerName="revoke-keys"
Jul 15 21:56:53.838098 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:56:53.837971    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="a39f4975-01af-449b-b706-7e3909ce7ed4" containerName="revoke-keys"
Jul 15 21:56:53.838098 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:56:53.838072    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="9578b013-22fc-48eb-987a-5adcf641a800" containerName="istio-proxy"
Jul 15 21:56:53.838098 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:56:53.838088    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="84c7ba00-138f-4d58-a923-397c39564ca5" containerName="maas-api"
Jul 15 21:56:53.838098 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:56:53.838099    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="a39f4975-01af-449b-b706-7e3909ce7ed4" containerName="revoke-keys"
Jul 15 21:56:53.838511 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:56:53.838112    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="9c800d1f-d678-4a22-8fd5-31f81784f935" containerName="revoke-keys"
Jul 15 21:56:53.842968 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:56:53.842911    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-c0ed16b0-openshift-default-595d7f46bc-n2q8h"
Jul 15 21:56:53.845363 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:56:53.845326    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-c0ed16b0-openshift-default-dockercfg-dfshj\""
Jul 15 21:56:53.855117 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:56:53.855093    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-c0ed16b0-openshift-default-595d7f46bc-n2q8h"]
Jul 15 21:56:53.928064 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:56:53.928028    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bbc52007-cea9-4b0d-9677-705d1401a004-istio-data\") pod \"e2e-derive-c0ed16b0-openshift-default-595d7f46bc-n2q8h\" (UID: \"bbc52007-cea9-4b0d-9677-705d1401a004\") " pod="openshift-ingress/e2e-derive-c0ed16b0-openshift-default-595d7f46bc-n2q8h"
Jul 15 21:56:53.928064 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:56:53.928070    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bbc52007-cea9-4b0d-9677-705d1401a004-istio-token\") pod \"e2e-derive-c0ed16b0-openshift-default-595d7f46bc-n2q8h\" (UID: \"bbc52007-cea9-4b0d-9677-705d1401a004\") " pod="openshift-ingress/e2e-derive-c0ed16b0-openshift-default-595d7f46bc-n2q8h"
Jul 15 21:56:53.928571 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:56:53.928108    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bbc52007-cea9-4b0d-9677-705d1401a004-workload-certs\") pod \"e2e-derive-c0ed16b0-openshift-default-595d7f46bc-n2q8h\" (UID: \"bbc52007-cea9-4b0d-9677-705d1401a004\") " pod="openshift-ingress/e2e-derive-c0ed16b0-openshift-default-595d7f46bc-n2q8h"
Jul 15 21:56:53.928571 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:56:53.928128    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-td2q8\" (UniqueName: \"kubernetes.io/projected/bbc52007-cea9-4b0d-9677-705d1401a004-kube-api-access-td2q8\") pod \"e2e-derive-c0ed16b0-openshift-default-595d7f46bc-n2q8h\" (UID: \"bbc52007-cea9-4b0d-9677-705d1401a004\") " pod="openshift-ingress/e2e-derive-c0ed16b0-openshift-default-595d7f46bc-n2q8h"
Jul 15 21:56:53.928571 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:56:53.928177    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bbc52007-cea9-4b0d-9677-705d1401a004-istio-envoy\") pod \"e2e-derive-c0ed16b0-openshift-default-595d7f46bc-n2q8h\" (UID: \"bbc52007-cea9-4b0d-9677-705d1401a004\") " pod="openshift-ingress/e2e-derive-c0ed16b0-openshift-default-595d7f46bc-n2q8h"
Jul 15 21:56:53.928571 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:56:53.928275    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bbc52007-cea9-4b0d-9677-705d1401a004-workload-socket\") pod \"e2e-derive-c0ed16b0-openshift-default-595d7f46bc-n2q8h\" (UID: \"bbc52007-cea9-4b0d-9677-705d1401a004\") " pod="openshift-ingress/e2e-derive-c0ed16b0-openshift-default-595d7f46bc-n2q8h"
Jul 15 21:56:53.928571 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:56:53.928326    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bbc52007-cea9-4b0d-9677-705d1401a004-credential-socket\") pod \"e2e-derive-c0ed16b0-openshift-default-595d7f46bc-n2q8h\" (UID: \"bbc52007-cea9-4b0d-9677-705d1401a004\") " pod="openshift-ingress/e2e-derive-c0ed16b0-openshift-default-595d7f46bc-n2q8h"
Jul 15 21:56:53.928571 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:56:53.928359    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bbc52007-cea9-4b0d-9677-705d1401a004-istio-podinfo\") pod \"e2e-derive-c0ed16b0-openshift-default-595d7f46bc-n2q8h\" (UID: \"bbc52007-cea9-4b0d-9677-705d1401a004\") " pod="openshift-ingress/e2e-derive-c0ed16b0-openshift-default-595d7f46bc-n2q8h"
Jul 15 21:56:53.928571 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:56:53.928403    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bbc52007-cea9-4b0d-9677-705d1401a004-istiod-ca-cert\") pod \"e2e-derive-c0ed16b0-openshift-default-595d7f46bc-n2q8h\" (UID: \"bbc52007-cea9-4b0d-9677-705d1401a004\") " pod="openshift-ingress/e2e-derive-c0ed16b0-openshift-default-595d7f46bc-n2q8h"
Jul 15 21:56:54.029571 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:56:54.029537    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bbc52007-cea9-4b0d-9677-705d1401a004-istio-data\") pod \"e2e-derive-c0ed16b0-openshift-default-595d7f46bc-n2q8h\" (UID: \"bbc52007-cea9-4b0d-9677-705d1401a004\") " pod="openshift-ingress/e2e-derive-c0ed16b0-openshift-default-595d7f46bc-n2q8h"
Jul 15 21:56:54.029571 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:56:54.029572    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bbc52007-cea9-4b0d-9677-705d1401a004-istio-token\") pod \"e2e-derive-c0ed16b0-openshift-default-595d7f46bc-n2q8h\" (UID: \"bbc52007-cea9-4b0d-9677-705d1401a004\") " pod="openshift-ingress/e2e-derive-c0ed16b0-openshift-default-595d7f46bc-n2q8h"
Jul 15 21:56:54.029788 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:56:54.029606    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bbc52007-cea9-4b0d-9677-705d1401a004-workload-certs\") pod \"e2e-derive-c0ed16b0-openshift-default-595d7f46bc-n2q8h\" (UID: \"bbc52007-cea9-4b0d-9677-705d1401a004\") " pod="openshift-ingress/e2e-derive-c0ed16b0-openshift-default-595d7f46bc-n2q8h"
Jul 15 21:56:54.029788 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:56:54.029720    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-td2q8\" (UniqueName: \"kubernetes.io/projected/bbc52007-cea9-4b0d-9677-705d1401a004-kube-api-access-td2q8\") pod \"e2e-derive-c0ed16b0-openshift-default-595d7f46bc-n2q8h\" (UID: \"bbc52007-cea9-4b0d-9677-705d1401a004\") " pod="openshift-ingress/e2e-derive-c0ed16b0-openshift-default-595d7f46bc-n2q8h"
Jul 15 21:56:54.029869 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:56:54.029809    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bbc52007-cea9-4b0d-9677-705d1401a004-istio-envoy\") pod \"e2e-derive-c0ed16b0-openshift-default-595d7f46bc-n2q8h\" (UID: \"bbc52007-cea9-4b0d-9677-705d1401a004\") " pod="openshift-ingress/e2e-derive-c0ed16b0-openshift-default-595d7f46bc-n2q8h"
Jul 15 21:56:54.029869 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:56:54.029858    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bbc52007-cea9-4b0d-9677-705d1401a004-workload-socket\") pod \"e2e-derive-c0ed16b0-openshift-default-595d7f46bc-n2q8h\" (UID: \"bbc52007-cea9-4b0d-9677-705d1401a004\") " pod="openshift-ingress/e2e-derive-c0ed16b0-openshift-default-595d7f46bc-n2q8h"
Jul 15 21:56:54.030015 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:56:54.029898    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bbc52007-cea9-4b0d-9677-705d1401a004-credential-socket\") pod \"e2e-derive-c0ed16b0-openshift-default-595d7f46bc-n2q8h\" (UID: \"bbc52007-cea9-4b0d-9677-705d1401a004\") " pod="openshift-ingress/e2e-derive-c0ed16b0-openshift-default-595d7f46bc-n2q8h"
Jul 15 21:56:54.030015 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:56:54.029907    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bbc52007-cea9-4b0d-9677-705d1401a004-workload-certs\") pod \"e2e-derive-c0ed16b0-openshift-default-595d7f46bc-n2q8h\" (UID: \"bbc52007-cea9-4b0d-9677-705d1401a004\") " pod="openshift-ingress/e2e-derive-c0ed16b0-openshift-default-595d7f46bc-n2q8h"
Jul 15 21:56:54.030015 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:56:54.029920    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bbc52007-cea9-4b0d-9677-705d1401a004-istio-podinfo\") pod \"e2e-derive-c0ed16b0-openshift-default-595d7f46bc-n2q8h\" (UID: \"bbc52007-cea9-4b0d-9677-705d1401a004\") " pod="openshift-ingress/e2e-derive-c0ed16b0-openshift-default-595d7f46bc-n2q8h"
Jul 15 21:56:54.030015 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:56:54.029999    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bbc52007-cea9-4b0d-9677-705d1401a004-istio-data\") pod \"e2e-derive-c0ed16b0-openshift-default-595d7f46bc-n2q8h\" (UID: \"bbc52007-cea9-4b0d-9677-705d1401a004\") " pod="openshift-ingress/e2e-derive-c0ed16b0-openshift-default-595d7f46bc-n2q8h"
Jul 15 21:56:54.030015 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:56:54.030008    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bbc52007-cea9-4b0d-9677-705d1401a004-istiod-ca-cert\") pod \"e2e-derive-c0ed16b0-openshift-default-595d7f46bc-n2q8h\" (UID: \"bbc52007-cea9-4b0d-9677-705d1401a004\") " pod="openshift-ingress/e2e-derive-c0ed16b0-openshift-default-595d7f46bc-n2q8h"
Jul 15 21:56:54.030261 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:56:54.030181    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bbc52007-cea9-4b0d-9677-705d1401a004-credential-socket\") pod \"e2e-derive-c0ed16b0-openshift-default-595d7f46bc-n2q8h\" (UID: \"bbc52007-cea9-4b0d-9677-705d1401a004\") " pod="openshift-ingress/e2e-derive-c0ed16b0-openshift-default-595d7f46bc-n2q8h"
Jul 15 21:56:54.030434 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:56:54.030411    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bbc52007-cea9-4b0d-9677-705d1401a004-workload-socket\") pod \"e2e-derive-c0ed16b0-openshift-default-595d7f46bc-n2q8h\" (UID: \"bbc52007-cea9-4b0d-9677-705d1401a004\") " pod="openshift-ingress/e2e-derive-c0ed16b0-openshift-default-595d7f46bc-n2q8h"
Jul 15 21:56:54.030563 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:56:54.030487    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bbc52007-cea9-4b0d-9677-705d1401a004-istiod-ca-cert\") pod \"e2e-derive-c0ed16b0-openshift-default-595d7f46bc-n2q8h\" (UID: \"bbc52007-cea9-4b0d-9677-705d1401a004\") " pod="openshift-ingress/e2e-derive-c0ed16b0-openshift-default-595d7f46bc-n2q8h"
Jul 15 21:56:54.032166 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:56:54.032139    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bbc52007-cea9-4b0d-9677-705d1401a004-istio-envoy\") pod \"e2e-derive-c0ed16b0-openshift-default-595d7f46bc-n2q8h\" (UID: \"bbc52007-cea9-4b0d-9677-705d1401a004\") " pod="openshift-ingress/e2e-derive-c0ed16b0-openshift-default-595d7f46bc-n2q8h"
Jul 15 21:56:54.032299 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:56:54.032280    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bbc52007-cea9-4b0d-9677-705d1401a004-istio-podinfo\") pod \"e2e-derive-c0ed16b0-openshift-default-595d7f46bc-n2q8h\" (UID: \"bbc52007-cea9-4b0d-9677-705d1401a004\") " pod="openshift-ingress/e2e-derive-c0ed16b0-openshift-default-595d7f46bc-n2q8h"
Jul 15 21:56:54.037700 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:56:54.037679    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bbc52007-cea9-4b0d-9677-705d1401a004-istio-token\") pod \"e2e-derive-c0ed16b0-openshift-default-595d7f46bc-n2q8h\" (UID: \"bbc52007-cea9-4b0d-9677-705d1401a004\") " pod="openshift-ingress/e2e-derive-c0ed16b0-openshift-default-595d7f46bc-n2q8h"
Jul 15 21:56:54.037981 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:56:54.037963    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-td2q8\" (UniqueName: \"kubernetes.io/projected/bbc52007-cea9-4b0d-9677-705d1401a004-kube-api-access-td2q8\") pod \"e2e-derive-c0ed16b0-openshift-default-595d7f46bc-n2q8h\" (UID: \"bbc52007-cea9-4b0d-9677-705d1401a004\") " pod="openshift-ingress/e2e-derive-c0ed16b0-openshift-default-595d7f46bc-n2q8h"
Jul 15 21:56:54.159508 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:56:54.159431    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-c0ed16b0-openshift-default-595d7f46bc-n2q8h"
Jul 15 21:56:54.336106 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:56:54.336076    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-c0ed16b0-openshift-default-595d7f46bc-n2q8h"]
Jul 15 21:56:54.339348 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:56:54.339323    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbbc52007_cea9_4b0d_9677_705d1401a004.slice/crio-adfb5b56241ead34b3433787aca3709e47dfb362d7d1142ee5450f63ca00c03a WatchSource:0}: Error finding container adfb5b56241ead34b3433787aca3709e47dfb362d7d1142ee5450f63ca00c03a: Status 404 returned error can't find the container with id adfb5b56241ead34b3433787aca3709e47dfb362d7d1142ee5450f63ca00c03a
Jul 15 21:56:54.341539 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:56:54.341507    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 15 21:56:54.341633 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:56:54.341575    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 15 21:56:54.341633 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:56:54.341606    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 15 21:56:54.996574 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:56:54.996537    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9578b013-22fc-48eb-987a-5adcf641a800" path="/var/lib/kubelet/pods/9578b013-22fc-48eb-987a-5adcf641a800/volumes"
Jul 15 21:56:55.114947 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:56:55.114896    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-c0ed16b0-58bd888d5d-zvncd"]
Jul 15 21:56:55.115645 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:56:55.115626    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="9578b013-22fc-48eb-987a-5adcf641a800" containerName="istio-proxy"
Jul 15 21:56:55.119308 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:56:55.119289    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-c0ed16b0-58bd888d5d-zvncd"
Jul 15 21:56:55.121851 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:56:55.121832    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-derive-c0ed16b0-serving-cert\""
Jul 15 21:56:55.129466 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:56:55.129076    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-c0ed16b0-58bd888d5d-zvncd"]
Jul 15 21:56:55.193466 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:56:55.193431    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-c0ed16b0-openshift-default-595d7f46bc-n2q8h" event={"ID":"bbc52007-cea9-4b0d-9677-705d1401a004","Type":"ContainerStarted","Data":"58892a0f7be783cd97e3f802b739dba3da70fcf2f96dcc4b17df87d057fa33e4"}
Jul 15 21:56:55.193641 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:56:55.193490    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-c0ed16b0-openshift-default-595d7f46bc-n2q8h" event={"ID":"bbc52007-cea9-4b0d-9677-705d1401a004","Type":"ContainerStarted","Data":"adfb5b56241ead34b3433787aca3709e47dfb362d7d1142ee5450f63ca00c03a"}
Jul 15 21:56:55.215643 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:56:55.215587    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-c0ed16b0-openshift-default-595d7f46bc-n2q8h" podStartSLOduration=2.215566351 podStartE2EDuration="2.215566351s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:56:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:56:55.21272373 +0000 UTC m=+1664.906651281" watchObservedRunningTime="2026-07-15 21:56:55.215566351 +0000 UTC m=+1664.909493904"
Jul 15 21:56:55.241315 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:56:55.241279    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bdf855ff-d4c9-4922-a9ed-6a26e14896f8-openshift-service-ca\") pod \"maas-api-e2e-derive-c0ed16b0-58bd888d5d-zvncd\" (UID: \"bdf855ff-d4c9-4922-a9ed-6a26e14896f8\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-c0ed16b0-58bd888d5d-zvncd"
Jul 15 21:56:55.241466 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:56:55.241436    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2np88\" (UniqueName: \"kubernetes.io/projected/bdf855ff-d4c9-4922-a9ed-6a26e14896f8-kube-api-access-2np88\") pod \"maas-api-e2e-derive-c0ed16b0-58bd888d5d-zvncd\" (UID: \"bdf855ff-d4c9-4922-a9ed-6a26e14896f8\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-c0ed16b0-58bd888d5d-zvncd"
Jul 15 21:56:55.241522 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:56:55.241470    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bdf855ff-d4c9-4922-a9ed-6a26e14896f8-maas-api-tls\") pod \"maas-api-e2e-derive-c0ed16b0-58bd888d5d-zvncd\" (UID: \"bdf855ff-d4c9-4922-a9ed-6a26e14896f8\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-c0ed16b0-58bd888d5d-zvncd"
Jul 15 21:56:55.342380 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:56:55.342339    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2np88\" (UniqueName: \"kubernetes.io/projected/bdf855ff-d4c9-4922-a9ed-6a26e14896f8-kube-api-access-2np88\") pod \"maas-api-e2e-derive-c0ed16b0-58bd888d5d-zvncd\" (UID: \"bdf855ff-d4c9-4922-a9ed-6a26e14896f8\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-c0ed16b0-58bd888d5d-zvncd"
Jul 15 21:56:55.342380 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:56:55.342382    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bdf855ff-d4c9-4922-a9ed-6a26e14896f8-maas-api-tls\") pod \"maas-api-e2e-derive-c0ed16b0-58bd888d5d-zvncd\" (UID: \"bdf855ff-d4c9-4922-a9ed-6a26e14896f8\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-c0ed16b0-58bd888d5d-zvncd"
Jul 15 21:56:55.342649 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:56:55.342444    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bdf855ff-d4c9-4922-a9ed-6a26e14896f8-openshift-service-ca\") pod \"maas-api-e2e-derive-c0ed16b0-58bd888d5d-zvncd\" (UID: \"bdf855ff-d4c9-4922-a9ed-6a26e14896f8\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-c0ed16b0-58bd888d5d-zvncd"
Jul 15 21:56:55.342649 ip-10-0-130-217 kubenswrapper[2563]: E0715 21:56:55.342585    2563 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-derive-c0ed16b0-serving-cert: secret "maas-api-e2e-derive-c0ed16b0-serving-cert" not found
Jul 15 21:56:55.342760 ip-10-0-130-217 kubenswrapper[2563]: E0715 21:56:55.342668    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bdf855ff-d4c9-4922-a9ed-6a26e14896f8-maas-api-tls podName:bdf855ff-d4c9-4922-a9ed-6a26e14896f8 nodeName:}" failed. No retries permitted until 2026-07-15 21:56:55.842645812 +0000 UTC m=+1665.536573344 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/bdf855ff-d4c9-4922-a9ed-6a26e14896f8-maas-api-tls") pod "maas-api-e2e-derive-c0ed16b0-58bd888d5d-zvncd" (UID: "bdf855ff-d4c9-4922-a9ed-6a26e14896f8") : secret "maas-api-e2e-derive-c0ed16b0-serving-cert" not found
Jul 15 21:56:55.343129 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:56:55.343110    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bdf855ff-d4c9-4922-a9ed-6a26e14896f8-openshift-service-ca\") pod \"maas-api-e2e-derive-c0ed16b0-58bd888d5d-zvncd\" (UID: \"bdf855ff-d4c9-4922-a9ed-6a26e14896f8\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-c0ed16b0-58bd888d5d-zvncd"
Jul 15 21:56:55.351393 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:56:55.351367    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2np88\" (UniqueName: \"kubernetes.io/projected/bdf855ff-d4c9-4922-a9ed-6a26e14896f8-kube-api-access-2np88\") pod \"maas-api-e2e-derive-c0ed16b0-58bd888d5d-zvncd\" (UID: \"bdf855ff-d4c9-4922-a9ed-6a26e14896f8\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-c0ed16b0-58bd888d5d-zvncd"
Jul 15 21:56:55.848153 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:56:55.848119    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bdf855ff-d4c9-4922-a9ed-6a26e14896f8-maas-api-tls\") pod \"maas-api-e2e-derive-c0ed16b0-58bd888d5d-zvncd\" (UID: \"bdf855ff-d4c9-4922-a9ed-6a26e14896f8\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-c0ed16b0-58bd888d5d-zvncd"
Jul 15 21:56:55.850563 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:56:55.850530    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bdf855ff-d4c9-4922-a9ed-6a26e14896f8-maas-api-tls\") pod \"maas-api-e2e-derive-c0ed16b0-58bd888d5d-zvncd\" (UID: \"bdf855ff-d4c9-4922-a9ed-6a26e14896f8\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-c0ed16b0-58bd888d5d-zvncd"
Jul 15 21:56:56.033251 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:56:56.033217    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-c0ed16b0-58bd888d5d-zvncd"
Jul 15 21:56:56.160065 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:56:56.160035    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-c0ed16b0-openshift-default-595d7f46bc-n2q8h"
Jul 15 21:56:56.164624 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:56:56.164599    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-c0ed16b0-openshift-default-595d7f46bc-n2q8h"
Jul 15 21:56:56.169198 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:56:56.169174    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-c0ed16b0-58bd888d5d-zvncd"]
Jul 15 21:56:56.171016 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:56:56.170990    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbdf855ff_d4c9_4922_a9ed_6a26e14896f8.slice/crio-c231d5bcf6d77c2d99b5ff192182c2c550255f89c04f3bd7b4b6dd47e2dd84ea WatchSource:0}: Error finding container c231d5bcf6d77c2d99b5ff192182c2c550255f89c04f3bd7b4b6dd47e2dd84ea: Status 404 returned error can't find the container with id c231d5bcf6d77c2d99b5ff192182c2c550255f89c04f3bd7b4b6dd47e2dd84ea
Jul 15 21:56:56.200129 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:56:56.200100    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-c0ed16b0-58bd888d5d-zvncd" event={"ID":"bdf855ff-d4c9-4922-a9ed-6a26e14896f8","Type":"ContainerStarted","Data":"c231d5bcf6d77c2d99b5ff192182c2c550255f89c04f3bd7b4b6dd47e2dd84ea"}
Jul 15 21:56:56.200385 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:56:56.200369    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-c0ed16b0-openshift-default-595d7f46bc-n2q8h"
Jul 15 21:56:56.201370 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:56:56.201350    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-c0ed16b0-openshift-default-595d7f46bc-n2q8h"
Jul 15 21:56:57.207424 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:56:57.207391    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-c0ed16b0-58bd888d5d-zvncd" event={"ID":"bdf855ff-d4c9-4922-a9ed-6a26e14896f8","Type":"ContainerStarted","Data":"3a976b3816f6dc14f6ed4f2d5d9f27647418243fb64f88b95f5d07875ad8bbb0"}
Jul 15 21:56:57.207799 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:56:57.207628    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-c0ed16b0-58bd888d5d-zvncd"
Jul 15 21:56:57.225242 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:56:57.225191    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-derive-c0ed16b0-58bd888d5d-zvncd" podStartSLOduration=1.76443752 podStartE2EDuration="2.22517694s" totalImagesPullingTime="460.73942ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:56:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:56:57.222398656 +0000 UTC m=+1666.916326206" watchObservedRunningTime="2026-07-15 21:56:57.22517694 +0000 UTC m=+1666.919104491"
Jul 15 21:56:59.429573 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:56:59.429529    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c0ed16b0-xntzp"]
Jul 15 21:56:59.433722 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:56:59.433696    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c0ed16b0-xntzp"
Jul 15 21:56:59.435639 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:56:59.435619    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-zx6nf\""
Jul 15 21:56:59.439768 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:56:59.439745    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c0ed16b0-xntzp"]
Jul 15 21:56:59.487501 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:56:59.487455    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ba0cf6e9-317c-43b6-9604-ec826375b432-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-c0ed16b0-xntzp\" (UID: \"ba0cf6e9-317c-43b6-9604-ec826375b432\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c0ed16b0-xntzp"
Jul 15 21:56:59.588902 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:56:59.588862    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ba0cf6e9-317c-43b6-9604-ec826375b432-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-c0ed16b0-xntzp\" (UID: \"ba0cf6e9-317c-43b6-9604-ec826375b432\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c0ed16b0-xntzp"
Jul 15 21:56:59.589756 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:56:59.589720    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ba0cf6e9-317c-43b6-9604-ec826375b432-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-c0ed16b0-xntzp\" (UID: \"ba0cf6e9-317c-43b6-9604-ec826375b432\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c0ed16b0-xntzp"
Jul 15 21:56:59.746654 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:56:59.746570    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c0ed16b0-xntzp"
Jul 15 21:56:59.939183 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:56:59.939160    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c0ed16b0-xntzp"]
Jul 15 21:56:59.941994 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:56:59.941962    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba0cf6e9_317c_43b6_9604_ec826375b432.slice/crio-f33dd1a1ab2880ce108f5bfc45ea5d93dd88d56e8aef0db6635b76ca9866474c WatchSource:0}: Error finding container f33dd1a1ab2880ce108f5bfc45ea5d93dd88d56e8aef0db6635b76ca9866474c: Status 404 returned error can't find the container with id f33dd1a1ab2880ce108f5bfc45ea5d93dd88d56e8aef0db6635b76ca9866474c
Jul 15 21:57:00.224887 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:57:00.224827    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c0ed16b0-xntzp" event={"ID":"ba0cf6e9-317c-43b6-9604-ec826375b432","Type":"ContainerStarted","Data":"f33dd1a1ab2880ce108f5bfc45ea5d93dd88d56e8aef0db6635b76ca9866474c"}
Jul 15 21:57:01.231800 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:57:01.231764    2563 generic.go:356] "Generic (PLEG): container finished" podID="ba0cf6e9-317c-43b6-9604-ec826375b432" containerID="202f72a7aea880c876ca5818019ac89fcbdc03f10d3d4495d0b0ce1397311f05" exitCode=7
Jul 15 21:57:01.232248 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:57:01.231852    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c0ed16b0-xntzp" event={"ID":"ba0cf6e9-317c-43b6-9604-ec826375b432","Type":"ContainerDied","Data":"202f72a7aea880c876ca5818019ac89fcbdc03f10d3d4495d0b0ce1397311f05"}
Jul 15 21:57:01.232248 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:57:01.232043    2563 scope.go:117] "RemoveContainer" containerID="202f72a7aea880c876ca5818019ac89fcbdc03f10d3d4495d0b0ce1397311f05"
Jul 15 21:57:02.238638 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:57:02.238345    2563 generic.go:356] "Generic (PLEG): container finished" podID="ba0cf6e9-317c-43b6-9604-ec826375b432" containerID="243e164505a6acf4c7f0897f11975db257bf38a9852c94e432011621018f3662" exitCode=7
Jul 15 21:57:02.238638 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:57:02.238421    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c0ed16b0-xntzp" event={"ID":"ba0cf6e9-317c-43b6-9604-ec826375b432","Type":"ContainerDied","Data":"243e164505a6acf4c7f0897f11975db257bf38a9852c94e432011621018f3662"}
Jul 15 21:57:02.238638 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:57:02.238478    2563 scope.go:117] "RemoveContainer" containerID="202f72a7aea880c876ca5818019ac89fcbdc03f10d3d4495d0b0ce1397311f05"
Jul 15 21:57:02.238638 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:57:02.238597    2563 scope.go:117] "RemoveContainer" containerID="243e164505a6acf4c7f0897f11975db257bf38a9852c94e432011621018f3662"
Jul 15 21:57:02.239118 ip-10-0-130-217 kubenswrapper[2563]: E0715 21:57:02.238782    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-derive-c0ed16b0-xntzp_odh-ai-gateway-infra(ba0cf6e9-317c-43b6-9604-ec826375b432)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c0ed16b0-xntzp" podUID="ba0cf6e9-317c-43b6-9604-ec826375b432"
Jul 15 21:57:03.218695 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:57:03.218664    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-c0ed16b0-58bd888d5d-zvncd"
Jul 15 21:57:03.246234 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:57:03.246208    2563 scope.go:117] "RemoveContainer" containerID="243e164505a6acf4c7f0897f11975db257bf38a9852c94e432011621018f3662"
Jul 15 21:57:03.246590 ip-10-0-130-217 kubenswrapper[2563]: E0715 21:57:03.246408    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-derive-c0ed16b0-xntzp_odh-ai-gateway-infra(ba0cf6e9-317c-43b6-9604-ec826375b432)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c0ed16b0-xntzp" podUID="ba0cf6e9-317c-43b6-9604-ec826375b432"
Jul 15 21:57:06.262547 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:57:06.262440    2563 generic.go:356] "Generic (PLEG): container finished" podID="bbc52007-cea9-4b0d-9677-705d1401a004" containerID="58892a0f7be783cd97e3f802b739dba3da70fcf2f96dcc4b17df87d057fa33e4" exitCode=0
Jul 15 21:57:06.262547 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:57:06.262480    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-c0ed16b0-openshift-default-595d7f46bc-n2q8h" event={"ID":"bbc52007-cea9-4b0d-9677-705d1401a004","Type":"ContainerDied","Data":"58892a0f7be783cd97e3f802b739dba3da70fcf2f96dcc4b17df87d057fa33e4"}
Jul 15 21:57:06.263113 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:57:06.263070    2563 scope.go:117] "RemoveContainer" containerID="58892a0f7be783cd97e3f802b739dba3da70fcf2f96dcc4b17df87d057fa33e4"
Jul 15 21:57:06.264055 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:57:06.264028    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 15 21:57:06.264131 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:57:06.264095    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 15 21:57:06.264131 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:57:06.264125    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 15 21:57:07.270414 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:57:07.270377    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-c0ed16b0-openshift-default-595d7f46bc-n2q8h" event={"ID":"bbc52007-cea9-4b0d-9677-705d1401a004","Type":"ContainerStarted","Data":"888d312429921bcfc20dc93aea09d04981662784f01b59a7827976745f3af886"}
Jul 15 21:57:08.160318 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:57:08.160279    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-c0ed16b0-openshift-default-595d7f46bc-n2q8h"
Jul 15 21:57:08.161375 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:57:08.161346    2563 patch_prober.go:28] interesting pod/e2e-derive-c0ed16b0-openshift-default-595d7f46bc-n2q8h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" start-of-body=
Jul 15 21:57:08.161498 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:57:08.161396    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-c0ed16b0-openshift-default-595d7f46bc-n2q8h" podUID="bbc52007-cea9-4b0d-9677-705d1401a004" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused"
Jul 15 21:57:09.160345 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:57:09.160304    2563 patch_prober.go:28] interesting pod/e2e-derive-c0ed16b0-openshift-default-595d7f46bc-n2q8h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" start-of-body=
Jul 15 21:57:09.160760 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:57:09.160357    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-c0ed16b0-openshift-default-595d7f46bc-n2q8h" podUID="bbc52007-cea9-4b0d-9677-705d1401a004" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused"
Jul 15 21:57:10.160596 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:57:10.160563    2563 patch_prober.go:28] interesting pod/e2e-derive-c0ed16b0-openshift-default-595d7f46bc-n2q8h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" start-of-body=
Jul 15 21:57:10.161003 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:57:10.160616    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-c0ed16b0-openshift-default-595d7f46bc-n2q8h" podUID="bbc52007-cea9-4b0d-9677-705d1401a004" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused"
Jul 15 21:57:11.181796 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:57:11.181759    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-c0ed16b0-openshift-default-595d7f46bc-n2q8h"
Jul 15 21:57:11.182249 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:57:11.182134    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-c0ed16b0-openshift-default-595d7f46bc-n2q8h"
Jul 15 21:57:11.183023 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:57:11.183003    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-c0ed16b0-openshift-default-595d7f46bc-n2q8h"
Jul 15 21:57:16.982121 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:57:16.982090    2563 scope.go:117] "RemoveContainer" containerID="243e164505a6acf4c7f0897f11975db257bf38a9852c94e432011621018f3662"
Jul 15 21:57:17.333983 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:57:17.333953    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c0ed16b0-xntzp" event={"ID":"ba0cf6e9-317c-43b6-9604-ec826375b432","Type":"ContainerStarted","Data":"2478625dedaa2b07119b4b7112abdb7462727d48bf7cd24d104365078dbaf2a6"}
Jul 15 21:57:17.350419 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:57:17.350371    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c0ed16b0-xntzp" podStartSLOduration=18.350354521 podStartE2EDuration="18.350354521s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:56:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:57:17.348909512 +0000 UTC m=+1687.042837060" watchObservedRunningTime="2026-07-15 21:57:17.350354521 +0000 UTC m=+1687.044282094"
Jul 15 21:57:18.340813 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:57:18.340778    2563 generic.go:356] "Generic (PLEG): container finished" podID="ba0cf6e9-317c-43b6-9604-ec826375b432" containerID="2478625dedaa2b07119b4b7112abdb7462727d48bf7cd24d104365078dbaf2a6" exitCode=0
Jul 15 21:57:18.341224 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:57:18.340856    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c0ed16b0-xntzp" event={"ID":"ba0cf6e9-317c-43b6-9604-ec826375b432","Type":"ContainerDied","Data":"2478625dedaa2b07119b4b7112abdb7462727d48bf7cd24d104365078dbaf2a6"}
Jul 15 21:57:18.341224 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:57:18.340924    2563 scope.go:117] "RemoveContainer" containerID="243e164505a6acf4c7f0897f11975db257bf38a9852c94e432011621018f3662"
Jul 15 21:57:18.360581 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:57:18.360552    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c0ed16b0-xntzp"]
Jul 15 21:57:19.488179 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:57:19.488147    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c0ed16b0-xntzp"
Jul 15 21:57:19.506332 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:57:19.506302    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ba0cf6e9-317c-43b6-9604-ec826375b432-maas-api-service-ca\") pod \"ba0cf6e9-317c-43b6-9604-ec826375b432\" (UID: \"ba0cf6e9-317c-43b6-9604-ec826375b432\") "
Jul 15 21:57:19.506705 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:57:19.506684    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ba0cf6e9-317c-43b6-9604-ec826375b432-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "ba0cf6e9-317c-43b6-9604-ec826375b432" (UID: "ba0cf6e9-317c-43b6-9604-ec826375b432"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 21:57:19.607704 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:57:19.607619    2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ba0cf6e9-317c-43b6-9604-ec826375b432-maas-api-service-ca\") on node \"ip-10-0-130-217.ec2.internal\" DevicePath \"\""
Jul 15 21:57:20.353814 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:57:20.353780    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c0ed16b0-xntzp" event={"ID":"ba0cf6e9-317c-43b6-9604-ec826375b432","Type":"ContainerDied","Data":"f33dd1a1ab2880ce108f5bfc45ea5d93dd88d56e8aef0db6635b76ca9866474c"}
Jul 15 21:57:20.353814 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:57:20.353812    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c0ed16b0-xntzp"
Jul 15 21:57:20.354077 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:57:20.353829    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f33dd1a1ab2880ce108f5bfc45ea5d93dd88d56e8aef0db6635b76ca9866474c"
Jul 15 21:57:20.380722 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:57:20.380694    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c0ed16b0-xntzp"]
Jul 15 21:57:20.384353 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:57:20.384330    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c0ed16b0-xntzp"]
Jul 15 21:57:20.988304 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:57:20.988270    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ba0cf6e9-317c-43b6-9604-ec826375b432" path="/var/lib/kubelet/pods/ba0cf6e9-317c-43b6-9604-ec826375b432/volumes"
Jul 15 21:57:59.479352 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:57:59.479311    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c0ed16b0-lt79s"]
Jul 15 21:57:59.480027 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:57:59.479749    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ba0cf6e9-317c-43b6-9604-ec826375b432" containerName="revoke-keys"
Jul 15 21:57:59.480027 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:57:59.479766    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="ba0cf6e9-317c-43b6-9604-ec826375b432" containerName="revoke-keys"
Jul 15 21:57:59.480027 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:57:59.479775    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ba0cf6e9-317c-43b6-9604-ec826375b432" containerName="revoke-keys"
Jul 15 21:57:59.480027 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:57:59.479781    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="ba0cf6e9-317c-43b6-9604-ec826375b432" containerName="revoke-keys"
Jul 15 21:57:59.480027 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:57:59.479885    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="ba0cf6e9-317c-43b6-9604-ec826375b432" containerName="revoke-keys"
Jul 15 21:57:59.480027 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:57:59.479900    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="ba0cf6e9-317c-43b6-9604-ec826375b432" containerName="revoke-keys"
Jul 15 21:57:59.483097 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:57:59.483075    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c0ed16b0-lt79s"
Jul 15 21:57:59.485168 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:57:59.485110    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-zx6nf\""
Jul 15 21:57:59.488907 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:57:59.488883    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c0ed16b0-lt79s"]
Jul 15 21:57:59.489583 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:57:59.489377    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/400b3ec3-894d-497a-8de9-3811701f1851-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-c0ed16b0-lt79s\" (UID: \"400b3ec3-894d-497a-8de9-3811701f1851\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c0ed16b0-lt79s"
Jul 15 21:57:59.589910 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:57:59.589864    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/400b3ec3-894d-497a-8de9-3811701f1851-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-c0ed16b0-lt79s\" (UID: \"400b3ec3-894d-497a-8de9-3811701f1851\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c0ed16b0-lt79s"
Jul 15 21:57:59.590507 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:57:59.590483    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/400b3ec3-894d-497a-8de9-3811701f1851-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-c0ed16b0-lt79s\" (UID: \"400b3ec3-894d-497a-8de9-3811701f1851\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c0ed16b0-lt79s"
Jul 15 21:57:59.799720 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:57:59.799625    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c0ed16b0-lt79s"
Jul 15 21:57:59.933731 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:57:59.933700    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c0ed16b0-lt79s"]
Jul 15 21:57:59.935671 ip-10-0-130-217 kubenswrapper[2563]: W0715 21:57:59.935625    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod400b3ec3_894d_497a_8de9_3811701f1851.slice/crio-a10379966a26e1d768d2a69085b4d98a7d8ee1f992ae9e597d4944045ea77be6 WatchSource:0}: Error finding container a10379966a26e1d768d2a69085b4d98a7d8ee1f992ae9e597d4944045ea77be6: Status 404 returned error can't find the container with id a10379966a26e1d768d2a69085b4d98a7d8ee1f992ae9e597d4944045ea77be6
Jul 15 21:58:00.566129 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:58:00.566032    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c0ed16b0-lt79s" event={"ID":"400b3ec3-894d-497a-8de9-3811701f1851","Type":"ContainerStarted","Data":"26a0582940318efe9f554a5647c623ae4ef0b7f1fc3d21b1a2020a8fd380f5e2"}
Jul 15 21:58:00.566129 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:58:00.566093    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c0ed16b0-lt79s" event={"ID":"400b3ec3-894d-497a-8de9-3811701f1851","Type":"ContainerStarted","Data":"a10379966a26e1d768d2a69085b4d98a7d8ee1f992ae9e597d4944045ea77be6"}
Jul 15 21:58:00.578908 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:58:00.578831    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c0ed16b0-lt79s" podStartSLOduration=1.578810993 podStartE2EDuration="1.578810993s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:57:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:58:00.578535582 +0000 UTC m=+1730.272463136" watchObservedRunningTime="2026-07-15 21:58:00.578810993 +0000 UTC m=+1730.272738546"
Jul 15 21:58:01.573744 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:58:01.573710    2563 generic.go:356] "Generic (PLEG): container finished" podID="400b3ec3-894d-497a-8de9-3811701f1851" containerID="26a0582940318efe9f554a5647c623ae4ef0b7f1fc3d21b1a2020a8fd380f5e2" exitCode=0
Jul 15 21:58:01.574155 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:58:01.573777    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c0ed16b0-lt79s" event={"ID":"400b3ec3-894d-497a-8de9-3811701f1851","Type":"ContainerDied","Data":"26a0582940318efe9f554a5647c623ae4ef0b7f1fc3d21b1a2020a8fd380f5e2"}
Jul 15 21:58:02.711909 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:58:02.711878    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c0ed16b0-lt79s"
Jul 15 21:58:02.714877 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:58:02.714857    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/400b3ec3-894d-497a-8de9-3811701f1851-maas-api-service-ca\") pod \"400b3ec3-894d-497a-8de9-3811701f1851\" (UID: \"400b3ec3-894d-497a-8de9-3811701f1851\") "
Jul 15 21:58:02.715235 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:58:02.715191    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/400b3ec3-894d-497a-8de9-3811701f1851-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "400b3ec3-894d-497a-8de9-3811701f1851" (UID: "400b3ec3-894d-497a-8de9-3811701f1851"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 21:58:02.816164 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:58:02.816130    2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/400b3ec3-894d-497a-8de9-3811701f1851-maas-api-service-ca\") on node \"ip-10-0-130-217.ec2.internal\" DevicePath \"\""
Jul 15 21:58:03.585757 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:58:03.585724    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c0ed16b0-lt79s"
Jul 15 21:58:03.585927 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:58:03.585761    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c0ed16b0-lt79s" event={"ID":"400b3ec3-894d-497a-8de9-3811701f1851","Type":"ContainerDied","Data":"a10379966a26e1d768d2a69085b4d98a7d8ee1f992ae9e597d4944045ea77be6"}
Jul 15 21:58:03.585927 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:58:03.585813    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a10379966a26e1d768d2a69085b4d98a7d8ee1f992ae9e597d4944045ea77be6"
Jul 15 21:58:09.905875 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:58:09.905837    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-c0ed16b0-58bd888d5d-zvncd"]
Jul 15 21:58:09.906605 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:58:09.906097    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-derive-c0ed16b0-58bd888d5d-zvncd" podUID="bdf855ff-d4c9-4922-a9ed-6a26e14896f8" containerName="maas-api" containerID="cri-o://3a976b3816f6dc14f6ed4f2d5d9f27647418243fb64f88b95f5d07875ad8bbb0" gracePeriod=30
Jul 15 21:58:10.160811 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:58:10.160745    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-c0ed16b0-58bd888d5d-zvncd"
Jul 15 21:58:10.185537 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:58:10.185507    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bdf855ff-d4c9-4922-a9ed-6a26e14896f8-openshift-service-ca\") pod \"bdf855ff-d4c9-4922-a9ed-6a26e14896f8\" (UID: \"bdf855ff-d4c9-4922-a9ed-6a26e14896f8\") "
Jul 15 21:58:10.185713 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:58:10.185613    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2np88\" (UniqueName: \"kubernetes.io/projected/bdf855ff-d4c9-4922-a9ed-6a26e14896f8-kube-api-access-2np88\") pod \"bdf855ff-d4c9-4922-a9ed-6a26e14896f8\" (UID: \"bdf855ff-d4c9-4922-a9ed-6a26e14896f8\") "
Jul 15 21:58:10.185713 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:58:10.185700    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bdf855ff-d4c9-4922-a9ed-6a26e14896f8-maas-api-tls\") pod \"bdf855ff-d4c9-4922-a9ed-6a26e14896f8\" (UID: \"bdf855ff-d4c9-4922-a9ed-6a26e14896f8\") "
Jul 15 21:58:10.185828 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:58:10.185761    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bdf855ff-d4c9-4922-a9ed-6a26e14896f8-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "bdf855ff-d4c9-4922-a9ed-6a26e14896f8" (UID: "bdf855ff-d4c9-4922-a9ed-6a26e14896f8"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 21:58:10.186046 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:58:10.186023    2563 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bdf855ff-d4c9-4922-a9ed-6a26e14896f8-openshift-service-ca\") on node \"ip-10-0-130-217.ec2.internal\" DevicePath \"\""
Jul 15 21:58:10.187717 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:58:10.187693    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bdf855ff-d4c9-4922-a9ed-6a26e14896f8-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "bdf855ff-d4c9-4922-a9ed-6a26e14896f8" (UID: "bdf855ff-d4c9-4922-a9ed-6a26e14896f8"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 21:58:10.187824 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:58:10.187795    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bdf855ff-d4c9-4922-a9ed-6a26e14896f8-kube-api-access-2np88" (OuterVolumeSpecName: "kube-api-access-2np88") pod "bdf855ff-d4c9-4922-a9ed-6a26e14896f8" (UID: "bdf855ff-d4c9-4922-a9ed-6a26e14896f8"). InnerVolumeSpecName "kube-api-access-2np88". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 21:58:10.286574 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:58:10.286533    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2np88\" (UniqueName: \"kubernetes.io/projected/bdf855ff-d4c9-4922-a9ed-6a26e14896f8-kube-api-access-2np88\") on node \"ip-10-0-130-217.ec2.internal\" DevicePath \"\""
Jul 15 21:58:10.286574 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:58:10.286566    2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bdf855ff-d4c9-4922-a9ed-6a26e14896f8-maas-api-tls\") on node \"ip-10-0-130-217.ec2.internal\" DevicePath \"\""
Jul 15 21:58:10.625626 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:58:10.625583    2563 generic.go:356] "Generic (PLEG): container finished" podID="bdf855ff-d4c9-4922-a9ed-6a26e14896f8" containerID="3a976b3816f6dc14f6ed4f2d5d9f27647418243fb64f88b95f5d07875ad8bbb0" exitCode=0
Jul 15 21:58:10.625626 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:58:10.625628    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-c0ed16b0-58bd888d5d-zvncd"
Jul 15 21:58:10.625834 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:58:10.625663    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-c0ed16b0-58bd888d5d-zvncd" event={"ID":"bdf855ff-d4c9-4922-a9ed-6a26e14896f8","Type":"ContainerDied","Data":"3a976b3816f6dc14f6ed4f2d5d9f27647418243fb64f88b95f5d07875ad8bbb0"}
Jul 15 21:58:10.625834 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:58:10.625720    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-c0ed16b0-58bd888d5d-zvncd" event={"ID":"bdf855ff-d4c9-4922-a9ed-6a26e14896f8","Type":"ContainerDied","Data":"c231d5bcf6d77c2d99b5ff192182c2c550255f89c04f3bd7b4b6dd47e2dd84ea"}
Jul 15 21:58:10.625834 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:58:10.625743    2563 scope.go:117] "RemoveContainer" containerID="3a976b3816f6dc14f6ed4f2d5d9f27647418243fb64f88b95f5d07875ad8bbb0"
Jul 15 21:58:10.635546 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:58:10.635527    2563 scope.go:117] "RemoveContainer" containerID="3a976b3816f6dc14f6ed4f2d5d9f27647418243fb64f88b95f5d07875ad8bbb0"
Jul 15 21:58:10.635795 ip-10-0-130-217 kubenswrapper[2563]: E0715 21:58:10.635776    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3a976b3816f6dc14f6ed4f2d5d9f27647418243fb64f88b95f5d07875ad8bbb0\": container with ID starting with 3a976b3816f6dc14f6ed4f2d5d9f27647418243fb64f88b95f5d07875ad8bbb0 not found: ID does not exist" containerID="3a976b3816f6dc14f6ed4f2d5d9f27647418243fb64f88b95f5d07875ad8bbb0"
Jul 15 21:58:10.635868 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:58:10.635804    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3a976b3816f6dc14f6ed4f2d5d9f27647418243fb64f88b95f5d07875ad8bbb0"} err="failed to get container status \"3a976b3816f6dc14f6ed4f2d5d9f27647418243fb64f88b95f5d07875ad8bbb0\": rpc error: code = NotFound desc = could not find container \"3a976b3816f6dc14f6ed4f2d5d9f27647418243fb64f88b95f5d07875ad8bbb0\": container with ID starting with 3a976b3816f6dc14f6ed4f2d5d9f27647418243fb64f88b95f5d07875ad8bbb0 not found: ID does not exist"
Jul 15 21:58:10.645978 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:58:10.645927    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-c0ed16b0-58bd888d5d-zvncd"]
Jul 15 21:58:10.649183 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:58:10.649159    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-c0ed16b0-58bd888d5d-zvncd"]
Jul 15 21:58:10.988710 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:58:10.988629    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bdf855ff-d4c9-4922-a9ed-6a26e14896f8" path="/var/lib/kubelet/pods/bdf855ff-d4c9-4922-a9ed-6a26e14896f8/volumes"
Jul 15 21:58:24.734826 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:58:24.734784    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-c0ed16b0-openshift-default-595d7f46bc-n2q8h"]
Jul 15 21:58:24.735323 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:58:24.735069    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-c0ed16b0-openshift-default-595d7f46bc-n2q8h" podUID="bbc52007-cea9-4b0d-9677-705d1401a004" containerName="istio-proxy" containerID="cri-o://888d312429921bcfc20dc93aea09d04981662784f01b59a7827976745f3af886" gracePeriod=30
Jul 15 21:58:26.184446 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:58:26.184409    2563 patch_prober.go:28] interesting pod/e2e-derive-c0ed16b0-openshift-default-595d7f46bc-n2q8h container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 15 21:58:26.184847 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:58:26.184477    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-derive-c0ed16b0-openshift-default-595d7f46bc-n2q8h" podUID="bbc52007-cea9-4b0d-9677-705d1401a004" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 15 21:58:29.990450 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:58:29.990422    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-c0ed16b0-openshift-default-595d7f46bc-n2q8h"
Jul 15 21:58:30.075826 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:58:30.075789    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bbc52007-cea9-4b0d-9677-705d1401a004-credential-socket\") pod \"bbc52007-cea9-4b0d-9677-705d1401a004\" (UID: \"bbc52007-cea9-4b0d-9677-705d1401a004\") "
Jul 15 21:58:30.076005 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:58:30.075875    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bbc52007-cea9-4b0d-9677-705d1401a004-workload-socket\") pod \"bbc52007-cea9-4b0d-9677-705d1401a004\" (UID: \"bbc52007-cea9-4b0d-9677-705d1401a004\") "
Jul 15 21:58:30.076005 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:58:30.075950    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bbc52007-cea9-4b0d-9677-705d1401a004-istio-envoy\") pod \"bbc52007-cea9-4b0d-9677-705d1401a004\" (UID: \"bbc52007-cea9-4b0d-9677-705d1401a004\") "
Jul 15 21:58:30.076005 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:58:30.075984    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-td2q8\" (UniqueName: \"kubernetes.io/projected/bbc52007-cea9-4b0d-9677-705d1401a004-kube-api-access-td2q8\") pod \"bbc52007-cea9-4b0d-9677-705d1401a004\" (UID: \"bbc52007-cea9-4b0d-9677-705d1401a004\") "
Jul 15 21:58:30.076168 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:58:30.076019    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bbc52007-cea9-4b0d-9677-705d1401a004-istio-data\") pod \"bbc52007-cea9-4b0d-9677-705d1401a004\" (UID: \"bbc52007-cea9-4b0d-9677-705d1401a004\") "
Jul 15 21:58:30.076168 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:58:30.076050    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bbc52007-cea9-4b0d-9677-705d1401a004-istio-token\") pod \"bbc52007-cea9-4b0d-9677-705d1401a004\" (UID: \"bbc52007-cea9-4b0d-9677-705d1401a004\") "
Jul 15 21:58:30.076168 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:58:30.076081    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bbc52007-cea9-4b0d-9677-705d1401a004-istio-podinfo\") pod \"bbc52007-cea9-4b0d-9677-705d1401a004\" (UID: \"bbc52007-cea9-4b0d-9677-705d1401a004\") "
Jul 15 21:58:30.076168 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:58:30.076116    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bbc52007-cea9-4b0d-9677-705d1401a004-istiod-ca-cert\") pod \"bbc52007-cea9-4b0d-9677-705d1401a004\" (UID: \"bbc52007-cea9-4b0d-9677-705d1401a004\") "
Jul 15 21:58:30.076168 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:58:30.076123    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bbc52007-cea9-4b0d-9677-705d1401a004-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "bbc52007-cea9-4b0d-9677-705d1401a004" (UID: "bbc52007-cea9-4b0d-9677-705d1401a004"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 21:58:30.076414 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:58:30.076217    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bbc52007-cea9-4b0d-9677-705d1401a004-workload-certs\") pod \"bbc52007-cea9-4b0d-9677-705d1401a004\" (UID: \"bbc52007-cea9-4b0d-9677-705d1401a004\") "
Jul 15 21:58:30.076473 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:58:30.076407    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bbc52007-cea9-4b0d-9677-705d1401a004-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "bbc52007-cea9-4b0d-9677-705d1401a004" (UID: "bbc52007-cea9-4b0d-9677-705d1401a004"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 21:58:30.076993 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:58:30.076583    2563 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bbc52007-cea9-4b0d-9677-705d1401a004-credential-socket\") on node \"ip-10-0-130-217.ec2.internal\" DevicePath \"\""
Jul 15 21:58:30.076993 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:58:30.076690    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bbc52007-cea9-4b0d-9677-705d1401a004-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "bbc52007-cea9-4b0d-9677-705d1401a004" (UID: "bbc52007-cea9-4b0d-9677-705d1401a004"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 21:58:30.076993 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:58:30.076869    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bbc52007-cea9-4b0d-9677-705d1401a004-istio-data" (OuterVolumeSpecName: "istio-data") pod "bbc52007-cea9-4b0d-9677-705d1401a004" (UID: "bbc52007-cea9-4b0d-9677-705d1401a004"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 21:58:30.076993 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:58:30.076607    2563 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bbc52007-cea9-4b0d-9677-705d1401a004-workload-socket\") on node \"ip-10-0-130-217.ec2.internal\" DevicePath \"\""
Jul 15 21:58:30.076993 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:58:30.076959    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bbc52007-cea9-4b0d-9677-705d1401a004-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "bbc52007-cea9-4b0d-9677-705d1401a004" (UID: "bbc52007-cea9-4b0d-9677-705d1401a004"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 21:58:30.078539 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:58:30.078517    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/bbc52007-cea9-4b0d-9677-705d1401a004-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "bbc52007-cea9-4b0d-9677-705d1401a004" (UID: "bbc52007-cea9-4b0d-9677-705d1401a004"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 15 21:58:30.078765 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:58:30.078742    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bbc52007-cea9-4b0d-9677-705d1401a004-istio-token" (OuterVolumeSpecName: "istio-token") pod "bbc52007-cea9-4b0d-9677-705d1401a004" (UID: "bbc52007-cea9-4b0d-9677-705d1401a004"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 21:58:30.079042 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:58:30.079014    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bbc52007-cea9-4b0d-9677-705d1401a004-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "bbc52007-cea9-4b0d-9677-705d1401a004" (UID: "bbc52007-cea9-4b0d-9677-705d1401a004"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 21:58:30.079136 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:58:30.079044    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bbc52007-cea9-4b0d-9677-705d1401a004-kube-api-access-td2q8" (OuterVolumeSpecName: "kube-api-access-td2q8") pod "bbc52007-cea9-4b0d-9677-705d1401a004" (UID: "bbc52007-cea9-4b0d-9677-705d1401a004"). InnerVolumeSpecName "kube-api-access-td2q8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 21:58:30.177954 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:58:30.177859    2563 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bbc52007-cea9-4b0d-9677-705d1401a004-istio-envoy\") on node \"ip-10-0-130-217.ec2.internal\" DevicePath \"\""
Jul 15 21:58:30.177954 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:58:30.177892    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-td2q8\" (UniqueName: \"kubernetes.io/projected/bbc52007-cea9-4b0d-9677-705d1401a004-kube-api-access-td2q8\") on node \"ip-10-0-130-217.ec2.internal\" DevicePath \"\""
Jul 15 21:58:30.177954 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:58:30.177902    2563 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bbc52007-cea9-4b0d-9677-705d1401a004-istio-data\") on node \"ip-10-0-130-217.ec2.internal\" DevicePath \"\""
Jul 15 21:58:30.177954 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:58:30.177910    2563 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bbc52007-cea9-4b0d-9677-705d1401a004-istio-token\") on node \"ip-10-0-130-217.ec2.internal\" DevicePath \"\""
Jul 15 21:58:30.177954 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:58:30.177920    2563 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bbc52007-cea9-4b0d-9677-705d1401a004-istio-podinfo\") on node \"ip-10-0-130-217.ec2.internal\" DevicePath \"\""
Jul 15 21:58:30.177954 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:58:30.177929    2563 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bbc52007-cea9-4b0d-9677-705d1401a004-istiod-ca-cert\") on node \"ip-10-0-130-217.ec2.internal\" DevicePath \"\""
Jul 15 21:58:30.177954 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:58:30.177952    2563 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bbc52007-cea9-4b0d-9677-705d1401a004-workload-certs\") on node \"ip-10-0-130-217.ec2.internal\" DevicePath \"\""
Jul 15 21:58:30.733005 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:58:30.732972    2563 generic.go:356] "Generic (PLEG): container finished" podID="bbc52007-cea9-4b0d-9677-705d1401a004" containerID="888d312429921bcfc20dc93aea09d04981662784f01b59a7827976745f3af886" exitCode=0
Jul 15 21:58:30.733169 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:58:30.733022    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-c0ed16b0-openshift-default-595d7f46bc-n2q8h"
Jul 15 21:58:30.733169 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:58:30.733055    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-c0ed16b0-openshift-default-595d7f46bc-n2q8h" event={"ID":"bbc52007-cea9-4b0d-9677-705d1401a004","Type":"ContainerDied","Data":"888d312429921bcfc20dc93aea09d04981662784f01b59a7827976745f3af886"}
Jul 15 21:58:30.733169 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:58:30.733108    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-c0ed16b0-openshift-default-595d7f46bc-n2q8h" event={"ID":"bbc52007-cea9-4b0d-9677-705d1401a004","Type":"ContainerDied","Data":"adfb5b56241ead34b3433787aca3709e47dfb362d7d1142ee5450f63ca00c03a"}
Jul 15 21:58:30.733169 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:58:30.733131    2563 scope.go:117] "RemoveContainer" containerID="888d312429921bcfc20dc93aea09d04981662784f01b59a7827976745f3af886"
Jul 15 21:58:30.742507 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:58:30.742487    2563 scope.go:117] "RemoveContainer" containerID="58892a0f7be783cd97e3f802b739dba3da70fcf2f96dcc4b17df87d057fa33e4"
Jul 15 21:58:30.750622 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:58:30.750606    2563 scope.go:117] "RemoveContainer" containerID="888d312429921bcfc20dc93aea09d04981662784f01b59a7827976745f3af886"
Jul 15 21:58:30.750836 ip-10-0-130-217 kubenswrapper[2563]: E0715 21:58:30.750821    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"888d312429921bcfc20dc93aea09d04981662784f01b59a7827976745f3af886\": container with ID starting with 888d312429921bcfc20dc93aea09d04981662784f01b59a7827976745f3af886 not found: ID does not exist" containerID="888d312429921bcfc20dc93aea09d04981662784f01b59a7827976745f3af886"
Jul 15 21:58:30.750880 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:58:30.750844    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"888d312429921bcfc20dc93aea09d04981662784f01b59a7827976745f3af886"} err="failed to get container status \"888d312429921bcfc20dc93aea09d04981662784f01b59a7827976745f3af886\": rpc error: code = NotFound desc = could not find container \"888d312429921bcfc20dc93aea09d04981662784f01b59a7827976745f3af886\": container with ID starting with 888d312429921bcfc20dc93aea09d04981662784f01b59a7827976745f3af886 not found: ID does not exist"
Jul 15 21:58:30.750880 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:58:30.750858    2563 scope.go:117] "RemoveContainer" containerID="58892a0f7be783cd97e3f802b739dba3da70fcf2f96dcc4b17df87d057fa33e4"
Jul 15 21:58:30.751172 ip-10-0-130-217 kubenswrapper[2563]: E0715 21:58:30.751150    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"58892a0f7be783cd97e3f802b739dba3da70fcf2f96dcc4b17df87d057fa33e4\": container with ID starting with 58892a0f7be783cd97e3f802b739dba3da70fcf2f96dcc4b17df87d057fa33e4 not found: ID does not exist" containerID="58892a0f7be783cd97e3f802b739dba3da70fcf2f96dcc4b17df87d057fa33e4"
Jul 15 21:58:30.751318 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:58:30.751177    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"58892a0f7be783cd97e3f802b739dba3da70fcf2f96dcc4b17df87d057fa33e4"} err="failed to get container status \"58892a0f7be783cd97e3f802b739dba3da70fcf2f96dcc4b17df87d057fa33e4\": rpc error: code = NotFound desc = could not find container \"58892a0f7be783cd97e3f802b739dba3da70fcf2f96dcc4b17df87d057fa33e4\": container with ID starting with 58892a0f7be783cd97e3f802b739dba3da70fcf2f96dcc4b17df87d057fa33e4 not found: ID does not exist"
Jul 15 21:58:30.753849 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:58:30.753825    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-c0ed16b0-openshift-default-595d7f46bc-n2q8h"]
Jul 15 21:58:30.757503 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:58:30.757482    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-c0ed16b0-openshift-default-595d7f46bc-n2q8h"]
Jul 15 21:58:30.997481 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:58:30.997400    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bbc52007-cea9-4b0d-9677-705d1401a004" path="/var/lib/kubelet/pods/bbc52007-cea9-4b0d-9677-705d1401a004/volumes"
Jul 15 21:59:10.973054 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:59:10.973028    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-zlsbs_9b97af79-5c4a-4622-8d74-04d470841a53/console-operator/2.log"
Jul 15 21:59:10.975415 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:59:10.975389    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-zlsbs_9b97af79-5c4a-4622-8d74-04d470841a53/console-operator/2.log"
Jul 15 21:59:10.976692 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:59:10.976671    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bp2vz_7f43c078-b73a-4760-860b-e7f6e07afdbd/ovn-acl-logging/0.log"
Jul 15 21:59:10.979107 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:59:10.979082    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bp2vz_7f43c078-b73a-4760-860b-e7f6e07afdbd/ovn-acl-logging/0.log"
Jul 15 21:59:59.568633 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:59:59.568603    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-5920611a-openshift-default-ccdcc677f-r7h68"]
Jul 15 21:59:59.569088 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:59:59.569003    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bbc52007-cea9-4b0d-9677-705d1401a004" containerName="istio-proxy"
Jul 15 21:59:59.569088 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:59:59.569015    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="bbc52007-cea9-4b0d-9677-705d1401a004" containerName="istio-proxy"
Jul 15 21:59:59.569088 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:59:59.569023    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bbc52007-cea9-4b0d-9677-705d1401a004" containerName="istio-proxy"
Jul 15 21:59:59.569088 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:59:59.569028    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="bbc52007-cea9-4b0d-9677-705d1401a004" containerName="istio-proxy"
Jul 15 21:59:59.569088 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:59:59.569040    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="400b3ec3-894d-497a-8de9-3811701f1851" containerName="revoke-keys"
Jul 15 21:59:59.569088 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:59:59.569046    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="400b3ec3-894d-497a-8de9-3811701f1851" containerName="revoke-keys"
Jul 15 21:59:59.569088 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:59:59.569064    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ba0cf6e9-317c-43b6-9604-ec826375b432" containerName="revoke-keys"
Jul 15 21:59:59.569088 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:59:59.569069    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="ba0cf6e9-317c-43b6-9604-ec826375b432" containerName="revoke-keys"
Jul 15 21:59:59.569088 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:59:59.569080    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bdf855ff-d4c9-4922-a9ed-6a26e14896f8" containerName="maas-api"
Jul 15 21:59:59.569088 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:59:59.569085    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="bdf855ff-d4c9-4922-a9ed-6a26e14896f8" containerName="maas-api"
Jul 15 21:59:59.569407 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:59:59.569157    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="bdf855ff-d4c9-4922-a9ed-6a26e14896f8" containerName="maas-api"
Jul 15 21:59:59.569407 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:59:59.569168    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="bbc52007-cea9-4b0d-9677-705d1401a004" containerName="istio-proxy"
Jul 15 21:59:59.569407 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:59:59.569175    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="ba0cf6e9-317c-43b6-9604-ec826375b432" containerName="revoke-keys"
Jul 15 21:59:59.569407 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:59:59.569182    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="400b3ec3-894d-497a-8de9-3811701f1851" containerName="revoke-keys"
Jul 15 21:59:59.571776 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:59:59.571756    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-5920611a-openshift-default-ccdcc677f-r7h68"
Jul 15 21:59:59.574223 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:59:59.574200    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-5920611a-openshift-default-dockercfg-9zhpt\""
Jul 15 21:59:59.589017 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:59:59.588996    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-5920611a-openshift-default-ccdcc677f-r7h68"]
Jul 15 21:59:59.608796 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:59:59.608766    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0360f075-2e50-4fdf-90cb-230aa700b873-istio-token\") pod \"e2e-mt-5920611a-openshift-default-ccdcc677f-r7h68\" (UID: \"0360f075-2e50-4fdf-90cb-230aa700b873\") " pod="openshift-ingress/e2e-mt-5920611a-openshift-default-ccdcc677f-r7h68"
Jul 15 21:59:59.608963 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:59:59.608805    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0360f075-2e50-4fdf-90cb-230aa700b873-istio-podinfo\") pod \"e2e-mt-5920611a-openshift-default-ccdcc677f-r7h68\" (UID: \"0360f075-2e50-4fdf-90cb-230aa700b873\") " pod="openshift-ingress/e2e-mt-5920611a-openshift-default-ccdcc677f-r7h68"
Jul 15 21:59:59.608963 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:59:59.608828    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0360f075-2e50-4fdf-90cb-230aa700b873-istio-envoy\") pod \"e2e-mt-5920611a-openshift-default-ccdcc677f-r7h68\" (UID: \"0360f075-2e50-4fdf-90cb-230aa700b873\") " pod="openshift-ingress/e2e-mt-5920611a-openshift-default-ccdcc677f-r7h68"
Jul 15 21:59:59.608963 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:59:59.608885    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0360f075-2e50-4fdf-90cb-230aa700b873-istiod-ca-cert\") pod \"e2e-mt-5920611a-openshift-default-ccdcc677f-r7h68\" (UID: \"0360f075-2e50-4fdf-90cb-230aa700b873\") " pod="openshift-ingress/e2e-mt-5920611a-openshift-default-ccdcc677f-r7h68"
Jul 15 21:59:59.608963 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:59:59.608948    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0360f075-2e50-4fdf-90cb-230aa700b873-workload-certs\") pod \"e2e-mt-5920611a-openshift-default-ccdcc677f-r7h68\" (UID: \"0360f075-2e50-4fdf-90cb-230aa700b873\") " pod="openshift-ingress/e2e-mt-5920611a-openshift-default-ccdcc677f-r7h68"
Jul 15 21:59:59.609110 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:59:59.608973    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0360f075-2e50-4fdf-90cb-230aa700b873-credential-socket\") pod \"e2e-mt-5920611a-openshift-default-ccdcc677f-r7h68\" (UID: \"0360f075-2e50-4fdf-90cb-230aa700b873\") " pod="openshift-ingress/e2e-mt-5920611a-openshift-default-ccdcc677f-r7h68"
Jul 15 21:59:59.609110 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:59:59.609011    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wg4wq\" (UniqueName: \"kubernetes.io/projected/0360f075-2e50-4fdf-90cb-230aa700b873-kube-api-access-wg4wq\") pod \"e2e-mt-5920611a-openshift-default-ccdcc677f-r7h68\" (UID: \"0360f075-2e50-4fdf-90cb-230aa700b873\") " pod="openshift-ingress/e2e-mt-5920611a-openshift-default-ccdcc677f-r7h68"
Jul 15 21:59:59.609110 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:59:59.609055    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0360f075-2e50-4fdf-90cb-230aa700b873-workload-socket\") pod \"e2e-mt-5920611a-openshift-default-ccdcc677f-r7h68\" (UID: \"0360f075-2e50-4fdf-90cb-230aa700b873\") " pod="openshift-ingress/e2e-mt-5920611a-openshift-default-ccdcc677f-r7h68"
Jul 15 21:59:59.609110 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:59:59.609084    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0360f075-2e50-4fdf-90cb-230aa700b873-istio-data\") pod \"e2e-mt-5920611a-openshift-default-ccdcc677f-r7h68\" (UID: \"0360f075-2e50-4fdf-90cb-230aa700b873\") " pod="openshift-ingress/e2e-mt-5920611a-openshift-default-ccdcc677f-r7h68"
Jul 15 21:59:59.710026 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:59:59.709986    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0360f075-2e50-4fdf-90cb-230aa700b873-istio-data\") pod \"e2e-mt-5920611a-openshift-default-ccdcc677f-r7h68\" (UID: \"0360f075-2e50-4fdf-90cb-230aa700b873\") " pod="openshift-ingress/e2e-mt-5920611a-openshift-default-ccdcc677f-r7h68"
Jul 15 21:59:59.710026 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:59:59.710032    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0360f075-2e50-4fdf-90cb-230aa700b873-istio-token\") pod \"e2e-mt-5920611a-openshift-default-ccdcc677f-r7h68\" (UID: \"0360f075-2e50-4fdf-90cb-230aa700b873\") " pod="openshift-ingress/e2e-mt-5920611a-openshift-default-ccdcc677f-r7h68"
Jul 15 21:59:59.710278 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:59:59.710150    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0360f075-2e50-4fdf-90cb-230aa700b873-istio-podinfo\") pod \"e2e-mt-5920611a-openshift-default-ccdcc677f-r7h68\" (UID: \"0360f075-2e50-4fdf-90cb-230aa700b873\") " pod="openshift-ingress/e2e-mt-5920611a-openshift-default-ccdcc677f-r7h68"
Jul 15 21:59:59.710278 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:59:59.710195    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0360f075-2e50-4fdf-90cb-230aa700b873-istio-envoy\") pod \"e2e-mt-5920611a-openshift-default-ccdcc677f-r7h68\" (UID: \"0360f075-2e50-4fdf-90cb-230aa700b873\") " pod="openshift-ingress/e2e-mt-5920611a-openshift-default-ccdcc677f-r7h68"
Jul 15 21:59:59.710278 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:59:59.710232    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0360f075-2e50-4fdf-90cb-230aa700b873-istiod-ca-cert\") pod \"e2e-mt-5920611a-openshift-default-ccdcc677f-r7h68\" (UID: \"0360f075-2e50-4fdf-90cb-230aa700b873\") " pod="openshift-ingress/e2e-mt-5920611a-openshift-default-ccdcc677f-r7h68"
Jul 15 21:59:59.710278 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:59:59.710269    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0360f075-2e50-4fdf-90cb-230aa700b873-workload-certs\") pod \"e2e-mt-5920611a-openshift-default-ccdcc677f-r7h68\" (UID: \"0360f075-2e50-4fdf-90cb-230aa700b873\") " pod="openshift-ingress/e2e-mt-5920611a-openshift-default-ccdcc677f-r7h68"
Jul 15 21:59:59.710493 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:59:59.710310    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0360f075-2e50-4fdf-90cb-230aa700b873-credential-socket\") pod \"e2e-mt-5920611a-openshift-default-ccdcc677f-r7h68\" (UID: \"0360f075-2e50-4fdf-90cb-230aa700b873\") " pod="openshift-ingress/e2e-mt-5920611a-openshift-default-ccdcc677f-r7h68"
Jul 15 21:59:59.710493 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:59:59.710361    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wg4wq\" (UniqueName: \"kubernetes.io/projected/0360f075-2e50-4fdf-90cb-230aa700b873-kube-api-access-wg4wq\") pod \"e2e-mt-5920611a-openshift-default-ccdcc677f-r7h68\" (UID: \"0360f075-2e50-4fdf-90cb-230aa700b873\") " pod="openshift-ingress/e2e-mt-5920611a-openshift-default-ccdcc677f-r7h68"
Jul 15 21:59:59.710493 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:59:59.710444    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0360f075-2e50-4fdf-90cb-230aa700b873-workload-socket\") pod \"e2e-mt-5920611a-openshift-default-ccdcc677f-r7h68\" (UID: \"0360f075-2e50-4fdf-90cb-230aa700b873\") " pod="openshift-ingress/e2e-mt-5920611a-openshift-default-ccdcc677f-r7h68"
Jul 15 21:59:59.710644 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:59:59.710490    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0360f075-2e50-4fdf-90cb-230aa700b873-istio-data\") pod \"e2e-mt-5920611a-openshift-default-ccdcc677f-r7h68\" (UID: \"0360f075-2e50-4fdf-90cb-230aa700b873\") " pod="openshift-ingress/e2e-mt-5920611a-openshift-default-ccdcc677f-r7h68"
Jul 15 21:59:59.710728 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:59:59.710703    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0360f075-2e50-4fdf-90cb-230aa700b873-workload-certs\") pod \"e2e-mt-5920611a-openshift-default-ccdcc677f-r7h68\" (UID: \"0360f075-2e50-4fdf-90cb-230aa700b873\") " pod="openshift-ingress/e2e-mt-5920611a-openshift-default-ccdcc677f-r7h68"
Jul 15 21:59:59.710783 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:59:59.710755    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0360f075-2e50-4fdf-90cb-230aa700b873-workload-socket\") pod \"e2e-mt-5920611a-openshift-default-ccdcc677f-r7h68\" (UID: \"0360f075-2e50-4fdf-90cb-230aa700b873\") " pod="openshift-ingress/e2e-mt-5920611a-openshift-default-ccdcc677f-r7h68"
Jul 15 21:59:59.710963 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:59:59.710914    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0360f075-2e50-4fdf-90cb-230aa700b873-credential-socket\") pod \"e2e-mt-5920611a-openshift-default-ccdcc677f-r7h68\" (UID: \"0360f075-2e50-4fdf-90cb-230aa700b873\") " pod="openshift-ingress/e2e-mt-5920611a-openshift-default-ccdcc677f-r7h68"
Jul 15 21:59:59.711050 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:59:59.711028    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0360f075-2e50-4fdf-90cb-230aa700b873-istiod-ca-cert\") pod \"e2e-mt-5920611a-openshift-default-ccdcc677f-r7h68\" (UID: \"0360f075-2e50-4fdf-90cb-230aa700b873\") " pod="openshift-ingress/e2e-mt-5920611a-openshift-default-ccdcc677f-r7h68"
Jul 15 21:59:59.712485 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:59:59.712462    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0360f075-2e50-4fdf-90cb-230aa700b873-istio-envoy\") pod \"e2e-mt-5920611a-openshift-default-ccdcc677f-r7h68\" (UID: \"0360f075-2e50-4fdf-90cb-230aa700b873\") " pod="openshift-ingress/e2e-mt-5920611a-openshift-default-ccdcc677f-r7h68"
Jul 15 21:59:59.712603 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:59:59.712586    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0360f075-2e50-4fdf-90cb-230aa700b873-istio-podinfo\") pod \"e2e-mt-5920611a-openshift-default-ccdcc677f-r7h68\" (UID: \"0360f075-2e50-4fdf-90cb-230aa700b873\") " pod="openshift-ingress/e2e-mt-5920611a-openshift-default-ccdcc677f-r7h68"
Jul 15 21:59:59.717493 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:59:59.717465    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0360f075-2e50-4fdf-90cb-230aa700b873-istio-token\") pod \"e2e-mt-5920611a-openshift-default-ccdcc677f-r7h68\" (UID: \"0360f075-2e50-4fdf-90cb-230aa700b873\") " pod="openshift-ingress/e2e-mt-5920611a-openshift-default-ccdcc677f-r7h68"
Jul 15 21:59:59.717652 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:59:59.717633    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wg4wq\" (UniqueName: \"kubernetes.io/projected/0360f075-2e50-4fdf-90cb-230aa700b873-kube-api-access-wg4wq\") pod \"e2e-mt-5920611a-openshift-default-ccdcc677f-r7h68\" (UID: \"0360f075-2e50-4fdf-90cb-230aa700b873\") " pod="openshift-ingress/e2e-mt-5920611a-openshift-default-ccdcc677f-r7h68"
Jul 15 21:59:59.883144 ip-10-0-130-217 kubenswrapper[2563]: I0715 21:59:59.883108    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-5920611a-openshift-default-ccdcc677f-r7h68"
Jul 15 22:00:00.034578 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:00:00.034144    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-5920611a-openshift-default-ccdcc677f-r7h68"]
Jul 15 22:00:00.037038 ip-10-0-130-217 kubenswrapper[2563]: W0715 22:00:00.037007    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0360f075_2e50_4fdf_90cb_230aa700b873.slice/crio-7a0d4b753202ff39a7889f08168ecedd56da1f020937411e12abe9007b9206c8 WatchSource:0}: Error finding container 7a0d4b753202ff39a7889f08168ecedd56da1f020937411e12abe9007b9206c8: Status 404 returned error can't find the container with id 7a0d4b753202ff39a7889f08168ecedd56da1f020937411e12abe9007b9206c8
Jul 15 22:00:00.039713 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:00:00.039676    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 15 22:00:00.039813 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:00:00.039761    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 15 22:00:00.039813 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:00:00.039807    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 15 22:00:00.134759 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:00:00.134687    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29735880-9d9sm"]
Jul 15 22:00:00.135867 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:00:00.135842    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="bbc52007-cea9-4b0d-9677-705d1401a004" containerName="istio-proxy"
Jul 15 22:00:00.139240 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:00:00.139166    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735880-9d9sm"
Jul 15 22:00:00.141230 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:00:00.141207    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-zx6nf\""
Jul 15 22:00:00.145441 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:00:00.145404    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29735880-9d9sm"]
Jul 15 22:00:00.155309 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:00:00.153919    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735880-9d9sm"
Jul 15 22:00:00.193889 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:00:00.193847    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-5920611a-openshift-default-ccdcc677f-r7h68" event={"ID":"0360f075-2e50-4fdf-90cb-230aa700b873","Type":"ContainerStarted","Data":"db78f009a58dbb862426b3a45208540bd3a41d65b219a266506c841cb1475325"}
Jul 15 22:00:00.194088 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:00:00.193911    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-5920611a-openshift-default-ccdcc677f-r7h68" event={"ID":"0360f075-2e50-4fdf-90cb-230aa700b873","Type":"ContainerStarted","Data":"7a0d4b753202ff39a7889f08168ecedd56da1f020937411e12abe9007b9206c8"}
Jul 15 22:00:00.223745 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:00:00.222551    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-5920611a-openshift-default-ccdcc677f-r7h68" podStartSLOduration=1.222529948 podStartE2EDuration="1.222529948s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:59:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 22:00:00.221618886 +0000 UTC m=+1849.915546448" watchObservedRunningTime="2026-07-15 22:00:00.222529948 +0000 UTC m=+1849.916457500"
Jul 15 22:00:00.319210 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:00:00.319187    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29735880-9d9sm"]
Jul 15 22:00:00.321581 ip-10-0-130-217 kubenswrapper[2563]: W0715 22:00:00.321507    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod254f2214_c59b_4649_9fc0_1a751b3c36d2.slice/crio-1b21d3d0ee915306aedf8ca656f650891a42cfc5ed4df7023716695d798f05c6 WatchSource:0}: Error finding container 1b21d3d0ee915306aedf8ca656f650891a42cfc5ed4df7023716695d798f05c6: Status 404 returned error can't find the container with id 1b21d3d0ee915306aedf8ca656f650891a42cfc5ed4df7023716695d798f05c6
Jul 15 22:00:00.883525 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:00:00.883485    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-5920611a-openshift-default-ccdcc677f-r7h68"
Jul 15 22:00:01.202544 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:00:01.202449    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735880-9d9sm" event={"ID":"254f2214-c59b-4649-9fc0-1a751b3c36d2","Type":"ContainerStarted","Data":"650e19b786be74d1273029bc7ec9b70f62c242236f2b0a774f977896e0fb8c67"}
Jul 15 22:00:01.202544 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:00:01.202521    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735880-9d9sm" event={"ID":"254f2214-c59b-4649-9fc0-1a751b3c36d2","Type":"ContainerStarted","Data":"1b21d3d0ee915306aedf8ca656f650891a42cfc5ed4df7023716695d798f05c6"}
Jul 15 22:00:01.217559 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:00:01.217510    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735880-9d9sm" podStartSLOduration=1.217493929 podStartE2EDuration="1.217493929s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 22:00:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 22:00:01.215411507 +0000 UTC m=+1850.909339058" watchObservedRunningTime="2026-07-15 22:00:01.217493929 +0000 UTC m=+1850.911421479"
Jul 15 22:00:01.889066 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:00:01.889034    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-5920611a-openshift-default-ccdcc677f-r7h68"
Jul 15 22:00:02.209771 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:00:02.209675    2563 generic.go:356] "Generic (PLEG): container finished" podID="254f2214-c59b-4649-9fc0-1a751b3c36d2" containerID="650e19b786be74d1273029bc7ec9b70f62c242236f2b0a774f977896e0fb8c67" exitCode=0
Jul 15 22:00:02.209771 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:00:02.209757    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735880-9d9sm" event={"ID":"254f2214-c59b-4649-9fc0-1a751b3c36d2","Type":"ContainerDied","Data":"650e19b786be74d1273029bc7ec9b70f62c242236f2b0a774f977896e0fb8c67"}
Jul 15 22:00:02.210189 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:00:02.210169    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-5920611a-openshift-default-ccdcc677f-r7h68"
Jul 15 22:00:02.211044 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:00:02.211020    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-5920611a-openshift-default-ccdcc677f-r7h68"
Jul 15 22:00:02.667671 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:00:02.667640    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-5920611a-78b69cbc4d-dvprc"]
Jul 15 22:00:02.671509 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:00:02.671487    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-5920611a-78b69cbc4d-dvprc"
Jul 15 22:00:02.673759 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:00:02.673736    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-5920611a-serving-cert\""
Jul 15 22:00:02.683041 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:00:02.682912    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-5920611a-78b69cbc4d-dvprc"]
Jul 15 22:00:02.739186 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:00:02.739150    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kcdxn\" (UniqueName: \"kubernetes.io/projected/fe445f5e-4bd2-4d67-b180-76d195efd5a3-kube-api-access-kcdxn\") pod \"maas-api-e2e-mt-5920611a-78b69cbc4d-dvprc\" (UID: \"fe445f5e-4bd2-4d67-b180-76d195efd5a3\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-5920611a-78b69cbc4d-dvprc"
Jul 15 22:00:02.739372 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:00:02.739195    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fe445f5e-4bd2-4d67-b180-76d195efd5a3-maas-api-tls\") pod \"maas-api-e2e-mt-5920611a-78b69cbc4d-dvprc\" (UID: \"fe445f5e-4bd2-4d67-b180-76d195efd5a3\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-5920611a-78b69cbc4d-dvprc"
Jul 15 22:00:02.739372 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:00:02.739257    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fe445f5e-4bd2-4d67-b180-76d195efd5a3-openshift-service-ca\") pod \"maas-api-e2e-mt-5920611a-78b69cbc4d-dvprc\" (UID: \"fe445f5e-4bd2-4d67-b180-76d195efd5a3\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-5920611a-78b69cbc4d-dvprc"
Jul 15 22:00:02.840301 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:00:02.840261    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fe445f5e-4bd2-4d67-b180-76d195efd5a3-openshift-service-ca\") pod \"maas-api-e2e-mt-5920611a-78b69cbc4d-dvprc\" (UID: \"fe445f5e-4bd2-4d67-b180-76d195efd5a3\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-5920611a-78b69cbc4d-dvprc"
Jul 15 22:00:02.840521 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:00:02.840397    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kcdxn\" (UniqueName: \"kubernetes.io/projected/fe445f5e-4bd2-4d67-b180-76d195efd5a3-kube-api-access-kcdxn\") pod \"maas-api-e2e-mt-5920611a-78b69cbc4d-dvprc\" (UID: \"fe445f5e-4bd2-4d67-b180-76d195efd5a3\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-5920611a-78b69cbc4d-dvprc"
Jul 15 22:00:02.840521 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:00:02.840443    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fe445f5e-4bd2-4d67-b180-76d195efd5a3-maas-api-tls\") pod \"maas-api-e2e-mt-5920611a-78b69cbc4d-dvprc\" (UID: \"fe445f5e-4bd2-4d67-b180-76d195efd5a3\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-5920611a-78b69cbc4d-dvprc"
Jul 15 22:00:02.841153 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:00:02.841127    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fe445f5e-4bd2-4d67-b180-76d195efd5a3-openshift-service-ca\") pod \"maas-api-e2e-mt-5920611a-78b69cbc4d-dvprc\" (UID: \"fe445f5e-4bd2-4d67-b180-76d195efd5a3\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-5920611a-78b69cbc4d-dvprc"
Jul 15 22:00:02.843014 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:00:02.842984    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fe445f5e-4bd2-4d67-b180-76d195efd5a3-maas-api-tls\") pod \"maas-api-e2e-mt-5920611a-78b69cbc4d-dvprc\" (UID: \"fe445f5e-4bd2-4d67-b180-76d195efd5a3\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-5920611a-78b69cbc4d-dvprc"
Jul 15 22:00:02.849168 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:00:02.849139    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kcdxn\" (UniqueName: \"kubernetes.io/projected/fe445f5e-4bd2-4d67-b180-76d195efd5a3-kube-api-access-kcdxn\") pod \"maas-api-e2e-mt-5920611a-78b69cbc4d-dvprc\" (UID: \"fe445f5e-4bd2-4d67-b180-76d195efd5a3\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-5920611a-78b69cbc4d-dvprc"
Jul 15 22:00:02.984138 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:00:02.984048    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-5920611a-78b69cbc4d-dvprc"
Jul 15 22:00:03.134703 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:00:03.134672    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-5920611a-78b69cbc4d-dvprc"]
Jul 15 22:00:03.136409 ip-10-0-130-217 kubenswrapper[2563]: W0715 22:00:03.136383    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfe445f5e_4bd2_4d67_b180_76d195efd5a3.slice/crio-1e53c97a27f3af385e74da44c216e027f171e618a62fed1395fc84feaa6ddff6 WatchSource:0}: Error finding container 1e53c97a27f3af385e74da44c216e027f171e618a62fed1395fc84feaa6ddff6: Status 404 returned error can't find the container with id 1e53c97a27f3af385e74da44c216e027f171e618a62fed1395fc84feaa6ddff6
Jul 15 22:00:03.137794 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:00:03.137777    2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 15 22:00:03.216781 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:00:03.216743    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-5920611a-78b69cbc4d-dvprc" event={"ID":"fe445f5e-4bd2-4d67-b180-76d195efd5a3","Type":"ContainerStarted","Data":"1e53c97a27f3af385e74da44c216e027f171e618a62fed1395fc84feaa6ddff6"}
Jul 15 22:00:03.337223 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:00:03.337197    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735880-9d9sm"
Jul 15 22:00:04.223890 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:00:04.223799    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735880-9d9sm"
Jul 15 22:00:04.223890 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:00:04.223838    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735880-9d9sm" event={"ID":"254f2214-c59b-4649-9fc0-1a751b3c36d2","Type":"ContainerDied","Data":"1b21d3d0ee915306aedf8ca656f650891a42cfc5ed4df7023716695d798f05c6"}
Jul 15 22:00:04.224308 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:00:04.223898    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1b21d3d0ee915306aedf8ca656f650891a42cfc5ed4df7023716695d798f05c6"
Jul 15 22:00:05.230525 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:00:05.230441    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-5920611a-78b69cbc4d-dvprc" event={"ID":"fe445f5e-4bd2-4d67-b180-76d195efd5a3","Type":"ContainerStarted","Data":"71dde0054b22e9495a22f5bd0c2ba79d9fb5060c3e6a6a6646cb57775d885a79"}
Jul 15 22:00:05.230525 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:00:05.230521    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-5920611a-78b69cbc4d-dvprc"
Jul 15 22:00:05.249221 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:00:05.249174    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-5920611a-78b69cbc4d-dvprc" podStartSLOduration=1.5529032900000002 podStartE2EDuration="3.249159619s" totalImagesPullingTime="1.696256329s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 22:00:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 22:00:05.24737982 +0000 UTC m=+1854.941307364" watchObservedRunningTime="2026-07-15 22:00:05.249159619 +0000 UTC m=+1854.943087170"
Jul 15 22:00:11.241739 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:00:11.241695    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-5920611a-78b69cbc4d-dvprc"
Jul 15 22:00:14.282385 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:00:14.282348    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-5920611a-fl5rp"]
Jul 15 22:00:14.282945 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:00:14.282918    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="254f2214-c59b-4649-9fc0-1a751b3c36d2" containerName="cleanup"
Jul 15 22:00:14.283110 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:00:14.282955    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="254f2214-c59b-4649-9fc0-1a751b3c36d2" containerName="cleanup"
Jul 15 22:00:14.283110 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:00:14.283049    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="254f2214-c59b-4649-9fc0-1a751b3c36d2" containerName="cleanup"
Jul 15 22:00:14.286520 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:00:14.286496    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-5920611a-fl5rp"
Jul 15 22:00:14.288637 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:00:14.288615    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-zx6nf\""
Jul 15 22:00:14.292506 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:00:14.292441    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-5920611a-fl5rp"]
Jul 15 22:00:14.348177 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:00:14.348140    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d024dd00-01c9-47b5-869a-c95f6b1005fc-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-5920611a-fl5rp\" (UID: \"d024dd00-01c9-47b5-869a-c95f6b1005fc\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-5920611a-fl5rp"
Jul 15 22:00:14.449686 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:00:14.449634    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d024dd00-01c9-47b5-869a-c95f6b1005fc-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-5920611a-fl5rp\" (UID: \"d024dd00-01c9-47b5-869a-c95f6b1005fc\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-5920611a-fl5rp"
Jul 15 22:00:14.450316 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:00:14.450293    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d024dd00-01c9-47b5-869a-c95f6b1005fc-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-5920611a-fl5rp\" (UID: \"d024dd00-01c9-47b5-869a-c95f6b1005fc\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-5920611a-fl5rp"
Jul 15 22:00:14.602848 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:00:14.602809    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-5920611a-fl5rp"
Jul 15 22:00:14.754207 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:00:14.754182    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-5920611a-fl5rp"]
Jul 15 22:00:14.756185 ip-10-0-130-217 kubenswrapper[2563]: W0715 22:00:14.756157    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd024dd00_01c9_47b5_869a_c95f6b1005fc.slice/crio-f0c83c4afe85c7c8aacbbbd39e632805ea16ce789fa70a71cdd677947a4aa836 WatchSource:0}: Error finding container f0c83c4afe85c7c8aacbbbd39e632805ea16ce789fa70a71cdd677947a4aa836: Status 404 returned error can't find the container with id f0c83c4afe85c7c8aacbbbd39e632805ea16ce789fa70a71cdd677947a4aa836
Jul 15 22:00:15.287929 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:00:15.287838    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-5920611a-fl5rp" event={"ID":"d024dd00-01c9-47b5-869a-c95f6b1005fc","Type":"ContainerStarted","Data":"b9ab56fcb0f5c84732a5ad6448231596de06a60bef18892ed04dccdf8cfaef74"}
Jul 15 22:00:15.287929 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:00:15.287911    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-5920611a-fl5rp" event={"ID":"d024dd00-01c9-47b5-869a-c95f6b1005fc","Type":"ContainerStarted","Data":"f0c83c4afe85c7c8aacbbbd39e632805ea16ce789fa70a71cdd677947a4aa836"}
Jul 15 22:00:15.302179 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:00:15.302124    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-5920611a-fl5rp" podStartSLOduration=1.302103459 podStartE2EDuration="1.302103459s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 22:00:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 22:00:15.301291352 +0000 UTC m=+1864.995218904" watchObservedRunningTime="2026-07-15 22:00:15.302103459 +0000 UTC m=+1864.996031012"
Jul 15 22:00:16.294557 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:00:16.294454    2563 generic.go:356] "Generic (PLEG): container finished" podID="d024dd00-01c9-47b5-869a-c95f6b1005fc" containerID="b9ab56fcb0f5c84732a5ad6448231596de06a60bef18892ed04dccdf8cfaef74" exitCode=0
Jul 15 22:00:16.294557 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:00:16.294538    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-5920611a-fl5rp" event={"ID":"d024dd00-01c9-47b5-869a-c95f6b1005fc","Type":"ContainerDied","Data":"b9ab56fcb0f5c84732a5ad6448231596de06a60bef18892ed04dccdf8cfaef74"}
Jul 15 22:00:16.296098 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:00:16.296077    2563 generic.go:356] "Generic (PLEG): container finished" podID="0360f075-2e50-4fdf-90cb-230aa700b873" containerID="db78f009a58dbb862426b3a45208540bd3a41d65b219a266506c841cb1475325" exitCode=0
Jul 15 22:00:16.296201 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:00:16.296115    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-5920611a-openshift-default-ccdcc677f-r7h68" event={"ID":"0360f075-2e50-4fdf-90cb-230aa700b873","Type":"ContainerDied","Data":"db78f009a58dbb862426b3a45208540bd3a41d65b219a266506c841cb1475325"}
Jul 15 22:00:16.296473 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:00:16.296461    2563 scope.go:117] "RemoveContainer" containerID="db78f009a58dbb862426b3a45208540bd3a41d65b219a266506c841cb1475325"
Jul 15 22:00:16.297448 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:00:16.297423    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 15 22:00:16.297500 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:00:16.297487    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 15 22:00:16.297537 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:00:16.297518    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 15 22:00:17.210157 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:00:17.210101    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-5920611a-openshift-default-ccdcc677f-r7h68"
Jul 15 22:00:17.303816 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:00:17.303775    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-5920611a-openshift-default-ccdcc677f-r7h68" event={"ID":"0360f075-2e50-4fdf-90cb-230aa700b873","Type":"ContainerStarted","Data":"74868b6cddfbf2c1bd9828d902e25ea460b5159deebf69e8894329251dc9e538"}
Jul 15 22:00:17.446268 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:00:17.446238    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-5920611a-fl5rp"
Jul 15 22:00:17.480366 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:00:17.480286    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d024dd00-01c9-47b5-869a-c95f6b1005fc-maas-api-service-ca\") pod \"d024dd00-01c9-47b5-869a-c95f6b1005fc\" (UID: \"d024dd00-01c9-47b5-869a-c95f6b1005fc\") "
Jul 15 22:00:17.480637 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:00:17.480613    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d024dd00-01c9-47b5-869a-c95f6b1005fc-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "d024dd00-01c9-47b5-869a-c95f6b1005fc" (UID: "d024dd00-01c9-47b5-869a-c95f6b1005fc"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 22:00:17.581915 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:00:17.581874    2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d024dd00-01c9-47b5-869a-c95f6b1005fc-maas-api-service-ca\") on node \"ip-10-0-130-217.ec2.internal\" DevicePath \"\""
Jul 15 22:00:17.883823 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:00:17.883775    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-5920611a-openshift-default-ccdcc677f-r7h68"
Jul 15 22:00:17.885197 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:00:17.885174    2563 patch_prober.go:28] interesting pod/e2e-mt-5920611a-openshift-default-ccdcc677f-r7h68 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused" start-of-body=
Jul 15 22:00:17.885272 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:00:17.885238    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-5920611a-openshift-default-ccdcc677f-r7h68" podUID="0360f075-2e50-4fdf-90cb-230aa700b873" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused"
Jul 15 22:00:18.311192 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:00:18.311104    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-5920611a-fl5rp"
Jul 15 22:00:18.311192 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:00:18.311148    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-5920611a-fl5rp" event={"ID":"d024dd00-01c9-47b5-869a-c95f6b1005fc","Type":"ContainerDied","Data":"f0c83c4afe85c7c8aacbbbd39e632805ea16ce789fa70a71cdd677947a4aa836"}
Jul 15 22:00:18.311628 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:00:18.311204    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f0c83c4afe85c7c8aacbbbd39e632805ea16ce789fa70a71cdd677947a4aa836"
Jul 15 22:00:18.884556 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:00:18.884515    2563 patch_prober.go:28] interesting pod/e2e-mt-5920611a-openshift-default-ccdcc677f-r7h68 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused" start-of-body=
Jul 15 22:00:18.884855 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:00:18.884827    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-5920611a-openshift-default-ccdcc677f-r7h68" podUID="0360f075-2e50-4fdf-90cb-230aa700b873" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused"
Jul 15 22:00:19.884500 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:00:19.884458    2563 patch_prober.go:28] interesting pod/e2e-mt-5920611a-openshift-default-ccdcc677f-r7h68 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused" start-of-body=
Jul 15 22:00:19.885099 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:00:19.885063    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-5920611a-openshift-default-ccdcc677f-r7h68" podUID="0360f075-2e50-4fdf-90cb-230aa700b873" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused"
Jul 15 22:00:20.884525 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:00:20.884488    2563 patch_prober.go:28] interesting pod/e2e-mt-5920611a-openshift-default-ccdcc677f-r7h68 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused" start-of-body=
Jul 15 22:00:20.885108 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:00:20.885075    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-5920611a-openshift-default-ccdcc677f-r7h68" podUID="0360f075-2e50-4fdf-90cb-230aa700b873" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused"
Jul 15 22:00:21.884420 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:00:21.884374    2563 patch_prober.go:28] interesting pod/e2e-mt-5920611a-openshift-default-ccdcc677f-r7h68 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused" start-of-body=
Jul 15 22:00:21.884650 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:00:21.884459    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-5920611a-openshift-default-ccdcc677f-r7h68" podUID="0360f075-2e50-4fdf-90cb-230aa700b873" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused"
Jul 15 22:00:22.888073 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:00:22.888038    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-5920611a-openshift-default-ccdcc677f-r7h68"
Jul 15 22:00:22.888464 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:00:22.888308    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-5920611a-openshift-default-ccdcc677f-r7h68"
Jul 15 22:00:22.889111 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:00:22.889078    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-5920611a-openshift-default-ccdcc677f-r7h68"
Jul 15 22:00:24.691867 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:00:24.691824    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-5920611a-78b69cbc4d-dvprc"]
Jul 15 22:00:24.692379 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:00:24.692095    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-5920611a-78b69cbc4d-dvprc" podUID="fe445f5e-4bd2-4d67-b180-76d195efd5a3" containerName="maas-api" containerID="cri-o://71dde0054b22e9495a22f5bd0c2ba79d9fb5060c3e6a6a6646cb57775d885a79" gracePeriod=30
Jul 15 22:00:24.948740 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:00:24.948683    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-5920611a-78b69cbc4d-dvprc"
Jul 15 22:00:25.051717 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:00:25.051689    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fe445f5e-4bd2-4d67-b180-76d195efd5a3-maas-api-tls\") pod \"fe445f5e-4bd2-4d67-b180-76d195efd5a3\" (UID: \"fe445f5e-4bd2-4d67-b180-76d195efd5a3\") "
Jul 15 22:00:25.051894 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:00:25.051741    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kcdxn\" (UniqueName: \"kubernetes.io/projected/fe445f5e-4bd2-4d67-b180-76d195efd5a3-kube-api-access-kcdxn\") pod \"fe445f5e-4bd2-4d67-b180-76d195efd5a3\" (UID: \"fe445f5e-4bd2-4d67-b180-76d195efd5a3\") "
Jul 15 22:00:25.051894 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:00:25.051788    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fe445f5e-4bd2-4d67-b180-76d195efd5a3-openshift-service-ca\") pod \"fe445f5e-4bd2-4d67-b180-76d195efd5a3\" (UID: \"fe445f5e-4bd2-4d67-b180-76d195efd5a3\") "
Jul 15 22:00:25.052238 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:00:25.052204    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fe445f5e-4bd2-4d67-b180-76d195efd5a3-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "fe445f5e-4bd2-4d67-b180-76d195efd5a3" (UID: "fe445f5e-4bd2-4d67-b180-76d195efd5a3"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 22:00:25.053830 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:00:25.053798    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fe445f5e-4bd2-4d67-b180-76d195efd5a3-kube-api-access-kcdxn" (OuterVolumeSpecName: "kube-api-access-kcdxn") pod "fe445f5e-4bd2-4d67-b180-76d195efd5a3" (UID: "fe445f5e-4bd2-4d67-b180-76d195efd5a3"). InnerVolumeSpecName "kube-api-access-kcdxn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 22:00:25.053972 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:00:25.053847    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fe445f5e-4bd2-4d67-b180-76d195efd5a3-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "fe445f5e-4bd2-4d67-b180-76d195efd5a3" (UID: "fe445f5e-4bd2-4d67-b180-76d195efd5a3"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 22:00:25.153100 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:00:25.153057    2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fe445f5e-4bd2-4d67-b180-76d195efd5a3-maas-api-tls\") on node \"ip-10-0-130-217.ec2.internal\" DevicePath \"\""
Jul 15 22:00:25.153100 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:00:25.153093    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kcdxn\" (UniqueName: \"kubernetes.io/projected/fe445f5e-4bd2-4d67-b180-76d195efd5a3-kube-api-access-kcdxn\") on node \"ip-10-0-130-217.ec2.internal\" DevicePath \"\""
Jul 15 22:00:25.153100 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:00:25.153104    2563 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fe445f5e-4bd2-4d67-b180-76d195efd5a3-openshift-service-ca\") on node \"ip-10-0-130-217.ec2.internal\" DevicePath \"\""
Jul 15 22:00:25.350531 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:00:25.350493    2563 generic.go:356] "Generic (PLEG): container finished" podID="fe445f5e-4bd2-4d67-b180-76d195efd5a3" containerID="71dde0054b22e9495a22f5bd0c2ba79d9fb5060c3e6a6a6646cb57775d885a79" exitCode=0
Jul 15 22:00:25.350710 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:00:25.350540    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-5920611a-78b69cbc4d-dvprc"
Jul 15 22:00:25.350710 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:00:25.350577    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-5920611a-78b69cbc4d-dvprc" event={"ID":"fe445f5e-4bd2-4d67-b180-76d195efd5a3","Type":"ContainerDied","Data":"71dde0054b22e9495a22f5bd0c2ba79d9fb5060c3e6a6a6646cb57775d885a79"}
Jul 15 22:00:25.350710 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:00:25.350629    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-5920611a-78b69cbc4d-dvprc" event={"ID":"fe445f5e-4bd2-4d67-b180-76d195efd5a3","Type":"ContainerDied","Data":"1e53c97a27f3af385e74da44c216e027f171e618a62fed1395fc84feaa6ddff6"}
Jul 15 22:00:25.350710 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:00:25.350651    2563 scope.go:117] "RemoveContainer" containerID="71dde0054b22e9495a22f5bd0c2ba79d9fb5060c3e6a6a6646cb57775d885a79"
Jul 15 22:00:25.360297 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:00:25.360281    2563 scope.go:117] "RemoveContainer" containerID="71dde0054b22e9495a22f5bd0c2ba79d9fb5060c3e6a6a6646cb57775d885a79"
Jul 15 22:00:25.360542 ip-10-0-130-217 kubenswrapper[2563]: E0715 22:00:25.360522    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"71dde0054b22e9495a22f5bd0c2ba79d9fb5060c3e6a6a6646cb57775d885a79\": container with ID starting with 71dde0054b22e9495a22f5bd0c2ba79d9fb5060c3e6a6a6646cb57775d885a79 not found: ID does not exist" containerID="71dde0054b22e9495a22f5bd0c2ba79d9fb5060c3e6a6a6646cb57775d885a79"
Jul 15 22:00:25.360626 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:00:25.360548    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"71dde0054b22e9495a22f5bd0c2ba79d9fb5060c3e6a6a6646cb57775d885a79"} err="failed to get container status \"71dde0054b22e9495a22f5bd0c2ba79d9fb5060c3e6a6a6646cb57775d885a79\": rpc error: code = NotFound desc = could not find container \"71dde0054b22e9495a22f5bd0c2ba79d9fb5060c3e6a6a6646cb57775d885a79\": container with ID starting with 71dde0054b22e9495a22f5bd0c2ba79d9fb5060c3e6a6a6646cb57775d885a79 not found: ID does not exist"
Jul 15 22:00:25.371144 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:00:25.371122    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-5920611a-78b69cbc4d-dvprc"]
Jul 15 22:00:25.374933 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:00:25.374908    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-5920611a-78b69cbc4d-dvprc"]
Jul 15 22:00:26.989983 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:00:26.989923    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fe445f5e-4bd2-4d67-b180-76d195efd5a3" path="/var/lib/kubelet/pods/fe445f5e-4bd2-4d67-b180-76d195efd5a3/volumes"
Jul 15 22:00:40.024276 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:00:40.024189    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-5920611a-openshift-default-ccdcc677f-r7h68"]
Jul 15 22:00:40.024881 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:00:40.024467    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-5920611a-openshift-default-ccdcc677f-r7h68" podUID="0360f075-2e50-4fdf-90cb-230aa700b873" containerName="istio-proxy" containerID="cri-o://74868b6cddfbf2c1bd9828d902e25ea460b5159deebf69e8894329251dc9e538" gracePeriod=30
Jul 15 22:00:45.287774 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:00:45.287708    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-5920611a-openshift-default-ccdcc677f-r7h68"
Jul 15 22:00:45.455967 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:00:45.455911    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wg4wq\" (UniqueName: \"kubernetes.io/projected/0360f075-2e50-4fdf-90cb-230aa700b873-kube-api-access-wg4wq\") pod \"0360f075-2e50-4fdf-90cb-230aa700b873\" (UID: \"0360f075-2e50-4fdf-90cb-230aa700b873\") "
Jul 15 22:00:45.456174 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:00:45.455988    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0360f075-2e50-4fdf-90cb-230aa700b873-workload-socket\") pod \"0360f075-2e50-4fdf-90cb-230aa700b873\" (UID: \"0360f075-2e50-4fdf-90cb-230aa700b873\") "
Jul 15 22:00:45.456174 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:00:45.456020    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0360f075-2e50-4fdf-90cb-230aa700b873-istiod-ca-cert\") pod \"0360f075-2e50-4fdf-90cb-230aa700b873\" (UID: \"0360f075-2e50-4fdf-90cb-230aa700b873\") "
Jul 15 22:00:45.456174 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:00:45.456076    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0360f075-2e50-4fdf-90cb-230aa700b873-istio-envoy\") pod \"0360f075-2e50-4fdf-90cb-230aa700b873\" (UID: \"0360f075-2e50-4fdf-90cb-230aa700b873\") "
Jul 15 22:00:45.456174 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:00:45.456098    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0360f075-2e50-4fdf-90cb-230aa700b873-workload-certs\") pod \"0360f075-2e50-4fdf-90cb-230aa700b873\" (UID: \"0360f075-2e50-4fdf-90cb-230aa700b873\") "
Jul 15 22:00:45.456174 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:00:45.456138    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0360f075-2e50-4fdf-90cb-230aa700b873-credential-socket\") pod \"0360f075-2e50-4fdf-90cb-230aa700b873\" (UID: \"0360f075-2e50-4fdf-90cb-230aa700b873\") "
Jul 15 22:00:45.456174 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:00:45.456169    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0360f075-2e50-4fdf-90cb-230aa700b873-istio-podinfo\") pod \"0360f075-2e50-4fdf-90cb-230aa700b873\" (UID: \"0360f075-2e50-4fdf-90cb-230aa700b873\") "
Jul 15 22:00:45.456518 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:00:45.456193    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0360f075-2e50-4fdf-90cb-230aa700b873-istio-token\") pod \"0360f075-2e50-4fdf-90cb-230aa700b873\" (UID: \"0360f075-2e50-4fdf-90cb-230aa700b873\") "
Jul 15 22:00:45.456518 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:00:45.456233    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0360f075-2e50-4fdf-90cb-230aa700b873-istio-data\") pod \"0360f075-2e50-4fdf-90cb-230aa700b873\" (UID: \"0360f075-2e50-4fdf-90cb-230aa700b873\") "
Jul 15 22:00:45.456518 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:00:45.456338    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0360f075-2e50-4fdf-90cb-230aa700b873-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "0360f075-2e50-4fdf-90cb-230aa700b873" (UID: "0360f075-2e50-4fdf-90cb-230aa700b873"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 22:00:45.456518 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:00:45.456468    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0360f075-2e50-4fdf-90cb-230aa700b873-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "0360f075-2e50-4fdf-90cb-230aa700b873" (UID: "0360f075-2e50-4fdf-90cb-230aa700b873"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 22:00:45.456734 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:00:45.456581    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0360f075-2e50-4fdf-90cb-230aa700b873-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "0360f075-2e50-4fdf-90cb-230aa700b873" (UID: "0360f075-2e50-4fdf-90cb-230aa700b873"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 22:00:45.456734 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:00:45.456642    2563 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0360f075-2e50-4fdf-90cb-230aa700b873-workload-socket\") on node \"ip-10-0-130-217.ec2.internal\" DevicePath \"\""
Jul 15 22:00:45.456734 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:00:45.456664    2563 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0360f075-2e50-4fdf-90cb-230aa700b873-workload-certs\") on node \"ip-10-0-130-217.ec2.internal\" DevicePath \"\""
Jul 15 22:00:45.456902 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:00:45.456840    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0360f075-2e50-4fdf-90cb-230aa700b873-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "0360f075-2e50-4fdf-90cb-230aa700b873" (UID: "0360f075-2e50-4fdf-90cb-230aa700b873"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 22:00:45.457355 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:00:45.457325    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0360f075-2e50-4fdf-90cb-230aa700b873-istio-data" (OuterVolumeSpecName: "istio-data") pod "0360f075-2e50-4fdf-90cb-230aa700b873" (UID: "0360f075-2e50-4fdf-90cb-230aa700b873"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 22:00:45.458664 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:00:45.458631    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0360f075-2e50-4fdf-90cb-230aa700b873-istio-token" (OuterVolumeSpecName: "istio-token") pod "0360f075-2e50-4fdf-90cb-230aa700b873" (UID: "0360f075-2e50-4fdf-90cb-230aa700b873"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 22:00:45.458761 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:00:45.458697    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0360f075-2e50-4fdf-90cb-230aa700b873-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "0360f075-2e50-4fdf-90cb-230aa700b873" (UID: "0360f075-2e50-4fdf-90cb-230aa700b873"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 22:00:45.458806 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:00:45.458763    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0360f075-2e50-4fdf-90cb-230aa700b873-kube-api-access-wg4wq" (OuterVolumeSpecName: "kube-api-access-wg4wq") pod "0360f075-2e50-4fdf-90cb-230aa700b873" (UID: "0360f075-2e50-4fdf-90cb-230aa700b873"). InnerVolumeSpecName "kube-api-access-wg4wq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 22:00:45.459130 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:00:45.459106    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/0360f075-2e50-4fdf-90cb-230aa700b873-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "0360f075-2e50-4fdf-90cb-230aa700b873" (UID: "0360f075-2e50-4fdf-90cb-230aa700b873"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 15 22:00:45.461691 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:00:45.461669    2563 generic.go:356] "Generic (PLEG): container finished" podID="0360f075-2e50-4fdf-90cb-230aa700b873" containerID="74868b6cddfbf2c1bd9828d902e25ea460b5159deebf69e8894329251dc9e538" exitCode=0
Jul 15 22:00:45.461771 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:00:45.461734    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-5920611a-openshift-default-ccdcc677f-r7h68"
Jul 15 22:00:45.461771 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:00:45.461746    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-5920611a-openshift-default-ccdcc677f-r7h68" event={"ID":"0360f075-2e50-4fdf-90cb-230aa700b873","Type":"ContainerDied","Data":"74868b6cddfbf2c1bd9828d902e25ea460b5159deebf69e8894329251dc9e538"}
Jul 15 22:00:45.461843 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:00:45.461795    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-5920611a-openshift-default-ccdcc677f-r7h68" event={"ID":"0360f075-2e50-4fdf-90cb-230aa700b873","Type":"ContainerDied","Data":"7a0d4b753202ff39a7889f08168ecedd56da1f020937411e12abe9007b9206c8"}
Jul 15 22:00:45.461843 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:00:45.461820    2563 scope.go:117] "RemoveContainer" containerID="74868b6cddfbf2c1bd9828d902e25ea460b5159deebf69e8894329251dc9e538"
Jul 15 22:00:45.481913 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:00:45.481894    2563 scope.go:117] "RemoveContainer" containerID="db78f009a58dbb862426b3a45208540bd3a41d65b219a266506c841cb1475325"
Jul 15 22:00:45.490910 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:00:45.490883    2563 scope.go:117] "RemoveContainer" containerID="74868b6cddfbf2c1bd9828d902e25ea460b5159deebf69e8894329251dc9e538"
Jul 15 22:00:45.491239 ip-10-0-130-217 kubenswrapper[2563]: E0715 22:00:45.491214    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"74868b6cddfbf2c1bd9828d902e25ea460b5159deebf69e8894329251dc9e538\": container with ID starting with 74868b6cddfbf2c1bd9828d902e25ea460b5159deebf69e8894329251dc9e538 not found: ID does not exist" containerID="74868b6cddfbf2c1bd9828d902e25ea460b5159deebf69e8894329251dc9e538"
Jul 15 22:00:45.491314 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:00:45.491252    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"74868b6cddfbf2c1bd9828d902e25ea460b5159deebf69e8894329251dc9e538"} err="failed to get container status \"74868b6cddfbf2c1bd9828d902e25ea460b5159deebf69e8894329251dc9e538\": rpc error: code = NotFound desc = could not find container \"74868b6cddfbf2c1bd9828d902e25ea460b5159deebf69e8894329251dc9e538\": container with ID starting with 74868b6cddfbf2c1bd9828d902e25ea460b5159deebf69e8894329251dc9e538 not found: ID does not exist"
Jul 15 22:00:45.491314 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:00:45.491279    2563 scope.go:117] "RemoveContainer" containerID="db78f009a58dbb862426b3a45208540bd3a41d65b219a266506c841cb1475325"
Jul 15 22:00:45.491611 ip-10-0-130-217 kubenswrapper[2563]: E0715 22:00:45.491593    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"db78f009a58dbb862426b3a45208540bd3a41d65b219a266506c841cb1475325\": container with ID starting with db78f009a58dbb862426b3a45208540bd3a41d65b219a266506c841cb1475325 not found: ID does not exist" containerID="db78f009a58dbb862426b3a45208540bd3a41d65b219a266506c841cb1475325"
Jul 15 22:00:45.491661 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:00:45.491616    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"db78f009a58dbb862426b3a45208540bd3a41d65b219a266506c841cb1475325"} err="failed to get container status \"db78f009a58dbb862426b3a45208540bd3a41d65b219a266506c841cb1475325\": rpc error: code = NotFound desc = could not find container \"db78f009a58dbb862426b3a45208540bd3a41d65b219a266506c841cb1475325\": container with ID starting with db78f009a58dbb862426b3a45208540bd3a41d65b219a266506c841cb1475325 not found: ID does not exist"
Jul 15 22:00:45.493382 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:00:45.493350    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-5920611a-openshift-default-ccdcc677f-r7h68"]
Jul 15 22:00:45.498115 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:00:45.498094    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-5920611a-openshift-default-ccdcc677f-r7h68"]
Jul 15 22:00:45.557571 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:00:45.557497    2563 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0360f075-2e50-4fdf-90cb-230aa700b873-istio-envoy\") on node \"ip-10-0-130-217.ec2.internal\" DevicePath \"\""
Jul 15 22:00:45.557571 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:00:45.557524    2563 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0360f075-2e50-4fdf-90cb-230aa700b873-credential-socket\") on node \"ip-10-0-130-217.ec2.internal\" DevicePath \"\""
Jul 15 22:00:45.557571 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:00:45.557533    2563 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0360f075-2e50-4fdf-90cb-230aa700b873-istio-podinfo\") on node \"ip-10-0-130-217.ec2.internal\" DevicePath \"\""
Jul 15 22:00:45.557571 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:00:45.557541    2563 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0360f075-2e50-4fdf-90cb-230aa700b873-istio-token\") on node \"ip-10-0-130-217.ec2.internal\" DevicePath \"\""
Jul 15 22:00:45.557571 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:00:45.557549    2563 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0360f075-2e50-4fdf-90cb-230aa700b873-istio-data\") on node \"ip-10-0-130-217.ec2.internal\" DevicePath \"\""
Jul 15 22:00:45.557571 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:00:45.557557    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wg4wq\" (UniqueName: \"kubernetes.io/projected/0360f075-2e50-4fdf-90cb-230aa700b873-kube-api-access-wg4wq\") on node \"ip-10-0-130-217.ec2.internal\" DevicePath \"\""
Jul 15 22:00:45.557571 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:00:45.557564    2563 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0360f075-2e50-4fdf-90cb-230aa700b873-istiod-ca-cert\") on node \"ip-10-0-130-217.ec2.internal\" DevicePath \"\""
Jul 15 22:00:46.988364 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:00:46.988330    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0360f075-2e50-4fdf-90cb-230aa700b873" path="/var/lib/kubelet/pods/0360f075-2e50-4fdf-90cb-230aa700b873/volumes"
Jul 15 22:01:11.054522 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:01:11.054491    2563 scope.go:117] "RemoveContainer" containerID="d5dfc76c886a82c65658800161190407dbcbfb470afde51d3a8d843cf52d93e5"
Jul 15 22:01:52.552080 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:01:52.552046    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-4081d1-openshift-default-bf6bd4569-g9dmx"]
Jul 15 22:01:52.552667 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:01:52.552643    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0360f075-2e50-4fdf-90cb-230aa700b873" containerName="istio-proxy"
Jul 15 22:01:52.552667 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:01:52.552667    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="0360f075-2e50-4fdf-90cb-230aa700b873" containerName="istio-proxy"
Jul 15 22:01:52.552819 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:01:52.552682    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d024dd00-01c9-47b5-869a-c95f6b1005fc" containerName="revoke-keys"
Jul 15 22:01:52.552819 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:01:52.552691    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="d024dd00-01c9-47b5-869a-c95f6b1005fc" containerName="revoke-keys"
Jul 15 22:01:52.552819 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:01:52.552725    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fe445f5e-4bd2-4d67-b180-76d195efd5a3" containerName="maas-api"
Jul 15 22:01:52.552819 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:01:52.552734    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="fe445f5e-4bd2-4d67-b180-76d195efd5a3" containerName="maas-api"
Jul 15 22:01:52.552978 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:01:52.552830    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="0360f075-2e50-4fdf-90cb-230aa700b873" containerName="istio-proxy"
Jul 15 22:01:52.552978 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:01:52.552845    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="d024dd00-01c9-47b5-869a-c95f6b1005fc" containerName="revoke-keys"
Jul 15 22:01:52.552978 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:01:52.552856    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="fe445f5e-4bd2-4d67-b180-76d195efd5a3" containerName="maas-api"
Jul 15 22:01:52.556304 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:01:52.556285    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-4081d1-openshift-default-bf6bd4569-g9dmx"
Jul 15 22:01:52.558419 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:01:52.558398    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-4081d1-openshift-default-dockercfg-ffjzv\""
Jul 15 22:01:52.565498 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:01:52.565474    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-4081d1-openshift-default-bf6bd4569-g9dmx"]
Jul 15 22:01:52.706678 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:01:52.706640    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/47355eb7-0019-40be-bf0e-d214e2b8a490-istiod-ca-cert\") pod \"e2e-inf-a-4081d1-openshift-default-bf6bd4569-g9dmx\" (UID: \"47355eb7-0019-40be-bf0e-d214e2b8a490\") " pod="openshift-ingress/e2e-inf-a-4081d1-openshift-default-bf6bd4569-g9dmx"
Jul 15 22:01:52.706852 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:01:52.706694    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4qwcr\" (UniqueName: \"kubernetes.io/projected/47355eb7-0019-40be-bf0e-d214e2b8a490-kube-api-access-4qwcr\") pod \"e2e-inf-a-4081d1-openshift-default-bf6bd4569-g9dmx\" (UID: \"47355eb7-0019-40be-bf0e-d214e2b8a490\") " pod="openshift-ingress/e2e-inf-a-4081d1-openshift-default-bf6bd4569-g9dmx"
Jul 15 22:01:52.706852 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:01:52.706769    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/47355eb7-0019-40be-bf0e-d214e2b8a490-istio-token\") pod \"e2e-inf-a-4081d1-openshift-default-bf6bd4569-g9dmx\" (UID: \"47355eb7-0019-40be-bf0e-d214e2b8a490\") " pod="openshift-ingress/e2e-inf-a-4081d1-openshift-default-bf6bd4569-g9dmx"
Jul 15 22:01:52.706852 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:01:52.706819    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/47355eb7-0019-40be-bf0e-d214e2b8a490-istio-envoy\") pod \"e2e-inf-a-4081d1-openshift-default-bf6bd4569-g9dmx\" (UID: \"47355eb7-0019-40be-bf0e-d214e2b8a490\") " pod="openshift-ingress/e2e-inf-a-4081d1-openshift-default-bf6bd4569-g9dmx"
Jul 15 22:01:52.706976 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:01:52.706862    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/47355eb7-0019-40be-bf0e-d214e2b8a490-workload-certs\") pod \"e2e-inf-a-4081d1-openshift-default-bf6bd4569-g9dmx\" (UID: \"47355eb7-0019-40be-bf0e-d214e2b8a490\") " pod="openshift-ingress/e2e-inf-a-4081d1-openshift-default-bf6bd4569-g9dmx"
Jul 15 22:01:52.706976 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:01:52.706898    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/47355eb7-0019-40be-bf0e-d214e2b8a490-credential-socket\") pod \"e2e-inf-a-4081d1-openshift-default-bf6bd4569-g9dmx\" (UID: \"47355eb7-0019-40be-bf0e-d214e2b8a490\") " pod="openshift-ingress/e2e-inf-a-4081d1-openshift-default-bf6bd4569-g9dmx"
Jul 15 22:01:52.706976 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:01:52.706921    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/47355eb7-0019-40be-bf0e-d214e2b8a490-istio-podinfo\") pod \"e2e-inf-a-4081d1-openshift-default-bf6bd4569-g9dmx\" (UID: \"47355eb7-0019-40be-bf0e-d214e2b8a490\") " pod="openshift-ingress/e2e-inf-a-4081d1-openshift-default-bf6bd4569-g9dmx"
Jul 15 22:01:52.707075 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:01:52.706981    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/47355eb7-0019-40be-bf0e-d214e2b8a490-workload-socket\") pod \"e2e-inf-a-4081d1-openshift-default-bf6bd4569-g9dmx\" (UID: \"47355eb7-0019-40be-bf0e-d214e2b8a490\") " pod="openshift-ingress/e2e-inf-a-4081d1-openshift-default-bf6bd4569-g9dmx"
Jul 15 22:01:52.707075 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:01:52.707022    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/47355eb7-0019-40be-bf0e-d214e2b8a490-istio-data\") pod \"e2e-inf-a-4081d1-openshift-default-bf6bd4569-g9dmx\" (UID: \"47355eb7-0019-40be-bf0e-d214e2b8a490\") " pod="openshift-ingress/e2e-inf-a-4081d1-openshift-default-bf6bd4569-g9dmx"
Jul 15 22:01:52.807613 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:01:52.807504    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/47355eb7-0019-40be-bf0e-d214e2b8a490-istio-token\") pod \"e2e-inf-a-4081d1-openshift-default-bf6bd4569-g9dmx\" (UID: \"47355eb7-0019-40be-bf0e-d214e2b8a490\") " pod="openshift-ingress/e2e-inf-a-4081d1-openshift-default-bf6bd4569-g9dmx"
Jul 15 22:01:52.807613 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:01:52.807562    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/47355eb7-0019-40be-bf0e-d214e2b8a490-istio-envoy\") pod \"e2e-inf-a-4081d1-openshift-default-bf6bd4569-g9dmx\" (UID: \"47355eb7-0019-40be-bf0e-d214e2b8a490\") " pod="openshift-ingress/e2e-inf-a-4081d1-openshift-default-bf6bd4569-g9dmx"
Jul 15 22:01:52.807860 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:01:52.807614    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/47355eb7-0019-40be-bf0e-d214e2b8a490-workload-certs\") pod \"e2e-inf-a-4081d1-openshift-default-bf6bd4569-g9dmx\" (UID: \"47355eb7-0019-40be-bf0e-d214e2b8a490\") " pod="openshift-ingress/e2e-inf-a-4081d1-openshift-default-bf6bd4569-g9dmx"
Jul 15 22:01:52.807860 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:01:52.807641    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/47355eb7-0019-40be-bf0e-d214e2b8a490-credential-socket\") pod \"e2e-inf-a-4081d1-openshift-default-bf6bd4569-g9dmx\" (UID: \"47355eb7-0019-40be-bf0e-d214e2b8a490\") " pod="openshift-ingress/e2e-inf-a-4081d1-openshift-default-bf6bd4569-g9dmx"
Jul 15 22:01:52.807860 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:01:52.807686    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/47355eb7-0019-40be-bf0e-d214e2b8a490-istio-podinfo\") pod \"e2e-inf-a-4081d1-openshift-default-bf6bd4569-g9dmx\" (UID: \"47355eb7-0019-40be-bf0e-d214e2b8a490\") " pod="openshift-ingress/e2e-inf-a-4081d1-openshift-default-bf6bd4569-g9dmx"
Jul 15 22:01:52.807860 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:01:52.807715    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/47355eb7-0019-40be-bf0e-d214e2b8a490-workload-socket\") pod \"e2e-inf-a-4081d1-openshift-default-bf6bd4569-g9dmx\" (UID: \"47355eb7-0019-40be-bf0e-d214e2b8a490\") " pod="openshift-ingress/e2e-inf-a-4081d1-openshift-default-bf6bd4569-g9dmx"
Jul 15 22:01:52.807860 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:01:52.807791    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/47355eb7-0019-40be-bf0e-d214e2b8a490-istio-data\") pod \"e2e-inf-a-4081d1-openshift-default-bf6bd4569-g9dmx\" (UID: \"47355eb7-0019-40be-bf0e-d214e2b8a490\") " pod="openshift-ingress/e2e-inf-a-4081d1-openshift-default-bf6bd4569-g9dmx"
Jul 15 22:01:52.807860 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:01:52.807854    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/47355eb7-0019-40be-bf0e-d214e2b8a490-istiod-ca-cert\") pod \"e2e-inf-a-4081d1-openshift-default-bf6bd4569-g9dmx\" (UID: \"47355eb7-0019-40be-bf0e-d214e2b8a490\") " pod="openshift-ingress/e2e-inf-a-4081d1-openshift-default-bf6bd4569-g9dmx"
Jul 15 22:01:52.808247 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:01:52.807900    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4qwcr\" (UniqueName: \"kubernetes.io/projected/47355eb7-0019-40be-bf0e-d214e2b8a490-kube-api-access-4qwcr\") pod \"e2e-inf-a-4081d1-openshift-default-bf6bd4569-g9dmx\" (UID: \"47355eb7-0019-40be-bf0e-d214e2b8a490\") " pod="openshift-ingress/e2e-inf-a-4081d1-openshift-default-bf6bd4569-g9dmx"
Jul 15 22:01:52.808247 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:01:52.808158    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/47355eb7-0019-40be-bf0e-d214e2b8a490-workload-certs\") pod \"e2e-inf-a-4081d1-openshift-default-bf6bd4569-g9dmx\" (UID: \"47355eb7-0019-40be-bf0e-d214e2b8a490\") " pod="openshift-ingress/e2e-inf-a-4081d1-openshift-default-bf6bd4569-g9dmx"
Jul 15 22:01:52.808247 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:01:52.808193    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/47355eb7-0019-40be-bf0e-d214e2b8a490-credential-socket\") pod \"e2e-inf-a-4081d1-openshift-default-bf6bd4569-g9dmx\" (UID: \"47355eb7-0019-40be-bf0e-d214e2b8a490\") " pod="openshift-ingress/e2e-inf-a-4081d1-openshift-default-bf6bd4569-g9dmx"
Jul 15 22:01:52.808428 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:01:52.808264    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/47355eb7-0019-40be-bf0e-d214e2b8a490-workload-socket\") pod \"e2e-inf-a-4081d1-openshift-default-bf6bd4569-g9dmx\" (UID: \"47355eb7-0019-40be-bf0e-d214e2b8a490\") " pod="openshift-ingress/e2e-inf-a-4081d1-openshift-default-bf6bd4569-g9dmx"
Jul 15 22:01:52.808503 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:01:52.808479    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/47355eb7-0019-40be-bf0e-d214e2b8a490-istio-data\") pod \"e2e-inf-a-4081d1-openshift-default-bf6bd4569-g9dmx\" (UID: \"47355eb7-0019-40be-bf0e-d214e2b8a490\") " pod="openshift-ingress/e2e-inf-a-4081d1-openshift-default-bf6bd4569-g9dmx"
Jul 15 22:01:52.808862 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:01:52.808840    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/47355eb7-0019-40be-bf0e-d214e2b8a490-istiod-ca-cert\") pod \"e2e-inf-a-4081d1-openshift-default-bf6bd4569-g9dmx\" (UID: \"47355eb7-0019-40be-bf0e-d214e2b8a490\") " pod="openshift-ingress/e2e-inf-a-4081d1-openshift-default-bf6bd4569-g9dmx"
Jul 15 22:01:52.810120 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:01:52.810096    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/47355eb7-0019-40be-bf0e-d214e2b8a490-istio-envoy\") pod \"e2e-inf-a-4081d1-openshift-default-bf6bd4569-g9dmx\" (UID: \"47355eb7-0019-40be-bf0e-d214e2b8a490\") " pod="openshift-ingress/e2e-inf-a-4081d1-openshift-default-bf6bd4569-g9dmx"
Jul 15 22:01:52.810239 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:01:52.810220    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/47355eb7-0019-40be-bf0e-d214e2b8a490-istio-podinfo\") pod \"e2e-inf-a-4081d1-openshift-default-bf6bd4569-g9dmx\" (UID: \"47355eb7-0019-40be-bf0e-d214e2b8a490\") " pod="openshift-ingress/e2e-inf-a-4081d1-openshift-default-bf6bd4569-g9dmx"
Jul 15 22:01:52.816014 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:01:52.815976    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/47355eb7-0019-40be-bf0e-d214e2b8a490-istio-token\") pod \"e2e-inf-a-4081d1-openshift-default-bf6bd4569-g9dmx\" (UID: \"47355eb7-0019-40be-bf0e-d214e2b8a490\") " pod="openshift-ingress/e2e-inf-a-4081d1-openshift-default-bf6bd4569-g9dmx"
Jul 15 22:01:52.816181 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:01:52.816160    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4qwcr\" (UniqueName: \"kubernetes.io/projected/47355eb7-0019-40be-bf0e-d214e2b8a490-kube-api-access-4qwcr\") pod \"e2e-inf-a-4081d1-openshift-default-bf6bd4569-g9dmx\" (UID: \"47355eb7-0019-40be-bf0e-d214e2b8a490\") " pod="openshift-ingress/e2e-inf-a-4081d1-openshift-default-bf6bd4569-g9dmx"
Jul 15 22:01:52.867631 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:01:52.867597    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-4081d1-openshift-default-bf6bd4569-g9dmx"
Jul 15 22:01:53.015560 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:01:53.015533    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-4081d1-openshift-default-bf6bd4569-g9dmx"]
Jul 15 22:01:53.016899 ip-10-0-130-217 kubenswrapper[2563]: W0715 22:01:53.016865    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod47355eb7_0019_40be_bf0e_d214e2b8a490.slice/crio-bba8ee618c8ecd8400b56652947c3b3906337d7d64cd0be6c67bed10fad6ac67 WatchSource:0}: Error finding container bba8ee618c8ecd8400b56652947c3b3906337d7d64cd0be6c67bed10fad6ac67: Status 404 returned error can't find the container with id bba8ee618c8ecd8400b56652947c3b3906337d7d64cd0be6c67bed10fad6ac67
Jul 15 22:01:53.019099 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:01:53.019030    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 15 22:01:53.019178 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:01:53.019137    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 15 22:01:53.019178 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:01:53.019164    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 15 22:01:53.828425 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:01:53.828377    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-4081d1-openshift-default-bf6bd4569-g9dmx" event={"ID":"47355eb7-0019-40be-bf0e-d214e2b8a490","Type":"ContainerStarted","Data":"88e95e7f4bcc110611718a0298d7fe4fb5133d72ca49c47f2a4930ff72575562"}
Jul 15 22:01:53.828792 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:01:53.828444    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-4081d1-openshift-default-bf6bd4569-g9dmx" event={"ID":"47355eb7-0019-40be-bf0e-d214e2b8a490","Type":"ContainerStarted","Data":"bba8ee618c8ecd8400b56652947c3b3906337d7d64cd0be6c67bed10fad6ac67"}
Jul 15 22:01:53.848073 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:01:53.848026    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-4081d1-openshift-default-bf6bd4569-g9dmx" podStartSLOduration=1.848009717 podStartE2EDuration="1.848009717s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 22:01:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 22:01:53.846365435 +0000 UTC m=+1963.540292986" watchObservedRunningTime="2026-07-15 22:01:53.848009717 +0000 UTC m=+1963.541937267"
Jul 15 22:01:53.868598 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:01:53.868563    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-4081d1-openshift-default-bf6bd4569-g9dmx"
Jul 15 22:01:54.874122 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:01:54.874086    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-4081d1-openshift-default-bf6bd4569-g9dmx"
Jul 15 22:01:55.838643 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:01:55.838609    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-4081d1-openshift-default-bf6bd4569-g9dmx"
Jul 15 22:01:55.841493 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:01:55.840776    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-4081d1-openshift-default-bf6bd4569-g9dmx"
Jul 15 22:01:56.042155 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:01:56.042119    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-4081d1-6fdcd4b589-mkrpr"]
Jul 15 22:01:56.042742 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:01:56.042714    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0360f075-2e50-4fdf-90cb-230aa700b873" containerName="istio-proxy"
Jul 15 22:01:56.042742 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:01:56.042742    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="0360f075-2e50-4fdf-90cb-230aa700b873" containerName="istio-proxy"
Jul 15 22:01:56.042968 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:01:56.042848    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="0360f075-2e50-4fdf-90cb-230aa700b873" containerName="istio-proxy"
Jul 15 22:01:56.046237 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:01:56.046215    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-4081d1-6fdcd4b589-mkrpr"
Jul 15 22:01:56.048489 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:01:56.048464    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-a-4081d1-serving-cert\""
Jul 15 22:01:56.055692 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:01:56.055529    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-4081d1-6fdcd4b589-mkrpr"]
Jul 15 22:01:56.141858 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:01:56.141763    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2af882ed-bf7b-4a5d-a458-3a9a72be93a8-openshift-service-ca\") pod \"maas-api-e2e-inf-a-4081d1-6fdcd4b589-mkrpr\" (UID: \"2af882ed-bf7b-4a5d-a458-3a9a72be93a8\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-4081d1-6fdcd4b589-mkrpr"
Jul 15 22:01:56.142152 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:01:56.142124    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x84nm\" (UniqueName: \"kubernetes.io/projected/2af882ed-bf7b-4a5d-a458-3a9a72be93a8-kube-api-access-x84nm\") pod \"maas-api-e2e-inf-a-4081d1-6fdcd4b589-mkrpr\" (UID: \"2af882ed-bf7b-4a5d-a458-3a9a72be93a8\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-4081d1-6fdcd4b589-mkrpr"
Jul 15 22:01:56.142372 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:01:56.142351    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2af882ed-bf7b-4a5d-a458-3a9a72be93a8-maas-api-tls\") pod \"maas-api-e2e-inf-a-4081d1-6fdcd4b589-mkrpr\" (UID: \"2af882ed-bf7b-4a5d-a458-3a9a72be93a8\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-4081d1-6fdcd4b589-mkrpr"
Jul 15 22:01:56.243733 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:01:56.243690    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2af882ed-bf7b-4a5d-a458-3a9a72be93a8-maas-api-tls\") pod \"maas-api-e2e-inf-a-4081d1-6fdcd4b589-mkrpr\" (UID: \"2af882ed-bf7b-4a5d-a458-3a9a72be93a8\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-4081d1-6fdcd4b589-mkrpr"
Jul 15 22:01:56.243913 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:01:56.243793    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2af882ed-bf7b-4a5d-a458-3a9a72be93a8-openshift-service-ca\") pod \"maas-api-e2e-inf-a-4081d1-6fdcd4b589-mkrpr\" (UID: \"2af882ed-bf7b-4a5d-a458-3a9a72be93a8\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-4081d1-6fdcd4b589-mkrpr"
Jul 15 22:01:56.243913 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:01:56.243823    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x84nm\" (UniqueName: \"kubernetes.io/projected/2af882ed-bf7b-4a5d-a458-3a9a72be93a8-kube-api-access-x84nm\") pod \"maas-api-e2e-inf-a-4081d1-6fdcd4b589-mkrpr\" (UID: \"2af882ed-bf7b-4a5d-a458-3a9a72be93a8\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-4081d1-6fdcd4b589-mkrpr"
Jul 15 22:01:56.243913 ip-10-0-130-217 kubenswrapper[2563]: E0715 22:01:56.243837    2563 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-a-4081d1-serving-cert: secret "maas-api-e2e-inf-a-4081d1-serving-cert" not found
Jul 15 22:01:56.243913 ip-10-0-130-217 kubenswrapper[2563]: E0715 22:01:56.243906    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2af882ed-bf7b-4a5d-a458-3a9a72be93a8-maas-api-tls podName:2af882ed-bf7b-4a5d-a458-3a9a72be93a8 nodeName:}" failed. No retries permitted until 2026-07-15 22:01:56.743886442 +0000 UTC m=+1966.437813971 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/2af882ed-bf7b-4a5d-a458-3a9a72be93a8-maas-api-tls") pod "maas-api-e2e-inf-a-4081d1-6fdcd4b589-mkrpr" (UID: "2af882ed-bf7b-4a5d-a458-3a9a72be93a8") : secret "maas-api-e2e-inf-a-4081d1-serving-cert" not found
Jul 15 22:01:56.244500 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:01:56.244482    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2af882ed-bf7b-4a5d-a458-3a9a72be93a8-openshift-service-ca\") pod \"maas-api-e2e-inf-a-4081d1-6fdcd4b589-mkrpr\" (UID: \"2af882ed-bf7b-4a5d-a458-3a9a72be93a8\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-4081d1-6fdcd4b589-mkrpr"
Jul 15 22:01:56.264947 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:01:56.264911    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x84nm\" (UniqueName: \"kubernetes.io/projected/2af882ed-bf7b-4a5d-a458-3a9a72be93a8-kube-api-access-x84nm\") pod \"maas-api-e2e-inf-a-4081d1-6fdcd4b589-mkrpr\" (UID: \"2af882ed-bf7b-4a5d-a458-3a9a72be93a8\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-4081d1-6fdcd4b589-mkrpr"
Jul 15 22:01:56.748443 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:01:56.748402    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2af882ed-bf7b-4a5d-a458-3a9a72be93a8-maas-api-tls\") pod \"maas-api-e2e-inf-a-4081d1-6fdcd4b589-mkrpr\" (UID: \"2af882ed-bf7b-4a5d-a458-3a9a72be93a8\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-4081d1-6fdcd4b589-mkrpr"
Jul 15 22:01:56.750975 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:01:56.750929    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2af882ed-bf7b-4a5d-a458-3a9a72be93a8-maas-api-tls\") pod \"maas-api-e2e-inf-a-4081d1-6fdcd4b589-mkrpr\" (UID: \"2af882ed-bf7b-4a5d-a458-3a9a72be93a8\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-4081d1-6fdcd4b589-mkrpr"
Jul 15 22:01:56.959681 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:01:56.959644    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-4081d1-6fdcd4b589-mkrpr"
Jul 15 22:01:57.133383 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:01:57.133356    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-4081d1-6fdcd4b589-mkrpr"]
Jul 15 22:01:57.135487 ip-10-0-130-217 kubenswrapper[2563]: W0715 22:01:57.135458    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2af882ed_bf7b_4a5d_a458_3a9a72be93a8.slice/crio-05eae26bf65993373dd23b72925ecbda0302fa29842ce17d766ebc1dd4a83f2f WatchSource:0}: Error finding container 05eae26bf65993373dd23b72925ecbda0302fa29842ce17d766ebc1dd4a83f2f: Status 404 returned error can't find the container with id 05eae26bf65993373dd23b72925ecbda0302fa29842ce17d766ebc1dd4a83f2f
Jul 15 22:01:57.850271 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:01:57.850235    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-4081d1-6fdcd4b589-mkrpr" event={"ID":"2af882ed-bf7b-4a5d-a458-3a9a72be93a8","Type":"ContainerStarted","Data":"f6d29fec416b95a31fe5942f4b6b998e95ab7c5afc4650c02dc204e5218ecd67"}
Jul 15 22:01:57.850463 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:01:57.850291    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-4081d1-6fdcd4b589-mkrpr" event={"ID":"2af882ed-bf7b-4a5d-a458-3a9a72be93a8","Type":"ContainerStarted","Data":"05eae26bf65993373dd23b72925ecbda0302fa29842ce17d766ebc1dd4a83f2f"}
Jul 15 22:01:57.850463 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:01:57.850319    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-4081d1-6fdcd4b589-mkrpr"
Jul 15 22:01:57.865019 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:01:57.864962    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-4081d1-6fdcd4b589-mkrpr" podStartSLOduration=1.501767073 podStartE2EDuration="1.864923378s" totalImagesPullingTime="363.156305ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 22:01:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 22:01:57.864319622 +0000 UTC m=+1967.558247174" watchObservedRunningTime="2026-07-15 22:01:57.864923378 +0000 UTC m=+1967.558850928"
Jul 15 22:02:03.862097 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:02:03.862019    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-4081d1-6fdcd4b589-mkrpr"
Jul 15 22:02:04.539006 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:02:04.538969    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-a6de7e-7876d959bb-5mhzm"]
Jul 15 22:02:04.543712 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:02:04.543686    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-a6de7e-7876d959bb-5mhzm"
Jul 15 22:02:04.545560 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:02:04.545539    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-b-a6de7e-serving-cert\""
Jul 15 22:02:04.552818 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:02:04.551716    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-a6de7e-7876d959bb-5mhzm"]
Jul 15 22:02:04.625115 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:02:04.625083    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/aa3b86e0-fe1d-4ff9-8633-8f6df4fec22c-maas-api-tls\") pod \"maas-api-e2e-inf-b-a6de7e-7876d959bb-5mhzm\" (UID: \"aa3b86e0-fe1d-4ff9-8633-8f6df4fec22c\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-a6de7e-7876d959bb-5mhzm"
Jul 15 22:02:04.625289 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:02:04.625144    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/aa3b86e0-fe1d-4ff9-8633-8f6df4fec22c-openshift-service-ca\") pod \"maas-api-e2e-inf-b-a6de7e-7876d959bb-5mhzm\" (UID: \"aa3b86e0-fe1d-4ff9-8633-8f6df4fec22c\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-a6de7e-7876d959bb-5mhzm"
Jul 15 22:02:04.625289 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:02:04.625232    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wt4tj\" (UniqueName: \"kubernetes.io/projected/aa3b86e0-fe1d-4ff9-8633-8f6df4fec22c-kube-api-access-wt4tj\") pod \"maas-api-e2e-inf-b-a6de7e-7876d959bb-5mhzm\" (UID: \"aa3b86e0-fe1d-4ff9-8633-8f6df4fec22c\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-a6de7e-7876d959bb-5mhzm"
Jul 15 22:02:04.726424 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:02:04.726389    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/aa3b86e0-fe1d-4ff9-8633-8f6df4fec22c-maas-api-tls\") pod \"maas-api-e2e-inf-b-a6de7e-7876d959bb-5mhzm\" (UID: \"aa3b86e0-fe1d-4ff9-8633-8f6df4fec22c\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-a6de7e-7876d959bb-5mhzm"
Jul 15 22:02:04.726424 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:02:04.726424    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/aa3b86e0-fe1d-4ff9-8633-8f6df4fec22c-openshift-service-ca\") pod \"maas-api-e2e-inf-b-a6de7e-7876d959bb-5mhzm\" (UID: \"aa3b86e0-fe1d-4ff9-8633-8f6df4fec22c\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-a6de7e-7876d959bb-5mhzm"
Jul 15 22:02:04.726645 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:02:04.726484    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wt4tj\" (UniqueName: \"kubernetes.io/projected/aa3b86e0-fe1d-4ff9-8633-8f6df4fec22c-kube-api-access-wt4tj\") pod \"maas-api-e2e-inf-b-a6de7e-7876d959bb-5mhzm\" (UID: \"aa3b86e0-fe1d-4ff9-8633-8f6df4fec22c\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-a6de7e-7876d959bb-5mhzm"
Jul 15 22:02:04.727234 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:02:04.727200    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/aa3b86e0-fe1d-4ff9-8633-8f6df4fec22c-openshift-service-ca\") pod \"maas-api-e2e-inf-b-a6de7e-7876d959bb-5mhzm\" (UID: \"aa3b86e0-fe1d-4ff9-8633-8f6df4fec22c\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-a6de7e-7876d959bb-5mhzm"
Jul 15 22:02:04.728948 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:02:04.728911    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/aa3b86e0-fe1d-4ff9-8633-8f6df4fec22c-maas-api-tls\") pod \"maas-api-e2e-inf-b-a6de7e-7876d959bb-5mhzm\" (UID: \"aa3b86e0-fe1d-4ff9-8633-8f6df4fec22c\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-a6de7e-7876d959bb-5mhzm"
Jul 15 22:02:04.757163 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:02:04.757126    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wt4tj\" (UniqueName: \"kubernetes.io/projected/aa3b86e0-fe1d-4ff9-8633-8f6df4fec22c-kube-api-access-wt4tj\") pod \"maas-api-e2e-inf-b-a6de7e-7876d959bb-5mhzm\" (UID: \"aa3b86e0-fe1d-4ff9-8633-8f6df4fec22c\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-a6de7e-7876d959bb-5mhzm"
Jul 15 22:02:04.855900 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:02:04.855867    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-a6de7e-7876d959bb-5mhzm"
Jul 15 22:02:05.060777 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:02:05.060746    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-a6de7e-7876d959bb-5mhzm"]
Jul 15 22:02:05.062289 ip-10-0-130-217 kubenswrapper[2563]: W0715 22:02:05.062250    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaa3b86e0_fe1d_4ff9_8633_8f6df4fec22c.slice/crio-c70029e5c5ecdfe4530905b9d0f9af2c7dfb54eff16b45f179ad3eb50681fedb WatchSource:0}: Error finding container c70029e5c5ecdfe4530905b9d0f9af2c7dfb54eff16b45f179ad3eb50681fedb: Status 404 returned error can't find the container with id c70029e5c5ecdfe4530905b9d0f9af2c7dfb54eff16b45f179ad3eb50681fedb
Jul 15 22:02:05.903611 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:02:05.903550    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-a6de7e-7876d959bb-5mhzm" event={"ID":"aa3b86e0-fe1d-4ff9-8633-8f6df4fec22c","Type":"ContainerStarted","Data":"e6b549830e43945338b47d2289a80046f3a4c6797d481d7c66163565465efb1d"}
Jul 15 22:02:05.903826 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:02:05.903675    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-a6de7e-7876d959bb-5mhzm" event={"ID":"aa3b86e0-fe1d-4ff9-8633-8f6df4fec22c","Type":"ContainerStarted","Data":"c70029e5c5ecdfe4530905b9d0f9af2c7dfb54eff16b45f179ad3eb50681fedb"}
Jul 15 22:02:05.903995 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:02:05.903975    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-a6de7e-7876d959bb-5mhzm"
Jul 15 22:02:05.920496 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:02:05.920447    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-a6de7e-7876d959bb-5mhzm" podStartSLOduration=1.521330209 podStartE2EDuration="1.920434026s" totalImagesPullingTime="399.103817ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 22:02:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 22:02:05.919049736 +0000 UTC m=+1975.612977287" watchObservedRunningTime="2026-07-15 22:02:05.920434026 +0000 UTC m=+1975.614361578"
Jul 15 22:02:11.082728 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:02:11.082692    2563 scope.go:117] "RemoveContainer" containerID="9e24453f9ded903cfa4b098bc3c08dade18ba205a4d5540ae01a6c823b761e2c"
Jul 15 22:02:11.513910 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:02:11.512724    2563 patch_prober.go:28] interesting pod/e2e-inf-a-4081d1-openshift-default-bf6bd4569-g9dmx container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.68:15021/healthz/ready\": read tcp 10.132.0.2:54268->10.132.0.68:15021: read: connection reset by peer" start-of-body=
Jul 15 22:02:11.513910 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:02:11.512812    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-4081d1-openshift-default-bf6bd4569-g9dmx" podUID="47355eb7-0019-40be-bf0e-d214e2b8a490" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.68:15021/healthz/ready\": read tcp 10.132.0.2:54268->10.132.0.68:15021: read: connection reset by peer"
Jul 15 22:02:11.915479 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:02:11.915451    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-a6de7e-7876d959bb-5mhzm"
Jul 15 22:02:11.938599 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:02:11.938568    2563 generic.go:356] "Generic (PLEG): container finished" podID="47355eb7-0019-40be-bf0e-d214e2b8a490" containerID="88e95e7f4bcc110611718a0298d7fe4fb5133d72ca49c47f2a4930ff72575562" exitCode=0
Jul 15 22:02:11.938760 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:02:11.938641    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-4081d1-openshift-default-bf6bd4569-g9dmx" event={"ID":"47355eb7-0019-40be-bf0e-d214e2b8a490","Type":"ContainerDied","Data":"88e95e7f4bcc110611718a0298d7fe4fb5133d72ca49c47f2a4930ff72575562"}
Jul 15 22:02:11.939169 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:02:11.939147    2563 scope.go:117] "RemoveContainer" containerID="88e95e7f4bcc110611718a0298d7fe4fb5133d72ca49c47f2a4930ff72575562"
Jul 15 22:02:11.940369 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:02:11.940337    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 15 22:02:11.940484 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:02:11.940405    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 15 22:02:11.940484 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:02:11.940472    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 15 22:02:12.945409 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:02:12.945376    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-4081d1-openshift-default-bf6bd4569-g9dmx" event={"ID":"47355eb7-0019-40be-bf0e-d214e2b8a490","Type":"ContainerStarted","Data":"7411225fb8143a4ca47a2f029b227d6e4ad4dbb8c1ec013f04884c6f32f1d4df"}
Jul 15 22:02:13.868649 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:02:13.868620    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-4081d1-openshift-default-bf6bd4569-g9dmx"
Jul 15 22:02:13.868814 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:02:13.868791    2563 patch_prober.go:28] interesting pod/e2e-inf-a-4081d1-openshift-default-bf6bd4569-g9dmx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused" start-of-body=
Jul 15 22:02:13.868865 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:02:13.868840    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-4081d1-openshift-default-bf6bd4569-g9dmx" podUID="47355eb7-0019-40be-bf0e-d214e2b8a490" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused"
Jul 15 22:02:14.868548 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:02:14.868508    2563 patch_prober.go:28] interesting pod/e2e-inf-a-4081d1-openshift-default-bf6bd4569-g9dmx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused" start-of-body=
Jul 15 22:02:14.868973 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:02:14.868564    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-4081d1-openshift-default-bf6bd4569-g9dmx" podUID="47355eb7-0019-40be-bf0e-d214e2b8a490" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused"
Jul 15 22:02:15.868864 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:02:15.868829    2563 patch_prober.go:28] interesting pod/e2e-inf-a-4081d1-openshift-default-bf6bd4569-g9dmx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused" start-of-body=
Jul 15 22:02:15.869299 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:02:15.868879    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-4081d1-openshift-default-bf6bd4569-g9dmx" podUID="47355eb7-0019-40be-bf0e-d214e2b8a490" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused"
Jul 15 22:02:16.871373 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:02:16.871330    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-4081d1-openshift-default-bf6bd4569-g9dmx"
Jul 15 22:02:16.871742 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:02:16.871632    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-4081d1-openshift-default-bf6bd4569-g9dmx"
Jul 15 22:02:16.872448 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:02:16.872429    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-4081d1-openshift-default-bf6bd4569-g9dmx"
Jul 15 22:03:03.317612 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:03:03.317574    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-4081d1-zrf9k"]
Jul 15 22:03:03.321280 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:03:03.321259    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-4081d1-zrf9k"
Jul 15 22:03:03.323437 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:03:03.323417    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-zx6nf\""
Jul 15 22:03:03.327749 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:03:03.327691    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-4081d1-zrf9k"]
Jul 15 22:03:03.379739 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:03:03.379702    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f51684a1-50b4-4431-8239-20f6e1149a11-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-4081d1-zrf9k\" (UID: \"f51684a1-50b4-4431-8239-20f6e1149a11\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-4081d1-zrf9k"
Jul 15 22:03:03.480833 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:03:03.480799    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f51684a1-50b4-4431-8239-20f6e1149a11-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-4081d1-zrf9k\" (UID: \"f51684a1-50b4-4431-8239-20f6e1149a11\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-4081d1-zrf9k"
Jul 15 22:03:03.481435 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:03:03.481412    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f51684a1-50b4-4431-8239-20f6e1149a11-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-4081d1-zrf9k\" (UID: \"f51684a1-50b4-4431-8239-20f6e1149a11\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-4081d1-zrf9k"
Jul 15 22:03:03.633368 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:03:03.633333    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-4081d1-zrf9k"
Jul 15 22:03:03.778522 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:03:03.778110    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-4081d1-zrf9k"]
Jul 15 22:03:03.783643 ip-10-0-130-217 kubenswrapper[2563]: W0715 22:03:03.783588    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf51684a1_50b4_4431_8239_20f6e1149a11.slice/crio-fb8a9a192f2bb0c89b47f7e15b81e16b6aa8f79dab05482038372dfd4219277c WatchSource:0}: Error finding container fb8a9a192f2bb0c89b47f7e15b81e16b6aa8f79dab05482038372dfd4219277c: Status 404 returned error can't find the container with id fb8a9a192f2bb0c89b47f7e15b81e16b6aa8f79dab05482038372dfd4219277c
Jul 15 22:03:04.223590 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:03:04.223545    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-4081d1-zrf9k" event={"ID":"f51684a1-50b4-4431-8239-20f6e1149a11","Type":"ContainerStarted","Data":"618e12cd6ec00d6241640ad93c7253286c36157b96795f597837140db94bae79"}
Jul 15 22:03:04.223761 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:03:04.223608    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-4081d1-zrf9k" event={"ID":"f51684a1-50b4-4431-8239-20f6e1149a11","Type":"ContainerStarted","Data":"fb8a9a192f2bb0c89b47f7e15b81e16b6aa8f79dab05482038372dfd4219277c"}
Jul 15 22:03:04.240847 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:03:04.240754    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-4081d1-zrf9k" podStartSLOduration=1.240739986 podStartE2EDuration="1.240739986s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 22:03:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 22:03:04.238336115 +0000 UTC m=+2033.932263671" watchObservedRunningTime="2026-07-15 22:03:04.240739986 +0000 UTC m=+2033.934667536"
Jul 15 22:03:05.230246 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:03:05.230206    2563 generic.go:356] "Generic (PLEG): container finished" podID="f51684a1-50b4-4431-8239-20f6e1149a11" containerID="618e12cd6ec00d6241640ad93c7253286c36157b96795f597837140db94bae79" exitCode=0
Jul 15 22:03:05.230638 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:03:05.230283    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-4081d1-zrf9k" event={"ID":"f51684a1-50b4-4431-8239-20f6e1149a11","Type":"ContainerDied","Data":"618e12cd6ec00d6241640ad93c7253286c36157b96795f597837140db94bae79"}
Jul 15 22:03:06.372240 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:03:06.372214    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-4081d1-zrf9k"
Jul 15 22:03:06.411466 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:03:06.411426    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f51684a1-50b4-4431-8239-20f6e1149a11-maas-api-service-ca\") pod \"f51684a1-50b4-4431-8239-20f6e1149a11\" (UID: \"f51684a1-50b4-4431-8239-20f6e1149a11\") "
Jul 15 22:03:06.411774 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:03:06.411750    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f51684a1-50b4-4431-8239-20f6e1149a11-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "f51684a1-50b4-4431-8239-20f6e1149a11" (UID: "f51684a1-50b4-4431-8239-20f6e1149a11"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 22:03:06.512314 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:03:06.512227    2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f51684a1-50b4-4431-8239-20f6e1149a11-maas-api-service-ca\") on node \"ip-10-0-130-217.ec2.internal\" DevicePath \"\""
Jul 15 22:03:07.241418 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:03:07.241392    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-4081d1-zrf9k"
Jul 15 22:03:07.241586 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:03:07.241386    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-4081d1-zrf9k" event={"ID":"f51684a1-50b4-4431-8239-20f6e1149a11","Type":"ContainerDied","Data":"fb8a9a192f2bb0c89b47f7e15b81e16b6aa8f79dab05482038372dfd4219277c"}
Jul 15 22:03:07.241586 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:03:07.241526    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="fb8a9a192f2bb0c89b47f7e15b81e16b6aa8f79dab05482038372dfd4219277c"
Jul 15 22:03:13.756479 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:03:13.756444    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-4081d1-6fdcd4b589-mkrpr"]
Jul 15 22:03:13.757041 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:03:13.756659    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-4081d1-6fdcd4b589-mkrpr" podUID="2af882ed-bf7b-4a5d-a458-3a9a72be93a8" containerName="maas-api" containerID="cri-o://f6d29fec416b95a31fe5942f4b6b998e95ab7c5afc4650c02dc204e5218ecd67" gracePeriod=30
Jul 15 22:03:13.857252 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:03:13.857208    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-4081d1-6fdcd4b589-mkrpr" podUID="2af882ed-bf7b-4a5d-a458-3a9a72be93a8" containerName="maas-api" probeResult="failure" output="Get \"https://10.132.0.69:8443/health\": dial tcp 10.132.0.69:8443: connect: connection refused"
Jul 15 22:03:14.015890 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:03:14.015828    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-4081d1-6fdcd4b589-mkrpr"
Jul 15 22:03:14.087785 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:03:14.087750    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2af882ed-bf7b-4a5d-a458-3a9a72be93a8-openshift-service-ca\") pod \"2af882ed-bf7b-4a5d-a458-3a9a72be93a8\" (UID: \"2af882ed-bf7b-4a5d-a458-3a9a72be93a8\") "
Jul 15 22:03:14.087985 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:03:14.087820    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2af882ed-bf7b-4a5d-a458-3a9a72be93a8-maas-api-tls\") pod \"2af882ed-bf7b-4a5d-a458-3a9a72be93a8\" (UID: \"2af882ed-bf7b-4a5d-a458-3a9a72be93a8\") "
Jul 15 22:03:14.087985 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:03:14.087930    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x84nm\" (UniqueName: \"kubernetes.io/projected/2af882ed-bf7b-4a5d-a458-3a9a72be93a8-kube-api-access-x84nm\") pod \"2af882ed-bf7b-4a5d-a458-3a9a72be93a8\" (UID: \"2af882ed-bf7b-4a5d-a458-3a9a72be93a8\") "
Jul 15 22:03:14.088257 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:03:14.088226    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2af882ed-bf7b-4a5d-a458-3a9a72be93a8-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "2af882ed-bf7b-4a5d-a458-3a9a72be93a8" (UID: "2af882ed-bf7b-4a5d-a458-3a9a72be93a8"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 22:03:14.088388 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:03:14.088355    2563 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2af882ed-bf7b-4a5d-a458-3a9a72be93a8-openshift-service-ca\") on node \"ip-10-0-130-217.ec2.internal\" DevicePath \"\""
Jul 15 22:03:14.089990 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:03:14.089963    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2af882ed-bf7b-4a5d-a458-3a9a72be93a8-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "2af882ed-bf7b-4a5d-a458-3a9a72be93a8" (UID: "2af882ed-bf7b-4a5d-a458-3a9a72be93a8"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 22:03:14.090077 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:03:14.090051    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2af882ed-bf7b-4a5d-a458-3a9a72be93a8-kube-api-access-x84nm" (OuterVolumeSpecName: "kube-api-access-x84nm") pod "2af882ed-bf7b-4a5d-a458-3a9a72be93a8" (UID: "2af882ed-bf7b-4a5d-a458-3a9a72be93a8"). InnerVolumeSpecName "kube-api-access-x84nm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 22:03:14.189130 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:03:14.189096    2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2af882ed-bf7b-4a5d-a458-3a9a72be93a8-maas-api-tls\") on node \"ip-10-0-130-217.ec2.internal\" DevicePath \"\""
Jul 15 22:03:14.189130 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:03:14.189125    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x84nm\" (UniqueName: \"kubernetes.io/projected/2af882ed-bf7b-4a5d-a458-3a9a72be93a8-kube-api-access-x84nm\") on node \"ip-10-0-130-217.ec2.internal\" DevicePath \"\""
Jul 15 22:03:14.278423 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:03:14.278329    2563 generic.go:356] "Generic (PLEG): container finished" podID="2af882ed-bf7b-4a5d-a458-3a9a72be93a8" containerID="f6d29fec416b95a31fe5942f4b6b998e95ab7c5afc4650c02dc204e5218ecd67" exitCode=0
Jul 15 22:03:14.278423 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:03:14.278377    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-4081d1-6fdcd4b589-mkrpr"
Jul 15 22:03:14.278613 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:03:14.278422    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-4081d1-6fdcd4b589-mkrpr" event={"ID":"2af882ed-bf7b-4a5d-a458-3a9a72be93a8","Type":"ContainerDied","Data":"f6d29fec416b95a31fe5942f4b6b998e95ab7c5afc4650c02dc204e5218ecd67"}
Jul 15 22:03:14.278613 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:03:14.278483    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-4081d1-6fdcd4b589-mkrpr" event={"ID":"2af882ed-bf7b-4a5d-a458-3a9a72be93a8","Type":"ContainerDied","Data":"05eae26bf65993373dd23b72925ecbda0302fa29842ce17d766ebc1dd4a83f2f"}
Jul 15 22:03:14.278613 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:03:14.278512    2563 scope.go:117] "RemoveContainer" containerID="f6d29fec416b95a31fe5942f4b6b998e95ab7c5afc4650c02dc204e5218ecd67"
Jul 15 22:03:14.288324 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:03:14.288307    2563 scope.go:117] "RemoveContainer" containerID="f6d29fec416b95a31fe5942f4b6b998e95ab7c5afc4650c02dc204e5218ecd67"
Jul 15 22:03:14.288598 ip-10-0-130-217 kubenswrapper[2563]: E0715 22:03:14.288578    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f6d29fec416b95a31fe5942f4b6b998e95ab7c5afc4650c02dc204e5218ecd67\": container with ID starting with f6d29fec416b95a31fe5942f4b6b998e95ab7c5afc4650c02dc204e5218ecd67 not found: ID does not exist" containerID="f6d29fec416b95a31fe5942f4b6b998e95ab7c5afc4650c02dc204e5218ecd67"
Jul 15 22:03:14.288663 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:03:14.288604    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f6d29fec416b95a31fe5942f4b6b998e95ab7c5afc4650c02dc204e5218ecd67"} err="failed to get container status \"f6d29fec416b95a31fe5942f4b6b998e95ab7c5afc4650c02dc204e5218ecd67\": rpc error: code = NotFound desc = could not find container \"f6d29fec416b95a31fe5942f4b6b998e95ab7c5afc4650c02dc204e5218ecd67\": container with ID starting with f6d29fec416b95a31fe5942f4b6b998e95ab7c5afc4650c02dc204e5218ecd67 not found: ID does not exist"
Jul 15 22:03:14.299833 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:03:14.299807    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-4081d1-6fdcd4b589-mkrpr"]
Jul 15 22:03:14.303949 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:03:14.303920    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-4081d1-6fdcd4b589-mkrpr"]
Jul 15 22:03:14.988645 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:03:14.988607    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2af882ed-bf7b-4a5d-a458-3a9a72be93a8" path="/var/lib/kubelet/pods/2af882ed-bf7b-4a5d-a458-3a9a72be93a8/volumes"
Jul 15 22:03:29.163508 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:03:29.163478    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-4081d1-openshift-default-bf6bd4569-g9dmx"]
Jul 15 22:03:29.163928 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:03:29.163718    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-4081d1-openshift-default-bf6bd4569-g9dmx" podUID="47355eb7-0019-40be-bf0e-d214e2b8a490" containerName="istio-proxy" containerID="cri-o://7411225fb8143a4ca47a2f029b227d6e4ad4dbb8c1ec013f04884c6f32f1d4df" gracePeriod=30
Jul 15 22:03:29.503535 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:03:29.503447    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-a6de7e-pgg4n"]
Jul 15 22:03:29.503896 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:03:29.503866    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2af882ed-bf7b-4a5d-a458-3a9a72be93a8" containerName="maas-api"
Jul 15 22:03:29.503896 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:03:29.503884    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="2af882ed-bf7b-4a5d-a458-3a9a72be93a8" containerName="maas-api"
Jul 15 22:03:29.503896 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:03:29.503896    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f51684a1-50b4-4431-8239-20f6e1149a11" containerName="revoke-keys"
Jul 15 22:03:29.503896 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:03:29.503902    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="f51684a1-50b4-4431-8239-20f6e1149a11" containerName="revoke-keys"
Jul 15 22:03:29.504252 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:03:29.504006    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="2af882ed-bf7b-4a5d-a458-3a9a72be93a8" containerName="maas-api"
Jul 15 22:03:29.504252 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:03:29.504021    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="f51684a1-50b4-4431-8239-20f6e1149a11" containerName="revoke-keys"
Jul 15 22:03:29.507318 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:03:29.507297    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-a6de7e-pgg4n"
Jul 15 22:03:29.509687 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:03:29.509662    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-zx6nf\""
Jul 15 22:03:29.515829 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:03:29.515795    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-a6de7e-pgg4n"]
Jul 15 22:03:29.641426 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:03:29.641387    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6a342e3e-dc7b-4d30-b341-425c1aaff700-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-a6de7e-pgg4n\" (UID: \"6a342e3e-dc7b-4d30-b341-425c1aaff700\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-a6de7e-pgg4n"
Jul 15 22:03:29.742689 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:03:29.742649    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6a342e3e-dc7b-4d30-b341-425c1aaff700-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-a6de7e-pgg4n\" (UID: \"6a342e3e-dc7b-4d30-b341-425c1aaff700\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-a6de7e-pgg4n"
Jul 15 22:03:29.743336 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:03:29.743314    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6a342e3e-dc7b-4d30-b341-425c1aaff700-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-a6de7e-pgg4n\" (UID: \"6a342e3e-dc7b-4d30-b341-425c1aaff700\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-a6de7e-pgg4n"
Jul 15 22:03:29.820806 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:03:29.820701    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-a6de7e-pgg4n"
Jul 15 22:03:29.963666 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:03:29.963589    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-a6de7e-pgg4n"]
Jul 15 22:03:29.966771 ip-10-0-130-217 kubenswrapper[2563]: W0715 22:03:29.966747    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6a342e3e_dc7b_4d30_b341_425c1aaff700.slice/crio-f247caac77c3ff5a562ce3a9851a801dfef735bb88bdabad79624e4bf6999d8b WatchSource:0}: Error finding container f247caac77c3ff5a562ce3a9851a801dfef735bb88bdabad79624e4bf6999d8b: Status 404 returned error can't find the container with id f247caac77c3ff5a562ce3a9851a801dfef735bb88bdabad79624e4bf6999d8b
Jul 15 22:03:30.369008 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:03:30.368968    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-a6de7e-pgg4n" event={"ID":"6a342e3e-dc7b-4d30-b341-425c1aaff700","Type":"ContainerStarted","Data":"2daa46f24452a091487535d82aa01c76f3d2c8486e0149b8803409d817c7d8ed"}
Jul 15 22:03:30.369376 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:03:30.369035    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-a6de7e-pgg4n" event={"ID":"6a342e3e-dc7b-4d30-b341-425c1aaff700","Type":"ContainerStarted","Data":"f247caac77c3ff5a562ce3a9851a801dfef735bb88bdabad79624e4bf6999d8b"}
Jul 15 22:03:30.385028 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:03:30.384980    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-a6de7e-pgg4n" podStartSLOduration=1.384962801 podStartE2EDuration="1.384962801s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 22:03:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 22:03:30.382884768 +0000 UTC m=+2060.076812321" watchObservedRunningTime="2026-07-15 22:03:30.384962801 +0000 UTC m=+2060.078890349"
Jul 15 22:03:31.375831 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:03:31.375788    2563 generic.go:356] "Generic (PLEG): container finished" podID="6a342e3e-dc7b-4d30-b341-425c1aaff700" containerID="2daa46f24452a091487535d82aa01c76f3d2c8486e0149b8803409d817c7d8ed" exitCode=0
Jul 15 22:03:31.376317 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:03:31.375876    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-a6de7e-pgg4n" event={"ID":"6a342e3e-dc7b-4d30-b341-425c1aaff700","Type":"ContainerDied","Data":"2daa46f24452a091487535d82aa01c76f3d2c8486e0149b8803409d817c7d8ed"}
Jul 15 22:03:31.874417 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:03:31.874374    2563 patch_prober.go:28] interesting pod/e2e-inf-a-4081d1-openshift-default-bf6bd4569-g9dmx container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 15 22:03:31.874581 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:03:31.874455    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-4081d1-openshift-default-bf6bd4569-g9dmx" podUID="47355eb7-0019-40be-bf0e-d214e2b8a490" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 15 22:03:32.515657 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:03:32.515629    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-a6de7e-pgg4n"
Jul 15 22:03:32.673445 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:03:32.673353    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6a342e3e-dc7b-4d30-b341-425c1aaff700-maas-api-service-ca\") pod \"6a342e3e-dc7b-4d30-b341-425c1aaff700\" (UID: \"6a342e3e-dc7b-4d30-b341-425c1aaff700\") "
Jul 15 22:03:32.673729 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:03:32.673702    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6a342e3e-dc7b-4d30-b341-425c1aaff700-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "6a342e3e-dc7b-4d30-b341-425c1aaff700" (UID: "6a342e3e-dc7b-4d30-b341-425c1aaff700"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 22:03:32.774642 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:03:32.774606    2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6a342e3e-dc7b-4d30-b341-425c1aaff700-maas-api-service-ca\") on node \"ip-10-0-130-217.ec2.internal\" DevicePath \"\""
Jul 15 22:03:33.393791 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:03:33.393748    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-a6de7e-pgg4n" event={"ID":"6a342e3e-dc7b-4d30-b341-425c1aaff700","Type":"ContainerDied","Data":"f247caac77c3ff5a562ce3a9851a801dfef735bb88bdabad79624e4bf6999d8b"}
Jul 15 22:03:33.394002 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:03:33.393818    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f247caac77c3ff5a562ce3a9851a801dfef735bb88bdabad79624e4bf6999d8b"
Jul 15 22:03:33.394002 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:03:33.393767    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-a6de7e-pgg4n"
Jul 15 22:03:34.402430 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:03:34.402398    2563 generic.go:356] "Generic (PLEG): container finished" podID="47355eb7-0019-40be-bf0e-d214e2b8a490" containerID="7411225fb8143a4ca47a2f029b227d6e4ad4dbb8c1ec013f04884c6f32f1d4df" exitCode=0
Jul 15 22:03:34.402912 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:03:34.402468    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-4081d1-openshift-default-bf6bd4569-g9dmx" event={"ID":"47355eb7-0019-40be-bf0e-d214e2b8a490","Type":"ContainerDied","Data":"7411225fb8143a4ca47a2f029b227d6e4ad4dbb8c1ec013f04884c6f32f1d4df"}
Jul 15 22:03:34.402912 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:03:34.402541    2563 scope.go:117] "RemoveContainer" containerID="88e95e7f4bcc110611718a0298d7fe4fb5133d72ca49c47f2a4930ff72575562"
Jul 15 22:03:34.426920 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:03:34.426872    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-4081d1-openshift-default-bf6bd4569-g9dmx"
Jul 15 22:03:34.490422 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:03:34.490388    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/47355eb7-0019-40be-bf0e-d214e2b8a490-workload-socket\") pod \"47355eb7-0019-40be-bf0e-d214e2b8a490\" (UID: \"47355eb7-0019-40be-bf0e-d214e2b8a490\") "
Jul 15 22:03:34.490601 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:03:34.490435    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/47355eb7-0019-40be-bf0e-d214e2b8a490-istio-podinfo\") pod \"47355eb7-0019-40be-bf0e-d214e2b8a490\" (UID: \"47355eb7-0019-40be-bf0e-d214e2b8a490\") "
Jul 15 22:03:34.490601 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:03:34.490456    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/47355eb7-0019-40be-bf0e-d214e2b8a490-istio-token\") pod \"47355eb7-0019-40be-bf0e-d214e2b8a490\" (UID: \"47355eb7-0019-40be-bf0e-d214e2b8a490\") "
Jul 15 22:03:34.490601 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:03:34.490474    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/47355eb7-0019-40be-bf0e-d214e2b8a490-istio-envoy\") pod \"47355eb7-0019-40be-bf0e-d214e2b8a490\" (UID: \"47355eb7-0019-40be-bf0e-d214e2b8a490\") "
Jul 15 22:03:34.490601 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:03:34.490488    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/47355eb7-0019-40be-bf0e-d214e2b8a490-istio-data\") pod \"47355eb7-0019-40be-bf0e-d214e2b8a490\" (UID: \"47355eb7-0019-40be-bf0e-d214e2b8a490\") "
Jul 15 22:03:34.490601 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:03:34.490509    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4qwcr\" (UniqueName: \"kubernetes.io/projected/47355eb7-0019-40be-bf0e-d214e2b8a490-kube-api-access-4qwcr\") pod \"47355eb7-0019-40be-bf0e-d214e2b8a490\" (UID: \"47355eb7-0019-40be-bf0e-d214e2b8a490\") "
Jul 15 22:03:34.490601 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:03:34.490534    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/47355eb7-0019-40be-bf0e-d214e2b8a490-istiod-ca-cert\") pod \"47355eb7-0019-40be-bf0e-d214e2b8a490\" (UID: \"47355eb7-0019-40be-bf0e-d214e2b8a490\") "
Jul 15 22:03:34.490601 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:03:34.490570    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/47355eb7-0019-40be-bf0e-d214e2b8a490-credential-socket\") pod \"47355eb7-0019-40be-bf0e-d214e2b8a490\" (UID: \"47355eb7-0019-40be-bf0e-d214e2b8a490\") "
Jul 15 22:03:34.491021 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:03:34.490613    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/47355eb7-0019-40be-bf0e-d214e2b8a490-workload-certs\") pod \"47355eb7-0019-40be-bf0e-d214e2b8a490\" (UID: \"47355eb7-0019-40be-bf0e-d214e2b8a490\") "
Jul 15 22:03:34.491021 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:03:34.490681    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/47355eb7-0019-40be-bf0e-d214e2b8a490-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "47355eb7-0019-40be-bf0e-d214e2b8a490" (UID: "47355eb7-0019-40be-bf0e-d214e2b8a490"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 22:03:34.491021 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:03:34.490982    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/47355eb7-0019-40be-bf0e-d214e2b8a490-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "47355eb7-0019-40be-bf0e-d214e2b8a490" (UID: "47355eb7-0019-40be-bf0e-d214e2b8a490"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 22:03:34.491179 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:03:34.491021    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/47355eb7-0019-40be-bf0e-d214e2b8a490-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "47355eb7-0019-40be-bf0e-d214e2b8a490" (UID: "47355eb7-0019-40be-bf0e-d214e2b8a490"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 22:03:34.491179 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:03:34.491122    2563 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/47355eb7-0019-40be-bf0e-d214e2b8a490-workload-socket\") on node \"ip-10-0-130-217.ec2.internal\" DevicePath \"\""
Jul 15 22:03:34.491179 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:03:34.491133    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/47355eb7-0019-40be-bf0e-d214e2b8a490-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "47355eb7-0019-40be-bf0e-d214e2b8a490" (UID: "47355eb7-0019-40be-bf0e-d214e2b8a490"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 22:03:34.491179 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:03:34.491142    2563 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/47355eb7-0019-40be-bf0e-d214e2b8a490-credential-socket\") on node \"ip-10-0-130-217.ec2.internal\" DevicePath \"\""
Jul 15 22:03:34.491902 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:03:34.491872    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/47355eb7-0019-40be-bf0e-d214e2b8a490-istio-data" (OuterVolumeSpecName: "istio-data") pod "47355eb7-0019-40be-bf0e-d214e2b8a490" (UID: "47355eb7-0019-40be-bf0e-d214e2b8a490"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 22:03:34.492799 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:03:34.492765    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/47355eb7-0019-40be-bf0e-d214e2b8a490-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "47355eb7-0019-40be-bf0e-d214e2b8a490" (UID: "47355eb7-0019-40be-bf0e-d214e2b8a490"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 22:03:34.492907 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:03:34.492827    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/47355eb7-0019-40be-bf0e-d214e2b8a490-kube-api-access-4qwcr" (OuterVolumeSpecName: "kube-api-access-4qwcr") pod "47355eb7-0019-40be-bf0e-d214e2b8a490" (UID: "47355eb7-0019-40be-bf0e-d214e2b8a490"). InnerVolumeSpecName "kube-api-access-4qwcr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 22:03:34.492907 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:03:34.492847    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/47355eb7-0019-40be-bf0e-d214e2b8a490-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "47355eb7-0019-40be-bf0e-d214e2b8a490" (UID: "47355eb7-0019-40be-bf0e-d214e2b8a490"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 15 22:03:34.493069 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:03:34.492903    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/47355eb7-0019-40be-bf0e-d214e2b8a490-istio-token" (OuterVolumeSpecName: "istio-token") pod "47355eb7-0019-40be-bf0e-d214e2b8a490" (UID: "47355eb7-0019-40be-bf0e-d214e2b8a490"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 22:03:34.591616 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:03:34.591575    2563 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/47355eb7-0019-40be-bf0e-d214e2b8a490-istio-podinfo\") on node \"ip-10-0-130-217.ec2.internal\" DevicePath \"\""
Jul 15 22:03:34.591616 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:03:34.591609    2563 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/47355eb7-0019-40be-bf0e-d214e2b8a490-istio-token\") on node \"ip-10-0-130-217.ec2.internal\" DevicePath \"\""
Jul 15 22:03:34.591616 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:03:34.591618    2563 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/47355eb7-0019-40be-bf0e-d214e2b8a490-istio-envoy\") on node \"ip-10-0-130-217.ec2.internal\" DevicePath \"\""
Jul 15 22:03:34.591616 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:03:34.591627    2563 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/47355eb7-0019-40be-bf0e-d214e2b8a490-istio-data\") on node \"ip-10-0-130-217.ec2.internal\" DevicePath \"\""
Jul 15 22:03:34.591890 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:03:34.591636    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4qwcr\" (UniqueName: \"kubernetes.io/projected/47355eb7-0019-40be-bf0e-d214e2b8a490-kube-api-access-4qwcr\") on node \"ip-10-0-130-217.ec2.internal\" DevicePath \"\""
Jul 15 22:03:34.591890 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:03:34.591654    2563 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/47355eb7-0019-40be-bf0e-d214e2b8a490-istiod-ca-cert\") on node \"ip-10-0-130-217.ec2.internal\" DevicePath \"\""
Jul 15 22:03:34.591890 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:03:34.591662    2563 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/47355eb7-0019-40be-bf0e-d214e2b8a490-workload-certs\") on node \"ip-10-0-130-217.ec2.internal\" DevicePath \"\""
Jul 15 22:03:35.408762 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:03:35.408735    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-4081d1-openshift-default-bf6bd4569-g9dmx"
Jul 15 22:03:35.409220 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:03:35.408761    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-4081d1-openshift-default-bf6bd4569-g9dmx" event={"ID":"47355eb7-0019-40be-bf0e-d214e2b8a490","Type":"ContainerDied","Data":"bba8ee618c8ecd8400b56652947c3b3906337d7d64cd0be6c67bed10fad6ac67"}
Jul 15 22:03:35.409220 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:03:35.408813    2563 scope.go:117] "RemoveContainer" containerID="7411225fb8143a4ca47a2f029b227d6e4ad4dbb8c1ec013f04884c6f32f1d4df"
Jul 15 22:03:35.441840 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:03:35.441816    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-4081d1-openshift-default-bf6bd4569-g9dmx"]
Jul 15 22:03:35.444031 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:03:35.444013    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-4081d1-openshift-default-bf6bd4569-g9dmx"]
Jul 15 22:03:36.988051 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:03:36.988017    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="47355eb7-0019-40be-bf0e-d214e2b8a490" path="/var/lib/kubelet/pods/47355eb7-0019-40be-bf0e-d214e2b8a490/volumes"
Jul 15 22:03:40.093243 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:03:40.093195    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-a6de7e-7876d959bb-5mhzm"]
Jul 15 22:03:40.093730 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:03:40.093452    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-a6de7e-7876d959bb-5mhzm" podUID="aa3b86e0-fe1d-4ff9-8633-8f6df4fec22c" containerName="maas-api" containerID="cri-o://e6b549830e43945338b47d2289a80046f3a4c6797d481d7c66163565465efb1d" gracePeriod=30
Jul 15 22:03:40.360565 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:03:40.360538    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-a6de7e-7876d959bb-5mhzm"
Jul 15 22:03:40.435849 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:03:40.435817    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/aa3b86e0-fe1d-4ff9-8633-8f6df4fec22c-openshift-service-ca\") pod \"aa3b86e0-fe1d-4ff9-8633-8f6df4fec22c\" (UID: \"aa3b86e0-fe1d-4ff9-8633-8f6df4fec22c\") "
Jul 15 22:03:40.436059 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:03:40.435868    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wt4tj\" (UniqueName: \"kubernetes.io/projected/aa3b86e0-fe1d-4ff9-8633-8f6df4fec22c-kube-api-access-wt4tj\") pod \"aa3b86e0-fe1d-4ff9-8633-8f6df4fec22c\" (UID: \"aa3b86e0-fe1d-4ff9-8633-8f6df4fec22c\") "
Jul 15 22:03:40.436059 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:03:40.435913    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/aa3b86e0-fe1d-4ff9-8633-8f6df4fec22c-maas-api-tls\") pod \"aa3b86e0-fe1d-4ff9-8633-8f6df4fec22c\" (UID: \"aa3b86e0-fe1d-4ff9-8633-8f6df4fec22c\") "
Jul 15 22:03:40.436277 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:03:40.436232    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/aa3b86e0-fe1d-4ff9-8633-8f6df4fec22c-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "aa3b86e0-fe1d-4ff9-8633-8f6df4fec22c" (UID: "aa3b86e0-fe1d-4ff9-8633-8f6df4fec22c"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 22:03:40.438205 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:03:40.438182    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/aa3b86e0-fe1d-4ff9-8633-8f6df4fec22c-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "aa3b86e0-fe1d-4ff9-8633-8f6df4fec22c" (UID: "aa3b86e0-fe1d-4ff9-8633-8f6df4fec22c"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 22:03:40.438341 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:03:40.438320    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aa3b86e0-fe1d-4ff9-8633-8f6df4fec22c-kube-api-access-wt4tj" (OuterVolumeSpecName: "kube-api-access-wt4tj") pod "aa3b86e0-fe1d-4ff9-8633-8f6df4fec22c" (UID: "aa3b86e0-fe1d-4ff9-8633-8f6df4fec22c"). InnerVolumeSpecName "kube-api-access-wt4tj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 22:03:40.438640 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:03:40.438617    2563 generic.go:356] "Generic (PLEG): container finished" podID="aa3b86e0-fe1d-4ff9-8633-8f6df4fec22c" containerID="e6b549830e43945338b47d2289a80046f3a4c6797d481d7c66163565465efb1d" exitCode=0
Jul 15 22:03:40.438723 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:03:40.438660    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-a6de7e-7876d959bb-5mhzm"
Jul 15 22:03:40.438723 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:03:40.438705    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-a6de7e-7876d959bb-5mhzm" event={"ID":"aa3b86e0-fe1d-4ff9-8633-8f6df4fec22c","Type":"ContainerDied","Data":"e6b549830e43945338b47d2289a80046f3a4c6797d481d7c66163565465efb1d"}
Jul 15 22:03:40.438805 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:03:40.438762    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-a6de7e-7876d959bb-5mhzm" event={"ID":"aa3b86e0-fe1d-4ff9-8633-8f6df4fec22c","Type":"ContainerDied","Data":"c70029e5c5ecdfe4530905b9d0f9af2c7dfb54eff16b45f179ad3eb50681fedb"}
Jul 15 22:03:40.438805 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:03:40.438796    2563 scope.go:117] "RemoveContainer" containerID="e6b549830e43945338b47d2289a80046f3a4c6797d481d7c66163565465efb1d"
Jul 15 22:03:40.456504 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:03:40.456485    2563 scope.go:117] "RemoveContainer" containerID="e6b549830e43945338b47d2289a80046f3a4c6797d481d7c66163565465efb1d"
Jul 15 22:03:40.456787 ip-10-0-130-217 kubenswrapper[2563]: E0715 22:03:40.456765    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e6b549830e43945338b47d2289a80046f3a4c6797d481d7c66163565465efb1d\": container with ID starting with e6b549830e43945338b47d2289a80046f3a4c6797d481d7c66163565465efb1d not found: ID does not exist" containerID="e6b549830e43945338b47d2289a80046f3a4c6797d481d7c66163565465efb1d"
Jul 15 22:03:40.456865 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:03:40.456795    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e6b549830e43945338b47d2289a80046f3a4c6797d481d7c66163565465efb1d"} err="failed to get container status \"e6b549830e43945338b47d2289a80046f3a4c6797d481d7c66163565465efb1d\": rpc error: code = NotFound desc = could not find container \"e6b549830e43945338b47d2289a80046f3a4c6797d481d7c66163565465efb1d\": container with ID starting with e6b549830e43945338b47d2289a80046f3a4c6797d481d7c66163565465efb1d not found: ID does not exist"
Jul 15 22:03:40.467885 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:03:40.467860    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-a6de7e-7876d959bb-5mhzm"]
Jul 15 22:03:40.474326 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:03:40.474303    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-a6de7e-7876d959bb-5mhzm"]
Jul 15 22:03:40.536886 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:03:40.536850    2563 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/aa3b86e0-fe1d-4ff9-8633-8f6df4fec22c-openshift-service-ca\") on node \"ip-10-0-130-217.ec2.internal\" DevicePath \"\""
Jul 15 22:03:40.536886 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:03:40.536878    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wt4tj\" (UniqueName: \"kubernetes.io/projected/aa3b86e0-fe1d-4ff9-8633-8f6df4fec22c-kube-api-access-wt4tj\") on node \"ip-10-0-130-217.ec2.internal\" DevicePath \"\""
Jul 15 22:03:40.536886 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:03:40.536890    2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/aa3b86e0-fe1d-4ff9-8633-8f6df4fec22c-maas-api-tls\") on node \"ip-10-0-130-217.ec2.internal\" DevicePath \"\""
Jul 15 22:03:40.989113 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:03:40.989081    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="aa3b86e0-fe1d-4ff9-8633-8f6df4fec22c" path="/var/lib/kubelet/pods/aa3b86e0-fe1d-4ff9-8633-8f6df4fec22c/volumes"
Jul 15 22:03:56.211867 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:03:56.211827    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-64d63c-openshift-default-55f5c74b7-9gdhk"]
Jul 15 22:03:56.212306 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:03:56.212291    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aa3b86e0-fe1d-4ff9-8633-8f6df4fec22c" containerName="maas-api"
Jul 15 22:03:56.212352 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:03:56.212307    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="aa3b86e0-fe1d-4ff9-8633-8f6df4fec22c" containerName="maas-api"
Jul 15 22:03:56.212352 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:03:56.212320    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="47355eb7-0019-40be-bf0e-d214e2b8a490" containerName="istio-proxy"
Jul 15 22:03:56.212352 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:03:56.212325    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="47355eb7-0019-40be-bf0e-d214e2b8a490" containerName="istio-proxy"
Jul 15 22:03:56.212352 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:03:56.212332    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="47355eb7-0019-40be-bf0e-d214e2b8a490" containerName="istio-proxy"
Jul 15 22:03:56.212352 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:03:56.212337    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="47355eb7-0019-40be-bf0e-d214e2b8a490" containerName="istio-proxy"
Jul 15 22:03:56.212352 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:03:56.212344    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6a342e3e-dc7b-4d30-b341-425c1aaff700" containerName="revoke-keys"
Jul 15 22:03:56.212352 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:03:56.212349    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="6a342e3e-dc7b-4d30-b341-425c1aaff700" containerName="revoke-keys"
Jul 15 22:03:56.212572 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:03:56.212412    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="6a342e3e-dc7b-4d30-b341-425c1aaff700" containerName="revoke-keys"
Jul 15 22:03:56.212572 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:03:56.212422    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="47355eb7-0019-40be-bf0e-d214e2b8a490" containerName="istio-proxy"
Jul 15 22:03:56.212572 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:03:56.212428    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="aa3b86e0-fe1d-4ff9-8633-8f6df4fec22c" containerName="maas-api"
Jul 15 22:03:56.212572 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:03:56.212434    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="47355eb7-0019-40be-bf0e-d214e2b8a490" containerName="istio-proxy"
Jul 15 22:03:56.215630 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:03:56.215611    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-64d63c-openshift-default-55f5c74b7-9gdhk"
Jul 15 22:03:56.217908 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:03:56.217883    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-64d63c-openshift-default-dockercfg-shpvw\""
Jul 15 22:03:56.226677 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:03:56.226655    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-64d63c-openshift-default-55f5c74b7-9gdhk"]
Jul 15 22:03:56.278505 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:03:56.278472    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3c2af0b9-39c0-49e3-903d-da16dc1ed7da-istiod-ca-cert\") pod \"e2e-api-a-64d63c-openshift-default-55f5c74b7-9gdhk\" (UID: \"3c2af0b9-39c0-49e3-903d-da16dc1ed7da\") " pod="openshift-ingress/e2e-api-a-64d63c-openshift-default-55f5c74b7-9gdhk"
Jul 15 22:03:56.278505 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:03:56.278512    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3c2af0b9-39c0-49e3-903d-da16dc1ed7da-credential-socket\") pod \"e2e-api-a-64d63c-openshift-default-55f5c74b7-9gdhk\" (UID: \"3c2af0b9-39c0-49e3-903d-da16dc1ed7da\") " pod="openshift-ingress/e2e-api-a-64d63c-openshift-default-55f5c74b7-9gdhk"
Jul 15 22:03:56.278746 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:03:56.278533    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3c2af0b9-39c0-49e3-903d-da16dc1ed7da-istio-podinfo\") pod \"e2e-api-a-64d63c-openshift-default-55f5c74b7-9gdhk\" (UID: \"3c2af0b9-39c0-49e3-903d-da16dc1ed7da\") " pod="openshift-ingress/e2e-api-a-64d63c-openshift-default-55f5c74b7-9gdhk"
Jul 15 22:03:56.278746 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:03:56.278635    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3c2af0b9-39c0-49e3-903d-da16dc1ed7da-istio-data\") pod \"e2e-api-a-64d63c-openshift-default-55f5c74b7-9gdhk\" (UID: \"3c2af0b9-39c0-49e3-903d-da16dc1ed7da\") " pod="openshift-ingress/e2e-api-a-64d63c-openshift-default-55f5c74b7-9gdhk"
Jul 15 22:03:56.278746 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:03:56.278679    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3c2af0b9-39c0-49e3-903d-da16dc1ed7da-istio-token\") pod \"e2e-api-a-64d63c-openshift-default-55f5c74b7-9gdhk\" (UID: \"3c2af0b9-39c0-49e3-903d-da16dc1ed7da\") " pod="openshift-ingress/e2e-api-a-64d63c-openshift-default-55f5c74b7-9gdhk"
Jul 15 22:03:56.278871 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:03:56.278750    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f6485\" (UniqueName: \"kubernetes.io/projected/3c2af0b9-39c0-49e3-903d-da16dc1ed7da-kube-api-access-f6485\") pod \"e2e-api-a-64d63c-openshift-default-55f5c74b7-9gdhk\" (UID: \"3c2af0b9-39c0-49e3-903d-da16dc1ed7da\") " pod="openshift-ingress/e2e-api-a-64d63c-openshift-default-55f5c74b7-9gdhk"
Jul 15 22:03:56.278871 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:03:56.278802    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3c2af0b9-39c0-49e3-903d-da16dc1ed7da-workload-certs\") pod \"e2e-api-a-64d63c-openshift-default-55f5c74b7-9gdhk\" (UID: \"3c2af0b9-39c0-49e3-903d-da16dc1ed7da\") " pod="openshift-ingress/e2e-api-a-64d63c-openshift-default-55f5c74b7-9gdhk"
Jul 15 22:03:56.278871 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:03:56.278825    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3c2af0b9-39c0-49e3-903d-da16dc1ed7da-istio-envoy\") pod \"e2e-api-a-64d63c-openshift-default-55f5c74b7-9gdhk\" (UID: \"3c2af0b9-39c0-49e3-903d-da16dc1ed7da\") " pod="openshift-ingress/e2e-api-a-64d63c-openshift-default-55f5c74b7-9gdhk"
Jul 15 22:03:56.278871 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:03:56.278842    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3c2af0b9-39c0-49e3-903d-da16dc1ed7da-workload-socket\") pod \"e2e-api-a-64d63c-openshift-default-55f5c74b7-9gdhk\" (UID: \"3c2af0b9-39c0-49e3-903d-da16dc1ed7da\") " pod="openshift-ingress/e2e-api-a-64d63c-openshift-default-55f5c74b7-9gdhk"
Jul 15 22:03:56.383023 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:03:56.380684    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f6485\" (UniqueName: \"kubernetes.io/projected/3c2af0b9-39c0-49e3-903d-da16dc1ed7da-kube-api-access-f6485\") pod \"e2e-api-a-64d63c-openshift-default-55f5c74b7-9gdhk\" (UID: \"3c2af0b9-39c0-49e3-903d-da16dc1ed7da\") " pod="openshift-ingress/e2e-api-a-64d63c-openshift-default-55f5c74b7-9gdhk"
Jul 15 22:03:56.383229 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:03:56.383120    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3c2af0b9-39c0-49e3-903d-da16dc1ed7da-workload-certs\") pod \"e2e-api-a-64d63c-openshift-default-55f5c74b7-9gdhk\" (UID: \"3c2af0b9-39c0-49e3-903d-da16dc1ed7da\") " pod="openshift-ingress/e2e-api-a-64d63c-openshift-default-55f5c74b7-9gdhk"
Jul 15 22:03:56.383229 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:03:56.383159    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3c2af0b9-39c0-49e3-903d-da16dc1ed7da-istio-envoy\") pod \"e2e-api-a-64d63c-openshift-default-55f5c74b7-9gdhk\" (UID: \"3c2af0b9-39c0-49e3-903d-da16dc1ed7da\") " pod="openshift-ingress/e2e-api-a-64d63c-openshift-default-55f5c74b7-9gdhk"
Jul 15 22:03:56.383229 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:03:56.383194    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3c2af0b9-39c0-49e3-903d-da16dc1ed7da-workload-socket\") pod \"e2e-api-a-64d63c-openshift-default-55f5c74b7-9gdhk\" (UID: \"3c2af0b9-39c0-49e3-903d-da16dc1ed7da\") " pod="openshift-ingress/e2e-api-a-64d63c-openshift-default-55f5c74b7-9gdhk"
Jul 15 22:03:56.383393 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:03:56.383253    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3c2af0b9-39c0-49e3-903d-da16dc1ed7da-istiod-ca-cert\") pod \"e2e-api-a-64d63c-openshift-default-55f5c74b7-9gdhk\" (UID: \"3c2af0b9-39c0-49e3-903d-da16dc1ed7da\") " pod="openshift-ingress/e2e-api-a-64d63c-openshift-default-55f5c74b7-9gdhk"
Jul 15 22:03:56.383393 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:03:56.383291    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3c2af0b9-39c0-49e3-903d-da16dc1ed7da-credential-socket\") pod \"e2e-api-a-64d63c-openshift-default-55f5c74b7-9gdhk\" (UID: \"3c2af0b9-39c0-49e3-903d-da16dc1ed7da\") " pod="openshift-ingress/e2e-api-a-64d63c-openshift-default-55f5c74b7-9gdhk"
Jul 15 22:03:56.383393 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:03:56.383325    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3c2af0b9-39c0-49e3-903d-da16dc1ed7da-istio-podinfo\") pod \"e2e-api-a-64d63c-openshift-default-55f5c74b7-9gdhk\" (UID: \"3c2af0b9-39c0-49e3-903d-da16dc1ed7da\") " pod="openshift-ingress/e2e-api-a-64d63c-openshift-default-55f5c74b7-9gdhk"
Jul 15 22:03:56.383393 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:03:56.383366    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3c2af0b9-39c0-49e3-903d-da16dc1ed7da-istio-data\") pod \"e2e-api-a-64d63c-openshift-default-55f5c74b7-9gdhk\" (UID: \"3c2af0b9-39c0-49e3-903d-da16dc1ed7da\") " pod="openshift-ingress/e2e-api-a-64d63c-openshift-default-55f5c74b7-9gdhk"
Jul 15 22:03:56.383576 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:03:56.383407    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3c2af0b9-39c0-49e3-903d-da16dc1ed7da-istio-token\") pod \"e2e-api-a-64d63c-openshift-default-55f5c74b7-9gdhk\" (UID: \"3c2af0b9-39c0-49e3-903d-da16dc1ed7da\") " pod="openshift-ingress/e2e-api-a-64d63c-openshift-default-55f5c74b7-9gdhk"
Jul 15 22:03:56.384229 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:03:56.384198    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3c2af0b9-39c0-49e3-903d-da16dc1ed7da-workload-certs\") pod \"e2e-api-a-64d63c-openshift-default-55f5c74b7-9gdhk\" (UID: \"3c2af0b9-39c0-49e3-903d-da16dc1ed7da\") " pod="openshift-ingress/e2e-api-a-64d63c-openshift-default-55f5c74b7-9gdhk"
Jul 15 22:03:56.387044 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:03:56.387018    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3c2af0b9-39c0-49e3-903d-da16dc1ed7da-istio-envoy\") pod \"e2e-api-a-64d63c-openshift-default-55f5c74b7-9gdhk\" (UID: \"3c2af0b9-39c0-49e3-903d-da16dc1ed7da\") " pod="openshift-ingress/e2e-api-a-64d63c-openshift-default-55f5c74b7-9gdhk"
Jul 15 22:03:56.387322 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:03:56.387298    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3c2af0b9-39c0-49e3-903d-da16dc1ed7da-workload-socket\") pod \"e2e-api-a-64d63c-openshift-default-55f5c74b7-9gdhk\" (UID: \"3c2af0b9-39c0-49e3-903d-da16dc1ed7da\") " pod="openshift-ingress/e2e-api-a-64d63c-openshift-default-55f5c74b7-9gdhk"
Jul 15 22:03:56.388115 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:03:56.388087    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3c2af0b9-39c0-49e3-903d-da16dc1ed7da-istiod-ca-cert\") pod \"e2e-api-a-64d63c-openshift-default-55f5c74b7-9gdhk\" (UID: \"3c2af0b9-39c0-49e3-903d-da16dc1ed7da\") " pod="openshift-ingress/e2e-api-a-64d63c-openshift-default-55f5c74b7-9gdhk"
Jul 15 22:03:56.388361 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:03:56.388341    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3c2af0b9-39c0-49e3-903d-da16dc1ed7da-credential-socket\") pod \"e2e-api-a-64d63c-openshift-default-55f5c74b7-9gdhk\" (UID: \"3c2af0b9-39c0-49e3-903d-da16dc1ed7da\") " pod="openshift-ingress/e2e-api-a-64d63c-openshift-default-55f5c74b7-9gdhk"
Jul 15 22:03:56.388993 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:03:56.388968    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3c2af0b9-39c0-49e3-903d-da16dc1ed7da-istio-data\") pod \"e2e-api-a-64d63c-openshift-default-55f5c74b7-9gdhk\" (UID: \"3c2af0b9-39c0-49e3-903d-da16dc1ed7da\") " pod="openshift-ingress/e2e-api-a-64d63c-openshift-default-55f5c74b7-9gdhk"
Jul 15 22:03:56.391093 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:03:56.391071    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3c2af0b9-39c0-49e3-903d-da16dc1ed7da-istio-token\") pod \"e2e-api-a-64d63c-openshift-default-55f5c74b7-9gdhk\" (UID: \"3c2af0b9-39c0-49e3-903d-da16dc1ed7da\") " pod="openshift-ingress/e2e-api-a-64d63c-openshift-default-55f5c74b7-9gdhk"
Jul 15 22:03:56.391236 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:03:56.391217    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3c2af0b9-39c0-49e3-903d-da16dc1ed7da-istio-podinfo\") pod \"e2e-api-a-64d63c-openshift-default-55f5c74b7-9gdhk\" (UID: \"3c2af0b9-39c0-49e3-903d-da16dc1ed7da\") " pod="openshift-ingress/e2e-api-a-64d63c-openshift-default-55f5c74b7-9gdhk"
Jul 15 22:03:56.391410 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:03:56.391389    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f6485\" (UniqueName: \"kubernetes.io/projected/3c2af0b9-39c0-49e3-903d-da16dc1ed7da-kube-api-access-f6485\") pod \"e2e-api-a-64d63c-openshift-default-55f5c74b7-9gdhk\" (UID: \"3c2af0b9-39c0-49e3-903d-da16dc1ed7da\") " pod="openshift-ingress/e2e-api-a-64d63c-openshift-default-55f5c74b7-9gdhk"
Jul 15 22:03:56.527386 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:03:56.527280    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-64d63c-openshift-default-55f5c74b7-9gdhk"
Jul 15 22:03:56.669733 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:03:56.669704    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-64d63c-openshift-default-55f5c74b7-9gdhk"]
Jul 15 22:03:56.671062 ip-10-0-130-217 kubenswrapper[2563]: W0715 22:03:56.671019    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3c2af0b9_39c0_49e3_903d_da16dc1ed7da.slice/crio-0e32d1fc8bc3551a217f62703beb0bf1f2049ea98b0e581cfc47af6565f4e25d WatchSource:0}: Error finding container 0e32d1fc8bc3551a217f62703beb0bf1f2049ea98b0e581cfc47af6565f4e25d: Status 404 returned error can't find the container with id 0e32d1fc8bc3551a217f62703beb0bf1f2049ea98b0e581cfc47af6565f4e25d
Jul 15 22:03:56.673228 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:03:56.673190    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 15 22:03:56.673300 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:03:56.673277    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 15 22:03:56.673380 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:03:56.673323    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 15 22:03:57.534267 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:03:57.534228    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-64d63c-openshift-default-55f5c74b7-9gdhk" event={"ID":"3c2af0b9-39c0-49e3-903d-da16dc1ed7da","Type":"ContainerStarted","Data":"04f762f06654bca46d80dcedb9fb2935da97f2625b55b21a7e562a1bc20abd41"}
Jul 15 22:03:57.535017 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:03:57.534287    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-64d63c-openshift-default-55f5c74b7-9gdhk" event={"ID":"3c2af0b9-39c0-49e3-903d-da16dc1ed7da","Type":"ContainerStarted","Data":"0e32d1fc8bc3551a217f62703beb0bf1f2049ea98b0e581cfc47af6565f4e25d"}
Jul 15 22:03:57.555492 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:03:57.555444    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-64d63c-openshift-default-55f5c74b7-9gdhk" podStartSLOduration=1.555429145 podStartE2EDuration="1.555429145s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 22:03:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 22:03:57.553585378 +0000 UTC m=+2087.247512929" watchObservedRunningTime="2026-07-15 22:03:57.555429145 +0000 UTC m=+2087.249356696"
Jul 15 22:03:58.527573 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:03:58.527540    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-64d63c-openshift-default-55f5c74b7-9gdhk"
Jul 15 22:03:58.532147 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:03:58.532121    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-64d63c-openshift-default-55f5c74b7-9gdhk"
Jul 15 22:03:58.539440 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:03:58.539414    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-64d63c-openshift-default-55f5c74b7-9gdhk"
Jul 15 22:03:58.540118 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:03:58.540101    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-64d63c-openshift-default-55f5c74b7-9gdhk"
Jul 15 22:03:59.591576 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:03:59.591546    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-64d63c-57bf457566-shjwc"]
Jul 15 22:03:59.595300 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:03:59.595278    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-64d63c-57bf457566-shjwc"
Jul 15 22:03:59.597462 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:03:59.597444    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-a-64d63c-serving-cert\""
Jul 15 22:03:59.607063 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:03:59.607042    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-64d63c-57bf457566-shjwc"]
Jul 15 22:03:59.717947 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:03:59.717903    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3b5f0e81-20e7-494f-abe8-56d3ed8d7f0a-maas-api-tls\") pod \"maas-api-e2e-api-a-64d63c-57bf457566-shjwc\" (UID: \"3b5f0e81-20e7-494f-abe8-56d3ed8d7f0a\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-64d63c-57bf457566-shjwc"
Jul 15 22:03:59.718114 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:03:59.718028    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3b5f0e81-20e7-494f-abe8-56d3ed8d7f0a-openshift-service-ca\") pod \"maas-api-e2e-api-a-64d63c-57bf457566-shjwc\" (UID: \"3b5f0e81-20e7-494f-abe8-56d3ed8d7f0a\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-64d63c-57bf457566-shjwc"
Jul 15 22:03:59.718114 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:03:59.718113    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zjssp\" (UniqueName: \"kubernetes.io/projected/3b5f0e81-20e7-494f-abe8-56d3ed8d7f0a-kube-api-access-zjssp\") pod \"maas-api-e2e-api-a-64d63c-57bf457566-shjwc\" (UID: \"3b5f0e81-20e7-494f-abe8-56d3ed8d7f0a\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-64d63c-57bf457566-shjwc"
Jul 15 22:03:59.819461 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:03:59.819429    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3b5f0e81-20e7-494f-abe8-56d3ed8d7f0a-openshift-service-ca\") pod \"maas-api-e2e-api-a-64d63c-57bf457566-shjwc\" (UID: \"3b5f0e81-20e7-494f-abe8-56d3ed8d7f0a\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-64d63c-57bf457566-shjwc"
Jul 15 22:03:59.819673 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:03:59.819510    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zjssp\" (UniqueName: \"kubernetes.io/projected/3b5f0e81-20e7-494f-abe8-56d3ed8d7f0a-kube-api-access-zjssp\") pod \"maas-api-e2e-api-a-64d63c-57bf457566-shjwc\" (UID: \"3b5f0e81-20e7-494f-abe8-56d3ed8d7f0a\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-64d63c-57bf457566-shjwc"
Jul 15 22:03:59.819673 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:03:59.819547    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3b5f0e81-20e7-494f-abe8-56d3ed8d7f0a-maas-api-tls\") pod \"maas-api-e2e-api-a-64d63c-57bf457566-shjwc\" (UID: \"3b5f0e81-20e7-494f-abe8-56d3ed8d7f0a\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-64d63c-57bf457566-shjwc"
Jul 15 22:03:59.820195 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:03:59.820167    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3b5f0e81-20e7-494f-abe8-56d3ed8d7f0a-openshift-service-ca\") pod \"maas-api-e2e-api-a-64d63c-57bf457566-shjwc\" (UID: \"3b5f0e81-20e7-494f-abe8-56d3ed8d7f0a\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-64d63c-57bf457566-shjwc"
Jul 15 22:03:59.821998 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:03:59.821975    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3b5f0e81-20e7-494f-abe8-56d3ed8d7f0a-maas-api-tls\") pod \"maas-api-e2e-api-a-64d63c-57bf457566-shjwc\" (UID: \"3b5f0e81-20e7-494f-abe8-56d3ed8d7f0a\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-64d63c-57bf457566-shjwc"
Jul 15 22:03:59.826727 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:03:59.826698    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zjssp\" (UniqueName: \"kubernetes.io/projected/3b5f0e81-20e7-494f-abe8-56d3ed8d7f0a-kube-api-access-zjssp\") pod \"maas-api-e2e-api-a-64d63c-57bf457566-shjwc\" (UID: \"3b5f0e81-20e7-494f-abe8-56d3ed8d7f0a\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-64d63c-57bf457566-shjwc"
Jul 15 22:03:59.910666 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:03:59.910571    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-64d63c-57bf457566-shjwc"
Jul 15 22:04:00.047696 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:04:00.047666    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-64d63c-57bf457566-shjwc"]
Jul 15 22:04:00.049329 ip-10-0-130-217 kubenswrapper[2563]: W0715 22:04:00.049302    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3b5f0e81_20e7_494f_abe8_56d3ed8d7f0a.slice/crio-46b611e42678cc5b9f08f44021cdafddbc8aa24146f1029695dfaad22a097e81 WatchSource:0}: Error finding container 46b611e42678cc5b9f08f44021cdafddbc8aa24146f1029695dfaad22a097e81: Status 404 returned error can't find the container with id 46b611e42678cc5b9f08f44021cdafddbc8aa24146f1029695dfaad22a097e81
Jul 15 22:04:00.551788 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:04:00.551760    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-64d63c-57bf457566-shjwc" event={"ID":"3b5f0e81-20e7-494f-abe8-56d3ed8d7f0a","Type":"ContainerStarted","Data":"46b611e42678cc5b9f08f44021cdafddbc8aa24146f1029695dfaad22a097e81"}
Jul 15 22:04:01.558619 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:04:01.558573    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-64d63c-57bf457566-shjwc" event={"ID":"3b5f0e81-20e7-494f-abe8-56d3ed8d7f0a","Type":"ContainerStarted","Data":"79b668a74f70cec98fb3fbe892b7087b9831a0548dba252792ebe4582ca9048a"}
Jul 15 22:04:01.559803 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:04:01.559773    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-64d63c-57bf457566-shjwc"
Jul 15 22:04:01.577459 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:04:01.577402    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-64d63c-57bf457566-shjwc" podStartSLOduration=2.137673548 podStartE2EDuration="2.577382075s" totalImagesPullingTime="439.708527ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 22:03:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 22:04:01.57433883 +0000 UTC m=+2091.268266391" watchObservedRunningTime="2026-07-15 22:04:01.577382075 +0000 UTC m=+2091.271309627"
Jul 15 22:04:08.007895 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:04:08.007854    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-ec9857-6bb798574b-vwwh4"]
Jul 15 22:04:08.018192 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:04:08.018158    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-ec9857-6bb798574b-vwwh4"
Jul 15 22:04:08.018853 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:04:08.018824    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-ec9857-6bb798574b-vwwh4"]
Jul 15 22:04:08.020690 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:04:08.020663    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-b-ec9857-serving-cert\""
Jul 15 22:04:08.106574 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:04:08.106533    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fe170a79-98b7-42d9-8213-f843c0302534-openshift-service-ca\") pod \"maas-api-e2e-api-b-ec9857-6bb798574b-vwwh4\" (UID: \"fe170a79-98b7-42d9-8213-f843c0302534\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-ec9857-6bb798574b-vwwh4"
Jul 15 22:04:08.106788 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:04:08.106603    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d4k2t\" (UniqueName: \"kubernetes.io/projected/fe170a79-98b7-42d9-8213-f843c0302534-kube-api-access-d4k2t\") pod \"maas-api-e2e-api-b-ec9857-6bb798574b-vwwh4\" (UID: \"fe170a79-98b7-42d9-8213-f843c0302534\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-ec9857-6bb798574b-vwwh4"
Jul 15 22:04:08.106788 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:04:08.106693    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fe170a79-98b7-42d9-8213-f843c0302534-maas-api-tls\") pod \"maas-api-e2e-api-b-ec9857-6bb798574b-vwwh4\" (UID: \"fe170a79-98b7-42d9-8213-f843c0302534\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-ec9857-6bb798574b-vwwh4"
Jul 15 22:04:08.207535 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:04:08.207484    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d4k2t\" (UniqueName: \"kubernetes.io/projected/fe170a79-98b7-42d9-8213-f843c0302534-kube-api-access-d4k2t\") pod \"maas-api-e2e-api-b-ec9857-6bb798574b-vwwh4\" (UID: \"fe170a79-98b7-42d9-8213-f843c0302534\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-ec9857-6bb798574b-vwwh4"
Jul 15 22:04:08.207735 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:04:08.207556    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fe170a79-98b7-42d9-8213-f843c0302534-maas-api-tls\") pod \"maas-api-e2e-api-b-ec9857-6bb798574b-vwwh4\" (UID: \"fe170a79-98b7-42d9-8213-f843c0302534\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-ec9857-6bb798574b-vwwh4"
Jul 15 22:04:08.207735 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:04:08.207695    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fe170a79-98b7-42d9-8213-f843c0302534-openshift-service-ca\") pod \"maas-api-e2e-api-b-ec9857-6bb798574b-vwwh4\" (UID: \"fe170a79-98b7-42d9-8213-f843c0302534\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-ec9857-6bb798574b-vwwh4"
Jul 15 22:04:08.208453 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:04:08.208427    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fe170a79-98b7-42d9-8213-f843c0302534-openshift-service-ca\") pod \"maas-api-e2e-api-b-ec9857-6bb798574b-vwwh4\" (UID: \"fe170a79-98b7-42d9-8213-f843c0302534\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-ec9857-6bb798574b-vwwh4"
Jul 15 22:04:08.210957 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:04:08.210284    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fe170a79-98b7-42d9-8213-f843c0302534-maas-api-tls\") pod \"maas-api-e2e-api-b-ec9857-6bb798574b-vwwh4\" (UID: \"fe170a79-98b7-42d9-8213-f843c0302534\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-ec9857-6bb798574b-vwwh4"
Jul 15 22:04:08.218978 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:04:08.218925    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d4k2t\" (UniqueName: \"kubernetes.io/projected/fe170a79-98b7-42d9-8213-f843c0302534-kube-api-access-d4k2t\") pod \"maas-api-e2e-api-b-ec9857-6bb798574b-vwwh4\" (UID: \"fe170a79-98b7-42d9-8213-f843c0302534\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-ec9857-6bb798574b-vwwh4"
Jul 15 22:04:08.331716 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:04:08.331678    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-ec9857-6bb798574b-vwwh4"
Jul 15 22:04:08.574817 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:04:08.574783    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-64d63c-57bf457566-shjwc"
Jul 15 22:04:08.732354 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:04:08.732328    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-ec9857-6bb798574b-vwwh4"]
Jul 15 22:04:08.733911 ip-10-0-130-217 kubenswrapper[2563]: W0715 22:04:08.733885    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfe170a79_98b7_42d9_8213_f843c0302534.slice/crio-1277b26fc4813177d8b049786fd0284181eef6cabb0db905951a3ab72025df71 WatchSource:0}: Error finding container 1277b26fc4813177d8b049786fd0284181eef6cabb0db905951a3ab72025df71: Status 404 returned error can't find the container with id 1277b26fc4813177d8b049786fd0284181eef6cabb0db905951a3ab72025df71
Jul 15 22:04:09.614441 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:04:09.614404    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-ec9857-6bb798574b-vwwh4" event={"ID":"fe170a79-98b7-42d9-8213-f843c0302534","Type":"ContainerStarted","Data":"73b2de3bcd0fbfb8e4f0a5cafb81b6becd3a72e78676e484297681d3b3e35851"}
Jul 15 22:04:09.614832 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:04:09.614473    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-ec9857-6bb798574b-vwwh4"
Jul 15 22:04:09.614832 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:04:09.614492    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-ec9857-6bb798574b-vwwh4" event={"ID":"fe170a79-98b7-42d9-8213-f843c0302534","Type":"ContainerStarted","Data":"1277b26fc4813177d8b049786fd0284181eef6cabb0db905951a3ab72025df71"}
Jul 15 22:04:09.630594 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:04:09.630539    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-ec9857-6bb798574b-vwwh4" podStartSLOduration=2.219651511 podStartE2EDuration="2.630524364s" totalImagesPullingTime="410.872853ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 22:04:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 22:04:09.628751629 +0000 UTC m=+2099.322679180" watchObservedRunningTime="2026-07-15 22:04:09.630524364 +0000 UTC m=+2099.324451949"
Jul 15 22:04:11.010897 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:04:11.010869    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-zlsbs_9b97af79-5c4a-4622-8d74-04d470841a53/console-operator/2.log"
Jul 15 22:04:11.023239 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:04:11.023208    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-zlsbs_9b97af79-5c4a-4622-8d74-04d470841a53/console-operator/2.log"
Jul 15 22:04:11.024361 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:04:11.024333    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bp2vz_7f43c078-b73a-4760-860b-e7f6e07afdbd/ovn-acl-logging/0.log"
Jul 15 22:04:11.027428 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:04:11.027407    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bp2vz_7f43c078-b73a-4760-860b-e7f6e07afdbd/ovn-acl-logging/0.log"
Jul 15 22:04:11.115116 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:04:11.115085    2563 scope.go:117] "RemoveContainer" containerID="2478625dedaa2b07119b4b7112abdb7462727d48bf7cd24d104365078dbaf2a6"
Jul 15 22:04:13.541080 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:04:13.541039    2563 patch_prober.go:28] interesting pod/e2e-api-a-64d63c-openshift-default-55f5c74b7-9gdhk container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.73:15021/healthz/ready\": dial tcp 10.132.0.73:15021: connect: connection refused" start-of-body=
Jul 15 22:04:13.541498 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:04:13.541107    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-64d63c-openshift-default-55f5c74b7-9gdhk" podUID="3c2af0b9-39c0-49e3-903d-da16dc1ed7da" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.73:15021/healthz/ready\": dial tcp 10.132.0.73:15021: connect: connection refused"
Jul 15 22:04:13.638284 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:04:13.638252    2563 generic.go:356] "Generic (PLEG): container finished" podID="3c2af0b9-39c0-49e3-903d-da16dc1ed7da" containerID="04f762f06654bca46d80dcedb9fb2935da97f2625b55b21a7e562a1bc20abd41" exitCode=0
Jul 15 22:04:13.638439 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:04:13.638281    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-64d63c-openshift-default-55f5c74b7-9gdhk" event={"ID":"3c2af0b9-39c0-49e3-903d-da16dc1ed7da","Type":"ContainerDied","Data":"04f762f06654bca46d80dcedb9fb2935da97f2625b55b21a7e562a1bc20abd41"}
Jul 15 22:04:13.638689 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:04:13.638675    2563 scope.go:117] "RemoveContainer" containerID="04f762f06654bca46d80dcedb9fb2935da97f2625b55b21a7e562a1bc20abd41"
Jul 15 22:04:13.639710 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:04:13.639684    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 15 22:04:13.639821 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:04:13.639750    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 15 22:04:13.639821 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:04:13.639782    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 15 22:04:14.645516 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:04:14.645480    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-64d63c-openshift-default-55f5c74b7-9gdhk" event={"ID":"3c2af0b9-39c0-49e3-903d-da16dc1ed7da","Type":"ContainerStarted","Data":"00897ad0781e17ad1c399c4b89b4ac7cf3f57f7f1fac060ad26171e9782d20c4"}
Jul 15 22:04:15.527926 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:04:15.527878    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-64d63c-openshift-default-55f5c74b7-9gdhk"
Jul 15 22:04:15.528186 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:04:15.528160    2563 patch_prober.go:28] interesting pod/e2e-api-a-64d63c-openshift-default-55f5c74b7-9gdhk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.73:15021/healthz/ready\": dial tcp 10.132.0.73:15021: connect: connection refused" start-of-body=
Jul 15 22:04:15.528279 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:04:15.528220    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-64d63c-openshift-default-55f5c74b7-9gdhk" podUID="3c2af0b9-39c0-49e3-903d-da16dc1ed7da" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.73:15021/healthz/ready\": dial tcp 10.132.0.73:15021: connect: connection refused"
Jul 15 22:04:15.627140 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:04:15.627109    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-ec9857-6bb798574b-vwwh4"
Jul 15 22:04:16.528345 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:04:16.528309    2563 patch_prober.go:28] interesting pod/e2e-api-a-64d63c-openshift-default-55f5c74b7-9gdhk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.73:15021/healthz/ready\": dial tcp 10.132.0.73:15021: connect: connection refused" start-of-body=
Jul 15 22:04:16.528752 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:04:16.528364    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-64d63c-openshift-default-55f5c74b7-9gdhk" podUID="3c2af0b9-39c0-49e3-903d-da16dc1ed7da" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.73:15021/healthz/ready\": dial tcp 10.132.0.73:15021: connect: connection refused"
Jul 15 22:04:17.527990 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:04:17.527922    2563 patch_prober.go:28] interesting pod/e2e-api-a-64d63c-openshift-default-55f5c74b7-9gdhk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.73:15021/healthz/ready\": dial tcp 10.132.0.73:15021: connect: connection refused" start-of-body=
Jul 15 22:04:17.528177 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:04:17.528023    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-64d63c-openshift-default-55f5c74b7-9gdhk" podUID="3c2af0b9-39c0-49e3-903d-da16dc1ed7da" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.73:15021/healthz/ready\": dial tcp 10.132.0.73:15021: connect: connection refused"
Jul 15 22:04:18.528360 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:04:18.528325    2563 patch_prober.go:28] interesting pod/e2e-api-a-64d63c-openshift-default-55f5c74b7-9gdhk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.73:15021/healthz/ready\": dial tcp 10.132.0.73:15021: connect: connection refused" start-of-body=
Jul 15 22:04:18.528760 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:04:18.528380    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-64d63c-openshift-default-55f5c74b7-9gdhk" podUID="3c2af0b9-39c0-49e3-903d-da16dc1ed7da" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.73:15021/healthz/ready\": dial tcp 10.132.0.73:15021: connect: connection refused"
Jul 15 22:04:19.531755 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:04:19.531723    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-64d63c-openshift-default-55f5c74b7-9gdhk"
Jul 15 22:04:19.532181 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:04:19.531980    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-64d63c-openshift-default-55f5c74b7-9gdhk"
Jul 15 22:04:19.532582 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:04:19.532565    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-64d63c-openshift-default-55f5c74b7-9gdhk"
Jul 15 22:04:20.512252 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:04:20.512219    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-64d63c-kvh6z"]
Jul 15 22:04:20.515931 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:04:20.515911    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-64d63c-kvh6z"
Jul 15 22:04:20.518216 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:04:20.518191    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-zx6nf\""
Jul 15 22:04:20.522963 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:04:20.522922    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-64d63c-kvh6z"]
Jul 15 22:04:20.542686 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:04:20.542657    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4d0a10f0-945c-4de2-994f-0ae75b5f5136-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-64d63c-kvh6z\" (UID: \"4d0a10f0-945c-4de2-994f-0ae75b5f5136\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-64d63c-kvh6z"
Jul 15 22:04:20.643422 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:04:20.643374    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4d0a10f0-945c-4de2-994f-0ae75b5f5136-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-64d63c-kvh6z\" (UID: \"4d0a10f0-945c-4de2-994f-0ae75b5f5136\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-64d63c-kvh6z"
Jul 15 22:04:20.644098 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:04:20.644071    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4d0a10f0-945c-4de2-994f-0ae75b5f5136-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-64d63c-kvh6z\" (UID: \"4d0a10f0-945c-4de2-994f-0ae75b5f5136\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-64d63c-kvh6z"
Jul 15 22:04:20.829211 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:04:20.829182    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-64d63c-kvh6z"
Jul 15 22:04:20.965255 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:04:20.965226    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-64d63c-kvh6z"]
Jul 15 22:04:20.967144 ip-10-0-130-217 kubenswrapper[2563]: W0715 22:04:20.967116    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4d0a10f0_945c_4de2_994f_0ae75b5f5136.slice/crio-105fbd3426c721f8735cdae1894be60e5a69cd483bb1bcdcbba021299c6d8f2b WatchSource:0}: Error finding container 105fbd3426c721f8735cdae1894be60e5a69cd483bb1bcdcbba021299c6d8f2b: Status 404 returned error can't find the container with id 105fbd3426c721f8735cdae1894be60e5a69cd483bb1bcdcbba021299c6d8f2b
Jul 15 22:04:21.686436 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:04:21.686396    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-64d63c-kvh6z" event={"ID":"4d0a10f0-945c-4de2-994f-0ae75b5f5136","Type":"ContainerStarted","Data":"de459bf1d051387afe09cd399b6aa9ae12ff36ee2e439b007b799a36a785e419"}
Jul 15 22:04:21.686914 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:04:21.686467    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-64d63c-kvh6z" event={"ID":"4d0a10f0-945c-4de2-994f-0ae75b5f5136","Type":"ContainerStarted","Data":"105fbd3426c721f8735cdae1894be60e5a69cd483bb1bcdcbba021299c6d8f2b"}
Jul 15 22:04:21.700086 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:04:21.700025    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-64d63c-kvh6z" podStartSLOduration=1.700003116 podStartE2EDuration="1.700003116s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 22:04:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 22:04:21.698750284 +0000 UTC m=+2111.392677849" watchObservedRunningTime="2026-07-15 22:04:21.700003116 +0000 UTC m=+2111.393930667"
Jul 15 22:04:22.696887 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:04:22.696852    2563 generic.go:356] "Generic (PLEG): container finished" podID="4d0a10f0-945c-4de2-994f-0ae75b5f5136" containerID="de459bf1d051387afe09cd399b6aa9ae12ff36ee2e439b007b799a36a785e419" exitCode=0
Jul 15 22:04:22.697355 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:04:22.696962    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-64d63c-kvh6z" event={"ID":"4d0a10f0-945c-4de2-994f-0ae75b5f5136","Type":"ContainerDied","Data":"de459bf1d051387afe09cd399b6aa9ae12ff36ee2e439b007b799a36a785e419"}
Jul 15 22:04:23.842489 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:04:23.842461    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-64d63c-kvh6z"
Jul 15 22:04:23.879614 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:04:23.879569    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4d0a10f0-945c-4de2-994f-0ae75b5f5136-maas-api-service-ca\") pod \"4d0a10f0-945c-4de2-994f-0ae75b5f5136\" (UID: \"4d0a10f0-945c-4de2-994f-0ae75b5f5136\") "
Jul 15 22:04:23.879911 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:04:23.879888    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4d0a10f0-945c-4de2-994f-0ae75b5f5136-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "4d0a10f0-945c-4de2-994f-0ae75b5f5136" (UID: "4d0a10f0-945c-4de2-994f-0ae75b5f5136"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 22:04:23.981113 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:04:23.981026    2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4d0a10f0-945c-4de2-994f-0ae75b5f5136-maas-api-service-ca\") on node \"ip-10-0-130-217.ec2.internal\" DevicePath \"\""
Jul 15 22:04:24.709290 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:04:24.709258    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-64d63c-kvh6z"
Jul 15 22:04:24.709453 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:04:24.709288    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-64d63c-kvh6z" event={"ID":"4d0a10f0-945c-4de2-994f-0ae75b5f5136","Type":"ContainerDied","Data":"105fbd3426c721f8735cdae1894be60e5a69cd483bb1bcdcbba021299c6d8f2b"}
Jul 15 22:04:24.709453 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:04:24.709334    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="105fbd3426c721f8735cdae1894be60e5a69cd483bb1bcdcbba021299c6d8f2b"
Jul 15 22:04:31.495868 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:04:31.495233    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-64d63c-57bf457566-shjwc"]
Jul 15 22:04:31.495868 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:04:31.495476    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-64d63c-57bf457566-shjwc" podUID="3b5f0e81-20e7-494f-abe8-56d3ed8d7f0a" containerName="maas-api" containerID="cri-o://79b668a74f70cec98fb3fbe892b7087b9831a0548dba252792ebe4582ca9048a" gracePeriod=30
Jul 15 22:04:31.749797 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:04:31.749727    2563 generic.go:356] "Generic (PLEG): container finished" podID="3b5f0e81-20e7-494f-abe8-56d3ed8d7f0a" containerID="79b668a74f70cec98fb3fbe892b7087b9831a0548dba252792ebe4582ca9048a" exitCode=0
Jul 15 22:04:31.749923 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:04:31.749794    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-64d63c-57bf457566-shjwc" event={"ID":"3b5f0e81-20e7-494f-abe8-56d3ed8d7f0a","Type":"ContainerDied","Data":"79b668a74f70cec98fb3fbe892b7087b9831a0548dba252792ebe4582ca9048a"}
Jul 15 22:04:31.749923 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:04:31.749844    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-64d63c-57bf457566-shjwc" event={"ID":"3b5f0e81-20e7-494f-abe8-56d3ed8d7f0a","Type":"ContainerDied","Data":"46b611e42678cc5b9f08f44021cdafddbc8aa24146f1029695dfaad22a097e81"}
Jul 15 22:04:31.749923 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:04:31.749861    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="46b611e42678cc5b9f08f44021cdafddbc8aa24146f1029695dfaad22a097e81"
Jul 15 22:04:31.750746 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:04:31.750731    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-64d63c-57bf457566-shjwc"
Jul 15 22:04:31.857367 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:04:31.857325    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3b5f0e81-20e7-494f-abe8-56d3ed8d7f0a-maas-api-tls\") pod \"3b5f0e81-20e7-494f-abe8-56d3ed8d7f0a\" (UID: \"3b5f0e81-20e7-494f-abe8-56d3ed8d7f0a\") "
Jul 15 22:04:31.857554 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:04:31.857432    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3b5f0e81-20e7-494f-abe8-56d3ed8d7f0a-openshift-service-ca\") pod \"3b5f0e81-20e7-494f-abe8-56d3ed8d7f0a\" (UID: \"3b5f0e81-20e7-494f-abe8-56d3ed8d7f0a\") "
Jul 15 22:04:31.857554 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:04:31.857493    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zjssp\" (UniqueName: \"kubernetes.io/projected/3b5f0e81-20e7-494f-abe8-56d3ed8d7f0a-kube-api-access-zjssp\") pod \"3b5f0e81-20e7-494f-abe8-56d3ed8d7f0a\" (UID: \"3b5f0e81-20e7-494f-abe8-56d3ed8d7f0a\") "
Jul 15 22:04:31.857888 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:04:31.857852    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3b5f0e81-20e7-494f-abe8-56d3ed8d7f0a-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "3b5f0e81-20e7-494f-abe8-56d3ed8d7f0a" (UID: "3b5f0e81-20e7-494f-abe8-56d3ed8d7f0a"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 22:04:31.859552 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:04:31.859521    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3b5f0e81-20e7-494f-abe8-56d3ed8d7f0a-kube-api-access-zjssp" (OuterVolumeSpecName: "kube-api-access-zjssp") pod "3b5f0e81-20e7-494f-abe8-56d3ed8d7f0a" (UID: "3b5f0e81-20e7-494f-abe8-56d3ed8d7f0a"). InnerVolumeSpecName "kube-api-access-zjssp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 22:04:31.859662 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:04:31.859569    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3b5f0e81-20e7-494f-abe8-56d3ed8d7f0a-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "3b5f0e81-20e7-494f-abe8-56d3ed8d7f0a" (UID: "3b5f0e81-20e7-494f-abe8-56d3ed8d7f0a"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 22:04:31.959318 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:04:31.959285    2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3b5f0e81-20e7-494f-abe8-56d3ed8d7f0a-maas-api-tls\") on node \"ip-10-0-130-217.ec2.internal\" DevicePath \"\""
Jul 15 22:04:31.959318 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:04:31.959312    2563 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3b5f0e81-20e7-494f-abe8-56d3ed8d7f0a-openshift-service-ca\") on node \"ip-10-0-130-217.ec2.internal\" DevicePath \"\""
Jul 15 22:04:31.959318 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:04:31.959321    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zjssp\" (UniqueName: \"kubernetes.io/projected/3b5f0e81-20e7-494f-abe8-56d3ed8d7f0a-kube-api-access-zjssp\") on node \"ip-10-0-130-217.ec2.internal\" DevicePath \"\""
Jul 15 22:04:32.754614 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:04:32.754585    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-64d63c-57bf457566-shjwc"
Jul 15 22:04:32.774488 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:04:32.774461    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-64d63c-57bf457566-shjwc"]
Jul 15 22:04:32.778268 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:04:32.778247    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-64d63c-57bf457566-shjwc"]
Jul 15 22:04:32.989164 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:04:32.989129    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3b5f0e81-20e7-494f-abe8-56d3ed8d7f0a" path="/var/lib/kubelet/pods/3b5f0e81-20e7-494f-abe8-56d3ed8d7f0a/volumes"
Jul 15 22:04:46.271969 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:04:46.271911    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-64d63c-openshift-default-55f5c74b7-9gdhk"]
Jul 15 22:04:46.272599 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:04:46.272213    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-64d63c-openshift-default-55f5c74b7-9gdhk" podUID="3c2af0b9-39c0-49e3-903d-da16dc1ed7da" containerName="istio-proxy" containerID="cri-o://00897ad0781e17ad1c399c4b89b4ac7cf3f57f7f1fac060ad26171e9782d20c4" gracePeriod=30
Jul 15 22:04:46.655530 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:04:46.655489    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-ec9857-hf2vh"]
Jul 15 22:04:46.655918 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:04:46.655903    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3b5f0e81-20e7-494f-abe8-56d3ed8d7f0a" containerName="maas-api"
Jul 15 22:04:46.655918 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:04:46.655917    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="3b5f0e81-20e7-494f-abe8-56d3ed8d7f0a" containerName="maas-api"
Jul 15 22:04:46.656080 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:04:46.655926    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4d0a10f0-945c-4de2-994f-0ae75b5f5136" containerName="revoke-keys"
Jul 15 22:04:46.656080 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:04:46.655932    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="4d0a10f0-945c-4de2-994f-0ae75b5f5136" containerName="revoke-keys"
Jul 15 22:04:46.656080 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:04:46.656009    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="3b5f0e81-20e7-494f-abe8-56d3ed8d7f0a" containerName="maas-api"
Jul 15 22:04:46.656080 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:04:46.656017    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="4d0a10f0-945c-4de2-994f-0ae75b5f5136" containerName="revoke-keys"
Jul 15 22:04:46.659131 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:04:46.659107    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-ec9857-hf2vh"
Jul 15 22:04:46.661290 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:04:46.661268    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-zx6nf\""
Jul 15 22:04:46.666080 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:04:46.666059    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-ec9857-hf2vh"]
Jul 15 22:04:46.809076 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:04:46.809038    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/41f6bd64-6205-4a24-ad1e-6cff83ed6d84-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-ec9857-hf2vh\" (UID: \"41f6bd64-6205-4a24-ad1e-6cff83ed6d84\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-ec9857-hf2vh"
Jul 15 22:04:46.910069 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:04:46.909974    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/41f6bd64-6205-4a24-ad1e-6cff83ed6d84-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-ec9857-hf2vh\" (UID: \"41f6bd64-6205-4a24-ad1e-6cff83ed6d84\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-ec9857-hf2vh"
Jul 15 22:04:46.910655 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:04:46.910627    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/41f6bd64-6205-4a24-ad1e-6cff83ed6d84-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-ec9857-hf2vh\" (UID: \"41f6bd64-6205-4a24-ad1e-6cff83ed6d84\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-ec9857-hf2vh"
Jul 15 22:04:46.972235 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:04:46.972201    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-ec9857-hf2vh"
Jul 15 22:04:47.110875 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:04:47.110842    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-ec9857-hf2vh"]
Jul 15 22:04:47.112478 ip-10-0-130-217 kubenswrapper[2563]: W0715 22:04:47.112450    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod41f6bd64_6205_4a24_ad1e_6cff83ed6d84.slice/crio-12d7f8e560dbfa0760dd7603fc1b5cb95421783be0d1dd4b688c4c618704d266 WatchSource:0}: Error finding container 12d7f8e560dbfa0760dd7603fc1b5cb95421783be0d1dd4b688c4c618704d266: Status 404 returned error can't find the container with id 12d7f8e560dbfa0760dd7603fc1b5cb95421783be0d1dd4b688c4c618704d266
Jul 15 22:04:47.846434 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:04:47.846397    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-ec9857-hf2vh" event={"ID":"41f6bd64-6205-4a24-ad1e-6cff83ed6d84","Type":"ContainerStarted","Data":"ceaf5139a5a7c468c8c426ba0d9c6ddc6dc4eb2bb5205177bfb3c0dbd3258a8e"}
Jul 15 22:04:47.846835 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:04:47.846454    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-ec9857-hf2vh" event={"ID":"41f6bd64-6205-4a24-ad1e-6cff83ed6d84","Type":"ContainerStarted","Data":"12d7f8e560dbfa0760dd7603fc1b5cb95421783be0d1dd4b688c4c618704d266"}
Jul 15 22:04:47.859419 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:04:47.859343    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-ec9857-hf2vh" podStartSLOduration=1.8593286089999999 podStartE2EDuration="1.859328609s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 22:04:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 22:04:47.859174094 +0000 UTC m=+2137.553101647" watchObservedRunningTime="2026-07-15 22:04:47.859328609 +0000 UTC m=+2137.553256160"
Jul 15 22:04:48.853545 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:04:48.853511    2563 generic.go:356] "Generic (PLEG): container finished" podID="41f6bd64-6205-4a24-ad1e-6cff83ed6d84" containerID="ceaf5139a5a7c468c8c426ba0d9c6ddc6dc4eb2bb5205177bfb3c0dbd3258a8e" exitCode=0
Jul 15 22:04:48.853922 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:04:48.853595    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-ec9857-hf2vh" event={"ID":"41f6bd64-6205-4a24-ad1e-6cff83ed6d84","Type":"ContainerDied","Data":"ceaf5139a5a7c468c8c426ba0d9c6ddc6dc4eb2bb5205177bfb3c0dbd3258a8e"}
Jul 15 22:04:49.534895 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:04:49.534852    2563 patch_prober.go:28] interesting pod/e2e-api-a-64d63c-openshift-default-55f5c74b7-9gdhk container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 15 22:04:49.535079 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:04:49.534912    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-64d63c-openshift-default-55f5c74b7-9gdhk" podUID="3c2af0b9-39c0-49e3-903d-da16dc1ed7da" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 15 22:04:50.000879 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:04:50.000848    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-ec9857-hf2vh"
Jul 15 22:04:50.144356 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:04:50.144265    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/41f6bd64-6205-4a24-ad1e-6cff83ed6d84-maas-api-service-ca\") pod \"41f6bd64-6205-4a24-ad1e-6cff83ed6d84\" (UID: \"41f6bd64-6205-4a24-ad1e-6cff83ed6d84\") "
Jul 15 22:04:50.144612 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:04:50.144584    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/41f6bd64-6205-4a24-ad1e-6cff83ed6d84-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "41f6bd64-6205-4a24-ad1e-6cff83ed6d84" (UID: "41f6bd64-6205-4a24-ad1e-6cff83ed6d84"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 22:04:50.144812 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:04:50.144768    2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/41f6bd64-6205-4a24-ad1e-6cff83ed6d84-maas-api-service-ca\") on node \"ip-10-0-130-217.ec2.internal\" DevicePath \"\""
Jul 15 22:04:50.865896 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:04:50.865851    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-ec9857-hf2vh" event={"ID":"41f6bd64-6205-4a24-ad1e-6cff83ed6d84","Type":"ContainerDied","Data":"12d7f8e560dbfa0760dd7603fc1b5cb95421783be0d1dd4b688c4c618704d266"}
Jul 15 22:04:50.866090 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:04:50.865877    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-ec9857-hf2vh"
Jul 15 22:04:50.866090 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:04:50.865954    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="12d7f8e560dbfa0760dd7603fc1b5cb95421783be0d1dd4b688c4c618704d266"
Jul 15 22:04:51.529755 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:04:51.529728    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-64d63c-openshift-default-55f5c74b7-9gdhk"
Jul 15 22:04:51.557931 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:04:51.557866    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f6485\" (UniqueName: \"kubernetes.io/projected/3c2af0b9-39c0-49e3-903d-da16dc1ed7da-kube-api-access-f6485\") pod \"3c2af0b9-39c0-49e3-903d-da16dc1ed7da\" (UID: \"3c2af0b9-39c0-49e3-903d-da16dc1ed7da\") "
Jul 15 22:04:51.557931 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:04:51.557915    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3c2af0b9-39c0-49e3-903d-da16dc1ed7da-credential-socket\") pod \"3c2af0b9-39c0-49e3-903d-da16dc1ed7da\" (UID: \"3c2af0b9-39c0-49e3-903d-da16dc1ed7da\") "
Jul 15 22:04:51.558455 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:04:51.558007    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3c2af0b9-39c0-49e3-903d-da16dc1ed7da-istio-podinfo\") pod \"3c2af0b9-39c0-49e3-903d-da16dc1ed7da\" (UID: \"3c2af0b9-39c0-49e3-903d-da16dc1ed7da\") "
Jul 15 22:04:51.558455 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:04:51.558034    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3c2af0b9-39c0-49e3-903d-da16dc1ed7da-istio-envoy\") pod \"3c2af0b9-39c0-49e3-903d-da16dc1ed7da\" (UID: \"3c2af0b9-39c0-49e3-903d-da16dc1ed7da\") "
Jul 15 22:04:51.558455 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:04:51.558057    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3c2af0b9-39c0-49e3-903d-da16dc1ed7da-istio-data\") pod \"3c2af0b9-39c0-49e3-903d-da16dc1ed7da\" (UID: \"3c2af0b9-39c0-49e3-903d-da16dc1ed7da\") "
Jul 15 22:04:51.558455 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:04:51.558084    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3c2af0b9-39c0-49e3-903d-da16dc1ed7da-istio-token\") pod \"3c2af0b9-39c0-49e3-903d-da16dc1ed7da\" (UID: \"3c2af0b9-39c0-49e3-903d-da16dc1ed7da\") "
Jul 15 22:04:51.558455 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:04:51.558160    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3c2af0b9-39c0-49e3-903d-da16dc1ed7da-workload-socket\") pod \"3c2af0b9-39c0-49e3-903d-da16dc1ed7da\" (UID: \"3c2af0b9-39c0-49e3-903d-da16dc1ed7da\") "
Jul 15 22:04:51.558455 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:04:51.558192    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3c2af0b9-39c0-49e3-903d-da16dc1ed7da-workload-certs\") pod \"3c2af0b9-39c0-49e3-903d-da16dc1ed7da\" (UID: \"3c2af0b9-39c0-49e3-903d-da16dc1ed7da\") "
Jul 15 22:04:51.558455 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:04:51.558224    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3c2af0b9-39c0-49e3-903d-da16dc1ed7da-istiod-ca-cert\") pod \"3c2af0b9-39c0-49e3-903d-da16dc1ed7da\" (UID: \"3c2af0b9-39c0-49e3-903d-da16dc1ed7da\") "
Jul 15 22:04:51.558455 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:04:51.558284    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3c2af0b9-39c0-49e3-903d-da16dc1ed7da-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "3c2af0b9-39c0-49e3-903d-da16dc1ed7da" (UID: "3c2af0b9-39c0-49e3-903d-da16dc1ed7da"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 22:04:51.558985 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:04:51.558607    2563 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3c2af0b9-39c0-49e3-903d-da16dc1ed7da-credential-socket\") on node \"ip-10-0-130-217.ec2.internal\" DevicePath \"\""
Jul 15 22:04:51.558985 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:04:51.558633    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3c2af0b9-39c0-49e3-903d-da16dc1ed7da-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "3c2af0b9-39c0-49e3-903d-da16dc1ed7da" (UID: "3c2af0b9-39c0-49e3-903d-da16dc1ed7da"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 22:04:51.558985 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:04:51.558781    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3c2af0b9-39c0-49e3-903d-da16dc1ed7da-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "3c2af0b9-39c0-49e3-903d-da16dc1ed7da" (UID: "3c2af0b9-39c0-49e3-903d-da16dc1ed7da"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 22:04:51.559156 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:04:51.558995    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3c2af0b9-39c0-49e3-903d-da16dc1ed7da-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "3c2af0b9-39c0-49e3-903d-da16dc1ed7da" (UID: "3c2af0b9-39c0-49e3-903d-da16dc1ed7da"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 22:04:51.559156 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:04:51.559113    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3c2af0b9-39c0-49e3-903d-da16dc1ed7da-istio-data" (OuterVolumeSpecName: "istio-data") pod "3c2af0b9-39c0-49e3-903d-da16dc1ed7da" (UID: "3c2af0b9-39c0-49e3-903d-da16dc1ed7da"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 22:04:51.560632 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:04:51.560592    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3c2af0b9-39c0-49e3-903d-da16dc1ed7da-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "3c2af0b9-39c0-49e3-903d-da16dc1ed7da" (UID: "3c2af0b9-39c0-49e3-903d-da16dc1ed7da"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 22:04:51.560751 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:04:51.560660    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3c2af0b9-39c0-49e3-903d-da16dc1ed7da-kube-api-access-f6485" (OuterVolumeSpecName: "kube-api-access-f6485") pod "3c2af0b9-39c0-49e3-903d-da16dc1ed7da" (UID: "3c2af0b9-39c0-49e3-903d-da16dc1ed7da"). InnerVolumeSpecName "kube-api-access-f6485". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 22:04:51.560809 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:04:51.560759    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3c2af0b9-39c0-49e3-903d-da16dc1ed7da-istio-token" (OuterVolumeSpecName: "istio-token") pod "3c2af0b9-39c0-49e3-903d-da16dc1ed7da" (UID: "3c2af0b9-39c0-49e3-903d-da16dc1ed7da"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 22:04:51.560882 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:04:51.560854    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/3c2af0b9-39c0-49e3-903d-da16dc1ed7da-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "3c2af0b9-39c0-49e3-903d-da16dc1ed7da" (UID: "3c2af0b9-39c0-49e3-903d-da16dc1ed7da"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 15 22:04:51.659866 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:04:51.659831    2563 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3c2af0b9-39c0-49e3-903d-da16dc1ed7da-istio-podinfo\") on node \"ip-10-0-130-217.ec2.internal\" DevicePath \"\""
Jul 15 22:04:51.659866 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:04:51.659862    2563 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3c2af0b9-39c0-49e3-903d-da16dc1ed7da-istio-envoy\") on node \"ip-10-0-130-217.ec2.internal\" DevicePath \"\""
Jul 15 22:04:51.659866 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:04:51.659871    2563 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3c2af0b9-39c0-49e3-903d-da16dc1ed7da-istio-data\") on node \"ip-10-0-130-217.ec2.internal\" DevicePath \"\""
Jul 15 22:04:51.660136 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:04:51.659878    2563 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3c2af0b9-39c0-49e3-903d-da16dc1ed7da-istio-token\") on node \"ip-10-0-130-217.ec2.internal\" DevicePath \"\""
Jul 15 22:04:51.660136 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:04:51.659886    2563 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3c2af0b9-39c0-49e3-903d-da16dc1ed7da-workload-socket\") on node \"ip-10-0-130-217.ec2.internal\" DevicePath \"\""
Jul 15 22:04:51.660136 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:04:51.659894    2563 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3c2af0b9-39c0-49e3-903d-da16dc1ed7da-workload-certs\") on node \"ip-10-0-130-217.ec2.internal\" DevicePath \"\""
Jul 15 22:04:51.660136 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:04:51.659902    2563 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3c2af0b9-39c0-49e3-903d-da16dc1ed7da-istiod-ca-cert\") on node \"ip-10-0-130-217.ec2.internal\" DevicePath \"\""
Jul 15 22:04:51.660136 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:04:51.659910    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f6485\" (UniqueName: \"kubernetes.io/projected/3c2af0b9-39c0-49e3-903d-da16dc1ed7da-kube-api-access-f6485\") on node \"ip-10-0-130-217.ec2.internal\" DevicePath \"\""
Jul 15 22:04:51.872954 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:04:51.872908    2563 generic.go:356] "Generic (PLEG): container finished" podID="3c2af0b9-39c0-49e3-903d-da16dc1ed7da" containerID="00897ad0781e17ad1c399c4b89b4ac7cf3f57f7f1fac060ad26171e9782d20c4" exitCode=0
Jul 15 22:04:51.873122 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:04:51.872973    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-64d63c-openshift-default-55f5c74b7-9gdhk"
Jul 15 22:04:51.873122 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:04:51.872967    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-64d63c-openshift-default-55f5c74b7-9gdhk" event={"ID":"3c2af0b9-39c0-49e3-903d-da16dc1ed7da","Type":"ContainerDied","Data":"00897ad0781e17ad1c399c4b89b4ac7cf3f57f7f1fac060ad26171e9782d20c4"}
Jul 15 22:04:51.873122 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:04:51.873098    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-64d63c-openshift-default-55f5c74b7-9gdhk" event={"ID":"3c2af0b9-39c0-49e3-903d-da16dc1ed7da","Type":"ContainerDied","Data":"0e32d1fc8bc3551a217f62703beb0bf1f2049ea98b0e581cfc47af6565f4e25d"}
Jul 15 22:04:51.873236 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:04:51.873123    2563 scope.go:117] "RemoveContainer" containerID="00897ad0781e17ad1c399c4b89b4ac7cf3f57f7f1fac060ad26171e9782d20c4"
Jul 15 22:04:51.882782 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:04:51.882764    2563 scope.go:117] "RemoveContainer" containerID="04f762f06654bca46d80dcedb9fb2935da97f2625b55b21a7e562a1bc20abd41"
Jul 15 22:04:51.890719 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:04:51.890705    2563 scope.go:117] "RemoveContainer" containerID="00897ad0781e17ad1c399c4b89b4ac7cf3f57f7f1fac060ad26171e9782d20c4"
Jul 15 22:04:51.890995 ip-10-0-130-217 kubenswrapper[2563]: E0715 22:04:51.890973    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"00897ad0781e17ad1c399c4b89b4ac7cf3f57f7f1fac060ad26171e9782d20c4\": container with ID starting with 00897ad0781e17ad1c399c4b89b4ac7cf3f57f7f1fac060ad26171e9782d20c4 not found: ID does not exist" containerID="00897ad0781e17ad1c399c4b89b4ac7cf3f57f7f1fac060ad26171e9782d20c4"
Jul 15 22:04:51.891042 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:04:51.891008    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"00897ad0781e17ad1c399c4b89b4ac7cf3f57f7f1fac060ad26171e9782d20c4"} err="failed to get container status \"00897ad0781e17ad1c399c4b89b4ac7cf3f57f7f1fac060ad26171e9782d20c4\": rpc error: code = NotFound desc = could not find container \"00897ad0781e17ad1c399c4b89b4ac7cf3f57f7f1fac060ad26171e9782d20c4\": container with ID starting with 00897ad0781e17ad1c399c4b89b4ac7cf3f57f7f1fac060ad26171e9782d20c4 not found: ID does not exist"
Jul 15 22:04:51.891042 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:04:51.891033    2563 scope.go:117] "RemoveContainer" containerID="04f762f06654bca46d80dcedb9fb2935da97f2625b55b21a7e562a1bc20abd41"
Jul 15 22:04:51.891299 ip-10-0-130-217 kubenswrapper[2563]: E0715 22:04:51.891275    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"04f762f06654bca46d80dcedb9fb2935da97f2625b55b21a7e562a1bc20abd41\": container with ID starting with 04f762f06654bca46d80dcedb9fb2935da97f2625b55b21a7e562a1bc20abd41 not found: ID does not exist" containerID="04f762f06654bca46d80dcedb9fb2935da97f2625b55b21a7e562a1bc20abd41"
Jul 15 22:04:51.891373 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:04:51.891307    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"04f762f06654bca46d80dcedb9fb2935da97f2625b55b21a7e562a1bc20abd41"} err="failed to get container status \"04f762f06654bca46d80dcedb9fb2935da97f2625b55b21a7e562a1bc20abd41\": rpc error: code = NotFound desc = could not find container \"04f762f06654bca46d80dcedb9fb2935da97f2625b55b21a7e562a1bc20abd41\": container with ID starting with 04f762f06654bca46d80dcedb9fb2935da97f2625b55b21a7e562a1bc20abd41 not found: ID does not exist"
Jul 15 22:04:51.898077 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:04:51.898053    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-64d63c-openshift-default-55f5c74b7-9gdhk"]
Jul 15 22:04:51.901304 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:04:51.901282    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-64d63c-openshift-default-55f5c74b7-9gdhk"]
Jul 15 22:04:52.988763 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:04:52.988725    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3c2af0b9-39c0-49e3-903d-da16dc1ed7da" path="/var/lib/kubelet/pods/3c2af0b9-39c0-49e3-903d-da16dc1ed7da/volumes"
Jul 15 22:04:57.071352 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:04:57.071307    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-ec9857-6bb798574b-vwwh4"]
Jul 15 22:04:57.078302 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:04:57.077199    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-ec9857-6bb798574b-vwwh4" podUID="fe170a79-98b7-42d9-8213-f843c0302534" containerName="maas-api" containerID="cri-o://73b2de3bcd0fbfb8e4f0a5cafb81b6becd3a72e78676e484297681d3b3e35851" gracePeriod=30
Jul 15 22:04:57.338637 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:04:57.338613    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-ec9857-6bb798574b-vwwh4"
Jul 15 22:04:57.409368 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:04:57.409334    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fe170a79-98b7-42d9-8213-f843c0302534-maas-api-tls\") pod \"fe170a79-98b7-42d9-8213-f843c0302534\" (UID: \"fe170a79-98b7-42d9-8213-f843c0302534\") "
Jul 15 22:04:57.409540 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:04:57.409428    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fe170a79-98b7-42d9-8213-f843c0302534-openshift-service-ca\") pod \"fe170a79-98b7-42d9-8213-f843c0302534\" (UID: \"fe170a79-98b7-42d9-8213-f843c0302534\") "
Jul 15 22:04:57.409540 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:04:57.409452    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d4k2t\" (UniqueName: \"kubernetes.io/projected/fe170a79-98b7-42d9-8213-f843c0302534-kube-api-access-d4k2t\") pod \"fe170a79-98b7-42d9-8213-f843c0302534\" (UID: \"fe170a79-98b7-42d9-8213-f843c0302534\") "
Jul 15 22:04:57.409819 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:04:57.409793    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fe170a79-98b7-42d9-8213-f843c0302534-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "fe170a79-98b7-42d9-8213-f843c0302534" (UID: "fe170a79-98b7-42d9-8213-f843c0302534"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 22:04:57.411447 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:04:57.411423    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fe170a79-98b7-42d9-8213-f843c0302534-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "fe170a79-98b7-42d9-8213-f843c0302534" (UID: "fe170a79-98b7-42d9-8213-f843c0302534"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 22:04:57.411546 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:04:57.411455    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fe170a79-98b7-42d9-8213-f843c0302534-kube-api-access-d4k2t" (OuterVolumeSpecName: "kube-api-access-d4k2t") pod "fe170a79-98b7-42d9-8213-f843c0302534" (UID: "fe170a79-98b7-42d9-8213-f843c0302534"). InnerVolumeSpecName "kube-api-access-d4k2t". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 22:04:57.511157 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:04:57.511121    2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fe170a79-98b7-42d9-8213-f843c0302534-maas-api-tls\") on node \"ip-10-0-130-217.ec2.internal\" DevicePath \"\""
Jul 15 22:04:57.511157 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:04:57.511152    2563 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fe170a79-98b7-42d9-8213-f843c0302534-openshift-service-ca\") on node \"ip-10-0-130-217.ec2.internal\" DevicePath \"\""
Jul 15 22:04:57.511157 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:04:57.511161    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d4k2t\" (UniqueName: \"kubernetes.io/projected/fe170a79-98b7-42d9-8213-f843c0302534-kube-api-access-d4k2t\") on node \"ip-10-0-130-217.ec2.internal\" DevicePath \"\""
Jul 15 22:04:57.907553 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:04:57.907517    2563 generic.go:356] "Generic (PLEG): container finished" podID="fe170a79-98b7-42d9-8213-f843c0302534" containerID="73b2de3bcd0fbfb8e4f0a5cafb81b6becd3a72e78676e484297681d3b3e35851" exitCode=0
Jul 15 22:04:57.907730 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:04:57.907569    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-ec9857-6bb798574b-vwwh4"
Jul 15 22:04:57.907730 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:04:57.907599    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-ec9857-6bb798574b-vwwh4" event={"ID":"fe170a79-98b7-42d9-8213-f843c0302534","Type":"ContainerDied","Data":"73b2de3bcd0fbfb8e4f0a5cafb81b6becd3a72e78676e484297681d3b3e35851"}
Jul 15 22:04:57.907730 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:04:57.907655    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-ec9857-6bb798574b-vwwh4" event={"ID":"fe170a79-98b7-42d9-8213-f843c0302534","Type":"ContainerDied","Data":"1277b26fc4813177d8b049786fd0284181eef6cabb0db905951a3ab72025df71"}
Jul 15 22:04:57.907730 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:04:57.907679    2563 scope.go:117] "RemoveContainer" containerID="73b2de3bcd0fbfb8e4f0a5cafb81b6becd3a72e78676e484297681d3b3e35851"
Jul 15 22:04:57.917364 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:04:57.917346    2563 scope.go:117] "RemoveContainer" containerID="73b2de3bcd0fbfb8e4f0a5cafb81b6becd3a72e78676e484297681d3b3e35851"
Jul 15 22:04:57.917613 ip-10-0-130-217 kubenswrapper[2563]: E0715 22:04:57.917593    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"73b2de3bcd0fbfb8e4f0a5cafb81b6becd3a72e78676e484297681d3b3e35851\": container with ID starting with 73b2de3bcd0fbfb8e4f0a5cafb81b6becd3a72e78676e484297681d3b3e35851 not found: ID does not exist" containerID="73b2de3bcd0fbfb8e4f0a5cafb81b6becd3a72e78676e484297681d3b3e35851"
Jul 15 22:04:57.917658 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:04:57.917622    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"73b2de3bcd0fbfb8e4f0a5cafb81b6becd3a72e78676e484297681d3b3e35851"} err="failed to get container status \"73b2de3bcd0fbfb8e4f0a5cafb81b6becd3a72e78676e484297681d3b3e35851\": rpc error: code = NotFound desc = could not find container \"73b2de3bcd0fbfb8e4f0a5cafb81b6becd3a72e78676e484297681d3b3e35851\": container with ID starting with 73b2de3bcd0fbfb8e4f0a5cafb81b6becd3a72e78676e484297681d3b3e35851 not found: ID does not exist"
Jul 15 22:04:57.929014 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:04:57.928984    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-ec9857-6bb798574b-vwwh4"]
Jul 15 22:04:57.931239 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:04:57.931217    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-ec9857-6bb798574b-vwwh4"]
Jul 15 22:04:58.989744 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:04:58.989708    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fe170a79-98b7-42d9-8213-f843c0302534" path="/var/lib/kubelet/pods/fe170a79-98b7-42d9-8213-f843c0302534/volumes"
Jul 15 22:05:13.458050 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:05:13.458017    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-8172c4-openshift-default-58c84c975f-mwr8r"]
Jul 15 22:05:13.458547 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:05:13.458459    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="41f6bd64-6205-4a24-ad1e-6cff83ed6d84" containerName="revoke-keys"
Jul 15 22:05:13.458547 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:05:13.458477    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="41f6bd64-6205-4a24-ad1e-6cff83ed6d84" containerName="revoke-keys"
Jul 15 22:05:13.458547 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:05:13.458508    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3c2af0b9-39c0-49e3-903d-da16dc1ed7da" containerName="istio-proxy"
Jul 15 22:05:13.458547 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:05:13.458517    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="3c2af0b9-39c0-49e3-903d-da16dc1ed7da" containerName="istio-proxy"
Jul 15 22:05:13.458547 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:05:13.458527    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fe170a79-98b7-42d9-8213-f843c0302534" containerName="maas-api"
Jul 15 22:05:13.458547 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:05:13.458535    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="fe170a79-98b7-42d9-8213-f843c0302534" containerName="maas-api"
Jul 15 22:05:13.458547 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:05:13.458544    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3c2af0b9-39c0-49e3-903d-da16dc1ed7da" containerName="istio-proxy"
Jul 15 22:05:13.458547 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:05:13.458553    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="3c2af0b9-39c0-49e3-903d-da16dc1ed7da" containerName="istio-proxy"
Jul 15 22:05:13.459074 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:05:13.458681    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="3c2af0b9-39c0-49e3-903d-da16dc1ed7da" containerName="istio-proxy"
Jul 15 22:05:13.459074 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:05:13.458696    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="41f6bd64-6205-4a24-ad1e-6cff83ed6d84" containerName="revoke-keys"
Jul 15 22:05:13.459074 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:05:13.458709    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="3c2af0b9-39c0-49e3-903d-da16dc1ed7da" containerName="istio-proxy"
Jul 15 22:05:13.459074 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:05:13.458719    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="fe170a79-98b7-42d9-8213-f843c0302534" containerName="maas-api"
Jul 15 22:05:13.463676 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:05:13.463651    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-8172c4-openshift-default-58c84c975f-mwr8r"
Jul 15 22:05:13.466035 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:05:13.466014    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-8172c4-openshift-default-dockercfg-jgxbt\""
Jul 15 22:05:13.474331 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:05:13.474305    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-8172c4-openshift-default-58c84c975f-mwr8r"]
Jul 15 22:05:13.551789 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:05:13.551754    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/baf37e03-29c9-4641-8e79-113d878f376d-credential-socket\") pod \"e2e-shared-a-8172c4-openshift-default-58c84c975f-mwr8r\" (UID: \"baf37e03-29c9-4641-8e79-113d878f376d\") " pod="openshift-ingress/e2e-shared-a-8172c4-openshift-default-58c84c975f-mwr8r"
Jul 15 22:05:13.551789 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:05:13.551794    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/baf37e03-29c9-4641-8e79-113d878f376d-istio-token\") pod \"e2e-shared-a-8172c4-openshift-default-58c84c975f-mwr8r\" (UID: \"baf37e03-29c9-4641-8e79-113d878f376d\") " pod="openshift-ingress/e2e-shared-a-8172c4-openshift-default-58c84c975f-mwr8r"
Jul 15 22:05:13.552034 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:05:13.551813    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/baf37e03-29c9-4641-8e79-113d878f376d-istio-data\") pod \"e2e-shared-a-8172c4-openshift-default-58c84c975f-mwr8r\" (UID: \"baf37e03-29c9-4641-8e79-113d878f376d\") " pod="openshift-ingress/e2e-shared-a-8172c4-openshift-default-58c84c975f-mwr8r"
Jul 15 22:05:13.552034 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:05:13.551842    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/baf37e03-29c9-4641-8e79-113d878f376d-istiod-ca-cert\") pod \"e2e-shared-a-8172c4-openshift-default-58c84c975f-mwr8r\" (UID: \"baf37e03-29c9-4641-8e79-113d878f376d\") " pod="openshift-ingress/e2e-shared-a-8172c4-openshift-default-58c84c975f-mwr8r"
Jul 15 22:05:13.552034 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:05:13.551924    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/baf37e03-29c9-4641-8e79-113d878f376d-istio-podinfo\") pod \"e2e-shared-a-8172c4-openshift-default-58c84c975f-mwr8r\" (UID: \"baf37e03-29c9-4641-8e79-113d878f376d\") " pod="openshift-ingress/e2e-shared-a-8172c4-openshift-default-58c84c975f-mwr8r"
Jul 15 22:05:13.552034 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:05:13.551992    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/baf37e03-29c9-4641-8e79-113d878f376d-istio-envoy\") pod \"e2e-shared-a-8172c4-openshift-default-58c84c975f-mwr8r\" (UID: \"baf37e03-29c9-4641-8e79-113d878f376d\") " pod="openshift-ingress/e2e-shared-a-8172c4-openshift-default-58c84c975f-mwr8r"
Jul 15 22:05:13.552210 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:05:13.552033    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/baf37e03-29c9-4641-8e79-113d878f376d-workload-certs\") pod \"e2e-shared-a-8172c4-openshift-default-58c84c975f-mwr8r\" (UID: \"baf37e03-29c9-4641-8e79-113d878f376d\") " pod="openshift-ingress/e2e-shared-a-8172c4-openshift-default-58c84c975f-mwr8r"
Jul 15 22:05:13.552210 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:05:13.552060    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pq9c4\" (UniqueName: \"kubernetes.io/projected/baf37e03-29c9-4641-8e79-113d878f376d-kube-api-access-pq9c4\") pod \"e2e-shared-a-8172c4-openshift-default-58c84c975f-mwr8r\" (UID: \"baf37e03-29c9-4641-8e79-113d878f376d\") " pod="openshift-ingress/e2e-shared-a-8172c4-openshift-default-58c84c975f-mwr8r"
Jul 15 22:05:13.552210 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:05:13.552128    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/baf37e03-29c9-4641-8e79-113d878f376d-workload-socket\") pod \"e2e-shared-a-8172c4-openshift-default-58c84c975f-mwr8r\" (UID: \"baf37e03-29c9-4641-8e79-113d878f376d\") " pod="openshift-ingress/e2e-shared-a-8172c4-openshift-default-58c84c975f-mwr8r"
Jul 15 22:05:13.653590 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:05:13.653556    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/baf37e03-29c9-4641-8e79-113d878f376d-workload-socket\") pod \"e2e-shared-a-8172c4-openshift-default-58c84c975f-mwr8r\" (UID: \"baf37e03-29c9-4641-8e79-113d878f376d\") " pod="openshift-ingress/e2e-shared-a-8172c4-openshift-default-58c84c975f-mwr8r"
Jul 15 22:05:13.653814 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:05:13.653635    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/baf37e03-29c9-4641-8e79-113d878f376d-credential-socket\") pod \"e2e-shared-a-8172c4-openshift-default-58c84c975f-mwr8r\" (UID: \"baf37e03-29c9-4641-8e79-113d878f376d\") " pod="openshift-ingress/e2e-shared-a-8172c4-openshift-default-58c84c975f-mwr8r"
Jul 15 22:05:13.653814 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:05:13.653671    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/baf37e03-29c9-4641-8e79-113d878f376d-istio-token\") pod \"e2e-shared-a-8172c4-openshift-default-58c84c975f-mwr8r\" (UID: \"baf37e03-29c9-4641-8e79-113d878f376d\") " pod="openshift-ingress/e2e-shared-a-8172c4-openshift-default-58c84c975f-mwr8r"
Jul 15 22:05:13.653814 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:05:13.653691    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/baf37e03-29c9-4641-8e79-113d878f376d-istio-data\") pod \"e2e-shared-a-8172c4-openshift-default-58c84c975f-mwr8r\" (UID: \"baf37e03-29c9-4641-8e79-113d878f376d\") " pod="openshift-ingress/e2e-shared-a-8172c4-openshift-default-58c84c975f-mwr8r"
Jul 15 22:05:13.653814 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:05:13.653715    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/baf37e03-29c9-4641-8e79-113d878f376d-istiod-ca-cert\") pod \"e2e-shared-a-8172c4-openshift-default-58c84c975f-mwr8r\" (UID: \"baf37e03-29c9-4641-8e79-113d878f376d\") " pod="openshift-ingress/e2e-shared-a-8172c4-openshift-default-58c84c975f-mwr8r"
Jul 15 22:05:13.653814 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:05:13.653746    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/baf37e03-29c9-4641-8e79-113d878f376d-istio-podinfo\") pod \"e2e-shared-a-8172c4-openshift-default-58c84c975f-mwr8r\" (UID: \"baf37e03-29c9-4641-8e79-113d878f376d\") " pod="openshift-ingress/e2e-shared-a-8172c4-openshift-default-58c84c975f-mwr8r"
Jul 15 22:05:13.653814 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:05:13.653775    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/baf37e03-29c9-4641-8e79-113d878f376d-istio-envoy\") pod \"e2e-shared-a-8172c4-openshift-default-58c84c975f-mwr8r\" (UID: \"baf37e03-29c9-4641-8e79-113d878f376d\") " pod="openshift-ingress/e2e-shared-a-8172c4-openshift-default-58c84c975f-mwr8r"
Jul 15 22:05:13.653814 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:05:13.653812    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/baf37e03-29c9-4641-8e79-113d878f376d-workload-certs\") pod \"e2e-shared-a-8172c4-openshift-default-58c84c975f-mwr8r\" (UID: \"baf37e03-29c9-4641-8e79-113d878f376d\") " pod="openshift-ingress/e2e-shared-a-8172c4-openshift-default-58c84c975f-mwr8r"
Jul 15 22:05:13.654199 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:05:13.653836    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pq9c4\" (UniqueName: \"kubernetes.io/projected/baf37e03-29c9-4641-8e79-113d878f376d-kube-api-access-pq9c4\") pod \"e2e-shared-a-8172c4-openshift-default-58c84c975f-mwr8r\" (UID: \"baf37e03-29c9-4641-8e79-113d878f376d\") " pod="openshift-ingress/e2e-shared-a-8172c4-openshift-default-58c84c975f-mwr8r"
Jul 15 22:05:13.654199 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:05:13.654078    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/baf37e03-29c9-4641-8e79-113d878f376d-credential-socket\") pod \"e2e-shared-a-8172c4-openshift-default-58c84c975f-mwr8r\" (UID: \"baf37e03-29c9-4641-8e79-113d878f376d\") " pod="openshift-ingress/e2e-shared-a-8172c4-openshift-default-58c84c975f-mwr8r"
Jul 15 22:05:13.654199 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:05:13.654099    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/baf37e03-29c9-4641-8e79-113d878f376d-workload-socket\") pod \"e2e-shared-a-8172c4-openshift-default-58c84c975f-mwr8r\" (UID: \"baf37e03-29c9-4641-8e79-113d878f376d\") " pod="openshift-ingress/e2e-shared-a-8172c4-openshift-default-58c84c975f-mwr8r"
Jul 15 22:05:13.654360 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:05:13.654341    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/baf37e03-29c9-4641-8e79-113d878f376d-workload-certs\") pod \"e2e-shared-a-8172c4-openshift-default-58c84c975f-mwr8r\" (UID: \"baf37e03-29c9-4641-8e79-113d878f376d\") " pod="openshift-ingress/e2e-shared-a-8172c4-openshift-default-58c84c975f-mwr8r"
Jul 15 22:05:13.654427 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:05:13.654334    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/baf37e03-29c9-4641-8e79-113d878f376d-istio-data\") pod \"e2e-shared-a-8172c4-openshift-default-58c84c975f-mwr8r\" (UID: \"baf37e03-29c9-4641-8e79-113d878f376d\") " pod="openshift-ingress/e2e-shared-a-8172c4-openshift-default-58c84c975f-mwr8r"
Jul 15 22:05:13.654480 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:05:13.654444    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/baf37e03-29c9-4641-8e79-113d878f376d-istiod-ca-cert\") pod \"e2e-shared-a-8172c4-openshift-default-58c84c975f-mwr8r\" (UID: \"baf37e03-29c9-4641-8e79-113d878f376d\") " pod="openshift-ingress/e2e-shared-a-8172c4-openshift-default-58c84c975f-mwr8r"
Jul 15 22:05:13.656180 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:05:13.656156    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/baf37e03-29c9-4641-8e79-113d878f376d-istio-envoy\") pod \"e2e-shared-a-8172c4-openshift-default-58c84c975f-mwr8r\" (UID: \"baf37e03-29c9-4641-8e79-113d878f376d\") " pod="openshift-ingress/e2e-shared-a-8172c4-openshift-default-58c84c975f-mwr8r"
Jul 15 22:05:13.656300 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:05:13.656281    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/baf37e03-29c9-4641-8e79-113d878f376d-istio-podinfo\") pod \"e2e-shared-a-8172c4-openshift-default-58c84c975f-mwr8r\" (UID: \"baf37e03-29c9-4641-8e79-113d878f376d\") " pod="openshift-ingress/e2e-shared-a-8172c4-openshift-default-58c84c975f-mwr8r"
Jul 15 22:05:13.661227 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:05:13.661206    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pq9c4\" (UniqueName: \"kubernetes.io/projected/baf37e03-29c9-4641-8e79-113d878f376d-kube-api-access-pq9c4\") pod \"e2e-shared-a-8172c4-openshift-default-58c84c975f-mwr8r\" (UID: \"baf37e03-29c9-4641-8e79-113d878f376d\") " pod="openshift-ingress/e2e-shared-a-8172c4-openshift-default-58c84c975f-mwr8r"
Jul 15 22:05:13.661311 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:05:13.661269    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/baf37e03-29c9-4641-8e79-113d878f376d-istio-token\") pod \"e2e-shared-a-8172c4-openshift-default-58c84c975f-mwr8r\" (UID: \"baf37e03-29c9-4641-8e79-113d878f376d\") " pod="openshift-ingress/e2e-shared-a-8172c4-openshift-default-58c84c975f-mwr8r"
Jul 15 22:05:13.776225 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:05:13.776139    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-8172c4-openshift-default-58c84c975f-mwr8r"
Jul 15 22:05:13.916494 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:05:13.916467    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-8172c4-openshift-default-58c84c975f-mwr8r"]
Jul 15 22:05:13.918962 ip-10-0-130-217 kubenswrapper[2563]: W0715 22:05:13.918920    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbaf37e03_29c9_4641_8e79_113d878f376d.slice/crio-713eb712d068ededc3a1ffe9f42b7c574fb72f93a8485073a53e400121540e6a WatchSource:0}: Error finding container 713eb712d068ededc3a1ffe9f42b7c574fb72f93a8485073a53e400121540e6a: Status 404 returned error can't find the container with id 713eb712d068ededc3a1ffe9f42b7c574fb72f93a8485073a53e400121540e6a
Jul 15 22:05:13.921524 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:05:13.921492    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 15 22:05:13.921620 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:05:13.921558    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 15 22:05:13.921620 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:05:13.921589    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 15 22:05:14.000095 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:05:14.000059    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-8172c4-openshift-default-58c84c975f-mwr8r" event={"ID":"baf37e03-29c9-4641-8e79-113d878f376d","Type":"ContainerStarted","Data":"253a4acbf81fd6a750aeb0234c227bc490523141f6c8f2bbfb3157ca532a84ca"}
Jul 15 22:05:14.000221 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:05:14.000126    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-8172c4-openshift-default-58c84c975f-mwr8r" event={"ID":"baf37e03-29c9-4641-8e79-113d878f376d","Type":"ContainerStarted","Data":"713eb712d068ededc3a1ffe9f42b7c574fb72f93a8485073a53e400121540e6a"}
Jul 15 22:05:14.019695 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:05:14.019647    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-8172c4-openshift-default-58c84c975f-mwr8r" podStartSLOduration=1.01963083 podStartE2EDuration="1.01963083s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 22:05:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 22:05:14.017892439 +0000 UTC m=+2163.711819989" watchObservedRunningTime="2026-07-15 22:05:14.01963083 +0000 UTC m=+2163.713558381"
Jul 15 22:05:14.777127 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:05:14.777092    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-8172c4-openshift-default-58c84c975f-mwr8r"
Jul 15 22:05:14.782420 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:05:14.782383    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-8172c4-openshift-default-58c84c975f-mwr8r"
Jul 15 22:05:15.005287 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:05:15.005253    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-8172c4-openshift-default-58c84c975f-mwr8r"
Jul 15 22:05:15.006195 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:05:15.006175    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-8172c4-openshift-default-58c84c975f-mwr8r"
Jul 15 22:05:16.227782 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:05:16.227747    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-8172c4-58b6d5494d-8np2z"]
Jul 15 22:05:16.231952 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:05:16.231910    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-8172c4-58b6d5494d-8np2z"
Jul 15 22:05:16.233852 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:05:16.233816    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-8172c4-serving-cert\""
Jul 15 22:05:16.249126 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:05:16.246515    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-8172c4-58b6d5494d-8np2z"]
Jul 15 22:05:16.278787 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:05:16.278753    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c1822f84-b0aa-47bf-a02b-b7419880fe3c-maas-api-tls\") pod \"maas-api-e2e-shared-a-8172c4-58b6d5494d-8np2z\" (UID: \"c1822f84-b0aa-47bf-a02b-b7419880fe3c\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-8172c4-58b6d5494d-8np2z"
Jul 15 22:05:16.278996 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:05:16.278812    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c1822f84-b0aa-47bf-a02b-b7419880fe3c-openshift-service-ca\") pod \"maas-api-e2e-shared-a-8172c4-58b6d5494d-8np2z\" (UID: \"c1822f84-b0aa-47bf-a02b-b7419880fe3c\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-8172c4-58b6d5494d-8np2z"
Jul 15 22:05:16.278996 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:05:16.278908    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z8svl\" (UniqueName: \"kubernetes.io/projected/c1822f84-b0aa-47bf-a02b-b7419880fe3c-kube-api-access-z8svl\") pod \"maas-api-e2e-shared-a-8172c4-58b6d5494d-8np2z\" (UID: \"c1822f84-b0aa-47bf-a02b-b7419880fe3c\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-8172c4-58b6d5494d-8np2z"
Jul 15 22:05:16.380414 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:05:16.380378    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c1822f84-b0aa-47bf-a02b-b7419880fe3c-maas-api-tls\") pod \"maas-api-e2e-shared-a-8172c4-58b6d5494d-8np2z\" (UID: \"c1822f84-b0aa-47bf-a02b-b7419880fe3c\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-8172c4-58b6d5494d-8np2z"
Jul 15 22:05:16.380622 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:05:16.380451    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c1822f84-b0aa-47bf-a02b-b7419880fe3c-openshift-service-ca\") pod \"maas-api-e2e-shared-a-8172c4-58b6d5494d-8np2z\" (UID: \"c1822f84-b0aa-47bf-a02b-b7419880fe3c\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-8172c4-58b6d5494d-8np2z"
Jul 15 22:05:16.380622 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:05:16.380493    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z8svl\" (UniqueName: \"kubernetes.io/projected/c1822f84-b0aa-47bf-a02b-b7419880fe3c-kube-api-access-z8svl\") pod \"maas-api-e2e-shared-a-8172c4-58b6d5494d-8np2z\" (UID: \"c1822f84-b0aa-47bf-a02b-b7419880fe3c\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-8172c4-58b6d5494d-8np2z"
Jul 15 22:05:16.381195 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:05:16.381170    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c1822f84-b0aa-47bf-a02b-b7419880fe3c-openshift-service-ca\") pod \"maas-api-e2e-shared-a-8172c4-58b6d5494d-8np2z\" (UID: \"c1822f84-b0aa-47bf-a02b-b7419880fe3c\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-8172c4-58b6d5494d-8np2z"
Jul 15 22:05:16.382909 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:05:16.382882    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c1822f84-b0aa-47bf-a02b-b7419880fe3c-maas-api-tls\") pod \"maas-api-e2e-shared-a-8172c4-58b6d5494d-8np2z\" (UID: \"c1822f84-b0aa-47bf-a02b-b7419880fe3c\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-8172c4-58b6d5494d-8np2z"
Jul 15 22:05:16.390989 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:05:16.390930    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z8svl\" (UniqueName: \"kubernetes.io/projected/c1822f84-b0aa-47bf-a02b-b7419880fe3c-kube-api-access-z8svl\") pod \"maas-api-e2e-shared-a-8172c4-58b6d5494d-8np2z\" (UID: \"c1822f84-b0aa-47bf-a02b-b7419880fe3c\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-8172c4-58b6d5494d-8np2z"
Jul 15 22:05:16.553766 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:05:16.553679    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-8172c4-58b6d5494d-8np2z"
Jul 15 22:05:16.902319 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:05:16.902288    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-8172c4-58b6d5494d-8np2z"]
Jul 15 22:05:16.904084 ip-10-0-130-217 kubenswrapper[2563]: W0715 22:05:16.904055    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc1822f84_b0aa_47bf_a02b_b7419880fe3c.slice/crio-bc2a765eec6d39c3e3017ce37bee00d067ceca81ead4ff8efe3c0f666d13f39c WatchSource:0}: Error finding container bc2a765eec6d39c3e3017ce37bee00d067ceca81ead4ff8efe3c0f666d13f39c: Status 404 returned error can't find the container with id bc2a765eec6d39c3e3017ce37bee00d067ceca81ead4ff8efe3c0f666d13f39c
Jul 15 22:05:16.905570 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:05:16.905549    2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 15 22:05:17.017892 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:05:17.017838    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-8172c4-58b6d5494d-8np2z" event={"ID":"c1822f84-b0aa-47bf-a02b-b7419880fe3c","Type":"ContainerStarted","Data":"bc2a765eec6d39c3e3017ce37bee00d067ceca81ead4ff8efe3c0f666d13f39c"}
Jul 15 22:05:18.024698 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:05:18.024609    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-8172c4-58b6d5494d-8np2z" event={"ID":"c1822f84-b0aa-47bf-a02b-b7419880fe3c","Type":"ContainerStarted","Data":"122fa71889e84af1cc42316c2ce951e59afa518fa64cf1b880003eea18ef6e5b"}
Jul 15 22:05:18.025152 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:05:18.024756    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-8172c4-58b6d5494d-8np2z"
Jul 15 22:05:18.044719 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:05:18.044672    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-8172c4-58b6d5494d-8np2z" podStartSLOduration=1.307759106 podStartE2EDuration="2.04465769s" totalImagesPullingTime="736.898584ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 22:05:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 22:05:18.04214247 +0000 UTC m=+2167.736070021" watchObservedRunningTime="2026-07-15 22:05:18.04465769 +0000 UTC m=+2167.738585238"
Jul 15 22:05:24.035991 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:05:24.035929    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-8172c4-58b6d5494d-8np2z"
Jul 15 22:05:24.569644 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:05:24.569598    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-8cc1f1-6df6d7db5d-6jmnh"]
Jul 15 22:05:24.575466 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:05:24.575439    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-8cc1f1-6df6d7db5d-6jmnh"
Jul 15 22:05:24.614726 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:05:24.614497    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-8cc1f1-serving-cert\""
Jul 15 22:05:24.619122 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:05:24.618618    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-8cc1f1-6df6d7db5d-6jmnh"]
Jul 15 22:05:24.660821 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:05:24.660788    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kjnh8\" (UniqueName: \"kubernetes.io/projected/a03b1c47-76e6-4f49-9ee5-d4487694b112-kube-api-access-kjnh8\") pod \"maas-api-e2e-shared-b-8cc1f1-6df6d7db5d-6jmnh\" (UID: \"a03b1c47-76e6-4f49-9ee5-d4487694b112\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-8cc1f1-6df6d7db5d-6jmnh"
Jul 15 22:05:24.661003 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:05:24.660951    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a03b1c47-76e6-4f49-9ee5-d4487694b112-maas-api-tls\") pod \"maas-api-e2e-shared-b-8cc1f1-6df6d7db5d-6jmnh\" (UID: \"a03b1c47-76e6-4f49-9ee5-d4487694b112\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-8cc1f1-6df6d7db5d-6jmnh"
Jul 15 22:05:24.661003 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:05:24.660992    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a03b1c47-76e6-4f49-9ee5-d4487694b112-openshift-service-ca\") pod \"maas-api-e2e-shared-b-8cc1f1-6df6d7db5d-6jmnh\" (UID: \"a03b1c47-76e6-4f49-9ee5-d4487694b112\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-8cc1f1-6df6d7db5d-6jmnh"
Jul 15 22:05:24.762007 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:05:24.761968    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a03b1c47-76e6-4f49-9ee5-d4487694b112-maas-api-tls\") pod \"maas-api-e2e-shared-b-8cc1f1-6df6d7db5d-6jmnh\" (UID: \"a03b1c47-76e6-4f49-9ee5-d4487694b112\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-8cc1f1-6df6d7db5d-6jmnh"
Jul 15 22:05:24.762007 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:05:24.762020    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a03b1c47-76e6-4f49-9ee5-d4487694b112-openshift-service-ca\") pod \"maas-api-e2e-shared-b-8cc1f1-6df6d7db5d-6jmnh\" (UID: \"a03b1c47-76e6-4f49-9ee5-d4487694b112\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-8cc1f1-6df6d7db5d-6jmnh"
Jul 15 22:05:24.762340 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:05:24.762066    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kjnh8\" (UniqueName: \"kubernetes.io/projected/a03b1c47-76e6-4f49-9ee5-d4487694b112-kube-api-access-kjnh8\") pod \"maas-api-e2e-shared-b-8cc1f1-6df6d7db5d-6jmnh\" (UID: \"a03b1c47-76e6-4f49-9ee5-d4487694b112\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-8cc1f1-6df6d7db5d-6jmnh"
Jul 15 22:05:24.762811 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:05:24.762786    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a03b1c47-76e6-4f49-9ee5-d4487694b112-openshift-service-ca\") pod \"maas-api-e2e-shared-b-8cc1f1-6df6d7db5d-6jmnh\" (UID: \"a03b1c47-76e6-4f49-9ee5-d4487694b112\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-8cc1f1-6df6d7db5d-6jmnh"
Jul 15 22:05:24.764619 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:05:24.764591    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a03b1c47-76e6-4f49-9ee5-d4487694b112-maas-api-tls\") pod \"maas-api-e2e-shared-b-8cc1f1-6df6d7db5d-6jmnh\" (UID: \"a03b1c47-76e6-4f49-9ee5-d4487694b112\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-8cc1f1-6df6d7db5d-6jmnh"
Jul 15 22:05:24.769923 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:05:24.769891    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kjnh8\" (UniqueName: \"kubernetes.io/projected/a03b1c47-76e6-4f49-9ee5-d4487694b112-kube-api-access-kjnh8\") pod \"maas-api-e2e-shared-b-8cc1f1-6df6d7db5d-6jmnh\" (UID: \"a03b1c47-76e6-4f49-9ee5-d4487694b112\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-8cc1f1-6df6d7db5d-6jmnh"
Jul 15 22:05:24.920002 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:05:24.919926    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-8cc1f1-6df6d7db5d-6jmnh"
Jul 15 22:05:25.100962 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:05:25.098570    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-8cc1f1-6df6d7db5d-6jmnh"]
Jul 15 22:05:25.108973 ip-10-0-130-217 kubenswrapper[2563]: W0715 22:05:25.108748    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda03b1c47_76e6_4f49_9ee5_d4487694b112.slice/crio-e03e8544440f78811ef8ef98d4adf395ce22a8f523be5372717307664c507b45 WatchSource:0}: Error finding container e03e8544440f78811ef8ef98d4adf395ce22a8f523be5372717307664c507b45: Status 404 returned error can't find the container with id e03e8544440f78811ef8ef98d4adf395ce22a8f523be5372717307664c507b45
Jul 15 22:05:26.071739 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:05:26.071708    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-8cc1f1-6df6d7db5d-6jmnh" event={"ID":"a03b1c47-76e6-4f49-9ee5-d4487694b112","Type":"ContainerStarted","Data":"e03e8544440f78811ef8ef98d4adf395ce22a8f523be5372717307664c507b45"}
Jul 15 22:05:27.081253 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:05:27.081207    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-8cc1f1-6df6d7db5d-6jmnh" event={"ID":"a03b1c47-76e6-4f49-9ee5-d4487694b112","Type":"ContainerStarted","Data":"36725758af3c5f568ffc68ffe1f9ac85ea05c87470fc26c0c97fc0bcd7114513"}
Jul 15 22:05:27.081769 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:05:27.081526    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-8cc1f1-6df6d7db5d-6jmnh"
Jul 15 22:05:27.103103 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:05:27.103032    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-8cc1f1-6df6d7db5d-6jmnh" podStartSLOduration=2.173220239 podStartE2EDuration="3.103010723s" totalImagesPullingTime="929.790484ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 22:05:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 22:05:27.097890676 +0000 UTC m=+2176.791818231" watchObservedRunningTime="2026-07-15 22:05:27.103010723 +0000 UTC m=+2176.796938277"
Jul 15 22:05:30.257661 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:05:30.256827    2563 patch_prober.go:28] interesting pod/e2e-shared-a-8172c4-openshift-default-58c84c975f-mwr8r container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.78:15021/healthz/ready\": read tcp 10.132.0.2:59008->10.132.0.78:15021: read: connection reset by peer" start-of-body=
Jul 15 22:05:30.257661 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:05:30.256901    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-8172c4-openshift-default-58c84c975f-mwr8r" podUID="baf37e03-29c9-4641-8e79-113d878f376d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.78:15021/healthz/ready\": read tcp 10.132.0.2:59008->10.132.0.78:15021: read: connection reset by peer"
Jul 15 22:05:31.107539 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:05:31.107505    2563 generic.go:356] "Generic (PLEG): container finished" podID="baf37e03-29c9-4641-8e79-113d878f376d" containerID="253a4acbf81fd6a750aeb0234c227bc490523141f6c8f2bbfb3157ca532a84ca" exitCode=0
Jul 15 22:05:31.107734 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:05:31.107557    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-8172c4-openshift-default-58c84c975f-mwr8r" event={"ID":"baf37e03-29c9-4641-8e79-113d878f376d","Type":"ContainerDied","Data":"253a4acbf81fd6a750aeb0234c227bc490523141f6c8f2bbfb3157ca532a84ca"}
Jul 15 22:05:31.107995 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:05:31.107975    2563 scope.go:117] "RemoveContainer" containerID="253a4acbf81fd6a750aeb0234c227bc490523141f6c8f2bbfb3157ca532a84ca"
Jul 15 22:05:31.108989 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:05:31.108957    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 15 22:05:31.109097 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:05:31.109036    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 15 22:05:31.109097 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:05:31.109066    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 15 22:05:32.114372 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:05:32.114336    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-8172c4-openshift-default-58c84c975f-mwr8r" event={"ID":"baf37e03-29c9-4641-8e79-113d878f376d","Type":"ContainerStarted","Data":"363037eeb697bd85be9c8c76460b64bbde47f617d44f17da87e50541d5254d59"}
Jul 15 22:05:32.776601 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:05:32.776565    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-8172c4-openshift-default-58c84c975f-mwr8r"
Jul 15 22:05:32.776971 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:05:32.776923    2563 patch_prober.go:28] interesting pod/e2e-shared-a-8172c4-openshift-default-58c84c975f-mwr8r container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused" start-of-body=
Jul 15 22:05:32.777091 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:05:32.777004    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-8172c4-openshift-default-58c84c975f-mwr8r" podUID="baf37e03-29c9-4641-8e79-113d878f376d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused"
Jul 15 22:05:33.099307 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:05:33.099268    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-8cc1f1-6df6d7db5d-6jmnh"
Jul 15 22:05:33.777196 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:05:33.777149    2563 patch_prober.go:28] interesting pod/e2e-shared-a-8172c4-openshift-default-58c84c975f-mwr8r container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused" start-of-body=
Jul 15 22:05:33.777709 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:05:33.777219    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-8172c4-openshift-default-58c84c975f-mwr8r" podUID="baf37e03-29c9-4641-8e79-113d878f376d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused"
Jul 15 22:05:34.777194 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:05:34.777145    2563 patch_prober.go:28] interesting pod/e2e-shared-a-8172c4-openshift-default-58c84c975f-mwr8r container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused" start-of-body=
Jul 15 22:05:34.777703 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:05:34.777222    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-8172c4-openshift-default-58c84c975f-mwr8r" podUID="baf37e03-29c9-4641-8e79-113d878f376d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused"
Jul 15 22:05:35.776590 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:05:35.776548    2563 patch_prober.go:28] interesting pod/e2e-shared-a-8172c4-openshift-default-58c84c975f-mwr8r container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused" start-of-body=
Jul 15 22:05:35.776904 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:05:35.776871    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-8172c4-openshift-default-58c84c975f-mwr8r" podUID="baf37e03-29c9-4641-8e79-113d878f376d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused"
Jul 15 22:05:36.781000 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:05:36.780963    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-8172c4-openshift-default-58c84c975f-mwr8r"
Jul 15 22:05:36.781492 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:05:36.781351    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-8172c4-openshift-default-58c84c975f-mwr8r"
Jul 15 22:05:36.782156 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:05:36.782131    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-8172c4-openshift-default-58c84c975f-mwr8r"
Jul 15 22:09:11.054734 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:09:11.054703    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-zlsbs_9b97af79-5c4a-4622-8d74-04d470841a53/console-operator/2.log"
Jul 15 22:09:11.058755 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:09:11.058728    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bp2vz_7f43c078-b73a-4760-860b-e7f6e07afdbd/ovn-acl-logging/0.log"
Jul 15 22:09:11.059274 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:09:11.059252    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-zlsbs_9b97af79-5c4a-4622-8d74-04d470841a53/console-operator/2.log"
Jul 15 22:09:11.062884 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:09:11.062863    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bp2vz_7f43c078-b73a-4760-860b-e7f6e07afdbd/ovn-acl-logging/0.log"
Jul 15 22:10:11.202450 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:10:11.202413    2563 scope.go:117] "RemoveContainer" containerID="79b668a74f70cec98fb3fbe892b7087b9831a0548dba252792ebe4582ca9048a"
Jul 15 22:10:43.953796 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:10:43.953748    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-8172c4-dqcl7"]
Jul 15 22:10:43.959152 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:10:43.959120    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-8172c4-dqcl7"
Jul 15 22:10:43.962680 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:10:43.962653    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-zx6nf\""
Jul 15 22:10:43.966950 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:10:43.966913    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-8172c4-dqcl7"]
Jul 15 22:10:44.032087 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:10:44.032046    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/38d7ea49-1217-4e59-8a6f-ff96de4be94d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-8172c4-dqcl7\" (UID: \"38d7ea49-1217-4e59-8a6f-ff96de4be94d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-8172c4-dqcl7"
Jul 15 22:10:44.133646 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:10:44.133601    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/38d7ea49-1217-4e59-8a6f-ff96de4be94d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-8172c4-dqcl7\" (UID: \"38d7ea49-1217-4e59-8a6f-ff96de4be94d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-8172c4-dqcl7"
Jul 15 22:10:44.134333 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:10:44.134306    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/38d7ea49-1217-4e59-8a6f-ff96de4be94d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-8172c4-dqcl7\" (UID: \"38d7ea49-1217-4e59-8a6f-ff96de4be94d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-8172c4-dqcl7"
Jul 15 22:10:44.274597 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:10:44.274510    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-8172c4-dqcl7"
Jul 15 22:10:44.417093 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:10:44.417067    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-8172c4-dqcl7"]
Jul 15 22:10:44.419224 ip-10-0-130-217 kubenswrapper[2563]: W0715 22:10:44.419186    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod38d7ea49_1217_4e59_8a6f_ff96de4be94d.slice/crio-b6eed4de82ba4f0f7060608ed9c24a4115a33668ad38a0197b8795125a8573a6 WatchSource:0}: Error finding container b6eed4de82ba4f0f7060608ed9c24a4115a33668ad38a0197b8795125a8573a6: Status 404 returned error can't find the container with id b6eed4de82ba4f0f7060608ed9c24a4115a33668ad38a0197b8795125a8573a6
Jul 15 22:10:44.865389 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:10:44.865353    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-8172c4-dqcl7" event={"ID":"38d7ea49-1217-4e59-8a6f-ff96de4be94d","Type":"ContainerStarted","Data":"89df8e7cededbd00fc0f18c8d810ee13c6c19087ad9d46afca3a2ac23fbf02aa"}
Jul 15 22:10:44.865559 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:10:44.865450    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-8172c4-dqcl7" event={"ID":"38d7ea49-1217-4e59-8a6f-ff96de4be94d","Type":"ContainerStarted","Data":"b6eed4de82ba4f0f7060608ed9c24a4115a33668ad38a0197b8795125a8573a6"}
Jul 15 22:10:44.880056 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:10:44.880004    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-8172c4-dqcl7" podStartSLOduration=1.87998821 podStartE2EDuration="1.87998821s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 22:10:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 22:10:44.8783893 +0000 UTC m=+2494.572316851" watchObservedRunningTime="2026-07-15 22:10:44.87998821 +0000 UTC m=+2494.573915763"
Jul 15 22:10:45.873354 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:10:45.873317    2563 generic.go:356] "Generic (PLEG): container finished" podID="38d7ea49-1217-4e59-8a6f-ff96de4be94d" containerID="89df8e7cededbd00fc0f18c8d810ee13c6c19087ad9d46afca3a2ac23fbf02aa" exitCode=0
Jul 15 22:10:45.873354 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:10:45.873355    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-8172c4-dqcl7" event={"ID":"38d7ea49-1217-4e59-8a6f-ff96de4be94d","Type":"ContainerDied","Data":"89df8e7cededbd00fc0f18c8d810ee13c6c19087ad9d46afca3a2ac23fbf02aa"}
Jul 15 22:10:47.024266 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:10:47.024237    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-8172c4-dqcl7"
Jul 15 22:10:47.162325 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:10:47.162236    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/38d7ea49-1217-4e59-8a6f-ff96de4be94d-maas-api-service-ca\") pod \"38d7ea49-1217-4e59-8a6f-ff96de4be94d\" (UID: \"38d7ea49-1217-4e59-8a6f-ff96de4be94d\") "
Jul 15 22:10:47.162601 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:10:47.162577    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/38d7ea49-1217-4e59-8a6f-ff96de4be94d-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "38d7ea49-1217-4e59-8a6f-ff96de4be94d" (UID: "38d7ea49-1217-4e59-8a6f-ff96de4be94d"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 22:10:47.263877 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:10:47.263828    2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/38d7ea49-1217-4e59-8a6f-ff96de4be94d-maas-api-service-ca\") on node \"ip-10-0-130-217.ec2.internal\" DevicePath \"\""
Jul 15 22:10:47.887124 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:10:47.887096    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-8172c4-dqcl7"
Jul 15 22:10:47.887297 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:10:47.887100    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-8172c4-dqcl7" event={"ID":"38d7ea49-1217-4e59-8a6f-ff96de4be94d","Type":"ContainerDied","Data":"b6eed4de82ba4f0f7060608ed9c24a4115a33668ad38a0197b8795125a8573a6"}
Jul 15 22:10:47.887297 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:10:47.887211    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b6eed4de82ba4f0f7060608ed9c24a4115a33668ad38a0197b8795125a8573a6"
Jul 15 22:10:54.746539 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:10:54.745916    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-8172c4-58b6d5494d-8np2z"]
Jul 15 22:10:54.747060 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:10:54.746778    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-8172c4-58b6d5494d-8np2z" podUID="c1822f84-b0aa-47bf-a02b-b7419880fe3c" containerName="maas-api" containerID="cri-o://122fa71889e84af1cc42316c2ce951e59afa518fa64cf1b880003eea18ef6e5b" gracePeriod=30
Jul 15 22:10:54.927620 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:10:54.927585    2563 generic.go:356] "Generic (PLEG): container finished" podID="c1822f84-b0aa-47bf-a02b-b7419880fe3c" containerID="122fa71889e84af1cc42316c2ce951e59afa518fa64cf1b880003eea18ef6e5b" exitCode=0
Jul 15 22:10:54.927794 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:10:54.927663    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-8172c4-58b6d5494d-8np2z" event={"ID":"c1822f84-b0aa-47bf-a02b-b7419880fe3c","Type":"ContainerDied","Data":"122fa71889e84af1cc42316c2ce951e59afa518fa64cf1b880003eea18ef6e5b"}
Jul 15 22:10:55.015203 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:10:55.015179    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-8172c4-58b6d5494d-8np2z"
Jul 15 22:10:55.145309 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:10:55.145271    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z8svl\" (UniqueName: \"kubernetes.io/projected/c1822f84-b0aa-47bf-a02b-b7419880fe3c-kube-api-access-z8svl\") pod \"c1822f84-b0aa-47bf-a02b-b7419880fe3c\" (UID: \"c1822f84-b0aa-47bf-a02b-b7419880fe3c\") "
Jul 15 22:10:55.145493 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:10:55.145386    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c1822f84-b0aa-47bf-a02b-b7419880fe3c-openshift-service-ca\") pod \"c1822f84-b0aa-47bf-a02b-b7419880fe3c\" (UID: \"c1822f84-b0aa-47bf-a02b-b7419880fe3c\") "
Jul 15 22:10:55.145493 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:10:55.145428    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c1822f84-b0aa-47bf-a02b-b7419880fe3c-maas-api-tls\") pod \"c1822f84-b0aa-47bf-a02b-b7419880fe3c\" (UID: \"c1822f84-b0aa-47bf-a02b-b7419880fe3c\") "
Jul 15 22:10:55.145755 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:10:55.145731    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c1822f84-b0aa-47bf-a02b-b7419880fe3c-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "c1822f84-b0aa-47bf-a02b-b7419880fe3c" (UID: "c1822f84-b0aa-47bf-a02b-b7419880fe3c"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 22:10:55.145826 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:10:55.145794    2563 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c1822f84-b0aa-47bf-a02b-b7419880fe3c-openshift-service-ca\") on node \"ip-10-0-130-217.ec2.internal\" DevicePath \"\""
Jul 15 22:10:55.147553 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:10:55.147527    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c1822f84-b0aa-47bf-a02b-b7419880fe3c-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "c1822f84-b0aa-47bf-a02b-b7419880fe3c" (UID: "c1822f84-b0aa-47bf-a02b-b7419880fe3c"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 22:10:55.147658 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:10:55.147556    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c1822f84-b0aa-47bf-a02b-b7419880fe3c-kube-api-access-z8svl" (OuterVolumeSpecName: "kube-api-access-z8svl") pod "c1822f84-b0aa-47bf-a02b-b7419880fe3c" (UID: "c1822f84-b0aa-47bf-a02b-b7419880fe3c"). InnerVolumeSpecName "kube-api-access-z8svl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 22:10:55.246590 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:10:55.246550    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z8svl\" (UniqueName: \"kubernetes.io/projected/c1822f84-b0aa-47bf-a02b-b7419880fe3c-kube-api-access-z8svl\") on node \"ip-10-0-130-217.ec2.internal\" DevicePath \"\""
Jul 15 22:10:55.246590 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:10:55.246585    2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c1822f84-b0aa-47bf-a02b-b7419880fe3c-maas-api-tls\") on node \"ip-10-0-130-217.ec2.internal\" DevicePath \"\""
Jul 15 22:10:55.933965 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:10:55.933910    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-8172c4-58b6d5494d-8np2z"
Jul 15 22:10:55.934443 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:10:55.933974    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-8172c4-58b6d5494d-8np2z" event={"ID":"c1822f84-b0aa-47bf-a02b-b7419880fe3c","Type":"ContainerDied","Data":"bc2a765eec6d39c3e3017ce37bee00d067ceca81ead4ff8efe3c0f666d13f39c"}
Jul 15 22:10:55.934443 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:10:55.934036    2563 scope.go:117] "RemoveContainer" containerID="122fa71889e84af1cc42316c2ce951e59afa518fa64cf1b880003eea18ef6e5b"
Jul 15 22:10:55.954761 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:10:55.954735    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-8172c4-58b6d5494d-8np2z"]
Jul 15 22:10:55.956975 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:10:55.956956    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-8172c4-58b6d5494d-8np2z"]
Jul 15 22:10:56.987981 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:10:56.987923    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c1822f84-b0aa-47bf-a02b-b7419880fe3c" path="/var/lib/kubelet/pods/c1822f84-b0aa-47bf-a02b-b7419880fe3c/volumes"
Jul 15 22:11:09.723576 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:11:09.723540    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-8172c4-openshift-default-58c84c975f-mwr8r"]
Jul 15 22:11:09.723982 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:11:09.723828    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-8172c4-openshift-default-58c84c975f-mwr8r" podUID="baf37e03-29c9-4641-8e79-113d878f376d" containerName="istio-proxy" containerID="cri-o://363037eeb697bd85be9c8c76460b64bbde47f617d44f17da87e50541d5254d59" gracePeriod=30
Jul 15 22:11:10.106797 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:11:10.106763    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-8cc1f1-qdfdw"]
Jul 15 22:11:10.107212 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:11:10.107199    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c1822f84-b0aa-47bf-a02b-b7419880fe3c" containerName="maas-api"
Jul 15 22:11:10.107255 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:11:10.107213    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="c1822f84-b0aa-47bf-a02b-b7419880fe3c" containerName="maas-api"
Jul 15 22:11:10.107255 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:11:10.107232    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="38d7ea49-1217-4e59-8a6f-ff96de4be94d" containerName="revoke-keys"
Jul 15 22:11:10.107255 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:11:10.107241    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="38d7ea49-1217-4e59-8a6f-ff96de4be94d" containerName="revoke-keys"
Jul 15 22:11:10.107361 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:11:10.107312    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="38d7ea49-1217-4e59-8a6f-ff96de4be94d" containerName="revoke-keys"
Jul 15 22:11:10.107361 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:11:10.107324    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="c1822f84-b0aa-47bf-a02b-b7419880fe3c" containerName="maas-api"
Jul 15 22:11:10.111649 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:11:10.111630    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-8cc1f1-qdfdw"
Jul 15 22:11:10.114048 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:11:10.114019    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-zx6nf\""
Jul 15 22:11:10.117041 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:11:10.117012    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-8cc1f1-qdfdw"]
Jul 15 22:11:10.191376 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:11:10.191344    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f9816696-ca7f-4c3c-b7bf-e57925b8a07d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-8cc1f1-qdfdw\" (UID: \"f9816696-ca7f-4c3c-b7bf-e57925b8a07d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-8cc1f1-qdfdw"
Jul 15 22:11:10.292766 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:11:10.292730    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f9816696-ca7f-4c3c-b7bf-e57925b8a07d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-8cc1f1-qdfdw\" (UID: \"f9816696-ca7f-4c3c-b7bf-e57925b8a07d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-8cc1f1-qdfdw"
Jul 15 22:11:10.293416 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:11:10.293397    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f9816696-ca7f-4c3c-b7bf-e57925b8a07d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-8cc1f1-qdfdw\" (UID: \"f9816696-ca7f-4c3c-b7bf-e57925b8a07d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-8cc1f1-qdfdw"
Jul 15 22:11:10.426286 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:11:10.426208    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-8cc1f1-qdfdw"
Jul 15 22:11:10.572911 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:11:10.572883    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-8cc1f1-qdfdw"]
Jul 15 22:11:10.574752 ip-10-0-130-217 kubenswrapper[2563]: W0715 22:11:10.574725    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf9816696_ca7f_4c3c_b7bf_e57925b8a07d.slice/crio-988c34f993fd8d43e1c8e8839f42f9f943ae55b061742b7cc75f97a8c2b16d95 WatchSource:0}: Error finding container 988c34f993fd8d43e1c8e8839f42f9f943ae55b061742b7cc75f97a8c2b16d95: Status 404 returned error can't find the container with id 988c34f993fd8d43e1c8e8839f42f9f943ae55b061742b7cc75f97a8c2b16d95
Jul 15 22:11:11.021320 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:11:11.021284    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-8cc1f1-qdfdw" event={"ID":"f9816696-ca7f-4c3c-b7bf-e57925b8a07d","Type":"ContainerStarted","Data":"84137dd8a4e9d23b74db2a38c5110291c52652c4d82dd819cb6e18664dbc7940"}
Jul 15 22:11:11.021740 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:11:11.021342    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-8cc1f1-qdfdw" event={"ID":"f9816696-ca7f-4c3c-b7bf-e57925b8a07d","Type":"ContainerStarted","Data":"988c34f993fd8d43e1c8e8839f42f9f943ae55b061742b7cc75f97a8c2b16d95"}
Jul 15 22:11:11.036298 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:11:11.036221    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-8cc1f1-qdfdw" podStartSLOduration=1.036207564 podStartE2EDuration="1.036207564s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 22:11:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 22:11:11.033849401 +0000 UTC m=+2520.727776953" watchObservedRunningTime="2026-07-15 22:11:11.036207564 +0000 UTC m=+2520.730135115"
Jul 15 22:11:12.028853 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:11:12.028819    2563 generic.go:356] "Generic (PLEG): container finished" podID="f9816696-ca7f-4c3c-b7bf-e57925b8a07d" containerID="84137dd8a4e9d23b74db2a38c5110291c52652c4d82dd819cb6e18664dbc7940" exitCode=0
Jul 15 22:11:12.029299 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:11:12.028864    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-8cc1f1-qdfdw" event={"ID":"f9816696-ca7f-4c3c-b7bf-e57925b8a07d","Type":"ContainerDied","Data":"84137dd8a4e9d23b74db2a38c5110291c52652c4d82dd819cb6e18664dbc7940"}
Jul 15 22:11:13.173952 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:11:13.173910    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-8cc1f1-qdfdw"
Jul 15 22:11:13.223216 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:11:13.223187    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f9816696-ca7f-4c3c-b7bf-e57925b8a07d-maas-api-service-ca\") pod \"f9816696-ca7f-4c3c-b7bf-e57925b8a07d\" (UID: \"f9816696-ca7f-4c3c-b7bf-e57925b8a07d\") "
Jul 15 22:11:13.223550 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:11:13.223529    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f9816696-ca7f-4c3c-b7bf-e57925b8a07d-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "f9816696-ca7f-4c3c-b7bf-e57925b8a07d" (UID: "f9816696-ca7f-4c3c-b7bf-e57925b8a07d"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 22:11:13.324321 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:11:13.324234    2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f9816696-ca7f-4c3c-b7bf-e57925b8a07d-maas-api-service-ca\") on node \"ip-10-0-130-217.ec2.internal\" DevicePath \"\""
Jul 15 22:11:14.044537 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:11:14.044508    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-8cc1f1-qdfdw"
Jul 15 22:11:14.044719 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:11:14.044549    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-8cc1f1-qdfdw" event={"ID":"f9816696-ca7f-4c3c-b7bf-e57925b8a07d","Type":"ContainerDied","Data":"988c34f993fd8d43e1c8e8839f42f9f943ae55b061742b7cc75f97a8c2b16d95"}
Jul 15 22:11:14.044719 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:11:14.044596    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="988c34f993fd8d43e1c8e8839f42f9f943ae55b061742b7cc75f97a8c2b16d95"
Jul 15 22:11:14.976824 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:11:14.976797    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-8172c4-openshift-default-58c84c975f-mwr8r"
Jul 15 22:11:15.041265 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:11:15.041178    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pq9c4\" (UniqueName: \"kubernetes.io/projected/baf37e03-29c9-4641-8e79-113d878f376d-kube-api-access-pq9c4\") pod \"baf37e03-29c9-4641-8e79-113d878f376d\" (UID: \"baf37e03-29c9-4641-8e79-113d878f376d\") "
Jul 15 22:11:15.041265 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:11:15.041221    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/baf37e03-29c9-4641-8e79-113d878f376d-workload-certs\") pod \"baf37e03-29c9-4641-8e79-113d878f376d\" (UID: \"baf37e03-29c9-4641-8e79-113d878f376d\") "
Jul 15 22:11:15.041265 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:11:15.041252    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/baf37e03-29c9-4641-8e79-113d878f376d-istio-data\") pod \"baf37e03-29c9-4641-8e79-113d878f376d\" (UID: \"baf37e03-29c9-4641-8e79-113d878f376d\") "
Jul 15 22:11:15.041559 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:11:15.041277    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/baf37e03-29c9-4641-8e79-113d878f376d-istio-envoy\") pod \"baf37e03-29c9-4641-8e79-113d878f376d\" (UID: \"baf37e03-29c9-4641-8e79-113d878f376d\") "
Jul 15 22:11:15.041559 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:11:15.041341    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/baf37e03-29c9-4641-8e79-113d878f376d-workload-socket\") pod \"baf37e03-29c9-4641-8e79-113d878f376d\" (UID: \"baf37e03-29c9-4641-8e79-113d878f376d\") "
Jul 15 22:11:15.041559 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:11:15.041389    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/baf37e03-29c9-4641-8e79-113d878f376d-istio-token\") pod \"baf37e03-29c9-4641-8e79-113d878f376d\" (UID: \"baf37e03-29c9-4641-8e79-113d878f376d\") "
Jul 15 22:11:15.041559 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:11:15.041428    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/baf37e03-29c9-4641-8e79-113d878f376d-istiod-ca-cert\") pod \"baf37e03-29c9-4641-8e79-113d878f376d\" (UID: \"baf37e03-29c9-4641-8e79-113d878f376d\") "
Jul 15 22:11:15.041559 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:11:15.041476    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/baf37e03-29c9-4641-8e79-113d878f376d-credential-socket\") pod \"baf37e03-29c9-4641-8e79-113d878f376d\" (UID: \"baf37e03-29c9-4641-8e79-113d878f376d\") "
Jul 15 22:11:15.041559 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:11:15.041531    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/baf37e03-29c9-4641-8e79-113d878f376d-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "baf37e03-29c9-4641-8e79-113d878f376d" (UID: "baf37e03-29c9-4641-8e79-113d878f376d"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 22:11:15.041868 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:11:15.041542    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/baf37e03-29c9-4641-8e79-113d878f376d-istio-podinfo\") pod \"baf37e03-29c9-4641-8e79-113d878f376d\" (UID: \"baf37e03-29c9-4641-8e79-113d878f376d\") "
Jul 15 22:11:15.042023 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:11:15.041928    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/baf37e03-29c9-4641-8e79-113d878f376d-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "baf37e03-29c9-4641-8e79-113d878f376d" (UID: "baf37e03-29c9-4641-8e79-113d878f376d"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 22:11:15.042170 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:11:15.042147    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/baf37e03-29c9-4641-8e79-113d878f376d-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "baf37e03-29c9-4641-8e79-113d878f376d" (UID: "baf37e03-29c9-4641-8e79-113d878f376d"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 22:11:15.042395 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:11:15.042216    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/baf37e03-29c9-4641-8e79-113d878f376d-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "baf37e03-29c9-4641-8e79-113d878f376d" (UID: "baf37e03-29c9-4641-8e79-113d878f376d"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 22:11:15.042395 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:11:15.042284    2563 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/baf37e03-29c9-4641-8e79-113d878f376d-workload-certs\") on node \"ip-10-0-130-217.ec2.internal\" DevicePath \"\""
Jul 15 22:11:15.042395 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:11:15.042321    2563 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/baf37e03-29c9-4641-8e79-113d878f376d-istiod-ca-cert\") on node \"ip-10-0-130-217.ec2.internal\" DevicePath \"\""
Jul 15 22:11:15.042653 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:11:15.042509    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/baf37e03-29c9-4641-8e79-113d878f376d-istio-data" (OuterVolumeSpecName: "istio-data") pod "baf37e03-29c9-4641-8e79-113d878f376d" (UID: "baf37e03-29c9-4641-8e79-113d878f376d"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 22:11:15.043577 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:11:15.043553    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/baf37e03-29c9-4641-8e79-113d878f376d-kube-api-access-pq9c4" (OuterVolumeSpecName: "kube-api-access-pq9c4") pod "baf37e03-29c9-4641-8e79-113d878f376d" (UID: "baf37e03-29c9-4641-8e79-113d878f376d"). InnerVolumeSpecName "kube-api-access-pq9c4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 22:11:15.043810 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:11:15.043698    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/baf37e03-29c9-4641-8e79-113d878f376d-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "baf37e03-29c9-4641-8e79-113d878f376d" (UID: "baf37e03-29c9-4641-8e79-113d878f376d"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 22:11:15.043810 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:11:15.043741    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/baf37e03-29c9-4641-8e79-113d878f376d-istio-token" (OuterVolumeSpecName: "istio-token") pod "baf37e03-29c9-4641-8e79-113d878f376d" (UID: "baf37e03-29c9-4641-8e79-113d878f376d"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 22:11:15.044115 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:11:15.044097    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/baf37e03-29c9-4641-8e79-113d878f376d-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "baf37e03-29c9-4641-8e79-113d878f376d" (UID: "baf37e03-29c9-4641-8e79-113d878f376d"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 15 22:11:15.053459 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:11:15.053431    2563 generic.go:356] "Generic (PLEG): container finished" podID="baf37e03-29c9-4641-8e79-113d878f376d" containerID="363037eeb697bd85be9c8c76460b64bbde47f617d44f17da87e50541d5254d59" exitCode=0
Jul 15 22:11:15.053563 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:11:15.053466    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-8172c4-openshift-default-58c84c975f-mwr8r" event={"ID":"baf37e03-29c9-4641-8e79-113d878f376d","Type":"ContainerDied","Data":"363037eeb697bd85be9c8c76460b64bbde47f617d44f17da87e50541d5254d59"}
Jul 15 22:11:15.053563 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:11:15.053484    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-8172c4-openshift-default-58c84c975f-mwr8r"
Jul 15 22:11:15.053563 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:11:15.053531    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-8172c4-openshift-default-58c84c975f-mwr8r" event={"ID":"baf37e03-29c9-4641-8e79-113d878f376d","Type":"ContainerDied","Data":"713eb712d068ededc3a1ffe9f42b7c574fb72f93a8485073a53e400121540e6a"}
Jul 15 22:11:15.053563 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:11:15.053555    2563 scope.go:117] "RemoveContainer" containerID="363037eeb697bd85be9c8c76460b64bbde47f617d44f17da87e50541d5254d59"
Jul 15 22:11:15.064756 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:11:15.064740    2563 scope.go:117] "RemoveContainer" containerID="253a4acbf81fd6a750aeb0234c227bc490523141f6c8f2bbfb3157ca532a84ca"
Jul 15 22:11:15.073500 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:11:15.073484    2563 scope.go:117] "RemoveContainer" containerID="363037eeb697bd85be9c8c76460b64bbde47f617d44f17da87e50541d5254d59"
Jul 15 22:11:15.073764 ip-10-0-130-217 kubenswrapper[2563]: E0715 22:11:15.073746    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"363037eeb697bd85be9c8c76460b64bbde47f617d44f17da87e50541d5254d59\": container with ID starting with 363037eeb697bd85be9c8c76460b64bbde47f617d44f17da87e50541d5254d59 not found: ID does not exist" containerID="363037eeb697bd85be9c8c76460b64bbde47f617d44f17da87e50541d5254d59"
Jul 15 22:11:15.073820 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:11:15.073772    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"363037eeb697bd85be9c8c76460b64bbde47f617d44f17da87e50541d5254d59"} err="failed to get container status \"363037eeb697bd85be9c8c76460b64bbde47f617d44f17da87e50541d5254d59\": rpc error: code = NotFound desc = could not find container \"363037eeb697bd85be9c8c76460b64bbde47f617d44f17da87e50541d5254d59\": container with ID starting with 363037eeb697bd85be9c8c76460b64bbde47f617d44f17da87e50541d5254d59 not found: ID does not exist"
Jul 15 22:11:15.073820 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:11:15.073789    2563 scope.go:117] "RemoveContainer" containerID="253a4acbf81fd6a750aeb0234c227bc490523141f6c8f2bbfb3157ca532a84ca"
Jul 15 22:11:15.074102 ip-10-0-130-217 kubenswrapper[2563]: E0715 22:11:15.074083    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"253a4acbf81fd6a750aeb0234c227bc490523141f6c8f2bbfb3157ca532a84ca\": container with ID starting with 253a4acbf81fd6a750aeb0234c227bc490523141f6c8f2bbfb3157ca532a84ca not found: ID does not exist" containerID="253a4acbf81fd6a750aeb0234c227bc490523141f6c8f2bbfb3157ca532a84ca"
Jul 15 22:11:15.074171 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:11:15.074108    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"253a4acbf81fd6a750aeb0234c227bc490523141f6c8f2bbfb3157ca532a84ca"} err="failed to get container status \"253a4acbf81fd6a750aeb0234c227bc490523141f6c8f2bbfb3157ca532a84ca\": rpc error: code = NotFound desc = could not find container \"253a4acbf81fd6a750aeb0234c227bc490523141f6c8f2bbfb3157ca532a84ca\": container with ID starting with 253a4acbf81fd6a750aeb0234c227bc490523141f6c8f2bbfb3157ca532a84ca not found: ID does not exist"
Jul 15 22:11:15.074931 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:11:15.074913    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-8172c4-openshift-default-58c84c975f-mwr8r"]
Jul 15 22:11:15.078024 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:11:15.078002    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-8172c4-openshift-default-58c84c975f-mwr8r"]
Jul 15 22:11:15.142820 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:11:15.142798    2563 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/baf37e03-29c9-4641-8e79-113d878f376d-workload-socket\") on node \"ip-10-0-130-217.ec2.internal\" DevicePath \"\""
Jul 15 22:11:15.142820 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:11:15.142817    2563 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/baf37e03-29c9-4641-8e79-113d878f376d-istio-token\") on node \"ip-10-0-130-217.ec2.internal\" DevicePath \"\""
Jul 15 22:11:15.143032 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:11:15.142828    2563 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/baf37e03-29c9-4641-8e79-113d878f376d-credential-socket\") on node \"ip-10-0-130-217.ec2.internal\" DevicePath \"\""
Jul 15 22:11:15.143032 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:11:15.142838    2563 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/baf37e03-29c9-4641-8e79-113d878f376d-istio-podinfo\") on node \"ip-10-0-130-217.ec2.internal\" DevicePath \"\""
Jul 15 22:11:15.143032 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:11:15.142848    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pq9c4\" (UniqueName: \"kubernetes.io/projected/baf37e03-29c9-4641-8e79-113d878f376d-kube-api-access-pq9c4\") on node \"ip-10-0-130-217.ec2.internal\" DevicePath \"\""
Jul 15 22:11:15.143032 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:11:15.142857    2563 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/baf37e03-29c9-4641-8e79-113d878f376d-istio-data\") on node \"ip-10-0-130-217.ec2.internal\" DevicePath \"\""
Jul 15 22:11:15.143032 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:11:15.142865    2563 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/baf37e03-29c9-4641-8e79-113d878f376d-istio-envoy\") on node \"ip-10-0-130-217.ec2.internal\" DevicePath \"\""
Jul 15 22:11:16.988996 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:11:16.988959    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="baf37e03-29c9-4641-8e79-113d878f376d" path="/var/lib/kubelet/pods/baf37e03-29c9-4641-8e79-113d878f376d/volumes"
Jul 15 22:11:20.663454 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:11:20.663414    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-8cc1f1-6df6d7db5d-6jmnh"]
Jul 15 22:11:20.663918 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:11:20.663694    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-8cc1f1-6df6d7db5d-6jmnh" podUID="a03b1c47-76e6-4f49-9ee5-d4487694b112" containerName="maas-api" containerID="cri-o://36725758af3c5f568ffc68ffe1f9ac85ea05c87470fc26c0c97fc0bcd7114513" gracePeriod=30
Jul 15 22:11:20.923588 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:11:20.923527    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-8cc1f1-6df6d7db5d-6jmnh"
Jul 15 22:11:20.996184 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:11:20.996154    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a03b1c47-76e6-4f49-9ee5-d4487694b112-maas-api-tls\") pod \"a03b1c47-76e6-4f49-9ee5-d4487694b112\" (UID: \"a03b1c47-76e6-4f49-9ee5-d4487694b112\") "
Jul 15 22:11:20.996346 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:11:20.996192    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a03b1c47-76e6-4f49-9ee5-d4487694b112-openshift-service-ca\") pod \"a03b1c47-76e6-4f49-9ee5-d4487694b112\" (UID: \"a03b1c47-76e6-4f49-9ee5-d4487694b112\") "
Jul 15 22:11:20.996346 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:11:20.996271    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kjnh8\" (UniqueName: \"kubernetes.io/projected/a03b1c47-76e6-4f49-9ee5-d4487694b112-kube-api-access-kjnh8\") pod \"a03b1c47-76e6-4f49-9ee5-d4487694b112\" (UID: \"a03b1c47-76e6-4f49-9ee5-d4487694b112\") "
Jul 15 22:11:20.996597 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:11:20.996565    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a03b1c47-76e6-4f49-9ee5-d4487694b112-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "a03b1c47-76e6-4f49-9ee5-d4487694b112" (UID: "a03b1c47-76e6-4f49-9ee5-d4487694b112"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 22:11:20.998281 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:11:20.998260    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a03b1c47-76e6-4f49-9ee5-d4487694b112-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "a03b1c47-76e6-4f49-9ee5-d4487694b112" (UID: "a03b1c47-76e6-4f49-9ee5-d4487694b112"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 22:11:20.998348 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:11:20.998328    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a03b1c47-76e6-4f49-9ee5-d4487694b112-kube-api-access-kjnh8" (OuterVolumeSpecName: "kube-api-access-kjnh8") pod "a03b1c47-76e6-4f49-9ee5-d4487694b112" (UID: "a03b1c47-76e6-4f49-9ee5-d4487694b112"). InnerVolumeSpecName "kube-api-access-kjnh8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 22:11:21.088063 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:11:21.088022    2563 generic.go:356] "Generic (PLEG): container finished" podID="a03b1c47-76e6-4f49-9ee5-d4487694b112" containerID="36725758af3c5f568ffc68ffe1f9ac85ea05c87470fc26c0c97fc0bcd7114513" exitCode=0
Jul 15 22:11:21.088251 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:11:21.088064    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-8cc1f1-6df6d7db5d-6jmnh"
Jul 15 22:11:21.088251 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:11:21.088108    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-8cc1f1-6df6d7db5d-6jmnh" event={"ID":"a03b1c47-76e6-4f49-9ee5-d4487694b112","Type":"ContainerDied","Data":"36725758af3c5f568ffc68ffe1f9ac85ea05c87470fc26c0c97fc0bcd7114513"}
Jul 15 22:11:21.088251 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:11:21.088169    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-8cc1f1-6df6d7db5d-6jmnh" event={"ID":"a03b1c47-76e6-4f49-9ee5-d4487694b112","Type":"ContainerDied","Data":"e03e8544440f78811ef8ef98d4adf395ce22a8f523be5372717307664c507b45"}
Jul 15 22:11:21.088251 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:11:21.088192    2563 scope.go:117] "RemoveContainer" containerID="36725758af3c5f568ffc68ffe1f9ac85ea05c87470fc26c0c97fc0bcd7114513"
Jul 15 22:11:21.097330 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:11:21.097307    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kjnh8\" (UniqueName: \"kubernetes.io/projected/a03b1c47-76e6-4f49-9ee5-d4487694b112-kube-api-access-kjnh8\") on node \"ip-10-0-130-217.ec2.internal\" DevicePath \"\""
Jul 15 22:11:21.097423 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:11:21.097334    2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a03b1c47-76e6-4f49-9ee5-d4487694b112-maas-api-tls\") on node \"ip-10-0-130-217.ec2.internal\" DevicePath \"\""
Jul 15 22:11:21.097423 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:11:21.097351    2563 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a03b1c47-76e6-4f49-9ee5-d4487694b112-openshift-service-ca\") on node \"ip-10-0-130-217.ec2.internal\" DevicePath \"\""
Jul 15 22:11:21.098829 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:11:21.098808    2563 scope.go:117] "RemoveContainer" containerID="36725758af3c5f568ffc68ffe1f9ac85ea05c87470fc26c0c97fc0bcd7114513"
Jul 15 22:11:21.099119 ip-10-0-130-217 kubenswrapper[2563]: E0715 22:11:21.099097    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"36725758af3c5f568ffc68ffe1f9ac85ea05c87470fc26c0c97fc0bcd7114513\": container with ID starting with 36725758af3c5f568ffc68ffe1f9ac85ea05c87470fc26c0c97fc0bcd7114513 not found: ID does not exist" containerID="36725758af3c5f568ffc68ffe1f9ac85ea05c87470fc26c0c97fc0bcd7114513"
Jul 15 22:11:21.099203 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:11:21.099125    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"36725758af3c5f568ffc68ffe1f9ac85ea05c87470fc26c0c97fc0bcd7114513"} err="failed to get container status \"36725758af3c5f568ffc68ffe1f9ac85ea05c87470fc26c0c97fc0bcd7114513\": rpc error: code = NotFound desc = could not find container \"36725758af3c5f568ffc68ffe1f9ac85ea05c87470fc26c0c97fc0bcd7114513\": container with ID starting with 36725758af3c5f568ffc68ffe1f9ac85ea05c87470fc26c0c97fc0bcd7114513 not found: ID does not exist"
Jul 15 22:11:21.109379 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:11:21.109356    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-8cc1f1-6df6d7db5d-6jmnh"]
Jul 15 22:11:21.113032 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:11:21.113012    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-8cc1f1-6df6d7db5d-6jmnh"]
Jul 15 22:11:22.989131 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:11:22.989098    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a03b1c47-76e6-4f49-9ee5-d4487694b112" path="/var/lib/kubelet/pods/a03b1c47-76e6-4f49-9ee5-d4487694b112/volumes"
Jul 15 22:11:42.260947 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:11:42.260904    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-75b45fb47d-pf94n_1efb696c-a59d-4df6-9961-ecd82f93bbb1/manager/0.log"
Jul 15 22:11:42.633363 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:11:42.633337    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-56fdfd95c4-9knb4_3eef3ee1-117c-444d-823b-a2bebe05e65b/copy-manifests/0.log"
Jul 15 22:11:42.650529 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:11:42.650500    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-56fdfd95c4-9knb4_3eef3ee1-117c-444d-823b-a2bebe05e65b/manager/0.log"
Jul 15 22:11:43.286287 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:11:43.286256    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-68b767c759-bk6c9_3bd879ab-a43e-4133-b25c-47df3119c12a/maas-api/0.log"
Jul 15 22:11:43.403136 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:11:43.403103    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29735865-mgw5h_ccfaf994-a80a-469c-ba11-7906926060fc/cleanup/0.log"
Jul 15 22:11:43.521685 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:11:43.521656    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29735880-9d9sm_254f2214-c59b-4649-9fc0-1a751b3c36d2/cleanup/0.log"
Jul 15 22:11:43.639193 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:11:43.639167    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-ait-a41b0fdd-s7h7f_13303763-e6f0-4e52-8bd2-e2abd426321a/revoke-keys/0.log"
Jul 15 22:11:43.755823 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:11:43.755784    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-api-a-64d63c-kvh6z_4d0a10f0-945c-4de2-994f-0ae75b5f5136/revoke-keys/0.log"
Jul 15 22:11:43.875460 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:11:43.875432    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-api-b-ec9857-hf2vh_41f6bd64-6205-4a24-ad1e-6cff83ed6d84/revoke-keys/0.log"
Jul 15 22:11:43.994291 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:11:43.994206    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-derive-c0ed16b0-lt79s_400b3ec3-894d-497a-8de9-3811701f1851/revoke-keys/0.log"
Jul 15 22:11:44.112468 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:11:44.112434    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-inf-a-4081d1-zrf9k_f51684a1-50b4-4431-8239-20f6e1149a11/revoke-keys/0.log"
Jul 15 22:11:44.230927 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:11:44.230896    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-inf-b-a6de7e-pgg4n_6a342e3e-dc7b-4d30-b341-425c1aaff700/revoke-keys/0.log"
Jul 15 22:11:44.347478 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:11:44.347444    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-migrate-02eac3fc-vm8r9_a39f4975-01af-449b-b706-7e3909ce7ed4/revoke-keys/0.log"
Jul 15 22:11:44.461688 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:11:44.461653    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-mt-5920611a-fl5rp_d024dd00-01c9-47b5-869a-c95f6b1005fc/revoke-keys/0.log"
Jul 15 22:11:44.577113 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:11:44.577082    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-shared-a-8172c4-dqcl7_38d7ea49-1217-4e59-8a6f-ff96de4be94d/revoke-keys/0.log"
Jul 15 22:11:44.695282 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:11:44.695201    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-shared-b-8cc1f1-qdfdw_f9816696-ca7f-4c3c-b7bf-e57925b8a07d/revoke-keys/0.log"
Jul 15 22:11:44.803214 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:11:44.803180    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-69fb4594cf-9cls9_18f9dd0c-2e90-4783-9f3f-fbd2ea324296/postgres/0.log"
Jul 15 22:11:46.287233 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:11:46.287199    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-98kcj_f51f71f9-17f6-4f13-bd94-d3ab2c910871/manager/0.log"
Jul 15 22:11:46.536619 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:11:46.536582    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-crnb5_c3304f3c-de45-48af-9327-61f838ab6854/registry-server/0.log"
Jul 15 22:11:46.667479 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:11:46.667446    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-qv8cl_d3fc3361-e4a1-4004-a32f-0f502e7b289c/manager/0.log"
Jul 15 22:11:47.410714 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:11:47.410686    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-kfxkz_985eca68-8ec9-4636-8dfd-07c84778365a/discovery/0.log"
Jul 15 22:11:47.529395 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:11:47.529361    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-9bff-7sssg_24903fdf-bd7f-4ea7-bb88-3785f0a0791a/kube-auth-proxy/0.log"
Jul 15 22:11:47.782529 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:11:47.782441    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-g9cv6_4a9ce1d9-cd12-4bde-b4af-171e9e9b8e65/istio-proxy/1.log"
Jul 15 22:11:47.905225 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:11:47.905188    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-74584bb9f8-jsfdn_2ce2c6c0-0890-4e5d-975b-fac0b8554085/payload-pre-processing/0.log"
Jul 15 22:11:48.029972 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:11:48.029924    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-f9b8d9b9b-9btmw_53898b8a-82af-4e21-b825-9646371ffd92/payload-processing/0.log"
Jul 15 22:11:48.145026 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:11:48.144996    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7bc9859798-z9kjp_9b4bbb5d-a934-4ca1-807d-c760d336c01d/router/0.log"
Jul 15 22:11:48.486619 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:11:48.486530    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-6j8zd_4bb8afb9-4b27-484a-b1c1-bfc765843821/main/0.log"
Jul 15 22:11:48.710562 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:11:48.710528    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-km59b_a8de4782-ea5a-4e34-8534-981cee53dbc0/main/0.log"
Jul 15 22:11:57.738106 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:11:57.738074    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-sj7lm_70c7abe7-c0b9-49bd-9ab9-a5db9117faa5/global-pull-secret-syncer/0.log"
Jul 15 22:11:57.901824 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:11:57.901776    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-rz4r6_6e450c81-34e8-4ad5-9939-56804ad78f86/konnectivity-agent/0.log"
Jul 15 22:11:57.922130 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:11:57.922101    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-130-217.ec2.internal_2041a50860cbd204c2d9aa835bb65766/haproxy/0.log"
Jul 15 22:12:03.575493 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:12:03.575453    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-98kcj_f51f71f9-17f6-4f13-bd94-d3ab2c910871/manager/0.log"
Jul 15 22:12:03.644950 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:12:03.644915    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-crnb5_c3304f3c-de45-48af-9327-61f838ab6854/registry-server/0.log"
Jul 15 22:12:03.861170 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:12:03.861133    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-qv8cl_d3fc3361-e4a1-4004-a32f-0f502e7b289c/manager/0.log"
Jul 15 22:12:05.752199 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:12:05.752167    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-5f7f494dd4-hgkh9_43c5f71f-98e5-4ed1-aa69-bfb6a8815cae/cluster-monitoring-operator/0.log"
Jul 15 22:12:05.893198 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:12:05.893170    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-f8bk7_753537ce-5cee-496f-ac97-a6cf94a5e65e/node-exporter/0.log"
Jul 15 22:12:05.910993 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:12:05.910929    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-f8bk7_753537ce-5cee-496f-ac97-a6cf94a5e65e/kube-rbac-proxy/0.log"
Jul 15 22:12:05.930078 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:12:05.930050    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-f8bk7_753537ce-5cee-496f-ac97-a6cf94a5e65e/init-textfile/0.log"
Jul 15 22:12:06.327975 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:12:06.327918    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-64785b6675-kvqlw_73e59fbc-e033-4930-b2eb-fafc28445643/prometheus-operator/0.log"
Jul 15 22:12:06.342874 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:12:06.342841    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-64785b6675-kvqlw_73e59fbc-e033-4930-b2eb-fafc28445643/kube-rbac-proxy/0.log"
Jul 15 22:12:06.386398 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:12:06.386362    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-8497cf4dff-564xl_d227ddfd-f229-4676-b838-0395a21f7e2d/telemeter-client/0.log"
Jul 15 22:12:06.404468 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:12:06.404441    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-8497cf4dff-564xl_d227ddfd-f229-4676-b838-0395a21f7e2d/reload/0.log"
Jul 15 22:12:06.422685 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:12:06.422663    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-8497cf4dff-564xl_d227ddfd-f229-4676-b838-0395a21f7e2d/kube-rbac-proxy/0.log"
Jul 15 22:12:07.829271 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:12:07.829235    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-rh4xt/perf-node-gather-daemonset-km6pj"]
Jul 15 22:12:07.830005 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:12:07.829657    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a03b1c47-76e6-4f49-9ee5-d4487694b112" containerName="maas-api"
Jul 15 22:12:07.830005 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:12:07.829677    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="a03b1c47-76e6-4f49-9ee5-d4487694b112" containerName="maas-api"
Jul 15 22:12:07.830005 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:12:07.829724    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="baf37e03-29c9-4641-8e79-113d878f376d" containerName="istio-proxy"
Jul 15 22:12:07.830005 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:12:07.829734    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="baf37e03-29c9-4641-8e79-113d878f376d" containerName="istio-proxy"
Jul 15 22:12:07.830005 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:12:07.829765    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f9816696-ca7f-4c3c-b7bf-e57925b8a07d" containerName="revoke-keys"
Jul 15 22:12:07.830005 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:12:07.829774    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="f9816696-ca7f-4c3c-b7bf-e57925b8a07d" containerName="revoke-keys"
Jul 15 22:12:07.830005 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:12:07.829910    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="a03b1c47-76e6-4f49-9ee5-d4487694b112" containerName="maas-api"
Jul 15 22:12:07.830005 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:12:07.829925    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="f9816696-ca7f-4c3c-b7bf-e57925b8a07d" containerName="revoke-keys"
Jul 15 22:12:07.830005 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:12:07.829956    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="baf37e03-29c9-4641-8e79-113d878f376d" containerName="istio-proxy"
Jul 15 22:12:07.830005 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:12:07.829967    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="baf37e03-29c9-4641-8e79-113d878f376d" containerName="istio-proxy"
Jul 15 22:12:07.833250 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:12:07.833230    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-rh4xt/perf-node-gather-daemonset-km6pj"
Jul 15 22:12:07.835142 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:12:07.835119    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-rh4xt\"/\"openshift-service-ca.crt\""
Jul 15 22:12:07.835249 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:12:07.835146    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-rh4xt\"/\"kube-root-ca.crt\""
Jul 15 22:12:07.835861 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:12:07.835846    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-rh4xt\"/\"default-dockercfg-9jmjh\""
Jul 15 22:12:07.841368 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:12:07.841345    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-rh4xt/perf-node-gather-daemonset-km6pj"]
Jul 15 22:12:07.931441 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:12:07.931399    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/e0e2cebf-72a6-4d62-937c-4647673465de-proc\") pod \"perf-node-gather-daemonset-km6pj\" (UID: \"e0e2cebf-72a6-4d62-937c-4647673465de\") " pod="openshift-must-gather-rh4xt/perf-node-gather-daemonset-km6pj"
Jul 15 22:12:07.931634 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:12:07.931529    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e0e2cebf-72a6-4d62-937c-4647673465de-lib-modules\") pod \"perf-node-gather-daemonset-km6pj\" (UID: \"e0e2cebf-72a6-4d62-937c-4647673465de\") " pod="openshift-must-gather-rh4xt/perf-node-gather-daemonset-km6pj"
Jul 15 22:12:07.931634 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:12:07.931564    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e0e2cebf-72a6-4d62-937c-4647673465de-sys\") pod \"perf-node-gather-daemonset-km6pj\" (UID: \"e0e2cebf-72a6-4d62-937c-4647673465de\") " pod="openshift-must-gather-rh4xt/perf-node-gather-daemonset-km6pj"
Jul 15 22:12:07.931634 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:12:07.931609    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g2974\" (UniqueName: \"kubernetes.io/projected/e0e2cebf-72a6-4d62-937c-4647673465de-kube-api-access-g2974\") pod \"perf-node-gather-daemonset-km6pj\" (UID: \"e0e2cebf-72a6-4d62-937c-4647673465de\") " pod="openshift-must-gather-rh4xt/perf-node-gather-daemonset-km6pj"
Jul 15 22:12:07.931752 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:12:07.931699    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/e0e2cebf-72a6-4d62-937c-4647673465de-podres\") pod \"perf-node-gather-daemonset-km6pj\" (UID: \"e0e2cebf-72a6-4d62-937c-4647673465de\") " pod="openshift-must-gather-rh4xt/perf-node-gather-daemonset-km6pj"
Jul 15 22:12:08.032720 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:12:08.032678    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e0e2cebf-72a6-4d62-937c-4647673465de-lib-modules\") pod \"perf-node-gather-daemonset-km6pj\" (UID: \"e0e2cebf-72a6-4d62-937c-4647673465de\") " pod="openshift-must-gather-rh4xt/perf-node-gather-daemonset-km6pj"
Jul 15 22:12:08.032720 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:12:08.032721    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e0e2cebf-72a6-4d62-937c-4647673465de-sys\") pod \"perf-node-gather-daemonset-km6pj\" (UID: \"e0e2cebf-72a6-4d62-937c-4647673465de\") " pod="openshift-must-gather-rh4xt/perf-node-gather-daemonset-km6pj"
Jul 15 22:12:08.032920 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:12:08.032795    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e0e2cebf-72a6-4d62-937c-4647673465de-sys\") pod \"perf-node-gather-daemonset-km6pj\" (UID: \"e0e2cebf-72a6-4d62-937c-4647673465de\") " pod="openshift-must-gather-rh4xt/perf-node-gather-daemonset-km6pj"
Jul 15 22:12:08.032920 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:12:08.032839    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g2974\" (UniqueName: \"kubernetes.io/projected/e0e2cebf-72a6-4d62-937c-4647673465de-kube-api-access-g2974\") pod \"perf-node-gather-daemonset-km6pj\" (UID: \"e0e2cebf-72a6-4d62-937c-4647673465de\") " pod="openshift-must-gather-rh4xt/perf-node-gather-daemonset-km6pj"
Jul 15 22:12:08.032920 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:12:08.032856    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e0e2cebf-72a6-4d62-937c-4647673465de-lib-modules\") pod \"perf-node-gather-daemonset-km6pj\" (UID: \"e0e2cebf-72a6-4d62-937c-4647673465de\") " pod="openshift-must-gather-rh4xt/perf-node-gather-daemonset-km6pj"
Jul 15 22:12:08.032920 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:12:08.032885    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/e0e2cebf-72a6-4d62-937c-4647673465de-podres\") pod \"perf-node-gather-daemonset-km6pj\" (UID: \"e0e2cebf-72a6-4d62-937c-4647673465de\") " pod="openshift-must-gather-rh4xt/perf-node-gather-daemonset-km6pj"
Jul 15 22:12:08.033095 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:12:08.032960    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/e0e2cebf-72a6-4d62-937c-4647673465de-proc\") pod \"perf-node-gather-daemonset-km6pj\" (UID: \"e0e2cebf-72a6-4d62-937c-4647673465de\") " pod="openshift-must-gather-rh4xt/perf-node-gather-daemonset-km6pj"
Jul 15 22:12:08.033095 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:12:08.033001    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/e0e2cebf-72a6-4d62-937c-4647673465de-podres\") pod \"perf-node-gather-daemonset-km6pj\" (UID: \"e0e2cebf-72a6-4d62-937c-4647673465de\") " pod="openshift-must-gather-rh4xt/perf-node-gather-daemonset-km6pj"
Jul 15 22:12:08.033095 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:12:08.033045    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/e0e2cebf-72a6-4d62-937c-4647673465de-proc\") pod \"perf-node-gather-daemonset-km6pj\" (UID: \"e0e2cebf-72a6-4d62-937c-4647673465de\") " pod="openshift-must-gather-rh4xt/perf-node-gather-daemonset-km6pj"
Jul 15 22:12:08.039798 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:12:08.039774    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g2974\" (UniqueName: \"kubernetes.io/projected/e0e2cebf-72a6-4d62-937c-4647673465de-kube-api-access-g2974\") pod \"perf-node-gather-daemonset-km6pj\" (UID: \"e0e2cebf-72a6-4d62-937c-4647673465de\") " pod="openshift-must-gather-rh4xt/perf-node-gather-daemonset-km6pj"
Jul 15 22:12:08.144852 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:12:08.144770    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-rh4xt/perf-node-gather-daemonset-km6pj"
Jul 15 22:12:08.283796 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:12:08.283771    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-rh4xt/perf-node-gather-daemonset-km6pj"]
Jul 15 22:12:08.285551 ip-10-0-130-217 kubenswrapper[2563]: W0715 22:12:08.285523    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pode0e2cebf_72a6_4d62_937c_4647673465de.slice/crio-3c06fce985969ef2b872d2fcb15eae6f2ecdc041ea64666f637b3c05760d64dd WatchSource:0}: Error finding container 3c06fce985969ef2b872d2fcb15eae6f2ecdc041ea64666f637b3c05760d64dd: Status 404 returned error can't find the container with id 3c06fce985969ef2b872d2fcb15eae6f2ecdc041ea64666f637b3c05760d64dd
Jul 15 22:12:08.314070 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:12:08.314051    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-zlsbs_9b97af79-5c4a-4622-8d74-04d470841a53/console-operator/2.log"
Jul 15 22:12:08.322154 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:12:08.322123    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-zlsbs_9b97af79-5c4a-4622-8d74-04d470841a53/console-operator/3.log"
Jul 15 22:12:08.361116 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:12:08.361084    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-rh4xt/perf-node-gather-daemonset-km6pj" event={"ID":"e0e2cebf-72a6-4d62-937c-4647673465de","Type":"ContainerStarted","Data":"3c06fce985969ef2b872d2fcb15eae6f2ecdc041ea64666f637b3c05760d64dd"}
Jul 15 22:12:08.827629 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:12:08.827597    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-58f795db5f-x87hj_4f959056-8782-42a6-aa16-2119afa5362e/console/0.log"
Jul 15 22:12:09.368435 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:12:09.368393    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-rh4xt/perf-node-gather-daemonset-km6pj" event={"ID":"e0e2cebf-72a6-4d62-937c-4647673465de","Type":"ContainerStarted","Data":"39932729abb2cba1f0e099f2fab64159caf1e4221d7e12c274e6d32513152035"}
Jul 15 22:12:09.368852 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:12:09.368520    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-rh4xt/perf-node-gather-daemonset-km6pj"
Jul 15 22:12:09.383706 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:12:09.383658    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-rh4xt/perf-node-gather-daemonset-km6pj" podStartSLOduration=2.383642805 podStartE2EDuration="2.383642805s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 22:12:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 22:12:09.381061878 +0000 UTC m=+2579.074989429" watchObservedRunningTime="2026-07-15 22:12:09.383642805 +0000 UTC m=+2579.077570356"
Jul 15 22:12:09.418314 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:12:09.418280    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-78495597f6-jwp9w_ec86bd51-57c3-469e-967d-851a42be041f/volume-data-source-validator/0.log"
Jul 15 22:12:10.369812 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:12:10.369781    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-l8f7b_a2939e65-0409-4060-a51e-59bc7a1f6600/dns/0.log"
Jul 15 22:12:10.386406 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:12:10.386380    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-l8f7b_a2939e65-0409-4060-a51e-59bc7a1f6600/kube-rbac-proxy/0.log"
Jul 15 22:12:10.528574 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:12:10.528545    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-tlrgr_a8599815-6b89-4248-99de-f4a3ee849bf0/dns-node-resolver/0.log"
Jul 15 22:12:11.054994 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:12:11.054962    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-9rlc4_29df31ab-38b3-4cec-ab5e-013432132c57/node-ca/0.log"
Jul 15 22:12:12.146786 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:12:12.146747    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-kfxkz_985eca68-8ec9-4636-8dfd-07c84778365a/discovery/0.log"
Jul 15 22:12:12.168421 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:12:12.168387    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-9bff-7sssg_24903fdf-bd7f-4ea7-bb88-3785f0a0791a/kube-auth-proxy/0.log"
Jul 15 22:12:12.218366 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:12:12.218337    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-g9cv6_4a9ce1d9-cd12-4bde-b4af-171e9e9b8e65/istio-proxy/0.log"
Jul 15 22:12:12.281954 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:12:12.281915    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-g9cv6_4a9ce1d9-cd12-4bde-b4af-171e9e9b8e65/istio-proxy/1.log"
Jul 15 22:12:12.316030 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:12:12.316005    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-74584bb9f8-jsfdn_2ce2c6c0-0890-4e5d-975b-fac0b8554085/payload-pre-processing/0.log"
Jul 15 22:12:12.354771 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:12:12.354744    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-f9b8d9b9b-9btmw_53898b8a-82af-4e21-b825-9646371ffd92/payload-processing/0.log"
Jul 15 22:12:12.374302 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:12:12.374275    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7bc9859798-z9kjp_9b4bbb5d-a934-4ca1-807d-c760d336c01d/router/0.log"
Jul 15 22:12:13.006798 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:12:13.006763    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-2jskd_d912f2b6-80b8-4639-be45-72e51e7b565f/serve-healthcheck-canary/0.log"
Jul 15 22:12:13.485354 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:12:13.485326    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-68d9dd94cf-j57mj_7c107438-4a43-49fe-9bcb-a9c114c05d85/insights-operator/0.log"
Jul 15 22:12:13.486718 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:12:13.486694    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-68d9dd94cf-j57mj_7c107438-4a43-49fe-9bcb-a9c114c05d85/insights-operator/1.log"
Jul 15 22:12:13.576615 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:12:13.576589    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-j4l5v_6f7d5625-636f-4ee3-b08f-05a8822fbb9c/kube-rbac-proxy/0.log"
Jul 15 22:12:13.597555 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:12:13.597529    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-j4l5v_6f7d5625-636f-4ee3-b08f-05a8822fbb9c/exporter/0.log"
Jul 15 22:12:13.617602 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:12:13.617578    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-j4l5v_6f7d5625-636f-4ee3-b08f-05a8822fbb9c/extractor/0.log"
Jul 15 22:12:15.385269 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:12:15.385241    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-rh4xt/perf-node-gather-daemonset-km6pj"
Jul 15 22:12:16.058299 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:12:16.058267    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-75b45fb47d-pf94n_1efb696c-a59d-4df6-9961-ecd82f93bbb1/manager/0.log"
Jul 15 22:12:16.283841 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:12:16.283805    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-56fdfd95c4-9knb4_3eef3ee1-117c-444d-823b-a2bebe05e65b/manager/0.log"
Jul 15 22:12:16.298926 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:12:16.298898    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-56fdfd95c4-9knb4_3eef3ee1-117c-444d-823b-a2bebe05e65b/copy-manifests/0.log"
Jul 15 22:12:18.657549 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:12:18.657520    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-kfxkz_985eca68-8ec9-4636-8dfd-07c84778365a/discovery/0.log"
Jul 15 22:12:18.667956 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:12:18.667904    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-9bff-7sssg_24903fdf-bd7f-4ea7-bb88-3785f0a0791a/kube-auth-proxy/0.log"
Jul 15 22:12:18.709980 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:12:18.709931    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-g9cv6_4a9ce1d9-cd12-4bde-b4af-171e9e9b8e65/istio-proxy/0.log"
Jul 15 22:12:18.774135 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:12:18.774097    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-g9cv6_4a9ce1d9-cd12-4bde-b4af-171e9e9b8e65/istio-proxy/1.log"
Jul 15 22:12:18.803444 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:12:18.803412    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-74584bb9f8-jsfdn_2ce2c6c0-0890-4e5d-975b-fac0b8554085/payload-pre-processing/0.log"
Jul 15 22:12:18.831667 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:12:18.831635    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-f9b8d9b9b-9btmw_53898b8a-82af-4e21-b825-9646371ffd92/payload-processing/0.log"
Jul 15 22:12:18.847545 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:12:18.847510    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7bc9859798-z9kjp_9b4bbb5d-a934-4ca1-807d-c760d336c01d/router/0.log"
Jul 15 22:12:20.210775 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:12:20.210739    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-kfxkz_985eca68-8ec9-4636-8dfd-07c84778365a/discovery/0.log"
Jul 15 22:12:20.222910 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:12:20.222887    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-9bff-7sssg_24903fdf-bd7f-4ea7-bb88-3785f0a0791a/kube-auth-proxy/0.log"
Jul 15 22:12:20.258757 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:12:20.258722    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-g9cv6_4a9ce1d9-cd12-4bde-b4af-171e9e9b8e65/istio-proxy/0.log"
Jul 15 22:12:20.319409 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:12:20.319373    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-g9cv6_4a9ce1d9-cd12-4bde-b4af-171e9e9b8e65/istio-proxy/1.log"
Jul 15 22:12:20.347807 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:12:20.347782    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-74584bb9f8-jsfdn_2ce2c6c0-0890-4e5d-975b-fac0b8554085/payload-pre-processing/0.log"
Jul 15 22:12:20.379611 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:12:20.379585    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-f9b8d9b9b-9btmw_53898b8a-82af-4e21-b825-9646371ffd92/payload-processing/0.log"
Jul 15 22:12:20.395657 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:12:20.395624    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7bc9859798-z9kjp_9b4bbb5d-a934-4ca1-807d-c760d336c01d/router/0.log"
Jul 15 22:12:23.017823 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:12:23.017790    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-799cb7f958-2jn97_1683be20-36a0-4ca3-b861-972d9805c362/kube-storage-version-migrator-operator/1.log"
Jul 15 22:12:23.019578 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:12:23.019557    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-799cb7f958-2jn97_1683be20-36a0-4ca3-b861-972d9805c362/kube-storage-version-migrator-operator/0.log"
Jul 15 22:12:23.980492 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:12:23.980391    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-f2sjs_cdc00ed8-331f-4ccc-9d0e-66e123a578eb/kube-multus-additional-cni-plugins/0.log"
Jul 15 22:12:24.004667 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:12:24.004641    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-f2sjs_cdc00ed8-331f-4ccc-9d0e-66e123a578eb/egress-router-binary-copy/0.log"
Jul 15 22:12:24.023036 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:12:24.023012    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-f2sjs_cdc00ed8-331f-4ccc-9d0e-66e123a578eb/cni-plugins/0.log"
Jul 15 22:12:24.043027 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:12:24.043004    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-f2sjs_cdc00ed8-331f-4ccc-9d0e-66e123a578eb/bond-cni-plugin/0.log"
Jul 15 22:12:24.061917 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:12:24.061887    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-f2sjs_cdc00ed8-331f-4ccc-9d0e-66e123a578eb/routeoverride-cni/0.log"
Jul 15 22:12:24.079731 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:12:24.079697    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-f2sjs_cdc00ed8-331f-4ccc-9d0e-66e123a578eb/whereabouts-cni-bincopy/0.log"
Jul 15 22:12:24.098061 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:12:24.098039    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-f2sjs_cdc00ed8-331f-4ccc-9d0e-66e123a578eb/whereabouts-cni/0.log"
Jul 15 22:12:24.479649 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:12:24.479617    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-dnzpf_0a247377-2db3-4a4f-9faf-24b8cf6b2688/kube-multus/0.log"
Jul 15 22:12:24.529489 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:12:24.529455    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-6tbzj_c4900b8a-d9f9-4926-8c67-62cd4a52ce9b/network-metrics-daemon/0.log"
Jul 15 22:12:24.545762 ip-10-0-130-217 kubenswrapper[2563]: I0715 22:12:24.545736    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-6tbzj_c4900b8a-d9f9-4926-8c67-62cd4a52ce9b/kube-rbac-proxy/0.log"