Jul 13 18:56:33.253276 ip-10-0-135-38 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Jul 13 18:56:33.253288 ip-10-0-135-38 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Jul 13 18:56:33.253297 ip-10-0-135-38 systemd[1]: kubelet.service: Failed with result 'resources'.
Jul 13 18:56:33.253656 ip-10-0-135-38 systemd[1]: Failed to start Kubernetes Kubelet.
Jul 13 18:56:43.480179 ip-10-0-135-38 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Jul 13 18:56:43.480199 ip-10-0-135-38 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 6e4c57112ae943848e0303b8aa131c90 --
Jul 13 18:58:30.243913 ip-10-0-135-38 systemd[1]: Starting Kubernetes Kubelet...
Jul 13 18:58:30.649440 ip-10-0-135-38 kubenswrapper[2563]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 13 18:58:30.649440 ip-10-0-135-38 kubenswrapper[2563]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 13 18:58:30.649440 ip-10-0-135-38 kubenswrapper[2563]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 13 18:58:30.649440 ip-10-0-135-38 kubenswrapper[2563]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 13 18:58:30.649440 ip-10-0-135-38 kubenswrapper[2563]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 13 18:58:30.650887 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:30.650788    2563 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 13 18:58:30.658111 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.658088    2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 13 18:58:30.658111 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.658110    2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 13 18:58:30.658111 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.658113    2563 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 13 18:58:30.658213 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.658117    2563 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 13 18:58:30.658213 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.658120    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 13 18:58:30.658213 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.658124    2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 13 18:58:30.658213 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.658127    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 13 18:58:30.658213 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.658130    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 13 18:58:30.658213 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.658133    2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 13 18:58:30.658213 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.658136    2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 13 18:58:30.658213 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.658139    2563 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 13 18:58:30.658213 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.658141    2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 13 18:58:30.658213 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.658151    2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 13 18:58:30.658213 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.658154    2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 13 18:58:30.658213 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.658157    2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 13 18:58:30.658213 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.658160    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 13 18:58:30.658213 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.658163    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 13 18:58:30.658213 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.658165    2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 13 18:58:30.658213 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.658169    2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 13 18:58:30.658213 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.658171    2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 13 18:58:30.658213 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.658174    2563 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 13 18:58:30.658213 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.658176    2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 13 18:58:30.658213 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.658179    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 13 18:58:30.658718 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.658181    2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 13 18:58:30.658718 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.658184    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 13 18:58:30.658718 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.658186    2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 13 18:58:30.658718 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.658189    2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 13 18:58:30.658718 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.658191    2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 13 18:58:30.658718 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.658194    2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 13 18:58:30.658718 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.658196    2563 feature_gate.go:328] unrecognized feature gate: Example
Jul 13 18:58:30.658718 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.658199    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 13 18:58:30.658718 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.658202    2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 13 18:58:30.658718 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.658204    2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 13 18:58:30.658718 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.658206    2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 13 18:58:30.658718 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.658209    2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 13 18:58:30.658718 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.658211    2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 13 18:58:30.658718 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.658214    2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 13 18:58:30.658718 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.658222    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 13 18:58:30.658718 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.658225    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 13 18:58:30.658718 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.658228    2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 13 18:58:30.658718 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.658231    2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 13 18:58:30.658718 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.658234    2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 13 18:58:30.658718 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.658236    2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 13 18:58:30.659194 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.658238    2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 13 18:58:30.659194 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.658241    2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 13 18:58:30.659194 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.658243    2563 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 13 18:58:30.659194 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.658246    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 13 18:58:30.659194 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.658248    2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 13 18:58:30.659194 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.658252    2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 13 18:58:30.659194 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.658256    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 13 18:58:30.659194 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.658260    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 13 18:58:30.659194 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.658265    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 13 18:58:30.659194 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.658269    2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 13 18:58:30.659194 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.658273    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 13 18:58:30.659194 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.658297    2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 13 18:58:30.659194 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.658302    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 13 18:58:30.659194 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.658304    2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 13 18:58:30.659194 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.658307    2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 13 18:58:30.659194 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.658311    2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 13 18:58:30.659194 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.658314    2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 13 18:58:30.659194 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.658317    2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 13 18:58:30.659194 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.658320    2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 13 18:58:30.659673 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.658322    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 13 18:58:30.659673 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.658325    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 13 18:58:30.659673 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.658327    2563 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 13 18:58:30.659673 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.658330    2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 13 18:58:30.659673 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.658332    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 13 18:58:30.659673 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.658335    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 13 18:58:30.659673 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.658339    2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 13 18:58:30.659673 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.658349    2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 13 18:58:30.659673 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.658354    2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 13 18:58:30.659673 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.658357    2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 13 18:58:30.659673 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.658361    2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 13 18:58:30.659673 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.658365    2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 13 18:58:30.659673 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.658367    2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 13 18:58:30.659673 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.658370    2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 13 18:58:30.659673 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.658373    2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 13 18:58:30.659673 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.658376    2563 feature_gate.go:328] unrecognized feature gate: Example2
Jul 13 18:58:30.659673 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.658381    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 13 18:58:30.659673 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.658384    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 13 18:58:30.659673 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.658386    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 13 18:58:30.659673 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.658389    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 13 18:58:30.660153 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.658392    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 13 18:58:30.660153 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.658395    2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 13 18:58:30.660153 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.658397    2563 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 13 18:58:30.660153 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.658400    2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 13 18:58:30.660153 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.658402    2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 13 18:58:30.660153 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.658405    2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 13 18:58:30.660153 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.658408    2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 13 18:58:30.660153 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.658410    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 13 18:58:30.660153 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.658413    2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 13 18:58:30.660153 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.658415    2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 13 18:58:30.660153 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.658417    2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 13 18:58:30.660153 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.658420    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 13 18:58:30.660153 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.658422    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 13 18:58:30.660153 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.658425    2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 13 18:58:30.660153 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.658427    2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 13 18:58:30.660153 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.658430    2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 13 18:58:30.660153 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.658432    2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 13 18:58:30.660153 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.659256    2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 13 18:58:30.660153 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.659265    2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 13 18:58:30.660153 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.659269    2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 13 18:58:30.660624 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.659272    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 13 18:58:30.660624 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.659276    2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 13 18:58:30.660624 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.659279    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 13 18:58:30.660624 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.659281    2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 13 18:58:30.660624 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.659284    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 13 18:58:30.660624 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.659287    2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 13 18:58:30.660624 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.659290    2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 13 18:58:30.660624 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.659293    2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 13 18:58:30.660624 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.659295    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 13 18:58:30.660624 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.659298    2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 13 18:58:30.660624 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.659301    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 13 18:58:30.660624 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.659303    2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 13 18:58:30.660624 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.659306    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 13 18:58:30.660624 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.659309    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 13 18:58:30.660624 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.659312    2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 13 18:58:30.660624 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.659316    2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 13 18:58:30.660624 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.659319    2563 feature_gate.go:328] unrecognized feature gate: Example2
Jul 13 18:58:30.660624 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.659334    2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 13 18:58:30.660624 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.659338    2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 13 18:58:30.660624 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.659341    2563 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 13 18:58:30.661113 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.659344    2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 13 18:58:30.661113 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.659347    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 13 18:58:30.661113 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.659350    2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 13 18:58:30.661113 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.659353    2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 13 18:58:30.661113 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.659355    2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 13 18:58:30.661113 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.659357    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 13 18:58:30.661113 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.659360    2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 13 18:58:30.661113 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.659363    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 13 18:58:30.661113 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.659366    2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 13 18:58:30.661113 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.659368    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 13 18:58:30.661113 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.659371    2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 13 18:58:30.661113 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.659374    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 13 18:58:30.661113 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.659377    2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 13 18:58:30.661113 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.659380    2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 13 18:58:30.661113 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.659383    2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 13 18:58:30.661113 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.659386    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 13 18:58:30.661113 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.659388    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 13 18:58:30.661113 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.659391    2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 13 18:58:30.661113 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.659393    2563 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 13 18:58:30.661113 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.659396    2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 13 18:58:30.661591 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.659398    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 13 18:58:30.661591 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.659401    2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 13 18:58:30.661591 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.659404    2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 13 18:58:30.661591 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.659406    2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 13 18:58:30.661591 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.659409    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 13 18:58:30.661591 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.659413    2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 13 18:58:30.661591 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.659415    2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 13 18:58:30.661591 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.659418    2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 13 18:58:30.661591 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.659420    2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 13 18:58:30.661591 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.659424    2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 13 18:58:30.661591 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.659426    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 13 18:58:30.661591 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.659429    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 13 18:58:30.661591 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.659431    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 13 18:58:30.661591 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.659434    2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 13 18:58:30.661591 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.659437    2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 13 18:58:30.661591 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.659439    2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 13 18:58:30.661591 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.659441    2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 13 18:58:30.661591 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.659444    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 13 18:58:30.661591 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.659446    2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 13 18:58:30.662037 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.659449    2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 13 18:58:30.662037 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.659451    2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 13 18:58:30.662037 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.659454    2563 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 13 18:58:30.662037 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.659457    2563 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 13 18:58:30.662037 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.659459    2563 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 13 18:58:30.662037 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.659462    2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 13 18:58:30.662037 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.659464    2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 13 18:58:30.662037 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.659467    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 13 18:58:30.662037 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.659470    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 13 18:58:30.662037 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.659473    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 13 18:58:30.662037 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.659475    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 13 18:58:30.662037 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.659478    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 13 18:58:30.662037 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.659482    2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 13 18:58:30.662037 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.659485    2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 13 18:58:30.662037 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.659488    2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 13 18:58:30.662037 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.659490    2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 13 18:58:30.662037 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.659493    2563 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 13 18:58:30.662037 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.659496    2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 13 18:58:30.662037 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.659498    2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 13 18:58:30.662037 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.659501    2563 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 13 18:58:30.662516 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.659503    2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 13 18:58:30.662516 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.659506    2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 13 18:58:30.662516 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.659509    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 13 18:58:30.662516 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.659511    2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 13 18:58:30.662516 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.659514    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 13 18:58:30.662516 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.659516    2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 13 18:58:30.662516 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.659519    2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 13 18:58:30.662516 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.659521    2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 13 18:58:30.662516 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.659524    2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 13 18:58:30.662516 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.659526    2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 13 18:58:30.662516 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.659529    2563 feature_gate.go:328] unrecognized feature gate: Example
Jul 13 18:58:30.662516 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.659531    2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 13 18:58:30.662516 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.659535    2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 13 18:58:30.662516 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.659539    2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 13 18:58:30.662516 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.659542    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 13 18:58:30.662516 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.659545    2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 13 18:58:30.662516 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.659548    2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 13 18:58:30.662516 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.659979    2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 13 18:58:30.662516 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.659985    2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 13 18:58:30.663026 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.659988    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 13 18:58:30.663026 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.659991    2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 13 18:58:30.663026 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.659994    2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 13 18:58:30.663026 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.659997    2563 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 13 18:58:30.663026 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.659999    2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 13 18:58:30.663026 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.660002    2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 13 18:58:30.663026 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.660005    2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 13 18:58:30.663026 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.660007    2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 13 18:58:30.663026 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.660010    2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 13 18:58:30.663026 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.660013    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 13 18:58:30.663026 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.660016    2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 13 18:58:30.663026 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.660019    2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 13 18:58:30.663026 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.660021    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 13 18:58:30.663026 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.660024    2563 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 13 18:58:30.663026 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.660026    2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 13 18:58:30.663026 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.660029    2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 13 18:58:30.663026 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.660031    2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 13 18:58:30.663026 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.660034    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 13 18:58:30.663026 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.660037    2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 13 18:58:30.663026 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.660039    2563 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 13 18:58:30.663507 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.660042    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 13 18:58:30.663507 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.660046    2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 13 18:58:30.663507 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.660049    2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 13 18:58:30.663507 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.660052    2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 13 18:58:30.663507 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.660055    2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 13 18:58:30.663507 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.660058    2563 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 13 18:58:30.663507 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.660061    2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 13 18:58:30.663507 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.660063    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 13 18:58:30.663507 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.660070    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 13 18:58:30.663507 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.660073    2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 13 18:58:30.663507 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.660076    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 13 18:58:30.663507 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.660078    2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 13 18:58:30.663507 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.660081    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 13 18:58:30.663507 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.660083    2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 13 18:58:30.663507 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.660086    2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 13 18:58:30.663507 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.660089    2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 13 18:58:30.663507 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.660091    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 13 18:58:30.663507 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.660094    2563 feature_gate.go:328] unrecognized feature gate: Example2
Jul 13 18:58:30.663507 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.660096    2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 13 18:58:30.663507 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.660099    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 13 18:58:30.664067 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.660101    2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 13 18:58:30.664067 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.660104    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 13 18:58:30.664067 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.660106    2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 13 18:58:30.664067 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.660109    2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 13 18:58:30.664067 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.660112    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 13 18:58:30.664067 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.660115    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 13 18:58:30.664067 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.660118    2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 13 18:58:30.664067 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.660120    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 13 18:58:30.664067 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.660123    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 13 18:58:30.664067 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.660125    2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 13 18:58:30.664067 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.660128    2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 13 18:58:30.664067 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.660131    2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 13 18:58:30.664067 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.660134    2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 13 18:58:30.664067 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.660136    2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 13 18:58:30.664067 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.660138    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 13 18:58:30.664067 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.660141    2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 13 18:58:30.664067 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.660143    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 13 18:58:30.664067 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.660145    2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 13 18:58:30.664067 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.660148    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 13 18:58:30.664067 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.660150    2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 13 18:58:30.664529 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.660155    2563 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 13 18:58:30.664529 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.660157    2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 13 18:58:30.664529 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.660160    2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 13 18:58:30.664529 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.660163    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 13 18:58:30.664529 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.660166    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 13 18:58:30.664529 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.660168    2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 13 18:58:30.664529 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.660171    2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 13 18:58:30.664529 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.660174    2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 13 18:58:30.664529 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.660176    2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 13 18:58:30.664529 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.660179    2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 13 18:58:30.664529 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.660182    2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 13 18:58:30.664529 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.660184    2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 13 18:58:30.664529 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.660187    2563 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 13 18:58:30.664529 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.660189    2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 13 18:58:30.664529 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.660191    2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 13 18:58:30.664529 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.660196    2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 13 18:58:30.664529 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.660198    2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 13 18:58:30.664529 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.660201    2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 13 18:58:30.664529 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.660203    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 13 18:58:30.665001 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.660206    2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 13 18:58:30.665001 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.660208    2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 13 18:58:30.665001 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.660211    2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 13 18:58:30.665001 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.660215    2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 13 18:58:30.665001 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.660218    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 13 18:58:30.665001 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.660221    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 13 18:58:30.665001 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.660223    2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 13 18:58:30.665001 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.660226    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 13 18:58:30.665001 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.660228    2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 13 18:58:30.665001 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.660231    2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 13 18:58:30.665001 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.660233    2563 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 13 18:58:30.665001 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.660236    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 13 18:58:30.665001 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.660238    2563 feature_gate.go:328] unrecognized feature gate: Example
Jul 13 18:58:30.665001 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.660242    2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 13 18:58:30.665001 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.660245    2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 13 18:58:30.665001 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.660247    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 13 18:58:30.665001 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.660250    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 13 18:58:30.665001 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.660252    2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 13 18:58:30.665001 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:30.660330    2563 flags.go:64] FLAG: --address="0.0.0.0"
Jul 13 18:58:30.665001 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:30.660338    2563 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 13 18:58:30.665497 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:30.660345    2563 flags.go:64] FLAG: --anonymous-auth="true"
Jul 13 18:58:30.665497 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:30.660363    2563 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 13 18:58:30.665497 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:30.660367    2563 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 13 18:58:30.665497 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:30.660371    2563 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 13 18:58:30.665497 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:30.660375    2563 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 13 18:58:30.665497 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:30.660379    2563 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 13 18:58:30.665497 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:30.660383    2563 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 13 18:58:30.665497 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:30.660386    2563 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 13 18:58:30.665497 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:30.660391    2563 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 13 18:58:30.665497 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:30.660394    2563 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 13 18:58:30.665497 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:30.660397    2563 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 13 18:58:30.665497 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:30.660401    2563 flags.go:64] FLAG: --cgroup-root=""
Jul 13 18:58:30.665497 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:30.660404    2563 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 13 18:58:30.665497 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:30.660407    2563 flags.go:64] FLAG: --client-ca-file=""
Jul 13 18:58:30.665497 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:30.660410    2563 flags.go:64] FLAG: --cloud-provider="external"
Jul 13 18:58:30.665497 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:30.660413    2563 flags.go:64] FLAG: --cluster-dns="[]"
Jul 13 18:58:30.665497 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:30.660417    2563 flags.go:64] FLAG: --cluster-domain=""
Jul 13 18:58:30.665497 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:30.660420    2563 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 13 18:58:30.665497 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:30.660424    2563 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 13 18:58:30.665497 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:30.660427    2563 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 13 18:58:30.665497 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:30.660430    2563 flags.go:64] FLAG: --container-log-max-files="5"
Jul 13 18:58:30.665497 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:30.660434    2563 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 13 18:58:30.665497 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:30.660437    2563 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 13 18:58:30.666048 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:30.660440    2563 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 13 18:58:30.666048 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:30.660444    2563 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 13 18:58:30.666048 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:30.660449    2563 flags.go:64] FLAG: --contention-profiling="false"
Jul 13 18:58:30.666048 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:30.660452    2563 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 13 18:58:30.666048 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:30.660455    2563 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 13 18:58:30.666048 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:30.660458    2563 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 13 18:58:30.666048 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:30.660461    2563 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 13 18:58:30.666048 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:30.660465    2563 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 13 18:58:30.666048 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:30.660468    2563 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 13 18:58:30.666048 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:30.660471    2563 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 13 18:58:30.666048 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:30.660474    2563 flags.go:64] FLAG: --enable-load-reader="false"
Jul 13 18:58:30.666048 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:30.660478    2563 flags.go:64] FLAG: --enable-server="true"
Jul 13 18:58:30.666048 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:30.660481    2563 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 13 18:58:30.666048 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:30.660486    2563 flags.go:64] FLAG: --event-burst="100"
Jul 13 18:58:30.666048 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:30.660489    2563 flags.go:64] FLAG: --event-qps="50"
Jul 13 18:58:30.666048 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:30.660492    2563 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 13 18:58:30.666048 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:30.660495    2563 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 13 18:58:30.666048 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:30.660499    2563 flags.go:64] FLAG: --eviction-hard=""
Jul 13 18:58:30.666048 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:30.660502    2563 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 13 18:58:30.666048 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:30.660505    2563 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 13 18:58:30.666048 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:30.660508    2563 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 13 18:58:30.666048 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:30.660511    2563 flags.go:64] FLAG: --eviction-soft=""
Jul 13 18:58:30.666048 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:30.660514    2563 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 13 18:58:30.666048 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:30.660517    2563 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 13 18:58:30.666048 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:30.660520    2563 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 13 18:58:30.666687 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:30.660522    2563 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 13 18:58:30.666687 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:30.660525    2563 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 13 18:58:30.666687 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:30.660528    2563 flags.go:64] FLAG: --fail-swap-on="true"
Jul 13 18:58:30.666687 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:30.660531    2563 flags.go:64] FLAG: --feature-gates=""
Jul 13 18:58:30.666687 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:30.660535    2563 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 13 18:58:30.666687 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:30.660537    2563 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 13 18:58:30.666687 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:30.660540    2563 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 13 18:58:30.666687 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:30.660543    2563 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 13 18:58:30.666687 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:30.660546    2563 flags.go:64] FLAG: --healthz-port="10248"
Jul 13 18:58:30.666687 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:30.660550    2563 flags.go:64] FLAG: --help="false"
Jul 13 18:58:30.666687 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:30.660553    2563 flags.go:64] FLAG: --hostname-override="ip-10-0-135-38.ec2.internal"
Jul 13 18:58:30.666687 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:30.660556    2563 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 13 18:58:30.666687 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:30.660573    2563 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 13 18:58:30.666687 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:30.660575    2563 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 13 18:58:30.666687 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:30.660579    2563 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 13 18:58:30.666687 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:30.660582    2563 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 13 18:58:30.666687 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:30.660585    2563 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 13 18:58:30.666687 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:30.660588    2563 flags.go:64] FLAG: --image-service-endpoint=""
Jul 13 18:58:30.666687 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:30.660591    2563 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 13 18:58:30.666687 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:30.660594    2563 flags.go:64] FLAG: --kube-api-burst="100"
Jul 13 18:58:30.666687 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:30.660597    2563 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 13 18:58:30.666687 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:30.660600    2563 flags.go:64] FLAG: --kube-api-qps="50"
Jul 13 18:58:30.666687 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:30.660603    2563 flags.go:64] FLAG: --kube-reserved=""
Jul 13 18:58:30.666687 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:30.660606    2563 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 13 18:58:30.667315 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:30.660610    2563 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 13 18:58:30.667315 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:30.660613    2563 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 13 18:58:30.667315 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:30.660616    2563 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 13 18:58:30.667315 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:30.660619    2563 flags.go:64] FLAG: --lock-file=""
Jul 13 18:58:30.667315 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:30.660622    2563 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 13 18:58:30.667315 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:30.660625    2563 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 13 18:58:30.667315 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:30.660628    2563 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 13 18:58:30.667315 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:30.660633    2563 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 13 18:58:30.667315 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:30.660636    2563 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 13 18:58:30.667315 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:30.660639    2563 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 13 18:58:30.667315 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:30.660642    2563 flags.go:64] FLAG: --logging-format="text"
Jul 13 18:58:30.667315 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:30.660645    2563 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 13 18:58:30.667315 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:30.660648    2563 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 13 18:58:30.667315 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:30.660651    2563 flags.go:64] FLAG: --manifest-url=""
Jul 13 18:58:30.667315 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:30.660654    2563 flags.go:64] FLAG: --manifest-url-header=""
Jul 13 18:58:30.667315 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:30.660658    2563 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 13 18:58:30.667315 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:30.660661    2563 flags.go:64] FLAG: --max-open-files="1000000"
Jul 13 18:58:30.667315 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:30.660667    2563 flags.go:64] FLAG: --max-pods="110"
Jul 13 18:58:30.667315 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:30.660669    2563 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 13 18:58:30.667315 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:30.660672    2563 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 13 18:58:30.667315 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:30.660675    2563 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 13 18:58:30.667315 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:30.660678    2563 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 13 18:58:30.667315 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:30.660681    2563 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 13 18:58:30.667315 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:30.660683    2563 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 13 18:58:30.667315 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:30.660686    2563 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 13 18:58:30.667976 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:30.660694    2563 flags.go:64] FLAG: --node-status-max-images="50"
Jul 13 18:58:30.667976 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:30.660697    2563 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 13 18:58:30.667976 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:30.660700    2563 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 13 18:58:30.667976 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:30.660704    2563 flags.go:64] FLAG: --pod-cidr=""
Jul 13 18:58:30.667976 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:30.660707    2563 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b04c0b1f73af4d021dd8f0b51bfeb302c24482c093de5f2c43654ab56c506926"
Jul 13 18:58:30.667976 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:30.660712    2563 flags.go:64] FLAG: --pod-manifest-path=""
Jul 13 18:58:30.667976 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:30.660715    2563 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 13 18:58:30.667976 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:30.660720    2563 flags.go:64] FLAG: --pods-per-core="0"
Jul 13 18:58:30.667976 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:30.660723    2563 flags.go:64] FLAG: --port="10250"
Jul 13 18:58:30.667976 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:30.660727    2563 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 13 18:58:30.667976 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:30.660729    2563 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-05aa2381ed9046686"
Jul 13 18:58:30.667976 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:30.660733    2563 flags.go:64] FLAG: --qos-reserved=""
Jul 13 18:58:30.667976 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:30.660735    2563 flags.go:64] FLAG: --read-only-port="10255"
Jul 13 18:58:30.667976 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:30.660738    2563 flags.go:64] FLAG: --register-node="true"
Jul 13 18:58:30.667976 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:30.660741    2563 flags.go:64] FLAG: --register-with-taints=""
Jul 13 18:58:30.667976 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:30.660744    2563 flags.go:64] FLAG: --registry-burst="10"
Jul 13 18:58:30.667976 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:30.660747    2563 flags.go:64] FLAG: --registry-qps="5"
Jul 13 18:58:30.667976 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:30.660750    2563 flags.go:64] FLAG: --reserved-cpus=""
Jul 13 18:58:30.667976 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:30.660753    2563 flags.go:64] FLAG: --reserved-memory=""
Jul 13 18:58:30.667976 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:30.660757    2563 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 13 18:58:30.667976 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:30.660760    2563 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 13 18:58:30.667976 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:30.660763    2563 flags.go:64] FLAG: --rotate-certificates="false"
Jul 13 18:58:30.667976 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:30.660766    2563 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 13 18:58:30.667976 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:30.660769    2563 flags.go:64] FLAG: --runonce="false"
Jul 13 18:58:30.667976 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:30.660772    2563 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 13 18:58:30.668846 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:30.660777    2563 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 13 18:58:30.668846 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:30.660780    2563 flags.go:64] FLAG: --seccomp-default="false"
Jul 13 18:58:30.668846 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:30.660783    2563 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 13 18:58:30.668846 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:30.660786    2563 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 13 18:58:30.668846 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:30.660789    2563 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 13 18:58:30.668846 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:30.660792    2563 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 13 18:58:30.668846 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:30.660795    2563 flags.go:64] FLAG: --storage-driver-password="root"
Jul 13 18:58:30.668846 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:30.660798    2563 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 13 18:58:30.668846 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:30.660801    2563 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 13 18:58:30.668846 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:30.660803    2563 flags.go:64] FLAG: --storage-driver-user="root"
Jul 13 18:58:30.668846 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:30.660806    2563 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 13 18:58:30.668846 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:30.660810    2563 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 13 18:58:30.668846 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:30.660813    2563 flags.go:64] FLAG: --system-cgroups=""
Jul 13 18:58:30.668846 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:30.660816    2563 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 13 18:58:30.668846 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:30.660823    2563 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 13 18:58:30.668846 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:30.660826    2563 flags.go:64] FLAG: --tls-cert-file=""
Jul 13 18:58:30.668846 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:30.660829    2563 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 13 18:58:30.668846 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:30.660833    2563 flags.go:64] FLAG: --tls-min-version=""
Jul 13 18:58:30.668846 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:30.660836    2563 flags.go:64] FLAG: --tls-private-key-file=""
Jul 13 18:58:30.668846 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:30.660838    2563 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 13 18:58:30.668846 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:30.660841    2563 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 13 18:58:30.668846 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:30.660844    2563 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 13 18:58:30.668846 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:30.660847    2563 flags.go:64] FLAG: --v="2"
Jul 13 18:58:30.668846 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:30.660851    2563 flags.go:64] FLAG: --version="false"
Jul 13 18:58:30.668846 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:30.660855    2563 flags.go:64] FLAG: --vmodule=""
Jul 13 18:58:30.670018 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:30.660858    2563 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 13 18:58:30.670018 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:30.660862    2563 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 13 18:58:30.670018 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.660986    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 13 18:58:30.670018 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.660990    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 13 18:58:30.670018 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.660993    2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 13 18:58:30.670018 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.660996    2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 13 18:58:30.670018 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.660999    2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 13 18:58:30.670018 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.661003    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 13 18:58:30.670018 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.661005    2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 13 18:58:30.670018 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.661008    2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 13 18:58:30.670018 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.661010    2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 13 18:58:30.670018 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.661013    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 13 18:58:30.670018 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.661015    2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 13 18:58:30.670018 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.661018    2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 13 18:58:30.670018 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.661022    2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 13 18:58:30.670018 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.661025    2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 13 18:58:30.670018 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.661028    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 13 18:58:30.670018 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.661031    2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 13 18:58:30.670018 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.661034    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 13 18:58:30.670792 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.661038    2563 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 13 18:58:30.670792 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.661041    2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 13 18:58:30.670792 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.661045    2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 13 18:58:30.670792 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.661048    2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 13 18:58:30.670792 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.661050    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 13 18:58:30.670792 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.661054    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 13 18:58:30.670792 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.661056    2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 13 18:58:30.670792 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.661059    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 13 18:58:30.670792 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.661061    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 13 18:58:30.670792 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.661064    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 13 18:58:30.670792 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.661066    2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 13 18:58:30.670792 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.661069    2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 13 18:58:30.670792 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.661073    2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 13 18:58:30.670792 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.661076    2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 13 18:58:30.670792 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.661079    2563 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 13 18:58:30.670792 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.661082    2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 13 18:58:30.670792 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.661084    2563 feature_gate.go:328] unrecognized feature gate: Example
Jul 13 18:58:30.670792 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.661087    2563 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 13 18:58:30.670792 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.661090    2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 13 18:58:30.670792 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.661092    2563 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 13 18:58:30.671283 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.661096    2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 13 18:58:30.671283 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.661098    2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 13 18:58:30.671283 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.661101    2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 13 18:58:30.671283 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.661104    2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 13 18:58:30.671283 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.661106    2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 13 18:58:30.671283 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.661109    2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 13 18:58:30.671283 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.661112    2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 13 18:58:30.671283 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.661115    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 13 18:58:30.671283 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.661117    2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 13 18:58:30.671283 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.661120    2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 13 18:58:30.671283 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.661123    2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 13 18:58:30.671283 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.661125    2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 13 18:58:30.671283 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.661128    2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 13 18:58:30.671283 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.661131    2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 13 18:58:30.671283 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.661134    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 13 18:58:30.671283 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.661137    2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 13 18:58:30.671283 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.661139    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 13 18:58:30.671283 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.661141    2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 13 18:58:30.671283 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.661144    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 13 18:58:30.671283 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.661146    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 13 18:58:30.671802 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.661148    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 13 18:58:30.671802 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.661151    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 13 18:58:30.671802 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.661153    2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 13 18:58:30.671802 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.661156    2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 13 18:58:30.671802 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.661158    2563 feature_gate.go:328] unrecognized feature gate: Example2
Jul 13 18:58:30.671802 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.661161    2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 13 18:58:30.671802 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.661163    2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 13 18:58:30.671802 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.661166    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 13 18:58:30.671802 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.661170    2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 13 18:58:30.671802 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.661173    2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 13 18:58:30.671802 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.661177    2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 13 18:58:30.671802 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.661179    2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 13 18:58:30.671802 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.661182    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 13 18:58:30.671802 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.661185    2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 13 18:58:30.671802 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.661187    2563 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 13 18:58:30.671802 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.661190    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 13 18:58:30.671802 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.661192    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 13 18:58:30.671802 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.661195    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 13 18:58:30.671802 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.661197    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 13 18:58:30.671802 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.661199    2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 13 18:58:30.672286 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.661202    2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 13 18:58:30.672286 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.661204    2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 13 18:58:30.672286 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.661207    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 13 18:58:30.672286 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.661209    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 13 18:58:30.672286 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.661211    2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 13 18:58:30.672286 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.661213    2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 13 18:58:30.672286 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.661216    2563 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 13 18:58:30.672286 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.661219    2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 13 18:58:30.672286 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.661221    2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 13 18:58:30.672286 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.661224    2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 13 18:58:30.672286 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.661226    2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 13 18:58:30.672286 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.661229    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 13 18:58:30.672286 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.661232    2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 13 18:58:30.672286 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.661234    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 13 18:58:30.672286 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.661236    2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 13 18:58:30.672286 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.661239    2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 13 18:58:30.672286 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.661241    2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 13 18:58:30.672286 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.661243    2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 13 18:58:30.672286 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.661246    2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 13 18:58:30.672757 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.661248    2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 13 18:58:30.672757 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.661250    2563 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 13 18:58:30.672757 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.661253    2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 13 18:58:30.672757 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:30.661258    2563 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 13 18:58:30.672757 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:30.671155    2563 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 13 18:58:30.672757 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:30.671173    2563 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 13 18:58:30.672757 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:30.671196    2563 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 13 18:58:30.672757 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:30.671202    2563 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 13 18:58:30.672757 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.671264    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 13 18:58:30.672757 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.671269    2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 13 18:58:30.672757 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.671273    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 13 18:58:30.672757 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.671277    2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 13 18:58:30.672757 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.671280    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 13 18:58:30.672757 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.671283    2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 13 18:58:30.672757 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.671286    2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 13 18:58:30.673123 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.671289    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 13 18:58:30.673123 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.671292    2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 13 18:58:30.673123 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.671295    2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 13 18:58:30.673123 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.671298    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 13 18:58:30.673123 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.671301    2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 13 18:58:30.673123 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.671304    2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 13 18:58:30.673123 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.671307    2563 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 13 18:58:30.673123 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.671310    2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 13 18:58:30.673123 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.671312    2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 13 18:58:30.673123 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.671315    2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 13 18:58:30.673123 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.671318    2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 13 18:58:30.673123 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.671320    2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 13 18:58:30.673123 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.671323    2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 13 18:58:30.673123 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.671326    2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 13 18:58:30.673123 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.671328    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 13 18:58:30.673123 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.671331    2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 13 18:58:30.673123 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.671333    2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 13 18:58:30.673123 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.671336    2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 13 18:58:30.673123 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.671339    2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 13 18:58:30.673123 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.671341    2563 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 13 18:58:30.673615 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.671344    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 13 18:58:30.673615 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.671347    2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 13 18:58:30.673615 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.671350    2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 13 18:58:30.673615 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.671353    2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 13 18:58:30.673615 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.671355    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 13 18:58:30.673615 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.671358    2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 13 18:58:30.673615 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.671361    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 13 18:58:30.673615 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.671364    2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 13 18:58:30.673615 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.671366    2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 13 18:58:30.673615 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.671369    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 13 18:58:30.673615 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.671371    2563 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 13 18:58:30.673615 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.671374    2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 13 18:58:30.673615 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.671376    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 13 18:58:30.673615 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.671380    2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 13 18:58:30.673615 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.671384    2563 feature_gate.go:328] unrecognized feature gate: Example
Jul 13 18:58:30.673615 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.671387    2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 13 18:58:30.673615 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.671390    2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 13 18:58:30.673615 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.671393    2563 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 13 18:58:30.673615 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.671396    2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 13 18:58:30.674064 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.671398    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 13 18:58:30.674064 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.671401    2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 13 18:58:30.674064 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.671404    2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 13 18:58:30.674064 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.671407    2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 13 18:58:30.674064 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.671410    2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 13 18:58:30.674064 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.671412    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 13 18:58:30.674064 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.671415    2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 13 18:58:30.674064 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.671418    2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 13 18:58:30.674064 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.671421    2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 13 18:58:30.674064 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.671424    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 13 18:58:30.674064 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.671427    2563 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 13 18:58:30.674064 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.671429    2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 13 18:58:30.674064 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.671432    2563 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 13 18:58:30.674064 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.671434    2563 feature_gate.go:328] unrecognized feature gate: Example2
Jul 13 18:58:30.674064 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.671437    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 13 18:58:30.674064 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.671439    2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 13 18:58:30.674064 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.671442    2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 13 18:58:30.674064 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.671445    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 13 18:58:30.674064 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.671448    2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 13 18:58:30.674064 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.671450    2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 13 18:58:30.674534 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.671453    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 13 18:58:30.674534 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.671455    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 13 18:58:30.674534 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.671458    2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 13 18:58:30.674534 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.671461    2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 13 18:58:30.674534 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.671463    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 13 18:58:30.674534 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.671467    2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 13 18:58:30.674534 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.671471    2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 13 18:58:30.674534 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.671474    2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 13 18:58:30.674534 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.671477    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 13 18:58:30.674534 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.671480    2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 13 18:58:30.674534 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.671483    2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 13 18:58:30.674534 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.671486    2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 13 18:58:30.674534 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.671489    2563 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 13 18:58:30.674534 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.671492    2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 13 18:58:30.674534 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.671496    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 13 18:58:30.674534 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.671499    2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 13 18:58:30.674534 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.671501    2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 13 18:58:30.674534 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.671504    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 13 18:58:30.674534 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.671507    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 13 18:58:30.674534 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.671509    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 13 18:58:30.675178 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.671512    2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 13 18:58:30.675178 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.671515    2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 13 18:58:30.675178 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.671517    2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 13 18:58:30.675178 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.671520    2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 13 18:58:30.675178 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.671522    2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 13 18:58:30.675178 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.671526    2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 13 18:58:30.675178 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.671529    2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 13 18:58:30.675178 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.671532    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 13 18:58:30.675178 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.671535    2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 13 18:58:30.675178 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.671538    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 13 18:58:30.675178 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.671541    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 13 18:58:30.675178 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.671544    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 13 18:58:30.675178 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.671546    2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 13 18:58:30.675178 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:30.671552    2563 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 13 18:58:30.675178 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.671710    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 13 18:58:30.675584 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.671716    2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 13 18:58:30.675584 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.671719    2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 13 18:58:30.675584 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.671722    2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 13 18:58:30.675584 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.671725    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 13 18:58:30.675584 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.671728    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 13 18:58:30.675584 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.671730    2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 13 18:58:30.675584 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.671733    2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 13 18:58:30.675584 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.671736    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 13 18:58:30.675584 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.671738    2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 13 18:58:30.675584 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.671741    2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 13 18:58:30.675584 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.671743    2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 13 18:58:30.675584 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.671747    2563 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 13 18:58:30.675584 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.671749    2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 13 18:58:30.675584 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.671752    2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 13 18:58:30.675584 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.671755    2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 13 18:58:30.675584 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.671757    2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 13 18:58:30.675584 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.671760    2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 13 18:58:30.675584 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.671762    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 13 18:58:30.675584 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.671765    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 13 18:58:30.675584 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.671767    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 13 18:58:30.676080 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.671769    2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 13 18:58:30.676080 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.671772    2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 13 18:58:30.676080 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.671775    2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 13 18:58:30.676080 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.671778    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 13 18:58:30.676080 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.671781    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 13 18:58:30.676080 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.671783    2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 13 18:58:30.676080 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.671786    2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 13 18:58:30.676080 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.671789    2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 13 18:58:30.676080 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.671792    2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 13 18:58:30.676080 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.671794    2563 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 13 18:58:30.676080 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.671797    2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 13 18:58:30.676080 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.671799    2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 13 18:58:30.676080 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.671802    2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 13 18:58:30.676080 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.671805    2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 13 18:58:30.676080 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.671807    2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 13 18:58:30.676080 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.671810    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 13 18:58:30.676080 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.671813    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 13 18:58:30.676080 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.671815    2563 feature_gate.go:328] unrecognized feature gate: Example
Jul 13 18:58:30.676080 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.671818    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 13 18:58:30.676524 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.671822    2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 13 18:58:30.676524 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.671826    2563 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 13 18:58:30.676524 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.671829    2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 13 18:58:30.676524 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.671844    2563 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 13 18:58:30.676524 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.671847    2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 13 18:58:30.676524 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.671851    2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 13 18:58:30.676524 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.671853    2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 13 18:58:30.676524 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.671856    2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 13 18:58:30.676524 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.671859    2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 13 18:58:30.676524 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.671861    2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 13 18:58:30.676524 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.671863    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 13 18:58:30.676524 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.671866    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 13 18:58:30.676524 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.671868    2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 13 18:58:30.676524 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.671870    2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 13 18:58:30.676524 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.671873    2563 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 13 18:58:30.676524 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.671876    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 13 18:58:30.676524 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.671880    2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 13 18:58:30.676524 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.671883    2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 13 18:58:30.676524 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.671886    2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 13 18:58:30.676524 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.671889    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 13 18:58:30.677012 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.671891    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 13 18:58:30.677012 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.671895    2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 13 18:58:30.677012 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.671897    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 13 18:58:30.677012 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.671900    2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 13 18:58:30.677012 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.671903    2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 13 18:58:30.677012 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.671905    2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 13 18:58:30.677012 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.671907    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 13 18:58:30.677012 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.671910    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 13 18:58:30.677012 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.671913    2563 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 13 18:58:30.677012 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.671915    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 13 18:58:30.677012 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.671918    2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 13 18:58:30.677012 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.671920    2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 13 18:58:30.677012 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.671923    2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 13 18:58:30.677012 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.671925    2563 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 13 18:58:30.677012 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.671928    2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 13 18:58:30.677012 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.671931    2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 13 18:58:30.677012 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.671934    2563 feature_gate.go:328] unrecognized feature gate: Example2
Jul 13 18:58:30.677012 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.671937    2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 13 18:58:30.677012 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.671940    2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 13 18:58:30.677012 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.671942    2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 13 18:58:30.677486 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.671945    2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 13 18:58:30.677486 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.671947    2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 13 18:58:30.677486 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.671950    2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 13 18:58:30.677486 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.671952    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 13 18:58:30.677486 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.671954    2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 13 18:58:30.677486 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.671957    2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 13 18:58:30.677486 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.671960    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 13 18:58:30.677486 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.671962    2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 13 18:58:30.677486 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.671965    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 13 18:58:30.677486 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.671967    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 13 18:58:30.677486 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.671970    2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 13 18:58:30.677486 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.671973    2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 13 18:58:30.677486 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.671976    2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 13 18:58:30.677486 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.671978    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 13 18:58:30.677486 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.671980    2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 13 18:58:30.677486 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.671983    2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 13 18:58:30.677486 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.671985    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 13 18:58:30.677486 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.671988    2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 13 18:58:30.677486 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:30.671990    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 13 18:58:30.677950 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:30.671994    2563 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 13 18:58:30.677950 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:30.672122    2563 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 13 18:58:30.677950 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:30.674334    2563 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 13 18:58:30.677950 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:30.675883    2563 server.go:1019] "Starting client certificate rotation"
Jul 13 18:58:30.677950 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:30.675989    2563 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 13 18:58:30.677950 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:30.676026    2563 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 13 18:58:30.679734 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:30.679719    2563 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 13 18:58:30.681021 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:30.681001    2563 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 13 18:58:30.693770 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:30.693746    2563 log.go:25] "Validated CRI v1 runtime API"
Jul 13 18:58:30.696053 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:30.696032    2563 log.go:25] "Validated CRI v1 image API"
Jul 13 18:58:30.699282 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:30.699258    2563 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 13 18:58:30.702286 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:30.702265    2563 fs.go:135] Filesystem UUIDs: map[4dfb6bd7-6060-4027-a9bd-8df73841abf7:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 c9a5cc49-2a39-4436-a6ee-2042e0268615:/dev/nvme0n1p3]
Jul 13 18:58:30.702338 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:30.702286    2563 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 13 18:58:30.708087 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:30.707965    2563 manager.go:216] Machine: {Timestamp:2026-07-13 18:58:30.706621904 +0000 UTC m=+0.340955865 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3257105 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2d3599ce0d41f83e13926a0b0bcb70 SystemUUID:ec2d3599-ce0d-41f8-3e13-926a0b0bcb70 BootID:6e4c5711-2ae9-4384-8e03-03b8aa131c90 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:d4:2f:f1:68:c5 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:d4:2f:f1:68:c5 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:12:2e:fb:59:7f:4c Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 13 18:58:30.708087 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:30.708082    2563 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 13 18:58:30.708217 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:30.708181    2563 manager.go:232] Version: {KernelVersion:5.14.0-570.126.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260702-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 13 18:58:30.710485 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:30.710464    2563 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 13 18:58:30.710917 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:30.710891    2563 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 13 18:58:30.711120 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:30.710925    2563 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-135-38.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 13 18:58:30.711733 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:30.711716    2563 topology_manager.go:138] "Creating topology manager with none policy"
Jul 13 18:58:30.711801 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:30.711739    2563 container_manager_linux.go:309] "Creating device plugin manager"
Jul 13 18:58:30.711801 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:30.711751    2563 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 13 18:58:30.712490 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:30.712477    2563 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 13 18:58:30.713321 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:30.713309    2563 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 13 18:58:30.716653 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:30.716637    2563 state_mem.go:36] "Initialized new in-memory state store"
Jul 13 18:58:30.716880 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:30.716867    2563 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 13 18:58:30.716944 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:30.716909    2563 kubelet.go:486] "Attempting to sync node with API server"
Jul 13 18:58:30.716944 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:30.716929    2563 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 13 18:58:30.717040 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:30.716955    2563 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 13 18:58:30.717040 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:30.717029    2563 kubelet.go:398] "Adding apiserver pod source"
Jul 13 18:58:30.717122 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:30.717056    2563 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 13 18:58:30.718159 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:30.718132    2563 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 13 18:58:30.718260 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:30.718249    2563 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 13 18:58:30.721938 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:30.721916    2563 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 13 18:58:30.723844 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:30.723816    2563 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 13 18:58:30.723915 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:30.723858    2563 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 13 18:58:30.724545 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:30.724530    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 13 18:58:30.724604 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:30.724550    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 13 18:58:30.724604 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:30.724580    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 13 18:58:30.724604 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:30.724588    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 13 18:58:30.724604 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:30.724597    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 13 18:58:30.724604 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:30.724603    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 13 18:58:30.724816 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:30.724808    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 13 18:58:30.724850 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:30.724817    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 13 18:58:30.724850 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:30.724824    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 13 18:58:30.724850 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:30.724830    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 13 18:58:30.724850 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:30.724840    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 13 18:58:30.724850 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:30.724848    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 13 18:58:30.725552 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:30.725543    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 13 18:58:30.725552 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:30.725552    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 13 18:58:30.728690 ip-10-0-135-38 kubenswrapper[2563]: E0713 18:58:30.728666    2563 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 13 18:58:30.728690 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:30.728683    2563 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-135-38.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 13 18:58:30.728870 ip-10-0-135-38 kubenswrapper[2563]: E0713 18:58:30.728851    2563 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-135-38.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 13 18:58:30.729210 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:30.729197    2563 server.go:1268] "Started kubelet"
Jul 13 18:58:30.729326 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:30.729288    2563 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 13 18:58:30.729386 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:30.729344    2563 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 13 18:58:30.729451 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:30.729406    2563 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 13 18:58:30.730585 ip-10-0-135-38 systemd[1]: Started Kubernetes Kubelet.
Jul 13 18:58:30.731814 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:30.731798    2563 server.go:310] "Adding debug handlers to kubelet server"
Jul 13 18:58:30.732178 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:30.732159    2563 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-fc9ms"
Jul 13 18:58:30.733810 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:30.733791    2563 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 13 18:58:30.734787 ip-10-0-135-38 kubenswrapper[2563]: E0713 18:58:30.734770    2563 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 13 18:58:30.736489 ip-10-0-135-38 kubenswrapper[2563]: E0713 18:58:30.735661    2563 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-135-38.ec2.internal.18c1ee744f481e6f  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-135-38.ec2.internal,UID:ip-10-0-135-38.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-135-38.ec2.internal,},FirstTimestamp:2026-07-13 18:58:30.729170543 +0000 UTC m=+0.363504512,LastTimestamp:2026-07-13 18:58:30.729170543 +0000 UTC m=+0.363504512,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-135-38.ec2.internal,}"
Jul 13 18:58:30.739594 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:30.739575    2563 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-fc9ms"
Jul 13 18:58:30.740941 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:30.740924    2563 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 13 18:58:30.741016 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:30.740958    2563 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 13 18:58:30.741610 ip-10-0-135-38 kubenswrapper[2563]: E0713 18:58:30.741592    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-38.ec2.internal\" not found"
Jul 13 18:58:30.741836 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:30.741761    2563 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 13 18:58:30.741836 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:30.741777    2563 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 13 18:58:30.741955 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:30.741922    2563 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 13 18:58:30.741998 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:30.741985    2563 reconstruct.go:97] "Volume reconstruction finished"
Jul 13 18:58:30.741998 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:30.741992    2563 reconciler.go:29] "Reconciler: start to sync state"
Jul 13 18:58:30.742575 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:30.742549    2563 factory.go:55] Registering systemd factory
Jul 13 18:58:30.742678 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:30.742579    2563 factory.go:223] Registration of the systemd container factory successfully
Jul 13 18:58:30.742859 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:30.742843    2563 factory.go:153] Registering CRI-O factory
Jul 13 18:58:30.742917 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:30.742861    2563 factory.go:223] Registration of the crio container factory successfully
Jul 13 18:58:30.742965 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:30.742932    2563 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 13 18:58:30.742965 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:30.742955    2563 factory.go:103] Registering Raw factory
Jul 13 18:58:30.743028 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:30.742973    2563 manager.go:1196] Started watching for new ooms in manager
Jul 13 18:58:30.743767 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:30.743752    2563 manager.go:349] Starting recovery of all containers
Jul 13 18:58:30.744414 ip-10-0-135-38 kubenswrapper[2563]: E0713 18:58:30.744383    2563 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 13 18:58:30.744511 ip-10-0-135-38 kubenswrapper[2563]: E0713 18:58:30.744488    2563 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-135-38.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 13 18:58:30.755326 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:30.755307    2563 manager.go:354] Recovery completed
Jul 13 18:58:30.759708 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:30.759503    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 13 18:58:30.764602 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:30.764585    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-38.ec2.internal" event="NodeHasSufficientMemory"
Jul 13 18:58:30.764666 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:30.764616    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-38.ec2.internal" event="NodeHasNoDiskPressure"
Jul 13 18:58:30.764666 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:30.764627    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-38.ec2.internal" event="NodeHasSufficientPID"
Jul 13 18:58:30.765165 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:30.765151    2563 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 13 18:58:30.765165 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:30.765165    2563 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 13 18:58:30.765259 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:30.765181    2563 state_mem.go:36] "Initialized new in-memory state store"
Jul 13 18:58:30.765259 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:30.765216    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 13 18:58:30.766118 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:30.766104    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-38.ec2.internal" event="NodeHasSufficientMemory"
Jul 13 18:58:30.766173 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:30.766127    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-38.ec2.internal" event="NodeHasNoDiskPressure"
Jul 13 18:58:30.766173 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:30.766136    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-38.ec2.internal" event="NodeHasSufficientPID"
Jul 13 18:58:30.766362 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:30.766351    2563 policy_none.go:49] "None policy: Start"
Jul 13 18:58:30.766394 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:30.766368    2563 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 13 18:58:30.766394 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:30.766378    2563 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 13 18:58:30.767637 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:30.767623    2563 policy_none.go:47] "Start"
Jul 13 18:58:30.809324 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:30.809297    2563 manager.go:337] "Starting Device Plugin manager"
Jul 13 18:58:30.824434 ip-10-0-135-38 kubenswrapper[2563]: E0713 18:58:30.809349    2563 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 13 18:58:30.824434 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:30.809361    2563 server.go:87] "Starting device plugin registration server"
Jul 13 18:58:30.824434 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:30.809693    2563 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 13 18:58:30.824434 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:30.809708    2563 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 13 18:58:30.824434 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:30.809813    2563 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 13 18:58:30.824434 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:30.809916    2563 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 13 18:58:30.824434 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:30.809923    2563 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 13 18:58:30.824434 ip-10-0-135-38 kubenswrapper[2563]: E0713 18:58:30.811198    2563 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 13 18:58:30.824434 ip-10-0-135-38 kubenswrapper[2563]: E0713 18:58:30.811248    2563 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-135-38.ec2.internal\" not found"
Jul 13 18:58:30.888623 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:30.888586    2563 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 13 18:58:30.889838 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:30.889807    2563 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 13 18:58:30.889838 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:30.889845    2563 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 13 18:58:30.890020 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:30.889870    2563 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 13 18:58:30.890020 ip-10-0-135-38 kubenswrapper[2563]: E0713 18:58:30.889903    2563 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 13 18:58:30.892329 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:30.892310    2563 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 13 18:58:30.910367 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:30.910297    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 13 18:58:30.911308 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:30.911287    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-38.ec2.internal" event="NodeHasSufficientMemory"
Jul 13 18:58:30.911425 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:30.911322    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-38.ec2.internal" event="NodeHasNoDiskPressure"
Jul 13 18:58:30.911425 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:30.911334    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-38.ec2.internal" event="NodeHasSufficientPID"
Jul 13 18:58:30.911425 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:30.911358    2563 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-135-38.ec2.internal"
Jul 13 18:58:30.919972 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:30.919955    2563 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-135-38.ec2.internal"
Jul 13 18:58:30.920061 ip-10-0-135-38 kubenswrapper[2563]: E0713 18:58:30.919978    2563 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-135-38.ec2.internal\": node \"ip-10-0-135-38.ec2.internal\" not found"
Jul 13 18:58:30.946573 ip-10-0-135-38 kubenswrapper[2563]: E0713 18:58:30.946533    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-38.ec2.internal\" not found"
Jul 13 18:58:30.991019 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:30.990960    2563 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-38.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-135-38.ec2.internal"]
Jul 13 18:58:30.991136 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:30.991068    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 13 18:58:30.992175 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:30.992154    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-38.ec2.internal" event="NodeHasSufficientMemory"
Jul 13 18:58:30.992286 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:30.992194    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-38.ec2.internal" event="NodeHasNoDiskPressure"
Jul 13 18:58:30.992286 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:30.992210    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-38.ec2.internal" event="NodeHasSufficientPID"
Jul 13 18:58:30.993690 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:30.993673    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 13 18:58:30.993792 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:30.993779    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-38.ec2.internal"
Jul 13 18:58:30.993829 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:30.993810    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 13 18:58:30.994439 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:30.994426    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-38.ec2.internal" event="NodeHasSufficientMemory"
Jul 13 18:58:30.994501 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:30.994442    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-38.ec2.internal" event="NodeHasSufficientMemory"
Jul 13 18:58:30.994501 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:30.994450    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-38.ec2.internal" event="NodeHasNoDiskPressure"
Jul 13 18:58:30.994501 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:30.994462    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-38.ec2.internal" event="NodeHasSufficientPID"
Jul 13 18:58:30.994501 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:30.994464    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-38.ec2.internal" event="NodeHasNoDiskPressure"
Jul 13 18:58:30.994501 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:30.994474    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-38.ec2.internal" event="NodeHasSufficientPID"
Jul 13 18:58:30.995702 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:30.995687    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-38.ec2.internal"
Jul 13 18:58:30.995752 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:30.995713    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 13 18:58:30.996396 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:30.996373    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-38.ec2.internal" event="NodeHasSufficientMemory"
Jul 13 18:58:30.996396 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:30.996393    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-38.ec2.internal" event="NodeHasNoDiskPressure"
Jul 13 18:58:30.996508 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:30.996408    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-38.ec2.internal" event="NodeHasSufficientPID"
Jul 13 18:58:31.018521 ip-10-0-135-38 kubenswrapper[2563]: E0713 18:58:31.018494    2563 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-135-38.ec2.internal\" not found" node="ip-10-0-135-38.ec2.internal"
Jul 13 18:58:31.023366 ip-10-0-135-38 kubenswrapper[2563]: E0713 18:58:31.023347    2563 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-135-38.ec2.internal\" not found" node="ip-10-0-135-38.ec2.internal"
Jul 13 18:58:31.043409 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:31.043375    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/588e76b45ba8b873b684c4e7e4822233-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-38.ec2.internal\" (UID: \"588e76b45ba8b873b684c4e7e4822233\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-38.ec2.internal"
Jul 13 18:58:31.043524 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:31.043418    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/588e76b45ba8b873b684c4e7e4822233-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-38.ec2.internal\" (UID: \"588e76b45ba8b873b684c4e7e4822233\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-38.ec2.internal"
Jul 13 18:58:31.043524 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:31.043482    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/9c30996778b0a4a51abebd056dde6bd9-config\") pod \"kube-apiserver-proxy-ip-10-0-135-38.ec2.internal\" (UID: \"9c30996778b0a4a51abebd056dde6bd9\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-38.ec2.internal"
Jul 13 18:58:31.047487 ip-10-0-135-38 kubenswrapper[2563]: E0713 18:58:31.047460    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-38.ec2.internal\" not found"
Jul 13 18:58:31.144447 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:31.144412    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/588e76b45ba8b873b684c4e7e4822233-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-38.ec2.internal\" (UID: \"588e76b45ba8b873b684c4e7e4822233\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-38.ec2.internal"
Jul 13 18:58:31.144447 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:31.144458    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/588e76b45ba8b873b684c4e7e4822233-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-38.ec2.internal\" (UID: \"588e76b45ba8b873b684c4e7e4822233\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-38.ec2.internal"
Jul 13 18:58:31.144698 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:31.144482    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/9c30996778b0a4a51abebd056dde6bd9-config\") pod \"kube-apiserver-proxy-ip-10-0-135-38.ec2.internal\" (UID: \"9c30996778b0a4a51abebd056dde6bd9\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-38.ec2.internal"
Jul 13 18:58:31.144698 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:31.144525    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/588e76b45ba8b873b684c4e7e4822233-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-38.ec2.internal\" (UID: \"588e76b45ba8b873b684c4e7e4822233\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-38.ec2.internal"
Jul 13 18:58:31.144698 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:31.144534    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/588e76b45ba8b873b684c4e7e4822233-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-38.ec2.internal\" (UID: \"588e76b45ba8b873b684c4e7e4822233\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-38.ec2.internal"
Jul 13 18:58:31.144698 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:31.144533    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/9c30996778b0a4a51abebd056dde6bd9-config\") pod \"kube-apiserver-proxy-ip-10-0-135-38.ec2.internal\" (UID: \"9c30996778b0a4a51abebd056dde6bd9\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-38.ec2.internal"
Jul 13 18:58:31.148511 ip-10-0-135-38 kubenswrapper[2563]: E0713 18:58:31.148497    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-38.ec2.internal\" not found"
Jul 13 18:58:31.249474 ip-10-0-135-38 kubenswrapper[2563]: E0713 18:58:31.249435    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-38.ec2.internal\" not found"
Jul 13 18:58:31.322717 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:31.322680    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-38.ec2.internal"
Jul 13 18:58:31.325861 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:31.325842    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-38.ec2.internal"
Jul 13 18:58:31.350576 ip-10-0-135-38 kubenswrapper[2563]: E0713 18:58:31.350528    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-38.ec2.internal\" not found"
Jul 13 18:58:31.451122 ip-10-0-135-38 kubenswrapper[2563]: E0713 18:58:31.451065    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-38.ec2.internal\" not found"
Jul 13 18:58:31.551665 ip-10-0-135-38 kubenswrapper[2563]: E0713 18:58:31.551578    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-38.ec2.internal\" not found"
Jul 13 18:58:31.652268 ip-10-0-135-38 kubenswrapper[2563]: E0713 18:58:31.652237    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-38.ec2.internal\" not found"
Jul 13 18:58:31.675451 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:31.675414    2563 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 13 18:58:31.675643 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:31.675618    2563 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 13 18:58:31.744144 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:31.744096    2563 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-12 18:53:32 +0000 UTC" deadline="2027-12-26 14:13:41.82518412 +0000 UTC"
Jul 13 18:58:31.744144 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:31.744126    2563 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12739h15m10.081061076s"
Jul 13 18:58:31.752490 ip-10-0-135-38 kubenswrapper[2563]: E0713 18:58:31.752459    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-38.ec2.internal\" not found"
Jul 13 18:58:31.853251 ip-10-0-135-38 kubenswrapper[2563]: E0713 18:58:31.853216    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-38.ec2.internal\" not found"
Jul 13 18:58:31.890597 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:31.890543    2563 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 13 18:58:31.953312 ip-10-0-135-38 kubenswrapper[2563]: E0713 18:58:31.953278    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-38.ec2.internal\" not found"
Jul 13 18:58:31.953484 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:31.953402    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod588e76b45ba8b873b684c4e7e4822233.slice/crio-a9dc280ab46bf3f6ecf32d327289c1307f305d60da4006cef46349e0b1a2a2d6 WatchSource:0}: Error finding container a9dc280ab46bf3f6ecf32d327289c1307f305d60da4006cef46349e0b1a2a2d6: Status 404 returned error can't find the container with id a9dc280ab46bf3f6ecf32d327289c1307f305d60da4006cef46349e0b1a2a2d6
Jul 13 18:58:31.953697 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:31.953679    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9c30996778b0a4a51abebd056dde6bd9.slice/crio-eaca3e06f6981131173ee5b81a47f5673c63d644d9a557b59e9496ba8a2f16aa WatchSource:0}: Error finding container eaca3e06f6981131173ee5b81a47f5673c63d644d9a557b59e9496ba8a2f16aa: Status 404 returned error can't find the container with id eaca3e06f6981131173ee5b81a47f5673c63d644d9a557b59e9496ba8a2f16aa
Jul 13 18:58:31.957507 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:31.957486    2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 13 18:58:31.984620 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:31.984593    2563 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 13 18:58:32.043056 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:32.043005    2563 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-38.ec2.internal"
Jul 13 18:58:32.055030 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:32.054999    2563 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 13 18:58:32.056921 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:32.056905    2563 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-38.ec2.internal"
Jul 13 18:58:32.066258 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:32.066234    2563 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 13 18:58:32.082080 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:32.082006    2563 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 13 18:58:32.718171 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:32.718134    2563 apiserver.go:52] "Watching apiserver"
Jul 13 18:58:32.723590 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:32.723549    2563 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 13 18:58:32.724904 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:32.724878    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-b7ptz","openshift-cluster-node-tuning-operator/tuned-tvnk8","openshift-dns/node-resolver-jrzv2","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-38.ec2.internal","openshift-multus/multus-additional-cni-plugins-nkdq7","openshift-multus/network-metrics-daemon-8hrpw","openshift-network-diagnostics/network-check-target-vbjkv","openshift-ovn-kubernetes/ovnkube-node-hwqhc","kube-system/konnectivity-agent-n59kb","kube-system/kube-apiserver-proxy-ip-10-0-135-38.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9dvlb","openshift-image-registry/node-ca-ghl52","openshift-multus/multus-tm4bj","openshift-network-operator/iptables-alerter-mrdlq"]
Jul 13 18:58:32.728749 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:32.728728    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-tm4bj"
Jul 13 18:58:32.730941 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:32.730915    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-tvnk8"
Jul 13 18:58:32.731258 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:32.731225    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 13 18:58:32.731344 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:32.731277    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 13 18:58:32.731344 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:32.731249    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 13 18:58:32.731344 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:32.731327    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-lk2dz\""
Jul 13 18:58:32.731530 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:32.731398    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 13 18:58:32.732507 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:32.732485    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 13 18:58:32.732938 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:32.732918    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 13 18:58:32.733028 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:32.732937    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-lsnbz\""
Jul 13 18:58:32.733086 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:32.733067    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-jrzv2"
Jul 13 18:58:32.735258 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:32.735239    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b7ptz"
Jul 13 18:58:32.735352 ip-10-0-135-38 kubenswrapper[2563]: E0713 18:58:32.735329    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b7ptz" podUID="aba89b91-cc04-4c11-8692-1c17006f5f7a"
Jul 13 18:58:32.736092 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:32.736078    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 13 18:58:32.736169 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:32.736151    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-fmmcw\""
Jul 13 18:58:32.736211 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:32.736173    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 13 18:58:32.738062 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:32.738043    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-nkdq7"
Jul 13 18:58:32.739830 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:32.739811    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-kgz75\""
Jul 13 18:58:32.740294 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:32.740278    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 13 18:58:32.740364 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:32.740278    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 13 18:58:32.740411 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:32.740379    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8hrpw"
Jul 13 18:58:32.740460 ip-10-0-135-38 kubenswrapper[2563]: E0713 18:58:32.740445    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8hrpw" podUID="02bf7c85-7eab-4d14-8e16-562c3ee29573"
Jul 13 18:58:32.741410 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:32.741391    2563 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 13 18:58:32.742592 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:32.742573    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vbjkv"
Jul 13 18:58:32.742746 ip-10-0-135-38 kubenswrapper[2563]: E0713 18:58:32.742716    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vbjkv" podUID="c72f59c6-8ebc-447d-8b92-096dac42859f"
Jul 13 18:58:32.745120 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:32.745102    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-hwqhc"
Jul 13 18:58:32.747546 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:32.747517    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-n59kb"
Jul 13 18:58:32.748343 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:32.748316    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 13 18:58:32.750451 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:32.748632    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 13 18:58:32.750451 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:32.748656    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 13 18:58:32.750451 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:32.748698    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 13 18:58:32.750451 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:32.749115    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 13 18:58:32.750451 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:32.749142    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 13 18:58:32.750451 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:32.749428    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-8k96r\""
Jul 13 18:58:32.751922 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:32.751905    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-mrdlq"
Jul 13 18:58:32.752176 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:32.752159    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 13 18:58:32.752543 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:32.752523    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 13 18:58:32.752955 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:32.752938    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/09aa4086-5243-477a-aa13-3b0c054d764a-tmp-dir\") pod \"node-resolver-jrzv2\" (UID: \"09aa4086-5243-477a-aa13-3b0c054d764a\") " pod="openshift-dns/node-resolver-jrzv2"
Jul 13 18:58:32.753016 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:32.752970    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/aba89b91-cc04-4c11-8692-1c17006f5f7a-original-pull-secret\") pod \"global-pull-secret-syncer-b7ptz\" (UID: \"aba89b91-cc04-4c11-8692-1c17006f5f7a\") " pod="kube-system/global-pull-secret-syncer-b7ptz"
Jul 13 18:58:32.753016 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:32.752996    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lc2ff\" (UniqueName: \"kubernetes.io/projected/c72f59c6-8ebc-447d-8b92-096dac42859f-kube-api-access-lc2ff\") pod \"network-check-target-vbjkv\" (UID: \"c72f59c6-8ebc-447d-8b92-096dac42859f\") " pod="openshift-network-diagnostics/network-check-target-vbjkv"
Jul 13 18:58:32.753082 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:32.753019    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b26f5a70-1ec7-4056-9658-25878216543f-os-release\") pod \"multus-additional-cni-plugins-nkdq7\" (UID: \"b26f5a70-1ec7-4056-9658-25878216543f\") " pod="openshift-multus/multus-additional-cni-plugins-nkdq7"
Jul 13 18:58:32.753082 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:32.753021    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-5rpcd\""
Jul 13 18:58:32.753082 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:32.753042    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/4193271d-0ed3-4ea0-8b78-fcfe94025f66-etc-sysctl-d\") pod \"tuned-tvnk8\" (UID: \"4193271d-0ed3-4ea0-8b78-fcfe94025f66\") " pod="openshift-cluster-node-tuning-operator/tuned-tvnk8"
Jul 13 18:58:32.753082 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:32.753073    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ptp8q\" (UniqueName: \"kubernetes.io/projected/4193271d-0ed3-4ea0-8b78-fcfe94025f66-kube-api-access-ptp8q\") pod \"tuned-tvnk8\" (UID: \"4193271d-0ed3-4ea0-8b78-fcfe94025f66\") " pod="openshift-cluster-node-tuning-operator/tuned-tvnk8"
Jul 13 18:58:32.753195 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:32.753088    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lsvrm\" (UniqueName: \"kubernetes.io/projected/09aa4086-5243-477a-aa13-3b0c054d764a-kube-api-access-lsvrm\") pod \"node-resolver-jrzv2\" (UID: \"09aa4086-5243-477a-aa13-3b0c054d764a\") " pod="openshift-dns/node-resolver-jrzv2"
Jul 13 18:58:32.753195 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:32.753110    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b26f5a70-1ec7-4056-9658-25878216543f-tuning-conf-dir\") pod \"multus-additional-cni-plugins-nkdq7\" (UID: \"b26f5a70-1ec7-4056-9658-25878216543f\") " pod="openshift-multus/multus-additional-cni-plugins-nkdq7"
Jul 13 18:58:32.753195 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:32.753129    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/02bf7c85-7eab-4d14-8e16-562c3ee29573-metrics-certs\") pod \"network-metrics-daemon-8hrpw\" (UID: \"02bf7c85-7eab-4d14-8e16-562c3ee29573\") " pod="openshift-multus/network-metrics-daemon-8hrpw"
Jul 13 18:58:32.753195 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:32.753149    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/dea817c3-e510-4cf3-86ef-852930ad3466-multus-socket-dir-parent\") pod \"multus-tm4bj\" (UID: \"dea817c3-e510-4cf3-86ef-852930ad3466\") " pod="openshift-multus/multus-tm4bj"
Jul 13 18:58:32.753195 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:32.753171    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/dea817c3-e510-4cf3-86ef-852930ad3466-host-var-lib-cni-multus\") pod \"multus-tm4bj\" (UID: \"dea817c3-e510-4cf3-86ef-852930ad3466\") " pod="openshift-multus/multus-tm4bj"
Jul 13 18:58:32.753401 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:32.753195    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/dea817c3-e510-4cf3-86ef-852930ad3466-hostroot\") pod \"multus-tm4bj\" (UID: \"dea817c3-e510-4cf3-86ef-852930ad3466\") " pod="openshift-multus/multus-tm4bj"
Jul 13 18:58:32.753401 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:32.753218    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/dea817c3-e510-4cf3-86ef-852930ad3466-host-run-multus-certs\") pod \"multus-tm4bj\" (UID: \"dea817c3-e510-4cf3-86ef-852930ad3466\") " pod="openshift-multus/multus-tm4bj"
Jul 13 18:58:32.753401 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:32.753240    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4193271d-0ed3-4ea0-8b78-fcfe94025f66-var-lib-kubelet\") pod \"tuned-tvnk8\" (UID: \"4193271d-0ed3-4ea0-8b78-fcfe94025f66\") " pod="openshift-cluster-node-tuning-operator/tuned-tvnk8"
Jul 13 18:58:32.753401 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:32.753261    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/4193271d-0ed3-4ea0-8b78-fcfe94025f66-etc-tuned\") pod \"tuned-tvnk8\" (UID: \"4193271d-0ed3-4ea0-8b78-fcfe94025f66\") " pod="openshift-cluster-node-tuning-operator/tuned-tvnk8"
Jul 13 18:58:32.753401 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:32.753287    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/dea817c3-e510-4cf3-86ef-852930ad3466-host-run-k8s-cni-cncf-io\") pod \"multus-tm4bj\" (UID: \"dea817c3-e510-4cf3-86ef-852930ad3466\") " pod="openshift-multus/multus-tm4bj"
Jul 13 18:58:32.753401 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:32.753310    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/dea817c3-e510-4cf3-86ef-852930ad3466-host-var-lib-cni-bin\") pod \"multus-tm4bj\" (UID: \"dea817c3-e510-4cf3-86ef-852930ad3466\") " pod="openshift-multus/multus-tm4bj"
Jul 13 18:58:32.753401 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:32.753327    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b26f5a70-1ec7-4056-9658-25878216543f-cnibin\") pod \"multus-additional-cni-plugins-nkdq7\" (UID: \"b26f5a70-1ec7-4056-9658-25878216543f\") " pod="openshift-multus/multus-additional-cni-plugins-nkdq7"
Jul 13 18:58:32.753401 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:32.753375    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/b26f5a70-1ec7-4056-9658-25878216543f-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-nkdq7\" (UID: \"b26f5a70-1ec7-4056-9658-25878216543f\") " pod="openshift-multus/multus-additional-cni-plugins-nkdq7"
Jul 13 18:58:32.753717 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:32.753420    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6mnc9\" (UniqueName: \"kubernetes.io/projected/b26f5a70-1ec7-4056-9658-25878216543f-kube-api-access-6mnc9\") pod \"multus-additional-cni-plugins-nkdq7\" (UID: \"b26f5a70-1ec7-4056-9658-25878216543f\") " pod="openshift-multus/multus-additional-cni-plugins-nkdq7"
Jul 13 18:58:32.753717 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:32.753452    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/dea817c3-e510-4cf3-86ef-852930ad3466-system-cni-dir\") pod \"multus-tm4bj\" (UID: \"dea817c3-e510-4cf3-86ef-852930ad3466\") " pod="openshift-multus/multus-tm4bj"
Jul 13 18:58:32.753717 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:32.753476    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/dea817c3-e510-4cf3-86ef-852930ad3466-multus-cni-dir\") pod \"multus-tm4bj\" (UID: \"dea817c3-e510-4cf3-86ef-852930ad3466\") " pod="openshift-multus/multus-tm4bj"
Jul 13 18:58:32.753717 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:32.753498    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/dea817c3-e510-4cf3-86ef-852930ad3466-cni-binary-copy\") pod \"multus-tm4bj\" (UID: \"dea817c3-e510-4cf3-86ef-852930ad3466\") " pod="openshift-multus/multus-tm4bj"
Jul 13 18:58:32.753717 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:32.753521    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/dea817c3-e510-4cf3-86ef-852930ad3466-host-run-netns\") pod \"multus-tm4bj\" (UID: \"dea817c3-e510-4cf3-86ef-852930ad3466\") " pod="openshift-multus/multus-tm4bj"
Jul 13 18:58:32.753717 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:32.753542    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/4193271d-0ed3-4ea0-8b78-fcfe94025f66-etc-modprobe-d\") pod \"tuned-tvnk8\" (UID: \"4193271d-0ed3-4ea0-8b78-fcfe94025f66\") " pod="openshift-cluster-node-tuning-operator/tuned-tvnk8"
Jul 13 18:58:32.753717 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:32.753591    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/4193271d-0ed3-4ea0-8b78-fcfe94025f66-etc-systemd\") pod \"tuned-tvnk8\" (UID: \"4193271d-0ed3-4ea0-8b78-fcfe94025f66\") " pod="openshift-cluster-node-tuning-operator/tuned-tvnk8"
Jul 13 18:58:32.753717 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:32.753617    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4193271d-0ed3-4ea0-8b78-fcfe94025f66-lib-modules\") pod \"tuned-tvnk8\" (UID: \"4193271d-0ed3-4ea0-8b78-fcfe94025f66\") " pod="openshift-cluster-node-tuning-operator/tuned-tvnk8"
Jul 13 18:58:32.753717 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:32.753633    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4193271d-0ed3-4ea0-8b78-fcfe94025f66-etc-kubernetes\") pod \"tuned-tvnk8\" (UID: \"4193271d-0ed3-4ea0-8b78-fcfe94025f66\") " pod="openshift-cluster-node-tuning-operator/tuned-tvnk8"
Jul 13 18:58:32.753717 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:32.753652    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4193271d-0ed3-4ea0-8b78-fcfe94025f66-tmp\") pod \"tuned-tvnk8\" (UID: \"4193271d-0ed3-4ea0-8b78-fcfe94025f66\") " pod="openshift-cluster-node-tuning-operator/tuned-tvnk8"
Jul 13 18:58:32.753717 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:32.753677    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/09aa4086-5243-477a-aa13-3b0c054d764a-hosts-file\") pod \"node-resolver-jrzv2\" (UID: \"09aa4086-5243-477a-aa13-3b0c054d764a\") " pod="openshift-dns/node-resolver-jrzv2"
Jul 13 18:58:32.753717 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:32.753704    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/aba89b91-cc04-4c11-8692-1c17006f5f7a-kubelet-config\") pod \"global-pull-secret-syncer-b7ptz\" (UID: \"aba89b91-cc04-4c11-8692-1c17006f5f7a\") " pod="kube-system/global-pull-secret-syncer-b7ptz"
Jul 13 18:58:32.754043 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:32.753727    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/aba89b91-cc04-4c11-8692-1c17006f5f7a-dbus\") pod \"global-pull-secret-syncer-b7ptz\" (UID: \"aba89b91-cc04-4c11-8692-1c17006f5f7a\") " pod="kube-system/global-pull-secret-syncer-b7ptz"
Jul 13 18:58:32.754043 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:32.753751    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b26f5a70-1ec7-4056-9658-25878216543f-system-cni-dir\") pod \"multus-additional-cni-plugins-nkdq7\" (UID: \"b26f5a70-1ec7-4056-9658-25878216543f\") " pod="openshift-multus/multus-additional-cni-plugins-nkdq7"
Jul 13 18:58:32.754043 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:32.753772    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b26f5a70-1ec7-4056-9658-25878216543f-cni-binary-copy\") pod \"multus-additional-cni-plugins-nkdq7\" (UID: \"b26f5a70-1ec7-4056-9658-25878216543f\") " pod="openshift-multus/multus-additional-cni-plugins-nkdq7"
Jul 13 18:58:32.754043 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:32.753787    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/dea817c3-e510-4cf3-86ef-852930ad3466-cnibin\") pod \"multus-tm4bj\" (UID: \"dea817c3-e510-4cf3-86ef-852930ad3466\") " pod="openshift-multus/multus-tm4bj"
Jul 13 18:58:32.754043 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:32.753810    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/dea817c3-e510-4cf3-86ef-852930ad3466-os-release\") pod \"multus-tm4bj\" (UID: \"dea817c3-e510-4cf3-86ef-852930ad3466\") " pod="openshift-multus/multus-tm4bj"
Jul 13 18:58:32.754043 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:32.753837    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/dea817c3-e510-4cf3-86ef-852930ad3466-etc-kubernetes\") pod \"multus-tm4bj\" (UID: \"dea817c3-e510-4cf3-86ef-852930ad3466\") " pod="openshift-multus/multus-tm4bj"
Jul 13 18:58:32.754043 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:32.753859    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/4193271d-0ed3-4ea0-8b78-fcfe94025f66-etc-sysctl-conf\") pod \"tuned-tvnk8\" (UID: \"4193271d-0ed3-4ea0-8b78-fcfe94025f66\") " pod="openshift-cluster-node-tuning-operator/tuned-tvnk8"
Jul 13 18:58:32.754043 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:32.753880    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4193271d-0ed3-4ea0-8b78-fcfe94025f66-sys\") pod \"tuned-tvnk8\" (UID: \"4193271d-0ed3-4ea0-8b78-fcfe94025f66\") " pod="openshift-cluster-node-tuning-operator/tuned-tvnk8"
Jul 13 18:58:32.754043 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:32.753901    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4193271d-0ed3-4ea0-8b78-fcfe94025f66-host\") pod \"tuned-tvnk8\" (UID: \"4193271d-0ed3-4ea0-8b78-fcfe94025f66\") " pod="openshift-cluster-node-tuning-operator/tuned-tvnk8"
Jul 13 18:58:32.754043 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:32.753928    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-df5h4\" (UniqueName: \"kubernetes.io/projected/02bf7c85-7eab-4d14-8e16-562c3ee29573-kube-api-access-df5h4\") pod \"network-metrics-daemon-8hrpw\" (UID: \"02bf7c85-7eab-4d14-8e16-562c3ee29573\") " pod="openshift-multus/network-metrics-daemon-8hrpw"
Jul 13 18:58:32.754043 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:32.753945    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/dea817c3-e510-4cf3-86ef-852930ad3466-multus-conf-dir\") pod \"multus-tm4bj\" (UID: \"dea817c3-e510-4cf3-86ef-852930ad3466\") " pod="openshift-multus/multus-tm4bj"
Jul 13 18:58:32.754043 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:32.753959    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/dea817c3-e510-4cf3-86ef-852930ad3466-multus-daemon-config\") pod \"multus-tm4bj\" (UID: \"dea817c3-e510-4cf3-86ef-852930ad3466\") " pod="openshift-multus/multus-tm4bj"
Jul 13 18:58:32.754043 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:32.753972    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/4193271d-0ed3-4ea0-8b78-fcfe94025f66-run\") pod \"tuned-tvnk8\" (UID: \"4193271d-0ed3-4ea0-8b78-fcfe94025f66\") " pod="openshift-cluster-node-tuning-operator/tuned-tvnk8"
Jul 13 18:58:32.754043 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:32.753985    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/b26f5a70-1ec7-4056-9658-25878216543f-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-nkdq7\" (UID: \"b26f5a70-1ec7-4056-9658-25878216543f\") " pod="openshift-multus/multus-additional-cni-plugins-nkdq7"
Jul 13 18:58:32.754043 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:32.753999    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/dea817c3-e510-4cf3-86ef-852930ad3466-host-var-lib-kubelet\") pod \"multus-tm4bj\" (UID: \"dea817c3-e510-4cf3-86ef-852930ad3466\") " pod="openshift-multus/multus-tm4bj"
Jul 13 18:58:32.754043 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:32.754013    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k78gz\" (UniqueName: \"kubernetes.io/projected/dea817c3-e510-4cf3-86ef-852930ad3466-kube-api-access-k78gz\") pod \"multus-tm4bj\" (UID: \"dea817c3-e510-4cf3-86ef-852930ad3466\") " pod="openshift-multus/multus-tm4bj"
Jul 13 18:58:32.754043 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:32.754031    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/4193271d-0ed3-4ea0-8b78-fcfe94025f66-etc-sysconfig\") pod \"tuned-tvnk8\" (UID: \"4193271d-0ed3-4ea0-8b78-fcfe94025f66\") " pod="openshift-cluster-node-tuning-operator/tuned-tvnk8"
Jul 13 18:58:32.754713 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:32.754413    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9dvlb"
Jul 13 18:58:32.756247 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:32.756231    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 13 18:58:32.756427 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:32.756413    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 13 18:58:32.756477 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:32.756423    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-hph7t\""
Jul 13 18:58:32.756477 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:32.756415    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 13 18:58:32.756865 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:32.756848    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-ghl52"
Jul 13 18:58:32.759295 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:32.759275    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 13 18:58:32.759417 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:32.759397    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 13 18:58:32.759478 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:32.759463    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 13 18:58:32.759517 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:32.759494    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-fs6zk\""
Jul 13 18:58:32.759772 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:32.759759    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 13 18:58:32.759928 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:32.759910    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 13 18:58:32.760007 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:32.759937    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 13 18:58:32.760056 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:32.760004    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-g6n5d\""
Jul 13 18:58:32.764573 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:32.764545    2563 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 13 18:58:32.787472 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:32.787451    2563 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-fbjs4"
Jul 13 18:58:32.799648 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:32.799623    2563 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-fbjs4"
Jul 13 18:58:32.843355 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:32.843318    2563 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 13 18:58:32.855095 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:32.855066    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7ae2e1d0-8a16-4821-9cb7-353862cfbec8-host-slash\") pod \"ovnkube-node-hwqhc\" (UID: \"7ae2e1d0-8a16-4821-9cb7-353862cfbec8\") " pod="openshift-ovn-kubernetes/ovnkube-node-hwqhc"
Jul 13 18:58:32.855209 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:32.855106    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-df5h4\" (UniqueName: \"kubernetes.io/projected/02bf7c85-7eab-4d14-8e16-562c3ee29573-kube-api-access-df5h4\") pod \"network-metrics-daemon-8hrpw\" (UID: \"02bf7c85-7eab-4d14-8e16-562c3ee29573\") " pod="openshift-multus/network-metrics-daemon-8hrpw"
Jul 13 18:58:32.855209 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:32.855128    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4193271d-0ed3-4ea0-8b78-fcfe94025f66-etc-kubernetes\") pod \"tuned-tvnk8\" (UID: \"4193271d-0ed3-4ea0-8b78-fcfe94025f66\") " pod="openshift-cluster-node-tuning-operator/tuned-tvnk8"
Jul 13 18:58:32.855209 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:32.855144    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/07b6332f-faaf-46f8-9959-f74468d61647-iptables-alerter-script\") pod \"iptables-alerter-mrdlq\" (UID: \"07b6332f-faaf-46f8-9959-f74468d61647\") " pod="openshift-network-operator/iptables-alerter-mrdlq"
Jul 13 18:58:32.855351 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:32.855255    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7ae2e1d0-8a16-4821-9cb7-353862cfbec8-run-openvswitch\") pod \"ovnkube-node-hwqhc\" (UID: \"7ae2e1d0-8a16-4821-9cb7-353862cfbec8\") " pod="openshift-ovn-kubernetes/ovnkube-node-hwqhc"
Jul 13 18:58:32.855351 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:32.855272    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4193271d-0ed3-4ea0-8b78-fcfe94025f66-etc-kubernetes\") pod \"tuned-tvnk8\" (UID: \"4193271d-0ed3-4ea0-8b78-fcfe94025f66\") " pod="openshift-cluster-node-tuning-operator/tuned-tvnk8"
Jul 13 18:58:32.855351 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:32.855300    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/dea817c3-e510-4cf3-86ef-852930ad3466-cnibin\") pod \"multus-tm4bj\" (UID: \"dea817c3-e510-4cf3-86ef-852930ad3466\") " pod="openshift-multus/multus-tm4bj"
Jul 13 18:58:32.855351 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:32.855335    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/dea817c3-e510-4cf3-86ef-852930ad3466-os-release\") pod \"multus-tm4bj\" (UID: \"dea817c3-e510-4cf3-86ef-852930ad3466\") " pod="openshift-multus/multus-tm4bj"
Jul 13 18:58:32.855523 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:32.855358    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/dea817c3-e510-4cf3-86ef-852930ad3466-etc-kubernetes\") pod \"multus-tm4bj\" (UID: \"dea817c3-e510-4cf3-86ef-852930ad3466\") " pod="openshift-multus/multus-tm4bj"
Jul 13 18:58:32.855523 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:32.855398    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4193271d-0ed3-4ea0-8b78-fcfe94025f66-sys\") pod \"tuned-tvnk8\" (UID: \"4193271d-0ed3-4ea0-8b78-fcfe94025f66\") " pod="openshift-cluster-node-tuning-operator/tuned-tvnk8"
Jul 13 18:58:32.855523 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:32.855406    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/dea817c3-e510-4cf3-86ef-852930ad3466-cnibin\") pod \"multus-tm4bj\" (UID: \"dea817c3-e510-4cf3-86ef-852930ad3466\") " pod="openshift-multus/multus-tm4bj"
Jul 13 18:58:32.855523 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:32.855433    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/7ae2e1d0-8a16-4821-9cb7-353862cfbec8-ovnkube-script-lib\") pod \"ovnkube-node-hwqhc\" (UID: \"7ae2e1d0-8a16-4821-9cb7-353862cfbec8\") " pod="openshift-ovn-kubernetes/ovnkube-node-hwqhc"
Jul 13 18:58:32.855523 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:32.855441    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/dea817c3-e510-4cf3-86ef-852930ad3466-os-release\") pod \"multus-tm4bj\" (UID: \"dea817c3-e510-4cf3-86ef-852930ad3466\") " pod="openshift-multus/multus-tm4bj"
Jul 13 18:58:32.855523 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:32.855453    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/dea817c3-e510-4cf3-86ef-852930ad3466-etc-kubernetes\") pod \"multus-tm4bj\" (UID: \"dea817c3-e510-4cf3-86ef-852930ad3466\") " pod="openshift-multus/multus-tm4bj"
Jul 13 18:58:32.855523 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:32.855503    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4193271d-0ed3-4ea0-8b78-fcfe94025f66-sys\") pod \"tuned-tvnk8\" (UID: \"4193271d-0ed3-4ea0-8b78-fcfe94025f66\") " pod="openshift-cluster-node-tuning-operator/tuned-tvnk8"
Jul 13 18:58:32.855523 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:32.855488    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/dea817c3-e510-4cf3-86ef-852930ad3466-multus-daemon-config\") pod \"multus-tm4bj\" (UID: \"dea817c3-e510-4cf3-86ef-852930ad3466\") " pod="openshift-multus/multus-tm4bj"
Jul 13 18:58:32.855948 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:32.855545    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/4193271d-0ed3-4ea0-8b78-fcfe94025f66-run\") pod \"tuned-tvnk8\" (UID: \"4193271d-0ed3-4ea0-8b78-fcfe94025f66\") " pod="openshift-cluster-node-tuning-operator/tuned-tvnk8"
Jul 13 18:58:32.855948 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:32.855586    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/b26f5a70-1ec7-4056-9658-25878216543f-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-nkdq7\" (UID: \"b26f5a70-1ec7-4056-9658-25878216543f\") " pod="openshift-multus/multus-additional-cni-plugins-nkdq7"
Jul 13 18:58:32.855948 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:32.855613    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/7223a804-aca6-480f-9443-f129f82d33b5-agent-certs\") pod \"konnectivity-agent-n59kb\" (UID: \"7223a804-aca6-480f-9443-f129f82d33b5\") " pod="kube-system/konnectivity-agent-n59kb"
Jul 13 18:58:32.855948 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:32.855634    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7ae2e1d0-8a16-4821-9cb7-353862cfbec8-var-lib-openvswitch\") pod \"ovnkube-node-hwqhc\" (UID: \"7ae2e1d0-8a16-4821-9cb7-353862cfbec8\") " pod="openshift-ovn-kubernetes/ovnkube-node-hwqhc"
Jul 13 18:58:32.855948 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:32.855654    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/7ae2e1d0-8a16-4821-9cb7-353862cfbec8-node-log\") pod \"ovnkube-node-hwqhc\" (UID: \"7ae2e1d0-8a16-4821-9cb7-353862cfbec8\") " pod="openshift-ovn-kubernetes/ovnkube-node-hwqhc"
Jul 13 18:58:32.855948 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:32.855668    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/4193271d-0ed3-4ea0-8b78-fcfe94025f66-run\") pod \"tuned-tvnk8\" (UID: \"4193271d-0ed3-4ea0-8b78-fcfe94025f66\") " pod="openshift-cluster-node-tuning-operator/tuned-tvnk8"
Jul 13 18:58:32.855948 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:32.855707    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/dea817c3-e510-4cf3-86ef-852930ad3466-host-var-lib-kubelet\") pod \"multus-tm4bj\" (UID: \"dea817c3-e510-4cf3-86ef-852930ad3466\") " pod="openshift-multus/multus-tm4bj"
Jul 13 18:58:32.855948 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:32.855736    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k78gz\" (UniqueName: \"kubernetes.io/projected/dea817c3-e510-4cf3-86ef-852930ad3466-kube-api-access-k78gz\") pod \"multus-tm4bj\" (UID: \"dea817c3-e510-4cf3-86ef-852930ad3466\") " pod="openshift-multus/multus-tm4bj"
Jul 13 18:58:32.855948 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:32.855763    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/aba89b91-cc04-4c11-8692-1c17006f5f7a-original-pull-secret\") pod \"global-pull-secret-syncer-b7ptz\" (UID: \"aba89b91-cc04-4c11-8692-1c17006f5f7a\") " pod="kube-system/global-pull-secret-syncer-b7ptz"
Jul 13 18:58:32.855948 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:32.855770    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/dea817c3-e510-4cf3-86ef-852930ad3466-host-var-lib-kubelet\") pod \"multus-tm4bj\" (UID: \"dea817c3-e510-4cf3-86ef-852930ad3466\") " pod="openshift-multus/multus-tm4bj"
Jul 13 18:58:32.855948 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:32.855794    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f5d7f580-f8e8-42f5-8d25-0fdb212f30c8-host\") pod \"node-ca-ghl52\" (UID: \"f5d7f580-f8e8-42f5-8d25-0fdb212f30c8\") " pod="openshift-image-registry/node-ca-ghl52"
Jul 13 18:58:32.855948 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:32.855817    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/f5d7f580-f8e8-42f5-8d25-0fdb212f30c8-serviceca\") pod \"node-ca-ghl52\" (UID: \"f5d7f580-f8e8-42f5-8d25-0fdb212f30c8\") " pod="openshift-image-registry/node-ca-ghl52"
Jul 13 18:58:32.855948 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:32.855851    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/4193271d-0ed3-4ea0-8b78-fcfe94025f66-etc-sysctl-d\") pod \"tuned-tvnk8\" (UID: \"4193271d-0ed3-4ea0-8b78-fcfe94025f66\") " pod="openshift-cluster-node-tuning-operator/tuned-tvnk8"
Jul 13 18:58:32.855948 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:32.855874    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ptp8q\" (UniqueName: \"kubernetes.io/projected/4193271d-0ed3-4ea0-8b78-fcfe94025f66-kube-api-access-ptp8q\") pod \"tuned-tvnk8\" (UID: \"4193271d-0ed3-4ea0-8b78-fcfe94025f66\") " pod="openshift-cluster-node-tuning-operator/tuned-tvnk8"
Jul 13 18:58:32.855948 ip-10-0-135-38 kubenswrapper[2563]: E0713 18:58:32.855878    2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 13 18:58:32.855948 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:32.855900    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/02bf7c85-7eab-4d14-8e16-562c3ee29573-metrics-certs\") pod \"network-metrics-daemon-8hrpw\" (UID: \"02bf7c85-7eab-4d14-8e16-562c3ee29573\") " pod="openshift-multus/network-metrics-daemon-8hrpw"
Jul 13 18:58:32.855948 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:32.855928    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4cdk2\" (UniqueName: \"kubernetes.io/projected/f7a4ace4-0eef-464d-b901-09b2f03f6f05-kube-api-access-4cdk2\") pod \"aws-ebs-csi-driver-node-9dvlb\" (UID: \"f7a4ace4-0eef-464d-b901-09b2f03f6f05\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9dvlb"
Jul 13 18:58:32.855948 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:32.855954    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/7ae2e1d0-8a16-4821-9cb7-353862cfbec8-systemd-units\") pod \"ovnkube-node-hwqhc\" (UID: \"7ae2e1d0-8a16-4821-9cb7-353862cfbec8\") " pod="openshift-ovn-kubernetes/ovnkube-node-hwqhc"
Jul 13 18:58:32.856823 ip-10-0-135-38 kubenswrapper[2563]: E0713 18:58:32.855981    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aba89b91-cc04-4c11-8692-1c17006f5f7a-original-pull-secret podName:aba89b91-cc04-4c11-8692-1c17006f5f7a nodeName:}" failed. No retries permitted until 2026-07-13 18:58:33.355960163 +0000 UTC m=+2.990294134 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/aba89b91-cc04-4c11-8692-1c17006f5f7a-original-pull-secret") pod "global-pull-secret-syncer-b7ptz" (UID: "aba89b91-cc04-4c11-8692-1c17006f5f7a") : object "kube-system"/"original-pull-secret" not registered
Jul 13 18:58:32.856823 ip-10-0-135-38 kubenswrapper[2563]: E0713 18:58:32.856045    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 13 18:58:32.856823 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:32.856071    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/7ae2e1d0-8a16-4821-9cb7-353862cfbec8-ovnkube-config\") pod \"ovnkube-node-hwqhc\" (UID: \"7ae2e1d0-8a16-4821-9cb7-353862cfbec8\") " pod="openshift-ovn-kubernetes/ovnkube-node-hwqhc"
Jul 13 18:58:32.856823 ip-10-0-135-38 kubenswrapper[2563]: E0713 18:58:32.856098    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/02bf7c85-7eab-4d14-8e16-562c3ee29573-metrics-certs podName:02bf7c85-7eab-4d14-8e16-562c3ee29573 nodeName:}" failed. No retries permitted until 2026-07-13 18:58:33.356082224 +0000 UTC m=+2.990416183 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/02bf7c85-7eab-4d14-8e16-562c3ee29573-metrics-certs") pod "network-metrics-daemon-8hrpw" (UID: "02bf7c85-7eab-4d14-8e16-562c3ee29573") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 13 18:58:32.856823 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:32.856093    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/4193271d-0ed3-4ea0-8b78-fcfe94025f66-etc-sysctl-d\") pod \"tuned-tvnk8\" (UID: \"4193271d-0ed3-4ea0-8b78-fcfe94025f66\") " pod="openshift-cluster-node-tuning-operator/tuned-tvnk8"
Jul 13 18:58:32.856823 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:32.856130    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/dea817c3-e510-4cf3-86ef-852930ad3466-host-run-multus-certs\") pod \"multus-tm4bj\" (UID: \"dea817c3-e510-4cf3-86ef-852930ad3466\") " pod="openshift-multus/multus-tm4bj"
Jul 13 18:58:32.856823 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:32.856163    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/4193271d-0ed3-4ea0-8b78-fcfe94025f66-etc-tuned\") pod \"tuned-tvnk8\" (UID: \"4193271d-0ed3-4ea0-8b78-fcfe94025f66\") " pod="openshift-cluster-node-tuning-operator/tuned-tvnk8"
Jul 13 18:58:32.856823 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:32.856163    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/dea817c3-e510-4cf3-86ef-852930ad3466-host-run-multus-certs\") pod \"multus-tm4bj\" (UID: \"dea817c3-e510-4cf3-86ef-852930ad3466\") " pod="openshift-multus/multus-tm4bj"
Jul 13 18:58:32.856823 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:32.856181    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/7ae2e1d0-8a16-4821-9cb7-353862cfbec8-run-ovn\") pod \"ovnkube-node-hwqhc\" (UID: \"7ae2e1d0-8a16-4821-9cb7-353862cfbec8\") " pod="openshift-ovn-kubernetes/ovnkube-node-hwqhc"
Jul 13 18:58:32.856823 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:32.856667    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/7ae2e1d0-8a16-4821-9cb7-353862cfbec8-host-cni-netd\") pod \"ovnkube-node-hwqhc\" (UID: \"7ae2e1d0-8a16-4821-9cb7-353862cfbec8\") " pod="openshift-ovn-kubernetes/ovnkube-node-hwqhc"
Jul 13 18:58:32.856823 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:32.856683    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/7ae2e1d0-8a16-4821-9cb7-353862cfbec8-ovn-node-metrics-cert\") pod \"ovnkube-node-hwqhc\" (UID: \"7ae2e1d0-8a16-4821-9cb7-353862cfbec8\") " pod="openshift-ovn-kubernetes/ovnkube-node-hwqhc"
Jul 13 18:58:32.856823 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:32.856700    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/dea817c3-e510-4cf3-86ef-852930ad3466-host-var-lib-cni-bin\") pod \"multus-tm4bj\" (UID: \"dea817c3-e510-4cf3-86ef-852930ad3466\") " pod="openshift-multus/multus-tm4bj"
Jul 13 18:58:32.856823 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:32.856715    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/7ae2e1d0-8a16-4821-9cb7-353862cfbec8-run-systemd\") pod \"ovnkube-node-hwqhc\" (UID: \"7ae2e1d0-8a16-4821-9cb7-353862cfbec8\") " pod="openshift-ovn-kubernetes/ovnkube-node-hwqhc"
Jul 13 18:58:32.856823 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:32.856717    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/dea817c3-e510-4cf3-86ef-852930ad3466-multus-daemon-config\") pod \"multus-tm4bj\" (UID: \"dea817c3-e510-4cf3-86ef-852930ad3466\") " pod="openshift-multus/multus-tm4bj"
Jul 13 18:58:32.856823 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:32.856637    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/b26f5a70-1ec7-4056-9658-25878216543f-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-nkdq7\" (UID: \"b26f5a70-1ec7-4056-9658-25878216543f\") " pod="openshift-multus/multus-additional-cni-plugins-nkdq7"
Jul 13 18:58:32.856823 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:32.856755    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/f7a4ace4-0eef-464d-b901-09b2f03f6f05-socket-dir\") pod \"aws-ebs-csi-driver-node-9dvlb\" (UID: \"f7a4ace4-0eef-464d-b901-09b2f03f6f05\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9dvlb"
Jul 13 18:58:32.857461 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:32.856758    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/dea817c3-e510-4cf3-86ef-852930ad3466-host-var-lib-cni-bin\") pod \"multus-tm4bj\" (UID: \"dea817c3-e510-4cf3-86ef-852930ad3466\") " pod="openshift-multus/multus-tm4bj"
Jul 13 18:58:32.857461 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:32.856788    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/dea817c3-e510-4cf3-86ef-852930ad3466-cni-binary-copy\") pod \"multus-tm4bj\" (UID: \"dea817c3-e510-4cf3-86ef-852930ad3466\") " pod="openshift-multus/multus-tm4bj"
Jul 13 18:58:32.857461 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:32.856817    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/dea817c3-e510-4cf3-86ef-852930ad3466-host-run-netns\") pod \"multus-tm4bj\" (UID: \"dea817c3-e510-4cf3-86ef-852930ad3466\") " pod="openshift-multus/multus-tm4bj"
Jul 13 18:58:32.857461 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:32.856846    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/dea817c3-e510-4cf3-86ef-852930ad3466-host-run-netns\") pod \"multus-tm4bj\" (UID: \"dea817c3-e510-4cf3-86ef-852930ad3466\") " pod="openshift-multus/multus-tm4bj"
Jul 13 18:58:32.857461 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:32.856852    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/4193271d-0ed3-4ea0-8b78-fcfe94025f66-etc-systemd\") pod \"tuned-tvnk8\" (UID: \"4193271d-0ed3-4ea0-8b78-fcfe94025f66\") " pod="openshift-cluster-node-tuning-operator/tuned-tvnk8"
Jul 13 18:58:32.857461 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:32.856882    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4193271d-0ed3-4ea0-8b78-fcfe94025f66-lib-modules\") pod \"tuned-tvnk8\" (UID: \"4193271d-0ed3-4ea0-8b78-fcfe94025f66\") " pod="openshift-cluster-node-tuning-operator/tuned-tvnk8"
Jul 13 18:58:32.857461 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:32.856912    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4193271d-0ed3-4ea0-8b78-fcfe94025f66-tmp\") pod \"tuned-tvnk8\" (UID: \"4193271d-0ed3-4ea0-8b78-fcfe94025f66\") " pod="openshift-cluster-node-tuning-operator/tuned-tvnk8"
Jul 13 18:58:32.857461 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:32.856923    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/4193271d-0ed3-4ea0-8b78-fcfe94025f66-etc-systemd\") pod \"tuned-tvnk8\" (UID: \"4193271d-0ed3-4ea0-8b78-fcfe94025f66\") " pod="openshift-cluster-node-tuning-operator/tuned-tvnk8"
Jul 13 18:58:32.857461 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:32.856942    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7ae2e1d0-8a16-4821-9cb7-353862cfbec8-etc-openvswitch\") pod \"ovnkube-node-hwqhc\" (UID: \"7ae2e1d0-8a16-4821-9cb7-353862cfbec8\") " pod="openshift-ovn-kubernetes/ovnkube-node-hwqhc"
Jul 13 18:58:32.857461 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:32.856972    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/aba89b91-cc04-4c11-8692-1c17006f5f7a-kubelet-config\") pod \"global-pull-secret-syncer-b7ptz\" (UID: \"aba89b91-cc04-4c11-8692-1c17006f5f7a\") " pod="kube-system/global-pull-secret-syncer-b7ptz"
Jul 13 18:58:32.857461 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:32.856971    2563 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 13 18:58:32.857461 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:32.857003    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/aba89b91-cc04-4c11-8692-1c17006f5f7a-dbus\") pod \"global-pull-secret-syncer-b7ptz\" (UID: \"aba89b91-cc04-4c11-8692-1c17006f5f7a\") " pod="kube-system/global-pull-secret-syncer-b7ptz"
Jul 13 18:58:32.857461 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:32.857013    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4193271d-0ed3-4ea0-8b78-fcfe94025f66-lib-modules\") pod \"tuned-tvnk8\" (UID: \"4193271d-0ed3-4ea0-8b78-fcfe94025f66\") " pod="openshift-cluster-node-tuning-operator/tuned-tvnk8"
Jul 13 18:58:32.857461 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:32.857032    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/f7a4ace4-0eef-464d-b901-09b2f03f6f05-sys-fs\") pod \"aws-ebs-csi-driver-node-9dvlb\" (UID: \"f7a4ace4-0eef-464d-b901-09b2f03f6f05\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9dvlb"
Jul 13 18:58:32.857461 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:32.857050    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/aba89b91-cc04-4c11-8692-1c17006f5f7a-kubelet-config\") pod \"global-pull-secret-syncer-b7ptz\" (UID: \"aba89b91-cc04-4c11-8692-1c17006f5f7a\") " pod="kube-system/global-pull-secret-syncer-b7ptz"
Jul 13 18:58:32.857461 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:32.857059    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7ae2e1d0-8a16-4821-9cb7-353862cfbec8-host-cni-bin\") pod \"ovnkube-node-hwqhc\" (UID: \"7ae2e1d0-8a16-4821-9cb7-353862cfbec8\") " pod="openshift-ovn-kubernetes/ovnkube-node-hwqhc"
Jul 13 18:58:32.857461 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:32.857098    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-chhbq\" (UniqueName: \"kubernetes.io/projected/7ae2e1d0-8a16-4821-9cb7-353862cfbec8-kube-api-access-chhbq\") pod \"ovnkube-node-hwqhc\" (UID: \"7ae2e1d0-8a16-4821-9cb7-353862cfbec8\") " pod="openshift-ovn-kubernetes/ovnkube-node-hwqhc"
Jul 13 18:58:32.857461 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:32.857125    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/4193271d-0ed3-4ea0-8b78-fcfe94025f66-etc-sysctl-conf\") pod \"tuned-tvnk8\" (UID: \"4193271d-0ed3-4ea0-8b78-fcfe94025f66\") " pod="openshift-cluster-node-tuning-operator/tuned-tvnk8"
Jul 13 18:58:32.858154 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:32.857145    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/aba89b91-cc04-4c11-8692-1c17006f5f7a-dbus\") pod \"global-pull-secret-syncer-b7ptz\" (UID: \"aba89b91-cc04-4c11-8692-1c17006f5f7a\") " pod="kube-system/global-pull-secret-syncer-b7ptz"
Jul 13 18:58:32.858154 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:32.857153    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4193271d-0ed3-4ea0-8b78-fcfe94025f66-host\") pod \"tuned-tvnk8\" (UID: \"4193271d-0ed3-4ea0-8b78-fcfe94025f66\") " pod="openshift-cluster-node-tuning-operator/tuned-tvnk8"
Jul 13 18:58:32.858154 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:32.857183    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/7223a804-aca6-480f-9443-f129f82d33b5-konnectivity-ca\") pod \"konnectivity-agent-n59kb\" (UID: \"7223a804-aca6-480f-9443-f129f82d33b5\") " pod="kube-system/konnectivity-agent-n59kb"
Jul 13 18:58:32.858154 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:32.857232    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4193271d-0ed3-4ea0-8b78-fcfe94025f66-host\") pod \"tuned-tvnk8\" (UID: \"4193271d-0ed3-4ea0-8b78-fcfe94025f66\") " pod="openshift-cluster-node-tuning-operator/tuned-tvnk8"
Jul 13 18:58:32.858154 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:32.857239    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/07b6332f-faaf-46f8-9959-f74468d61647-host-slash\") pod \"iptables-alerter-mrdlq\" (UID: \"07b6332f-faaf-46f8-9959-f74468d61647\") " pod="openshift-network-operator/iptables-alerter-mrdlq"
Jul 13 18:58:32.858154 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:32.857270    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/dea817c3-e510-4cf3-86ef-852930ad3466-multus-conf-dir\") pod \"multus-tm4bj\" (UID: \"dea817c3-e510-4cf3-86ef-852930ad3466\") " pod="openshift-multus/multus-tm4bj"
Jul 13 18:58:32.858154 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:32.857303    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/f7a4ace4-0eef-464d-b901-09b2f03f6f05-registration-dir\") pod \"aws-ebs-csi-driver-node-9dvlb\" (UID: \"f7a4ace4-0eef-464d-b901-09b2f03f6f05\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9dvlb"
Jul 13 18:58:32.858154 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:32.857321    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/4193271d-0ed3-4ea0-8b78-fcfe94025f66-etc-sysctl-conf\") pod \"tuned-tvnk8\" (UID: \"4193271d-0ed3-4ea0-8b78-fcfe94025f66\") " pod="openshift-cluster-node-tuning-operator/tuned-tvnk8"
Jul 13 18:58:32.858154 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:32.857335    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9qjks\" (UniqueName: \"kubernetes.io/projected/07b6332f-faaf-46f8-9959-f74468d61647-kube-api-access-9qjks\") pod \"iptables-alerter-mrdlq\" (UID: \"07b6332f-faaf-46f8-9959-f74468d61647\") " pod="openshift-network-operator/iptables-alerter-mrdlq"
Jul 13 18:58:32.858154 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:32.857399    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bpn5x\" (UniqueName: \"kubernetes.io/projected/f5d7f580-f8e8-42f5-8d25-0fdb212f30c8-kube-api-access-bpn5x\") pod \"node-ca-ghl52\" (UID: \"f5d7f580-f8e8-42f5-8d25-0fdb212f30c8\") " pod="openshift-image-registry/node-ca-ghl52"
Jul 13 18:58:32.858154 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:32.857411    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/dea817c3-e510-4cf3-86ef-852930ad3466-multus-conf-dir\") pod \"multus-tm4bj\" (UID: \"dea817c3-e510-4cf3-86ef-852930ad3466\") " pod="openshift-multus/multus-tm4bj"
Jul 13 18:58:32.858154 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:32.857450    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7ae2e1d0-8a16-4821-9cb7-353862cfbec8-host-run-netns\") pod \"ovnkube-node-hwqhc\" (UID: \"7ae2e1d0-8a16-4821-9cb7-353862cfbec8\") " pod="openshift-ovn-kubernetes/ovnkube-node-hwqhc"
Jul 13 18:58:32.858154 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:32.857474    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/4193271d-0ed3-4ea0-8b78-fcfe94025f66-etc-sysconfig\") pod \"tuned-tvnk8\" (UID: \"4193271d-0ed3-4ea0-8b78-fcfe94025f66\") " pod="openshift-cluster-node-tuning-operator/tuned-tvnk8"
Jul 13 18:58:32.858154 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:32.857514    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/4193271d-0ed3-4ea0-8b78-fcfe94025f66-etc-sysconfig\") pod \"tuned-tvnk8\" (UID: \"4193271d-0ed3-4ea0-8b78-fcfe94025f66\") " pod="openshift-cluster-node-tuning-operator/tuned-tvnk8"
Jul 13 18:58:32.858154 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:32.857549    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/09aa4086-5243-477a-aa13-3b0c054d764a-tmp-dir\") pod \"node-resolver-jrzv2\" (UID: \"09aa4086-5243-477a-aa13-3b0c054d764a\") " pod="openshift-dns/node-resolver-jrzv2"
Jul 13 18:58:32.858154 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:32.857600    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lc2ff\" (UniqueName: \"kubernetes.io/projected/c72f59c6-8ebc-447d-8b92-096dac42859f-kube-api-access-lc2ff\") pod \"network-check-target-vbjkv\" (UID: \"c72f59c6-8ebc-447d-8b92-096dac42859f\") " pod="openshift-network-diagnostics/network-check-target-vbjkv"
Jul 13 18:58:32.858154 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:32.857634    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b26f5a70-1ec7-4056-9658-25878216543f-os-release\") pod \"multus-additional-cni-plugins-nkdq7\" (UID: \"b26f5a70-1ec7-4056-9658-25878216543f\") " pod="openshift-multus/multus-additional-cni-plugins-nkdq7"
Jul 13 18:58:32.858874 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:32.857658    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/f7a4ace4-0eef-464d-b901-09b2f03f6f05-kubelet-dir\") pod \"aws-ebs-csi-driver-node-9dvlb\" (UID: \"f7a4ace4-0eef-464d-b901-09b2f03f6f05\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9dvlb"
Jul 13 18:58:32.858874 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:32.857681    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lsvrm\" (UniqueName: \"kubernetes.io/projected/09aa4086-5243-477a-aa13-3b0c054d764a-kube-api-access-lsvrm\") pod \"node-resolver-jrzv2\" (UID: \"09aa4086-5243-477a-aa13-3b0c054d764a\") " pod="openshift-dns/node-resolver-jrzv2"
Jul 13 18:58:32.858874 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:32.857708    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b26f5a70-1ec7-4056-9658-25878216543f-tuning-conf-dir\") pod \"multus-additional-cni-plugins-nkdq7\" (UID: \"b26f5a70-1ec7-4056-9658-25878216543f\") " pod="openshift-multus/multus-additional-cni-plugins-nkdq7"
Jul 13 18:58:32.858874 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:32.857731    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/7ae2e1d0-8a16-4821-9cb7-353862cfbec8-host-kubelet\") pod \"ovnkube-node-hwqhc\" (UID: \"7ae2e1d0-8a16-4821-9cb7-353862cfbec8\") " pod="openshift-ovn-kubernetes/ovnkube-node-hwqhc"
Jul 13 18:58:32.858874 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:32.857739    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/dea817c3-e510-4cf3-86ef-852930ad3466-cni-binary-copy\") pod \"multus-tm4bj\" (UID: \"dea817c3-e510-4cf3-86ef-852930ad3466\") " pod="openshift-multus/multus-tm4bj"
Jul 13 18:58:32.858874 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:32.857757    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7ae2e1d0-8a16-4821-9cb7-353862cfbec8-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-hwqhc\" (UID: \"7ae2e1d0-8a16-4821-9cb7-353862cfbec8\") " pod="openshift-ovn-kubernetes/ovnkube-node-hwqhc"
Jul 13 18:58:32.858874 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:32.857800    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/09aa4086-5243-477a-aa13-3b0c054d764a-tmp-dir\") pod \"node-resolver-jrzv2\" (UID: \"09aa4086-5243-477a-aa13-3b0c054d764a\") " pod="openshift-dns/node-resolver-jrzv2"
Jul 13 18:58:32.858874 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:32.857819    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/dea817c3-e510-4cf3-86ef-852930ad3466-multus-socket-dir-parent\") pod \"multus-tm4bj\" (UID: \"dea817c3-e510-4cf3-86ef-852930ad3466\") " pod="openshift-multus/multus-tm4bj"
Jul 13 18:58:32.858874 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:32.857855    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/dea817c3-e510-4cf3-86ef-852930ad3466-host-var-lib-cni-multus\") pod \"multus-tm4bj\" (UID: \"dea817c3-e510-4cf3-86ef-852930ad3466\") " pod="openshift-multus/multus-tm4bj"
Jul 13 18:58:32.858874 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:32.857872    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/dea817c3-e510-4cf3-86ef-852930ad3466-multus-socket-dir-parent\") pod \"multus-tm4bj\" (UID: \"dea817c3-e510-4cf3-86ef-852930ad3466\") " pod="openshift-multus/multus-tm4bj"
Jul 13 18:58:32.858874 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:32.857876    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/dea817c3-e510-4cf3-86ef-852930ad3466-hostroot\") pod \"multus-tm4bj\" (UID: \"dea817c3-e510-4cf3-86ef-852930ad3466\") " pod="openshift-multus/multus-tm4bj"
Jul 13 18:58:32.858874 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:32.857888    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b26f5a70-1ec7-4056-9658-25878216543f-tuning-conf-dir\") pod \"multus-additional-cni-plugins-nkdq7\" (UID: \"b26f5a70-1ec7-4056-9658-25878216543f\") " pod="openshift-multus/multus-additional-cni-plugins-nkdq7"
Jul 13 18:58:32.858874 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:32.857916    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/dea817c3-e510-4cf3-86ef-852930ad3466-host-var-lib-cni-multus\") pod \"multus-tm4bj\" (UID: \"dea817c3-e510-4cf3-86ef-852930ad3466\") " pod="openshift-multus/multus-tm4bj"
Jul 13 18:58:32.858874 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:32.857925    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b26f5a70-1ec7-4056-9658-25878216543f-os-release\") pod \"multus-additional-cni-plugins-nkdq7\" (UID: \"b26f5a70-1ec7-4056-9658-25878216543f\") " pod="openshift-multus/multus-additional-cni-plugins-nkdq7"
Jul 13 18:58:32.858874 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:32.857944    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/dea817c3-e510-4cf3-86ef-852930ad3466-hostroot\") pod \"multus-tm4bj\" (UID: \"dea817c3-e510-4cf3-86ef-852930ad3466\") " pod="openshift-multus/multus-tm4bj"
Jul 13 18:58:32.858874 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:32.857934    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4193271d-0ed3-4ea0-8b78-fcfe94025f66-var-lib-kubelet\") pod \"tuned-tvnk8\" (UID: \"4193271d-0ed3-4ea0-8b78-fcfe94025f66\") " pod="openshift-cluster-node-tuning-operator/tuned-tvnk8"
Jul 13 18:58:32.858874 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:32.857973    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/f7a4ace4-0eef-464d-b901-09b2f03f6f05-etc-selinux\") pod \"aws-ebs-csi-driver-node-9dvlb\" (UID: \"f7a4ace4-0eef-464d-b901-09b2f03f6f05\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9dvlb"
Jul 13 18:58:32.859469 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:32.857991    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4193271d-0ed3-4ea0-8b78-fcfe94025f66-var-lib-kubelet\") pod \"tuned-tvnk8\" (UID: \"4193271d-0ed3-4ea0-8b78-fcfe94025f66\") " pod="openshift-cluster-node-tuning-operator/tuned-tvnk8"
Jul 13 18:58:32.859469 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:32.857993    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/7ae2e1d0-8a16-4821-9cb7-353862cfbec8-log-socket\") pod \"ovnkube-node-hwqhc\" (UID: \"7ae2e1d0-8a16-4821-9cb7-353862cfbec8\") " pod="openshift-ovn-kubernetes/ovnkube-node-hwqhc"
Jul 13 18:58:32.859469 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:32.858029    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/7ae2e1d0-8a16-4821-9cb7-353862cfbec8-env-overrides\") pod \"ovnkube-node-hwqhc\" (UID: \"7ae2e1d0-8a16-4821-9cb7-353862cfbec8\") " pod="openshift-ovn-kubernetes/ovnkube-node-hwqhc"
Jul 13 18:58:32.859469 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:32.858045    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/dea817c3-e510-4cf3-86ef-852930ad3466-host-run-k8s-cni-cncf-io\") pod \"multus-tm4bj\" (UID: \"dea817c3-e510-4cf3-86ef-852930ad3466\") " pod="openshift-multus/multus-tm4bj"
Jul 13 18:58:32.859469 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:32.858073    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b26f5a70-1ec7-4056-9658-25878216543f-cnibin\") pod \"multus-additional-cni-plugins-nkdq7\" (UID: \"b26f5a70-1ec7-4056-9658-25878216543f\") " pod="openshift-multus/multus-additional-cni-plugins-nkdq7"
Jul 13 18:58:32.859469 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:32.858088    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/b26f5a70-1ec7-4056-9658-25878216543f-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-nkdq7\" (UID: \"b26f5a70-1ec7-4056-9658-25878216543f\") " pod="openshift-multus/multus-additional-cni-plugins-nkdq7"
Jul 13 18:58:32.859469 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:32.858105    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6mnc9\" (UniqueName: \"kubernetes.io/projected/b26f5a70-1ec7-4056-9658-25878216543f-kube-api-access-6mnc9\") pod \"multus-additional-cni-plugins-nkdq7\" (UID: \"b26f5a70-1ec7-4056-9658-25878216543f\") " pod="openshift-multus/multus-additional-cni-plugins-nkdq7"
Jul 13 18:58:32.859469 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:32.858120    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/f7a4ace4-0eef-464d-b901-09b2f03f6f05-device-dir\") pod \"aws-ebs-csi-driver-node-9dvlb\" (UID: \"f7a4ace4-0eef-464d-b901-09b2f03f6f05\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9dvlb"
Jul 13 18:58:32.859469 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:32.858124    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/dea817c3-e510-4cf3-86ef-852930ad3466-host-run-k8s-cni-cncf-io\") pod \"multus-tm4bj\" (UID: \"dea817c3-e510-4cf3-86ef-852930ad3466\") " pod="openshift-multus/multus-tm4bj"
Jul 13 18:58:32.859469 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:32.858142    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7ae2e1d0-8a16-4821-9cb7-353862cfbec8-host-run-ovn-kubernetes\") pod \"ovnkube-node-hwqhc\" (UID: \"7ae2e1d0-8a16-4821-9cb7-353862cfbec8\") " pod="openshift-ovn-kubernetes/ovnkube-node-hwqhc"
Jul 13 18:58:32.859469 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:32.858149    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b26f5a70-1ec7-4056-9658-25878216543f-cnibin\") pod \"multus-additional-cni-plugins-nkdq7\" (UID: \"b26f5a70-1ec7-4056-9658-25878216543f\") " pod="openshift-multus/multus-additional-cni-plugins-nkdq7"
Jul 13 18:58:32.859469 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:32.858177    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/dea817c3-e510-4cf3-86ef-852930ad3466-system-cni-dir\") pod \"multus-tm4bj\" (UID: \"dea817c3-e510-4cf3-86ef-852930ad3466\") " pod="openshift-multus/multus-tm4bj"
Jul 13 18:58:32.859469 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:32.858212    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/dea817c3-e510-4cf3-86ef-852930ad3466-multus-cni-dir\") pod \"multus-tm4bj\" (UID: \"dea817c3-e510-4cf3-86ef-852930ad3466\") " pod="openshift-multus/multus-tm4bj"
Jul 13 18:58:32.859469 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:32.858236    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/4193271d-0ed3-4ea0-8b78-fcfe94025f66-etc-modprobe-d\") pod \"tuned-tvnk8\" (UID: \"4193271d-0ed3-4ea0-8b78-fcfe94025f66\") " pod="openshift-cluster-node-tuning-operator/tuned-tvnk8"
Jul 13 18:58:32.859469 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:32.858259    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/09aa4086-5243-477a-aa13-3b0c054d764a-hosts-file\") pod \"node-resolver-jrzv2\" (UID: \"09aa4086-5243-477a-aa13-3b0c054d764a\") " pod="openshift-dns/node-resolver-jrzv2"
Jul 13 18:58:32.859469 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:32.858278    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/dea817c3-e510-4cf3-86ef-852930ad3466-system-cni-dir\") pod \"multus-tm4bj\" (UID: \"dea817c3-e510-4cf3-86ef-852930ad3466\") " pod="openshift-multus/multus-tm4bj"
Jul 13 18:58:32.859469 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:32.858283    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/dea817c3-e510-4cf3-86ef-852930ad3466-multus-cni-dir\") pod \"multus-tm4bj\" (UID: \"dea817c3-e510-4cf3-86ef-852930ad3466\") " pod="openshift-multus/multus-tm4bj"
Jul 13 18:58:32.860010 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:32.858281    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b26f5a70-1ec7-4056-9658-25878216543f-system-cni-dir\") pod \"multus-additional-cni-plugins-nkdq7\" (UID: \"b26f5a70-1ec7-4056-9658-25878216543f\") " pod="openshift-multus/multus-additional-cni-plugins-nkdq7"
Jul 13 18:58:32.860010 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:32.858326    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b26f5a70-1ec7-4056-9658-25878216543f-cni-binary-copy\") pod \"multus-additional-cni-plugins-nkdq7\" (UID: \"b26f5a70-1ec7-4056-9658-25878216543f\") " pod="openshift-multus/multus-additional-cni-plugins-nkdq7"
Jul 13 18:58:32.860010 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:32.858335    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/09aa4086-5243-477a-aa13-3b0c054d764a-hosts-file\") pod \"node-resolver-jrzv2\" (UID: \"09aa4086-5243-477a-aa13-3b0c054d764a\") " pod="openshift-dns/node-resolver-jrzv2"
Jul 13 18:58:32.860010 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:32.858360    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/4193271d-0ed3-4ea0-8b78-fcfe94025f66-etc-modprobe-d\") pod \"tuned-tvnk8\" (UID: \"4193271d-0ed3-4ea0-8b78-fcfe94025f66\") " pod="openshift-cluster-node-tuning-operator/tuned-tvnk8"
Jul 13 18:58:32.860010 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:32.858358    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b26f5a70-1ec7-4056-9658-25878216543f-system-cni-dir\") pod \"multus-additional-cni-plugins-nkdq7\" (UID: \"b26f5a70-1ec7-4056-9658-25878216543f\") " pod="openshift-multus/multus-additional-cni-plugins-nkdq7"
Jul 13 18:58:32.860010 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:32.858643    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/b26f5a70-1ec7-4056-9658-25878216543f-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-nkdq7\" (UID: \"b26f5a70-1ec7-4056-9658-25878216543f\") " pod="openshift-multus/multus-additional-cni-plugins-nkdq7"
Jul 13 18:58:32.860010 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:32.858966    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b26f5a70-1ec7-4056-9658-25878216543f-cni-binary-copy\") pod \"multus-additional-cni-plugins-nkdq7\" (UID: \"b26f5a70-1ec7-4056-9658-25878216543f\") " pod="openshift-multus/multus-additional-cni-plugins-nkdq7"
Jul 13 18:58:32.860434 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:32.860415    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4193271d-0ed3-4ea0-8b78-fcfe94025f66-tmp\") pod \"tuned-tvnk8\" (UID: \"4193271d-0ed3-4ea0-8b78-fcfe94025f66\") " pod="openshift-cluster-node-tuning-operator/tuned-tvnk8"
Jul 13 18:58:32.860474 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:32.860447    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/4193271d-0ed3-4ea0-8b78-fcfe94025f66-etc-tuned\") pod \"tuned-tvnk8\" (UID: \"4193271d-0ed3-4ea0-8b78-fcfe94025f66\") " pod="openshift-cluster-node-tuning-operator/tuned-tvnk8"
Jul 13 18:58:34.751261 ip-10-0-135-38 kubenswrapper[2563]: E0713 18:58:34.751214    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 13 18:58:34.751261 ip-10-0-135-38 kubenswrapper[2563]: E0713 18:58:34.751248    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 13 18:58:34.751261 ip-10-0-135-38 kubenswrapper[2563]: E0713 18:58:34.751263    2563 projected.go:196] Error preparing data for projected volume kube-api-access-lc2ff for pod openshift-network-diagnostics/network-check-target-vbjkv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 13 18:58:34.751569 ip-10-0-135-38 kubenswrapper[2563]: E0713 18:58:34.751342    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c72f59c6-8ebc-447d-8b92-096dac42859f-kube-api-access-lc2ff podName:c72f59c6-8ebc-447d-8b92-096dac42859f nodeName:}" failed. No retries permitted until 2026-07-13 18:58:35.251322592 +0000 UTC m=+3.026198943 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-lc2ff" (UniqueName: "kubernetes.io/projected/c72f59c6-8ebc-447d-8b92-096dac42859f-kube-api-access-lc2ff") pod "network-check-target-vbjkv" (UID: "c72f59c6-8ebc-447d-8b92-096dac42859f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 13 18:58:34.753396 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:34.753360    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ptp8q\" (UniqueName: \"kubernetes.io/projected/4193271d-0ed3-4ea0-8b78-fcfe94025f66-kube-api-access-ptp8q\") pod \"tuned-tvnk8\" (UID: \"4193271d-0ed3-4ea0-8b78-fcfe94025f66\") " pod="openshift-cluster-node-tuning-operator/tuned-tvnk8"
Jul 13 18:58:34.753930 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:34.753902    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6mnc9\" (UniqueName: \"kubernetes.io/projected/b26f5a70-1ec7-4056-9658-25878216543f-kube-api-access-6mnc9\") pod \"multus-additional-cni-plugins-nkdq7\" (UID: \"b26f5a70-1ec7-4056-9658-25878216543f\") " pod="openshift-multus/multus-additional-cni-plugins-nkdq7"
Jul 13 18:58:34.754422 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:34.754396    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lsvrm\" (UniqueName: \"kubernetes.io/projected/09aa4086-5243-477a-aa13-3b0c054d764a-kube-api-access-lsvrm\") pod \"node-resolver-jrzv2\" (UID: \"09aa4086-5243-477a-aa13-3b0c054d764a\") " pod="openshift-dns/node-resolver-jrzv2"
Jul 13 18:58:34.754422 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:34.754410    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k78gz\" (UniqueName: \"kubernetes.io/projected/dea817c3-e510-4cf3-86ef-852930ad3466-kube-api-access-k78gz\") pod \"multus-tm4bj\" (UID: \"dea817c3-e510-4cf3-86ef-852930ad3466\") " pod="openshift-multus/multus-tm4bj"
Jul 13 18:58:34.754673 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:34.754651    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-df5h4\" (UniqueName: \"kubernetes.io/projected/02bf7c85-7eab-4d14-8e16-562c3ee29573-kube-api-access-df5h4\") pod \"network-metrics-daemon-8hrpw\" (UID: \"02bf7c85-7eab-4d14-8e16-562c3ee29573\") " pod="openshift-multus/network-metrics-daemon-8hrpw"
Jul 13 18:58:34.754876 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:34.754826    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-38.ec2.internal" event={"ID":"9c30996778b0a4a51abebd056dde6bd9","Type":"ContainerStarted","Data":"eaca3e06f6981131173ee5b81a47f5673c63d644d9a557b59e9496ba8a2f16aa"}
Jul 13 18:58:34.756094 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:34.756072    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-38.ec2.internal" event={"ID":"588e76b45ba8b873b684c4e7e4822233","Type":"ContainerStarted","Data":"a9dc280ab46bf3f6ecf32d327289c1307f305d60da4006cef46349e0b1a2a2d6"}
Jul 13 18:58:34.802614 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:34.802574    2563 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 13 18:58:34.818239 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:34.818097    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4cdk2\" (UniqueName: \"kubernetes.io/projected/f7a4ace4-0eef-464d-b901-09b2f03f6f05-kube-api-access-4cdk2\") pod \"aws-ebs-csi-driver-node-9dvlb\" (UID: \"f7a4ace4-0eef-464d-b901-09b2f03f6f05\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9dvlb"
Jul 13 18:58:34.818239 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:34.818158    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/7ae2e1d0-8a16-4821-9cb7-353862cfbec8-systemd-units\") pod \"ovnkube-node-hwqhc\" (UID: \"7ae2e1d0-8a16-4821-9cb7-353862cfbec8\") " pod="openshift-ovn-kubernetes/ovnkube-node-hwqhc"
Jul 13 18:58:34.818239 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:34.818185    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/7ae2e1d0-8a16-4821-9cb7-353862cfbec8-ovnkube-config\") pod \"ovnkube-node-hwqhc\" (UID: \"7ae2e1d0-8a16-4821-9cb7-353862cfbec8\") " pod="openshift-ovn-kubernetes/ovnkube-node-hwqhc"
Jul 13 18:58:34.818239 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:34.818212    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/7ae2e1d0-8a16-4821-9cb7-353862cfbec8-run-ovn\") pod \"ovnkube-node-hwqhc\" (UID: \"7ae2e1d0-8a16-4821-9cb7-353862cfbec8\") " pod="openshift-ovn-kubernetes/ovnkube-node-hwqhc"
Jul 13 18:58:34.818239 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:34.818239    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/7ae2e1d0-8a16-4821-9cb7-353862cfbec8-host-cni-netd\") pod \"ovnkube-node-hwqhc\" (UID: \"7ae2e1d0-8a16-4821-9cb7-353862cfbec8\") " pod="openshift-ovn-kubernetes/ovnkube-node-hwqhc"
Jul 13 18:58:34.818772 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:34.818266    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/7ae2e1d0-8a16-4821-9cb7-353862cfbec8-ovn-node-metrics-cert\") pod \"ovnkube-node-hwqhc\" (UID: \"7ae2e1d0-8a16-4821-9cb7-353862cfbec8\") " pod="openshift-ovn-kubernetes/ovnkube-node-hwqhc"
Jul 13 18:58:34.818772 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:34.818260    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/7ae2e1d0-8a16-4821-9cb7-353862cfbec8-systemd-units\") pod \"ovnkube-node-hwqhc\" (UID: \"7ae2e1d0-8a16-4821-9cb7-353862cfbec8\") " pod="openshift-ovn-kubernetes/ovnkube-node-hwqhc"
Jul 13 18:58:34.818772 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:34.818291    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/7ae2e1d0-8a16-4821-9cb7-353862cfbec8-run-systemd\") pod \"ovnkube-node-hwqhc\" (UID: \"7ae2e1d0-8a16-4821-9cb7-353862cfbec8\") " pod="openshift-ovn-kubernetes/ovnkube-node-hwqhc"
Jul 13 18:58:34.818772 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:34.818319    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/f7a4ace4-0eef-464d-b901-09b2f03f6f05-socket-dir\") pod \"aws-ebs-csi-driver-node-9dvlb\" (UID: \"f7a4ace4-0eef-464d-b901-09b2f03f6f05\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9dvlb"
Jul 13 18:58:34.818772 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:34.818331    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/7ae2e1d0-8a16-4821-9cb7-353862cfbec8-run-ovn\") pod \"ovnkube-node-hwqhc\" (UID: \"7ae2e1d0-8a16-4821-9cb7-353862cfbec8\") " pod="openshift-ovn-kubernetes/ovnkube-node-hwqhc"
Jul 13 18:58:34.818772 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:34.818346    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7ae2e1d0-8a16-4821-9cb7-353862cfbec8-etc-openvswitch\") pod \"ovnkube-node-hwqhc\" (UID: \"7ae2e1d0-8a16-4821-9cb7-353862cfbec8\") " pod="openshift-ovn-kubernetes/ovnkube-node-hwqhc"
Jul 13 18:58:34.818772 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:34.818381    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7ae2e1d0-8a16-4821-9cb7-353862cfbec8-etc-openvswitch\") pod \"ovnkube-node-hwqhc\" (UID: \"7ae2e1d0-8a16-4821-9cb7-353862cfbec8\") " pod="openshift-ovn-kubernetes/ovnkube-node-hwqhc"
Jul 13 18:58:34.818772 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:34.818392    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/f7a4ace4-0eef-464d-b901-09b2f03f6f05-sys-fs\") pod \"aws-ebs-csi-driver-node-9dvlb\" (UID: \"f7a4ace4-0eef-464d-b901-09b2f03f6f05\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9dvlb"
Jul 13 18:58:34.818772 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:34.818425    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7ae2e1d0-8a16-4821-9cb7-353862cfbec8-host-cni-bin\") pod \"ovnkube-node-hwqhc\" (UID: \"7ae2e1d0-8a16-4821-9cb7-353862cfbec8\") " pod="openshift-ovn-kubernetes/ovnkube-node-hwqhc"
Jul 13 18:58:34.818772 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:34.818431    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/7ae2e1d0-8a16-4821-9cb7-353862cfbec8-run-systemd\") pod \"ovnkube-node-hwqhc\" (UID: \"7ae2e1d0-8a16-4821-9cb7-353862cfbec8\") " pod="openshift-ovn-kubernetes/ovnkube-node-hwqhc"
Jul 13 18:58:34.818772 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:34.818337    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/7ae2e1d0-8a16-4821-9cb7-353862cfbec8-host-cni-netd\") pod \"ovnkube-node-hwqhc\" (UID: \"7ae2e1d0-8a16-4821-9cb7-353862cfbec8\") " pod="openshift-ovn-kubernetes/ovnkube-node-hwqhc"
Jul 13 18:58:34.818772 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:34.818450    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-chhbq\" (UniqueName: \"kubernetes.io/projected/7ae2e1d0-8a16-4821-9cb7-353862cfbec8-kube-api-access-chhbq\") pod \"ovnkube-node-hwqhc\" (UID: \"7ae2e1d0-8a16-4821-9cb7-353862cfbec8\") " pod="openshift-ovn-kubernetes/ovnkube-node-hwqhc"
Jul 13 18:58:34.818772 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:34.818479    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/7223a804-aca6-480f-9443-f129f82d33b5-konnectivity-ca\") pod \"konnectivity-agent-n59kb\" (UID: \"7223a804-aca6-480f-9443-f129f82d33b5\") " pod="kube-system/konnectivity-agent-n59kb"
Jul 13 18:58:34.818772 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:34.818501    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/07b6332f-faaf-46f8-9959-f74468d61647-host-slash\") pod \"iptables-alerter-mrdlq\" (UID: \"07b6332f-faaf-46f8-9959-f74468d61647\") " pod="openshift-network-operator/iptables-alerter-mrdlq"
Jul 13 18:58:34.818772 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:34.818528    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/f7a4ace4-0eef-464d-b901-09b2f03f6f05-registration-dir\") pod \"aws-ebs-csi-driver-node-9dvlb\" (UID: \"f7a4ace4-0eef-464d-b901-09b2f03f6f05\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9dvlb"
Jul 13 18:58:34.818772 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:34.818533    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/f7a4ace4-0eef-464d-b901-09b2f03f6f05-socket-dir\") pod \"aws-ebs-csi-driver-node-9dvlb\" (UID: \"f7a4ace4-0eef-464d-b901-09b2f03f6f05\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9dvlb"
Jul 13 18:58:34.818772 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:34.818555    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9qjks\" (UniqueName: \"kubernetes.io/projected/07b6332f-faaf-46f8-9959-f74468d61647-kube-api-access-9qjks\") pod \"iptables-alerter-mrdlq\" (UID: \"07b6332f-faaf-46f8-9959-f74468d61647\") " pod="openshift-network-operator/iptables-alerter-mrdlq"
Jul 13 18:58:34.819842 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:34.818584    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bpn5x\" (UniqueName: \"kubernetes.io/projected/f5d7f580-f8e8-42f5-8d25-0fdb212f30c8-kube-api-access-bpn5x\") pod \"node-ca-ghl52\" (UID: \"f5d7f580-f8e8-42f5-8d25-0fdb212f30c8\") " pod="openshift-image-registry/node-ca-ghl52"
Jul 13 18:58:34.819842 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:34.818590    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/f7a4ace4-0eef-464d-b901-09b2f03f6f05-sys-fs\") pod \"aws-ebs-csi-driver-node-9dvlb\" (UID: \"f7a4ace4-0eef-464d-b901-09b2f03f6f05\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9dvlb"
Jul 13 18:58:34.819842 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:34.818609    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7ae2e1d0-8a16-4821-9cb7-353862cfbec8-host-run-netns\") pod \"ovnkube-node-hwqhc\" (UID: \"7ae2e1d0-8a16-4821-9cb7-353862cfbec8\") " pod="openshift-ovn-kubernetes/ovnkube-node-hwqhc"
Jul 13 18:58:34.819842 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:34.818631    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/07b6332f-faaf-46f8-9959-f74468d61647-host-slash\") pod \"iptables-alerter-mrdlq\" (UID: \"07b6332f-faaf-46f8-9959-f74468d61647\") " pod="openshift-network-operator/iptables-alerter-mrdlq"
Jul 13 18:58:34.819842 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:34.818669    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7ae2e1d0-8a16-4821-9cb7-353862cfbec8-host-cni-bin\") pod \"ovnkube-node-hwqhc\" (UID: \"7ae2e1d0-8a16-4821-9cb7-353862cfbec8\") " pod="openshift-ovn-kubernetes/ovnkube-node-hwqhc"
Jul 13 18:58:34.819842 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:34.818653    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/f7a4ace4-0eef-464d-b901-09b2f03f6f05-kubelet-dir\") pod \"aws-ebs-csi-driver-node-9dvlb\" (UID: \"f7a4ace4-0eef-464d-b901-09b2f03f6f05\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9dvlb"
Jul 13 18:58:34.819842 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:34.818748    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/7ae2e1d0-8a16-4821-9cb7-353862cfbec8-host-kubelet\") pod \"ovnkube-node-hwqhc\" (UID: \"7ae2e1d0-8a16-4821-9cb7-353862cfbec8\") " pod="openshift-ovn-kubernetes/ovnkube-node-hwqhc"
Jul 13 18:58:34.819842 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:34.818765    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/f7a4ace4-0eef-464d-b901-09b2f03f6f05-registration-dir\") pod \"aws-ebs-csi-driver-node-9dvlb\" (UID: \"f7a4ace4-0eef-464d-b901-09b2f03f6f05\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9dvlb"
Jul 13 18:58:34.819842 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:34.818781    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7ae2e1d0-8a16-4821-9cb7-353862cfbec8-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-hwqhc\" (UID: \"7ae2e1d0-8a16-4821-9cb7-353862cfbec8\") " pod="openshift-ovn-kubernetes/ovnkube-node-hwqhc"
Jul 13 18:58:34.819842 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:34.818804    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/f7a4ace4-0eef-464d-b901-09b2f03f6f05-etc-selinux\") pod \"aws-ebs-csi-driver-node-9dvlb\" (UID: \"f7a4ace4-0eef-464d-b901-09b2f03f6f05\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9dvlb"
Jul 13 18:58:34.819842 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:34.818821    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/7ae2e1d0-8a16-4821-9cb7-353862cfbec8-log-socket\") pod \"ovnkube-node-hwqhc\" (UID: \"7ae2e1d0-8a16-4821-9cb7-353862cfbec8\") " pod="openshift-ovn-kubernetes/ovnkube-node-hwqhc"
Jul 13 18:58:34.819842 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:34.818839    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/7ae2e1d0-8a16-4821-9cb7-353862cfbec8-env-overrides\") pod \"ovnkube-node-hwqhc\" (UID: \"7ae2e1d0-8a16-4821-9cb7-353862cfbec8\") " pod="openshift-ovn-kubernetes/ovnkube-node-hwqhc"
Jul 13 18:58:34.819842 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:34.818862    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/f7a4ace4-0eef-464d-b901-09b2f03f6f05-device-dir\") pod \"aws-ebs-csi-driver-node-9dvlb\" (UID: \"f7a4ace4-0eef-464d-b901-09b2f03f6f05\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9dvlb"
Jul 13 18:58:34.819842 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:34.818877    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7ae2e1d0-8a16-4821-9cb7-353862cfbec8-host-run-ovn-kubernetes\") pod \"ovnkube-node-hwqhc\" (UID: \"7ae2e1d0-8a16-4821-9cb7-353862cfbec8\") " pod="openshift-ovn-kubernetes/ovnkube-node-hwqhc"
Jul 13 18:58:34.819842 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:34.818918    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7ae2e1d0-8a16-4821-9cb7-353862cfbec8-host-slash\") pod \"ovnkube-node-hwqhc\" (UID: \"7ae2e1d0-8a16-4821-9cb7-353862cfbec8\") " pod="openshift-ovn-kubernetes/ovnkube-node-hwqhc"
Jul 13 18:58:34.819842 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:34.818938    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/07b6332f-faaf-46f8-9959-f74468d61647-iptables-alerter-script\") pod \"iptables-alerter-mrdlq\" (UID: \"07b6332f-faaf-46f8-9959-f74468d61647\") " pod="openshift-network-operator/iptables-alerter-mrdlq"
Jul 13 18:58:34.819842 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:34.818947    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/7ae2e1d0-8a16-4821-9cb7-353862cfbec8-ovnkube-config\") pod \"ovnkube-node-hwqhc\" (UID: \"7ae2e1d0-8a16-4821-9cb7-353862cfbec8\") " pod="openshift-ovn-kubernetes/ovnkube-node-hwqhc"
Jul 13 18:58:34.820527 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:34.818958    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7ae2e1d0-8a16-4821-9cb7-353862cfbec8-run-openvswitch\") pod \"ovnkube-node-hwqhc\" (UID: \"7ae2e1d0-8a16-4821-9cb7-353862cfbec8\") " pod="openshift-ovn-kubernetes/ovnkube-node-hwqhc"
Jul 13 18:58:34.820527 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:34.818948    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7ae2e1d0-8a16-4821-9cb7-353862cfbec8-host-run-netns\") pod \"ovnkube-node-hwqhc\" (UID: \"7ae2e1d0-8a16-4821-9cb7-353862cfbec8\") " pod="openshift-ovn-kubernetes/ovnkube-node-hwqhc"
Jul 13 18:58:34.820527 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:34.818977    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/7ae2e1d0-8a16-4821-9cb7-353862cfbec8-ovnkube-script-lib\") pod \"ovnkube-node-hwqhc\" (UID: \"7ae2e1d0-8a16-4821-9cb7-353862cfbec8\") " pod="openshift-ovn-kubernetes/ovnkube-node-hwqhc"
Jul 13 18:58:34.820527 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:34.818990    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/f7a4ace4-0eef-464d-b901-09b2f03f6f05-kubelet-dir\") pod \"aws-ebs-csi-driver-node-9dvlb\" (UID: \"f7a4ace4-0eef-464d-b901-09b2f03f6f05\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9dvlb"
Jul 13 18:58:34.820527 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:34.819006    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/7223a804-aca6-480f-9443-f129f82d33b5-agent-certs\") pod \"konnectivity-agent-n59kb\" (UID: \"7223a804-aca6-480f-9443-f129f82d33b5\") " pod="kube-system/konnectivity-agent-n59kb"
Jul 13 18:58:34.820527 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:34.819058    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7ae2e1d0-8a16-4821-9cb7-353862cfbec8-var-lib-openvswitch\") pod \"ovnkube-node-hwqhc\" (UID: \"7ae2e1d0-8a16-4821-9cb7-353862cfbec8\") " pod="openshift-ovn-kubernetes/ovnkube-node-hwqhc"
Jul 13 18:58:34.820527 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:34.819066    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7ae2e1d0-8a16-4821-9cb7-353862cfbec8-host-run-ovn-kubernetes\") pod \"ovnkube-node-hwqhc\" (UID: \"7ae2e1d0-8a16-4821-9cb7-353862cfbec8\") " pod="openshift-ovn-kubernetes/ovnkube-node-hwqhc"
Jul 13 18:58:34.820527 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:34.819087    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/7ae2e1d0-8a16-4821-9cb7-353862cfbec8-node-log\") pod \"ovnkube-node-hwqhc\" (UID: \"7ae2e1d0-8a16-4821-9cb7-353862cfbec8\") " pod="openshift-ovn-kubernetes/ovnkube-node-hwqhc"
Jul 13 18:58:34.820527 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:34.819101    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7ae2e1d0-8a16-4821-9cb7-353862cfbec8-host-slash\") pod \"ovnkube-node-hwqhc\" (UID: \"7ae2e1d0-8a16-4821-9cb7-353862cfbec8\") " pod="openshift-ovn-kubernetes/ovnkube-node-hwqhc"
Jul 13 18:58:34.820527 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:34.819131    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f5d7f580-f8e8-42f5-8d25-0fdb212f30c8-host\") pod \"node-ca-ghl52\" (UID: \"f5d7f580-f8e8-42f5-8d25-0fdb212f30c8\") " pod="openshift-image-registry/node-ca-ghl52"
Jul 13 18:58:34.820527 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:34.819156    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/f5d7f580-f8e8-42f5-8d25-0fdb212f30c8-serviceca\") pod \"node-ca-ghl52\" (UID: \"f5d7f580-f8e8-42f5-8d25-0fdb212f30c8\") " pod="openshift-image-registry/node-ca-ghl52"
Jul 13 18:58:34.820527 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:34.819197    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/7ae2e1d0-8a16-4821-9cb7-353862cfbec8-node-log\") pod \"ovnkube-node-hwqhc\" (UID: \"7ae2e1d0-8a16-4821-9cb7-353862cfbec8\") " pod="openshift-ovn-kubernetes/ovnkube-node-hwqhc"
Jul 13 18:58:34.820527 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:34.819251    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/f7a4ace4-0eef-464d-b901-09b2f03f6f05-device-dir\") pod \"aws-ebs-csi-driver-node-9dvlb\" (UID: \"f7a4ace4-0eef-464d-b901-09b2f03f6f05\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9dvlb"
Jul 13 18:58:34.820527 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:34.819290    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7ae2e1d0-8a16-4821-9cb7-353862cfbec8-var-lib-openvswitch\") pod \"ovnkube-node-hwqhc\" (UID: \"7ae2e1d0-8a16-4821-9cb7-353862cfbec8\") " pod="openshift-ovn-kubernetes/ovnkube-node-hwqhc"
Jul 13 18:58:34.820527 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:34.819348    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f5d7f580-f8e8-42f5-8d25-0fdb212f30c8-host\") pod \"node-ca-ghl52\" (UID: \"f5d7f580-f8e8-42f5-8d25-0fdb212f30c8\") " pod="openshift-image-registry/node-ca-ghl52"
Jul 13 18:58:34.820527 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:34.819384    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/7ae2e1d0-8a16-4821-9cb7-353862cfbec8-env-overrides\") pod \"ovnkube-node-hwqhc\" (UID: \"7ae2e1d0-8a16-4821-9cb7-353862cfbec8\") " pod="openshift-ovn-kubernetes/ovnkube-node-hwqhc"
Jul 13 18:58:34.820527 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:34.819388    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7ae2e1d0-8a16-4821-9cb7-353862cfbec8-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-hwqhc\" (UID: \"7ae2e1d0-8a16-4821-9cb7-353862cfbec8\") " pod="openshift-ovn-kubernetes/ovnkube-node-hwqhc"
Jul 13 18:58:34.820527 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:34.819430    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/7ae2e1d0-8a16-4821-9cb7-353862cfbec8-host-kubelet\") pod \"ovnkube-node-hwqhc\" (UID: \"7ae2e1d0-8a16-4821-9cb7-353862cfbec8\") " pod="openshift-ovn-kubernetes/ovnkube-node-hwqhc"
Jul 13 18:58:34.821288 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:34.819501    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/f7a4ace4-0eef-464d-b901-09b2f03f6f05-etc-selinux\") pod \"aws-ebs-csi-driver-node-9dvlb\" (UID: \"f7a4ace4-0eef-464d-b901-09b2f03f6f05\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9dvlb"
Jul 13 18:58:34.821288 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:34.819521    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/07b6332f-faaf-46f8-9959-f74468d61647-iptables-alerter-script\") pod \"iptables-alerter-mrdlq\" (UID: \"07b6332f-faaf-46f8-9959-f74468d61647\") " pod="openshift-network-operator/iptables-alerter-mrdlq"
Jul 13 18:58:34.821288 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:34.819542    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/7ae2e1d0-8a16-4821-9cb7-353862cfbec8-log-socket\") pod \"ovnkube-node-hwqhc\" (UID: \"7ae2e1d0-8a16-4821-9cb7-353862cfbec8\") " pod="openshift-ovn-kubernetes/ovnkube-node-hwqhc"
Jul 13 18:58:34.821288 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:34.819563    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7ae2e1d0-8a16-4821-9cb7-353862cfbec8-run-openvswitch\") pod \"ovnkube-node-hwqhc\" (UID: \"7ae2e1d0-8a16-4821-9cb7-353862cfbec8\") " pod="openshift-ovn-kubernetes/ovnkube-node-hwqhc"
Jul 13 18:58:34.821288 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:34.819640    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/f5d7f580-f8e8-42f5-8d25-0fdb212f30c8-serviceca\") pod \"node-ca-ghl52\" (UID: \"f5d7f580-f8e8-42f5-8d25-0fdb212f30c8\") " pod="openshift-image-registry/node-ca-ghl52"
Jul 13 18:58:34.821288 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:34.819913    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/7223a804-aca6-480f-9443-f129f82d33b5-konnectivity-ca\") pod \"konnectivity-agent-n59kb\" (UID: \"7223a804-aca6-480f-9443-f129f82d33b5\") " pod="kube-system/konnectivity-agent-n59kb"
Jul 13 18:58:34.821288 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:34.819964    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/7ae2e1d0-8a16-4821-9cb7-353862cfbec8-ovnkube-script-lib\") pod \"ovnkube-node-hwqhc\" (UID: \"7ae2e1d0-8a16-4821-9cb7-353862cfbec8\") " pod="openshift-ovn-kubernetes/ovnkube-node-hwqhc"
Jul 13 18:58:34.821288 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:34.820745    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/7ae2e1d0-8a16-4821-9cb7-353862cfbec8-ovn-node-metrics-cert\") pod \"ovnkube-node-hwqhc\" (UID: \"7ae2e1d0-8a16-4821-9cb7-353862cfbec8\") " pod="openshift-ovn-kubernetes/ovnkube-node-hwqhc"
Jul 13 18:58:34.821906 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:34.821885    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/7223a804-aca6-480f-9443-f129f82d33b5-agent-certs\") pod \"konnectivity-agent-n59kb\" (UID: \"7223a804-aca6-480f-9443-f129f82d33b5\") " pod="kube-system/konnectivity-agent-n59kb"
Jul 13 18:58:34.833452 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:34.833376    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-chhbq\" (UniqueName: \"kubernetes.io/projected/7ae2e1d0-8a16-4821-9cb7-353862cfbec8-kube-api-access-chhbq\") pod \"ovnkube-node-hwqhc\" (UID: \"7ae2e1d0-8a16-4821-9cb7-353862cfbec8\") " pod="openshift-ovn-kubernetes/ovnkube-node-hwqhc"
Jul 13 18:58:34.836775 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:34.836747    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9qjks\" (UniqueName: \"kubernetes.io/projected/07b6332f-faaf-46f8-9959-f74468d61647-kube-api-access-9qjks\") pod \"iptables-alerter-mrdlq\" (UID: \"07b6332f-faaf-46f8-9959-f74468d61647\") " pod="openshift-network-operator/iptables-alerter-mrdlq"
Jul 13 18:58:34.837474 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:34.837448    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bpn5x\" (UniqueName: \"kubernetes.io/projected/f5d7f580-f8e8-42f5-8d25-0fdb212f30c8-kube-api-access-bpn5x\") pod \"node-ca-ghl52\" (UID: \"f5d7f580-f8e8-42f5-8d25-0fdb212f30c8\") " pod="openshift-image-registry/node-ca-ghl52"
Jul 13 18:58:34.840369 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:34.840342    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4cdk2\" (UniqueName: \"kubernetes.io/projected/f7a4ace4-0eef-464d-b901-09b2f03f6f05-kube-api-access-4cdk2\") pod \"aws-ebs-csi-driver-node-9dvlb\" (UID: \"f7a4ace4-0eef-464d-b901-09b2f03f6f05\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9dvlb"
Jul 13 18:58:34.898326 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:34.898289    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-tm4bj"
Jul 13 18:58:34.903924 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:34.903887    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-tvnk8"
Jul 13 18:58:34.911843 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:34.911816    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-jrzv2"
Jul 13 18:58:34.912936 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:34.912898    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddea817c3_e510_4cf3_86ef_852930ad3466.slice/crio-ce4ed91634656298e351ddfa46465d5afcda7f201518f874153afd9b44349dfd WatchSource:0}: Error finding container ce4ed91634656298e351ddfa46465d5afcda7f201518f874153afd9b44349dfd: Status 404 returned error can't find the container with id ce4ed91634656298e351ddfa46465d5afcda7f201518f874153afd9b44349dfd
Jul 13 18:58:34.916981 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:34.916790    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4193271d_0ed3_4ea0_8b78_fcfe94025f66.slice/crio-a34d0bb10fcdc26db12201ebe1b408a56b8b46f135b45bcae2d2e438aa96801a WatchSource:0}: Error finding container a34d0bb10fcdc26db12201ebe1b408a56b8b46f135b45bcae2d2e438aa96801a: Status 404 returned error can't find the container with id a34d0bb10fcdc26db12201ebe1b408a56b8b46f135b45bcae2d2e438aa96801a
Jul 13 18:58:34.916981 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:34.916885    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-nkdq7"
Jul 13 18:58:34.922734 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:34.922694    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod09aa4086_5243_477a_aa13_3b0c054d764a.slice/crio-1f8073fd8b4a71a334f4cc76e5086d503ec28e8e37a7b7c9f9f74ba384a85447 WatchSource:0}: Error finding container 1f8073fd8b4a71a334f4cc76e5086d503ec28e8e37a7b7c9f9f74ba384a85447: Status 404 returned error can't find the container with id 1f8073fd8b4a71a334f4cc76e5086d503ec28e8e37a7b7c9f9f74ba384a85447
Jul 13 18:58:34.923501 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:34.923477    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-hwqhc"
Jul 13 18:58:34.927107 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:34.927080    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb26f5a70_1ec7_4056_9658_25878216543f.slice/crio-bbb9b248a4882a637cbede29f0c9ed1eedc52d56d61d69f12d5064e125c7d251 WatchSource:0}: Error finding container bbb9b248a4882a637cbede29f0c9ed1eedc52d56d61d69f12d5064e125c7d251: Status 404 returned error can't find the container with id bbb9b248a4882a637cbede29f0c9ed1eedc52d56d61d69f12d5064e125c7d251
Jul 13 18:58:34.929512 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:34.929353    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-n59kb"
Jul 13 18:58:34.933532 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:34.933500    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7ae2e1d0_8a16_4821_9cb7_353862cfbec8.slice/crio-53636d255d3162097e3ce0e4ee112b776b7df7af66947275e1b3291d5ae8c12a WatchSource:0}: Error finding container 53636d255d3162097e3ce0e4ee112b776b7df7af66947275e1b3291d5ae8c12a: Status 404 returned error can't find the container with id 53636d255d3162097e3ce0e4ee112b776b7df7af66947275e1b3291d5ae8c12a
Jul 13 18:58:34.936304 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:34.936280    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-mrdlq"
Jul 13 18:58:34.939515 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:34.939486    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7223a804_aca6_480f_9443_f129f82d33b5.slice/crio-c8476ca4385afef31753a16aa3fbab1f2f6ba7f8a112ef5fe50622a09ec0042f WatchSource:0}: Error finding container c8476ca4385afef31753a16aa3fbab1f2f6ba7f8a112ef5fe50622a09ec0042f: Status 404 returned error can't find the container with id c8476ca4385afef31753a16aa3fbab1f2f6ba7f8a112ef5fe50622a09ec0042f
Jul 13 18:58:34.942403 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:34.942186    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9dvlb"
Jul 13 18:58:34.946562 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:34.946547    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-ghl52"
Jul 13 18:58:34.946871 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:34.946824    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod07b6332f_faaf_46f8_9959_f74468d61647.slice/crio-da52cf3ae79290ccb2c3abb342e41886d64e6bfefaa019f23ed34bfdd7b3da31 WatchSource:0}: Error finding container da52cf3ae79290ccb2c3abb342e41886d64e6bfefaa019f23ed34bfdd7b3da31: Status 404 returned error can't find the container with id da52cf3ae79290ccb2c3abb342e41886d64e6bfefaa019f23ed34bfdd7b3da31
Jul 13 18:58:34.956741 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:34.956701    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf7a4ace4_0eef_464d_b901_09b2f03f6f05.slice/crio-d9561aa9a738c014d0a0ecc203ad0f7d68ab435c0286b8b0d36529fe0072353e WatchSource:0}: Error finding container d9561aa9a738c014d0a0ecc203ad0f7d68ab435c0286b8b0d36529fe0072353e: Status 404 returned error can't find the container with id d9561aa9a738c014d0a0ecc203ad0f7d68ab435c0286b8b0d36529fe0072353e
Jul 13 18:58:34.957515 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:58:34.957489    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf5d7f580_f8e8_42f5_8d25_0fdb212f30c8.slice/crio-56c8800a9f662f4804a2eaa438d7492d11507805cd74f884f8fef772153d12e2 WatchSource:0}: Error finding container 56c8800a9f662f4804a2eaa438d7492d11507805cd74f884f8fef772153d12e2: Status 404 returned error can't find the container with id 56c8800a9f662f4804a2eaa438d7492d11507805cd74f884f8fef772153d12e2
Jul 13 18:58:35.222027 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:35.221972    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/aba89b91-cc04-4c11-8692-1c17006f5f7a-original-pull-secret\") pod \"global-pull-secret-syncer-b7ptz\" (UID: \"aba89b91-cc04-4c11-8692-1c17006f5f7a\") " pod="kube-system/global-pull-secret-syncer-b7ptz"
Jul 13 18:58:35.222273 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:35.222107    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/02bf7c85-7eab-4d14-8e16-562c3ee29573-metrics-certs\") pod \"network-metrics-daemon-8hrpw\" (UID: \"02bf7c85-7eab-4d14-8e16-562c3ee29573\") " pod="openshift-multus/network-metrics-daemon-8hrpw"
Jul 13 18:58:35.222273 ip-10-0-135-38 kubenswrapper[2563]: E0713 18:58:35.222156    2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 13 18:58:35.222273 ip-10-0-135-38 kubenswrapper[2563]: E0713 18:58:35.222216    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 13 18:58:35.222273 ip-10-0-135-38 kubenswrapper[2563]: E0713 18:58:35.222225    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aba89b91-cc04-4c11-8692-1c17006f5f7a-original-pull-secret podName:aba89b91-cc04-4c11-8692-1c17006f5f7a nodeName:}" failed. No retries permitted until 2026-07-13 18:58:36.222204779 +0000 UTC m=+3.997081133 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/aba89b91-cc04-4c11-8692-1c17006f5f7a-original-pull-secret") pod "global-pull-secret-syncer-b7ptz" (UID: "aba89b91-cc04-4c11-8692-1c17006f5f7a") : object "kube-system"/"original-pull-secret" not registered
Jul 13 18:58:35.222273 ip-10-0-135-38 kubenswrapper[2563]: E0713 18:58:35.222250    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/02bf7c85-7eab-4d14-8e16-562c3ee29573-metrics-certs podName:02bf7c85-7eab-4d14-8e16-562c3ee29573 nodeName:}" failed. No retries permitted until 2026-07-13 18:58:36.222240009 +0000 UTC m=+3.997116357 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/02bf7c85-7eab-4d14-8e16-562c3ee29573-metrics-certs") pod "network-metrics-daemon-8hrpw" (UID: "02bf7c85-7eab-4d14-8e16-562c3ee29573") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 13 18:58:35.323048 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:35.322995    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lc2ff\" (UniqueName: \"kubernetes.io/projected/c72f59c6-8ebc-447d-8b92-096dac42859f-kube-api-access-lc2ff\") pod \"network-check-target-vbjkv\" (UID: \"c72f59c6-8ebc-447d-8b92-096dac42859f\") " pod="openshift-network-diagnostics/network-check-target-vbjkv"
Jul 13 18:58:35.323288 ip-10-0-135-38 kubenswrapper[2563]: E0713 18:58:35.323264    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 13 18:58:35.323400 ip-10-0-135-38 kubenswrapper[2563]: E0713 18:58:35.323311    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 13 18:58:35.323400 ip-10-0-135-38 kubenswrapper[2563]: E0713 18:58:35.323327    2563 projected.go:196] Error preparing data for projected volume kube-api-access-lc2ff for pod openshift-network-diagnostics/network-check-target-vbjkv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 13 18:58:35.323400 ip-10-0-135-38 kubenswrapper[2563]: E0713 18:58:35.323397    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c72f59c6-8ebc-447d-8b92-096dac42859f-kube-api-access-lc2ff podName:c72f59c6-8ebc-447d-8b92-096dac42859f nodeName:}" failed. No retries permitted until 2026-07-13 18:58:36.323374121 +0000 UTC m=+4.098250478 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-lc2ff" (UniqueName: "kubernetes.io/projected/c72f59c6-8ebc-447d-8b92-096dac42859f-kube-api-access-lc2ff") pod "network-check-target-vbjkv" (UID: "c72f59c6-8ebc-447d-8b92-096dac42859f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 13 18:58:35.662363 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:35.662302    2563 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-12 18:53:34 +0000 UTC" deadline="2028-04-01 05:50:35.041865352 +0000 UTC"
Jul 13 18:58:35.662363 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:35.662359    2563 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15058h51m59.379510313s"
Jul 13 18:58:35.750244 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:35.750194    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b7ptz"
Jul 13 18:58:35.750416 ip-10-0-135-38 kubenswrapper[2563]: E0713 18:58:35.750325    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b7ptz" podUID="aba89b91-cc04-4c11-8692-1c17006f5f7a"
Jul 13 18:58:35.759752 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:35.759709    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-ghl52" event={"ID":"f5d7f580-f8e8-42f5-8d25-0fdb212f30c8","Type":"ContainerStarted","Data":"56c8800a9f662f4804a2eaa438d7492d11507805cd74f884f8fef772153d12e2"}
Jul 13 18:58:35.761188 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:35.761152    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hwqhc" event={"ID":"7ae2e1d0-8a16-4821-9cb7-353862cfbec8","Type":"ContainerStarted","Data":"53636d255d3162097e3ce0e4ee112b776b7df7af66947275e1b3291d5ae8c12a"}
Jul 13 18:58:35.763355 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:35.763319    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nkdq7" event={"ID":"b26f5a70-1ec7-4056-9658-25878216543f","Type":"ContainerStarted","Data":"bbb9b248a4882a637cbede29f0c9ed1eedc52d56d61d69f12d5064e125c7d251"}
Jul 13 18:58:35.765734 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:35.765706    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9dvlb" event={"ID":"f7a4ace4-0eef-464d-b901-09b2f03f6f05","Type":"ContainerStarted","Data":"d9561aa9a738c014d0a0ecc203ad0f7d68ab435c0286b8b0d36529fe0072353e"}
Jul 13 18:58:35.767423 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:35.767394    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-mrdlq" event={"ID":"07b6332f-faaf-46f8-9959-f74468d61647","Type":"ContainerStarted","Data":"da52cf3ae79290ccb2c3abb342e41886d64e6bfefaa019f23ed34bfdd7b3da31"}
Jul 13 18:58:35.768832 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:35.768807    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-n59kb" event={"ID":"7223a804-aca6-480f-9443-f129f82d33b5","Type":"ContainerStarted","Data":"c8476ca4385afef31753a16aa3fbab1f2f6ba7f8a112ef5fe50622a09ec0042f"}
Jul 13 18:58:35.770393 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:35.770366    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-jrzv2" event={"ID":"09aa4086-5243-477a-aa13-3b0c054d764a","Type":"ContainerStarted","Data":"1f8073fd8b4a71a334f4cc76e5086d503ec28e8e37a7b7c9f9f74ba384a85447"}
Jul 13 18:58:35.772122 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:35.772097    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-tvnk8" event={"ID":"4193271d-0ed3-4ea0-8b78-fcfe94025f66","Type":"ContainerStarted","Data":"a34d0bb10fcdc26db12201ebe1b408a56b8b46f135b45bcae2d2e438aa96801a"}
Jul 13 18:58:35.773924 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:35.773900    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-tm4bj" event={"ID":"dea817c3-e510-4cf3-86ef-852930ad3466","Type":"ContainerStarted","Data":"ce4ed91634656298e351ddfa46465d5afcda7f201518f874153afd9b44349dfd"}
Jul 13 18:58:36.230089 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:36.230041    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/aba89b91-cc04-4c11-8692-1c17006f5f7a-original-pull-secret\") pod \"global-pull-secret-syncer-b7ptz\" (UID: \"aba89b91-cc04-4c11-8692-1c17006f5f7a\") " pod="kube-system/global-pull-secret-syncer-b7ptz"
Jul 13 18:58:36.230304 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:36.230104    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/02bf7c85-7eab-4d14-8e16-562c3ee29573-metrics-certs\") pod \"network-metrics-daemon-8hrpw\" (UID: \"02bf7c85-7eab-4d14-8e16-562c3ee29573\") " pod="openshift-multus/network-metrics-daemon-8hrpw"
Jul 13 18:58:36.230366 ip-10-0-135-38 kubenswrapper[2563]: E0713 18:58:36.230300    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 13 18:58:36.230423 ip-10-0-135-38 kubenswrapper[2563]: E0713 18:58:36.230367    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/02bf7c85-7eab-4d14-8e16-562c3ee29573-metrics-certs podName:02bf7c85-7eab-4d14-8e16-562c3ee29573 nodeName:}" failed. No retries permitted until 2026-07-13 18:58:38.230347865 +0000 UTC m=+6.005224212 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/02bf7c85-7eab-4d14-8e16-562c3ee29573-metrics-certs") pod "network-metrics-daemon-8hrpw" (UID: "02bf7c85-7eab-4d14-8e16-562c3ee29573") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 13 18:58:36.230807 ip-10-0-135-38 kubenswrapper[2563]: E0713 18:58:36.230783    2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 13 18:58:36.230903 ip-10-0-135-38 kubenswrapper[2563]: E0713 18:58:36.230849    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aba89b91-cc04-4c11-8692-1c17006f5f7a-original-pull-secret podName:aba89b91-cc04-4c11-8692-1c17006f5f7a nodeName:}" failed. No retries permitted until 2026-07-13 18:58:38.23083266 +0000 UTC m=+6.005708994 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/aba89b91-cc04-4c11-8692-1c17006f5f7a-original-pull-secret") pod "global-pull-secret-syncer-b7ptz" (UID: "aba89b91-cc04-4c11-8692-1c17006f5f7a") : object "kube-system"/"original-pull-secret" not registered
Jul 13 18:58:36.331600 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:36.331529    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lc2ff\" (UniqueName: \"kubernetes.io/projected/c72f59c6-8ebc-447d-8b92-096dac42859f-kube-api-access-lc2ff\") pod \"network-check-target-vbjkv\" (UID: \"c72f59c6-8ebc-447d-8b92-096dac42859f\") " pod="openshift-network-diagnostics/network-check-target-vbjkv"
Jul 13 18:58:36.331793 ip-10-0-135-38 kubenswrapper[2563]: E0713 18:58:36.331754    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 13 18:58:36.331793 ip-10-0-135-38 kubenswrapper[2563]: E0713 18:58:36.331778    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 13 18:58:36.331793 ip-10-0-135-38 kubenswrapper[2563]: E0713 18:58:36.331790    2563 projected.go:196] Error preparing data for projected volume kube-api-access-lc2ff for pod openshift-network-diagnostics/network-check-target-vbjkv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 13 18:58:36.331932 ip-10-0-135-38 kubenswrapper[2563]: E0713 18:58:36.331853    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c72f59c6-8ebc-447d-8b92-096dac42859f-kube-api-access-lc2ff podName:c72f59c6-8ebc-447d-8b92-096dac42859f nodeName:}" failed. No retries permitted until 2026-07-13 18:58:38.33183443 +0000 UTC m=+6.106710769 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-lc2ff" (UniqueName: "kubernetes.io/projected/c72f59c6-8ebc-447d-8b92-096dac42859f-kube-api-access-lc2ff") pod "network-check-target-vbjkv" (UID: "c72f59c6-8ebc-447d-8b92-096dac42859f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 13 18:58:36.663510 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:36.663461    2563 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-12 18:53:34 +0000 UTC" deadline="2028-04-07 04:14:00.875194868 +0000 UTC"
Jul 13 18:58:36.663510 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:36.663507    2563 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15201h15m24.211693422s"
Jul 13 18:58:36.751945 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:36.751909    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vbjkv"
Jul 13 18:58:36.752123 ip-10-0-135-38 kubenswrapper[2563]: E0713 18:58:36.752072    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vbjkv" podUID="c72f59c6-8ebc-447d-8b92-096dac42859f"
Jul 13 18:58:36.752529 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:36.752507    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8hrpw"
Jul 13 18:58:36.752649 ip-10-0-135-38 kubenswrapper[2563]: E0713 18:58:36.752626    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8hrpw" podUID="02bf7c85-7eab-4d14-8e16-562c3ee29573"
Jul 13 18:58:37.750847 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:37.749993    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b7ptz"
Jul 13 18:58:37.750847 ip-10-0-135-38 kubenswrapper[2563]: E0713 18:58:37.750447    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b7ptz" podUID="aba89b91-cc04-4c11-8692-1c17006f5f7a"
Jul 13 18:58:37.788648 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:37.788606    2563 generic.go:356] "Generic (PLEG): container finished" podID="588e76b45ba8b873b684c4e7e4822233" containerID="c16f09039207cc3d75f5e05d7378cf59048c94ebeaf47c147050f4c89108d729" exitCode=0
Jul 13 18:58:37.788851 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:37.788714    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-38.ec2.internal" event={"ID":"588e76b45ba8b873b684c4e7e4822233","Type":"ContainerDied","Data":"c16f09039207cc3d75f5e05d7378cf59048c94ebeaf47c147050f4c89108d729"}
Jul 13 18:58:37.793538 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:37.793502    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-38.ec2.internal" event={"ID":"9c30996778b0a4a51abebd056dde6bd9","Type":"ContainerStarted","Data":"9d82caad05ab8734571bc6f74e132b759d9d6aa0b63cd9578fe394282aa85c77"}
Jul 13 18:58:37.842203 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:37.841853    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-38.ec2.internal" podStartSLOduration=4.841830603 podStartE2EDuration="4.841830603s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 18:58:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 18:58:37.840886753 +0000 UTC m=+5.615763108" watchObservedRunningTime="2026-07-13 18:58:37.841830603 +0000 UTC m=+5.616706959"
Jul 13 18:58:38.252175 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:38.252132    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/02bf7c85-7eab-4d14-8e16-562c3ee29573-metrics-certs\") pod \"network-metrics-daemon-8hrpw\" (UID: \"02bf7c85-7eab-4d14-8e16-562c3ee29573\") " pod="openshift-multus/network-metrics-daemon-8hrpw"
Jul 13 18:58:38.252387 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:38.252251    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/aba89b91-cc04-4c11-8692-1c17006f5f7a-original-pull-secret\") pod \"global-pull-secret-syncer-b7ptz\" (UID: \"aba89b91-cc04-4c11-8692-1c17006f5f7a\") " pod="kube-system/global-pull-secret-syncer-b7ptz"
Jul 13 18:58:38.252387 ip-10-0-135-38 kubenswrapper[2563]: E0713 18:58:38.252291    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 13 18:58:38.252387 ip-10-0-135-38 kubenswrapper[2563]: E0713 18:58:38.252358    2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 13 18:58:38.252387 ip-10-0-135-38 kubenswrapper[2563]: E0713 18:58:38.252376    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/02bf7c85-7eab-4d14-8e16-562c3ee29573-metrics-certs podName:02bf7c85-7eab-4d14-8e16-562c3ee29573 nodeName:}" failed. No retries permitted until 2026-07-13 18:58:42.252354118 +0000 UTC m=+10.027230472 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/02bf7c85-7eab-4d14-8e16-562c3ee29573-metrics-certs") pod "network-metrics-daemon-8hrpw" (UID: "02bf7c85-7eab-4d14-8e16-562c3ee29573") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 13 18:58:38.252604 ip-10-0-135-38 kubenswrapper[2563]: E0713 18:58:38.252409    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aba89b91-cc04-4c11-8692-1c17006f5f7a-original-pull-secret podName:aba89b91-cc04-4c11-8692-1c17006f5f7a nodeName:}" failed. No retries permitted until 2026-07-13 18:58:42.252393243 +0000 UTC m=+10.027269580 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/aba89b91-cc04-4c11-8692-1c17006f5f7a-original-pull-secret") pod "global-pull-secret-syncer-b7ptz" (UID: "aba89b91-cc04-4c11-8692-1c17006f5f7a") : object "kube-system"/"original-pull-secret" not registered
Jul 13 18:58:38.353449 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:38.353410    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lc2ff\" (UniqueName: \"kubernetes.io/projected/c72f59c6-8ebc-447d-8b92-096dac42859f-kube-api-access-lc2ff\") pod \"network-check-target-vbjkv\" (UID: \"c72f59c6-8ebc-447d-8b92-096dac42859f\") " pod="openshift-network-diagnostics/network-check-target-vbjkv"
Jul 13 18:58:38.353653 ip-10-0-135-38 kubenswrapper[2563]: E0713 18:58:38.353596    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 13 18:58:38.353653 ip-10-0-135-38 kubenswrapper[2563]: E0713 18:58:38.353614    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 13 18:58:38.353653 ip-10-0-135-38 kubenswrapper[2563]: E0713 18:58:38.353626    2563 projected.go:196] Error preparing data for projected volume kube-api-access-lc2ff for pod openshift-network-diagnostics/network-check-target-vbjkv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 13 18:58:38.353809 ip-10-0-135-38 kubenswrapper[2563]: E0713 18:58:38.353688    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c72f59c6-8ebc-447d-8b92-096dac42859f-kube-api-access-lc2ff podName:c72f59c6-8ebc-447d-8b92-096dac42859f nodeName:}" failed. No retries permitted until 2026-07-13 18:58:42.353668867 +0000 UTC m=+10.128545203 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-lc2ff" (UniqueName: "kubernetes.io/projected/c72f59c6-8ebc-447d-8b92-096dac42859f-kube-api-access-lc2ff") pod "network-check-target-vbjkv" (UID: "c72f59c6-8ebc-447d-8b92-096dac42859f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 13 18:58:38.751404 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:38.750929    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vbjkv"
Jul 13 18:58:38.751404 ip-10-0-135-38 kubenswrapper[2563]: E0713 18:58:38.751092    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vbjkv" podUID="c72f59c6-8ebc-447d-8b92-096dac42859f"
Jul 13 18:58:38.751910 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:38.750936    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8hrpw"
Jul 13 18:58:38.751910 ip-10-0-135-38 kubenswrapper[2563]: E0713 18:58:38.751588    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8hrpw" podUID="02bf7c85-7eab-4d14-8e16-562c3ee29573"
Jul 13 18:58:39.750056 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:39.749952    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b7ptz"
Jul 13 18:58:39.750252 ip-10-0-135-38 kubenswrapper[2563]: E0713 18:58:39.750146    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b7ptz" podUID="aba89b91-cc04-4c11-8692-1c17006f5f7a"
Jul 13 18:58:40.750334 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:40.750268    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vbjkv"
Jul 13 18:58:40.750334 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:40.750297    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8hrpw"
Jul 13 18:58:40.750874 ip-10-0-135-38 kubenswrapper[2563]: E0713 18:58:40.750428    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8hrpw" podUID="02bf7c85-7eab-4d14-8e16-562c3ee29573"
Jul 13 18:58:40.750874 ip-10-0-135-38 kubenswrapper[2563]: E0713 18:58:40.750792    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vbjkv" podUID="c72f59c6-8ebc-447d-8b92-096dac42859f"
Jul 13 18:58:41.750165 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:41.750098    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b7ptz"
Jul 13 18:58:41.750389 ip-10-0-135-38 kubenswrapper[2563]: E0713 18:58:41.750278    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b7ptz" podUID="aba89b91-cc04-4c11-8692-1c17006f5f7a"
Jul 13 18:58:42.290373 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:42.290327    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/aba89b91-cc04-4c11-8692-1c17006f5f7a-original-pull-secret\") pod \"global-pull-secret-syncer-b7ptz\" (UID: \"aba89b91-cc04-4c11-8692-1c17006f5f7a\") " pod="kube-system/global-pull-secret-syncer-b7ptz"
Jul 13 18:58:42.290567 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:42.290385    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/02bf7c85-7eab-4d14-8e16-562c3ee29573-metrics-certs\") pod \"network-metrics-daemon-8hrpw\" (UID: \"02bf7c85-7eab-4d14-8e16-562c3ee29573\") " pod="openshift-multus/network-metrics-daemon-8hrpw"
Jul 13 18:58:42.290567 ip-10-0-135-38 kubenswrapper[2563]: E0713 18:58:42.290509    2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 13 18:58:42.290567 ip-10-0-135-38 kubenswrapper[2563]: E0713 18:58:42.290539    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 13 18:58:42.290742 ip-10-0-135-38 kubenswrapper[2563]: E0713 18:58:42.290606    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aba89b91-cc04-4c11-8692-1c17006f5f7a-original-pull-secret podName:aba89b91-cc04-4c11-8692-1c17006f5f7a nodeName:}" failed. No retries permitted until 2026-07-13 18:58:50.29056755 +0000 UTC m=+18.065443902 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/aba89b91-cc04-4c11-8692-1c17006f5f7a-original-pull-secret") pod "global-pull-secret-syncer-b7ptz" (UID: "aba89b91-cc04-4c11-8692-1c17006f5f7a") : object "kube-system"/"original-pull-secret" not registered
Jul 13 18:58:42.290742 ip-10-0-135-38 kubenswrapper[2563]: E0713 18:58:42.290629    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/02bf7c85-7eab-4d14-8e16-562c3ee29573-metrics-certs podName:02bf7c85-7eab-4d14-8e16-562c3ee29573 nodeName:}" failed. No retries permitted until 2026-07-13 18:58:50.290617624 +0000 UTC m=+18.065493965 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/02bf7c85-7eab-4d14-8e16-562c3ee29573-metrics-certs") pod "network-metrics-daemon-8hrpw" (UID: "02bf7c85-7eab-4d14-8e16-562c3ee29573") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 13 18:58:42.391842 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:42.391803    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lc2ff\" (UniqueName: \"kubernetes.io/projected/c72f59c6-8ebc-447d-8b92-096dac42859f-kube-api-access-lc2ff\") pod \"network-check-target-vbjkv\" (UID: \"c72f59c6-8ebc-447d-8b92-096dac42859f\") " pod="openshift-network-diagnostics/network-check-target-vbjkv"
Jul 13 18:58:42.392067 ip-10-0-135-38 kubenswrapper[2563]: E0713 18:58:42.392041    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 13 18:58:42.392143 ip-10-0-135-38 kubenswrapper[2563]: E0713 18:58:42.392077    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 13 18:58:42.392143 ip-10-0-135-38 kubenswrapper[2563]: E0713 18:58:42.392103    2563 projected.go:196] Error preparing data for projected volume kube-api-access-lc2ff for pod openshift-network-diagnostics/network-check-target-vbjkv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 13 18:58:42.392252 ip-10-0-135-38 kubenswrapper[2563]: E0713 18:58:42.392184    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c72f59c6-8ebc-447d-8b92-096dac42859f-kube-api-access-lc2ff podName:c72f59c6-8ebc-447d-8b92-096dac42859f nodeName:}" failed. No retries permitted until 2026-07-13 18:58:50.392153602 +0000 UTC m=+18.167029951 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-lc2ff" (UniqueName: "kubernetes.io/projected/c72f59c6-8ebc-447d-8b92-096dac42859f-kube-api-access-lc2ff") pod "network-check-target-vbjkv" (UID: "c72f59c6-8ebc-447d-8b92-096dac42859f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 13 18:58:42.751402 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:42.750871    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vbjkv"
Jul 13 18:58:42.751402 ip-10-0-135-38 kubenswrapper[2563]: E0713 18:58:42.751008    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vbjkv" podUID="c72f59c6-8ebc-447d-8b92-096dac42859f"
Jul 13 18:58:42.751402 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:42.751286    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8hrpw"
Jul 13 18:58:42.752004 ip-10-0-135-38 kubenswrapper[2563]: E0713 18:58:42.751419    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8hrpw" podUID="02bf7c85-7eab-4d14-8e16-562c3ee29573"
Jul 13 18:58:43.750038 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:43.749996    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b7ptz"
Jul 13 18:58:43.750266 ip-10-0-135-38 kubenswrapper[2563]: E0713 18:58:43.750142    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b7ptz" podUID="aba89b91-cc04-4c11-8692-1c17006f5f7a"
Jul 13 18:58:44.750610 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:44.750567    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vbjkv"
Jul 13 18:58:44.751134 ip-10-0-135-38 kubenswrapper[2563]: E0713 18:58:44.750717    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vbjkv" podUID="c72f59c6-8ebc-447d-8b92-096dac42859f"
Jul 13 18:58:44.751260 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:44.751231    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8hrpw"
Jul 13 18:58:44.751386 ip-10-0-135-38 kubenswrapper[2563]: E0713 18:58:44.751364    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8hrpw" podUID="02bf7c85-7eab-4d14-8e16-562c3ee29573"
Jul 13 18:58:45.750157 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:45.750114    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b7ptz"
Jul 13 18:58:45.750399 ip-10-0-135-38 kubenswrapper[2563]: E0713 18:58:45.750316    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b7ptz" podUID="aba89b91-cc04-4c11-8692-1c17006f5f7a"
Jul 13 18:58:46.749629 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:46.749585    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vbjkv"
Jul 13 18:58:46.750116 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:46.749607    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8hrpw"
Jul 13 18:58:46.750116 ip-10-0-135-38 kubenswrapper[2563]: E0713 18:58:46.749751    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vbjkv" podUID="c72f59c6-8ebc-447d-8b92-096dac42859f"
Jul 13 18:58:46.750116 ip-10-0-135-38 kubenswrapper[2563]: E0713 18:58:46.749798    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8hrpw" podUID="02bf7c85-7eab-4d14-8e16-562c3ee29573"
Jul 13 18:58:47.750147 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:47.750084    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b7ptz"
Jul 13 18:58:47.750587 ip-10-0-135-38 kubenswrapper[2563]: E0713 18:58:47.750234    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b7ptz" podUID="aba89b91-cc04-4c11-8692-1c17006f5f7a"
Jul 13 18:58:48.749971 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:48.749933    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8hrpw"
Jul 13 18:58:48.750208 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:48.749933    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vbjkv"
Jul 13 18:58:48.750208 ip-10-0-135-38 kubenswrapper[2563]: E0713 18:58:48.750131    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8hrpw" podUID="02bf7c85-7eab-4d14-8e16-562c3ee29573"
Jul 13 18:58:48.750630 ip-10-0-135-38 kubenswrapper[2563]: E0713 18:58:48.750267    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vbjkv" podUID="c72f59c6-8ebc-447d-8b92-096dac42859f"
Jul 13 18:58:49.750331 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:49.750309    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b7ptz"
Jul 13 18:58:49.750651 ip-10-0-135-38 kubenswrapper[2563]: E0713 18:58:49.750443    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b7ptz" podUID="aba89b91-cc04-4c11-8692-1c17006f5f7a"
Jul 13 18:58:50.358512 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:50.358462    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/aba89b91-cc04-4c11-8692-1c17006f5f7a-original-pull-secret\") pod \"global-pull-secret-syncer-b7ptz\" (UID: \"aba89b91-cc04-4c11-8692-1c17006f5f7a\") " pod="kube-system/global-pull-secret-syncer-b7ptz"
Jul 13 18:58:50.358512 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:50.358518    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/02bf7c85-7eab-4d14-8e16-562c3ee29573-metrics-certs\") pod \"network-metrics-daemon-8hrpw\" (UID: \"02bf7c85-7eab-4d14-8e16-562c3ee29573\") " pod="openshift-multus/network-metrics-daemon-8hrpw"
Jul 13 18:58:50.358761 ip-10-0-135-38 kubenswrapper[2563]: E0713 18:58:50.358667    2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 13 18:58:50.358761 ip-10-0-135-38 kubenswrapper[2563]: E0713 18:58:50.358678    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 13 18:58:50.358847 ip-10-0-135-38 kubenswrapper[2563]: E0713 18:58:50.358762    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aba89b91-cc04-4c11-8692-1c17006f5f7a-original-pull-secret podName:aba89b91-cc04-4c11-8692-1c17006f5f7a nodeName:}" failed. No retries permitted until 2026-07-13 18:59:06.358740226 +0000 UTC m=+34.133616588 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/aba89b91-cc04-4c11-8692-1c17006f5f7a-original-pull-secret") pod "global-pull-secret-syncer-b7ptz" (UID: "aba89b91-cc04-4c11-8692-1c17006f5f7a") : object "kube-system"/"original-pull-secret" not registered
Jul 13 18:58:50.358903 ip-10-0-135-38 kubenswrapper[2563]: E0713 18:58:50.358849    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/02bf7c85-7eab-4d14-8e16-562c3ee29573-metrics-certs podName:02bf7c85-7eab-4d14-8e16-562c3ee29573 nodeName:}" failed. No retries permitted until 2026-07-13 18:59:06.358819662 +0000 UTC m=+34.133696000 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/02bf7c85-7eab-4d14-8e16-562c3ee29573-metrics-certs") pod "network-metrics-daemon-8hrpw" (UID: "02bf7c85-7eab-4d14-8e16-562c3ee29573") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 13 18:58:50.459230 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:50.459192    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lc2ff\" (UniqueName: \"kubernetes.io/projected/c72f59c6-8ebc-447d-8b92-096dac42859f-kube-api-access-lc2ff\") pod \"network-check-target-vbjkv\" (UID: \"c72f59c6-8ebc-447d-8b92-096dac42859f\") " pod="openshift-network-diagnostics/network-check-target-vbjkv"
Jul 13 18:58:50.459419 ip-10-0-135-38 kubenswrapper[2563]: E0713 18:58:50.459357    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 13 18:58:50.459419 ip-10-0-135-38 kubenswrapper[2563]: E0713 18:58:50.459376    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 13 18:58:50.459419 ip-10-0-135-38 kubenswrapper[2563]: E0713 18:58:50.459391    2563 projected.go:196] Error preparing data for projected volume kube-api-access-lc2ff for pod openshift-network-diagnostics/network-check-target-vbjkv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 13 18:58:50.459578 ip-10-0-135-38 kubenswrapper[2563]: E0713 18:58:50.459457    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c72f59c6-8ebc-447d-8b92-096dac42859f-kube-api-access-lc2ff podName:c72f59c6-8ebc-447d-8b92-096dac42859f nodeName:}" failed. No retries permitted until 2026-07-13 18:59:06.459437753 +0000 UTC m=+34.234314101 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-lc2ff" (UniqueName: "kubernetes.io/projected/c72f59c6-8ebc-447d-8b92-096dac42859f-kube-api-access-lc2ff") pod "network-check-target-vbjkv" (UID: "c72f59c6-8ebc-447d-8b92-096dac42859f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 13 18:58:50.750648 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:50.750547    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vbjkv"
Jul 13 18:58:50.751174 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:50.750547    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8hrpw"
Jul 13 18:58:50.751174 ip-10-0-135-38 kubenswrapper[2563]: E0713 18:58:50.750696    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vbjkv" podUID="c72f59c6-8ebc-447d-8b92-096dac42859f"
Jul 13 18:58:50.751174 ip-10-0-135-38 kubenswrapper[2563]: E0713 18:58:50.750744    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8hrpw" podUID="02bf7c85-7eab-4d14-8e16-562c3ee29573"
Jul 13 18:58:51.750269 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:51.750222    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b7ptz"
Jul 13 18:58:51.750478 ip-10-0-135-38 kubenswrapper[2563]: E0713 18:58:51.750370    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b7ptz" podUID="aba89b91-cc04-4c11-8692-1c17006f5f7a"
Jul 13 18:58:52.750755 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:52.750689    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vbjkv"
Jul 13 18:58:52.751341 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:52.750780    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8hrpw"
Jul 13 18:58:52.751341 ip-10-0-135-38 kubenswrapper[2563]: E0713 18:58:52.750799    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vbjkv" podUID="c72f59c6-8ebc-447d-8b92-096dac42859f"
Jul 13 18:58:52.751341 ip-10-0-135-38 kubenswrapper[2563]: E0713 18:58:52.750914    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8hrpw" podUID="02bf7c85-7eab-4d14-8e16-562c3ee29573"
Jul 13 18:58:53.750251 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:53.749673    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b7ptz"
Jul 13 18:58:53.750251 ip-10-0-135-38 kubenswrapper[2563]: E0713 18:58:53.749771    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b7ptz" podUID="aba89b91-cc04-4c11-8692-1c17006f5f7a"
Jul 13 18:58:53.829872 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:53.829566    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-tvnk8" event={"ID":"4193271d-0ed3-4ea0-8b78-fcfe94025f66","Type":"ContainerStarted","Data":"a701fcafbd24231f00bd1874625e285a7b81fdf0c4b0823a8993c6cd70d455c9"}
Jul 13 18:58:53.832084 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:53.831977    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-tm4bj" event={"ID":"dea817c3-e510-4cf3-86ef-852930ad3466","Type":"ContainerStarted","Data":"47a8e33a847b57ffaefb162482be5cc761c192b44dc347cecee6ba8bc652fee9"}
Jul 13 18:58:53.833639 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:53.833606    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-ghl52" event={"ID":"f5d7f580-f8e8-42f5-8d25-0fdb212f30c8","Type":"ContainerStarted","Data":"20a8fbe5533e60f7af9c1f92991ee4bd174d2fdb83d62399a3598f7d181fe39a"}
Jul 13 18:58:53.836079 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:53.836048    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hwqhc" event={"ID":"7ae2e1d0-8a16-4821-9cb7-353862cfbec8","Type":"ContainerStarted","Data":"92ac1e18d63e0704a1ca595f6a705a624b9690bb545e61e91d63d9dce1b931a2"}
Jul 13 18:58:53.838696 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:53.838616    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nkdq7" event={"ID":"b26f5a70-1ec7-4056-9658-25878216543f","Type":"ContainerStarted","Data":"cf92a6f110ee7ec1bf3a209e8f17bf03d0bc70f3e2e1af4bab0bcd1c3e99113a"}
Jul 13 18:58:53.841407 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:53.841371    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-38.ec2.internal" event={"ID":"588e76b45ba8b873b684c4e7e4822233","Type":"ContainerStarted","Data":"4bf92e871eb884fad2bcd8a61b1b1a656929234fbe12cb51dad1d5762ea6e2dd"}
Jul 13 18:58:53.843502 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:53.843469    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9dvlb" event={"ID":"f7a4ace4-0eef-464d-b901-09b2f03f6f05","Type":"ContainerStarted","Data":"30b40f1b745b90759f8a669eccd86f41c4b2961404678f5cee962713a8320e9c"}
Jul 13 18:58:53.845786 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:53.845760    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-n59kb" event={"ID":"7223a804-aca6-480f-9443-f129f82d33b5","Type":"ContainerStarted","Data":"3bd5b6fba5ec8a8cc2cf89e09e8f14be2d509ce5eb94abb5f545d090b570e165"}
Jul 13 18:58:53.847650 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:53.847624    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-jrzv2" event={"ID":"09aa4086-5243-477a-aa13-3b0c054d764a","Type":"ContainerStarted","Data":"e826f9e0b877f9818d6a4d71f93e83f7b6e00a6a5a1f2512ba39545f831ac02f"}
Jul 13 18:58:53.882363 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:53.882301    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-tvnk8" podStartSLOduration=3.219011771 podStartE2EDuration="21.882282232s" totalImagesPullingTime="18.663270461s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 18:58:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 18:58:53.858365543 +0000 UTC m=+21.633241899" watchObservedRunningTime="2026-07-13 18:58:53.882282232 +0000 UTC m=+21.657158587"
Jul 13 18:58:53.907270 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:53.907217    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-tm4bj" podStartSLOduration=3.173036899 podStartE2EDuration="21.907200597s" totalImagesPullingTime="18.734163698s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 18:58:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 18:58:53.882633757 +0000 UTC m=+21.657510113" watchObservedRunningTime="2026-07-13 18:58:53.907200597 +0000 UTC m=+21.682077035"
Jul 13 18:58:53.923407 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:53.923336    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-n59kb" podStartSLOduration=3.288716823 podStartE2EDuration="21.923298445s" totalImagesPullingTime="18.634581622s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 18:58:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 18:58:53.92253222 +0000 UTC m=+21.697408588" watchObservedRunningTime="2026-07-13 18:58:53.923298445 +0000 UTC m=+21.698174803"
Jul 13 18:58:53.937378 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:53.937328    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-ghl52" podStartSLOduration=7.151149576 podStartE2EDuration="21.937311404s" totalImagesPullingTime="14.786161828s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 18:58:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 18:58:53.937144945 +0000 UTC m=+21.712021301" watchObservedRunningTime="2026-07-13 18:58:53.937311404 +0000 UTC m=+21.712187760"
Jul 13 18:58:53.982311 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:53.982258    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-38.ec2.internal" podStartSLOduration=20.982240057 podStartE2EDuration="20.982240057s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 18:58:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 18:58:53.961220994 +0000 UTC m=+21.736097349" watchObservedRunningTime="2026-07-13 18:58:53.982240057 +0000 UTC m=+21.757116413"
Jul 13 18:58:54.750639 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:54.750426    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vbjkv"
Jul 13 18:58:54.750881 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:54.750438    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8hrpw"
Jul 13 18:58:54.750881 ip-10-0-135-38 kubenswrapper[2563]: E0713 18:58:54.750748    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vbjkv" podUID="c72f59c6-8ebc-447d-8b92-096dac42859f"
Jul 13 18:58:54.750881 ip-10-0-135-38 kubenswrapper[2563]: E0713 18:58:54.750835    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8hrpw" podUID="02bf7c85-7eab-4d14-8e16-562c3ee29573"
Jul 13 18:58:54.854389 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:54.854354    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hwqhc_7ae2e1d0-8a16-4821-9cb7-353862cfbec8/ovn-acl-logging/0.log"
Jul 13 18:58:54.855155 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:54.854953    2563 generic.go:356] "Generic (PLEG): container finished" podID="7ae2e1d0-8a16-4821-9cb7-353862cfbec8" containerID="b0b061c2d98545687d4e23c4e781641268a1acd5e51442ab22178670cf4a2baf" exitCode=1
Jul 13 18:58:54.855155 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:54.855064    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hwqhc" event={"ID":"7ae2e1d0-8a16-4821-9cb7-353862cfbec8","Type":"ContainerStarted","Data":"ee3338409a144e2f6c028a3407efa322ecad1d7407dfbe1a89ef02039e418d88"}
Jul 13 18:58:54.855155 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:54.855141    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hwqhc" event={"ID":"7ae2e1d0-8a16-4821-9cb7-353862cfbec8","Type":"ContainerStarted","Data":"0e6faa53db7ae64061e250eb77d9581ee7548c48da403653787f6d1c1e44b438"}
Jul 13 18:58:54.855287 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:54.855188    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hwqhc" event={"ID":"7ae2e1d0-8a16-4821-9cb7-353862cfbec8","Type":"ContainerStarted","Data":"4ef12c37e006b642228d4d4d4bf7992a2ce1a45941349884032d24034af287ae"}
Jul 13 18:58:54.855287 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:54.855248    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hwqhc" event={"ID":"7ae2e1d0-8a16-4821-9cb7-353862cfbec8","Type":"ContainerStarted","Data":"59c0c39c7f7edee6962e681c50e11bd9f0b0f50ae89cb7e7c04205453cc3071d"}
Jul 13 18:58:54.855390 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:54.855299    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hwqhc" event={"ID":"7ae2e1d0-8a16-4821-9cb7-353862cfbec8","Type":"ContainerDied","Data":"b0b061c2d98545687d4e23c4e781641268a1acd5e51442ab22178670cf4a2baf"}
Jul 13 18:58:54.857068 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:54.857011    2563 generic.go:356] "Generic (PLEG): container finished" podID="b26f5a70-1ec7-4056-9658-25878216543f" containerID="cf92a6f110ee7ec1bf3a209e8f17bf03d0bc70f3e2e1af4bab0bcd1c3e99113a" exitCode=0
Jul 13 18:58:54.857218 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:54.857149    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nkdq7" event={"ID":"b26f5a70-1ec7-4056-9658-25878216543f","Type":"ContainerDied","Data":"cf92a6f110ee7ec1bf3a209e8f17bf03d0bc70f3e2e1af4bab0bcd1c3e99113a"}
Jul 13 18:58:54.878791 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:54.878733    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-jrzv2" podStartSLOduration=8.056481512 podStartE2EDuration="22.87871532s" totalImagesPullingTime="14.822233808s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 18:58:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 18:58:53.982779524 +0000 UTC m=+21.757655880" watchObservedRunningTime="2026-07-13 18:58:54.87871532 +0000 UTC m=+22.653591677"
Jul 13 18:58:55.050408 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:55.050268    2563 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 13 18:58:55.685097 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:55.684891    2563 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-13T18:58:55.050283496Z","UUID":"6e72b544-14ec-4bd5-a48a-5b2cf950b761","Handler":null,"Name":"","Endpoint":""}
Jul 13 18:58:55.686845 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:55.686812    2563 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 13 18:58:55.687011 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:55.686866    2563 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 13 18:58:55.750467 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:55.750415    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b7ptz"
Jul 13 18:58:55.750740 ip-10-0-135-38 kubenswrapper[2563]: E0713 18:58:55.750558    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b7ptz" podUID="aba89b91-cc04-4c11-8692-1c17006f5f7a"
Jul 13 18:58:55.862077 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:55.862012    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9dvlb" event={"ID":"f7a4ace4-0eef-464d-b901-09b2f03f6f05","Type":"ContainerStarted","Data":"49c17ab369b65902a538c8e3b59f4f1359ca8e79287d38a861b23f6e80df9c28"}
Jul 13 18:58:55.863858 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:55.863829    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-mrdlq" event={"ID":"07b6332f-faaf-46f8-9959-f74468d61647","Type":"ContainerStarted","Data":"b761e89a4b825a14194dcd70a572af2d5c59a5f8f1c1700602ad7b3cfc52af7d"}
Jul 13 18:58:55.880137 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:55.880083    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-mrdlq" podStartSLOduration=5.253171949 podStartE2EDuration="23.880062742s" totalImagesPullingTime="18.626890793s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 18:58:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 18:58:55.879649323 +0000 UTC m=+23.654525678" watchObservedRunningTime="2026-07-13 18:58:55.880062742 +0000 UTC m=+23.654939097"
Jul 13 18:58:56.750604 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:56.750353    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vbjkv"
Jul 13 18:58:56.750809 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:56.750358    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8hrpw"
Jul 13 18:58:56.750809 ip-10-0-135-38 kubenswrapper[2563]: E0713 18:58:56.750724    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vbjkv" podUID="c72f59c6-8ebc-447d-8b92-096dac42859f"
Jul 13 18:58:56.750939 ip-10-0-135-38 kubenswrapper[2563]: E0713 18:58:56.750832    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8hrpw" podUID="02bf7c85-7eab-4d14-8e16-562c3ee29573"
Jul 13 18:58:56.868489 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:56.868448    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9dvlb" event={"ID":"f7a4ace4-0eef-464d-b901-09b2f03f6f05","Type":"ContainerStarted","Data":"f416268f2a5cf0070499eedf94d41859f4c164615cf77bef57bace4114a499bf"}
Jul 13 18:58:56.872169 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:56.872138    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hwqhc_7ae2e1d0-8a16-4821-9cb7-353862cfbec8/ovn-acl-logging/0.log"
Jul 13 18:58:56.872684 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:56.872643    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hwqhc" event={"ID":"7ae2e1d0-8a16-4821-9cb7-353862cfbec8","Type":"ContainerStarted","Data":"5e95277468dc5de07380a205df9ebf95fcafd38584dbdabc1f348b485f7facba"}
Jul 13 18:58:56.885876 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:56.885812    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9dvlb" podStartSLOduration=3.8334535069999998 podStartE2EDuration="24.885790163s" totalImagesPullingTime="21.052336656s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 18:58:32 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 18:58:56.88526638 +0000 UTC m=+24.660142736" watchObservedRunningTime="2026-07-13 18:58:56.885790163 +0000 UTC m=+24.660666518"
Jul 13 18:58:57.132031 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:57.131976    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-n59kb"
Jul 13 18:58:57.132755 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:57.132725    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-n59kb"
Jul 13 18:58:57.749604 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:57.749568    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b7ptz"
Jul 13 18:58:57.749858 ip-10-0-135-38 kubenswrapper[2563]: E0713 18:58:57.749715    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b7ptz" podUID="aba89b91-cc04-4c11-8692-1c17006f5f7a"
Jul 13 18:58:57.875392 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:57.875361    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-n59kb"
Jul 13 18:58:57.875973 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:57.875732    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-n59kb"
Jul 13 18:58:58.750220 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:58.750118    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vbjkv"
Jul 13 18:58:58.750220 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:58.750153    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8hrpw"
Jul 13 18:58:58.750420 ip-10-0-135-38 kubenswrapper[2563]: E0713 18:58:58.750259    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vbjkv" podUID="c72f59c6-8ebc-447d-8b92-096dac42859f"
Jul 13 18:58:58.750420 ip-10-0-135-38 kubenswrapper[2563]: E0713 18:58:58.750390    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8hrpw" podUID="02bf7c85-7eab-4d14-8e16-562c3ee29573"
Jul 13 18:58:59.750573 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:59.750361    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b7ptz"
Jul 13 18:58:59.751245 ip-10-0-135-38 kubenswrapper[2563]: E0713 18:58:59.750652    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b7ptz" podUID="aba89b91-cc04-4c11-8692-1c17006f5f7a"
Jul 13 18:58:59.883606 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:59.883577    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hwqhc_7ae2e1d0-8a16-4821-9cb7-353862cfbec8/ovn-acl-logging/0.log"
Jul 13 18:58:59.883952 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:59.883929    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hwqhc" event={"ID":"7ae2e1d0-8a16-4821-9cb7-353862cfbec8","Type":"ContainerStarted","Data":"e3bad38e2c449e1efbc5253c14a28c13d9131f81256769bd9376b36fc6949469"}
Jul 13 18:58:59.884251 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:59.884234    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-hwqhc"
Jul 13 18:58:59.884359 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:59.884314    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-hwqhc"
Jul 13 18:58:59.884579 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:59.884561    2563 scope.go:117] "RemoveContainer" containerID="b0b061c2d98545687d4e23c4e781641268a1acd5e51442ab22178670cf4a2baf"
Jul 13 18:58:59.886128 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:59.886079    2563 generic.go:356] "Generic (PLEG): container finished" podID="b26f5a70-1ec7-4056-9658-25878216543f" containerID="e3f80c638bb85da965b262aebc0ecfb8c717d0c21b1efcc186e2016ebd3403b9" exitCode=0
Jul 13 18:58:59.886210 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:59.886160    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nkdq7" event={"ID":"b26f5a70-1ec7-4056-9658-25878216543f","Type":"ContainerDied","Data":"e3f80c638bb85da965b262aebc0ecfb8c717d0c21b1efcc186e2016ebd3403b9"}
Jul 13 18:58:59.901888 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:58:59.901860    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-hwqhc"
Jul 13 18:59:00.750507 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:59:00.750458    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8hrpw"
Jul 13 18:59:00.750507 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:59:00.750497    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vbjkv"
Jul 13 18:59:00.750903 ip-10-0-135-38 kubenswrapper[2563]: E0713 18:59:00.750619    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8hrpw" podUID="02bf7c85-7eab-4d14-8e16-562c3ee29573"
Jul 13 18:59:00.750903 ip-10-0-135-38 kubenswrapper[2563]: E0713 18:59:00.750734    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vbjkv" podUID="c72f59c6-8ebc-447d-8b92-096dac42859f"
Jul 13 18:59:00.892717 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:59:00.892691    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hwqhc_7ae2e1d0-8a16-4821-9cb7-353862cfbec8/ovn-acl-logging/0.log"
Jul 13 18:59:00.893157 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:59:00.893128    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hwqhc" event={"ID":"7ae2e1d0-8a16-4821-9cb7-353862cfbec8","Type":"ContainerStarted","Data":"fd197aa106bd13b304ec9f523e5a08ea66e2b09e2adcabe07469d5c2537e71d6"}
Jul 13 18:59:00.893511 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:59:00.893490    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-hwqhc"
Jul 13 18:59:00.914982 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:59:00.914948    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-hwqhc"
Jul 13 18:59:00.926819 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:59:00.926778    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-hwqhc" podStartSLOduration=10.207049178 podStartE2EDuration="28.926751989s" totalImagesPullingTime="18.719702811s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 18:58:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 18:59:00.925931565 +0000 UTC m=+28.700807920" watchObservedRunningTime="2026-07-13 18:59:00.926751989 +0000 UTC m=+28.701628344"
Jul 13 18:59:00.943960 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:59:00.943929    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-vbjkv"]
Jul 13 18:59:00.944123 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:59:00.944085    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vbjkv"
Jul 13 18:59:00.944227 ip-10-0-135-38 kubenswrapper[2563]: E0713 18:59:00.944204    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vbjkv" podUID="c72f59c6-8ebc-447d-8b92-096dac42859f"
Jul 13 18:59:00.946575 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:59:00.946550    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-8hrpw"]
Jul 13 18:59:00.946708 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:59:00.946635    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8hrpw"
Jul 13 18:59:00.946766 ip-10-0-135-38 kubenswrapper[2563]: E0713 18:59:00.946721    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8hrpw" podUID="02bf7c85-7eab-4d14-8e16-562c3ee29573"
Jul 13 18:59:00.974574 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:59:00.974318    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-b7ptz"]
Jul 13 18:59:00.975083 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:59:00.975057    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b7ptz"
Jul 13 18:59:00.975218 ip-10-0-135-38 kubenswrapper[2563]: E0713 18:59:00.975188    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b7ptz" podUID="aba89b91-cc04-4c11-8692-1c17006f5f7a"
Jul 13 18:59:01.897951 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:59:01.897914    2563 generic.go:356] "Generic (PLEG): container finished" podID="b26f5a70-1ec7-4056-9658-25878216543f" containerID="6f773809ef97313e60a6c516136c840965e1334dee1978f5efc5f0f02d794e27" exitCode=0
Jul 13 18:59:01.898501 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:59:01.897992    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nkdq7" event={"ID":"b26f5a70-1ec7-4056-9658-25878216543f","Type":"ContainerDied","Data":"6f773809ef97313e60a6c516136c840965e1334dee1978f5efc5f0f02d794e27"}
Jul 13 18:59:02.750876 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:59:02.750833    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8hrpw"
Jul 13 18:59:02.750876 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:59:02.750878    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b7ptz"
Jul 13 18:59:02.751159 ip-10-0-135-38 kubenswrapper[2563]: E0713 18:59:02.750947    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8hrpw" podUID="02bf7c85-7eab-4d14-8e16-562c3ee29573"
Jul 13 18:59:02.751159 ip-10-0-135-38 kubenswrapper[2563]: E0713 18:59:02.751000    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b7ptz" podUID="aba89b91-cc04-4c11-8692-1c17006f5f7a"
Jul 13 18:59:02.751159 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:59:02.751050    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vbjkv"
Jul 13 18:59:02.751159 ip-10-0-135-38 kubenswrapper[2563]: E0713 18:59:02.751122    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vbjkv" podUID="c72f59c6-8ebc-447d-8b92-096dac42859f"
Jul 13 18:59:03.904358 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:59:03.904315    2563 generic.go:356] "Generic (PLEG): container finished" podID="b26f5a70-1ec7-4056-9658-25878216543f" containerID="9065f3a6c87b34cdd3602ae20c70b564a3d1ea19ca49ca56c1b17b87264b398f" exitCode=0
Jul 13 18:59:03.904358 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:59:03.904349    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nkdq7" event={"ID":"b26f5a70-1ec7-4056-9658-25878216543f","Type":"ContainerDied","Data":"9065f3a6c87b34cdd3602ae20c70b564a3d1ea19ca49ca56c1b17b87264b398f"}
Jul 13 18:59:04.750283 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:59:04.750212    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vbjkv"
Jul 13 18:59:04.750493 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:59:04.750222    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b7ptz"
Jul 13 18:59:04.750493 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:59:04.750349    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8hrpw"
Jul 13 18:59:04.750493 ip-10-0-135-38 kubenswrapper[2563]: E0713 18:59:04.750343    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vbjkv" podUID="c72f59c6-8ebc-447d-8b92-096dac42859f"
Jul 13 18:59:04.750493 ip-10-0-135-38 kubenswrapper[2563]: E0713 18:59:04.750473    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b7ptz" podUID="aba89b91-cc04-4c11-8692-1c17006f5f7a"
Jul 13 18:59:04.750681 ip-10-0-135-38 kubenswrapper[2563]: E0713 18:59:04.750584    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8hrpw" podUID="02bf7c85-7eab-4d14-8e16-562c3ee29573"
Jul 13 18:59:05.568652 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:59:05.568624    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-jrzv2_09aa4086-5243-477a-aa13-3b0c054d764a/dns-node-resolver/0.log"
Jul 13 18:59:06.135570 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:59:06.135290    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-ghl52_f5d7f580-f8e8-42f5-8d25-0fdb212f30c8/node-ca/0.log"
Jul 13 18:59:06.378734 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:59:06.378640    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/aba89b91-cc04-4c11-8692-1c17006f5f7a-original-pull-secret\") pod \"global-pull-secret-syncer-b7ptz\" (UID: \"aba89b91-cc04-4c11-8692-1c17006f5f7a\") " pod="kube-system/global-pull-secret-syncer-b7ptz"
Jul 13 18:59:06.378734 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:59:06.378691    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/02bf7c85-7eab-4d14-8e16-562c3ee29573-metrics-certs\") pod \"network-metrics-daemon-8hrpw\" (UID: \"02bf7c85-7eab-4d14-8e16-562c3ee29573\") " pod="openshift-multus/network-metrics-daemon-8hrpw"
Jul 13 18:59:06.378942 ip-10-0-135-38 kubenswrapper[2563]: E0713 18:59:06.378794    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 13 18:59:06.378942 ip-10-0-135-38 kubenswrapper[2563]: E0713 18:59:06.378795    2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 13 18:59:06.378942 ip-10-0-135-38 kubenswrapper[2563]: E0713 18:59:06.378857    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/02bf7c85-7eab-4d14-8e16-562c3ee29573-metrics-certs podName:02bf7c85-7eab-4d14-8e16-562c3ee29573 nodeName:}" failed. No retries permitted until 2026-07-13 18:59:38.378839435 +0000 UTC m=+66.153715770 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/02bf7c85-7eab-4d14-8e16-562c3ee29573-metrics-certs") pod "network-metrics-daemon-8hrpw" (UID: "02bf7c85-7eab-4d14-8e16-562c3ee29573") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 13 18:59:06.378942 ip-10-0-135-38 kubenswrapper[2563]: E0713 18:59:06.378870    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aba89b91-cc04-4c11-8692-1c17006f5f7a-original-pull-secret podName:aba89b91-cc04-4c11-8692-1c17006f5f7a nodeName:}" failed. No retries permitted until 2026-07-13 18:59:38.37886407 +0000 UTC m=+66.153740404 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/aba89b91-cc04-4c11-8692-1c17006f5f7a-original-pull-secret") pod "global-pull-secret-syncer-b7ptz" (UID: "aba89b91-cc04-4c11-8692-1c17006f5f7a") : object "kube-system"/"original-pull-secret" not registered
Jul 13 18:59:06.479590 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:59:06.479558    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lc2ff\" (UniqueName: \"kubernetes.io/projected/c72f59c6-8ebc-447d-8b92-096dac42859f-kube-api-access-lc2ff\") pod \"network-check-target-vbjkv\" (UID: \"c72f59c6-8ebc-447d-8b92-096dac42859f\") " pod="openshift-network-diagnostics/network-check-target-vbjkv"
Jul 13 18:59:06.479765 ip-10-0-135-38 kubenswrapper[2563]: E0713 18:59:06.479689    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 13 18:59:06.479765 ip-10-0-135-38 kubenswrapper[2563]: E0713 18:59:06.479706    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 13 18:59:06.479765 ip-10-0-135-38 kubenswrapper[2563]: E0713 18:59:06.479716    2563 projected.go:196] Error preparing data for projected volume kube-api-access-lc2ff for pod openshift-network-diagnostics/network-check-target-vbjkv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 13 18:59:06.479875 ip-10-0-135-38 kubenswrapper[2563]: E0713 18:59:06.479773    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c72f59c6-8ebc-447d-8b92-096dac42859f-kube-api-access-lc2ff podName:c72f59c6-8ebc-447d-8b92-096dac42859f nodeName:}" failed. No retries permitted until 2026-07-13 18:59:38.479754423 +0000 UTC m=+66.254630758 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-lc2ff" (UniqueName: "kubernetes.io/projected/c72f59c6-8ebc-447d-8b92-096dac42859f-kube-api-access-lc2ff") pod "network-check-target-vbjkv" (UID: "c72f59c6-8ebc-447d-8b92-096dac42859f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 13 18:59:06.535435 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:59:06.535397    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-38.ec2.internal" event="NodeReady"
Jul 13 18:59:06.535617 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:59:06.535576    2563 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 13 18:59:06.750428 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:59:06.750295    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b7ptz"
Jul 13 18:59:06.750428 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:59:06.750295    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8hrpw"
Jul 13 18:59:06.750951 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:59:06.750494    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vbjkv"
Jul 13 18:59:06.753096 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:59:06.753070    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 13 18:59:06.753096 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:59:06.753075    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 13 18:59:06.753305 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:59:06.753075    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-bqf9d\""
Jul 13 18:59:06.753514 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:59:06.753494    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 13 18:59:06.753614 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:59:06.753571    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-cvxxg\""
Jul 13 18:59:06.753614 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:59:06.753590    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 13 18:59:08.920681 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:59:08.920643    2563 generic.go:356] "Generic (PLEG): container finished" podID="b26f5a70-1ec7-4056-9658-25878216543f" containerID="a593e1279b483b848b6f082dd1f0a4f9240d1b8db65b940bf394d2ac8cd9601c" exitCode=0
Jul 13 18:59:08.921091 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:59:08.920691    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nkdq7" event={"ID":"b26f5a70-1ec7-4056-9658-25878216543f","Type":"ContainerDied","Data":"a593e1279b483b848b6f082dd1f0a4f9240d1b8db65b940bf394d2ac8cd9601c"}
Jul 13 18:59:09.926748 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:59:09.926710    2563 generic.go:356] "Generic (PLEG): container finished" podID="b26f5a70-1ec7-4056-9658-25878216543f" containerID="07b48d32e068463505e5399c8cbee6800616ca6cbd299a97947741a8e827f703" exitCode=0
Jul 13 18:59:09.927166 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:59:09.926759    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nkdq7" event={"ID":"b26f5a70-1ec7-4056-9658-25878216543f","Type":"ContainerDied","Data":"07b48d32e068463505e5399c8cbee6800616ca6cbd299a97947741a8e827f703"}
Jul 13 18:59:10.933096 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:59:10.933061    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nkdq7" event={"ID":"b26f5a70-1ec7-4056-9658-25878216543f","Type":"ContainerStarted","Data":"fa4ed3035c33b574a19fbc317843491fcc0c67aa604c5dffdf0423c9fea8c0cc"}
Jul 13 18:59:10.964772 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:59:10.964715    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-nkdq7" podStartSLOduration=9.29694278 podStartE2EDuration="38.964695406s" totalImagesPullingTime="29.667752626s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 18:58:32 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 18:59:10.962684023 +0000 UTC m=+38.737560378" watchObservedRunningTime="2026-07-13 18:59:10.964695406 +0000 UTC m=+38.739571764"
Jul 13 18:59:27.889861 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:59:27.889825    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-59d7889dfd-7fv4b"]
Jul 13 18:59:27.895003 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:59:27.894980    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-59d7889dfd-7fv4b"
Jul 13 18:59:27.897288 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:59:27.897264    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 13 18:59:27.897583 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:59:27.897562    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 13 18:59:27.897740 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:59:27.897724    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 13 18:59:27.898378 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:59:27.898360    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-xpzcf\""
Jul 13 18:59:27.905510 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:59:27.905489    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 13 18:59:27.915965 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:59:27.915937    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-59d7889dfd-7fv4b"]
Jul 13 18:59:27.942331 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:59:27.942296    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-74bd64488b-bjk4l"]
Jul 13 18:59:27.946201 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:59:27.946176    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-74bd64488b-bjk4l"
Jul 13 18:59:27.948228 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:59:27.948196    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-6f79f6bbd8-8mnrp"]
Jul 13 18:59:27.951469 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:59:27.951441    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 13 18:59:27.952114 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:59:27.952090    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 13 18:59:27.952430 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:59:27.952412    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\""
Jul 13 18:59:27.952716 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:59:27.952668    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 13 18:59:27.952918 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:59:27.952899    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-mldw9\""
Jul 13 18:59:27.954210 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:59:27.954183    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6f79f6bbd8-8mnrp"
Jul 13 18:59:27.956382 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:59:27.956358    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\""
Jul 13 18:59:27.956672 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:59:27.956653    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5bc6c754db-87bqk"]
Jul 13 18:59:27.959965 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:59:27.959942    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5bc6c754db-87bqk"
Jul 13 18:59:27.961532 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:59:27.961505    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-74bd64488b-bjk4l"]
Jul 13 18:59:27.962124 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:59:27.962099    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-59d7889dfd-7fv4b"]
Jul 13 18:59:27.962313 ip-10-0-135-38 kubenswrapper[2563]: E0713 18:59:27.962291    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[bound-sa-token ca-trust-extracted image-registry-private-configuration installation-pull-secrets kube-api-access-5vfrn registry-certificates registry-tls trusted-ca], unattached volumes=[], failed to process volumes=[]: context canceled" pod="openshift-image-registry/image-registry-59d7889dfd-7fv4b" podUID="6f6c0fa7-f21d-4803-9177-105962563bcc"
Jul 13 18:59:27.963552 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:59:27.963529    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\""
Jul 13 18:59:27.963663 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:59:27.963576    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\""
Jul 13 18:59:27.963746 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:59:27.963704    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\""
Jul 13 18:59:27.963850 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:59:27.963788    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\""
Jul 13 18:59:27.966853 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:59:27.966829    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-6f79f6bbd8-8mnrp"]
Jul 13 18:59:27.973222 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:59:27.973192    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-59d7889dfd-7fv4b"
Jul 13 18:59:27.980191 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:59:27.980162    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5bc6c754db-87bqk"]
Jul 13 18:59:27.999151 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:59:27.999122    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-59d7889dfd-7fv4b"
Jul 13 18:59:28.033966 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:59:28.033926    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f29p2\" (UniqueName: \"kubernetes.io/projected/15955ddb-408d-42d1-8a94-3091d34fe757-kube-api-access-f29p2\") pod \"managed-serviceaccount-addon-agent-74bd64488b-bjk4l\" (UID: \"15955ddb-408d-42d1-8a94-3091d34fe757\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-74bd64488b-bjk4l"
Jul 13 18:59:28.033966 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:59:28.033964    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/6f6c0fa7-f21d-4803-9177-105962563bcc-image-registry-private-configuration\") pod \"image-registry-59d7889dfd-7fv4b\" (UID: \"6f6c0fa7-f21d-4803-9177-105962563bcc\") " pod="openshift-image-registry/image-registry-59d7889dfd-7fv4b"
Jul 13 18:59:28.034214 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:59:28.033999    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6f6c0fa7-f21d-4803-9177-105962563bcc-bound-sa-token\") pod \"image-registry-59d7889dfd-7fv4b\" (UID: \"6f6c0fa7-f21d-4803-9177-105962563bcc\") " pod="openshift-image-registry/image-registry-59d7889dfd-7fv4b"
Jul 13 18:59:28.034214 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:59:28.034113    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6f6c0fa7-f21d-4803-9177-105962563bcc-registry-tls\") pod \"image-registry-59d7889dfd-7fv4b\" (UID: \"6f6c0fa7-f21d-4803-9177-105962563bcc\") " pod="openshift-image-registry/image-registry-59d7889dfd-7fv4b"
Jul 13 18:59:28.034214 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:59:28.034143    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/6f6c0fa7-f21d-4803-9177-105962563bcc-installation-pull-secrets\") pod \"image-registry-59d7889dfd-7fv4b\" (UID: \"6f6c0fa7-f21d-4803-9177-105962563bcc\") " pod="openshift-image-registry/image-registry-59d7889dfd-7fv4b"
Jul 13 18:59:28.034214 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:59:28.034178    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5vfrn\" (UniqueName: \"kubernetes.io/projected/6f6c0fa7-f21d-4803-9177-105962563bcc-kube-api-access-5vfrn\") pod \"image-registry-59d7889dfd-7fv4b\" (UID: \"6f6c0fa7-f21d-4803-9177-105962563bcc\") " pod="openshift-image-registry/image-registry-59d7889dfd-7fv4b"
Jul 13 18:59:28.034343 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:59:28.034220    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/6f6c0fa7-f21d-4803-9177-105962563bcc-ca-trust-extracted\") pod \"image-registry-59d7889dfd-7fv4b\" (UID: \"6f6c0fa7-f21d-4803-9177-105962563bcc\") " pod="openshift-image-registry/image-registry-59d7889dfd-7fv4b"
Jul 13 18:59:28.034343 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:59:28.034238    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/6f6c0fa7-f21d-4803-9177-105962563bcc-registry-certificates\") pod \"image-registry-59d7889dfd-7fv4b\" (UID: \"6f6c0fa7-f21d-4803-9177-105962563bcc\") " pod="openshift-image-registry/image-registry-59d7889dfd-7fv4b"
Jul 13 18:59:28.034343 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:59:28.034300    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/15955ddb-408d-42d1-8a94-3091d34fe757-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-74bd64488b-bjk4l\" (UID: \"15955ddb-408d-42d1-8a94-3091d34fe757\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-74bd64488b-bjk4l"
Jul 13 18:59:28.034343 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:59:28.034319    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/6f6c0fa7-f21d-4803-9177-105962563bcc-trusted-ca\") pod \"image-registry-59d7889dfd-7fv4b\" (UID: \"6f6c0fa7-f21d-4803-9177-105962563bcc\") " pod="openshift-image-registry/image-registry-59d7889dfd-7fv4b"
Jul 13 18:59:28.048795 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:59:28.048749    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-lfx47"]
Jul 13 18:59:28.052213 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:59:28.052188    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-2lg9f"]
Jul 13 18:59:28.052317 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:59:28.052301    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-lfx47"
Jul 13 18:59:28.054594 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:59:28.054570    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-mbvx8\""
Jul 13 18:59:28.054714 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:59:28.054579    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 13 18:59:28.055460 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:59:28.055445    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-2lg9f"
Jul 13 18:59:28.057011 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:59:28.056990    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 13 18:59:28.061940 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:59:28.061918    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 13 18:59:28.063485 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:59:28.063467    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-d2l29\""
Jul 13 18:59:28.063695 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:59:28.063674    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 13 18:59:28.063936 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:59:28.063920    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 13 18:59:28.064911 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:59:28.064889    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-7dc86c76b9-z2vt7"]
Jul 13 18:59:28.065972 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:59:28.065950    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 13 18:59:28.066437 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:59:28.066401    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 13 18:59:28.068169 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:59:28.068140    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-lfx47"]
Jul 13 18:59:28.068266 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:59:28.068250    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7dc86c76b9-z2vt7"
Jul 13 18:59:28.080573 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:59:28.080546    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-2lg9f"]
Jul 13 18:59:28.087765 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:59:28.087733    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7dc86c76b9-z2vt7"]
Jul 13 18:59:28.134919 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:59:28.134875    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fzt2r\" (UniqueName: \"kubernetes.io/projected/cde15ec2-6044-4e2f-9eaf-ec83730850eb-kube-api-access-fzt2r\") pod \"klusterlet-addon-workmgr-6f79f6bbd8-8mnrp\" (UID: \"cde15ec2-6044-4e2f-9eaf-ec83730850eb\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6f79f6bbd8-8mnrp"
Jul 13 18:59:28.134919 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:59:28.134927    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/15955ddb-408d-42d1-8a94-3091d34fe757-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-74bd64488b-bjk4l\" (UID: \"15955ddb-408d-42d1-8a94-3091d34fe757\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-74bd64488b-bjk4l"
Jul 13 18:59:28.135165 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:59:28.134957    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/6f6c0fa7-f21d-4803-9177-105962563bcc-trusted-ca\") pod \"image-registry-59d7889dfd-7fv4b\" (UID: \"6f6c0fa7-f21d-4803-9177-105962563bcc\") " pod="openshift-image-registry/image-registry-59d7889dfd-7fv4b"
Jul 13 18:59:28.135165 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:59:28.135129    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f29p2\" (UniqueName: \"kubernetes.io/projected/15955ddb-408d-42d1-8a94-3091d34fe757-kube-api-access-f29p2\") pod \"managed-serviceaccount-addon-agent-74bd64488b-bjk4l\" (UID: \"15955ddb-408d-42d1-8a94-3091d34fe757\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-74bd64488b-bjk4l"
Jul 13 18:59:28.135517 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:59:28.135474    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/6f6c0fa7-f21d-4803-9177-105962563bcc-image-registry-private-configuration\") pod \"image-registry-59d7889dfd-7fv4b\" (UID: \"6f6c0fa7-f21d-4803-9177-105962563bcc\") " pod="openshift-image-registry/image-registry-59d7889dfd-7fv4b"
Jul 13 18:59:28.135623 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:59:28.135573    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6f6c0fa7-f21d-4803-9177-105962563bcc-bound-sa-token\") pod \"image-registry-59d7889dfd-7fv4b\" (UID: \"6f6c0fa7-f21d-4803-9177-105962563bcc\") " pod="openshift-image-registry/image-registry-59d7889dfd-7fv4b"
Jul 13 18:59:28.135623 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:59:28.135605    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/f9d60dad-1e8f-4575-9ca4-c5015b3d4b2d-ca\") pod \"cluster-proxy-proxy-agent-5bc6c754db-87bqk\" (UID: \"f9d60dad-1e8f-4575-9ca4-c5015b3d4b2d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5bc6c754db-87bqk"
Jul 13 18:59:28.135735 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:59:28.135639    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/f9d60dad-1e8f-4575-9ca4-c5015b3d4b2d-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-5bc6c754db-87bqk\" (UID: \"f9d60dad-1e8f-4575-9ca4-c5015b3d4b2d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5bc6c754db-87bqk"
Jul 13 18:59:28.135735 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:59:28.135696    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bvw5t\" (UniqueName: \"kubernetes.io/projected/f9d60dad-1e8f-4575-9ca4-c5015b3d4b2d-kube-api-access-bvw5t\") pod \"cluster-proxy-proxy-agent-5bc6c754db-87bqk\" (UID: \"f9d60dad-1e8f-4575-9ca4-c5015b3d4b2d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5bc6c754db-87bqk"
Jul 13 18:59:28.135735 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:59:28.135722    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cde15ec2-6044-4e2f-9eaf-ec83730850eb-tmp\") pod \"klusterlet-addon-workmgr-6f79f6bbd8-8mnrp\" (UID: \"cde15ec2-6044-4e2f-9eaf-ec83730850eb\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6f79f6bbd8-8mnrp"
Jul 13 18:59:28.136476 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:59:28.136439    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/6f6c0fa7-f21d-4803-9177-105962563bcc-trusted-ca\") pod \"image-registry-59d7889dfd-7fv4b\" (UID: \"6f6c0fa7-f21d-4803-9177-105962563bcc\") " pod="openshift-image-registry/image-registry-59d7889dfd-7fv4b"
Jul 13 18:59:28.136594 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:59:28.135761    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6f6c0fa7-f21d-4803-9177-105962563bcc-registry-tls\") pod \"image-registry-59d7889dfd-7fv4b\" (UID: \"6f6c0fa7-f21d-4803-9177-105962563bcc\") " pod="openshift-image-registry/image-registry-59d7889dfd-7fv4b"
Jul 13 18:59:28.136659 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:59:28.136621    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/f9d60dad-1e8f-4575-9ca4-c5015b3d4b2d-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-5bc6c754db-87bqk\" (UID: \"f9d60dad-1e8f-4575-9ca4-c5015b3d4b2d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5bc6c754db-87bqk"
Jul 13 18:59:28.136712 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:59:28.136683    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/6f6c0fa7-f21d-4803-9177-105962563bcc-installation-pull-secrets\") pod \"image-registry-59d7889dfd-7fv4b\" (UID: \"6f6c0fa7-f21d-4803-9177-105962563bcc\") " pod="openshift-image-registry/image-registry-59d7889dfd-7fv4b"
Jul 13 18:59:28.136814 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:59:28.136794    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/f9d60dad-1e8f-4575-9ca4-c5015b3d4b2d-additional-service-ca\") pod \"cluster-proxy-proxy-agent-5bc6c754db-87bqk\" (UID: \"f9d60dad-1e8f-4575-9ca4-c5015b3d4b2d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5bc6c754db-87bqk"
Jul 13 18:59:28.137873 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:59:28.137844    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5vfrn\" (UniqueName: \"kubernetes.io/projected/6f6c0fa7-f21d-4803-9177-105962563bcc-kube-api-access-5vfrn\") pod \"image-registry-59d7889dfd-7fv4b\" (UID: \"6f6c0fa7-f21d-4803-9177-105962563bcc\") " pod="openshift-image-registry/image-registry-59d7889dfd-7fv4b"
Jul 13 18:59:28.137959 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:59:28.137903    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/cde15ec2-6044-4e2f-9eaf-ec83730850eb-klusterlet-config\") pod \"klusterlet-addon-workmgr-6f79f6bbd8-8mnrp\" (UID: \"cde15ec2-6044-4e2f-9eaf-ec83730850eb\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6f79f6bbd8-8mnrp"
Jul 13 18:59:28.138057 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:59:28.137977    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/6f6c0fa7-f21d-4803-9177-105962563bcc-ca-trust-extracted\") pod \"image-registry-59d7889dfd-7fv4b\" (UID: \"6f6c0fa7-f21d-4803-9177-105962563bcc\") " pod="openshift-image-registry/image-registry-59d7889dfd-7fv4b"
Jul 13 18:59:28.138057 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:59:28.138030    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/6f6c0fa7-f21d-4803-9177-105962563bcc-registry-certificates\") pod \"image-registry-59d7889dfd-7fv4b\" (UID: \"6f6c0fa7-f21d-4803-9177-105962563bcc\") " pod="openshift-image-registry/image-registry-59d7889dfd-7fv4b"
Jul 13 18:59:28.138171 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:59:28.138076    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/f9d60dad-1e8f-4575-9ca4-c5015b3d4b2d-hub\") pod \"cluster-proxy-proxy-agent-5bc6c754db-87bqk\" (UID: \"f9d60dad-1e8f-4575-9ca4-c5015b3d4b2d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5bc6c754db-87bqk"
Jul 13 18:59:28.138576 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:59:28.138496    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/6f6c0fa7-f21d-4803-9177-105962563bcc-ca-trust-extracted\") pod \"image-registry-59d7889dfd-7fv4b\" (UID: \"6f6c0fa7-f21d-4803-9177-105962563bcc\") " pod="openshift-image-registry/image-registry-59d7889dfd-7fv4b"
Jul 13 18:59:28.139957 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:59:28.139811    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/6f6c0fa7-f21d-4803-9177-105962563bcc-registry-certificates\") pod \"image-registry-59d7889dfd-7fv4b\" (UID: \"6f6c0fa7-f21d-4803-9177-105962563bcc\") " pod="openshift-image-registry/image-registry-59d7889dfd-7fv4b"
Jul 13 18:59:28.141479 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:59:28.141454    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/15955ddb-408d-42d1-8a94-3091d34fe757-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-74bd64488b-bjk4l\" (UID: \"15955ddb-408d-42d1-8a94-3091d34fe757\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-74bd64488b-bjk4l"
Jul 13 18:59:28.142516 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:59:28.142488    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6f6c0fa7-f21d-4803-9177-105962563bcc-registry-tls\") pod \"image-registry-59d7889dfd-7fv4b\" (UID: \"6f6c0fa7-f21d-4803-9177-105962563bcc\") " pod="openshift-image-registry/image-registry-59d7889dfd-7fv4b"
Jul 13 18:59:28.143123 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:59:28.142698    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/6f6c0fa7-f21d-4803-9177-105962563bcc-image-registry-private-configuration\") pod \"image-registry-59d7889dfd-7fv4b\" (UID: \"6f6c0fa7-f21d-4803-9177-105962563bcc\") " pod="openshift-image-registry/image-registry-59d7889dfd-7fv4b"
Jul 13 18:59:28.143123 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:59:28.142780    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/6f6c0fa7-f21d-4803-9177-105962563bcc-installation-pull-secrets\") pod \"image-registry-59d7889dfd-7fv4b\" (UID: \"6f6c0fa7-f21d-4803-9177-105962563bcc\") " pod="openshift-image-registry/image-registry-59d7889dfd-7fv4b"
Jul 13 18:59:28.143742 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:59:28.143722    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-99pgk"]
Jul 13 18:59:28.147134 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:59:28.147108    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5vfrn\" (UniqueName: \"kubernetes.io/projected/6f6c0fa7-f21d-4803-9177-105962563bcc-kube-api-access-5vfrn\") pod \"image-registry-59d7889dfd-7fv4b\" (UID: \"6f6c0fa7-f21d-4803-9177-105962563bcc\") " pod="openshift-image-registry/image-registry-59d7889dfd-7fv4b"
Jul 13 18:59:28.147246 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:59:28.147109    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f29p2\" (UniqueName: \"kubernetes.io/projected/15955ddb-408d-42d1-8a94-3091d34fe757-kube-api-access-f29p2\") pod \"managed-serviceaccount-addon-agent-74bd64488b-bjk4l\" (UID: \"15955ddb-408d-42d1-8a94-3091d34fe757\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-74bd64488b-bjk4l"
Jul 13 18:59:28.147351 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:59:28.147330    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6f6c0fa7-f21d-4803-9177-105962563bcc-bound-sa-token\") pod \"image-registry-59d7889dfd-7fv4b\" (UID: \"6f6c0fa7-f21d-4803-9177-105962563bcc\") " pod="openshift-image-registry/image-registry-59d7889dfd-7fv4b"
Jul 13 18:59:28.149087 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:59:28.149067    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-99pgk"
Jul 13 18:59:28.152884 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:59:28.152862    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-wt7nz\""
Jul 13 18:59:28.152990 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:59:28.152972    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 13 18:59:28.153072 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:59:28.152985    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 13 18:59:28.160590 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:59:28.160565    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-99pgk"]
Jul 13 18:59:28.238558 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:59:28.238522    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/6f6c0fa7-f21d-4803-9177-105962563bcc-image-registry-private-configuration\") pod \"6f6c0fa7-f21d-4803-9177-105962563bcc\" (UID: \"6f6c0fa7-f21d-4803-9177-105962563bcc\") "
Jul 13 18:59:28.238558 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:59:28.238570    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6f6c0fa7-f21d-4803-9177-105962563bcc-bound-sa-token\") pod \"6f6c0fa7-f21d-4803-9177-105962563bcc\" (UID: \"6f6c0fa7-f21d-4803-9177-105962563bcc\") "
Jul 13 18:59:28.238813 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:59:28.238597    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6f6c0fa7-f21d-4803-9177-105962563bcc-registry-tls\") pod \"6f6c0fa7-f21d-4803-9177-105962563bcc\" (UID: \"6f6c0fa7-f21d-4803-9177-105962563bcc\") "
Jul 13 18:59:28.238813 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:59:28.238632    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/6f6c0fa7-f21d-4803-9177-105962563bcc-installation-pull-secrets\") pod \"6f6c0fa7-f21d-4803-9177-105962563bcc\" (UID: \"6f6c0fa7-f21d-4803-9177-105962563bcc\") "
Jul 13 18:59:28.238813 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:59:28.238659    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/6f6c0fa7-f21d-4803-9177-105962563bcc-registry-certificates\") pod \"6f6c0fa7-f21d-4803-9177-105962563bcc\" (UID: \"6f6c0fa7-f21d-4803-9177-105962563bcc\") "
Jul 13 18:59:28.238813 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:59:28.238691    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/6f6c0fa7-f21d-4803-9177-105962563bcc-ca-trust-extracted\") pod \"6f6c0fa7-f21d-4803-9177-105962563bcc\" (UID: \"6f6c0fa7-f21d-4803-9177-105962563bcc\") "
Jul 13 18:59:28.238813 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:59:28.238713    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/6f6c0fa7-f21d-4803-9177-105962563bcc-trusted-ca\") pod \"6f6c0fa7-f21d-4803-9177-105962563bcc\" (UID: \"6f6c0fa7-f21d-4803-9177-105962563bcc\") "
Jul 13 18:59:28.238813 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:59:28.238740    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5vfrn\" (UniqueName: \"kubernetes.io/projected/6f6c0fa7-f21d-4803-9177-105962563bcc-kube-api-access-5vfrn\") pod \"6f6c0fa7-f21d-4803-9177-105962563bcc\" (UID: \"6f6c0fa7-f21d-4803-9177-105962563bcc\") "
Jul 13 18:59:28.239116 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:59:28.238854    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9d10d62c-2d07-4e0f-886d-c2655493b867-tmp-dir\") pod \"dns-default-99pgk\" (UID: \"9d10d62c-2d07-4e0f-886d-c2655493b867\") " pod="openshift-dns/dns-default-99pgk"
Jul 13 18:59:28.239116 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:59:28.238887    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/5ada439c-465d-4679-93ee-b2bd1271a4c0-crio-socket\") pod \"insights-runtime-extractor-2lg9f\" (UID: \"5ada439c-465d-4679-93ee-b2bd1271a4c0\") " pod="openshift-insights/insights-runtime-extractor-2lg9f"
Jul 13 18:59:28.239116 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:59:28.238919    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/53a3c346-54ba-4102-b222-db8a5c3f303f-image-registry-private-configuration\") pod \"image-registry-7dc86c76b9-z2vt7\" (UID: \"53a3c346-54ba-4102-b222-db8a5c3f303f\") " pod="openshift-image-registry/image-registry-7dc86c76b9-z2vt7"
Jul 13 18:59:28.239116 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:59:28.238947    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/9d10d62c-2d07-4e0f-886d-c2655493b867-config-volume\") pod \"dns-default-99pgk\" (UID: \"9d10d62c-2d07-4e0f-886d-c2655493b867\") " pod="openshift-dns/dns-default-99pgk"
Jul 13 18:59:28.239116 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:59:28.238993    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/f9d60dad-1e8f-4575-9ca4-c5015b3d4b2d-ca\") pod \"cluster-proxy-proxy-agent-5bc6c754db-87bqk\" (UID: \"f9d60dad-1e8f-4575-9ca4-c5015b3d4b2d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5bc6c754db-87bqk"
Jul 13 18:59:28.239116 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:59:28.239058    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/f9d60dad-1e8f-4575-9ca4-c5015b3d4b2d-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-5bc6c754db-87bqk\" (UID: \"f9d60dad-1e8f-4575-9ca4-c5015b3d4b2d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5bc6c754db-87bqk"
Jul 13 18:59:28.239116 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:59:28.239087    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5ada439c-465d-4679-93ee-b2bd1271a4c0-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2lg9f\" (UID: \"5ada439c-465d-4679-93ee-b2bd1271a4c0\") " pod="openshift-insights/insights-runtime-extractor-2lg9f"
Jul 13 18:59:28.239452 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:59:28.239129    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cde15ec2-6044-4e2f-9eaf-ec83730850eb-tmp\") pod \"klusterlet-addon-workmgr-6f79f6bbd8-8mnrp\" (UID: \"cde15ec2-6044-4e2f-9eaf-ec83730850eb\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6f79f6bbd8-8mnrp"
Jul 13 18:59:28.239452 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:59:28.239160    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/f9d60dad-1e8f-4575-9ca4-c5015b3d4b2d-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-5bc6c754db-87bqk\" (UID: \"f9d60dad-1e8f-4575-9ca4-c5015b3d4b2d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5bc6c754db-87bqk"
Jul 13 18:59:28.239452 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:59:28.239195    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/f9d60dad-1e8f-4575-9ca4-c5015b3d4b2d-additional-service-ca\") pod \"cluster-proxy-proxy-agent-5bc6c754db-87bqk\" (UID: \"f9d60dad-1e8f-4575-9ca4-c5015b3d4b2d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5bc6c754db-87bqk"
Jul 13 18:59:28.239452 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:59:28.239247    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/53a3c346-54ba-4102-b222-db8a5c3f303f-registry-certificates\") pod \"image-registry-7dc86c76b9-z2vt7\" (UID: \"53a3c346-54ba-4102-b222-db8a5c3f303f\") " pod="openshift-image-registry/image-registry-7dc86c76b9-z2vt7"
Jul 13 18:59:28.239452 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:59:28.239273    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ct4lm\" (UniqueName: \"kubernetes.io/projected/9d10d62c-2d07-4e0f-886d-c2655493b867-kube-api-access-ct4lm\") pod \"dns-default-99pgk\" (UID: \"9d10d62c-2d07-4e0f-886d-c2655493b867\") " pod="openshift-dns/dns-default-99pgk"
Jul 13 18:59:28.239452 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:59:28.239303    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/f9d60dad-1e8f-4575-9ca4-c5015b3d4b2d-hub\") pod \"cluster-proxy-proxy-agent-5bc6c754db-87bqk\" (UID: \"f9d60dad-1e8f-4575-9ca4-c5015b3d4b2d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5bc6c754db-87bqk"
Jul 13 18:59:28.239452 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:59:28.239326    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9d10d62c-2d07-4e0f-886d-c2655493b867-metrics-tls\") pod \"dns-default-99pgk\" (UID: \"9d10d62c-2d07-4e0f-886d-c2655493b867\") " pod="openshift-dns/dns-default-99pgk"
Jul 13 18:59:28.239452 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:59:28.239359    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fzt2r\" (UniqueName: \"kubernetes.io/projected/cde15ec2-6044-4e2f-9eaf-ec83730850eb-kube-api-access-fzt2r\") pod \"klusterlet-addon-workmgr-6f79f6bbd8-8mnrp\" (UID: \"cde15ec2-6044-4e2f-9eaf-ec83730850eb\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6f79f6bbd8-8mnrp"
Jul 13 18:59:28.239452 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:59:28.239386    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/53a3c346-54ba-4102-b222-db8a5c3f303f-registry-tls\") pod \"image-registry-7dc86c76b9-z2vt7\" (UID: \"53a3c346-54ba-4102-b222-db8a5c3f303f\") " pod="openshift-image-registry/image-registry-7dc86c76b9-z2vt7"
Jul 13 18:59:28.239452 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:59:28.239450    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/53a3c346-54ba-4102-b222-db8a5c3f303f-ca-trust-extracted\") pod \"image-registry-7dc86c76b9-z2vt7\" (UID: \"53a3c346-54ba-4102-b222-db8a5c3f303f\") " pod="openshift-image-registry/image-registry-7dc86c76b9-z2vt7"
Jul 13 18:59:28.240098 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:59:28.239493    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/53a3c346-54ba-4102-b222-db8a5c3f303f-installation-pull-secrets\") pod \"image-registry-7dc86c76b9-z2vt7\" (UID: \"53a3c346-54ba-4102-b222-db8a5c3f303f\") " pod="openshift-image-registry/image-registry-7dc86c76b9-z2vt7"
Jul 13 18:59:28.240098 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:59:28.239525    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/53a3c346-54ba-4102-b222-db8a5c3f303f-bound-sa-token\") pod \"image-registry-7dc86c76b9-z2vt7\" (UID: \"53a3c346-54ba-4102-b222-db8a5c3f303f\") " pod="openshift-image-registry/image-registry-7dc86c76b9-z2vt7"
Jul 13 18:59:28.240098 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:59:28.239557    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tw68p\" (UniqueName: \"kubernetes.io/projected/53a3c346-54ba-4102-b222-db8a5c3f303f-kube-api-access-tw68p\") pod \"image-registry-7dc86c76b9-z2vt7\" (UID: \"53a3c346-54ba-4102-b222-db8a5c3f303f\") " pod="openshift-image-registry/image-registry-7dc86c76b9-z2vt7"
Jul 13 18:59:28.240098 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:59:28.239598    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bvw5t\" (UniqueName: \"kubernetes.io/projected/f9d60dad-1e8f-4575-9ca4-c5015b3d4b2d-kube-api-access-bvw5t\") pod \"cluster-proxy-proxy-agent-5bc6c754db-87bqk\" (UID: \"f9d60dad-1e8f-4575-9ca4-c5015b3d4b2d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5bc6c754db-87bqk"
Jul 13 18:59:28.240098 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:59:28.239641    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qw7gm\" (UniqueName: \"kubernetes.io/projected/5ada439c-465d-4679-93ee-b2bd1271a4c0-kube-api-access-qw7gm\") pod \"insights-runtime-extractor-2lg9f\" (UID: \"5ada439c-465d-4679-93ee-b2bd1271a4c0\") " pod="openshift-insights/insights-runtime-extractor-2lg9f"
Jul 13 18:59:28.240098 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:59:28.239669    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/5ada439c-465d-4679-93ee-b2bd1271a4c0-data-volume\") pod \"insights-runtime-extractor-2lg9f\" (UID: \"5ada439c-465d-4679-93ee-b2bd1271a4c0\") " pod="openshift-insights/insights-runtime-extractor-2lg9f"
Jul 13 18:59:28.240098 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:59:28.239698    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/cde15ec2-6044-4e2f-9eaf-ec83730850eb-klusterlet-config\") pod \"klusterlet-addon-workmgr-6f79f6bbd8-8mnrp\" (UID: \"cde15ec2-6044-4e2f-9eaf-ec83730850eb\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6f79f6bbd8-8mnrp"
Jul 13 18:59:28.240098 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:59:28.239717    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cde15ec2-6044-4e2f-9eaf-ec83730850eb-tmp\") pod \"klusterlet-addon-workmgr-6f79f6bbd8-8mnrp\" (UID: \"cde15ec2-6044-4e2f-9eaf-ec83730850eb\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6f79f6bbd8-8mnrp"
Jul 13 18:59:28.240098 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:59:28.239722    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pn47j\" (UniqueName: \"kubernetes.io/projected/aac9bfb1-117e-40fa-ac83-d47cc1a55908-kube-api-access-pn47j\") pod \"ingress-canary-lfx47\" (UID: \"aac9bfb1-117e-40fa-ac83-d47cc1a55908\") " pod="openshift-ingress-canary/ingress-canary-lfx47"
Jul 13 18:59:28.240098 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:59:28.239224    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6f6c0fa7-f21d-4803-9177-105962563bcc-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "6f6c0fa7-f21d-4803-9177-105962563bcc" (UID: "6f6c0fa7-f21d-4803-9177-105962563bcc"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 18:59:28.240098 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:59:28.239309    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6f6c0fa7-f21d-4803-9177-105962563bcc-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "6f6c0fa7-f21d-4803-9177-105962563bcc" (UID: "6f6c0fa7-f21d-4803-9177-105962563bcc"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 18:59:28.240098 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:59:28.239374    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6f6c0fa7-f21d-4803-9177-105962563bcc-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "6f6c0fa7-f21d-4803-9177-105962563bcc" (UID: "6f6c0fa7-f21d-4803-9177-105962563bcc"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 18:59:28.240687 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:59:28.240501    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/53a3c346-54ba-4102-b222-db8a5c3f303f-trusted-ca\") pod \"image-registry-7dc86c76b9-z2vt7\" (UID: \"53a3c346-54ba-4102-b222-db8a5c3f303f\") " pod="openshift-image-registry/image-registry-7dc86c76b9-z2vt7"
Jul 13 18:59:28.241864 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:59:28.241827    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6f6c0fa7-f21d-4803-9177-105962563bcc-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "6f6c0fa7-f21d-4803-9177-105962563bcc" (UID: "6f6c0fa7-f21d-4803-9177-105962563bcc"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 18:59:28.241994 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:59:28.241901    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6f6c0fa7-f21d-4803-9177-105962563bcc-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "6f6c0fa7-f21d-4803-9177-105962563bcc" (UID: "6f6c0fa7-f21d-4803-9177-105962563bcc"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 13 18:59:28.241994 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:59:28.241953    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6f6c0fa7-f21d-4803-9177-105962563bcc-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "6f6c0fa7-f21d-4803-9177-105962563bcc" (UID: "6f6c0fa7-f21d-4803-9177-105962563bcc"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 18:59:28.241994 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:59:28.241970    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/f9d60dad-1e8f-4575-9ca4-c5015b3d4b2d-additional-service-ca\") pod \"cluster-proxy-proxy-agent-5bc6c754db-87bqk\" (UID: \"f9d60dad-1e8f-4575-9ca4-c5015b3d4b2d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5bc6c754db-87bqk"
Jul 13 18:59:28.242191 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:59:28.242084    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/aac9bfb1-117e-40fa-ac83-d47cc1a55908-cert\") pod \"ingress-canary-lfx47\" (UID: \"aac9bfb1-117e-40fa-ac83-d47cc1a55908\") " pod="openshift-ingress-canary/ingress-canary-lfx47"
Jul 13 18:59:28.242191 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:59:28.242161    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5ada439c-465d-4679-93ee-b2bd1271a4c0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2lg9f\" (UID: \"5ada439c-465d-4679-93ee-b2bd1271a4c0\") " pod="openshift-insights/insights-runtime-extractor-2lg9f"
Jul 13 18:59:28.242394 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:59:28.242363    2563 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/6f6c0fa7-f21d-4803-9177-105962563bcc-registry-certificates\") on node \"ip-10-0-135-38.ec2.internal\" DevicePath \"\""
Jul 13 18:59:28.242548 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:59:28.242533    2563 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/6f6c0fa7-f21d-4803-9177-105962563bcc-ca-trust-extracted\") on node \"ip-10-0-135-38.ec2.internal\" DevicePath \"\""
Jul 13 18:59:28.242654 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:59:28.242636    2563 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/6f6c0fa7-f21d-4803-9177-105962563bcc-trusted-ca\") on node \"ip-10-0-135-38.ec2.internal\" DevicePath \"\""
Jul 13 18:59:28.242962 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:59:28.242939    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/cde15ec2-6044-4e2f-9eaf-ec83730850eb-klusterlet-config\") pod \"klusterlet-addon-workmgr-6f79f6bbd8-8mnrp\" (UID: \"cde15ec2-6044-4e2f-9eaf-ec83730850eb\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6f79f6bbd8-8mnrp"
Jul 13 18:59:28.243198 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:59:28.243167    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6f6c0fa7-f21d-4803-9177-105962563bcc-kube-api-access-5vfrn" (OuterVolumeSpecName: "kube-api-access-5vfrn") pod "6f6c0fa7-f21d-4803-9177-105962563bcc" (UID: "6f6c0fa7-f21d-4803-9177-105962563bcc"). InnerVolumeSpecName "kube-api-access-5vfrn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 18:59:28.243537 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:59:28.243516    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/f9d60dad-1e8f-4575-9ca4-c5015b3d4b2d-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-5bc6c754db-87bqk\" (UID: \"f9d60dad-1e8f-4575-9ca4-c5015b3d4b2d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5bc6c754db-87bqk"
Jul 13 18:59:28.243738 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:59:28.243719    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6f6c0fa7-f21d-4803-9177-105962563bcc-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "6f6c0fa7-f21d-4803-9177-105962563bcc" (UID: "6f6c0fa7-f21d-4803-9177-105962563bcc"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 13 18:59:28.243803 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:59:28.243736    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/f9d60dad-1e8f-4575-9ca4-c5015b3d4b2d-ca\") pod \"cluster-proxy-proxy-agent-5bc6c754db-87bqk\" (UID: \"f9d60dad-1e8f-4575-9ca4-c5015b3d4b2d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5bc6c754db-87bqk"
Jul 13 18:59:28.243803 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:59:28.243762    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/f9d60dad-1e8f-4575-9ca4-c5015b3d4b2d-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-5bc6c754db-87bqk\" (UID: \"f9d60dad-1e8f-4575-9ca4-c5015b3d4b2d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5bc6c754db-87bqk"
Jul 13 18:59:28.244649 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:59:28.244630    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/f9d60dad-1e8f-4575-9ca4-c5015b3d4b2d-hub\") pod \"cluster-proxy-proxy-agent-5bc6c754db-87bqk\" (UID: \"f9d60dad-1e8f-4575-9ca4-c5015b3d4b2d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5bc6c754db-87bqk"
Jul 13 18:59:28.248089 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:59:28.248064    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fzt2r\" (UniqueName: \"kubernetes.io/projected/cde15ec2-6044-4e2f-9eaf-ec83730850eb-kube-api-access-fzt2r\") pod \"klusterlet-addon-workmgr-6f79f6bbd8-8mnrp\" (UID: \"cde15ec2-6044-4e2f-9eaf-ec83730850eb\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6f79f6bbd8-8mnrp"
Jul 13 18:59:28.250479 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:59:28.250451    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bvw5t\" (UniqueName: \"kubernetes.io/projected/f9d60dad-1e8f-4575-9ca4-c5015b3d4b2d-kube-api-access-bvw5t\") pod \"cluster-proxy-proxy-agent-5bc6c754db-87bqk\" (UID: \"f9d60dad-1e8f-4575-9ca4-c5015b3d4b2d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5bc6c754db-87bqk"
Jul 13 18:59:28.270254 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:59:28.270220    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-74bd64488b-bjk4l"
Jul 13 18:59:28.278525 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:59:28.278501    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6f79f6bbd8-8mnrp"
Jul 13 18:59:28.286260 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:59:28.286229    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5bc6c754db-87bqk"
Jul 13 18:59:28.351221 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:59:28.349412    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9d10d62c-2d07-4e0f-886d-c2655493b867-metrics-tls\") pod \"dns-default-99pgk\" (UID: \"9d10d62c-2d07-4e0f-886d-c2655493b867\") " pod="openshift-dns/dns-default-99pgk"
Jul 13 18:59:28.351221 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:59:28.349462    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/53a3c346-54ba-4102-b222-db8a5c3f303f-registry-tls\") pod \"image-registry-7dc86c76b9-z2vt7\" (UID: \"53a3c346-54ba-4102-b222-db8a5c3f303f\") " pod="openshift-image-registry/image-registry-7dc86c76b9-z2vt7"
Jul 13 18:59:28.351221 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:59:28.349493    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/53a3c346-54ba-4102-b222-db8a5c3f303f-ca-trust-extracted\") pod \"image-registry-7dc86c76b9-z2vt7\" (UID: \"53a3c346-54ba-4102-b222-db8a5c3f303f\") " pod="openshift-image-registry/image-registry-7dc86c76b9-z2vt7"
Jul 13 18:59:28.351221 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:59:28.349523    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/53a3c346-54ba-4102-b222-db8a5c3f303f-installation-pull-secrets\") pod \"image-registry-7dc86c76b9-z2vt7\" (UID: \"53a3c346-54ba-4102-b222-db8a5c3f303f\") " pod="openshift-image-registry/image-registry-7dc86c76b9-z2vt7"
Jul 13 18:59:28.351221 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:59:28.349551    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/53a3c346-54ba-4102-b222-db8a5c3f303f-bound-sa-token\") pod \"image-registry-7dc86c76b9-z2vt7\" (UID: \"53a3c346-54ba-4102-b222-db8a5c3f303f\") " pod="openshift-image-registry/image-registry-7dc86c76b9-z2vt7"
Jul 13 18:59:28.351221 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:59:28.349574    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tw68p\" (UniqueName: \"kubernetes.io/projected/53a3c346-54ba-4102-b222-db8a5c3f303f-kube-api-access-tw68p\") pod \"image-registry-7dc86c76b9-z2vt7\" (UID: \"53a3c346-54ba-4102-b222-db8a5c3f303f\") " pod="openshift-image-registry/image-registry-7dc86c76b9-z2vt7"
Jul 13 18:59:28.351221 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:59:28.349608    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qw7gm\" (UniqueName: \"kubernetes.io/projected/5ada439c-465d-4679-93ee-b2bd1271a4c0-kube-api-access-qw7gm\") pod \"insights-runtime-extractor-2lg9f\" (UID: \"5ada439c-465d-4679-93ee-b2bd1271a4c0\") " pod="openshift-insights/insights-runtime-extractor-2lg9f"
Jul 13 18:59:28.351221 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:59:28.349633    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/5ada439c-465d-4679-93ee-b2bd1271a4c0-data-volume\") pod \"insights-runtime-extractor-2lg9f\" (UID: \"5ada439c-465d-4679-93ee-b2bd1271a4c0\") " pod="openshift-insights/insights-runtime-extractor-2lg9f"
Jul 13 18:59:28.351221 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:59:28.349663    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pn47j\" (UniqueName: \"kubernetes.io/projected/aac9bfb1-117e-40fa-ac83-d47cc1a55908-kube-api-access-pn47j\") pod \"ingress-canary-lfx47\" (UID: \"aac9bfb1-117e-40fa-ac83-d47cc1a55908\") " pod="openshift-ingress-canary/ingress-canary-lfx47"
Jul 13 18:59:28.351221 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:59:28.349695    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/53a3c346-54ba-4102-b222-db8a5c3f303f-trusted-ca\") pod \"image-registry-7dc86c76b9-z2vt7\" (UID: \"53a3c346-54ba-4102-b222-db8a5c3f303f\") " pod="openshift-image-registry/image-registry-7dc86c76b9-z2vt7"
Jul 13 18:59:28.351221 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:59:28.349718    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/aac9bfb1-117e-40fa-ac83-d47cc1a55908-cert\") pod \"ingress-canary-lfx47\" (UID: \"aac9bfb1-117e-40fa-ac83-d47cc1a55908\") " pod="openshift-ingress-canary/ingress-canary-lfx47"
Jul 13 18:59:28.351221 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:59:28.349739    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5ada439c-465d-4679-93ee-b2bd1271a4c0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2lg9f\" (UID: \"5ada439c-465d-4679-93ee-b2bd1271a4c0\") " pod="openshift-insights/insights-runtime-extractor-2lg9f"
Jul 13 18:59:28.351221 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:59:28.349769    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9d10d62c-2d07-4e0f-886d-c2655493b867-tmp-dir\") pod \"dns-default-99pgk\" (UID: \"9d10d62c-2d07-4e0f-886d-c2655493b867\") " pod="openshift-dns/dns-default-99pgk"
Jul 13 18:59:28.351221 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:59:28.349794    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/5ada439c-465d-4679-93ee-b2bd1271a4c0-crio-socket\") pod \"insights-runtime-extractor-2lg9f\" (UID: \"5ada439c-465d-4679-93ee-b2bd1271a4c0\") " pod="openshift-insights/insights-runtime-extractor-2lg9f"
Jul 13 18:59:28.351221 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:59:28.349818    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/53a3c346-54ba-4102-b222-db8a5c3f303f-image-registry-private-configuration\") pod \"image-registry-7dc86c76b9-z2vt7\" (UID: \"53a3c346-54ba-4102-b222-db8a5c3f303f\") " pod="openshift-image-registry/image-registry-7dc86c76b9-z2vt7"
Jul 13 18:59:28.351221 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:59:28.349843    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/9d10d62c-2d07-4e0f-886d-c2655493b867-config-volume\") pod \"dns-default-99pgk\" (UID: \"9d10d62c-2d07-4e0f-886d-c2655493b867\") " pod="openshift-dns/dns-default-99pgk"
Jul 13 18:59:28.352225 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:59:28.349885    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5ada439c-465d-4679-93ee-b2bd1271a4c0-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2lg9f\" (UID: \"5ada439c-465d-4679-93ee-b2bd1271a4c0\") " pod="openshift-insights/insights-runtime-extractor-2lg9f"
Jul 13 18:59:28.352225 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:59:28.349953    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/53a3c346-54ba-4102-b222-db8a5c3f303f-registry-certificates\") pod \"image-registry-7dc86c76b9-z2vt7\" (UID: \"53a3c346-54ba-4102-b222-db8a5c3f303f\") " pod="openshift-image-registry/image-registry-7dc86c76b9-z2vt7"
Jul 13 18:59:28.352225 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:59:28.349975    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ct4lm\" (UniqueName: \"kubernetes.io/projected/9d10d62c-2d07-4e0f-886d-c2655493b867-kube-api-access-ct4lm\") pod \"dns-default-99pgk\" (UID: \"9d10d62c-2d07-4e0f-886d-c2655493b867\") " pod="openshift-dns/dns-default-99pgk"
Jul 13 18:59:28.352225 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:59:28.350213    2563 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6f6c0fa7-f21d-4803-9177-105962563bcc-bound-sa-token\") on node \"ip-10-0-135-38.ec2.internal\" DevicePath \"\""
Jul 13 18:59:28.352225 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:59:28.350234    2563 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/6f6c0fa7-f21d-4803-9177-105962563bcc-image-registry-private-configuration\") on node \"ip-10-0-135-38.ec2.internal\" DevicePath \"\""
Jul 13 18:59:28.352225 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:59:28.350251    2563 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/6f6c0fa7-f21d-4803-9177-105962563bcc-installation-pull-secrets\") on node \"ip-10-0-135-38.ec2.internal\" DevicePath \"\""
Jul 13 18:59:28.352225 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:59:28.350266    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5vfrn\" (UniqueName: \"kubernetes.io/projected/6f6c0fa7-f21d-4803-9177-105962563bcc-kube-api-access-5vfrn\") on node \"ip-10-0-135-38.ec2.internal\" DevicePath \"\""
Jul 13 18:59:28.352225 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:59:28.350284    2563 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6f6c0fa7-f21d-4803-9177-105962563bcc-registry-tls\") on node \"ip-10-0-135-38.ec2.internal\" DevicePath \"\""
Jul 13 18:59:28.352225 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:59:28.350844    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/5ada439c-465d-4679-93ee-b2bd1271a4c0-data-volume\") pod \"insights-runtime-extractor-2lg9f\" (UID: \"5ada439c-465d-4679-93ee-b2bd1271a4c0\") " pod="openshift-insights/insights-runtime-extractor-2lg9f"
Jul 13 18:59:28.352225 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:59:28.351237    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/5ada439c-465d-4679-93ee-b2bd1271a4c0-crio-socket\") pod \"insights-runtime-extractor-2lg9f\" (UID: \"5ada439c-465d-4679-93ee-b2bd1271a4c0\") " pod="openshift-insights/insights-runtime-extractor-2lg9f"
Jul 13 18:59:28.352225 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:59:28.351776    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/53a3c346-54ba-4102-b222-db8a5c3f303f-trusted-ca\") pod \"image-registry-7dc86c76b9-z2vt7\" (UID: \"53a3c346-54ba-4102-b222-db8a5c3f303f\") " pod="openshift-image-registry/image-registry-7dc86c76b9-z2vt7"
Jul 13 18:59:28.352757 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:59:28.352616    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5ada439c-465d-4679-93ee-b2bd1271a4c0-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2lg9f\" (UID: \"5ada439c-465d-4679-93ee-b2bd1271a4c0\") " pod="openshift-insights/insights-runtime-extractor-2lg9f"
Jul 13 18:59:28.355484 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:59:28.353832    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/53a3c346-54ba-4102-b222-db8a5c3f303f-registry-certificates\") pod \"image-registry-7dc86c76b9-z2vt7\" (UID: \"53a3c346-54ba-4102-b222-db8a5c3f303f\") " pod="openshift-image-registry/image-registry-7dc86c76b9-z2vt7"
Jul 13 18:59:28.355484 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:59:28.354979    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9d10d62c-2d07-4e0f-886d-c2655493b867-tmp-dir\") pod \"dns-default-99pgk\" (UID: \"9d10d62c-2d07-4e0f-886d-c2655493b867\") " pod="openshift-dns/dns-default-99pgk"
Jul 13 18:59:28.355484 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:59:28.355308    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/53a3c346-54ba-4102-b222-db8a5c3f303f-ca-trust-extracted\") pod \"image-registry-7dc86c76b9-z2vt7\" (UID: \"53a3c346-54ba-4102-b222-db8a5c3f303f\") " pod="openshift-image-registry/image-registry-7dc86c76b9-z2vt7"
Jul 13 18:59:28.359647 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:59:28.359577    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/9d10d62c-2d07-4e0f-886d-c2655493b867-config-volume\") pod \"dns-default-99pgk\" (UID: \"9d10d62c-2d07-4e0f-886d-c2655493b867\") " pod="openshift-dns/dns-default-99pgk"
Jul 13 18:59:28.394678 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:59:28.393473    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pn47j\" (UniqueName: \"kubernetes.io/projected/aac9bfb1-117e-40fa-ac83-d47cc1a55908-kube-api-access-pn47j\") pod \"ingress-canary-lfx47\" (UID: \"aac9bfb1-117e-40fa-ac83-d47cc1a55908\") " pod="openshift-ingress-canary/ingress-canary-lfx47"
Jul 13 18:59:28.397146 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:59:28.395450    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tw68p\" (UniqueName: \"kubernetes.io/projected/53a3c346-54ba-4102-b222-db8a5c3f303f-kube-api-access-tw68p\") pod \"image-registry-7dc86c76b9-z2vt7\" (UID: \"53a3c346-54ba-4102-b222-db8a5c3f303f\") " pod="openshift-image-registry/image-registry-7dc86c76b9-z2vt7"
Jul 13 18:59:28.397146 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:59:28.395878    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/53a3c346-54ba-4102-b222-db8a5c3f303f-installation-pull-secrets\") pod \"image-registry-7dc86c76b9-z2vt7\" (UID: \"53a3c346-54ba-4102-b222-db8a5c3f303f\") " pod="openshift-image-registry/image-registry-7dc86c76b9-z2vt7"
Jul 13 18:59:28.397146 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:59:28.396224    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5ada439c-465d-4679-93ee-b2bd1271a4c0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2lg9f\" (UID: \"5ada439c-465d-4679-93ee-b2bd1271a4c0\") " pod="openshift-insights/insights-runtime-extractor-2lg9f"
Jul 13 18:59:28.397146 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:59:28.396470    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/53a3c346-54ba-4102-b222-db8a5c3f303f-registry-tls\") pod \"image-registry-7dc86c76b9-z2vt7\" (UID: \"53a3c346-54ba-4102-b222-db8a5c3f303f\") " pod="openshift-image-registry/image-registry-7dc86c76b9-z2vt7"
Jul 13 18:59:28.397146 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:59:28.396519    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ct4lm\" (UniqueName: \"kubernetes.io/projected/9d10d62c-2d07-4e0f-886d-c2655493b867-kube-api-access-ct4lm\") pod \"dns-default-99pgk\" (UID: \"9d10d62c-2d07-4e0f-886d-c2655493b867\") " pod="openshift-dns/dns-default-99pgk"
Jul 13 18:59:28.397146 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:59:28.396637    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qw7gm\" (UniqueName: \"kubernetes.io/projected/5ada439c-465d-4679-93ee-b2bd1271a4c0-kube-api-access-qw7gm\") pod \"insights-runtime-extractor-2lg9f\" (UID: \"5ada439c-465d-4679-93ee-b2bd1271a4c0\") " pod="openshift-insights/insights-runtime-extractor-2lg9f"
Jul 13 18:59:28.397146 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:59:28.396784    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9d10d62c-2d07-4e0f-886d-c2655493b867-metrics-tls\") pod \"dns-default-99pgk\" (UID: \"9d10d62c-2d07-4e0f-886d-c2655493b867\") " pod="openshift-dns/dns-default-99pgk"
Jul 13 18:59:28.397146 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:59:28.396901    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/53a3c346-54ba-4102-b222-db8a5c3f303f-image-registry-private-configuration\") pod \"image-registry-7dc86c76b9-z2vt7\" (UID: \"53a3c346-54ba-4102-b222-db8a5c3f303f\") " pod="openshift-image-registry/image-registry-7dc86c76b9-z2vt7"
Jul 13 18:59:28.397146 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:59:28.396929    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/aac9bfb1-117e-40fa-ac83-d47cc1a55908-cert\") pod \"ingress-canary-lfx47\" (UID: \"aac9bfb1-117e-40fa-ac83-d47cc1a55908\") " pod="openshift-ingress-canary/ingress-canary-lfx47"
Jul 13 18:59:28.397759 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:59:28.397013    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/53a3c346-54ba-4102-b222-db8a5c3f303f-bound-sa-token\") pod \"image-registry-7dc86c76b9-z2vt7\" (UID: \"53a3c346-54ba-4102-b222-db8a5c3f303f\") " pod="openshift-image-registry/image-registry-7dc86c76b9-z2vt7"
Jul 13 18:59:28.462427 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:59:28.462397    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-99pgk"
Jul 13 18:59:28.465062 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:59:28.465010    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-74bd64488b-bjk4l"]
Jul 13 18:59:28.469455 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:59:28.469430    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod15955ddb_408d_42d1_8a94_3091d34fe757.slice/crio-e04dddd5b91859045bf2fd97e433a297cc9e49a9f63edea44eb9383ac62015c3 WatchSource:0}: Error finding container e04dddd5b91859045bf2fd97e433a297cc9e49a9f63edea44eb9383ac62015c3: Status 404 returned error can't find the container with id e04dddd5b91859045bf2fd97e433a297cc9e49a9f63edea44eb9383ac62015c3
Jul 13 18:59:28.595412 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:59:28.595238    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-99pgk"]
Jul 13 18:59:28.597867 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:59:28.597838    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9d10d62c_2d07_4e0f_886d_c2655493b867.slice/crio-57665abf89067cdee735894d88a12d3a47f44464d083a0689c68fead1a4c352c WatchSource:0}: Error finding container 57665abf89067cdee735894d88a12d3a47f44464d083a0689c68fead1a4c352c: Status 404 returned error can't find the container with id 57665abf89067cdee735894d88a12d3a47f44464d083a0689c68fead1a4c352c
Jul 13 18:59:28.662793 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:59:28.662697    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-lfx47"
Jul 13 18:59:28.668338 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:59:28.668304    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-2lg9f"
Jul 13 18:59:28.676686 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:59:28.676654    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7dc86c76b9-z2vt7"
Jul 13 18:59:28.704855 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:59:28.704770    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5bc6c754db-87bqk"]
Jul 13 18:59:28.710304 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:59:28.710266    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf9d60dad_1e8f_4575_9ca4_c5015b3d4b2d.slice/crio-4e27d860cf6a264df6795d8699f703163304211135d638072b8bc31509c5be2a WatchSource:0}: Error finding container 4e27d860cf6a264df6795d8699f703163304211135d638072b8bc31509c5be2a: Status 404 returned error can't find the container with id 4e27d860cf6a264df6795d8699f703163304211135d638072b8bc31509c5be2a
Jul 13 18:59:28.741323 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:59:28.740656    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-6f79f6bbd8-8mnrp"]
Jul 13 18:59:28.832261 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:59:28.832220    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-lfx47"]
Jul 13 18:59:28.837356 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:59:28.837324    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaac9bfb1_117e_40fa_ac83_d47cc1a55908.slice/crio-ec2e3a9b7351230d45d8c1c04c19e98f7e93998b20687480e1a2ee08fc959766 WatchSource:0}: Error finding container ec2e3a9b7351230d45d8c1c04c19e98f7e93998b20687480e1a2ee08fc959766: Status 404 returned error can't find the container with id ec2e3a9b7351230d45d8c1c04c19e98f7e93998b20687480e1a2ee08fc959766
Jul 13 18:59:28.977289 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:59:28.977183    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-99pgk" event={"ID":"9d10d62c-2d07-4e0f-886d-c2655493b867","Type":"ContainerStarted","Data":"57665abf89067cdee735894d88a12d3a47f44464d083a0689c68fead1a4c352c"}
Jul 13 18:59:28.978260 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:59:28.978236    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5bc6c754db-87bqk" event={"ID":"f9d60dad-1e8f-4575-9ca4-c5015b3d4b2d","Type":"ContainerStarted","Data":"4e27d860cf6a264df6795d8699f703163304211135d638072b8bc31509c5be2a"}
Jul 13 18:59:28.979420 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:59:28.979392    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6f79f6bbd8-8mnrp" event={"ID":"cde15ec2-6044-4e2f-9eaf-ec83730850eb","Type":"ContainerStarted","Data":"07267dd514f2e1be072a5ae9b76c805e871a7093590157b906b41aced8639331"}
Jul 13 18:59:28.980679 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:59:28.980656    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-lfx47" event={"ID":"aac9bfb1-117e-40fa-ac83-d47cc1a55908","Type":"ContainerStarted","Data":"ec2e3a9b7351230d45d8c1c04c19e98f7e93998b20687480e1a2ee08fc959766"}
Jul 13 18:59:28.981769 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:59:28.981746    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-74bd64488b-bjk4l" event={"ID":"15955ddb-408d-42d1-8a94-3091d34fe757","Type":"ContainerStarted","Data":"e04dddd5b91859045bf2fd97e433a297cc9e49a9f63edea44eb9383ac62015c3"}
Jul 13 18:59:28.981862 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:59:28.981789    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-59d7889dfd-7fv4b"
Jul 13 18:59:29.034679 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:59:29.034359    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-59d7889dfd-7fv4b"]
Jul 13 18:59:29.036304 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:59:29.036277    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-59d7889dfd-7fv4b"]
Jul 13 18:59:29.057856 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:59:29.057824    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-2lg9f"]
Jul 13 18:59:29.061745 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:59:29.061702    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5ada439c_465d_4679_93ee_b2bd1271a4c0.slice/crio-ac2f94c48cb6fccc60894210599de4a1e111f7356b1278bfea19f4bf4a282fea WatchSource:0}: Error finding container ac2f94c48cb6fccc60894210599de4a1e111f7356b1278bfea19f4bf4a282fea: Status 404 returned error can't find the container with id ac2f94c48cb6fccc60894210599de4a1e111f7356b1278bfea19f4bf4a282fea
Jul 13 18:59:29.062868 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:59:29.062843    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7dc86c76b9-z2vt7"]
Jul 13 18:59:29.066228 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:59:29.066197    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod53a3c346_54ba_4102_b222_db8a5c3f303f.slice/crio-5a2aa7b17ae15e914c5eff80814b5bddc9d162741ae0d6e54c80c551108b72e0 WatchSource:0}: Error finding container 5a2aa7b17ae15e914c5eff80814b5bddc9d162741ae0d6e54c80c551108b72e0: Status 404 returned error can't find the container with id 5a2aa7b17ae15e914c5eff80814b5bddc9d162741ae0d6e54c80c551108b72e0
Jul 13 18:59:30.012057 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:59:30.011917    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-2lg9f" event={"ID":"5ada439c-465d-4679-93ee-b2bd1271a4c0","Type":"ContainerStarted","Data":"ac2f94c48cb6fccc60894210599de4a1e111f7356b1278bfea19f4bf4a282fea"}
Jul 13 18:59:30.026093 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:59:30.025085    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7dc86c76b9-z2vt7" event={"ID":"53a3c346-54ba-4102-b222-db8a5c3f303f","Type":"ContainerStarted","Data":"6fc0cbdc24d103f79d0a576b2d5ac0c8cd3482512b2a7aa8c2ca5902f731a729"}
Jul 13 18:59:30.026093 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:59:30.025156    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7dc86c76b9-z2vt7" event={"ID":"53a3c346-54ba-4102-b222-db8a5c3f303f","Type":"ContainerStarted","Data":"5a2aa7b17ae15e914c5eff80814b5bddc9d162741ae0d6e54c80c551108b72e0"}
Jul 13 18:59:30.026093 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:59:30.026002    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-7dc86c76b9-z2vt7"
Jul 13 18:59:30.051323 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:59:30.050082    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-7dc86c76b9-z2vt7" podStartSLOduration=2.050061799 podStartE2EDuration="2.050061799s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 18:59:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 18:59:30.049316677 +0000 UTC m=+57.824193028" watchObservedRunningTime="2026-07-13 18:59:30.050061799 +0000 UTC m=+57.824938136"
Jul 13 18:59:30.767882 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:59:30.767489    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6f6c0fa7-f21d-4803-9177-105962563bcc" path="/var/lib/kubelet/pods/6f6c0fa7-f21d-4803-9177-105962563bcc/volumes"
Jul 13 18:59:32.915504 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:59:32.915451    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-hwqhc"
Jul 13 18:59:38.441673 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:59:38.441628    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/aba89b91-cc04-4c11-8692-1c17006f5f7a-original-pull-secret\") pod \"global-pull-secret-syncer-b7ptz\" (UID: \"aba89b91-cc04-4c11-8692-1c17006f5f7a\") " pod="kube-system/global-pull-secret-syncer-b7ptz"
Jul 13 18:59:38.441673 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:59:38.441674    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/02bf7c85-7eab-4d14-8e16-562c3ee29573-metrics-certs\") pod \"network-metrics-daemon-8hrpw\" (UID: \"02bf7c85-7eab-4d14-8e16-562c3ee29573\") " pod="openshift-multus/network-metrics-daemon-8hrpw"
Jul 13 18:59:38.443869 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:59:38.443850    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 13 18:59:38.444500 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:59:38.444479    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 13 18:59:38.454563 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:59:38.454526    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/02bf7c85-7eab-4d14-8e16-562c3ee29573-metrics-certs\") pod \"network-metrics-daemon-8hrpw\" (UID: \"02bf7c85-7eab-4d14-8e16-562c3ee29573\") " pod="openshift-multus/network-metrics-daemon-8hrpw"
Jul 13 18:59:38.454563 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:59:38.454560    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/aba89b91-cc04-4c11-8692-1c17006f5f7a-original-pull-secret\") pod \"global-pull-secret-syncer-b7ptz\" (UID: \"aba89b91-cc04-4c11-8692-1c17006f5f7a\") " pod="kube-system/global-pull-secret-syncer-b7ptz"
Jul 13 18:59:38.542458 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:59:38.542418    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lc2ff\" (UniqueName: \"kubernetes.io/projected/c72f59c6-8ebc-447d-8b92-096dac42859f-kube-api-access-lc2ff\") pod \"network-check-target-vbjkv\" (UID: \"c72f59c6-8ebc-447d-8b92-096dac42859f\") " pod="openshift-network-diagnostics/network-check-target-vbjkv"
Jul 13 18:59:38.545472 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:59:38.545446    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 13 18:59:38.556277 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:59:38.556242    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 13 18:59:38.563421 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:59:38.563393    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b7ptz"
Jul 13 18:59:38.567068 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:59:38.567040    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lc2ff\" (UniqueName: \"kubernetes.io/projected/c72f59c6-8ebc-447d-8b92-096dac42859f-kube-api-access-lc2ff\") pod \"network-check-target-vbjkv\" (UID: \"c72f59c6-8ebc-447d-8b92-096dac42859f\") " pod="openshift-network-diagnostics/network-check-target-vbjkv"
Jul 13 18:59:38.573239 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:59:38.573207    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-cvxxg\""
Jul 13 18:59:38.580757 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:59:38.580727    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-bqf9d\""
Jul 13 18:59:38.580927 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:59:38.580812    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8hrpw"
Jul 13 18:59:38.587541 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:59:38.587513    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vbjkv"
Jul 13 18:59:39.710572 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:59:39.709862    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-b7ptz"]
Jul 13 18:59:39.724203 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:59:39.723475    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-vbjkv"]
Jul 13 18:59:39.726388 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:59:39.725795    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-8hrpw"]
Jul 13 18:59:39.734086 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:59:39.733248    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc72f59c6_8ebc_447d_8b92_096dac42859f.slice/crio-ddc731c92bec4757168ecb33791fff38292d38dfac498a50e2c592605851b466 WatchSource:0}: Error finding container ddc731c92bec4757168ecb33791fff38292d38dfac498a50e2c592605851b466: Status 404 returned error can't find the container with id ddc731c92bec4757168ecb33791fff38292d38dfac498a50e2c592605851b466
Jul 13 18:59:40.063070 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:59:40.062911    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-99pgk" event={"ID":"9d10d62c-2d07-4e0f-886d-c2655493b867","Type":"ContainerStarted","Data":"faf04cd1ecc313746f229411775a1aca4fe1728775f643a037ddace914ac0fb6"}
Jul 13 18:59:40.063070 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:59:40.062977    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-99pgk" event={"ID":"9d10d62c-2d07-4e0f-886d-c2655493b867","Type":"ContainerStarted","Data":"42716ad14281db84d2c2e401f1cdeee5c877939a37f3d1a0e59a66d8871f0cd5"}
Jul 13 18:59:40.063352 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:59:40.063070    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-99pgk"
Jul 13 18:59:40.065659 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:59:40.065617    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5bc6c754db-87bqk" event={"ID":"f9d60dad-1e8f-4575-9ca4-c5015b3d4b2d","Type":"ContainerStarted","Data":"069e522bd2984938dcf725aa303a7673a25f25ed41b6d036dc38b14693b3868b"}
Jul 13 18:59:40.065840 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:59:40.065684    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5bc6c754db-87bqk" event={"ID":"f9d60dad-1e8f-4575-9ca4-c5015b3d4b2d","Type":"ContainerStarted","Data":"27c9cef4af72f66e02347eb8fb39f642f9bfa57db15e111d1d2a447a0b2c2614"}
Jul 13 18:59:40.065840 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:59:40.065709    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5bc6c754db-87bqk" event={"ID":"f9d60dad-1e8f-4575-9ca4-c5015b3d4b2d","Type":"ContainerStarted","Data":"2fe7bb877f2537748cb0c6ec68eb5ac789e8ad5613e60294426ccfa7b2d0c516"}
Jul 13 18:59:40.067469 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:59:40.067422    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6f79f6bbd8-8mnrp" event={"ID":"cde15ec2-6044-4e2f-9eaf-ec83730850eb","Type":"ContainerStarted","Data":"1dc31db86aabb4ec8f8aaa6dc52aea4aff5a1b4ee12c6b75c487102fa4819515"}
Jul 13 18:59:40.067674 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:59:40.067650    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6f79f6bbd8-8mnrp"
Jul 13 18:59:40.068863 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:59:40.068831    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-8hrpw" event={"ID":"02bf7c85-7eab-4d14-8e16-562c3ee29573","Type":"ContainerStarted","Data":"4e2406a683b9e85b8a34b007bddac66be0ecf51e9c4f3b8cd88bc586da82a95d"}
Jul 13 18:59:40.070371 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:59:40.070345    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6f79f6bbd8-8mnrp"
Jul 13 18:59:40.070787 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:59:40.070576    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-lfx47" event={"ID":"aac9bfb1-117e-40fa-ac83-d47cc1a55908","Type":"ContainerStarted","Data":"c452a11a7c051aa69b5629f25a0b8d7d8ceba69bb3c3d27c96a85186383bd942"}
Jul 13 18:59:40.072112 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:59:40.072087    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-74bd64488b-bjk4l" event={"ID":"15955ddb-408d-42d1-8a94-3091d34fe757","Type":"ContainerStarted","Data":"3385e35b2c242d9d03c762a68dbb44a9b3d9d89c45d52db9df163b9b1a3e275c"}
Jul 13 18:59:40.073293 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:59:40.073268    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-vbjkv" event={"ID":"c72f59c6-8ebc-447d-8b92-096dac42859f","Type":"ContainerStarted","Data":"ddc731c92bec4757168ecb33791fff38292d38dfac498a50e2c592605851b466"}
Jul 13 18:59:40.074714 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:59:40.074693    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-2lg9f" event={"ID":"5ada439c-465d-4679-93ee-b2bd1271a4c0","Type":"ContainerStarted","Data":"7f07500a8111061b0b5465ad6485613de3e5549b38a188302c97faa4a4f3b882"}
Jul 13 18:59:40.075798 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:59:40.075778    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-b7ptz" event={"ID":"aba89b91-cc04-4c11-8692-1c17006f5f7a","Type":"ContainerStarted","Data":"67dae1b91ba7bba20d1f036562949ba8272d8e2467c7c3cf9393329e810473e4"}
Jul 13 18:59:40.083407 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:59:40.083355    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-99pgk" podStartSLOduration=1.198936546 podStartE2EDuration="12.083337792s" totalImagesPullingTime="10.884401246s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 18:59:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 18:59:40.082495523 +0000 UTC m=+67.857371882" watchObservedRunningTime="2026-07-13 18:59:40.083337792 +0000 UTC m=+67.858214165"
Jul 13 18:59:40.100248 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:59:40.100194    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-lfx47" podStartSLOduration=1.458926696 podStartE2EDuration="12.10017632s" totalImagesPullingTime="10.641249624s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 18:59:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 18:59:40.09959277 +0000 UTC m=+67.874469123" watchObservedRunningTime="2026-07-13 18:59:40.10017632 +0000 UTC m=+67.875052724"
Jul 13 18:59:40.123306 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:59:40.123252    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-74bd64488b-bjk4l" podStartSLOduration=2.113199569 podStartE2EDuration="13.123236023s" totalImagesPullingTime="11.010036454s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 18:59:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 18:59:40.121995383 +0000 UTC m=+67.896871739" watchObservedRunningTime="2026-07-13 18:59:40.123236023 +0000 UTC m=+67.898112378"
Jul 13 18:59:40.137245 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:59:40.137179    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6f79f6bbd8-8mnrp" podStartSLOduration=2.396442123 podStartE2EDuration="13.13715789s" totalImagesPullingTime="10.740715767s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 18:59:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 18:59:40.136394631 +0000 UTC m=+67.911270987" watchObservedRunningTime="2026-07-13 18:59:40.13715789 +0000 UTC m=+67.912034579"
Jul 13 18:59:40.155327 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:59:40.155263    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5bc6c754db-87bqk" podStartSLOduration=2.38339179 podStartE2EDuration="13.155238854s" totalImagesPullingTime="10.771847064s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 18:59:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 18:59:40.154621193 +0000 UTC m=+67.929497563" watchObservedRunningTime="2026-07-13 18:59:40.155238854 +0000 UTC m=+67.930115209"
Jul 13 18:59:41.092191 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:59:41.092090    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-2lg9f" event={"ID":"5ada439c-465d-4679-93ee-b2bd1271a4c0","Type":"ContainerStarted","Data":"204d4a2bb4e3b2ec5b2c276214f94cbeb5694f1b9e56661219ad17e4e8f4bc24"}
Jul 13 18:59:42.100095 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:59:42.099954    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-8hrpw" event={"ID":"02bf7c85-7eab-4d14-8e16-562c3ee29573","Type":"ContainerStarted","Data":"02335cfb4fa16136b574e84c01655185ea9157eec1635174007360f4f5d3c85d"}
Jul 13 18:59:42.100095 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:59:42.100046    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-8hrpw" event={"ID":"02bf7c85-7eab-4d14-8e16-562c3ee29573","Type":"ContainerStarted","Data":"73efaf35382506fa448e335a149bf7c1164e8e492cd4cfb94d63847689ed8fde"}
Jul 13 18:59:42.122064 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:59:42.121891    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-8hrpw" podStartSLOduration=68.898538086 podStartE2EDuration="1m10.121867163s" totalImagesPullingTime="1.223329077s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 18:58:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 18:59:42.118696848 +0000 UTC m=+69.893573208" watchObservedRunningTime="2026-07-13 18:59:42.121867163 +0000 UTC m=+69.896743521"
Jul 13 18:59:45.820446 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:59:45.820356    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-jc5v8"]
Jul 13 18:59:45.823655 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:59:45.823624    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-jc5v8"
Jul 13 18:59:45.826155 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:59:45.826128    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 13 18:59:45.826299 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:59:45.826236    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 13 18:59:45.826299 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:59:45.826251    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 13 18:59:45.826299 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:59:45.826246    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 13 18:59:45.827042 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:59:45.827008    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 13 18:59:45.827167 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:59:45.827063    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 13 18:59:45.827167 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:59:45.827105    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-486zq\""
Jul 13 18:59:45.910304 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:59:45.910260    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/68b03403-477c-48c2-9bd6-dc8836fcbdfa-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-jc5v8\" (UID: \"68b03403-477c-48c2-9bd6-dc8836fcbdfa\") " pod="openshift-monitoring/node-exporter-jc5v8"
Jul 13 18:59:45.910304 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:59:45.910306    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/68b03403-477c-48c2-9bd6-dc8836fcbdfa-node-exporter-wtmp\") pod \"node-exporter-jc5v8\" (UID: \"68b03403-477c-48c2-9bd6-dc8836fcbdfa\") " pod="openshift-monitoring/node-exporter-jc5v8"
Jul 13 18:59:45.910519 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:59:45.910333    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j4zst\" (UniqueName: \"kubernetes.io/projected/68b03403-477c-48c2-9bd6-dc8836fcbdfa-kube-api-access-j4zst\") pod \"node-exporter-jc5v8\" (UID: \"68b03403-477c-48c2-9bd6-dc8836fcbdfa\") " pod="openshift-monitoring/node-exporter-jc5v8"
Jul 13 18:59:45.910519 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:59:45.910410    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/68b03403-477c-48c2-9bd6-dc8836fcbdfa-sys\") pod \"node-exporter-jc5v8\" (UID: \"68b03403-477c-48c2-9bd6-dc8836fcbdfa\") " pod="openshift-monitoring/node-exporter-jc5v8"
Jul 13 18:59:45.910519 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:59:45.910435    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/68b03403-477c-48c2-9bd6-dc8836fcbdfa-node-exporter-textfile\") pod \"node-exporter-jc5v8\" (UID: \"68b03403-477c-48c2-9bd6-dc8836fcbdfa\") " pod="openshift-monitoring/node-exporter-jc5v8"
Jul 13 18:59:45.910519 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:59:45.910466    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/68b03403-477c-48c2-9bd6-dc8836fcbdfa-root\") pod \"node-exporter-jc5v8\" (UID: \"68b03403-477c-48c2-9bd6-dc8836fcbdfa\") " pod="openshift-monitoring/node-exporter-jc5v8"
Jul 13 18:59:45.910519 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:59:45.910487    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/68b03403-477c-48c2-9bd6-dc8836fcbdfa-metrics-client-ca\") pod \"node-exporter-jc5v8\" (UID: \"68b03403-477c-48c2-9bd6-dc8836fcbdfa\") " pod="openshift-monitoring/node-exporter-jc5v8"
Jul 13 18:59:45.910519 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:59:45.910518    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/68b03403-477c-48c2-9bd6-dc8836fcbdfa-node-exporter-tls\") pod \"node-exporter-jc5v8\" (UID: \"68b03403-477c-48c2-9bd6-dc8836fcbdfa\") " pod="openshift-monitoring/node-exporter-jc5v8"
Jul 13 18:59:45.910694 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:59:45.910537    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/68b03403-477c-48c2-9bd6-dc8836fcbdfa-node-exporter-accelerators-collector-config\") pod \"node-exporter-jc5v8\" (UID: \"68b03403-477c-48c2-9bd6-dc8836fcbdfa\") " pod="openshift-monitoring/node-exporter-jc5v8"
Jul 13 18:59:46.011078 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:59:46.011013    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/68b03403-477c-48c2-9bd6-dc8836fcbdfa-sys\") pod \"node-exporter-jc5v8\" (UID: \"68b03403-477c-48c2-9bd6-dc8836fcbdfa\") " pod="openshift-monitoring/node-exporter-jc5v8"
Jul 13 18:59:46.011078 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:59:46.011080    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/68b03403-477c-48c2-9bd6-dc8836fcbdfa-node-exporter-textfile\") pod \"node-exporter-jc5v8\" (UID: \"68b03403-477c-48c2-9bd6-dc8836fcbdfa\") " pod="openshift-monitoring/node-exporter-jc5v8"
Jul 13 18:59:46.011298 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:59:46.011108    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/68b03403-477c-48c2-9bd6-dc8836fcbdfa-root\") pod \"node-exporter-jc5v8\" (UID: \"68b03403-477c-48c2-9bd6-dc8836fcbdfa\") " pod="openshift-monitoring/node-exporter-jc5v8"
Jul 13 18:59:46.011298 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:59:46.011124    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/68b03403-477c-48c2-9bd6-dc8836fcbdfa-metrics-client-ca\") pod \"node-exporter-jc5v8\" (UID: \"68b03403-477c-48c2-9bd6-dc8836fcbdfa\") " pod="openshift-monitoring/node-exporter-jc5v8"
Jul 13 18:59:46.011298 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:59:46.011134    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/68b03403-477c-48c2-9bd6-dc8836fcbdfa-sys\") pod \"node-exporter-jc5v8\" (UID: \"68b03403-477c-48c2-9bd6-dc8836fcbdfa\") " pod="openshift-monitoring/node-exporter-jc5v8"
Jul 13 18:59:46.011298 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:59:46.011145    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/68b03403-477c-48c2-9bd6-dc8836fcbdfa-node-exporter-tls\") pod \"node-exporter-jc5v8\" (UID: \"68b03403-477c-48c2-9bd6-dc8836fcbdfa\") " pod="openshift-monitoring/node-exporter-jc5v8"
Jul 13 18:59:46.011298 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:59:46.011209    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/68b03403-477c-48c2-9bd6-dc8836fcbdfa-root\") pod \"node-exporter-jc5v8\" (UID: \"68b03403-477c-48c2-9bd6-dc8836fcbdfa\") " pod="openshift-monitoring/node-exporter-jc5v8"
Jul 13 18:59:46.011298 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:59:46.011210    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/68b03403-477c-48c2-9bd6-dc8836fcbdfa-node-exporter-accelerators-collector-config\") pod \"node-exporter-jc5v8\" (UID: \"68b03403-477c-48c2-9bd6-dc8836fcbdfa\") " pod="openshift-monitoring/node-exporter-jc5v8"
Jul 13 18:59:46.011298 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:59:46.011272    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/68b03403-477c-48c2-9bd6-dc8836fcbdfa-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-jc5v8\" (UID: \"68b03403-477c-48c2-9bd6-dc8836fcbdfa\") " pod="openshift-monitoring/node-exporter-jc5v8"
Jul 13 18:59:46.011298 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:59:46.011299    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/68b03403-477c-48c2-9bd6-dc8836fcbdfa-node-exporter-wtmp\") pod \"node-exporter-jc5v8\" (UID: \"68b03403-477c-48c2-9bd6-dc8836fcbdfa\") " pod="openshift-monitoring/node-exporter-jc5v8"
Jul 13 18:59:46.011707 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:59:46.011334    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j4zst\" (UniqueName: \"kubernetes.io/projected/68b03403-477c-48c2-9bd6-dc8836fcbdfa-kube-api-access-j4zst\") pod \"node-exporter-jc5v8\" (UID: \"68b03403-477c-48c2-9bd6-dc8836fcbdfa\") " pod="openshift-monitoring/node-exporter-jc5v8"
Jul 13 18:59:46.011707 ip-10-0-135-38 kubenswrapper[2563]: E0713 18:59:46.011344    2563 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Jul 13 18:59:46.011707 ip-10-0-135-38 kubenswrapper[2563]: E0713 18:59:46.011407    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/68b03403-477c-48c2-9bd6-dc8836fcbdfa-node-exporter-tls podName:68b03403-477c-48c2-9bd6-dc8836fcbdfa nodeName:}" failed. No retries permitted until 2026-07-13 18:59:46.511385378 +0000 UTC m=+74.286261723 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/68b03403-477c-48c2-9bd6-dc8836fcbdfa-node-exporter-tls") pod "node-exporter-jc5v8" (UID: "68b03403-477c-48c2-9bd6-dc8836fcbdfa") : secret "node-exporter-tls" not found
Jul 13 18:59:46.011707 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:59:46.011516    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/68b03403-477c-48c2-9bd6-dc8836fcbdfa-node-exporter-textfile\") pod \"node-exporter-jc5v8\" (UID: \"68b03403-477c-48c2-9bd6-dc8836fcbdfa\") " pod="openshift-monitoring/node-exporter-jc5v8"
Jul 13 18:59:46.011707 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:59:46.011581    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/68b03403-477c-48c2-9bd6-dc8836fcbdfa-node-exporter-wtmp\") pod \"node-exporter-jc5v8\" (UID: \"68b03403-477c-48c2-9bd6-dc8836fcbdfa\") " pod="openshift-monitoring/node-exporter-jc5v8"
Jul 13 18:59:46.011879 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:59:46.011752    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/68b03403-477c-48c2-9bd6-dc8836fcbdfa-metrics-client-ca\") pod \"node-exporter-jc5v8\" (UID: \"68b03403-477c-48c2-9bd6-dc8836fcbdfa\") " pod="openshift-monitoring/node-exporter-jc5v8"
Jul 13 18:59:46.011879 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:59:46.011798    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/68b03403-477c-48c2-9bd6-dc8836fcbdfa-node-exporter-accelerators-collector-config\") pod \"node-exporter-jc5v8\" (UID: \"68b03403-477c-48c2-9bd6-dc8836fcbdfa\") " pod="openshift-monitoring/node-exporter-jc5v8"
Jul 13 18:59:46.013630 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:59:46.013613    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/68b03403-477c-48c2-9bd6-dc8836fcbdfa-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-jc5v8\" (UID: \"68b03403-477c-48c2-9bd6-dc8836fcbdfa\") " pod="openshift-monitoring/node-exporter-jc5v8"
Jul 13 18:59:46.030939 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:59:46.030900    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j4zst\" (UniqueName: \"kubernetes.io/projected/68b03403-477c-48c2-9bd6-dc8836fcbdfa-kube-api-access-j4zst\") pod \"node-exporter-jc5v8\" (UID: \"68b03403-477c-48c2-9bd6-dc8836fcbdfa\") " pod="openshift-monitoring/node-exporter-jc5v8"
Jul 13 18:59:46.117106 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:59:46.117068    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-vbjkv" event={"ID":"c72f59c6-8ebc-447d-8b92-096dac42859f","Type":"ContainerStarted","Data":"fc807f37f2acfaa5cda8925e2761d15f1a98db1785b62b7aac295b2479921daf"}
Jul 13 18:59:46.117305 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:59:46.117139    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-vbjkv"
Jul 13 18:59:46.119130 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:59:46.119098    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-2lg9f" event={"ID":"5ada439c-465d-4679-93ee-b2bd1271a4c0","Type":"ContainerStarted","Data":"4b5abe9cb70cf49da3ef545f4ed922b279f9fdf501ce7ff8d456a7e77b3fa078"}
Jul 13 18:59:46.120487 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:59:46.120462    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-b7ptz" event={"ID":"aba89b91-cc04-4c11-8692-1c17006f5f7a","Type":"ContainerStarted","Data":"93c98fbbdb104d41f42df9e6545e96a9ab34977e60576d8fb0ae83116419b641"}
Jul 13 18:59:46.137820 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:59:46.137763    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-vbjkv" podStartSLOduration=68.32365339 podStartE2EDuration="1m14.137714205s" totalImagesPullingTime="5.814060815s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 18:58:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 18:59:46.136756617 +0000 UTC m=+73.911632972" watchObservedRunningTime="2026-07-13 18:59:46.137714205 +0000 UTC m=+73.912590562"
Jul 13 18:59:46.161484 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:59:46.161426    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-2lg9f" podStartSLOduration=1.9242161869999999 podStartE2EDuration="18.161408401s" totalImagesPullingTime="16.237192214s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 18:59:28 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 18:59:46.160681188 +0000 UTC m=+73.935557545" watchObservedRunningTime="2026-07-13 18:59:46.161408401 +0000 UTC m=+73.936284756"
Jul 13 18:59:46.178537 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:59:46.178479    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-b7ptz" podStartSLOduration=68.337408917 podStartE2EDuration="1m14.178463672s" totalImagesPullingTime="5.841054755s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 18:58:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 18:59:46.177823769 +0000 UTC m=+73.952700124" watchObservedRunningTime="2026-07-13 18:59:46.178463672 +0000 UTC m=+73.953340028"
Jul 13 18:59:46.516841 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:59:46.516735    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/68b03403-477c-48c2-9bd6-dc8836fcbdfa-node-exporter-tls\") pod \"node-exporter-jc5v8\" (UID: \"68b03403-477c-48c2-9bd6-dc8836fcbdfa\") " pod="openshift-monitoring/node-exporter-jc5v8"
Jul 13 18:59:46.519381 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:59:46.519355    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/68b03403-477c-48c2-9bd6-dc8836fcbdfa-node-exporter-tls\") pod \"node-exporter-jc5v8\" (UID: \"68b03403-477c-48c2-9bd6-dc8836fcbdfa\") " pod="openshift-monitoring/node-exporter-jc5v8"
Jul 13 18:59:46.733135 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:59:46.733100    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-jc5v8"
Jul 13 18:59:46.745667 ip-10-0-135-38 kubenswrapper[2563]: W0713 18:59:46.745635    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod68b03403_477c_48c2_9bd6_dc8836fcbdfa.slice/crio-cb4b2b79ef4135124450300602a2935bc8748076e7cbfe72e479e94600161a95 WatchSource:0}: Error finding container cb4b2b79ef4135124450300602a2935bc8748076e7cbfe72e479e94600161a95: Status 404 returned error can't find the container with id cb4b2b79ef4135124450300602a2935bc8748076e7cbfe72e479e94600161a95
Jul 13 18:59:47.125103 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:59:47.125056    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-jc5v8" event={"ID":"68b03403-477c-48c2-9bd6-dc8836fcbdfa","Type":"ContainerStarted","Data":"cb4b2b79ef4135124450300602a2935bc8748076e7cbfe72e479e94600161a95"}
Jul 13 18:59:48.681623 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:59:48.681578    2563 patch_prober.go:28] interesting pod/image-registry-7dc86c76b9-z2vt7 container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 13 18:59:48.682368 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:59:48.681645    2563 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-7dc86c76b9-z2vt7" podUID="53a3c346-54ba-4102-b222-db8a5c3f303f" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 13 18:59:49.134380 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:59:49.134343    2563 generic.go:356] "Generic (PLEG): container finished" podID="68b03403-477c-48c2-9bd6-dc8836fcbdfa" containerID="a8c174779ae9730683d28f676efa8529c8412c0166a9bca795685a0dfe4bb9f3" exitCode=0
Jul 13 18:59:49.134562 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:59:49.134410    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-jc5v8" event={"ID":"68b03403-477c-48c2-9bd6-dc8836fcbdfa","Type":"ContainerDied","Data":"a8c174779ae9730683d28f676efa8529c8412c0166a9bca795685a0dfe4bb9f3"}
Jul 13 18:59:50.095306 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:59:50.095268    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-99pgk"
Jul 13 18:59:50.142519 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:59:50.142484    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-jc5v8" event={"ID":"68b03403-477c-48c2-9bd6-dc8836fcbdfa","Type":"ContainerStarted","Data":"bb1cf786a0b824d32aebe5be12c9c50b9e2363b4141a05cccde404fd54195b37"}
Jul 13 18:59:50.142731 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:59:50.142539    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-jc5v8" event={"ID":"68b03403-477c-48c2-9bd6-dc8836fcbdfa","Type":"ContainerStarted","Data":"c5b85c9f5510376db49f7f1634b1aee0d58d40a3f12ae9ec6f4d7c2ef55c865e"}
Jul 13 18:59:50.162875 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:59:50.162809    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-jc5v8" podStartSLOduration=3.694726995 podStartE2EDuration="5.162789193s" totalImagesPullingTime="1.399672272s" totalInitContainerRuntime="68.389926ms" isStatefulPod=true podCreationTimestamp="2026-07-13 18:59:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 18:59:50.161378562 +0000 UTC m=+77.936254947" watchObservedRunningTime="2026-07-13 18:59:50.162789193 +0000 UTC m=+77.937665548"
Jul 13 18:59:52.042427 ip-10-0-135-38 kubenswrapper[2563]: I0713 18:59:52.042396    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-7dc86c76b9-z2vt7"
Jul 13 19:00:17.128067 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:00:17.128005    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-vbjkv"
Jul 13 19:03:20.053014 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:03:20.052979    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-559f5498f-sc6bc"]
Jul 13 19:03:20.055066 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:03:20.055046    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-559f5498f-sc6bc"
Jul 13 19:03:20.057622 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:03:20.057597    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 13 19:03:20.057764 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:03:20.057670    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 13 19:03:20.068157 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:03:20.068121    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 13 19:03:20.068314 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:03:20.068207    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 13 19:03:20.070560 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:03:20.070541    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-q7qnq\""
Jul 13 19:03:20.081560 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:03:20.081527    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-559f5498f-sc6bc"]
Jul 13 19:03:20.134842 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:03:20.134797    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/c4ad9c42-34fc-4532-ab29-e2fbfc5daba0-manifests\") pod \"opendatahub-operator-controller-manager-559f5498f-sc6bc\" (UID: \"c4ad9c42-34fc-4532-ab29-e2fbfc5daba0\") " pod="opendatahub/opendatahub-operator-controller-manager-559f5498f-sc6bc"
Jul 13 19:03:20.134842 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:03:20.134842    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c4ad9c42-34fc-4532-ab29-e2fbfc5daba0-webhook-cert\") pod \"opendatahub-operator-controller-manager-559f5498f-sc6bc\" (UID: \"c4ad9c42-34fc-4532-ab29-e2fbfc5daba0\") " pod="opendatahub/opendatahub-operator-controller-manager-559f5498f-sc6bc"
Jul 13 19:03:20.135147 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:03:20.134929    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c4ad9c42-34fc-4532-ab29-e2fbfc5daba0-tmp\") pod \"opendatahub-operator-controller-manager-559f5498f-sc6bc\" (UID: \"c4ad9c42-34fc-4532-ab29-e2fbfc5daba0\") " pod="opendatahub/opendatahub-operator-controller-manager-559f5498f-sc6bc"
Jul 13 19:03:20.135147 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:03:20.134990    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2v6mm\" (UniqueName: \"kubernetes.io/projected/c4ad9c42-34fc-4532-ab29-e2fbfc5daba0-kube-api-access-2v6mm\") pod \"opendatahub-operator-controller-manager-559f5498f-sc6bc\" (UID: \"c4ad9c42-34fc-4532-ab29-e2fbfc5daba0\") " pod="opendatahub/opendatahub-operator-controller-manager-559f5498f-sc6bc"
Jul 13 19:03:20.135147 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:03:20.135063    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/c4ad9c42-34fc-4532-ab29-e2fbfc5daba0-apiservice-cert\") pod \"opendatahub-operator-controller-manager-559f5498f-sc6bc\" (UID: \"c4ad9c42-34fc-4532-ab29-e2fbfc5daba0\") " pod="opendatahub/opendatahub-operator-controller-manager-559f5498f-sc6bc"
Jul 13 19:03:20.236340 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:03:20.236284    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c4ad9c42-34fc-4532-ab29-e2fbfc5daba0-tmp\") pod \"opendatahub-operator-controller-manager-559f5498f-sc6bc\" (UID: \"c4ad9c42-34fc-4532-ab29-e2fbfc5daba0\") " pod="opendatahub/opendatahub-operator-controller-manager-559f5498f-sc6bc"
Jul 13 19:03:20.236340 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:03:20.236332    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2v6mm\" (UniqueName: \"kubernetes.io/projected/c4ad9c42-34fc-4532-ab29-e2fbfc5daba0-kube-api-access-2v6mm\") pod \"opendatahub-operator-controller-manager-559f5498f-sc6bc\" (UID: \"c4ad9c42-34fc-4532-ab29-e2fbfc5daba0\") " pod="opendatahub/opendatahub-operator-controller-manager-559f5498f-sc6bc"
Jul 13 19:03:20.236621 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:03:20.236366    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/c4ad9c42-34fc-4532-ab29-e2fbfc5daba0-apiservice-cert\") pod \"opendatahub-operator-controller-manager-559f5498f-sc6bc\" (UID: \"c4ad9c42-34fc-4532-ab29-e2fbfc5daba0\") " pod="opendatahub/opendatahub-operator-controller-manager-559f5498f-sc6bc"
Jul 13 19:03:20.236621 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:03:20.236420    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/c4ad9c42-34fc-4532-ab29-e2fbfc5daba0-manifests\") pod \"opendatahub-operator-controller-manager-559f5498f-sc6bc\" (UID: \"c4ad9c42-34fc-4532-ab29-e2fbfc5daba0\") " pod="opendatahub/opendatahub-operator-controller-manager-559f5498f-sc6bc"
Jul 13 19:03:20.236621 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:03:20.236444    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c4ad9c42-34fc-4532-ab29-e2fbfc5daba0-webhook-cert\") pod \"opendatahub-operator-controller-manager-559f5498f-sc6bc\" (UID: \"c4ad9c42-34fc-4532-ab29-e2fbfc5daba0\") " pod="opendatahub/opendatahub-operator-controller-manager-559f5498f-sc6bc"
Jul 13 19:03:20.236813 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:03:20.236793    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/c4ad9c42-34fc-4532-ab29-e2fbfc5daba0-manifests\") pod \"opendatahub-operator-controller-manager-559f5498f-sc6bc\" (UID: \"c4ad9c42-34fc-4532-ab29-e2fbfc5daba0\") " pod="opendatahub/opendatahub-operator-controller-manager-559f5498f-sc6bc"
Jul 13 19:03:20.238884 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:03:20.238860    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c4ad9c42-34fc-4532-ab29-e2fbfc5daba0-tmp\") pod \"opendatahub-operator-controller-manager-559f5498f-sc6bc\" (UID: \"c4ad9c42-34fc-4532-ab29-e2fbfc5daba0\") " pod="opendatahub/opendatahub-operator-controller-manager-559f5498f-sc6bc"
Jul 13 19:03:20.238998 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:03:20.238985    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c4ad9c42-34fc-4532-ab29-e2fbfc5daba0-webhook-cert\") pod \"opendatahub-operator-controller-manager-559f5498f-sc6bc\" (UID: \"c4ad9c42-34fc-4532-ab29-e2fbfc5daba0\") " pod="opendatahub/opendatahub-operator-controller-manager-559f5498f-sc6bc"
Jul 13 19:03:20.239073 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:03:20.239058    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/c4ad9c42-34fc-4532-ab29-e2fbfc5daba0-apiservice-cert\") pod \"opendatahub-operator-controller-manager-559f5498f-sc6bc\" (UID: \"c4ad9c42-34fc-4532-ab29-e2fbfc5daba0\") " pod="opendatahub/opendatahub-operator-controller-manager-559f5498f-sc6bc"
Jul 13 19:03:20.246737 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:03:20.246715    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2v6mm\" (UniqueName: \"kubernetes.io/projected/c4ad9c42-34fc-4532-ab29-e2fbfc5daba0-kube-api-access-2v6mm\") pod \"opendatahub-operator-controller-manager-559f5498f-sc6bc\" (UID: \"c4ad9c42-34fc-4532-ab29-e2fbfc5daba0\") " pod="opendatahub/opendatahub-operator-controller-manager-559f5498f-sc6bc"
Jul 13 19:03:20.365710 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:03:20.365677    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-559f5498f-sc6bc"
Jul 13 19:03:20.504009 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:03:20.503975    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-559f5498f-sc6bc"]
Jul 13 19:03:20.507513 ip-10-0-135-38 kubenswrapper[2563]: W0713 19:03:20.507485    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc4ad9c42_34fc_4532_ab29_e2fbfc5daba0.slice/crio-cc688e5bddcd7e1b6429a5a0863e026cc7e1fba860ebda8bcd2769abfa0483a1 WatchSource:0}: Error finding container cc688e5bddcd7e1b6429a5a0863e026cc7e1fba860ebda8bcd2769abfa0483a1: Status 404 returned error can't find the container with id cc688e5bddcd7e1b6429a5a0863e026cc7e1fba860ebda8bcd2769abfa0483a1
Jul 13 19:03:20.853333 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:03:20.853293    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-559f5498f-sc6bc" event={"ID":"c4ad9c42-34fc-4532-ab29-e2fbfc5daba0","Type":"ContainerStarted","Data":"cc688e5bddcd7e1b6429a5a0863e026cc7e1fba860ebda8bcd2769abfa0483a1"}
Jul 13 19:03:24.868639 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:03:24.868602    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-559f5498f-sc6bc" event={"ID":"c4ad9c42-34fc-4532-ab29-e2fbfc5daba0","Type":"ContainerStarted","Data":"bc1011f1d305dea7d6b93cc6d0c3ec3b7a6af47b33d0b218d4a8a62ec40c01bd"}
Jul 13 19:03:25.873611 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:03:25.873574    2563 generic.go:356] "Generic (PLEG): container finished" podID="c4ad9c42-34fc-4532-ab29-e2fbfc5daba0" containerID="bc1011f1d305dea7d6b93cc6d0c3ec3b7a6af47b33d0b218d4a8a62ec40c01bd" exitCode=0
Jul 13 19:03:25.873999 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:03:25.873647    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-559f5498f-sc6bc" event={"ID":"c4ad9c42-34fc-4532-ab29-e2fbfc5daba0","Type":"ContainerDied","Data":"bc1011f1d305dea7d6b93cc6d0c3ec3b7a6af47b33d0b218d4a8a62ec40c01bd"}
Jul 13 19:03:26.879372 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:03:26.879332    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-559f5498f-sc6bc" event={"ID":"c4ad9c42-34fc-4532-ab29-e2fbfc5daba0","Type":"ContainerStarted","Data":"08a6f5eb32ed0e4d6b5174ec8d2e16b0b8c5b0e389a5c3e626a189ef78292ea1"}
Jul 13 19:03:26.879762 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:03:26.879559    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-559f5498f-sc6bc"
Jul 13 19:03:26.913240 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:03:26.913156    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-559f5498f-sc6bc" podStartSLOduration=1.9010150220000002 podStartE2EDuration="6.913137171s" totalImagesPullingTime="3.828879375s" totalInitContainerRuntime="1.183242774s" isStatefulPod=false podCreationTimestamp="2026-07-13 19:03:20 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 19:03:26.911701715 +0000 UTC m=+294.686578089" watchObservedRunningTime="2026-07-13 19:03:26.913137171 +0000 UTC m=+294.688013526"
Jul 13 19:03:32.610307 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:03:32.610274    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hwqhc_7ae2e1d0-8a16-4821-9cb7-353862cfbec8/ovn-acl-logging/0.log"
Jul 13 19:03:32.615733 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:03:32.615709    2563 kubelet.go:1648] "Image garbage collection succeeded"
Jul 13 19:03:32.617383 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:03:32.617355    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hwqhc_7ae2e1d0-8a16-4821-9cb7-353862cfbec8/ovn-acl-logging/0.log"
Jul 13 19:03:37.885580 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:03:37.885543    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-559f5498f-sc6bc"
Jul 13 19:03:45.994164 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:03:45.994124    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-85c9d98b58-tkb7k"]
Jul 13 19:03:45.996578 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:03:45.996553    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-85c9d98b58-tkb7k"
Jul 13 19:03:45.999001 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:03:45.998968    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 13 19:03:45.999171 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:03:45.998970    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-8mhb8\""
Jul 13 19:03:45.999171 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:03:45.999072    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 13 19:03:45.999933 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:03:45.999913    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 13 19:03:46.000242 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:03:46.000225    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 13 19:03:46.010955 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:03:46.010926    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-85c9d98b58-tkb7k"]
Jul 13 19:03:46.140757 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:03:46.140723    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l4f57\" (UniqueName: \"kubernetes.io/projected/f25c59ac-409e-4d56-9280-3a278164a11a-kube-api-access-l4f57\") pod \"kube-auth-proxy-85c9d98b58-tkb7k\" (UID: \"f25c59ac-409e-4d56-9280-3a278164a11a\") " pod="openshift-ingress/kube-auth-proxy-85c9d98b58-tkb7k"
Jul 13 19:03:46.140947 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:03:46.140780    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f25c59ac-409e-4d56-9280-3a278164a11a-tls-certs\") pod \"kube-auth-proxy-85c9d98b58-tkb7k\" (UID: \"f25c59ac-409e-4d56-9280-3a278164a11a\") " pod="openshift-ingress/kube-auth-proxy-85c9d98b58-tkb7k"
Jul 13 19:03:46.140947 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:03:46.140875    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f25c59ac-409e-4d56-9280-3a278164a11a-tmp\") pod \"kube-auth-proxy-85c9d98b58-tkb7k\" (UID: \"f25c59ac-409e-4d56-9280-3a278164a11a\") " pod="openshift-ingress/kube-auth-proxy-85c9d98b58-tkb7k"
Jul 13 19:03:46.210575 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:03:46.210539    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-qd8xv"]
Jul 13 19:03:46.213069 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:03:46.213040    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-qd8xv"
Jul 13 19:03:46.215700 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:03:46.215663    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
Jul 13 19:03:46.215842 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:03:46.215793    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-xztpr\""
Jul 13 19:03:46.241498 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:03:46.241452    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l4f57\" (UniqueName: \"kubernetes.io/projected/f25c59ac-409e-4d56-9280-3a278164a11a-kube-api-access-l4f57\") pod \"kube-auth-proxy-85c9d98b58-tkb7k\" (UID: \"f25c59ac-409e-4d56-9280-3a278164a11a\") " pod="openshift-ingress/kube-auth-proxy-85c9d98b58-tkb7k"
Jul 13 19:03:46.241696 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:03:46.241519    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f25c59ac-409e-4d56-9280-3a278164a11a-tls-certs\") pod \"kube-auth-proxy-85c9d98b58-tkb7k\" (UID: \"f25c59ac-409e-4d56-9280-3a278164a11a\") " pod="openshift-ingress/kube-auth-proxy-85c9d98b58-tkb7k"
Jul 13 19:03:46.241696 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:03:46.241554    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f25c59ac-409e-4d56-9280-3a278164a11a-tmp\") pod \"kube-auth-proxy-85c9d98b58-tkb7k\" (UID: \"f25c59ac-409e-4d56-9280-3a278164a11a\") " pod="openshift-ingress/kube-auth-proxy-85c9d98b58-tkb7k"
Jul 13 19:03:46.241696 ip-10-0-135-38 kubenswrapper[2563]: E0713 19:03:46.241645    2563 secret.go:189] Couldn't get secret openshift-ingress/kube-auth-proxy-tls: secret "kube-auth-proxy-tls" not found
Jul 13 19:03:46.241860 ip-10-0-135-38 kubenswrapper[2563]: E0713 19:03:46.241737    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f25c59ac-409e-4d56-9280-3a278164a11a-tls-certs podName:f25c59ac-409e-4d56-9280-3a278164a11a nodeName:}" failed. No retries permitted until 2026-07-13 19:03:46.741711703 +0000 UTC m=+314.516588039 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/f25c59ac-409e-4d56-9280-3a278164a11a-tls-certs") pod "kube-auth-proxy-85c9d98b58-tkb7k" (UID: "f25c59ac-409e-4d56-9280-3a278164a11a") : secret "kube-auth-proxy-tls" not found
Jul 13 19:03:46.243866 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:03:46.243842    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f25c59ac-409e-4d56-9280-3a278164a11a-tmp\") pod \"kube-auth-proxy-85c9d98b58-tkb7k\" (UID: \"f25c59ac-409e-4d56-9280-3a278164a11a\") " pod="openshift-ingress/kube-auth-proxy-85c9d98b58-tkb7k"
Jul 13 19:03:46.253576 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:03:46.253484    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-qd8xv"]
Jul 13 19:03:46.254478 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:03:46.254456    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l4f57\" (UniqueName: \"kubernetes.io/projected/f25c59ac-409e-4d56-9280-3a278164a11a-kube-api-access-l4f57\") pod \"kube-auth-proxy-85c9d98b58-tkb7k\" (UID: \"f25c59ac-409e-4d56-9280-3a278164a11a\") " pod="openshift-ingress/kube-auth-proxy-85c9d98b58-tkb7k"
Jul 13 19:03:46.342095 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:03:46.342056    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/bb5e6d86-d9aa-4f76-80dc-c977031d23c8-cert\") pod \"odh-model-controller-7998c67dc4-qd8xv\" (UID: \"bb5e6d86-d9aa-4f76-80dc-c977031d23c8\") " pod="opendatahub/odh-model-controller-7998c67dc4-qd8xv"
Jul 13 19:03:46.342095 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:03:46.342101    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bgzs4\" (UniqueName: \"kubernetes.io/projected/bb5e6d86-d9aa-4f76-80dc-c977031d23c8-kube-api-access-bgzs4\") pod \"odh-model-controller-7998c67dc4-qd8xv\" (UID: \"bb5e6d86-d9aa-4f76-80dc-c977031d23c8\") " pod="opendatahub/odh-model-controller-7998c67dc4-qd8xv"
Jul 13 19:03:46.443096 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:03:46.443062    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bgzs4\" (UniqueName: \"kubernetes.io/projected/bb5e6d86-d9aa-4f76-80dc-c977031d23c8-kube-api-access-bgzs4\") pod \"odh-model-controller-7998c67dc4-qd8xv\" (UID: \"bb5e6d86-d9aa-4f76-80dc-c977031d23c8\") " pod="opendatahub/odh-model-controller-7998c67dc4-qd8xv"
Jul 13 19:03:46.443314 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:03:46.443194    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/bb5e6d86-d9aa-4f76-80dc-c977031d23c8-cert\") pod \"odh-model-controller-7998c67dc4-qd8xv\" (UID: \"bb5e6d86-d9aa-4f76-80dc-c977031d23c8\") " pod="opendatahub/odh-model-controller-7998c67dc4-qd8xv"
Jul 13 19:03:46.445856 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:03:46.445814    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/bb5e6d86-d9aa-4f76-80dc-c977031d23c8-cert\") pod \"odh-model-controller-7998c67dc4-qd8xv\" (UID: \"bb5e6d86-d9aa-4f76-80dc-c977031d23c8\") " pod="opendatahub/odh-model-controller-7998c67dc4-qd8xv"
Jul 13 19:03:46.451906 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:03:46.451879    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bgzs4\" (UniqueName: \"kubernetes.io/projected/bb5e6d86-d9aa-4f76-80dc-c977031d23c8-kube-api-access-bgzs4\") pod \"odh-model-controller-7998c67dc4-qd8xv\" (UID: \"bb5e6d86-d9aa-4f76-80dc-c977031d23c8\") " pod="opendatahub/odh-model-controller-7998c67dc4-qd8xv"
Jul 13 19:03:46.524433 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:03:46.524337    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-qd8xv"
Jul 13 19:03:46.669421 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:03:46.669383    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-qd8xv"]
Jul 13 19:03:46.672877 ip-10-0-135-38 kubenswrapper[2563]: W0713 19:03:46.672838    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbb5e6d86_d9aa_4f76_80dc_c977031d23c8.slice/crio-3fbffc4ad021a4547cf3bac600506d34c623a827cc0cb3563b3a3d4786508305 WatchSource:0}: Error finding container 3fbffc4ad021a4547cf3bac600506d34c623a827cc0cb3563b3a3d4786508305: Status 404 returned error can't find the container with id 3fbffc4ad021a4547cf3bac600506d34c623a827cc0cb3563b3a3d4786508305
Jul 13 19:03:46.674288 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:03:46.674270    2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 13 19:03:46.746672 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:03:46.746626    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f25c59ac-409e-4d56-9280-3a278164a11a-tls-certs\") pod \"kube-auth-proxy-85c9d98b58-tkb7k\" (UID: \"f25c59ac-409e-4d56-9280-3a278164a11a\") " pod="openshift-ingress/kube-auth-proxy-85c9d98b58-tkb7k"
Jul 13 19:03:46.749105 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:03:46.749083    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f25c59ac-409e-4d56-9280-3a278164a11a-tls-certs\") pod \"kube-auth-proxy-85c9d98b58-tkb7k\" (UID: \"f25c59ac-409e-4d56-9280-3a278164a11a\") " pod="openshift-ingress/kube-auth-proxy-85c9d98b58-tkb7k"
Jul 13 19:03:46.906580 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:03:46.906529    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-85c9d98b58-tkb7k"
Jul 13 19:03:46.947615 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:03:46.947573    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-qd8xv" event={"ID":"bb5e6d86-d9aa-4f76-80dc-c977031d23c8","Type":"ContainerStarted","Data":"3fbffc4ad021a4547cf3bac600506d34c623a827cc0cb3563b3a3d4786508305"}
Jul 13 19:03:47.064456 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:03:47.064430    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-85c9d98b58-tkb7k"]
Jul 13 19:03:47.066374 ip-10-0-135-38 kubenswrapper[2563]: W0713 19:03:47.066351    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf25c59ac_409e_4d56_9280_3a278164a11a.slice/crio-3a722f2199ace88f77c8e2b4c832cc903aaff33e6899edd3aa6ff3d9286d0ea3 WatchSource:0}: Error finding container 3a722f2199ace88f77c8e2b4c832cc903aaff33e6899edd3aa6ff3d9286d0ea3: Status 404 returned error can't find the container with id 3a722f2199ace88f77c8e2b4c832cc903aaff33e6899edd3aa6ff3d9286d0ea3
Jul 13 19:03:47.118929 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:03:47.118895    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-gpln8"]
Jul 13 19:03:47.122098 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:03:47.122075    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-gpln8"
Jul 13 19:03:47.125068 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:03:47.125045    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-dockercfg-ndwfl\""
Jul 13 19:03:47.129394 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:03:47.129181    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\""
Jul 13 19:03:47.155667 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:03:47.155625    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-gpln8"]
Jul 13 19:03:47.249474 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:03:47.249375    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/937d7db5-088a-4878-8791-f08fb94d3c5d-tls-certs\") pod \"model-serving-api-54d89bd5fc-gpln8\" (UID: \"937d7db5-088a-4878-8791-f08fb94d3c5d\") " pod="opendatahub/model-serving-api-54d89bd5fc-gpln8"
Jul 13 19:03:47.249623 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:03:47.249502    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j4xcd\" (UniqueName: \"kubernetes.io/projected/937d7db5-088a-4878-8791-f08fb94d3c5d-kube-api-access-j4xcd\") pod \"model-serving-api-54d89bd5fc-gpln8\" (UID: \"937d7db5-088a-4878-8791-f08fb94d3c5d\") " pod="opendatahub/model-serving-api-54d89bd5fc-gpln8"
Jul 13 19:03:47.350708 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:03:47.350664    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j4xcd\" (UniqueName: \"kubernetes.io/projected/937d7db5-088a-4878-8791-f08fb94d3c5d-kube-api-access-j4xcd\") pod \"model-serving-api-54d89bd5fc-gpln8\" (UID: \"937d7db5-088a-4878-8791-f08fb94d3c5d\") " pod="opendatahub/model-serving-api-54d89bd5fc-gpln8"
Jul 13 19:03:47.350890 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:03:47.350731    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/937d7db5-088a-4878-8791-f08fb94d3c5d-tls-certs\") pod \"model-serving-api-54d89bd5fc-gpln8\" (UID: \"937d7db5-088a-4878-8791-f08fb94d3c5d\") " pod="opendatahub/model-serving-api-54d89bd5fc-gpln8"
Jul 13 19:03:47.353328 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:03:47.353304    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/937d7db5-088a-4878-8791-f08fb94d3c5d-tls-certs\") pod \"model-serving-api-54d89bd5fc-gpln8\" (UID: \"937d7db5-088a-4878-8791-f08fb94d3c5d\") " pod="opendatahub/model-serving-api-54d89bd5fc-gpln8"
Jul 13 19:03:47.360161 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:03:47.360134    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j4xcd\" (UniqueName: \"kubernetes.io/projected/937d7db5-088a-4878-8791-f08fb94d3c5d-kube-api-access-j4xcd\") pod \"model-serving-api-54d89bd5fc-gpln8\" (UID: \"937d7db5-088a-4878-8791-f08fb94d3c5d\") " pod="opendatahub/model-serving-api-54d89bd5fc-gpln8"
Jul 13 19:03:47.433243 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:03:47.433202    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-gpln8"
Jul 13 19:03:47.490076 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:03:47.489874    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-mm76z"]
Jul 13 19:03:47.492446 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:03:47.492367    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-mm76z"
Jul 13 19:03:47.494911 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:03:47.494887    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-wfm9v\""
Jul 13 19:03:47.496517 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:03:47.495179    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Jul 13 19:03:47.496517 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:03:47.495422    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Jul 13 19:03:47.496517 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:03:47.495610    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 13 19:03:47.496517 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:03:47.495754    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Jul 13 19:03:47.517638 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:03:47.517543    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-mm76z"]
Jul 13 19:03:47.616279 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:03:47.616242    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-gpln8"]
Jul 13 19:03:47.620603 ip-10-0-135-38 kubenswrapper[2563]: W0713 19:03:47.620567    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod937d7db5_088a_4878_8791_f08fb94d3c5d.slice/crio-a90929cf4c9f76a924be8ca7fe59b224bcddfc92ab3edffef9bd27d48e96ecfa WatchSource:0}: Error finding container a90929cf4c9f76a924be8ca7fe59b224bcddfc92ab3edffef9bd27d48e96ecfa: Status 404 returned error can't find the container with id a90929cf4c9f76a924be8ca7fe59b224bcddfc92ab3edffef9bd27d48e96ecfa
Jul 13 19:03:47.652369 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:03:47.652326    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4g478\" (UniqueName: \"kubernetes.io/projected/f27e4c2e-0d1c-471b-8e64-e8723ac7f914-kube-api-access-4g478\") pod \"istiod-openshift-gateway-7574459656-mm76z\" (UID: \"f27e4c2e-0d1c-471b-8e64-e8723ac7f914\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-mm76z"
Jul 13 19:03:47.652590 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:03:47.652387    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/f27e4c2e-0d1c-471b-8e64-e8723ac7f914-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-mm76z\" (UID: \"f27e4c2e-0d1c-471b-8e64-e8723ac7f914\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-mm76z"
Jul 13 19:03:47.652590 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:03:47.652437    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/f27e4c2e-0d1c-471b-8e64-e8723ac7f914-local-certs\") pod \"istiod-openshift-gateway-7574459656-mm76z\" (UID: \"f27e4c2e-0d1c-471b-8e64-e8723ac7f914\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-mm76z"
Jul 13 19:03:47.652590 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:03:47.652469    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/f27e4c2e-0d1c-471b-8e64-e8723ac7f914-cacerts\") pod \"istiod-openshift-gateway-7574459656-mm76z\" (UID: \"f27e4c2e-0d1c-471b-8e64-e8723ac7f914\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-mm76z"
Jul 13 19:03:47.652590 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:03:47.652510    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/f27e4c2e-0d1c-471b-8e64-e8723ac7f914-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-mm76z\" (UID: \"f27e4c2e-0d1c-471b-8e64-e8723ac7f914\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-mm76z"
Jul 13 19:03:47.652590 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:03:47.652532    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/f27e4c2e-0d1c-471b-8e64-e8723ac7f914-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-mm76z\" (UID: \"f27e4c2e-0d1c-471b-8e64-e8723ac7f914\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-mm76z"
Jul 13 19:03:47.652590 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:03:47.652560    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f27e4c2e-0d1c-471b-8e64-e8723ac7f914-istio-token\") pod \"istiod-openshift-gateway-7574459656-mm76z\" (UID: \"f27e4c2e-0d1c-471b-8e64-e8723ac7f914\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-mm76z"
Jul 13 19:03:47.753166 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:03:47.753126    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/f27e4c2e-0d1c-471b-8e64-e8723ac7f914-cacerts\") pod \"istiod-openshift-gateway-7574459656-mm76z\" (UID: \"f27e4c2e-0d1c-471b-8e64-e8723ac7f914\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-mm76z"
Jul 13 19:03:47.753166 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:03:47.753179    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/f27e4c2e-0d1c-471b-8e64-e8723ac7f914-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-mm76z\" (UID: \"f27e4c2e-0d1c-471b-8e64-e8723ac7f914\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-mm76z"
Jul 13 19:03:47.753430 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:03:47.753200    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/f27e4c2e-0d1c-471b-8e64-e8723ac7f914-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-mm76z\" (UID: \"f27e4c2e-0d1c-471b-8e64-e8723ac7f914\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-mm76z"
Jul 13 19:03:47.753430 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:03:47.753228    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f27e4c2e-0d1c-471b-8e64-e8723ac7f914-istio-token\") pod \"istiod-openshift-gateway-7574459656-mm76z\" (UID: \"f27e4c2e-0d1c-471b-8e64-e8723ac7f914\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-mm76z"
Jul 13 19:03:47.753430 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:03:47.753286    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4g478\" (UniqueName: \"kubernetes.io/projected/f27e4c2e-0d1c-471b-8e64-e8723ac7f914-kube-api-access-4g478\") pod \"istiod-openshift-gateway-7574459656-mm76z\" (UID: \"f27e4c2e-0d1c-471b-8e64-e8723ac7f914\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-mm76z"
Jul 13 19:03:47.753430 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:03:47.753336    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/f27e4c2e-0d1c-471b-8e64-e8723ac7f914-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-mm76z\" (UID: \"f27e4c2e-0d1c-471b-8e64-e8723ac7f914\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-mm76z"
Jul 13 19:03:47.753430 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:03:47.753390    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/f27e4c2e-0d1c-471b-8e64-e8723ac7f914-local-certs\") pod \"istiod-openshift-gateway-7574459656-mm76z\" (UID: \"f27e4c2e-0d1c-471b-8e64-e8723ac7f914\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-mm76z"
Jul 13 19:03:47.753901 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:03:47.753872    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/f27e4c2e-0d1c-471b-8e64-e8723ac7f914-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-mm76z\" (UID: \"f27e4c2e-0d1c-471b-8e64-e8723ac7f914\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-mm76z"
Jul 13 19:03:47.755865 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:03:47.755793    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/f27e4c2e-0d1c-471b-8e64-e8723ac7f914-cacerts\") pod \"istiod-openshift-gateway-7574459656-mm76z\" (UID: \"f27e4c2e-0d1c-471b-8e64-e8723ac7f914\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-mm76z"
Jul 13 19:03:47.755865 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:03:47.755795    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/f27e4c2e-0d1c-471b-8e64-e8723ac7f914-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-mm76z\" (UID: \"f27e4c2e-0d1c-471b-8e64-e8723ac7f914\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-mm76z"
Jul 13 19:03:47.756135 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:03:47.755953    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/f27e4c2e-0d1c-471b-8e64-e8723ac7f914-local-certs\") pod \"istiod-openshift-gateway-7574459656-mm76z\" (UID: \"f27e4c2e-0d1c-471b-8e64-e8723ac7f914\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-mm76z"
Jul 13 19:03:47.756204 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:03:47.756185    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/f27e4c2e-0d1c-471b-8e64-e8723ac7f914-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-mm76z\" (UID: \"f27e4c2e-0d1c-471b-8e64-e8723ac7f914\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-mm76z"
Jul 13 19:03:47.761974 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:03:47.761944    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f27e4c2e-0d1c-471b-8e64-e8723ac7f914-istio-token\") pod \"istiod-openshift-gateway-7574459656-mm76z\" (UID: \"f27e4c2e-0d1c-471b-8e64-e8723ac7f914\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-mm76z"
Jul 13 19:03:47.762104 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:03:47.761996    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4g478\" (UniqueName: \"kubernetes.io/projected/f27e4c2e-0d1c-471b-8e64-e8723ac7f914-kube-api-access-4g478\") pod \"istiod-openshift-gateway-7574459656-mm76z\" (UID: \"f27e4c2e-0d1c-471b-8e64-e8723ac7f914\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-mm76z"
Jul 13 19:03:47.812848 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:03:47.812810    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-mm76z"
Jul 13 19:03:47.971152 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:03:47.971011    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-85c9d98b58-tkb7k" event={"ID":"f25c59ac-409e-4d56-9280-3a278164a11a","Type":"ContainerStarted","Data":"3a722f2199ace88f77c8e2b4c832cc903aaff33e6899edd3aa6ff3d9286d0ea3"}
Jul 13 19:03:47.973708 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:03:47.973617    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-gpln8" event={"ID":"937d7db5-088a-4878-8791-f08fb94d3c5d","Type":"ContainerStarted","Data":"a90929cf4c9f76a924be8ca7fe59b224bcddfc92ab3edffef9bd27d48e96ecfa"}
Jul 13 19:03:48.020713 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:03:48.020617    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-mm76z"]
Jul 13 19:03:48.024833 ip-10-0-135-38 kubenswrapper[2563]: W0713 19:03:48.024796    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf27e4c2e_0d1c_471b_8e64_e8723ac7f914.slice/crio-641e500d93ec4794dfc4bd60d3abad6d6bd0c06efaa6b1c84be3eb8a47fa7fe6 WatchSource:0}: Error finding container 641e500d93ec4794dfc4bd60d3abad6d6bd0c06efaa6b1c84be3eb8a47fa7fe6: Status 404 returned error can't find the container with id 641e500d93ec4794dfc4bd60d3abad6d6bd0c06efaa6b1c84be3eb8a47fa7fe6
Jul 13 19:03:48.985227 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:03:48.985170    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-mm76z" event={"ID":"f27e4c2e-0d1c-471b-8e64-e8723ac7f914","Type":"ContainerStarted","Data":"641e500d93ec4794dfc4bd60d3abad6d6bd0c06efaa6b1c84be3eb8a47fa7fe6"}
Jul 13 19:03:52.771585 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:03:52.771542    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 13 19:03:52.771980 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:03:52.771616    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 13 19:03:53.006809 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:03:53.006707    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-85c9d98b58-tkb7k" event={"ID":"f25c59ac-409e-4d56-9280-3a278164a11a","Type":"ContainerStarted","Data":"fc5f20946cef35b23903fd60faf9fa36c227827b5b9b4a88d8993ba37fbd4d1c"}
Jul 13 19:03:53.009571 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:03:53.009001    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-mm76z" event={"ID":"f27e4c2e-0d1c-471b-8e64-e8723ac7f914","Type":"ContainerStarted","Data":"187d644fa55d951c33462f2435c41547b5096f75d1bb2cbc8a86792c903ce04f"}
Jul 13 19:03:53.009571 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:03:53.009096    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-mm76z"
Jul 13 19:03:53.011404 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:03:53.011158    2563 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7574459656-mm76z container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 13 19:03:53.011924 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:03:53.011895    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7574459656-mm76z" podUID="f27e4c2e-0d1c-471b-8e64-e8723ac7f914" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 13 19:03:53.012328 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:03:53.012299    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-qd8xv" event={"ID":"bb5e6d86-d9aa-4f76-80dc-c977031d23c8","Type":"ContainerStarted","Data":"d6a4f8c94f82916aa0c490fbd6cb097f5866583daebed8cce34970b05d38ef05"}
Jul 13 19:03:53.012442 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:03:53.012424    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-qd8xv"
Jul 13 19:03:53.014109 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:03:53.014084    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-gpln8" event={"ID":"937d7db5-088a-4878-8791-f08fb94d3c5d","Type":"ContainerStarted","Data":"63701c6ae7b36e32b86cb8ce7ab03fcaeb96e6134ee125f581e6aecfbba8a473"}
Jul 13 19:03:53.014237 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:03:53.014212    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-gpln8"
Jul 13 19:03:53.030657 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:03:53.030593    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-85c9d98b58-tkb7k" podStartSLOduration=2.328060098 podStartE2EDuration="8.030575399s" totalImagesPullingTime="5.702515301s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 19:03:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 19:03:53.028799268 +0000 UTC m=+320.803675639" watchObservedRunningTime="2026-07-13 19:03:53.030575399 +0000 UTC m=+320.805451754"
Jul 13 19:03:53.050656 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:03:53.050599    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-qd8xv" podStartSLOduration=0.945895062 podStartE2EDuration="7.050581118s" totalImagesPullingTime="6.104686056s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 19:03:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 19:03:53.049098144 +0000 UTC m=+320.823974502" watchObservedRunningTime="2026-07-13 19:03:53.050581118 +0000 UTC m=+320.825457474"
Jul 13 19:03:53.066940 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:03:53.066879    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-gpln8" podStartSLOduration=0.923302642 podStartE2EDuration="6.066859259s" totalImagesPullingTime="5.143556617s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 19:03:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 19:03:53.065622186 +0000 UTC m=+320.840498543" watchObservedRunningTime="2026-07-13 19:03:53.066859259 +0000 UTC m=+320.841735615"
Jul 13 19:03:53.087844 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:03:53.087787    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7574459656-mm76z" podStartSLOduration=1.344284509 podStartE2EDuration="6.087771724s" totalImagesPullingTime="4.743487215s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 19:03:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 19:03:53.08536815 +0000 UTC m=+320.860244507" watchObservedRunningTime="2026-07-13 19:03:53.087771724 +0000 UTC m=+320.862648079"
Jul 13 19:03:54.018934 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:03:54.018902    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-mm76z"
Jul 13 19:03:58.660144 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:03:58.660103    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-hl862"]
Jul 13 19:03:58.662479 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:03:58.662419    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-hl862"
Jul 13 19:03:58.667239 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:03:58.667208    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
Jul 13 19:03:58.667393 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:03:58.667346    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-w4g97\""
Jul 13 19:03:58.688713 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:03:58.688668    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-wjnk2"]
Jul 13 19:03:58.691291 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:03:58.691262    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-hl862"]
Jul 13 19:03:58.691491 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:03:58.691382    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-wjnk2"
Jul 13 19:03:58.694507 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:03:58.694479    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-46qz5\""
Jul 13 19:03:58.694656 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:03:58.694602    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\""
Jul 13 19:03:58.713932 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:03:58.713896    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-wjnk2"]
Jul 13 19:03:58.849732 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:03:58.849690    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/13f19b88-2eb9-4628-8780-bca323393344-cert\") pod \"kserve-controller-manager-d6f4b65b8-hl862\" (UID: \"13f19b88-2eb9-4628-8780-bca323393344\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-hl862"
Jul 13 19:03:58.849912 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:03:58.849739    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kjnl4\" (UniqueName: \"kubernetes.io/projected/13f19b88-2eb9-4628-8780-bca323393344-kube-api-access-kjnl4\") pod \"kserve-controller-manager-d6f4b65b8-hl862\" (UID: \"13f19b88-2eb9-4628-8780-bca323393344\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-hl862"
Jul 13 19:03:58.849912 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:03:58.849767    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/cc5fca4f-78c6-4aec-9c96-0948352cfc2a-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-wjnk2\" (UID: \"cc5fca4f-78c6-4aec-9c96-0948352cfc2a\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-wjnk2"
Jul 13 19:03:58.849912 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:03:58.849829    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mvbm2\" (UniqueName: \"kubernetes.io/projected/cc5fca4f-78c6-4aec-9c96-0948352cfc2a-kube-api-access-mvbm2\") pod \"llmisvc-controller-manager-777c6bd7d5-wjnk2\" (UID: \"cc5fca4f-78c6-4aec-9c96-0948352cfc2a\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-wjnk2"
Jul 13 19:03:58.950612 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:03:58.950500    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mvbm2\" (UniqueName: \"kubernetes.io/projected/cc5fca4f-78c6-4aec-9c96-0948352cfc2a-kube-api-access-mvbm2\") pod \"llmisvc-controller-manager-777c6bd7d5-wjnk2\" (UID: \"cc5fca4f-78c6-4aec-9c96-0948352cfc2a\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-wjnk2"
Jul 13 19:03:58.950612 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:03:58.950564    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/13f19b88-2eb9-4628-8780-bca323393344-cert\") pod \"kserve-controller-manager-d6f4b65b8-hl862\" (UID: \"13f19b88-2eb9-4628-8780-bca323393344\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-hl862"
Jul 13 19:03:58.950612 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:03:58.950586    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kjnl4\" (UniqueName: \"kubernetes.io/projected/13f19b88-2eb9-4628-8780-bca323393344-kube-api-access-kjnl4\") pod \"kserve-controller-manager-d6f4b65b8-hl862\" (UID: \"13f19b88-2eb9-4628-8780-bca323393344\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-hl862"
Jul 13 19:03:58.950612 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:03:58.950609    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/cc5fca4f-78c6-4aec-9c96-0948352cfc2a-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-wjnk2\" (UID: \"cc5fca4f-78c6-4aec-9c96-0948352cfc2a\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-wjnk2"
Jul 13 19:03:58.953302 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:03:58.953270    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/cc5fca4f-78c6-4aec-9c96-0948352cfc2a-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-wjnk2\" (UID: \"cc5fca4f-78c6-4aec-9c96-0948352cfc2a\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-wjnk2"
Jul 13 19:03:58.953428 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:03:58.953270    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/13f19b88-2eb9-4628-8780-bca323393344-cert\") pod \"kserve-controller-manager-d6f4b65b8-hl862\" (UID: \"13f19b88-2eb9-4628-8780-bca323393344\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-hl862"
Jul 13 19:03:58.971674 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:03:58.971636    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mvbm2\" (UniqueName: \"kubernetes.io/projected/cc5fca4f-78c6-4aec-9c96-0948352cfc2a-kube-api-access-mvbm2\") pod \"llmisvc-controller-manager-777c6bd7d5-wjnk2\" (UID: \"cc5fca4f-78c6-4aec-9c96-0948352cfc2a\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-wjnk2"
Jul 13 19:03:58.978754 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:03:58.978717    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kjnl4\" (UniqueName: \"kubernetes.io/projected/13f19b88-2eb9-4628-8780-bca323393344-kube-api-access-kjnl4\") pod \"kserve-controller-manager-d6f4b65b8-hl862\" (UID: \"13f19b88-2eb9-4628-8780-bca323393344\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-hl862"
Jul 13 19:03:59.003343 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:03:59.003283    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-wjnk2"
Jul 13 19:03:59.166801 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:03:59.166772    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-wjnk2"]
Jul 13 19:03:59.169171 ip-10-0-135-38 kubenswrapper[2563]: W0713 19:03:59.169139    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podcc5fca4f_78c6_4aec_9c96_0948352cfc2a.slice/crio-7a5e36706acac60175f83aa207db3ca4833a345c2a4e83dc05da2cf34f225f4e WatchSource:0}: Error finding container 7a5e36706acac60175f83aa207db3ca4833a345c2a4e83dc05da2cf34f225f4e: Status 404 returned error can't find the container with id 7a5e36706acac60175f83aa207db3ca4833a345c2a4e83dc05da2cf34f225f4e
Jul 13 19:03:59.275290 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:03:59.275194    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-hl862"
Jul 13 19:03:59.421742 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:03:59.421703    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-hl862"]
Jul 13 19:03:59.424755 ip-10-0-135-38 kubenswrapper[2563]: W0713 19:03:59.424724    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod13f19b88_2eb9_4628_8780_bca323393344.slice/crio-8aa4e2233299d2f83b41ff12caeebde1a5a92d0daba5ac793380132ab627e587 WatchSource:0}: Error finding container 8aa4e2233299d2f83b41ff12caeebde1a5a92d0daba5ac793380132ab627e587: Status 404 returned error can't find the container with id 8aa4e2233299d2f83b41ff12caeebde1a5a92d0daba5ac793380132ab627e587
Jul 13 19:04:00.043555 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:04:00.043519    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-wjnk2" event={"ID":"cc5fca4f-78c6-4aec-9c96-0948352cfc2a","Type":"ContainerStarted","Data":"7a5e36706acac60175f83aa207db3ca4833a345c2a4e83dc05da2cf34f225f4e"}
Jul 13 19:04:00.044588 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:04:00.044564    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-hl862" event={"ID":"13f19b88-2eb9-4628-8780-bca323393344","Type":"ContainerStarted","Data":"8aa4e2233299d2f83b41ff12caeebde1a5a92d0daba5ac793380132ab627e587"}
Jul 13 19:04:03.057236 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:04:03.057140    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-hl862" event={"ID":"13f19b88-2eb9-4628-8780-bca323393344","Type":"ContainerStarted","Data":"95c30f50850bc2b4283f5ddebcf540cf196530b00d267ce3dbc3e3d6c89ad69c"}
Jul 13 19:04:03.057703 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:04:03.057275    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-hl862"
Jul 13 19:04:03.075756 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:04:03.075697    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-hl862" podStartSLOduration=1.7391069639999999 podStartE2EDuration="5.07567799s" totalImagesPullingTime="3.336571026s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 19:03:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 19:04:03.074847775 +0000 UTC m=+330.849724153" watchObservedRunningTime="2026-07-13 19:04:03.07567799 +0000 UTC m=+330.850554347"
Jul 13 19:04:04.020281 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:04:04.020249    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-qd8xv"
Jul 13 19:04:04.023559 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:04:04.023531    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-gpln8"
Jul 13 19:04:04.065456 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:04:04.065420    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-wjnk2" event={"ID":"cc5fca4f-78c6-4aec-9c96-0948352cfc2a","Type":"ContainerStarted","Data":"0e832fe461f3883847c245400e202e7e8b1d025a8f1b8d4e71f2962267eb99da"}
Jul 13 19:04:04.084399 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:04:04.084338    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-wjnk2" podStartSLOduration=1.309703514 podStartE2EDuration="6.084317108s" totalImagesPullingTime="4.774613594s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 19:03:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 19:04:04.082847925 +0000 UTC m=+331.857724285" watchObservedRunningTime="2026-07-13 19:04:04.084317108 +0000 UTC m=+331.859193463"
Jul 13 19:04:05.068637 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:04:05.068604    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-wjnk2"
Jul 13 19:04:07.299282 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:04:07.299238    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-mm76z"]
Jul 13 19:04:07.299777 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:04:07.299432    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7574459656-mm76z" podUID="f27e4c2e-0d1c-471b-8e64-e8723ac7f914" containerName="discovery" containerID="cri-o://187d644fa55d951c33462f2435c41547b5096f75d1bb2cbc8a86792c903ce04f" gracePeriod=30
Jul 13 19:04:07.544867 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:04:07.544841    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-mm76z"
Jul 13 19:04:07.614453 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:04:07.614415    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/f27e4c2e-0d1c-471b-8e64-e8723ac7f914-istio-kubeconfig\") pod \"f27e4c2e-0d1c-471b-8e64-e8723ac7f914\" (UID: \"f27e4c2e-0d1c-471b-8e64-e8723ac7f914\") "
Jul 13 19:04:07.614648 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:04:07.614464    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/f27e4c2e-0d1c-471b-8e64-e8723ac7f914-cacerts\") pod \"f27e4c2e-0d1c-471b-8e64-e8723ac7f914\" (UID: \"f27e4c2e-0d1c-471b-8e64-e8723ac7f914\") "
Jul 13 19:04:07.614648 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:04:07.614502    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/f27e4c2e-0d1c-471b-8e64-e8723ac7f914-local-certs\") pod \"f27e4c2e-0d1c-471b-8e64-e8723ac7f914\" (UID: \"f27e4c2e-0d1c-471b-8e64-e8723ac7f914\") "
Jul 13 19:04:07.614648 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:04:07.614533    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f27e4c2e-0d1c-471b-8e64-e8723ac7f914-istio-token\") pod \"f27e4c2e-0d1c-471b-8e64-e8723ac7f914\" (UID: \"f27e4c2e-0d1c-471b-8e64-e8723ac7f914\") "
Jul 13 19:04:07.614648 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:04:07.614577    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/f27e4c2e-0d1c-471b-8e64-e8723ac7f914-istio-csr-dns-cert\") pod \"f27e4c2e-0d1c-471b-8e64-e8723ac7f914\" (UID: \"f27e4c2e-0d1c-471b-8e64-e8723ac7f914\") "
Jul 13 19:04:07.614648 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:04:07.614607    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/f27e4c2e-0d1c-471b-8e64-e8723ac7f914-istio-csr-ca-configmap\") pod \"f27e4c2e-0d1c-471b-8e64-e8723ac7f914\" (UID: \"f27e4c2e-0d1c-471b-8e64-e8723ac7f914\") "
Jul 13 19:04:07.614648 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:04:07.614634    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4g478\" (UniqueName: \"kubernetes.io/projected/f27e4c2e-0d1c-471b-8e64-e8723ac7f914-kube-api-access-4g478\") pod \"f27e4c2e-0d1c-471b-8e64-e8723ac7f914\" (UID: \"f27e4c2e-0d1c-471b-8e64-e8723ac7f914\") "
Jul 13 19:04:07.615170 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:04:07.615115    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f27e4c2e-0d1c-471b-8e64-e8723ac7f914-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "f27e4c2e-0d1c-471b-8e64-e8723ac7f914" (UID: "f27e4c2e-0d1c-471b-8e64-e8723ac7f914"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 19:04:07.617113 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:04:07.617047    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f27e4c2e-0d1c-471b-8e64-e8723ac7f914-local-certs" (OuterVolumeSpecName: "local-certs") pod "f27e4c2e-0d1c-471b-8e64-e8723ac7f914" (UID: "f27e4c2e-0d1c-471b-8e64-e8723ac7f914"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 19:04:07.617113 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:04:07.617106    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f27e4c2e-0d1c-471b-8e64-e8723ac7f914-cacerts" (OuterVolumeSpecName: "cacerts") pod "f27e4c2e-0d1c-471b-8e64-e8723ac7f914" (UID: "f27e4c2e-0d1c-471b-8e64-e8723ac7f914"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 13 19:04:07.617275 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:04:07.617167    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f27e4c2e-0d1c-471b-8e64-e8723ac7f914-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "f27e4c2e-0d1c-471b-8e64-e8723ac7f914" (UID: "f27e4c2e-0d1c-471b-8e64-e8723ac7f914"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 13 19:04:07.617337 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:04:07.617319    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f27e4c2e-0d1c-471b-8e64-e8723ac7f914-istio-token" (OuterVolumeSpecName: "istio-token") pod "f27e4c2e-0d1c-471b-8e64-e8723ac7f914" (UID: "f27e4c2e-0d1c-471b-8e64-e8723ac7f914"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 19:04:07.617379 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:04:07.617337    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f27e4c2e-0d1c-471b-8e64-e8723ac7f914-kube-api-access-4g478" (OuterVolumeSpecName: "kube-api-access-4g478") pod "f27e4c2e-0d1c-471b-8e64-e8723ac7f914" (UID: "f27e4c2e-0d1c-471b-8e64-e8723ac7f914"). InnerVolumeSpecName "kube-api-access-4g478". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 19:04:07.617379 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:04:07.617365    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f27e4c2e-0d1c-471b-8e64-e8723ac7f914-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "f27e4c2e-0d1c-471b-8e64-e8723ac7f914" (UID: "f27e4c2e-0d1c-471b-8e64-e8723ac7f914"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 13 19:04:07.715962 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:04:07.715917    2563 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f27e4c2e-0d1c-471b-8e64-e8723ac7f914-istio-token\") on node \"ip-10-0-135-38.ec2.internal\" DevicePath \"\""
Jul 13 19:04:07.715962 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:04:07.715953    2563 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/f27e4c2e-0d1c-471b-8e64-e8723ac7f914-istio-csr-dns-cert\") on node \"ip-10-0-135-38.ec2.internal\" DevicePath \"\""
Jul 13 19:04:07.715962 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:04:07.715963    2563 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/f27e4c2e-0d1c-471b-8e64-e8723ac7f914-istio-csr-ca-configmap\") on node \"ip-10-0-135-38.ec2.internal\" DevicePath \"\""
Jul 13 19:04:07.715962 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:04:07.715973    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4g478\" (UniqueName: \"kubernetes.io/projected/f27e4c2e-0d1c-471b-8e64-e8723ac7f914-kube-api-access-4g478\") on node \"ip-10-0-135-38.ec2.internal\" DevicePath \"\""
Jul 13 19:04:07.716249 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:04:07.715983    2563 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/f27e4c2e-0d1c-471b-8e64-e8723ac7f914-istio-kubeconfig\") on node \"ip-10-0-135-38.ec2.internal\" DevicePath \"\""
Jul 13 19:04:07.716249 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:04:07.715994    2563 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/f27e4c2e-0d1c-471b-8e64-e8723ac7f914-cacerts\") on node \"ip-10-0-135-38.ec2.internal\" DevicePath \"\""
Jul 13 19:04:07.716249 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:04:07.716001    2563 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/f27e4c2e-0d1c-471b-8e64-e8723ac7f914-local-certs\") on node \"ip-10-0-135-38.ec2.internal\" DevicePath \"\""
Jul 13 19:04:08.081947 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:04:08.081860    2563 generic.go:356] "Generic (PLEG): container finished" podID="f27e4c2e-0d1c-471b-8e64-e8723ac7f914" containerID="187d644fa55d951c33462f2435c41547b5096f75d1bb2cbc8a86792c903ce04f" exitCode=0
Jul 13 19:04:08.081947 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:04:08.081904    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-mm76z"
Jul 13 19:04:08.082152 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:04:08.081947    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-mm76z" event={"ID":"f27e4c2e-0d1c-471b-8e64-e8723ac7f914","Type":"ContainerDied","Data":"187d644fa55d951c33462f2435c41547b5096f75d1bb2cbc8a86792c903ce04f"}
Jul 13 19:04:08.082152 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:04:08.082004    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-mm76z" event={"ID":"f27e4c2e-0d1c-471b-8e64-e8723ac7f914","Type":"ContainerDied","Data":"641e500d93ec4794dfc4bd60d3abad6d6bd0c06efaa6b1c84be3eb8a47fa7fe6"}
Jul 13 19:04:08.082152 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:04:08.082046    2563 scope.go:117] "RemoveContainer" containerID="187d644fa55d951c33462f2435c41547b5096f75d1bb2cbc8a86792c903ce04f"
Jul 13 19:04:08.093988 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:04:08.093947    2563 scope.go:117] "RemoveContainer" containerID="187d644fa55d951c33462f2435c41547b5096f75d1bb2cbc8a86792c903ce04f"
Jul 13 19:04:08.094635 ip-10-0-135-38 kubenswrapper[2563]: E0713 19:04:08.094598    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"187d644fa55d951c33462f2435c41547b5096f75d1bb2cbc8a86792c903ce04f\": container with ID starting with 187d644fa55d951c33462f2435c41547b5096f75d1bb2cbc8a86792c903ce04f not found: ID does not exist" containerID="187d644fa55d951c33462f2435c41547b5096f75d1bb2cbc8a86792c903ce04f"
Jul 13 19:04:08.094790 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:04:08.094647    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"187d644fa55d951c33462f2435c41547b5096f75d1bb2cbc8a86792c903ce04f"} err="failed to get container status \"187d644fa55d951c33462f2435c41547b5096f75d1bb2cbc8a86792c903ce04f\": rpc error: code = NotFound desc = could not find container \"187d644fa55d951c33462f2435c41547b5096f75d1bb2cbc8a86792c903ce04f\": container with ID starting with 187d644fa55d951c33462f2435c41547b5096f75d1bb2cbc8a86792c903ce04f not found: ID does not exist"
Jul 13 19:04:08.109448 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:04:08.109415    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-mm76z"]
Jul 13 19:04:08.115401 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:04:08.115370    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-mm76z"]
Jul 13 19:04:08.756099 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:04:08.756064    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f27e4c2e-0d1c-471b-8e64-e8723ac7f914" path="/var/lib/kubelet/pods/f27e4c2e-0d1c-471b-8e64-e8723ac7f914/volumes"
Jul 13 19:04:34.071609 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:04:34.071566    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-hl862"
Jul 13 19:04:36.075461 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:04:36.075425    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-wjnk2"
Jul 13 19:04:41.895878 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:04:41.895842    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-fh9lt"]
Jul 13 19:04:41.896295 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:04:41.896134    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f27e4c2e-0d1c-471b-8e64-e8723ac7f914" containerName="discovery"
Jul 13 19:04:41.896295 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:04:41.896145    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="f27e4c2e-0d1c-471b-8e64-e8723ac7f914" containerName="discovery"
Jul 13 19:04:41.896295 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:04:41.896189    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="f27e4c2e-0d1c-471b-8e64-e8723ac7f914" containerName="discovery"
Jul 13 19:04:41.898583 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:04:41.898563    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-fh9lt"
Jul 13 19:04:41.902129 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:04:41.902094    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 13 19:04:41.902297 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:04:41.902094    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-j6dfg\""
Jul 13 19:04:41.902297 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:04:41.902129    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 13 19:04:41.915983 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:04:41.915951    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-fh9lt"]
Jul 13 19:04:41.991984 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:04:41.991944    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8l7b7\" (UniqueName: \"kubernetes.io/projected/0297bc6f-c2f1-4689-a2b2-68a511a5ba27-kube-api-access-8l7b7\") pod \"kuadrant-operator-catalog-fh9lt\" (UID: \"0297bc6f-c2f1-4689-a2b2-68a511a5ba27\") " pod="kuadrant-system/kuadrant-operator-catalog-fh9lt"
Jul 13 19:04:42.093125 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:04:42.093087    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8l7b7\" (UniqueName: \"kubernetes.io/projected/0297bc6f-c2f1-4689-a2b2-68a511a5ba27-kube-api-access-8l7b7\") pod \"kuadrant-operator-catalog-fh9lt\" (UID: \"0297bc6f-c2f1-4689-a2b2-68a511a5ba27\") " pod="kuadrant-system/kuadrant-operator-catalog-fh9lt"
Jul 13 19:04:42.105336 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:04:42.105298    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8l7b7\" (UniqueName: \"kubernetes.io/projected/0297bc6f-c2f1-4689-a2b2-68a511a5ba27-kube-api-access-8l7b7\") pod \"kuadrant-operator-catalog-fh9lt\" (UID: \"0297bc6f-c2f1-4689-a2b2-68a511a5ba27\") " pod="kuadrant-system/kuadrant-operator-catalog-fh9lt"
Jul 13 19:04:42.207511 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:04:42.207400    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-fh9lt"
Jul 13 19:04:42.254408 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:04:42.254372    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-fh9lt"]
Jul 13 19:04:42.374412 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:04:42.374374    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-fh9lt"]
Jul 13 19:04:42.377981 ip-10-0-135-38 kubenswrapper[2563]: W0713 19:04:42.377948    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0297bc6f_c2f1_4689_a2b2_68a511a5ba27.slice/crio-d2c01549edf917f1e0b71c7ada6f81f834f478ff251b931e34e56916e850e0af WatchSource:0}: Error finding container d2c01549edf917f1e0b71c7ada6f81f834f478ff251b931e34e56916e850e0af: Status 404 returned error can't find the container with id d2c01549edf917f1e0b71c7ada6f81f834f478ff251b931e34e56916e850e0af
Jul 13 19:04:42.478166 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:04:42.478069    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-nd95j"]
Jul 13 19:04:42.481113 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:04:42.481085    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-nd95j"
Jul 13 19:04:42.502276 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:04:42.502234    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-nd95j"]
Jul 13 19:04:42.595757 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:04:42.595721    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qx2qm\" (UniqueName: \"kubernetes.io/projected/eaae9c37-a1a4-448c-b323-aa129e8ff55a-kube-api-access-qx2qm\") pod \"kuadrant-operator-catalog-nd95j\" (UID: \"eaae9c37-a1a4-448c-b323-aa129e8ff55a\") " pod="kuadrant-system/kuadrant-operator-catalog-nd95j"
Jul 13 19:04:42.696481 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:04:42.696441    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qx2qm\" (UniqueName: \"kubernetes.io/projected/eaae9c37-a1a4-448c-b323-aa129e8ff55a-kube-api-access-qx2qm\") pod \"kuadrant-operator-catalog-nd95j\" (UID: \"eaae9c37-a1a4-448c-b323-aa129e8ff55a\") " pod="kuadrant-system/kuadrant-operator-catalog-nd95j"
Jul 13 19:04:42.712627 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:04:42.712596    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qx2qm\" (UniqueName: \"kubernetes.io/projected/eaae9c37-a1a4-448c-b323-aa129e8ff55a-kube-api-access-qx2qm\") pod \"kuadrant-operator-catalog-nd95j\" (UID: \"eaae9c37-a1a4-448c-b323-aa129e8ff55a\") " pod="kuadrant-system/kuadrant-operator-catalog-nd95j"
Jul 13 19:04:42.791231 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:04:42.791138    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-nd95j"
Jul 13 19:04:42.936917 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:04:42.936884    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-nd95j"]
Jul 13 19:04:42.939477 ip-10-0-135-38 kubenswrapper[2563]: W0713 19:04:42.939444    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeaae9c37_a1a4_448c_b323_aa129e8ff55a.slice/crio-5da0547ef2e7ba44231997b0d881b88da74c83e268efa2eeb88a2602d1286845 WatchSource:0}: Error finding container 5da0547ef2e7ba44231997b0d881b88da74c83e268efa2eeb88a2602d1286845: Status 404 returned error can't find the container with id 5da0547ef2e7ba44231997b0d881b88da74c83e268efa2eeb88a2602d1286845
Jul 13 19:04:43.221938 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:04:43.221883    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-fh9lt" event={"ID":"0297bc6f-c2f1-4689-a2b2-68a511a5ba27","Type":"ContainerStarted","Data":"d2c01549edf917f1e0b71c7ada6f81f834f478ff251b931e34e56916e850e0af"}
Jul 13 19:04:43.223354 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:04:43.223321    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-nd95j" event={"ID":"eaae9c37-a1a4-448c-b323-aa129e8ff55a","Type":"ContainerStarted","Data":"5da0547ef2e7ba44231997b0d881b88da74c83e268efa2eeb88a2602d1286845"}
Jul 13 19:04:45.234723 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:04:45.234687    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-fh9lt" event={"ID":"0297bc6f-c2f1-4689-a2b2-68a511a5ba27","Type":"ContainerStarted","Data":"c7262b3e041894d0dc4a54ce776436d6ec5ffbc532cffd635556f4b575a450a1"}
Jul 13 19:04:45.235253 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:04:45.234743    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-fh9lt" podUID="0297bc6f-c2f1-4689-a2b2-68a511a5ba27" containerName="registry-server" containerID="cri-o://c7262b3e041894d0dc4a54ce776436d6ec5ffbc532cffd635556f4b575a450a1" gracePeriod=2
Jul 13 19:04:45.236271 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:04:45.236245    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-nd95j" event={"ID":"eaae9c37-a1a4-448c-b323-aa129e8ff55a","Type":"ContainerStarted","Data":"2cd34cd8fd500773e48e716584dd9aa315c65bc902b31e5c437f3c4951cbdfe7"}
Jul 13 19:04:45.267528 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:04:45.267469    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-fh9lt" podStartSLOduration=1.936539093 podStartE2EDuration="4.267449435s" totalImagesPullingTime="2.330910342s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 19:04:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 19:04:45.26631116 +0000 UTC m=+373.041187526" watchObservedRunningTime="2026-07-13 19:04:45.267449435 +0000 UTC m=+373.042325792"
Jul 13 19:04:45.478164 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:04:45.478132    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-fh9lt"
Jul 13 19:04:45.495757 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:04:45.495649    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-nd95j" podStartSLOduration=1.7381476569999998 podStartE2EDuration="3.495626488s" totalImagesPullingTime="1.757478831s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 19:04:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 19:04:45.291337124 +0000 UTC m=+373.066213658" watchObservedRunningTime="2026-07-13 19:04:45.495626488 +0000 UTC m=+373.270502845"
Jul 13 19:04:45.626231 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:04:45.626191    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8l7b7\" (UniqueName: \"kubernetes.io/projected/0297bc6f-c2f1-4689-a2b2-68a511a5ba27-kube-api-access-8l7b7\") pod \"0297bc6f-c2f1-4689-a2b2-68a511a5ba27\" (UID: \"0297bc6f-c2f1-4689-a2b2-68a511a5ba27\") "
Jul 13 19:04:45.628402 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:04:45.628365    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0297bc6f-c2f1-4689-a2b2-68a511a5ba27-kube-api-access-8l7b7" (OuterVolumeSpecName: "kube-api-access-8l7b7") pod "0297bc6f-c2f1-4689-a2b2-68a511a5ba27" (UID: "0297bc6f-c2f1-4689-a2b2-68a511a5ba27"). InnerVolumeSpecName "kube-api-access-8l7b7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 19:04:45.727772 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:04:45.727739    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8l7b7\" (UniqueName: \"kubernetes.io/projected/0297bc6f-c2f1-4689-a2b2-68a511a5ba27-kube-api-access-8l7b7\") on node \"ip-10-0-135-38.ec2.internal\" DevicePath \"\""
Jul 13 19:04:46.241842 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:04:46.241806    2563 generic.go:356] "Generic (PLEG): container finished" podID="0297bc6f-c2f1-4689-a2b2-68a511a5ba27" containerID="c7262b3e041894d0dc4a54ce776436d6ec5ffbc532cffd635556f4b575a450a1" exitCode=0
Jul 13 19:04:46.242301 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:04:46.241853    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-fh9lt"
Jul 13 19:04:46.242301 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:04:46.241894    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-fh9lt" event={"ID":"0297bc6f-c2f1-4689-a2b2-68a511a5ba27","Type":"ContainerDied","Data":"c7262b3e041894d0dc4a54ce776436d6ec5ffbc532cffd635556f4b575a450a1"}
Jul 13 19:04:46.242301 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:04:46.241959    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-fh9lt" event={"ID":"0297bc6f-c2f1-4689-a2b2-68a511a5ba27","Type":"ContainerDied","Data":"d2c01549edf917f1e0b71c7ada6f81f834f478ff251b931e34e56916e850e0af"}
Jul 13 19:04:46.242301 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:04:46.241986    2563 scope.go:117] "RemoveContainer" containerID="c7262b3e041894d0dc4a54ce776436d6ec5ffbc532cffd635556f4b575a450a1"
Jul 13 19:04:46.251457 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:04:46.251433    2563 scope.go:117] "RemoveContainer" containerID="c7262b3e041894d0dc4a54ce776436d6ec5ffbc532cffd635556f4b575a450a1"
Jul 13 19:04:46.251773 ip-10-0-135-38 kubenswrapper[2563]: E0713 19:04:46.251753    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c7262b3e041894d0dc4a54ce776436d6ec5ffbc532cffd635556f4b575a450a1\": container with ID starting with c7262b3e041894d0dc4a54ce776436d6ec5ffbc532cffd635556f4b575a450a1 not found: ID does not exist" containerID="c7262b3e041894d0dc4a54ce776436d6ec5ffbc532cffd635556f4b575a450a1"
Jul 13 19:04:46.251828 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:04:46.251785    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c7262b3e041894d0dc4a54ce776436d6ec5ffbc532cffd635556f4b575a450a1"} err="failed to get container status \"c7262b3e041894d0dc4a54ce776436d6ec5ffbc532cffd635556f4b575a450a1\": rpc error: code = NotFound desc = could not find container \"c7262b3e041894d0dc4a54ce776436d6ec5ffbc532cffd635556f4b575a450a1\": container with ID starting with c7262b3e041894d0dc4a54ce776436d6ec5ffbc532cffd635556f4b575a450a1 not found: ID does not exist"
Jul 13 19:04:46.271107 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:04:46.271069    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-fh9lt"]
Jul 13 19:04:46.274514 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:04:46.274482    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-fh9lt"]
Jul 13 19:04:46.755489 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:04:46.755455    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0297bc6f-c2f1-4689-a2b2-68a511a5ba27" path="/var/lib/kubelet/pods/0297bc6f-c2f1-4689-a2b2-68a511a5ba27/volumes"
Jul 13 19:04:52.791451 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:04:52.791394    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-nd95j"
Jul 13 19:04:52.791899 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:04:52.791473    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-nd95j"
Jul 13 19:04:52.815824 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:04:52.815795    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-nd95j"
Jul 13 19:04:53.294548 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:04:53.294512    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-nd95j"
Jul 13 19:05:14.302810 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:05:14.302774    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-knvxb"]
Jul 13 19:05:14.303262 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:05:14.303083    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0297bc6f-c2f1-4689-a2b2-68a511a5ba27" containerName="registry-server"
Jul 13 19:05:14.303262 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:05:14.303097    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="0297bc6f-c2f1-4689-a2b2-68a511a5ba27" containerName="registry-server"
Jul 13 19:05:14.303262 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:05:14.303175    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="0297bc6f-c2f1-4689-a2b2-68a511a5ba27" containerName="registry-server"
Jul 13 19:05:14.307418 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:05:14.307388    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-knvxb"
Jul 13 19:05:14.309933 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:05:14.309906    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
Jul 13 19:05:14.310088 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:05:14.309908    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-7mpcj\""
Jul 13 19:05:14.319891 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:05:14.319862    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-knvxb"]
Jul 13 19:05:14.360969 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:05:14.360935    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f5zx8\" (UniqueName: \"kubernetes.io/projected/2bd6e0af-9a31-4376-aa3b-34b7084998c2-kube-api-access-f5zx8\") pod \"dns-operator-controller-manager-864dd78c4c-knvxb\" (UID: \"2bd6e0af-9a31-4376-aa3b-34b7084998c2\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-knvxb"
Jul 13 19:05:14.461627 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:05:14.461583    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f5zx8\" (UniqueName: \"kubernetes.io/projected/2bd6e0af-9a31-4376-aa3b-34b7084998c2-kube-api-access-f5zx8\") pod \"dns-operator-controller-manager-864dd78c4c-knvxb\" (UID: \"2bd6e0af-9a31-4376-aa3b-34b7084998c2\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-knvxb"
Jul 13 19:05:14.471099 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:05:14.471064    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f5zx8\" (UniqueName: \"kubernetes.io/projected/2bd6e0af-9a31-4376-aa3b-34b7084998c2-kube-api-access-f5zx8\") pod \"dns-operator-controller-manager-864dd78c4c-knvxb\" (UID: \"2bd6e0af-9a31-4376-aa3b-34b7084998c2\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-knvxb"
Jul 13 19:05:14.618148 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:05:14.618107    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-knvxb"
Jul 13 19:05:14.760504 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:05:14.760427    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-knvxb"]
Jul 13 19:05:14.762904 ip-10-0-135-38 kubenswrapper[2563]: W0713 19:05:14.762878    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2bd6e0af_9a31_4376_aa3b_34b7084998c2.slice/crio-60b90d499d73b1f3177141df8192968a3cb708d99d5d839b1973b2478213e250 WatchSource:0}: Error finding container 60b90d499d73b1f3177141df8192968a3cb708d99d5d839b1973b2478213e250: Status 404 returned error can't find the container with id 60b90d499d73b1f3177141df8192968a3cb708d99d5d839b1973b2478213e250
Jul 13 19:05:15.363075 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:05:15.363035    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-knvxb" event={"ID":"2bd6e0af-9a31-4376-aa3b-34b7084998c2","Type":"ContainerStarted","Data":"60b90d499d73b1f3177141df8192968a3cb708d99d5d839b1973b2478213e250"}
Jul 13 19:05:17.378669 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:05:17.378629    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-knvxb" event={"ID":"2bd6e0af-9a31-4376-aa3b-34b7084998c2","Type":"ContainerStarted","Data":"f2f3bba399a46c654d45e0142b7b0c5e1f84afb4d80c71d3f9b4524030ce8347"}
Jul 13 19:05:17.379090 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:05:17.378774    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-knvxb"
Jul 13 19:05:17.403626 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:05:17.403508    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-knvxb" podStartSLOduration=1.025849678 podStartE2EDuration="3.403488671s" totalImagesPullingTime="2.377638993s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 19:05:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 19:05:17.401413126 +0000 UTC m=+405.176289482" watchObservedRunningTime="2026-07-13 19:05:17.403488671 +0000 UTC m=+405.178365027"
Jul 13 19:05:18.457600 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:05:18.457563    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-5sj5k"]
Jul 13 19:05:18.460845 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:05:18.460825    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-5sj5k"
Jul 13 19:05:18.463538 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:05:18.463510    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-8sg4m\""
Jul 13 19:05:18.472284 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:05:18.472253    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-5sj5k"]
Jul 13 19:05:18.496218 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:05:18.496177    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hf4v8\" (UniqueName: \"kubernetes.io/projected/d53364f6-3e19-4780-aaf2-98967f9b26a9-kube-api-access-hf4v8\") pod \"authorino-operator-75cc8d5cb7-5sj5k\" (UID: \"d53364f6-3e19-4780-aaf2-98967f9b26a9\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-5sj5k"
Jul 13 19:05:18.597588 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:05:18.597548    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hf4v8\" (UniqueName: \"kubernetes.io/projected/d53364f6-3e19-4780-aaf2-98967f9b26a9-kube-api-access-hf4v8\") pod \"authorino-operator-75cc8d5cb7-5sj5k\" (UID: \"d53364f6-3e19-4780-aaf2-98967f9b26a9\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-5sj5k"
Jul 13 19:05:18.609090 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:05:18.609065    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hf4v8\" (UniqueName: \"kubernetes.io/projected/d53364f6-3e19-4780-aaf2-98967f9b26a9-kube-api-access-hf4v8\") pod \"authorino-operator-75cc8d5cb7-5sj5k\" (UID: \"d53364f6-3e19-4780-aaf2-98967f9b26a9\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-5sj5k"
Jul 13 19:05:18.771355 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:05:18.771252    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-5sj5k"
Jul 13 19:05:18.920244 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:05:18.920214    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-5sj5k"]
Jul 13 19:05:18.923043 ip-10-0-135-38 kubenswrapper[2563]: W0713 19:05:18.922981    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd53364f6_3e19_4780_aaf2_98967f9b26a9.slice/crio-a0e8bc6795dbc786b974ac6016c78e2fc79e021a9af0e8f3d576922404295c3a WatchSource:0}: Error finding container a0e8bc6795dbc786b974ac6016c78e2fc79e021a9af0e8f3d576922404295c3a: Status 404 returned error can't find the container with id a0e8bc6795dbc786b974ac6016c78e2fc79e021a9af0e8f3d576922404295c3a
Jul 13 19:05:19.388512 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:05:19.388475    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-5sj5k" event={"ID":"d53364f6-3e19-4780-aaf2-98967f9b26a9","Type":"ContainerStarted","Data":"a0e8bc6795dbc786b974ac6016c78e2fc79e021a9af0e8f3d576922404295c3a"}
Jul 13 19:05:21.400261 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:05:21.400218    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-5sj5k" event={"ID":"d53364f6-3e19-4780-aaf2-98967f9b26a9","Type":"ContainerStarted","Data":"a8d33168f57818b1af2f199abc0db08663ce9e530c946619c5189b02829156ff"}
Jul 13 19:05:21.400651 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:05:21.400308    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-5sj5k"
Jul 13 19:05:21.430682 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:05:21.430619    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-5sj5k" podStartSLOduration=1.148960928 podStartE2EDuration="3.430599192s" totalImagesPullingTime="2.281638264s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 19:05:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 19:05:21.42910335 +0000 UTC m=+409.203979706" watchObservedRunningTime="2026-07-13 19:05:21.430599192 +0000 UTC m=+409.205475547"
Jul 13 19:05:22.255548 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:05:22.255505    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tbg6q"]
Jul 13 19:05:22.258957 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:05:22.258930    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tbg6q"
Jul 13 19:05:22.263897 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:05:22.263874    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-5766p\""
Jul 13 19:05:22.287165 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:05:22.287131    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tbg6q"]
Jul 13 19:05:22.325243 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:05:22.325205    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-svdmm\" (UniqueName: \"kubernetes.io/projected/c1bbcb3a-1040-48a0-856f-701bedb0bd4a-kube-api-access-svdmm\") pod \"limitador-operator-controller-manager-859d7b78bd-tbg6q\" (UID: \"c1bbcb3a-1040-48a0-856f-701bedb0bd4a\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tbg6q"
Jul 13 19:05:22.426089 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:05:22.426046    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-svdmm\" (UniqueName: \"kubernetes.io/projected/c1bbcb3a-1040-48a0-856f-701bedb0bd4a-kube-api-access-svdmm\") pod \"limitador-operator-controller-manager-859d7b78bd-tbg6q\" (UID: \"c1bbcb3a-1040-48a0-856f-701bedb0bd4a\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tbg6q"
Jul 13 19:05:22.438175 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:05:22.438136    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-svdmm\" (UniqueName: \"kubernetes.io/projected/c1bbcb3a-1040-48a0-856f-701bedb0bd4a-kube-api-access-svdmm\") pod \"limitador-operator-controller-manager-859d7b78bd-tbg6q\" (UID: \"c1bbcb3a-1040-48a0-856f-701bedb0bd4a\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tbg6q"
Jul 13 19:05:22.569696 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:05:22.569592    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tbg6q"
Jul 13 19:05:22.736439 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:05:22.736415    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tbg6q"]
Jul 13 19:05:22.738917 ip-10-0-135-38 kubenswrapper[2563]: W0713 19:05:22.738884    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc1bbcb3a_1040_48a0_856f_701bedb0bd4a.slice/crio-6c4f3cbd691945f0ff53a985a91019e1e47d41f06a547001306e50bbff3fadb0 WatchSource:0}: Error finding container 6c4f3cbd691945f0ff53a985a91019e1e47d41f06a547001306e50bbff3fadb0: Status 404 returned error can't find the container with id 6c4f3cbd691945f0ff53a985a91019e1e47d41f06a547001306e50bbff3fadb0
Jul 13 19:05:23.410332 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:05:23.410289    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tbg6q" event={"ID":"c1bbcb3a-1040-48a0-856f-701bedb0bd4a","Type":"ContainerStarted","Data":"6c4f3cbd691945f0ff53a985a91019e1e47d41f06a547001306e50bbff3fadb0"}
Jul 13 19:05:25.421856 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:05:25.421806    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tbg6q" event={"ID":"c1bbcb3a-1040-48a0-856f-701bedb0bd4a","Type":"ContainerStarted","Data":"159b495955ff8406a7cb8201754f2be3a53ce77def992df59631ce413c3a9d86"}
Jul 13 19:05:25.422301 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:05:25.421899    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tbg6q"
Jul 13 19:05:25.451003 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:05:25.450944    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tbg6q" podStartSLOduration=1.217284707 podStartE2EDuration="3.450925649s" totalImagesPullingTime="2.233640942s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 19:05:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 19:05:25.449848881 +0000 UTC m=+413.224725294" watchObservedRunningTime="2026-07-13 19:05:25.450925649 +0000 UTC m=+413.225802004"
Jul 13 19:05:28.385690 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:05:28.385661    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-knvxb"
Jul 13 19:05:29.255855 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:05:29.255819    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-447vh"]
Jul 13 19:05:29.259280 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:05:29.259255    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-447vh"
Jul 13 19:05:29.262510 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:05:29.262481    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-blcgc\""
Jul 13 19:05:29.278501 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:05:29.278467    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-447vh"]
Jul 13 19:05:29.386931 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:05:29.386878    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ll2cb\" (UniqueName: \"kubernetes.io/projected/d191416d-0b89-4bb5-bb84-b1752d69a4f4-kube-api-access-ll2cb\") pod \"kuadrant-operator-controller-manager-8684c9ff49-447vh\" (UID: \"d191416d-0b89-4bb5-bb84-b1752d69a4f4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-447vh"
Jul 13 19:05:29.387364 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:05:29.386966    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d191416d-0b89-4bb5-bb84-b1752d69a4f4-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-447vh\" (UID: \"d191416d-0b89-4bb5-bb84-b1752d69a4f4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-447vh"
Jul 13 19:05:29.488090 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:05:29.488039    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d191416d-0b89-4bb5-bb84-b1752d69a4f4-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-447vh\" (UID: \"d191416d-0b89-4bb5-bb84-b1752d69a4f4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-447vh"
Jul 13 19:05:29.488267 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:05:29.488117    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ll2cb\" (UniqueName: \"kubernetes.io/projected/d191416d-0b89-4bb5-bb84-b1752d69a4f4-kube-api-access-ll2cb\") pod \"kuadrant-operator-controller-manager-8684c9ff49-447vh\" (UID: \"d191416d-0b89-4bb5-bb84-b1752d69a4f4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-447vh"
Jul 13 19:05:29.488453 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:05:29.488430    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d191416d-0b89-4bb5-bb84-b1752d69a4f4-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-447vh\" (UID: \"d191416d-0b89-4bb5-bb84-b1752d69a4f4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-447vh"
Jul 13 19:05:29.504434 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:05:29.504405    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ll2cb\" (UniqueName: \"kubernetes.io/projected/d191416d-0b89-4bb5-bb84-b1752d69a4f4-kube-api-access-ll2cb\") pod \"kuadrant-operator-controller-manager-8684c9ff49-447vh\" (UID: \"d191416d-0b89-4bb5-bb84-b1752d69a4f4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-447vh"
Jul 13 19:05:29.569691 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:05:29.569589    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-447vh"
Jul 13 19:05:29.727818 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:05:29.727792    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-447vh"]
Jul 13 19:05:29.729571 ip-10-0-135-38 kubenswrapper[2563]: W0713 19:05:29.729535    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd191416d_0b89_4bb5_bb84_b1752d69a4f4.slice/crio-8d3bb917bbbba04017c0a10bc49586f271618dd2236aeedaf59f5b33a011b202 WatchSource:0}: Error finding container 8d3bb917bbbba04017c0a10bc49586f271618dd2236aeedaf59f5b33a011b202: Status 404 returned error can't find the container with id 8d3bb917bbbba04017c0a10bc49586f271618dd2236aeedaf59f5b33a011b202
Jul 13 19:05:30.446546 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:05:30.446506    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-447vh" event={"ID":"d191416d-0b89-4bb5-bb84-b1752d69a4f4","Type":"ContainerStarted","Data":"8d3bb917bbbba04017c0a10bc49586f271618dd2236aeedaf59f5b33a011b202"}
Jul 13 19:05:32.407759 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:05:32.407725    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-5sj5k"
Jul 13 19:05:36.428990 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:05:36.428955    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tbg6q"
Jul 13 19:05:37.482134 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:05:37.482089    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-447vh" event={"ID":"d191416d-0b89-4bb5-bb84-b1752d69a4f4","Type":"ContainerStarted","Data":"36b70f35c274894b484cda942fc19b085572acf01158a95b2e54d2e43a57377d"}
Jul 13 19:05:37.482582 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:05:37.482232    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-447vh"
Jul 13 19:05:37.539345 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:05:37.539221    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-447vh" podStartSLOduration=1.02070265 podStartE2EDuration="8.539195734s" totalImagesPullingTime="7.518493084s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 19:05:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 19:05:37.53079893 +0000 UTC m=+425.305675297" watchObservedRunningTime="2026-07-13 19:05:37.539195734 +0000 UTC m=+425.314072089"
Jul 13 19:05:40.180862 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:05:40.180819    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-4f54b"]
Jul 13 19:05:40.184451 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:05:40.184423    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-4f54b"
Jul 13 19:05:40.190926 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:05:40.190895    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-lsvdw\""
Jul 13 19:05:40.190926 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:05:40.190894    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\""
Jul 13 19:05:40.191527 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:05:40.191283    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\""
Jul 13 19:05:40.204431 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:05:40.204395    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-4f54b"]
Jul 13 19:05:40.277649 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:05:40.277606    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/0def2810-edcf-4e02-af68-35d4d55c228e-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-4f54b\" (UID: \"0def2810-edcf-4e02-af68-35d4d55c228e\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-4f54b"
Jul 13 19:05:40.277649 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:05:40.277643    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/0def2810-edcf-4e02-af68-35d4d55c228e-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-4f54b\" (UID: \"0def2810-edcf-4e02-af68-35d4d55c228e\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-4f54b"
Jul 13 19:05:40.277873 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:05:40.277685    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vzddm\" (UniqueName: \"kubernetes.io/projected/0def2810-edcf-4e02-af68-35d4d55c228e-kube-api-access-vzddm\") pod \"kuadrant-console-plugin-66b5774985-4f54b\" (UID: \"0def2810-edcf-4e02-af68-35d4d55c228e\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-4f54b"
Jul 13 19:05:40.378954 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:05:40.378910    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vzddm\" (UniqueName: \"kubernetes.io/projected/0def2810-edcf-4e02-af68-35d4d55c228e-kube-api-access-vzddm\") pod \"kuadrant-console-plugin-66b5774985-4f54b\" (UID: \"0def2810-edcf-4e02-af68-35d4d55c228e\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-4f54b"
Jul 13 19:05:40.379183 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:05:40.379003    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/0def2810-edcf-4e02-af68-35d4d55c228e-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-4f54b\" (UID: \"0def2810-edcf-4e02-af68-35d4d55c228e\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-4f54b"
Jul 13 19:05:40.379183 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:05:40.379050    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/0def2810-edcf-4e02-af68-35d4d55c228e-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-4f54b\" (UID: \"0def2810-edcf-4e02-af68-35d4d55c228e\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-4f54b"
Jul 13 19:05:40.379183 ip-10-0-135-38 kubenswrapper[2563]: E0713 19:05:40.379149    2563 secret.go:189] Couldn't get secret kuadrant-system/plugin-serving-cert: secret "plugin-serving-cert" not found
Jul 13 19:05:40.379290 ip-10-0-135-38 kubenswrapper[2563]: E0713 19:05:40.379218    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0def2810-edcf-4e02-af68-35d4d55c228e-plugin-serving-cert podName:0def2810-edcf-4e02-af68-35d4d55c228e nodeName:}" failed. No retries permitted until 2026-07-13 19:05:40.879196242 +0000 UTC m=+428.654072594 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "plugin-serving-cert" (UniqueName: "kubernetes.io/secret/0def2810-edcf-4e02-af68-35d4d55c228e-plugin-serving-cert") pod "kuadrant-console-plugin-66b5774985-4f54b" (UID: "0def2810-edcf-4e02-af68-35d4d55c228e") : secret "plugin-serving-cert" not found
Jul 13 19:05:40.379777 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:05:40.379757    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/0def2810-edcf-4e02-af68-35d4d55c228e-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-4f54b\" (UID: \"0def2810-edcf-4e02-af68-35d4d55c228e\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-4f54b"
Jul 13 19:05:40.390186 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:05:40.390153    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vzddm\" (UniqueName: \"kubernetes.io/projected/0def2810-edcf-4e02-af68-35d4d55c228e-kube-api-access-vzddm\") pod \"kuadrant-console-plugin-66b5774985-4f54b\" (UID: \"0def2810-edcf-4e02-af68-35d4d55c228e\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-4f54b"
Jul 13 19:05:40.883704 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:05:40.883648    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/0def2810-edcf-4e02-af68-35d4d55c228e-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-4f54b\" (UID: \"0def2810-edcf-4e02-af68-35d4d55c228e\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-4f54b"
Jul 13 19:05:40.886276 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:05:40.886248    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/0def2810-edcf-4e02-af68-35d4d55c228e-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-4f54b\" (UID: \"0def2810-edcf-4e02-af68-35d4d55c228e\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-4f54b"
Jul 13 19:05:41.094961 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:05:41.094929    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-4f54b"
Jul 13 19:05:41.242477 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:05:41.242448    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-4f54b"]
Jul 13 19:05:41.244723 ip-10-0-135-38 kubenswrapper[2563]: W0713 19:05:41.244689    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0def2810_edcf_4e02_af68_35d4d55c228e.slice/crio-c7773dbd5daaced6efa8f8e6cbe875b230f51ab76ae3a471e2999d1058ae3818 WatchSource:0}: Error finding container c7773dbd5daaced6efa8f8e6cbe875b230f51ab76ae3a471e2999d1058ae3818: Status 404 returned error can't find the container with id c7773dbd5daaced6efa8f8e6cbe875b230f51ab76ae3a471e2999d1058ae3818
Jul 13 19:05:41.501723 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:05:41.501626    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-4f54b" event={"ID":"0def2810-edcf-4e02-af68-35d4d55c228e","Type":"ContainerStarted","Data":"c7773dbd5daaced6efa8f8e6cbe875b230f51ab76ae3a471e2999d1058ae3818"}
Jul 13 19:05:48.490140 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:05:48.490102    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-447vh"
Jul 13 19:05:49.994521 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:05:49.994478    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-4lzfz"]
Jul 13 19:05:49.998083 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:05:49.998056    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-4lzfz"
Jul 13 19:05:50.014561 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:05:50.014527    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-4lzfz"]
Jul 13 19:05:50.065643 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:05:50.065599    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7477c650-dace-4d66-a7ec-6bda3516c3a9-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-4lzfz\" (UID: \"7477c650-dace-4d66-a7ec-6bda3516c3a9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-4lzfz"
Jul 13 19:05:50.065854 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:05:50.065661    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vklpg\" (UniqueName: \"kubernetes.io/projected/7477c650-dace-4d66-a7ec-6bda3516c3a9-kube-api-access-vklpg\") pod \"kuadrant-operator-controller-manager-55467d9f7-4lzfz\" (UID: \"7477c650-dace-4d66-a7ec-6bda3516c3a9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-4lzfz"
Jul 13 19:05:50.166785 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:05:50.166733    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7477c650-dace-4d66-a7ec-6bda3516c3a9-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-4lzfz\" (UID: \"7477c650-dace-4d66-a7ec-6bda3516c3a9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-4lzfz"
Jul 13 19:05:50.166785 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:05:50.166793    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vklpg\" (UniqueName: \"kubernetes.io/projected/7477c650-dace-4d66-a7ec-6bda3516c3a9-kube-api-access-vklpg\") pod \"kuadrant-operator-controller-manager-55467d9f7-4lzfz\" (UID: \"7477c650-dace-4d66-a7ec-6bda3516c3a9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-4lzfz"
Jul 13 19:05:50.167257 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:05:50.167233    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7477c650-dace-4d66-a7ec-6bda3516c3a9-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-4lzfz\" (UID: \"7477c650-dace-4d66-a7ec-6bda3516c3a9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-4lzfz"
Jul 13 19:05:50.175402 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:05:50.175355    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vklpg\" (UniqueName: \"kubernetes.io/projected/7477c650-dace-4d66-a7ec-6bda3516c3a9-kube-api-access-vklpg\") pod \"kuadrant-operator-controller-manager-55467d9f7-4lzfz\" (UID: \"7477c650-dace-4d66-a7ec-6bda3516c3a9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-4lzfz"
Jul 13 19:05:50.238563 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:05:50.238520    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-4lzfz"]
Jul 13 19:05:50.238892 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:05:50.238859    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-4lzfz"
Jul 13 19:05:50.246356 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:05:50.246273    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-4lzfz"]
Jul 13 19:05:50.255878 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:05:50.255736    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-447vh"]
Jul 13 19:05:50.256101 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:05:50.255979    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-447vh" podUID="d191416d-0b89-4bb5-bb84-b1752d69a4f4" containerName="manager" containerID="cri-o://36b70f35c274894b484cda942fc19b085572acf01158a95b2e54d2e43a57377d" gracePeriod=2
Jul 13 19:05:50.270368 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:05:50.270331    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-447vh"]
Jul 13 19:05:50.273903 ip-10-0-135-38 kubenswrapper[2563]: E0713 19:05:50.273855    2563 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"d191416d-0b89-4bb5-bb84-b1752d69a4f4\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"kuadrant-operator-controller-manager-8684c9ff49-447vh\": pods \"kuadrant-operator-controller-manager-8684c9ff49-447vh\" not found" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-447vh"
Jul 13 19:05:50.275768 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:05:50.275734    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-2skzx"]
Jul 13 19:05:50.276362 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:05:50.276219    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d191416d-0b89-4bb5-bb84-b1752d69a4f4" containerName="manager"
Jul 13 19:05:50.276362 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:05:50.276244    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="d191416d-0b89-4bb5-bb84-b1752d69a4f4" containerName="manager"
Jul 13 19:05:50.276362 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:05:50.276336    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="d191416d-0b89-4bb5-bb84-b1752d69a4f4" containerName="manager"
Jul 13 19:05:50.280152 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:05:50.279723    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-2skzx"
Jul 13 19:05:50.283130 ip-10-0-135-38 kubenswrapper[2563]: E0713 19:05:50.282921    2563 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-447vh\" is forbidden: User \"system:node:ip-10-0-135-38.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-38.ec2.internal' and this object" podUID="d191416d-0b89-4bb5-bb84-b1752d69a4f4" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-447vh"
Jul 13 19:05:50.286682 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:05:50.285609    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5xmq6"]
Jul 13 19:05:50.289820 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:05:50.289784    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tbg6q"]
Jul 13 19:05:50.290012 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:05:50.289929    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5xmq6"
Jul 13 19:05:50.290098 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:05:50.290049    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tbg6q" podUID="c1bbcb3a-1040-48a0-856f-701bedb0bd4a" containerName="manager" containerID="cri-o://159b495955ff8406a7cb8201754f2be3a53ce77def992df59631ce413c3a9d86" gracePeriod=2
Jul 13 19:05:50.299783 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:05:50.296135    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-2skzx"]
Jul 13 19:05:50.299783 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:05:50.299112    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tbg6q"]
Jul 13 19:05:50.304870 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:05:50.304819    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5xmq6"]
Jul 13 19:05:50.322262 ip-10-0-135-38 kubenswrapper[2563]: E0713 19:05:50.322207    2563 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-447vh\" is forbidden: User \"system:node:ip-10-0-135-38.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-38.ec2.internal' and this object" podUID="d191416d-0b89-4bb5-bb84-b1752d69a4f4" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-447vh"
Jul 13 19:05:50.347467 ip-10-0-135-38 kubenswrapper[2563]: E0713 19:05:50.347423    2563 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-tbg6q\" is forbidden: User \"system:node:ip-10-0-135-38.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-38.ec2.internal' and this object" podUID="c1bbcb3a-1040-48a0-856f-701bedb0bd4a" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tbg6q"
Jul 13 19:05:50.370841 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:05:50.370800    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5f051a68-ce55-4ae0-9706-cfc0916acd92-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-5xmq6\" (UID: \"5f051a68-ce55-4ae0-9706-cfc0916acd92\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5xmq6"
Jul 13 19:05:50.371037 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:05:50.370851    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l8cbm\" (UniqueName: \"kubernetes.io/projected/9c5cd351-c8b3-43e9-b609-98c9caefe3de-kube-api-access-l8cbm\") pod \"kuadrant-operator-controller-manager-55467d9f7-2skzx\" (UID: \"9c5cd351-c8b3-43e9-b609-98c9caefe3de\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-2skzx"
Jul 13 19:05:50.371037 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:05:50.370947    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9c5cd351-c8b3-43e9-b609-98c9caefe3de-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-2skzx\" (UID: \"9c5cd351-c8b3-43e9-b609-98c9caefe3de\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-2skzx"
Jul 13 19:05:50.371037 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:05:50.370990    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mcjgs\" (UniqueName: \"kubernetes.io/projected/5f051a68-ce55-4ae0-9706-cfc0916acd92-kube-api-access-mcjgs\") pod \"kuadrant-operator-controller-manager-8684c9ff49-5xmq6\" (UID: \"5f051a68-ce55-4ae0-9706-cfc0916acd92\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5xmq6"
Jul 13 19:05:50.472569 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:05:50.472517    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5f051a68-ce55-4ae0-9706-cfc0916acd92-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-5xmq6\" (UID: \"5f051a68-ce55-4ae0-9706-cfc0916acd92\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5xmq6"
Jul 13 19:05:50.472757 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:05:50.472580    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l8cbm\" (UniqueName: \"kubernetes.io/projected/9c5cd351-c8b3-43e9-b609-98c9caefe3de-kube-api-access-l8cbm\") pod \"kuadrant-operator-controller-manager-55467d9f7-2skzx\" (UID: \"9c5cd351-c8b3-43e9-b609-98c9caefe3de\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-2skzx"
Jul 13 19:05:50.472757 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:05:50.472615    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9c5cd351-c8b3-43e9-b609-98c9caefe3de-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-2skzx\" (UID: \"9c5cd351-c8b3-43e9-b609-98c9caefe3de\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-2skzx"
Jul 13 19:05:50.472757 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:05:50.472642    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mcjgs\" (UniqueName: \"kubernetes.io/projected/5f051a68-ce55-4ae0-9706-cfc0916acd92-kube-api-access-mcjgs\") pod \"kuadrant-operator-controller-manager-8684c9ff49-5xmq6\" (UID: \"5f051a68-ce55-4ae0-9706-cfc0916acd92\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5xmq6"
Jul 13 19:05:50.473112 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:05:50.473077    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5f051a68-ce55-4ae0-9706-cfc0916acd92-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-5xmq6\" (UID: \"5f051a68-ce55-4ae0-9706-cfc0916acd92\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5xmq6"
Jul 13 19:05:50.474867 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:05:50.473224    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9c5cd351-c8b3-43e9-b609-98c9caefe3de-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-2skzx\" (UID: \"9c5cd351-c8b3-43e9-b609-98c9caefe3de\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-2skzx"
Jul 13 19:05:50.484216 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:05:50.484142    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mcjgs\" (UniqueName: \"kubernetes.io/projected/5f051a68-ce55-4ae0-9706-cfc0916acd92-kube-api-access-mcjgs\") pod \"kuadrant-operator-controller-manager-8684c9ff49-5xmq6\" (UID: \"5f051a68-ce55-4ae0-9706-cfc0916acd92\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5xmq6"
Jul 13 19:05:50.485524 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:05:50.485489    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l8cbm\" (UniqueName: \"kubernetes.io/projected/9c5cd351-c8b3-43e9-b609-98c9caefe3de-kube-api-access-l8cbm\") pod \"kuadrant-operator-controller-manager-55467d9f7-2skzx\" (UID: \"9c5cd351-c8b3-43e9-b609-98c9caefe3de\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-2skzx"
Jul 13 19:05:50.543516 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:05:50.543485    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-447vh"
Jul 13 19:05:50.545773 ip-10-0-135-38 kubenswrapper[2563]: E0713 19:05:50.545735    2563 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-447vh\" is forbidden: User \"system:node:ip-10-0-135-38.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-38.ec2.internal' and this object" podUID="d191416d-0b89-4bb5-bb84-b1752d69a4f4" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-447vh"
Jul 13 19:05:50.547741 ip-10-0-135-38 kubenswrapper[2563]: E0713 19:05:50.547699    2563 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-tbg6q\" is forbidden: User \"system:node:ip-10-0-135-38.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-38.ec2.internal' and this object" podUID="c1bbcb3a-1040-48a0-856f-701bedb0bd4a" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tbg6q"
Jul 13 19:05:50.550128 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:05:50.550031    2563 generic.go:356] "Generic (PLEG): container finished" podID="d191416d-0b89-4bb5-bb84-b1752d69a4f4" containerID="36b70f35c274894b484cda942fc19b085572acf01158a95b2e54d2e43a57377d" exitCode=0
Jul 13 19:05:50.550128 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:05:50.550088    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-447vh"
Jul 13 19:05:50.550337 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:05:50.550145    2563 scope.go:117] "RemoveContainer" containerID="36b70f35c274894b484cda942fc19b085572acf01158a95b2e54d2e43a57377d"
Jul 13 19:05:50.551479 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:05:50.551455    2563 generic.go:356] "Generic (PLEG): container finished" podID="c1bbcb3a-1040-48a0-856f-701bedb0bd4a" containerID="159b495955ff8406a7cb8201754f2be3a53ce77def992df59631ce413c3a9d86" exitCode=0
Jul 13 19:05:50.551575 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:05:50.551521    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6c4f3cbd691945f0ff53a985a91019e1e47d41f06a547001306e50bbff3fadb0"
Jul 13 19:05:50.552074 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:05:50.552053    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tbg6q"
Jul 13 19:05:50.552305 ip-10-0-135-38 kubenswrapper[2563]: E0713 19:05:50.552277    2563 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-447vh\" is forbidden: User \"system:node:ip-10-0-135-38.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-38.ec2.internal' and this object" podUID="d191416d-0b89-4bb5-bb84-b1752d69a4f4" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-447vh"
Jul 13 19:05:50.554286 ip-10-0-135-38 kubenswrapper[2563]: E0713 19:05:50.554262    2563 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-tbg6q\" is forbidden: User \"system:node:ip-10-0-135-38.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-38.ec2.internal' and this object" podUID="c1bbcb3a-1040-48a0-856f-701bedb0bd4a" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tbg6q"
Jul 13 19:05:50.556153 ip-10-0-135-38 kubenswrapper[2563]: E0713 19:05:50.556124    2563 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-447vh\" is forbidden: User \"system:node:ip-10-0-135-38.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-38.ec2.internal' and this object" podUID="d191416d-0b89-4bb5-bb84-b1752d69a4f4" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-447vh"
Jul 13 19:05:50.558031 ip-10-0-135-38 kubenswrapper[2563]: E0713 19:05:50.557987    2563 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-tbg6q\" is forbidden: User \"system:node:ip-10-0-135-38.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-38.ec2.internal' and this object" podUID="c1bbcb3a-1040-48a0-856f-701bedb0bd4a" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tbg6q"
Jul 13 19:05:50.559481 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:05:50.559457    2563 scope.go:117] "RemoveContainer" containerID="36b70f35c274894b484cda942fc19b085572acf01158a95b2e54d2e43a57377d"
Jul 13 19:05:50.559877 ip-10-0-135-38 kubenswrapper[2563]: E0713 19:05:50.559852    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"36b70f35c274894b484cda942fc19b085572acf01158a95b2e54d2e43a57377d\": container with ID starting with 36b70f35c274894b484cda942fc19b085572acf01158a95b2e54d2e43a57377d not found: ID does not exist" containerID="36b70f35c274894b484cda942fc19b085572acf01158a95b2e54d2e43a57377d"
Jul 13 19:05:50.559969 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:05:50.559884    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"36b70f35c274894b484cda942fc19b085572acf01158a95b2e54d2e43a57377d"} err="failed to get container status \"36b70f35c274894b484cda942fc19b085572acf01158a95b2e54d2e43a57377d\": rpc error: code = NotFound desc = could not find container \"36b70f35c274894b484cda942fc19b085572acf01158a95b2e54d2e43a57377d\": container with ID starting with 36b70f35c274894b484cda942fc19b085572acf01158a95b2e54d2e43a57377d not found: ID does not exist"
Jul 13 19:05:50.673675 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:05:50.673637    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ll2cb\" (UniqueName: \"kubernetes.io/projected/d191416d-0b89-4bb5-bb84-b1752d69a4f4-kube-api-access-ll2cb\") pod \"d191416d-0b89-4bb5-bb84-b1752d69a4f4\" (UID: \"d191416d-0b89-4bb5-bb84-b1752d69a4f4\") "
Jul 13 19:05:50.673876 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:05:50.673699    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-svdmm\" (UniqueName: \"kubernetes.io/projected/c1bbcb3a-1040-48a0-856f-701bedb0bd4a-kube-api-access-svdmm\") pod \"c1bbcb3a-1040-48a0-856f-701bedb0bd4a\" (UID: \"c1bbcb3a-1040-48a0-856f-701bedb0bd4a\") "
Jul 13 19:05:50.673876 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:05:50.673774    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d191416d-0b89-4bb5-bb84-b1752d69a4f4-extensions-socket-volume\") pod \"d191416d-0b89-4bb5-bb84-b1752d69a4f4\" (UID: \"d191416d-0b89-4bb5-bb84-b1752d69a4f4\") "
Jul 13 19:05:50.674549 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:05:50.674490    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d191416d-0b89-4bb5-bb84-b1752d69a4f4-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "d191416d-0b89-4bb5-bb84-b1752d69a4f4" (UID: "d191416d-0b89-4bb5-bb84-b1752d69a4f4"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 19:05:50.676317 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:05:50.676275    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d191416d-0b89-4bb5-bb84-b1752d69a4f4-kube-api-access-ll2cb" (OuterVolumeSpecName: "kube-api-access-ll2cb") pod "d191416d-0b89-4bb5-bb84-b1752d69a4f4" (UID: "d191416d-0b89-4bb5-bb84-b1752d69a4f4"). InnerVolumeSpecName "kube-api-access-ll2cb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 19:05:50.676419 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:05:50.676323    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c1bbcb3a-1040-48a0-856f-701bedb0bd4a-kube-api-access-svdmm" (OuterVolumeSpecName: "kube-api-access-svdmm") pod "c1bbcb3a-1040-48a0-856f-701bedb0bd4a" (UID: "c1bbcb3a-1040-48a0-856f-701bedb0bd4a"). InnerVolumeSpecName "kube-api-access-svdmm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 19:05:50.704573 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:05:50.704522    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-2skzx"
Jul 13 19:05:50.713868 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:05:50.713836    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5xmq6"
Jul 13 19:05:50.759144 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:05:50.759087    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c1bbcb3a-1040-48a0-856f-701bedb0bd4a" path="/var/lib/kubelet/pods/c1bbcb3a-1040-48a0-856f-701bedb0bd4a/volumes"
Jul 13 19:05:50.759906 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:05:50.759634    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d191416d-0b89-4bb5-bb84-b1752d69a4f4" path="/var/lib/kubelet/pods/d191416d-0b89-4bb5-bb84-b1752d69a4f4/volumes"
Jul 13 19:05:50.774862 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:05:50.774809    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ll2cb\" (UniqueName: \"kubernetes.io/projected/d191416d-0b89-4bb5-bb84-b1752d69a4f4-kube-api-access-ll2cb\") on node \"ip-10-0-135-38.ec2.internal\" DevicePath \"\""
Jul 13 19:05:50.774862 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:05:50.774862    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-svdmm\" (UniqueName: \"kubernetes.io/projected/c1bbcb3a-1040-48a0-856f-701bedb0bd4a-kube-api-access-svdmm\") on node \"ip-10-0-135-38.ec2.internal\" DevicePath \"\""
Jul 13 19:05:50.775209 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:05:50.774886    2563 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d191416d-0b89-4bb5-bb84-b1752d69a4f4-extensions-socket-volume\") on node \"ip-10-0-135-38.ec2.internal\" DevicePath \"\""
Jul 13 19:05:50.915119 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:05:50.915070    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-2skzx"]
Jul 13 19:05:50.919314 ip-10-0-135-38 kubenswrapper[2563]: W0713 19:05:50.919264    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9c5cd351_c8b3_43e9_b609_98c9caefe3de.slice/crio-f3fb3fd686092cbedfcffd0d38aa463d50056d1ed9960496b145e76db5e26a56 WatchSource:0}: Error finding container f3fb3fd686092cbedfcffd0d38aa463d50056d1ed9960496b145e76db5e26a56: Status 404 returned error can't find the container with id f3fb3fd686092cbedfcffd0d38aa463d50056d1ed9960496b145e76db5e26a56
Jul 13 19:05:50.926053 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:05:50.926005    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5xmq6"]
Jul 13 19:05:50.929384 ip-10-0-135-38 kubenswrapper[2563]: W0713 19:05:50.929348    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5f051a68_ce55_4ae0_9706_cfc0916acd92.slice/crio-cc610ad9343c89561aa258317e2635159f59b408c86a4897eeedc79e0076058a WatchSource:0}: Error finding container cc610ad9343c89561aa258317e2635159f59b408c86a4897eeedc79e0076058a: Status 404 returned error can't find the container with id cc610ad9343c89561aa258317e2635159f59b408c86a4897eeedc79e0076058a
Jul 13 19:05:51.559221 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:05:51.559103    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5xmq6" event={"ID":"5f051a68-ce55-4ae0-9706-cfc0916acd92","Type":"ContainerStarted","Data":"726b04bb1339f88f27855011cba80ef4034690c7a826daa4117c7bc39eed8026"}
Jul 13 19:05:51.559221 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:05:51.559176    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5xmq6" event={"ID":"5f051a68-ce55-4ae0-9706-cfc0916acd92","Type":"ContainerStarted","Data":"cc610ad9343c89561aa258317e2635159f59b408c86a4897eeedc79e0076058a"}
Jul 13 19:05:51.559714 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:05:51.559308    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5xmq6"
Jul 13 19:05:51.560903 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:05:51.560882    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tbg6q"
Jul 13 19:05:51.561069 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:05:51.560880    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-2skzx" event={"ID":"9c5cd351-c8b3-43e9-b609-98c9caefe3de","Type":"ContainerStarted","Data":"65d7cc31255828ab04917887a706eb3703941878ec3022a16776654ca72dc10b"}
Jul 13 19:05:51.561069 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:05:51.560970    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-2skzx" event={"ID":"9c5cd351-c8b3-43e9-b609-98c9caefe3de","Type":"ContainerStarted","Data":"f3fb3fd686092cbedfcffd0d38aa463d50056d1ed9960496b145e76db5e26a56"}
Jul 13 19:05:51.561069 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:05:51.561031    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-2skzx"
Jul 13 19:05:51.603436 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:05:51.603372    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5xmq6" podStartSLOduration=1.60334816 podStartE2EDuration="1.60334816s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 19:05:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 19:05:51.60101111 +0000 UTC m=+439.375887466" watchObservedRunningTime="2026-07-13 19:05:51.60334816 +0000 UTC m=+439.378224563"
Jul 13 19:05:51.649959 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:05:51.649901    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-2skzx" podStartSLOduration=1.6498812859999998 podStartE2EDuration="1.649881286s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 19:05:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 19:05:51.649537183 +0000 UTC m=+439.424413539" watchObservedRunningTime="2026-07-13 19:05:51.649881286 +0000 UTC m=+439.424757641"
Jul 13 19:06:02.568912 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:06:02.568691    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-2skzx"
Jul 13 19:06:02.568912 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:06:02.568788    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5xmq6"
Jul 13 19:06:02.626108 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:06:02.626068    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5xmq6"]
Jul 13 19:06:02.626372 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:06:02.626328    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5xmq6" podUID="5f051a68-ce55-4ae0-9706-cfc0916acd92" containerName="manager" containerID="cri-o://726b04bb1339f88f27855011cba80ef4034690c7a826daa4117c7bc39eed8026" gracePeriod=10
Jul 13 19:06:03.401497 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:06:03.401446    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vnjz8"]
Jul 13 19:06:03.401888 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:06:03.401860    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c1bbcb3a-1040-48a0-856f-701bedb0bd4a" containerName="manager"
Jul 13 19:06:03.401888 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:06:03.401883    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="c1bbcb3a-1040-48a0-856f-701bedb0bd4a" containerName="manager"
Jul 13 19:06:03.402115 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:06:03.401962    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="c1bbcb3a-1040-48a0-856f-701bedb0bd4a" containerName="manager"
Jul 13 19:06:03.426567 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:06:03.426522    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vnjz8"
Jul 13 19:06:03.426866 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:06:03.426839    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vnjz8"]
Jul 13 19:06:03.494724 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:06:03.494679    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-42wjb\" (UniqueName: \"kubernetes.io/projected/bbb51ea3-098c-478a-8e8c-abb8be2bb5ca-kube-api-access-42wjb\") pod \"kuadrant-operator-controller-manager-86878c769f-vnjz8\" (UID: \"bbb51ea3-098c-478a-8e8c-abb8be2bb5ca\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vnjz8"
Jul 13 19:06:03.494946 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:06:03.494778    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/bbb51ea3-098c-478a-8e8c-abb8be2bb5ca-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-vnjz8\" (UID: \"bbb51ea3-098c-478a-8e8c-abb8be2bb5ca\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vnjz8"
Jul 13 19:06:03.595529 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:06:03.595473    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-42wjb\" (UniqueName: \"kubernetes.io/projected/bbb51ea3-098c-478a-8e8c-abb8be2bb5ca-kube-api-access-42wjb\") pod \"kuadrant-operator-controller-manager-86878c769f-vnjz8\" (UID: \"bbb51ea3-098c-478a-8e8c-abb8be2bb5ca\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vnjz8"
Jul 13 19:06:03.595982 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:06:03.595595    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/bbb51ea3-098c-478a-8e8c-abb8be2bb5ca-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-vnjz8\" (UID: \"bbb51ea3-098c-478a-8e8c-abb8be2bb5ca\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vnjz8"
Jul 13 19:06:03.596051 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:06:03.596003    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/bbb51ea3-098c-478a-8e8c-abb8be2bb5ca-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-vnjz8\" (UID: \"bbb51ea3-098c-478a-8e8c-abb8be2bb5ca\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vnjz8"
Jul 13 19:06:03.604185 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:06:03.604157    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-42wjb\" (UniqueName: \"kubernetes.io/projected/bbb51ea3-098c-478a-8e8c-abb8be2bb5ca-kube-api-access-42wjb\") pod \"kuadrant-operator-controller-manager-86878c769f-vnjz8\" (UID: \"bbb51ea3-098c-478a-8e8c-abb8be2bb5ca\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vnjz8"
Jul 13 19:06:03.743409 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:06:03.743310    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vnjz8"
Jul 13 19:06:06.980738 ip-10-0-135-38 kubenswrapper[2563]: E0713 19:06:06.980588    2563 log.go:32] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to create pod network sandbox k8s_kuadrant-operator-controller-manager-55467d9f7-4lzfz_kuadrant-system_7477c650-dace-4d66-a7ec-6bda3516c3a9_0(809761f35c5cd4c08b9a7e3e8d45b5ca550593ed6146b866294fcbadfc0105cd): error adding pod kuadrant-system_kuadrant-operator-controller-manager-55467d9f7-4lzfz to CNI network \"multus-cni-network\": plugin type=\"multus-shim\" name=\"multus-cni-network\" failed (add): CmdAdd (shim): failed to send CNI request: Post \"http://dummy/cni\": EOF: StdinData: {\"auxiliaryCNIChainName\":\"vendor-cni-chain\",\"binDir\":\"/var/lib/cni/bin\",\"clusterNetwork\":\"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf\",\"cniVersion\":\"0.3.1\",\"daemonSocketDir\":\"/run/multus/socket\",\"globalNamespaces\":\"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv\",\"logLevel\":\"verbose\",\"logToStderr\":true,\"name\":\"multus-cni-network\",\"namespaceIsolation\":true,\"type\":\"multus-shim\"}"
Jul 13 19:06:06.980738 ip-10-0-135-38 kubenswrapper[2563]: E0713 19:06:06.980681    2563 kuberuntime_sandbox.go:71] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to create pod network sandbox k8s_kuadrant-operator-controller-manager-55467d9f7-4lzfz_kuadrant-system_7477c650-dace-4d66-a7ec-6bda3516c3a9_0(809761f35c5cd4c08b9a7e3e8d45b5ca550593ed6146b866294fcbadfc0105cd): error adding pod kuadrant-system_kuadrant-operator-controller-manager-55467d9f7-4lzfz to CNI network \"multus-cni-network\": plugin type=\"multus-shim\" name=\"multus-cni-network\" failed (add): CmdAdd (shim): failed to send CNI request: Post \"http://dummy/cni\": EOF: StdinData: {\"auxiliaryCNIChainName\":\"vendor-cni-chain\",\"binDir\":\"/var/lib/cni/bin\",\"clusterNetwork\":\"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf\",\"cniVersion\":\"0.3.1\",\"daemonSocketDir\":\"/run/multus/socket\",\"globalNamespaces\":\"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv\",\"logLevel\":\"verbose\",\"logToStderr\":true,\"name\":\"multus-cni-network\",\"namespaceIsolation\":true,\"type\":\"multus-shim\"}" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-4lzfz"
Jul 13 19:06:07.137357 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:06:07.137327    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vnjz8"]
Jul 13 19:06:07.141239 ip-10-0-135-38 kubenswrapper[2563]: W0713 19:06:07.141211    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbbb51ea3_098c_478a_8e8c_abb8be2bb5ca.slice/crio-181d41cddb368e57e295b050f2881bb83c59ec41774d06c8364e1b194c345c8e WatchSource:0}: Error finding container 181d41cddb368e57e295b050f2881bb83c59ec41774d06c8364e1b194c345c8e: Status 404 returned error can't find the container with id 181d41cddb368e57e295b050f2881bb83c59ec41774d06c8364e1b194c345c8e
Jul 13 19:06:07.143938 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:06:07.143917    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5xmq6"
Jul 13 19:06:07.230166 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:06:07.230129    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mcjgs\" (UniqueName: \"kubernetes.io/projected/5f051a68-ce55-4ae0-9706-cfc0916acd92-kube-api-access-mcjgs\") pod \"5f051a68-ce55-4ae0-9706-cfc0916acd92\" (UID: \"5f051a68-ce55-4ae0-9706-cfc0916acd92\") "
Jul 13 19:06:07.230377 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:06:07.230222    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5f051a68-ce55-4ae0-9706-cfc0916acd92-extensions-socket-volume\") pod \"5f051a68-ce55-4ae0-9706-cfc0916acd92\" (UID: \"5f051a68-ce55-4ae0-9706-cfc0916acd92\") "
Jul 13 19:06:07.230615 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:06:07.230591    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5f051a68-ce55-4ae0-9706-cfc0916acd92-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "5f051a68-ce55-4ae0-9706-cfc0916acd92" (UID: "5f051a68-ce55-4ae0-9706-cfc0916acd92"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 19:06:07.232457 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:06:07.232434    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5f051a68-ce55-4ae0-9706-cfc0916acd92-kube-api-access-mcjgs" (OuterVolumeSpecName: "kube-api-access-mcjgs") pod "5f051a68-ce55-4ae0-9706-cfc0916acd92" (UID: "5f051a68-ce55-4ae0-9706-cfc0916acd92"). InnerVolumeSpecName "kube-api-access-mcjgs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 19:06:07.331750 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:06:07.331704    2563 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5f051a68-ce55-4ae0-9706-cfc0916acd92-extensions-socket-volume\") on node \"ip-10-0-135-38.ec2.internal\" DevicePath \"\""
Jul 13 19:06:07.331750 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:06:07.331741    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mcjgs\" (UniqueName: \"kubernetes.io/projected/5f051a68-ce55-4ae0-9706-cfc0916acd92-kube-api-access-mcjgs\") on node \"ip-10-0-135-38.ec2.internal\" DevicePath \"\""
Jul 13 19:06:07.649450 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:06:07.649416    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-4f54b" event={"ID":"0def2810-edcf-4e02-af68-35d4d55c228e","Type":"ContainerStarted","Data":"0b0f1c068bc12908b7c8ddb20c0298151a8974dd7343761dac33b4c1b1c860c4"}
Jul 13 19:06:07.650780 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:06:07.650754    2563 generic.go:356] "Generic (PLEG): container finished" podID="5f051a68-ce55-4ae0-9706-cfc0916acd92" containerID="726b04bb1339f88f27855011cba80ef4034690c7a826daa4117c7bc39eed8026" exitCode=0
Jul 13 19:06:07.650902 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:06:07.650792    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5xmq6"
Jul 13 19:06:07.650902 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:06:07.650830    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5xmq6" event={"ID":"5f051a68-ce55-4ae0-9706-cfc0916acd92","Type":"ContainerDied","Data":"726b04bb1339f88f27855011cba80ef4034690c7a826daa4117c7bc39eed8026"}
Jul 13 19:06:07.650902 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:06:07.650880    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5xmq6" event={"ID":"5f051a68-ce55-4ae0-9706-cfc0916acd92","Type":"ContainerDied","Data":"cc610ad9343c89561aa258317e2635159f59b408c86a4897eeedc79e0076058a"}
Jul 13 19:06:07.651050 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:06:07.650913    2563 scope.go:117] "RemoveContainer" containerID="726b04bb1339f88f27855011cba80ef4034690c7a826daa4117c7bc39eed8026"
Jul 13 19:06:07.652749 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:06:07.652720    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vnjz8" event={"ID":"bbb51ea3-098c-478a-8e8c-abb8be2bb5ca","Type":"ContainerStarted","Data":"a5b665894326a4ce6b29e06a4a7e1d0233a405512e5e5e4b3ee31e4936aa7256"}
Jul 13 19:06:07.652858 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:06:07.652774    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vnjz8"
Jul 13 19:06:07.652858 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:06:07.652798    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vnjz8" event={"ID":"bbb51ea3-098c-478a-8e8c-abb8be2bb5ca","Type":"ContainerStarted","Data":"181d41cddb368e57e295b050f2881bb83c59ec41774d06c8364e1b194c345c8e"}
Jul 13 19:06:07.652858 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:06:07.652795    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-4lzfz"
Jul 13 19:06:07.660554 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:06:07.660535    2563 scope.go:117] "RemoveContainer" containerID="726b04bb1339f88f27855011cba80ef4034690c7a826daa4117c7bc39eed8026"
Jul 13 19:06:07.660818 ip-10-0-135-38 kubenswrapper[2563]: E0713 19:06:07.660800    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"726b04bb1339f88f27855011cba80ef4034690c7a826daa4117c7bc39eed8026\": container with ID starting with 726b04bb1339f88f27855011cba80ef4034690c7a826daa4117c7bc39eed8026 not found: ID does not exist" containerID="726b04bb1339f88f27855011cba80ef4034690c7a826daa4117c7bc39eed8026"
Jul 13 19:06:07.660878 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:06:07.660831    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"726b04bb1339f88f27855011cba80ef4034690c7a826daa4117c7bc39eed8026"} err="failed to get container status \"726b04bb1339f88f27855011cba80ef4034690c7a826daa4117c7bc39eed8026\": rpc error: code = NotFound desc = could not find container \"726b04bb1339f88f27855011cba80ef4034690c7a826daa4117c7bc39eed8026\": container with ID starting with 726b04bb1339f88f27855011cba80ef4034690c7a826daa4117c7bc39eed8026 not found: ID does not exist"
Jul 13 19:06:07.661453 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:06:07.661436    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-4lzfz"
Jul 13 19:06:07.667729 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:06:07.667685    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-4f54b" podStartSLOduration=1.849536651 podStartE2EDuration="27.667670311s" totalImagesPullingTime="25.81813366s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 19:05:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 19:06:07.665636613 +0000 UTC m=+455.440512989" watchObservedRunningTime="2026-07-13 19:06:07.667670311 +0000 UTC m=+455.442546666"
Jul 13 19:06:07.699423 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:06:07.699371    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vnjz8" podStartSLOduration=4.699353837 podStartE2EDuration="4.699353837s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 19:06:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 19:06:07.689512717 +0000 UTC m=+455.464389073" watchObservedRunningTime="2026-07-13 19:06:07.699353837 +0000 UTC m=+455.474230193"
Jul 13 19:06:07.705367 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:06:07.705336    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5xmq6"]
Jul 13 19:06:07.710911 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:06:07.710875    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5xmq6"]
Jul 13 19:06:07.713758 ip-10-0-135-38 kubenswrapper[2563]: E0713 19:06:07.713723    2563 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-4lzfz\" is forbidden: User \"system:node:ip-10-0-135-38.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-38.ec2.internal' and this object" podUID="7477c650-dace-4d66-a7ec-6bda3516c3a9" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-4lzfz"
Jul 13 19:06:07.734585 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:06:07.734549    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vklpg\" (UniqueName: \"kubernetes.io/projected/7477c650-dace-4d66-a7ec-6bda3516c3a9-kube-api-access-vklpg\") pod \"7477c650-dace-4d66-a7ec-6bda3516c3a9\" (UID: \"7477c650-dace-4d66-a7ec-6bda3516c3a9\") "
Jul 13 19:06:07.734749 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:06:07.734732    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7477c650-dace-4d66-a7ec-6bda3516c3a9-extensions-socket-volume\") pod \"7477c650-dace-4d66-a7ec-6bda3516c3a9\" (UID: \"7477c650-dace-4d66-a7ec-6bda3516c3a9\") "
Jul 13 19:06:07.735044 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:06:07.734991    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7477c650-dace-4d66-a7ec-6bda3516c3a9-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "7477c650-dace-4d66-a7ec-6bda3516c3a9" (UID: "7477c650-dace-4d66-a7ec-6bda3516c3a9"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 19:06:07.735294 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:06:07.735271    2563 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7477c650-dace-4d66-a7ec-6bda3516c3a9-extensions-socket-volume\") on node \"ip-10-0-135-38.ec2.internal\" DevicePath \"\""
Jul 13 19:06:07.736668 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:06:07.736642    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7477c650-dace-4d66-a7ec-6bda3516c3a9-kube-api-access-vklpg" (OuterVolumeSpecName: "kube-api-access-vklpg") pod "7477c650-dace-4d66-a7ec-6bda3516c3a9" (UID: "7477c650-dace-4d66-a7ec-6bda3516c3a9"). InnerVolumeSpecName "kube-api-access-vklpg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 19:06:07.836036 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:06:07.835983    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vklpg\" (UniqueName: \"kubernetes.io/projected/7477c650-dace-4d66-a7ec-6bda3516c3a9-kube-api-access-vklpg\") on node \"ip-10-0-135-38.ec2.internal\" DevicePath \"\""
Jul 13 19:06:08.658568 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:06:08.658533    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-4lzfz"
Jul 13 19:06:08.660716 ip-10-0-135-38 kubenswrapper[2563]: E0713 19:06:08.660682    2563 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-4lzfz\" is forbidden: User \"system:node:ip-10-0-135-38.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-38.ec2.internal' and this object" podUID="7477c650-dace-4d66-a7ec-6bda3516c3a9" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-4lzfz"
Jul 13 19:06:08.666591 ip-10-0-135-38 kubenswrapper[2563]: E0713 19:06:08.666552    2563 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-4lzfz\" is forbidden: User \"system:node:ip-10-0-135-38.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-38.ec2.internal' and this object" podUID="7477c650-dace-4d66-a7ec-6bda3516c3a9" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-4lzfz"
Jul 13 19:06:08.755594 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:06:08.755556    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5f051a68-ce55-4ae0-9706-cfc0916acd92" path="/var/lib/kubelet/pods/5f051a68-ce55-4ae0-9706-cfc0916acd92/volumes"
Jul 13 19:06:08.755932 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:06:08.755918    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7477c650-dace-4d66-a7ec-6bda3516c3a9" path="/var/lib/kubelet/pods/7477c650-dace-4d66-a7ec-6bda3516c3a9/volumes"
Jul 13 19:06:18.661352 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:06:18.661311    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vnjz8"
Jul 13 19:06:18.716460 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:06:18.716426    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-2skzx"]
Jul 13 19:06:18.716659 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:06:18.716636    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-2skzx" podUID="9c5cd351-c8b3-43e9-b609-98c9caefe3de" containerName="manager" containerID="cri-o://65d7cc31255828ab04917887a706eb3703941878ec3022a16776654ca72dc10b" gracePeriod=10
Jul 13 19:06:18.977849 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:06:18.977816    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-2skzx"
Jul 13 19:06:19.032744 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:06:19.032710    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9c5cd351-c8b3-43e9-b609-98c9caefe3de-extensions-socket-volume\") pod \"9c5cd351-c8b3-43e9-b609-98c9caefe3de\" (UID: \"9c5cd351-c8b3-43e9-b609-98c9caefe3de\") "
Jul 13 19:06:19.032744 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:06:19.032757    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l8cbm\" (UniqueName: \"kubernetes.io/projected/9c5cd351-c8b3-43e9-b609-98c9caefe3de-kube-api-access-l8cbm\") pod \"9c5cd351-c8b3-43e9-b609-98c9caefe3de\" (UID: \"9c5cd351-c8b3-43e9-b609-98c9caefe3de\") "
Jul 13 19:06:19.033263 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:06:19.033231    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9c5cd351-c8b3-43e9-b609-98c9caefe3de-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "9c5cd351-c8b3-43e9-b609-98c9caefe3de" (UID: "9c5cd351-c8b3-43e9-b609-98c9caefe3de"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 19:06:19.035445 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:06:19.035257    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9c5cd351-c8b3-43e9-b609-98c9caefe3de-kube-api-access-l8cbm" (OuterVolumeSpecName: "kube-api-access-l8cbm") pod "9c5cd351-c8b3-43e9-b609-98c9caefe3de" (UID: "9c5cd351-c8b3-43e9-b609-98c9caefe3de"). InnerVolumeSpecName "kube-api-access-l8cbm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 19:06:19.037095 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:06:19.037068    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-7s4bt"]
Jul 13 19:06:19.037559 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:06:19.037543    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9c5cd351-c8b3-43e9-b609-98c9caefe3de" containerName="manager"
Jul 13 19:06:19.037600 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:06:19.037566    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="9c5cd351-c8b3-43e9-b609-98c9caefe3de" containerName="manager"
Jul 13 19:06:19.037600 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:06:19.037585    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5f051a68-ce55-4ae0-9706-cfc0916acd92" containerName="manager"
Jul 13 19:06:19.037600 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:06:19.037594    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="5f051a68-ce55-4ae0-9706-cfc0916acd92" containerName="manager"
Jul 13 19:06:19.037701 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:06:19.037689    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="9c5cd351-c8b3-43e9-b609-98c9caefe3de" containerName="manager"
Jul 13 19:06:19.037738 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:06:19.037709    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="5f051a68-ce55-4ae0-9706-cfc0916acd92" containerName="manager"
Jul 13 19:06:19.041083 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:06:19.041063    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-7s4bt"
Jul 13 19:06:19.045176 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:06:19.045140    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 13 19:06:19.045854 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:06:19.045829    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-6vzrf\""
Jul 13 19:06:19.074394 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:06:19.074361    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-7s4bt"]
Jul 13 19:06:19.133340 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:06:19.133291    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dk44w\" (UniqueName: \"kubernetes.io/projected/4acae5fb-5b4e-4393-b00d-dfedc5dfef9a-kube-api-access-dk44w\") pod \"maas-default-gateway-openshift-default-56654dcf7-7s4bt\" (UID: \"4acae5fb-5b4e-4393-b00d-dfedc5dfef9a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-7s4bt"
Jul 13 19:06:19.133340 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:06:19.133337    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4acae5fb-5b4e-4393-b00d-dfedc5dfef9a-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-7s4bt\" (UID: \"4acae5fb-5b4e-4393-b00d-dfedc5dfef9a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-7s4bt"
Jul 13 19:06:19.133573 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:06:19.133361    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4acae5fb-5b4e-4393-b00d-dfedc5dfef9a-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-7s4bt\" (UID: \"4acae5fb-5b4e-4393-b00d-dfedc5dfef9a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-7s4bt"
Jul 13 19:06:19.133573 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:06:19.133415    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4acae5fb-5b4e-4393-b00d-dfedc5dfef9a-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-7s4bt\" (UID: \"4acae5fb-5b4e-4393-b00d-dfedc5dfef9a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-7s4bt"
Jul 13 19:06:19.133573 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:06:19.133460    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4acae5fb-5b4e-4393-b00d-dfedc5dfef9a-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-7s4bt\" (UID: \"4acae5fb-5b4e-4393-b00d-dfedc5dfef9a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-7s4bt"
Jul 13 19:06:19.133573 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:06:19.133517    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4acae5fb-5b4e-4393-b00d-dfedc5dfef9a-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-7s4bt\" (UID: \"4acae5fb-5b4e-4393-b00d-dfedc5dfef9a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-7s4bt"
Jul 13 19:06:19.133573 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:06:19.133543    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4acae5fb-5b4e-4393-b00d-dfedc5dfef9a-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-7s4bt\" (UID: \"4acae5fb-5b4e-4393-b00d-dfedc5dfef9a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-7s4bt"
Jul 13 19:06:19.133573 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:06:19.133561    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4acae5fb-5b4e-4393-b00d-dfedc5dfef9a-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-7s4bt\" (UID: \"4acae5fb-5b4e-4393-b00d-dfedc5dfef9a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-7s4bt"
Jul 13 19:06:19.133753 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:06:19.133627    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4acae5fb-5b4e-4393-b00d-dfedc5dfef9a-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-7s4bt\" (UID: \"4acae5fb-5b4e-4393-b00d-dfedc5dfef9a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-7s4bt"
Jul 13 19:06:19.133753 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:06:19.133681    2563 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9c5cd351-c8b3-43e9-b609-98c9caefe3de-extensions-socket-volume\") on node \"ip-10-0-135-38.ec2.internal\" DevicePath \"\""
Jul 13 19:06:19.133753 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:06:19.133698    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l8cbm\" (UniqueName: \"kubernetes.io/projected/9c5cd351-c8b3-43e9-b609-98c9caefe3de-kube-api-access-l8cbm\") on node \"ip-10-0-135-38.ec2.internal\" DevicePath \"\""
Jul 13 19:06:19.234240 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:06:19.234129    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4acae5fb-5b4e-4393-b00d-dfedc5dfef9a-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-7s4bt\" (UID: \"4acae5fb-5b4e-4393-b00d-dfedc5dfef9a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-7s4bt"
Jul 13 19:06:19.234240 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:06:19.234176    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4acae5fb-5b4e-4393-b00d-dfedc5dfef9a-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-7s4bt\" (UID: \"4acae5fb-5b4e-4393-b00d-dfedc5dfef9a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-7s4bt"
Jul 13 19:06:19.234240 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:06:19.234205    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4acae5fb-5b4e-4393-b00d-dfedc5dfef9a-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-7s4bt\" (UID: \"4acae5fb-5b4e-4393-b00d-dfedc5dfef9a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-7s4bt"
Jul 13 19:06:19.234240 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:06:19.234237    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4acae5fb-5b4e-4393-b00d-dfedc5dfef9a-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-7s4bt\" (UID: \"4acae5fb-5b4e-4393-b00d-dfedc5dfef9a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-7s4bt"
Jul 13 19:06:19.234586 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:06:19.234274    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dk44w\" (UniqueName: \"kubernetes.io/projected/4acae5fb-5b4e-4393-b00d-dfedc5dfef9a-kube-api-access-dk44w\") pod \"maas-default-gateway-openshift-default-56654dcf7-7s4bt\" (UID: \"4acae5fb-5b4e-4393-b00d-dfedc5dfef9a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-7s4bt"
Jul 13 19:06:19.234586 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:06:19.234305    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4acae5fb-5b4e-4393-b00d-dfedc5dfef9a-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-7s4bt\" (UID: \"4acae5fb-5b4e-4393-b00d-dfedc5dfef9a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-7s4bt"
Jul 13 19:06:19.234586 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:06:19.234336    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4acae5fb-5b4e-4393-b00d-dfedc5dfef9a-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-7s4bt\" (UID: \"4acae5fb-5b4e-4393-b00d-dfedc5dfef9a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-7s4bt"
Jul 13 19:06:19.234586 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:06:19.234360    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4acae5fb-5b4e-4393-b00d-dfedc5dfef9a-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-7s4bt\" (UID: \"4acae5fb-5b4e-4393-b00d-dfedc5dfef9a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-7s4bt"
Jul 13 19:06:19.234586 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:06:19.234392    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4acae5fb-5b4e-4393-b00d-dfedc5dfef9a-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-7s4bt\" (UID: \"4acae5fb-5b4e-4393-b00d-dfedc5dfef9a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-7s4bt"
Jul 13 19:06:19.234805 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:06:19.234655    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4acae5fb-5b4e-4393-b00d-dfedc5dfef9a-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-7s4bt\" (UID: \"4acae5fb-5b4e-4393-b00d-dfedc5dfef9a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-7s4bt"
Jul 13 19:06:19.234805 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:06:19.234797    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4acae5fb-5b4e-4393-b00d-dfedc5dfef9a-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-7s4bt\" (UID: \"4acae5fb-5b4e-4393-b00d-dfedc5dfef9a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-7s4bt"
Jul 13 19:06:19.234890 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:06:19.234875    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4acae5fb-5b4e-4393-b00d-dfedc5dfef9a-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-7s4bt\" (UID: \"4acae5fb-5b4e-4393-b00d-dfedc5dfef9a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-7s4bt"
Jul 13 19:06:19.234948 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:06:19.234919    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4acae5fb-5b4e-4393-b00d-dfedc5dfef9a-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-7s4bt\" (UID: \"4acae5fb-5b4e-4393-b00d-dfedc5dfef9a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-7s4bt"
Jul 13 19:06:19.235305 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:06:19.235285    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4acae5fb-5b4e-4393-b00d-dfedc5dfef9a-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-7s4bt\" (UID: \"4acae5fb-5b4e-4393-b00d-dfedc5dfef9a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-7s4bt"
Jul 13 19:06:19.236687 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:06:19.236663    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4acae5fb-5b4e-4393-b00d-dfedc5dfef9a-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-7s4bt\" (UID: \"4acae5fb-5b4e-4393-b00d-dfedc5dfef9a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-7s4bt"
Jul 13 19:06:19.236918 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:06:19.236896    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4acae5fb-5b4e-4393-b00d-dfedc5dfef9a-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-7s4bt\" (UID: \"4acae5fb-5b4e-4393-b00d-dfedc5dfef9a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-7s4bt"
Jul 13 19:06:19.244399 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:06:19.244368    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4acae5fb-5b4e-4393-b00d-dfedc5dfef9a-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-7s4bt\" (UID: \"4acae5fb-5b4e-4393-b00d-dfedc5dfef9a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-7s4bt"
Jul 13 19:06:19.244576 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:06:19.244532    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dk44w\" (UniqueName: \"kubernetes.io/projected/4acae5fb-5b4e-4393-b00d-dfedc5dfef9a-kube-api-access-dk44w\") pod \"maas-default-gateway-openshift-default-56654dcf7-7s4bt\" (UID: \"4acae5fb-5b4e-4393-b00d-dfedc5dfef9a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-7s4bt"
Jul 13 19:06:19.352222 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:06:19.352174    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-7s4bt"
Jul 13 19:06:19.501527 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:06:19.501500    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-7s4bt"]
Jul 13 19:06:19.504200 ip-10-0-135-38 kubenswrapper[2563]: W0713 19:06:19.504172    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4acae5fb_5b4e_4393_b00d_dfedc5dfef9a.slice/crio-fc3272febebbf6936b573b546dda81ab858794abc43f6653ba8bd7604ba12775 WatchSource:0}: Error finding container fc3272febebbf6936b573b546dda81ab858794abc43f6653ba8bd7604ba12775: Status 404 returned error can't find the container with id fc3272febebbf6936b573b546dda81ab858794abc43f6653ba8bd7604ba12775
Jul 13 19:06:19.709852 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:06:19.709810    2563 generic.go:356] "Generic (PLEG): container finished" podID="9c5cd351-c8b3-43e9-b609-98c9caefe3de" containerID="65d7cc31255828ab04917887a706eb3703941878ec3022a16776654ca72dc10b" exitCode=0
Jul 13 19:06:19.709852 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:06:19.709854    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-2skzx"
Jul 13 19:06:19.710368 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:06:19.709901    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-2skzx" event={"ID":"9c5cd351-c8b3-43e9-b609-98c9caefe3de","Type":"ContainerDied","Data":"65d7cc31255828ab04917887a706eb3703941878ec3022a16776654ca72dc10b"}
Jul 13 19:06:19.710368 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:06:19.709959    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-2skzx" event={"ID":"9c5cd351-c8b3-43e9-b609-98c9caefe3de","Type":"ContainerDied","Data":"f3fb3fd686092cbedfcffd0d38aa463d50056d1ed9960496b145e76db5e26a56"}
Jul 13 19:06:19.710368 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:06:19.709993    2563 scope.go:117] "RemoveContainer" containerID="65d7cc31255828ab04917887a706eb3703941878ec3022a16776654ca72dc10b"
Jul 13 19:06:19.711379 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:06:19.711345    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-7s4bt" event={"ID":"4acae5fb-5b4e-4393-b00d-dfedc5dfef9a","Type":"ContainerStarted","Data":"fc3272febebbf6936b573b546dda81ab858794abc43f6653ba8bd7604ba12775"}
Jul 13 19:06:19.718937 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:06:19.718790    2563 scope.go:117] "RemoveContainer" containerID="65d7cc31255828ab04917887a706eb3703941878ec3022a16776654ca72dc10b"
Jul 13 19:06:19.719139 ip-10-0-135-38 kubenswrapper[2563]: E0713 19:06:19.719117    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"65d7cc31255828ab04917887a706eb3703941878ec3022a16776654ca72dc10b\": container with ID starting with 65d7cc31255828ab04917887a706eb3703941878ec3022a16776654ca72dc10b not found: ID does not exist" containerID="65d7cc31255828ab04917887a706eb3703941878ec3022a16776654ca72dc10b"
Jul 13 19:06:19.719200 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:06:19.719149    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"65d7cc31255828ab04917887a706eb3703941878ec3022a16776654ca72dc10b"} err="failed to get container status \"65d7cc31255828ab04917887a706eb3703941878ec3022a16776654ca72dc10b\": rpc error: code = NotFound desc = could not find container \"65d7cc31255828ab04917887a706eb3703941878ec3022a16776654ca72dc10b\": container with ID starting with 65d7cc31255828ab04917887a706eb3703941878ec3022a16776654ca72dc10b not found: ID does not exist"
Jul 13 19:06:19.732655 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:06:19.732619    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-2skzx"]
Jul 13 19:06:19.735493 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:06:19.735463    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-2skzx"]
Jul 13 19:06:20.757352 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:06:20.757309    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9c5cd351-c8b3-43e9-b609-98c9caefe3de" path="/var/lib/kubelet/pods/9c5cd351-c8b3-43e9-b609-98c9caefe3de/volumes"
Jul 13 19:06:22.039397 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:06:22.039356    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 13 19:06:22.039730 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:06:22.039456    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 13 19:06:22.039730 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:06:22.039498    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 13 19:06:22.729425 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:06:22.729367    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-7s4bt" event={"ID":"4acae5fb-5b4e-4393-b00d-dfedc5dfef9a","Type":"ContainerStarted","Data":"5ca510c08a15f17bfc0f4276ccc5146294abd744a5e6b5a4e636f2244b1e0044"}
Jul 13 19:06:22.749326 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:06:22.749256    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-7s4bt" podStartSLOduration=1.216470211 podStartE2EDuration="3.749236301s" totalImagesPullingTime="2.53276609s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 19:06:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 19:06:22.74848492 +0000 UTC m=+470.523361276" watchObservedRunningTime="2026-07-13 19:06:22.749236301 +0000 UTC m=+470.524112661"
Jul 13 19:06:23.352558 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:06:23.352515    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-7s4bt"
Jul 13 19:06:23.357892 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:06:23.357858    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-7s4bt"
Jul 13 19:06:23.733879 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:06:23.733778    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-7s4bt"
Jul 13 19:06:23.734989 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:06:23.734965    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-7s4bt"
Jul 13 19:06:38.464881 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:06:38.464848    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-fw6lp"]
Jul 13 19:06:38.688397 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:06:38.688346    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-fw6lp"]
Jul 13 19:06:38.688614 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:06:38.688490    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-fw6lp"
Jul 13 19:06:38.688614 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:06:38.688494    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-fw6lp"]
Jul 13 19:06:38.691143 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:06:38.691111    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 13 19:06:38.815102 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:06:38.814965    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h486w\" (UniqueName: \"kubernetes.io/projected/45f9ddac-bd72-4379-8e08-9b02708a3691-kube-api-access-h486w\") pod \"limitador-limitador-64c94fd64f-fw6lp\" (UID: \"45f9ddac-bd72-4379-8e08-9b02708a3691\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-fw6lp"
Jul 13 19:06:38.815269 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:06:38.815117    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/45f9ddac-bd72-4379-8e08-9b02708a3691-config-file\") pod \"limitador-limitador-64c94fd64f-fw6lp\" (UID: \"45f9ddac-bd72-4379-8e08-9b02708a3691\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-fw6lp"
Jul 13 19:06:38.916308 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:06:38.916267    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h486w\" (UniqueName: \"kubernetes.io/projected/45f9ddac-bd72-4379-8e08-9b02708a3691-kube-api-access-h486w\") pod \"limitador-limitador-64c94fd64f-fw6lp\" (UID: \"45f9ddac-bd72-4379-8e08-9b02708a3691\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-fw6lp"
Jul 13 19:06:38.916542 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:06:38.916386    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/45f9ddac-bd72-4379-8e08-9b02708a3691-config-file\") pod \"limitador-limitador-64c94fd64f-fw6lp\" (UID: \"45f9ddac-bd72-4379-8e08-9b02708a3691\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-fw6lp"
Jul 13 19:06:38.917112 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:06:38.917091    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/45f9ddac-bd72-4379-8e08-9b02708a3691-config-file\") pod \"limitador-limitador-64c94fd64f-fw6lp\" (UID: \"45f9ddac-bd72-4379-8e08-9b02708a3691\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-fw6lp"
Jul 13 19:06:38.925632 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:06:38.925606    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h486w\" (UniqueName: \"kubernetes.io/projected/45f9ddac-bd72-4379-8e08-9b02708a3691-kube-api-access-h486w\") pod \"limitador-limitador-64c94fd64f-fw6lp\" (UID: \"45f9ddac-bd72-4379-8e08-9b02708a3691\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-fw6lp"
Jul 13 19:06:39.001628 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:06:39.001576    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-fw6lp"
Jul 13 19:06:39.160158 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:06:39.160131    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-fw6lp"]
Jul 13 19:06:39.162408 ip-10-0-135-38 kubenswrapper[2563]: W0713 19:06:39.162379    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod45f9ddac_bd72_4379_8e08_9b02708a3691.slice/crio-6c32dadf64f1c4ee1317f25c29e38d893fbb0141595e12964e69f27abf11698f WatchSource:0}: Error finding container 6c32dadf64f1c4ee1317f25c29e38d893fbb0141595e12964e69f27abf11698f: Status 404 returned error can't find the container with id 6c32dadf64f1c4ee1317f25c29e38d893fbb0141595e12964e69f27abf11698f
Jul 13 19:06:39.418075 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:06:39.417969    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-l2245"]
Jul 13 19:06:39.421180 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:06:39.421152    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-l2245"
Jul 13 19:06:39.425866 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:06:39.425843    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-hjsjl\""
Jul 13 19:06:39.436533 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:06:39.436496    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-l2245"]
Jul 13 19:06:39.520418 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:06:39.520381    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rfxk9\" (UniqueName: \"kubernetes.io/projected/b42e7d17-e344-4f50-b447-7cf5935772b9-kube-api-access-rfxk9\") pod \"authorino-58cd955675-l2245\" (UID: \"b42e7d17-e344-4f50-b447-7cf5935772b9\") " pod="kuadrant-system/authorino-58cd955675-l2245"
Jul 13 19:06:39.621339 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:06:39.621300    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rfxk9\" (UniqueName: \"kubernetes.io/projected/b42e7d17-e344-4f50-b447-7cf5935772b9-kube-api-access-rfxk9\") pod \"authorino-58cd955675-l2245\" (UID: \"b42e7d17-e344-4f50-b447-7cf5935772b9\") " pod="kuadrant-system/authorino-58cd955675-l2245"
Jul 13 19:06:39.635698 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:06:39.635658    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rfxk9\" (UniqueName: \"kubernetes.io/projected/b42e7d17-e344-4f50-b447-7cf5935772b9-kube-api-access-rfxk9\") pod \"authorino-58cd955675-l2245\" (UID: \"b42e7d17-e344-4f50-b447-7cf5935772b9\") " pod="kuadrant-system/authorino-58cd955675-l2245"
Jul 13 19:06:39.731002 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:06:39.730860    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-l2245"
Jul 13 19:06:39.801427 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:06:39.801386    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-j2zmz"]
Jul 13 19:06:39.803916 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:06:39.803888    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-j2zmz"
Jul 13 19:06:39.813042 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:06:39.812990    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-fw6lp" event={"ID":"45f9ddac-bd72-4379-8e08-9b02708a3691","Type":"ContainerStarted","Data":"6c32dadf64f1c4ee1317f25c29e38d893fbb0141595e12964e69f27abf11698f"}
Jul 13 19:06:39.817387 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:06:39.817341    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-j2zmz"]
Jul 13 19:06:39.896945 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:06:39.896905    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-l2245"]
Jul 13 19:06:39.901641 ip-10-0-135-38 kubenswrapper[2563]: W0713 19:06:39.901592    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb42e7d17_e344_4f50_b447_7cf5935772b9.slice/crio-3e754173010519d75e6454a447dd1186d83c1123038413405da8ea7f6f68e1fd WatchSource:0}: Error finding container 3e754173010519d75e6454a447dd1186d83c1123038413405da8ea7f6f68e1fd: Status 404 returned error can't find the container with id 3e754173010519d75e6454a447dd1186d83c1123038413405da8ea7f6f68e1fd
Jul 13 19:06:39.923702 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:06:39.923554    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gtpgf\" (UniqueName: \"kubernetes.io/projected/36ab0d58-13e4-4db3-86a7-18b10e490673-kube-api-access-gtpgf\") pod \"authorino-75d556bd77-j2zmz\" (UID: \"36ab0d58-13e4-4db3-86a7-18b10e490673\") " pod="kuadrant-system/authorino-75d556bd77-j2zmz"
Jul 13 19:06:40.024614 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:06:40.024489    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gtpgf\" (UniqueName: \"kubernetes.io/projected/36ab0d58-13e4-4db3-86a7-18b10e490673-kube-api-access-gtpgf\") pod \"authorino-75d556bd77-j2zmz\" (UID: \"36ab0d58-13e4-4db3-86a7-18b10e490673\") " pod="kuadrant-system/authorino-75d556bd77-j2zmz"
Jul 13 19:06:40.041329 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:06:40.041277    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gtpgf\" (UniqueName: \"kubernetes.io/projected/36ab0d58-13e4-4db3-86a7-18b10e490673-kube-api-access-gtpgf\") pod \"authorino-75d556bd77-j2zmz\" (UID: \"36ab0d58-13e4-4db3-86a7-18b10e490673\") " pod="kuadrant-system/authorino-75d556bd77-j2zmz"
Jul 13 19:06:40.115758 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:06:40.115719    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-j2zmz"
Jul 13 19:06:40.322906 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:06:40.322821    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-j2zmz"]
Jul 13 19:06:40.326555 ip-10-0-135-38 kubenswrapper[2563]: W0713 19:06:40.326519    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod36ab0d58_13e4_4db3_86a7_18b10e490673.slice/crio-024168bb672513c49705ccabd57f8dcc2d9f2cbc7f16fa1a88bbc750f6497b09 WatchSource:0}: Error finding container 024168bb672513c49705ccabd57f8dcc2d9f2cbc7f16fa1a88bbc750f6497b09: Status 404 returned error can't find the container with id 024168bb672513c49705ccabd57f8dcc2d9f2cbc7f16fa1a88bbc750f6497b09
Jul 13 19:06:40.823763 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:06:40.823720    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-l2245" event={"ID":"b42e7d17-e344-4f50-b447-7cf5935772b9","Type":"ContainerStarted","Data":"3e754173010519d75e6454a447dd1186d83c1123038413405da8ea7f6f68e1fd"}
Jul 13 19:06:40.826500 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:06:40.826460    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-j2zmz" event={"ID":"36ab0d58-13e4-4db3-86a7-18b10e490673","Type":"ContainerStarted","Data":"024168bb672513c49705ccabd57f8dcc2d9f2cbc7f16fa1a88bbc750f6497b09"}
Jul 13 19:06:44.850494 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:06:44.850448    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-fw6lp" event={"ID":"45f9ddac-bd72-4379-8e08-9b02708a3691","Type":"ContainerStarted","Data":"3130bce0ade0ac957dacb360f89d4bb84ead977a19150e4b567c6b7731195df0"}
Jul 13 19:06:44.851005 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:06:44.850573    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-fw6lp"
Jul 13 19:06:44.852162 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:06:44.852138    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-l2245" event={"ID":"b42e7d17-e344-4f50-b447-7cf5935772b9","Type":"ContainerStarted","Data":"20285a71256bea35dfe27796a23f5de13c32fedcc7b1d296e97a1ac7330748fc"}
Jul 13 19:06:44.853467 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:06:44.853446    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-j2zmz" event={"ID":"36ab0d58-13e4-4db3-86a7-18b10e490673","Type":"ContainerStarted","Data":"c2b570a1d9e7ab54145c688be8abe675c0cdabfee33c49d73532f9c5faf3edfa"}
Jul 13 19:06:44.880429 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:06:44.880364    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-fw6lp" podStartSLOduration=1.9623024230000001 podStartE2EDuration="6.880346071s" totalImagesPullingTime="4.918043648s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 19:06:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 19:06:44.879191779 +0000 UTC m=+492.654068135" watchObservedRunningTime="2026-07-13 19:06:44.880346071 +0000 UTC m=+492.655222426"
Jul 13 19:06:44.919746 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:06:44.919689    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-j2zmz" podStartSLOduration=2.081918517 podStartE2EDuration="5.91967344s" totalImagesPullingTime="3.837754923s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 19:06:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 19:06:44.918741957 +0000 UTC m=+492.693618314" watchObservedRunningTime="2026-07-13 19:06:44.91967344 +0000 UTC m=+492.694549879"
Jul 13 19:06:44.960535 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:06:44.960476    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-l2245" podStartSLOduration=1.712859124 podStartE2EDuration="5.96045741s" totalImagesPullingTime="4.247598286s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 19:06:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 19:06:44.959465692 +0000 UTC m=+492.734342049" watchObservedRunningTime="2026-07-13 19:06:44.96045741 +0000 UTC m=+492.735333766"
Jul 13 19:06:45.003040 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:06:45.002986    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-l2245"]
Jul 13 19:06:46.863329 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:06:46.863277    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-l2245" podUID="b42e7d17-e344-4f50-b447-7cf5935772b9" containerName="authorino" containerID="cri-o://20285a71256bea35dfe27796a23f5de13c32fedcc7b1d296e97a1ac7330748fc" gracePeriod=30
Jul 13 19:06:47.119468 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:06:47.119394    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-l2245"
Jul 13 19:06:47.295975 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:06:47.295936    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rfxk9\" (UniqueName: \"kubernetes.io/projected/b42e7d17-e344-4f50-b447-7cf5935772b9-kube-api-access-rfxk9\") pod \"b42e7d17-e344-4f50-b447-7cf5935772b9\" (UID: \"b42e7d17-e344-4f50-b447-7cf5935772b9\") "
Jul 13 19:06:47.298284 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:06:47.298242    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b42e7d17-e344-4f50-b447-7cf5935772b9-kube-api-access-rfxk9" (OuterVolumeSpecName: "kube-api-access-rfxk9") pod "b42e7d17-e344-4f50-b447-7cf5935772b9" (UID: "b42e7d17-e344-4f50-b447-7cf5935772b9"). InnerVolumeSpecName "kube-api-access-rfxk9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 19:06:47.397078 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:06:47.396950    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rfxk9\" (UniqueName: \"kubernetes.io/projected/b42e7d17-e344-4f50-b447-7cf5935772b9-kube-api-access-rfxk9\") on node \"ip-10-0-135-38.ec2.internal\" DevicePath \"\""
Jul 13 19:06:47.868861 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:06:47.868827    2563 generic.go:356] "Generic (PLEG): container finished" podID="b42e7d17-e344-4f50-b447-7cf5935772b9" containerID="20285a71256bea35dfe27796a23f5de13c32fedcc7b1d296e97a1ac7330748fc" exitCode=0
Jul 13 19:06:47.869275 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:06:47.868874    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-l2245"
Jul 13 19:06:47.869275 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:06:47.868910    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-l2245" event={"ID":"b42e7d17-e344-4f50-b447-7cf5935772b9","Type":"ContainerDied","Data":"20285a71256bea35dfe27796a23f5de13c32fedcc7b1d296e97a1ac7330748fc"}
Jul 13 19:06:47.869275 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:06:47.868960    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-l2245" event={"ID":"b42e7d17-e344-4f50-b447-7cf5935772b9","Type":"ContainerDied","Data":"3e754173010519d75e6454a447dd1186d83c1123038413405da8ea7f6f68e1fd"}
Jul 13 19:06:47.869275 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:06:47.868982    2563 scope.go:117] "RemoveContainer" containerID="20285a71256bea35dfe27796a23f5de13c32fedcc7b1d296e97a1ac7330748fc"
Jul 13 19:06:47.878116 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:06:47.878093    2563 scope.go:117] "RemoveContainer" containerID="20285a71256bea35dfe27796a23f5de13c32fedcc7b1d296e97a1ac7330748fc"
Jul 13 19:06:47.878471 ip-10-0-135-38 kubenswrapper[2563]: E0713 19:06:47.878448    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"20285a71256bea35dfe27796a23f5de13c32fedcc7b1d296e97a1ac7330748fc\": container with ID starting with 20285a71256bea35dfe27796a23f5de13c32fedcc7b1d296e97a1ac7330748fc not found: ID does not exist" containerID="20285a71256bea35dfe27796a23f5de13c32fedcc7b1d296e97a1ac7330748fc"
Jul 13 19:06:47.878519 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:06:47.878482    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"20285a71256bea35dfe27796a23f5de13c32fedcc7b1d296e97a1ac7330748fc"} err="failed to get container status \"20285a71256bea35dfe27796a23f5de13c32fedcc7b1d296e97a1ac7330748fc\": rpc error: code = NotFound desc = could not find container \"20285a71256bea35dfe27796a23f5de13c32fedcc7b1d296e97a1ac7330748fc\": container with ID starting with 20285a71256bea35dfe27796a23f5de13c32fedcc7b1d296e97a1ac7330748fc not found: ID does not exist"
Jul 13 19:06:47.890109 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:06:47.890076    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-l2245"]
Jul 13 19:06:47.896694 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:06:47.896663    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-l2245"]
Jul 13 19:06:48.755117 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:06:48.755080    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b42e7d17-e344-4f50-b447-7cf5935772b9" path="/var/lib/kubelet/pods/b42e7d17-e344-4f50-b447-7cf5935772b9/volumes"
Jul 13 19:06:53.608412 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:06:53.608375    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-fw6lp"]
Jul 13 19:06:53.609007 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:06:53.608621    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-fw6lp" podUID="45f9ddac-bd72-4379-8e08-9b02708a3691" containerName="limitador" containerID="cri-o://3130bce0ade0ac957dacb360f89d4bb84ead977a19150e4b567c6b7731195df0" gracePeriod=30
Jul 13 19:06:53.609654 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:06:53.609610    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-fw6lp"
Jul 13 19:06:54.175325 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:06:54.175247    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-fw6lp"
Jul 13 19:06:54.259536 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:06:54.259487    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h486w\" (UniqueName: \"kubernetes.io/projected/45f9ddac-bd72-4379-8e08-9b02708a3691-kube-api-access-h486w\") pod \"45f9ddac-bd72-4379-8e08-9b02708a3691\" (UID: \"45f9ddac-bd72-4379-8e08-9b02708a3691\") "
Jul 13 19:06:54.259752 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:06:54.259561    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/45f9ddac-bd72-4379-8e08-9b02708a3691-config-file\") pod \"45f9ddac-bd72-4379-8e08-9b02708a3691\" (UID: \"45f9ddac-bd72-4379-8e08-9b02708a3691\") "
Jul 13 19:06:54.259939 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:06:54.259915    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/45f9ddac-bd72-4379-8e08-9b02708a3691-config-file" (OuterVolumeSpecName: "config-file") pod "45f9ddac-bd72-4379-8e08-9b02708a3691" (UID: "45f9ddac-bd72-4379-8e08-9b02708a3691"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 19:06:54.261661 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:06:54.261632    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/45f9ddac-bd72-4379-8e08-9b02708a3691-kube-api-access-h486w" (OuterVolumeSpecName: "kube-api-access-h486w") pod "45f9ddac-bd72-4379-8e08-9b02708a3691" (UID: "45f9ddac-bd72-4379-8e08-9b02708a3691"). InnerVolumeSpecName "kube-api-access-h486w". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 19:06:54.360530 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:06:54.360484    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h486w\" (UniqueName: \"kubernetes.io/projected/45f9ddac-bd72-4379-8e08-9b02708a3691-kube-api-access-h486w\") on node \"ip-10-0-135-38.ec2.internal\" DevicePath \"\""
Jul 13 19:06:54.360530 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:06:54.360520    2563 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/45f9ddac-bd72-4379-8e08-9b02708a3691-config-file\") on node \"ip-10-0-135-38.ec2.internal\" DevicePath \"\""
Jul 13 19:06:54.903611 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:06:54.903575    2563 generic.go:356] "Generic (PLEG): container finished" podID="45f9ddac-bd72-4379-8e08-9b02708a3691" containerID="3130bce0ade0ac957dacb360f89d4bb84ead977a19150e4b567c6b7731195df0" exitCode=0
Jul 13 19:06:54.904073 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:06:54.903627    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-fw6lp"
Jul 13 19:06:54.904073 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:06:54.903664    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-fw6lp" event={"ID":"45f9ddac-bd72-4379-8e08-9b02708a3691","Type":"ContainerDied","Data":"3130bce0ade0ac957dacb360f89d4bb84ead977a19150e4b567c6b7731195df0"}
Jul 13 19:06:54.904073 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:06:54.903730    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-fw6lp" event={"ID":"45f9ddac-bd72-4379-8e08-9b02708a3691","Type":"ContainerDied","Data":"6c32dadf64f1c4ee1317f25c29e38d893fbb0141595e12964e69f27abf11698f"}
Jul 13 19:06:54.904073 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:06:54.903759    2563 scope.go:117] "RemoveContainer" containerID="3130bce0ade0ac957dacb360f89d4bb84ead977a19150e4b567c6b7731195df0"
Jul 13 19:06:54.912961 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:06:54.912939    2563 scope.go:117] "RemoveContainer" containerID="3130bce0ade0ac957dacb360f89d4bb84ead977a19150e4b567c6b7731195df0"
Jul 13 19:06:54.913314 ip-10-0-135-38 kubenswrapper[2563]: E0713 19:06:54.913294    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3130bce0ade0ac957dacb360f89d4bb84ead977a19150e4b567c6b7731195df0\": container with ID starting with 3130bce0ade0ac957dacb360f89d4bb84ead977a19150e4b567c6b7731195df0 not found: ID does not exist" containerID="3130bce0ade0ac957dacb360f89d4bb84ead977a19150e4b567c6b7731195df0"
Jul 13 19:06:54.913400 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:06:54.913324    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3130bce0ade0ac957dacb360f89d4bb84ead977a19150e4b567c6b7731195df0"} err="failed to get container status \"3130bce0ade0ac957dacb360f89d4bb84ead977a19150e4b567c6b7731195df0\": rpc error: code = NotFound desc = could not find container \"3130bce0ade0ac957dacb360f89d4bb84ead977a19150e4b567c6b7731195df0\": container with ID starting with 3130bce0ade0ac957dacb360f89d4bb84ead977a19150e4b567c6b7731195df0 not found: ID does not exist"
Jul 13 19:06:54.923543 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:06:54.923500    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-fw6lp"]
Jul 13 19:06:54.925683 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:06:54.925653    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-fw6lp"]
Jul 13 19:06:55.824164 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:06:55.824126    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-rhpwb"]
Jul 13 19:06:55.824482 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:06:55.824469    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="45f9ddac-bd72-4379-8e08-9b02708a3691" containerName="limitador"
Jul 13 19:06:55.824541 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:06:55.824486    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="45f9ddac-bd72-4379-8e08-9b02708a3691" containerName="limitador"
Jul 13 19:06:55.824541 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:06:55.824504    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b42e7d17-e344-4f50-b447-7cf5935772b9" containerName="authorino"
Jul 13 19:06:55.824541 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:06:55.824510    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="b42e7d17-e344-4f50-b447-7cf5935772b9" containerName="authorino"
Jul 13 19:06:55.824630 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:06:55.824573    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="b42e7d17-e344-4f50-b447-7cf5935772b9" containerName="authorino"
Jul 13 19:06:55.824630 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:06:55.824581    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="45f9ddac-bd72-4379-8e08-9b02708a3691" containerName="limitador"
Jul 13 19:06:55.826553 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:06:55.826537    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-rhpwb"
Jul 13 19:06:55.829276 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:06:55.829258    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\""
Jul 13 19:06:55.829651 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:06:55.829637    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-flhbc\""
Jul 13 19:06:55.830956 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:06:55.830943    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 13 19:06:55.833986 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:06:55.833968    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 13 19:06:55.842358 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:06:55.842332    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-rhpwb"]
Jul 13 19:06:55.872480 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:06:55.872444    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fth57\" (UniqueName: \"kubernetes.io/projected/58a2af2f-d24d-4944-a748-fbf2a6b1d796-kube-api-access-fth57\") pod \"postgres-69fb4594cf-rhpwb\" (UID: \"58a2af2f-d24d-4944-a748-fbf2a6b1d796\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-rhpwb"
Jul 13 19:06:55.872684 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:06:55.872491    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/58a2af2f-d24d-4944-a748-fbf2a6b1d796-data\") pod \"postgres-69fb4594cf-rhpwb\" (UID: \"58a2af2f-d24d-4944-a748-fbf2a6b1d796\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-rhpwb"
Jul 13 19:06:55.973648 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:06:55.973595    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fth57\" (UniqueName: \"kubernetes.io/projected/58a2af2f-d24d-4944-a748-fbf2a6b1d796-kube-api-access-fth57\") pod \"postgres-69fb4594cf-rhpwb\" (UID: \"58a2af2f-d24d-4944-a748-fbf2a6b1d796\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-rhpwb"
Jul 13 19:06:55.973648 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:06:55.973654    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/58a2af2f-d24d-4944-a748-fbf2a6b1d796-data\") pod \"postgres-69fb4594cf-rhpwb\" (UID: \"58a2af2f-d24d-4944-a748-fbf2a6b1d796\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-rhpwb"
Jul 13 19:06:55.974138 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:06:55.974011    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/58a2af2f-d24d-4944-a748-fbf2a6b1d796-data\") pod \"postgres-69fb4594cf-rhpwb\" (UID: \"58a2af2f-d24d-4944-a748-fbf2a6b1d796\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-rhpwb"
Jul 13 19:06:55.983587 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:06:55.983558    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fth57\" (UniqueName: \"kubernetes.io/projected/58a2af2f-d24d-4944-a748-fbf2a6b1d796-kube-api-access-fth57\") pod \"postgres-69fb4594cf-rhpwb\" (UID: \"58a2af2f-d24d-4944-a748-fbf2a6b1d796\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-rhpwb"
Jul 13 19:06:56.137303 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:06:56.137264    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-rhpwb"
Jul 13 19:06:56.285014 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:06:56.284976    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-rhpwb"]
Jul 13 19:06:56.288847 ip-10-0-135-38 kubenswrapper[2563]: W0713 19:06:56.288813    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod58a2af2f_d24d_4944_a748_fbf2a6b1d796.slice/crio-56413a662096427af81a16282d3c7df19a878bc4c7bf148da411f545802f211e WatchSource:0}: Error finding container 56413a662096427af81a16282d3c7df19a878bc4c7bf148da411f545802f211e: Status 404 returned error can't find the container with id 56413a662096427af81a16282d3c7df19a878bc4c7bf148da411f545802f211e
Jul 13 19:06:56.756136 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:06:56.756099    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="45f9ddac-bd72-4379-8e08-9b02708a3691" path="/var/lib/kubelet/pods/45f9ddac-bd72-4379-8e08-9b02708a3691/volumes"
Jul 13 19:06:56.915863 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:06:56.915825    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-rhpwb" event={"ID":"58a2af2f-d24d-4944-a748-fbf2a6b1d796","Type":"ContainerStarted","Data":"56413a662096427af81a16282d3c7df19a878bc4c7bf148da411f545802f211e"}
Jul 13 19:07:01.945397 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:07:01.945355    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-rhpwb" event={"ID":"58a2af2f-d24d-4944-a748-fbf2a6b1d796","Type":"ContainerStarted","Data":"12b5a84ed63a4471a77782ad8a505b734957289798e02873ba8be249e8ed806a"}
Jul 13 19:07:01.945847 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:07:01.945427    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-rhpwb"
Jul 13 19:07:01.967311 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:07:01.967258    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-rhpwb" podStartSLOduration=2.103723564 podStartE2EDuration="6.967241105s" totalImagesPullingTime="4.863517541s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 19:06:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 19:07:01.964650824 +0000 UTC m=+509.739527181" watchObservedRunningTime="2026-07-13 19:07:01.967241105 +0000 UTC m=+509.742117461"
Jul 13 19:07:07.981569 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:07:07.981535    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-rhpwb"
Jul 13 19:07:08.580459 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:07:08.580421    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-8fbfj"]
Jul 13 19:07:08.584075 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:07:08.584055    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-8fbfj"
Jul 13 19:07:08.592912 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:07:08.592879    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-8fbfj"]
Jul 13 19:07:08.685874 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:07:08.685841    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c6nbw\" (UniqueName: \"kubernetes.io/projected/ec6ca865-c48a-4f69-9c44-dda8cf1b6ba8-kube-api-access-c6nbw\") pod \"authorino-5d4b67c446-8fbfj\" (UID: \"ec6ca865-c48a-4f69-9c44-dda8cf1b6ba8\") " pod="kuadrant-system/authorino-5d4b67c446-8fbfj"
Jul 13 19:07:08.787279 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:07:08.787244    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c6nbw\" (UniqueName: \"kubernetes.io/projected/ec6ca865-c48a-4f69-9c44-dda8cf1b6ba8-kube-api-access-c6nbw\") pod \"authorino-5d4b67c446-8fbfj\" (UID: \"ec6ca865-c48a-4f69-9c44-dda8cf1b6ba8\") " pod="kuadrant-system/authorino-5d4b67c446-8fbfj"
Jul 13 19:07:08.797006 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:07:08.796968    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c6nbw\" (UniqueName: \"kubernetes.io/projected/ec6ca865-c48a-4f69-9c44-dda8cf1b6ba8-kube-api-access-c6nbw\") pod \"authorino-5d4b67c446-8fbfj\" (UID: \"ec6ca865-c48a-4f69-9c44-dda8cf1b6ba8\") " pod="kuadrant-system/authorino-5d4b67c446-8fbfj"
Jul 13 19:07:08.832795 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:07:08.832700    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-8fbfj"]
Jul 13 19:07:08.832969 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:07:08.832957    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-8fbfj"
Jul 13 19:07:08.868181 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:07:08.868144    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-888776b49-vzswn"]
Jul 13 19:07:08.872427 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:07:08.872399    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-888776b49-vzswn"
Jul 13 19:07:08.880273 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:07:08.880231    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-888776b49-vzswn"]
Jul 13 19:07:08.987612 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:07:08.987578    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-8fbfj"]
Jul 13 19:07:08.989130 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:07:08.989102    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-llflr\" (UniqueName: \"kubernetes.io/projected/81558556-999a-4af0-a515-21677cbda400-kube-api-access-llflr\") pod \"authorino-888776b49-vzswn\" (UID: \"81558556-999a-4af0-a515-21677cbda400\") " pod="kuadrant-system/authorino-888776b49-vzswn"
Jul 13 19:07:08.990754 ip-10-0-135-38 kubenswrapper[2563]: W0713 19:07:08.990722    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podec6ca865_c48a_4f69_9c44_dda8cf1b6ba8.slice/crio-5080305d8c4cfd7f8eeebe968c9d5cf798e1d0178b3457e9301cb428e7858477 WatchSource:0}: Error finding container 5080305d8c4cfd7f8eeebe968c9d5cf798e1d0178b3457e9301cb428e7858477: Status 404 returned error can't find the container with id 5080305d8c4cfd7f8eeebe968c9d5cf798e1d0178b3457e9301cb428e7858477
Jul 13 19:07:09.090103 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:07:09.090071    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-llflr\" (UniqueName: \"kubernetes.io/projected/81558556-999a-4af0-a515-21677cbda400-kube-api-access-llflr\") pod \"authorino-888776b49-vzswn\" (UID: \"81558556-999a-4af0-a515-21677cbda400\") " pod="kuadrant-system/authorino-888776b49-vzswn"
Jul 13 19:07:09.126043 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:07:09.125977    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-llflr\" (UniqueName: \"kubernetes.io/projected/81558556-999a-4af0-a515-21677cbda400-kube-api-access-llflr\") pod \"authorino-888776b49-vzswn\" (UID: \"81558556-999a-4af0-a515-21677cbda400\") " pod="kuadrant-system/authorino-888776b49-vzswn"
Jul 13 19:07:09.165340 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:07:09.165300    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-888776b49-vzswn"]
Jul 13 19:07:09.165544 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:07:09.165533    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-888776b49-vzswn"
Jul 13 19:07:09.215296 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:07:09.215237    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-59d747569c-fqlwb"]
Jul 13 19:07:09.220166 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:07:09.220138    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59d747569c-fqlwb"
Jul 13 19:07:09.223058 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:07:09.223007    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Jul 13 19:07:09.254154 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:07:09.254115    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-59d747569c-fqlwb"]
Jul 13 19:07:09.292416 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:07:09.292377    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/a61b77fb-185c-438c-89ca-9a5f30b57395-tls-cert\") pod \"authorino-59d747569c-fqlwb\" (UID: \"a61b77fb-185c-438c-89ca-9a5f30b57395\") " pod="kuadrant-system/authorino-59d747569c-fqlwb"
Jul 13 19:07:09.292593 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:07:09.292455    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cgmn2\" (UniqueName: \"kubernetes.io/projected/a61b77fb-185c-438c-89ca-9a5f30b57395-kube-api-access-cgmn2\") pod \"authorino-59d747569c-fqlwb\" (UID: \"a61b77fb-185c-438c-89ca-9a5f30b57395\") " pod="kuadrant-system/authorino-59d747569c-fqlwb"
Jul 13 19:07:09.321175 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:07:09.321124    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-888776b49-vzswn"]
Jul 13 19:07:09.323659 ip-10-0-135-38 kubenswrapper[2563]: W0713 19:07:09.323626    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod81558556_999a_4af0_a515_21677cbda400.slice/crio-8bb88b9324a22814f161954bd2e9a504213863827515485229f02612e146a0b8 WatchSource:0}: Error finding container 8bb88b9324a22814f161954bd2e9a504213863827515485229f02612e146a0b8: Status 404 returned error can't find the container with id 8bb88b9324a22814f161954bd2e9a504213863827515485229f02612e146a0b8
Jul 13 19:07:09.393356 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:07:09.393244    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/a61b77fb-185c-438c-89ca-9a5f30b57395-tls-cert\") pod \"authorino-59d747569c-fqlwb\" (UID: \"a61b77fb-185c-438c-89ca-9a5f30b57395\") " pod="kuadrant-system/authorino-59d747569c-fqlwb"
Jul 13 19:07:09.393356 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:07:09.393306    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cgmn2\" (UniqueName: \"kubernetes.io/projected/a61b77fb-185c-438c-89ca-9a5f30b57395-kube-api-access-cgmn2\") pod \"authorino-59d747569c-fqlwb\" (UID: \"a61b77fb-185c-438c-89ca-9a5f30b57395\") " pod="kuadrant-system/authorino-59d747569c-fqlwb"
Jul 13 19:07:09.395792 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:07:09.395763    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/a61b77fb-185c-438c-89ca-9a5f30b57395-tls-cert\") pod \"authorino-59d747569c-fqlwb\" (UID: \"a61b77fb-185c-438c-89ca-9a5f30b57395\") " pod="kuadrant-system/authorino-59d747569c-fqlwb"
Jul 13 19:07:09.405760 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:07:09.405731    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cgmn2\" (UniqueName: \"kubernetes.io/projected/a61b77fb-185c-438c-89ca-9a5f30b57395-kube-api-access-cgmn2\") pod \"authorino-59d747569c-fqlwb\" (UID: \"a61b77fb-185c-438c-89ca-9a5f30b57395\") " pod="kuadrant-system/authorino-59d747569c-fqlwb"
Jul 13 19:07:09.533602 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:07:09.533566    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59d747569c-fqlwb"
Jul 13 19:07:09.686248 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:07:09.686219    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-59d747569c-fqlwb"]
Jul 13 19:07:09.696371 ip-10-0-135-38 kubenswrapper[2563]: W0713 19:07:09.696332    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda61b77fb_185c_438c_89ca_9a5f30b57395.slice/crio-45de1f4ce8970512d1d036646f7a7fd25448134ac8a6a2d48e8b756e9a67a9a7 WatchSource:0}: Error finding container 45de1f4ce8970512d1d036646f7a7fd25448134ac8a6a2d48e8b756e9a67a9a7: Status 404 returned error can't find the container with id 45de1f4ce8970512d1d036646f7a7fd25448134ac8a6a2d48e8b756e9a67a9a7
Jul 13 19:07:09.983959 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:07:09.983701    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-888776b49-vzswn" event={"ID":"81558556-999a-4af0-a515-21677cbda400","Type":"ContainerStarted","Data":"60b8f02a9f2426e84c9cfdd62369f147854f0ad6922e9999f9bf51f877e1a1ce"}
Jul 13 19:07:09.983959 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:07:09.983753    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-888776b49-vzswn" event={"ID":"81558556-999a-4af0-a515-21677cbda400","Type":"ContainerStarted","Data":"8bb88b9324a22814f161954bd2e9a504213863827515485229f02612e146a0b8"}
Jul 13 19:07:09.983959 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:07:09.983734    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-888776b49-vzswn" podUID="81558556-999a-4af0-a515-21677cbda400" containerName="authorino" containerID="cri-o://60b8f02a9f2426e84c9cfdd62369f147854f0ad6922e9999f9bf51f877e1a1ce" gracePeriod=30
Jul 13 19:07:09.985150 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:07:09.985111    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-59d747569c-fqlwb" event={"ID":"a61b77fb-185c-438c-89ca-9a5f30b57395","Type":"ContainerStarted","Data":"45de1f4ce8970512d1d036646f7a7fd25448134ac8a6a2d48e8b756e9a67a9a7"}
Jul 13 19:07:09.986390 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:07:09.986366    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-8fbfj" event={"ID":"ec6ca865-c48a-4f69-9c44-dda8cf1b6ba8","Type":"ContainerStarted","Data":"5080305d8c4cfd7f8eeebe968c9d5cf798e1d0178b3457e9301cb428e7858477"}
Jul 13 19:07:10.016612 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:07:10.016554    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-888776b49-vzswn" podStartSLOduration=1.675187443 podStartE2EDuration="2.016534086s" totalImagesPullingTime="341.346643ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 19:07:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 19:07:10.014475106 +0000 UTC m=+517.789351462" watchObservedRunningTime="2026-07-13 19:07:10.016534086 +0000 UTC m=+517.791410487"
Jul 13 19:07:10.245920 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:07:10.245854    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-888776b49-vzswn"
Jul 13 19:07:10.301625 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:07:10.301591    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-llflr\" (UniqueName: \"kubernetes.io/projected/81558556-999a-4af0-a515-21677cbda400-kube-api-access-llflr\") pod \"81558556-999a-4af0-a515-21677cbda400\" (UID: \"81558556-999a-4af0-a515-21677cbda400\") "
Jul 13 19:07:10.303817 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:07:10.303781    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/81558556-999a-4af0-a515-21677cbda400-kube-api-access-llflr" (OuterVolumeSpecName: "kube-api-access-llflr") pod "81558556-999a-4af0-a515-21677cbda400" (UID: "81558556-999a-4af0-a515-21677cbda400"). InnerVolumeSpecName "kube-api-access-llflr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 19:07:10.402627 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:07:10.402590    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-llflr\" (UniqueName: \"kubernetes.io/projected/81558556-999a-4af0-a515-21677cbda400-kube-api-access-llflr\") on node \"ip-10-0-135-38.ec2.internal\" DevicePath \"\""
Jul 13 19:07:10.992469 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:07:10.992428    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-8fbfj" event={"ID":"ec6ca865-c48a-4f69-9c44-dda8cf1b6ba8","Type":"ContainerStarted","Data":"029c165b27046cfd5464f568a7dc1a408d1b4bfe5519d691c130155fd0b2fff1"}
Jul 13 19:07:10.992708 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:07:10.992466    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-5d4b67c446-8fbfj" podUID="ec6ca865-c48a-4f69-9c44-dda8cf1b6ba8" containerName="authorino" containerID="cri-o://029c165b27046cfd5464f568a7dc1a408d1b4bfe5519d691c130155fd0b2fff1" gracePeriod=30
Jul 13 19:07:10.993877 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:07:10.993850    2563 generic.go:356] "Generic (PLEG): container finished" podID="81558556-999a-4af0-a515-21677cbda400" containerID="60b8f02a9f2426e84c9cfdd62369f147854f0ad6922e9999f9bf51f877e1a1ce" exitCode=0
Jul 13 19:07:10.993975 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:07:10.993901    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-888776b49-vzswn"
Jul 13 19:07:10.993975 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:07:10.993937    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-888776b49-vzswn" event={"ID":"81558556-999a-4af0-a515-21677cbda400","Type":"ContainerDied","Data":"60b8f02a9f2426e84c9cfdd62369f147854f0ad6922e9999f9bf51f877e1a1ce"}
Jul 13 19:07:10.994089 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:07:10.993978    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-888776b49-vzswn" event={"ID":"81558556-999a-4af0-a515-21677cbda400","Type":"ContainerDied","Data":"8bb88b9324a22814f161954bd2e9a504213863827515485229f02612e146a0b8"}
Jul 13 19:07:10.994089 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:07:10.994002    2563 scope.go:117] "RemoveContainer" containerID="60b8f02a9f2426e84c9cfdd62369f147854f0ad6922e9999f9bf51f877e1a1ce"
Jul 13 19:07:10.995845 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:07:10.995813    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-59d747569c-fqlwb" event={"ID":"a61b77fb-185c-438c-89ca-9a5f30b57395","Type":"ContainerStarted","Data":"8321a0173c09d93fd459ee4fffedadcb041657da2a2f7a14b9d58848d1082214"}
Jul 13 19:07:11.003312 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:07:11.003294    2563 scope.go:117] "RemoveContainer" containerID="60b8f02a9f2426e84c9cfdd62369f147854f0ad6922e9999f9bf51f877e1a1ce"
Jul 13 19:07:11.003659 ip-10-0-135-38 kubenswrapper[2563]: E0713 19:07:11.003638    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"60b8f02a9f2426e84c9cfdd62369f147854f0ad6922e9999f9bf51f877e1a1ce\": container with ID starting with 60b8f02a9f2426e84c9cfdd62369f147854f0ad6922e9999f9bf51f877e1a1ce not found: ID does not exist" containerID="60b8f02a9f2426e84c9cfdd62369f147854f0ad6922e9999f9bf51f877e1a1ce"
Jul 13 19:07:11.003705 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:07:11.003668    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"60b8f02a9f2426e84c9cfdd62369f147854f0ad6922e9999f9bf51f877e1a1ce"} err="failed to get container status \"60b8f02a9f2426e84c9cfdd62369f147854f0ad6922e9999f9bf51f877e1a1ce\": rpc error: code = NotFound desc = could not find container \"60b8f02a9f2426e84c9cfdd62369f147854f0ad6922e9999f9bf51f877e1a1ce\": container with ID starting with 60b8f02a9f2426e84c9cfdd62369f147854f0ad6922e9999f9bf51f877e1a1ce not found: ID does not exist"
Jul 13 19:07:11.021488 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:07:11.021431    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5d4b67c446-8fbfj" podStartSLOduration=1.723930027 podStartE2EDuration="3.021413982s" totalImagesPullingTime="1.297483955s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 19:07:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 19:07:11.02034137 +0000 UTC m=+518.795217725" watchObservedRunningTime="2026-07-13 19:07:11.021413982 +0000 UTC m=+518.796290339"
Jul 13 19:07:11.045694 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:07:11.045657    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-888776b49-vzswn"]
Jul 13 19:07:11.050300 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:07:11.050267    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-888776b49-vzswn"]
Jul 13 19:07:11.068641 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:07:11.068577    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-59d747569c-fqlwb" podStartSLOduration=1.435728636 podStartE2EDuration="2.068558294s" totalImagesPullingTime="632.829658ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 19:07:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 19:07:11.067904869 +0000 UTC m=+518.842781226" watchObservedRunningTime="2026-07-13 19:07:11.068558294 +0000 UTC m=+518.843434705"
Jul 13 19:07:11.118851 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:07:11.118803    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-j2zmz"]
Jul 13 19:07:11.119095 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:07:11.119061    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-j2zmz" podUID="36ab0d58-13e4-4db3-86a7-18b10e490673" containerName="authorino" containerID="cri-o://c2b570a1d9e7ab54145c688be8abe675c0cdabfee33c49d73532f9c5faf3edfa" gracePeriod=30
Jul 13 19:07:11.265674 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:07:11.265635    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-8fbfj"
Jul 13 19:07:11.312581 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:07:11.312548    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c6nbw\" (UniqueName: \"kubernetes.io/projected/ec6ca865-c48a-4f69-9c44-dda8cf1b6ba8-kube-api-access-c6nbw\") pod \"ec6ca865-c48a-4f69-9c44-dda8cf1b6ba8\" (UID: \"ec6ca865-c48a-4f69-9c44-dda8cf1b6ba8\") "
Jul 13 19:07:11.315773 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:07:11.315734    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ec6ca865-c48a-4f69-9c44-dda8cf1b6ba8-kube-api-access-c6nbw" (OuterVolumeSpecName: "kube-api-access-c6nbw") pod "ec6ca865-c48a-4f69-9c44-dda8cf1b6ba8" (UID: "ec6ca865-c48a-4f69-9c44-dda8cf1b6ba8"). InnerVolumeSpecName "kube-api-access-c6nbw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 19:07:11.369230 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:07:11.369198    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-j2zmz"
Jul 13 19:07:11.413934 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:07:11.413891    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gtpgf\" (UniqueName: \"kubernetes.io/projected/36ab0d58-13e4-4db3-86a7-18b10e490673-kube-api-access-gtpgf\") pod \"36ab0d58-13e4-4db3-86a7-18b10e490673\" (UID: \"36ab0d58-13e4-4db3-86a7-18b10e490673\") "
Jul 13 19:07:11.414255 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:07:11.414234    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c6nbw\" (UniqueName: \"kubernetes.io/projected/ec6ca865-c48a-4f69-9c44-dda8cf1b6ba8-kube-api-access-c6nbw\") on node \"ip-10-0-135-38.ec2.internal\" DevicePath \"\""
Jul 13 19:07:11.416454 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:07:11.416422    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/36ab0d58-13e4-4db3-86a7-18b10e490673-kube-api-access-gtpgf" (OuterVolumeSpecName: "kube-api-access-gtpgf") pod "36ab0d58-13e4-4db3-86a7-18b10e490673" (UID: "36ab0d58-13e4-4db3-86a7-18b10e490673"). InnerVolumeSpecName "kube-api-access-gtpgf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 19:07:11.515720 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:07:11.515621    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gtpgf\" (UniqueName: \"kubernetes.io/projected/36ab0d58-13e4-4db3-86a7-18b10e490673-kube-api-access-gtpgf\") on node \"ip-10-0-135-38.ec2.internal\" DevicePath \"\""
Jul 13 19:07:12.002524 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:07:12.002477    2563 generic.go:356] "Generic (PLEG): container finished" podID="36ab0d58-13e4-4db3-86a7-18b10e490673" containerID="c2b570a1d9e7ab54145c688be8abe675c0cdabfee33c49d73532f9c5faf3edfa" exitCode=0
Jul 13 19:07:12.002731 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:07:12.002555    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-j2zmz" event={"ID":"36ab0d58-13e4-4db3-86a7-18b10e490673","Type":"ContainerDied","Data":"c2b570a1d9e7ab54145c688be8abe675c0cdabfee33c49d73532f9c5faf3edfa"}
Jul 13 19:07:12.002731 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:07:12.002591    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-j2zmz" event={"ID":"36ab0d58-13e4-4db3-86a7-18b10e490673","Type":"ContainerDied","Data":"024168bb672513c49705ccabd57f8dcc2d9f2cbc7f16fa1a88bbc750f6497b09"}
Jul 13 19:07:12.002731 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:07:12.002608    2563 scope.go:117] "RemoveContainer" containerID="c2b570a1d9e7ab54145c688be8abe675c0cdabfee33c49d73532f9c5faf3edfa"
Jul 13 19:07:12.002731 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:07:12.002559    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-j2zmz"
Jul 13 19:07:12.004222 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:07:12.003851    2563 generic.go:356] "Generic (PLEG): container finished" podID="ec6ca865-c48a-4f69-9c44-dda8cf1b6ba8" containerID="029c165b27046cfd5464f568a7dc1a408d1b4bfe5519d691c130155fd0b2fff1" exitCode=0
Jul 13 19:07:12.004222 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:07:12.003933    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-8fbfj"
Jul 13 19:07:12.004222 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:07:12.003937    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-8fbfj" event={"ID":"ec6ca865-c48a-4f69-9c44-dda8cf1b6ba8","Type":"ContainerDied","Data":"029c165b27046cfd5464f568a7dc1a408d1b4bfe5519d691c130155fd0b2fff1"}
Jul 13 19:07:12.004222 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:07:12.003979    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-8fbfj" event={"ID":"ec6ca865-c48a-4f69-9c44-dda8cf1b6ba8","Type":"ContainerDied","Data":"5080305d8c4cfd7f8eeebe968c9d5cf798e1d0178b3457e9301cb428e7858477"}
Jul 13 19:07:12.012953 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:07:12.012816    2563 scope.go:117] "RemoveContainer" containerID="c2b570a1d9e7ab54145c688be8abe675c0cdabfee33c49d73532f9c5faf3edfa"
Jul 13 19:07:12.013237 ip-10-0-135-38 kubenswrapper[2563]: E0713 19:07:12.013209    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c2b570a1d9e7ab54145c688be8abe675c0cdabfee33c49d73532f9c5faf3edfa\": container with ID starting with c2b570a1d9e7ab54145c688be8abe675c0cdabfee33c49d73532f9c5faf3edfa not found: ID does not exist" containerID="c2b570a1d9e7ab54145c688be8abe675c0cdabfee33c49d73532f9c5faf3edfa"
Jul 13 19:07:12.013319 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:07:12.013251    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c2b570a1d9e7ab54145c688be8abe675c0cdabfee33c49d73532f9c5faf3edfa"} err="failed to get container status \"c2b570a1d9e7ab54145c688be8abe675c0cdabfee33c49d73532f9c5faf3edfa\": rpc error: code = NotFound desc = could not find container \"c2b570a1d9e7ab54145c688be8abe675c0cdabfee33c49d73532f9c5faf3edfa\": container with ID starting with c2b570a1d9e7ab54145c688be8abe675c0cdabfee33c49d73532f9c5faf3edfa not found: ID does not exist"
Jul 13 19:07:12.013319 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:07:12.013277    2563 scope.go:117] "RemoveContainer" containerID="029c165b27046cfd5464f568a7dc1a408d1b4bfe5519d691c130155fd0b2fff1"
Jul 13 19:07:12.022485 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:07:12.022463    2563 scope.go:117] "RemoveContainer" containerID="029c165b27046cfd5464f568a7dc1a408d1b4bfe5519d691c130155fd0b2fff1"
Jul 13 19:07:12.022785 ip-10-0-135-38 kubenswrapper[2563]: E0713 19:07:12.022753    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"029c165b27046cfd5464f568a7dc1a408d1b4bfe5519d691c130155fd0b2fff1\": container with ID starting with 029c165b27046cfd5464f568a7dc1a408d1b4bfe5519d691c130155fd0b2fff1 not found: ID does not exist" containerID="029c165b27046cfd5464f568a7dc1a408d1b4bfe5519d691c130155fd0b2fff1"
Jul 13 19:07:12.022826 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:07:12.022782    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"029c165b27046cfd5464f568a7dc1a408d1b4bfe5519d691c130155fd0b2fff1"} err="failed to get container status \"029c165b27046cfd5464f568a7dc1a408d1b4bfe5519d691c130155fd0b2fff1\": rpc error: code = NotFound desc = could not find container \"029c165b27046cfd5464f568a7dc1a408d1b4bfe5519d691c130155fd0b2fff1\": container with ID starting with 029c165b27046cfd5464f568a7dc1a408d1b4bfe5519d691c130155fd0b2fff1 not found: ID does not exist"
Jul 13 19:07:12.065116 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:07:12.065027    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-j2zmz"]
Jul 13 19:07:12.072844 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:07:12.072814    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-j2zmz"]
Jul 13 19:07:12.093708 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:07:12.093667    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-8fbfj"]
Jul 13 19:07:12.103718 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:07:12.103686    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-8fbfj"]
Jul 13 19:07:12.756246 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:07:12.756200    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="36ab0d58-13e4-4db3-86a7-18b10e490673" path="/var/lib/kubelet/pods/36ab0d58-13e4-4db3-86a7-18b10e490673/volumes"
Jul 13 19:07:12.756649 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:07:12.756629    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="81558556-999a-4af0-a515-21677cbda400" path="/var/lib/kubelet/pods/81558556-999a-4af0-a515-21677cbda400/volumes"
Jul 13 19:07:12.757004 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:07:12.756987    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ec6ca865-c48a-4f69-9c44-dda8cf1b6ba8" path="/var/lib/kubelet/pods/ec6ca865-c48a-4f69-9c44-dda8cf1b6ba8/volumes"
Jul 13 19:07:16.295315 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:07:16.295274    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-bc7d68687-zgl5p"]
Jul 13 19:07:16.295705 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:07:16.295606    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="81558556-999a-4af0-a515-21677cbda400" containerName="authorino"
Jul 13 19:07:16.295705 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:07:16.295620    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="81558556-999a-4af0-a515-21677cbda400" containerName="authorino"
Jul 13 19:07:16.295705 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:07:16.295637    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="36ab0d58-13e4-4db3-86a7-18b10e490673" containerName="authorino"
Jul 13 19:07:16.295705 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:07:16.295642    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="36ab0d58-13e4-4db3-86a7-18b10e490673" containerName="authorino"
Jul 13 19:07:16.295705 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:07:16.295654    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ec6ca865-c48a-4f69-9c44-dda8cf1b6ba8" containerName="authorino"
Jul 13 19:07:16.295705 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:07:16.295659    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="ec6ca865-c48a-4f69-9c44-dda8cf1b6ba8" containerName="authorino"
Jul 13 19:07:16.295910 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:07:16.295710    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="ec6ca865-c48a-4f69-9c44-dda8cf1b6ba8" containerName="authorino"
Jul 13 19:07:16.295910 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:07:16.295719    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="81558556-999a-4af0-a515-21677cbda400" containerName="authorino"
Jul 13 19:07:16.295910 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:07:16.295728    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="36ab0d58-13e4-4db3-86a7-18b10e490673" containerName="authorino"
Jul 13 19:07:16.351401 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:07:16.351359    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-bc7d68687-zgl5p"]
Jul 13 19:07:16.351401 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:07:16.351398    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-bc7d68687-zgl5p"
Jul 13 19:07:16.353941 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:07:16.353917    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 13 19:07:16.354737 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:07:16.354715    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 13 19:07:16.358012 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:07:16.357989    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-88m76\""
Jul 13 19:07:16.460945 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:07:16.460908    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/02869a16-ca70-4d6a-af63-34af5e484c05-webhook-cert\") pod \"maas-controller-bc7d68687-zgl5p\" (UID: \"02869a16-ca70-4d6a-af63-34af5e484c05\") " pod="opendatahub/maas-controller-bc7d68687-zgl5p"
Jul 13 19:07:16.461131 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:07:16.460959    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nctbm\" (UniqueName: \"kubernetes.io/projected/02869a16-ca70-4d6a-af63-34af5e484c05-kube-api-access-nctbm\") pod \"maas-controller-bc7d68687-zgl5p\" (UID: \"02869a16-ca70-4d6a-af63-34af5e484c05\") " pod="opendatahub/maas-controller-bc7d68687-zgl5p"
Jul 13 19:07:16.561947 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:07:16.561835    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/02869a16-ca70-4d6a-af63-34af5e484c05-webhook-cert\") pod \"maas-controller-bc7d68687-zgl5p\" (UID: \"02869a16-ca70-4d6a-af63-34af5e484c05\") " pod="opendatahub/maas-controller-bc7d68687-zgl5p"
Jul 13 19:07:16.561947 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:07:16.561895    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nctbm\" (UniqueName: \"kubernetes.io/projected/02869a16-ca70-4d6a-af63-34af5e484c05-kube-api-access-nctbm\") pod \"maas-controller-bc7d68687-zgl5p\" (UID: \"02869a16-ca70-4d6a-af63-34af5e484c05\") " pod="opendatahub/maas-controller-bc7d68687-zgl5p"
Jul 13 19:07:16.564523 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:07:16.564499    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/02869a16-ca70-4d6a-af63-34af5e484c05-webhook-cert\") pod \"maas-controller-bc7d68687-zgl5p\" (UID: \"02869a16-ca70-4d6a-af63-34af5e484c05\") " pod="opendatahub/maas-controller-bc7d68687-zgl5p"
Jul 13 19:07:16.571787 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:07:16.571752    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nctbm\" (UniqueName: \"kubernetes.io/projected/02869a16-ca70-4d6a-af63-34af5e484c05-kube-api-access-nctbm\") pod \"maas-controller-bc7d68687-zgl5p\" (UID: \"02869a16-ca70-4d6a-af63-34af5e484c05\") " pod="opendatahub/maas-controller-bc7d68687-zgl5p"
Jul 13 19:07:16.662192 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:07:16.662152    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-bc7d68687-zgl5p"
Jul 13 19:07:16.832474 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:07:16.832411    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-bc7d68687-zgl5p"]
Jul 13 19:07:16.834969 ip-10-0-135-38 kubenswrapper[2563]: W0713 19:07:16.834942    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod02869a16_ca70_4d6a_af63_34af5e484c05.slice/crio-80f0349981c0da9928b1f310d90fbd76168ad3771e46e649fcfd83bd4b5cc976 WatchSource:0}: Error finding container 80f0349981c0da9928b1f310d90fbd76168ad3771e46e649fcfd83bd4b5cc976: Status 404 returned error can't find the container with id 80f0349981c0da9928b1f310d90fbd76168ad3771e46e649fcfd83bd4b5cc976
Jul 13 19:07:17.030922 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:07:17.030883    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-bc7d68687-zgl5p" event={"ID":"02869a16-ca70-4d6a-af63-34af5e484c05","Type":"ContainerStarted","Data":"80f0349981c0da9928b1f310d90fbd76168ad3771e46e649fcfd83bd4b5cc976"}
Jul 13 19:07:20.051678 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:07:20.051626    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-bc7d68687-zgl5p" event={"ID":"02869a16-ca70-4d6a-af63-34af5e484c05","Type":"ContainerStarted","Data":"c4ea78d603e31ddb305b241e94b5cba99af8d4a6591aba6fe973de146e80cd3e"}
Jul 13 19:07:20.052181 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:07:20.051758    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-bc7d68687-zgl5p"
Jul 13 19:07:20.076125 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:07:20.076064    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-bc7d68687-zgl5p" podStartSLOduration=1.4134484409999999 podStartE2EDuration="4.076047154s" totalImagesPullingTime="2.662598713s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 19:07:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 19:07:20.075417475 +0000 UTC m=+527.850293831" watchObservedRunningTime="2026-07-13 19:07:20.076047154 +0000 UTC m=+527.850923510"
Jul 13 19:07:31.060391 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:07:31.060360    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-bc7d68687-zgl5p"
Jul 13 19:07:31.376739 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:07:31.376693    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-bc7d68687-zgl5p"]
Jul 13 19:07:31.377050 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:07:31.376983    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-bc7d68687-zgl5p" podUID="02869a16-ca70-4d6a-af63-34af5e484c05" containerName="manager" containerID="cri-o://c4ea78d603e31ddb305b241e94b5cba99af8d4a6591aba6fe973de146e80cd3e" gracePeriod=30
Jul 13 19:07:31.641821 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:07:31.641793    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-bc7d68687-zgl5p"
Jul 13 19:07:31.807003 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:07:31.806956    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/02869a16-ca70-4d6a-af63-34af5e484c05-webhook-cert\") pod \"02869a16-ca70-4d6a-af63-34af5e484c05\" (UID: \"02869a16-ca70-4d6a-af63-34af5e484c05\") "
Jul 13 19:07:31.807003 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:07:31.807001    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nctbm\" (UniqueName: \"kubernetes.io/projected/02869a16-ca70-4d6a-af63-34af5e484c05-kube-api-access-nctbm\") pod \"02869a16-ca70-4d6a-af63-34af5e484c05\" (UID: \"02869a16-ca70-4d6a-af63-34af5e484c05\") "
Jul 13 19:07:31.809334 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:07:31.809299    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/02869a16-ca70-4d6a-af63-34af5e484c05-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "02869a16-ca70-4d6a-af63-34af5e484c05" (UID: "02869a16-ca70-4d6a-af63-34af5e484c05"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 13 19:07:31.809457 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:07:31.809339    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/02869a16-ca70-4d6a-af63-34af5e484c05-kube-api-access-nctbm" (OuterVolumeSpecName: "kube-api-access-nctbm") pod "02869a16-ca70-4d6a-af63-34af5e484c05" (UID: "02869a16-ca70-4d6a-af63-34af5e484c05"). InnerVolumeSpecName "kube-api-access-nctbm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 19:07:31.908541 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:07:31.908432    2563 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/02869a16-ca70-4d6a-af63-34af5e484c05-webhook-cert\") on node \"ip-10-0-135-38.ec2.internal\" DevicePath \"\""
Jul 13 19:07:31.908541 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:07:31.908466    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nctbm\" (UniqueName: \"kubernetes.io/projected/02869a16-ca70-4d6a-af63-34af5e484c05-kube-api-access-nctbm\") on node \"ip-10-0-135-38.ec2.internal\" DevicePath \"\""
Jul 13 19:07:32.112392 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:07:32.112348    2563 generic.go:356] "Generic (PLEG): container finished" podID="02869a16-ca70-4d6a-af63-34af5e484c05" containerID="c4ea78d603e31ddb305b241e94b5cba99af8d4a6591aba6fe973de146e80cd3e" exitCode=0
Jul 13 19:07:32.112392 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:07:32.112391    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-bc7d68687-zgl5p"
Jul 13 19:07:32.112888 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:07:32.112416    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-bc7d68687-zgl5p" event={"ID":"02869a16-ca70-4d6a-af63-34af5e484c05","Type":"ContainerDied","Data":"c4ea78d603e31ddb305b241e94b5cba99af8d4a6591aba6fe973de146e80cd3e"}
Jul 13 19:07:32.112888 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:07:32.112465    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-bc7d68687-zgl5p" event={"ID":"02869a16-ca70-4d6a-af63-34af5e484c05","Type":"ContainerDied","Data":"80f0349981c0da9928b1f310d90fbd76168ad3771e46e649fcfd83bd4b5cc976"}
Jul 13 19:07:32.112888 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:07:32.112491    2563 scope.go:117] "RemoveContainer" containerID="c4ea78d603e31ddb305b241e94b5cba99af8d4a6591aba6fe973de146e80cd3e"
Jul 13 19:07:32.121555 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:07:32.121531    2563 scope.go:117] "RemoveContainer" containerID="c4ea78d603e31ddb305b241e94b5cba99af8d4a6591aba6fe973de146e80cd3e"
Jul 13 19:07:32.121875 ip-10-0-135-38 kubenswrapper[2563]: E0713 19:07:32.121856    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c4ea78d603e31ddb305b241e94b5cba99af8d4a6591aba6fe973de146e80cd3e\": container with ID starting with c4ea78d603e31ddb305b241e94b5cba99af8d4a6591aba6fe973de146e80cd3e not found: ID does not exist" containerID="c4ea78d603e31ddb305b241e94b5cba99af8d4a6591aba6fe973de146e80cd3e"
Jul 13 19:07:32.121932 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:07:32.121885    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c4ea78d603e31ddb305b241e94b5cba99af8d4a6591aba6fe973de146e80cd3e"} err="failed to get container status \"c4ea78d603e31ddb305b241e94b5cba99af8d4a6591aba6fe973de146e80cd3e\": rpc error: code = NotFound desc = could not find container \"c4ea78d603e31ddb305b241e94b5cba99af8d4a6591aba6fe973de146e80cd3e\": container with ID starting with c4ea78d603e31ddb305b241e94b5cba99af8d4a6591aba6fe973de146e80cd3e not found: ID does not exist"
Jul 13 19:07:32.133374 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:07:32.133334    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-bc7d68687-zgl5p"]
Jul 13 19:07:32.138143 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:07:32.138107    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-bc7d68687-zgl5p"]
Jul 13 19:07:32.756113 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:07:32.756074    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="02869a16-ca70-4d6a-af63-34af5e484c05" path="/var/lib/kubelet/pods/02869a16-ca70-4d6a-af63-34af5e484c05/volumes"
Jul 13 19:07:50.558378 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:07:50.558339    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-f9b8d9b9b-s67kb"]
Jul 13 19:07:50.558912 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:07:50.558736    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="02869a16-ca70-4d6a-af63-34af5e484c05" containerName="manager"
Jul 13 19:07:50.558912 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:07:50.558750    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="02869a16-ca70-4d6a-af63-34af5e484c05" containerName="manager"
Jul 13 19:07:50.558912 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:07:50.558816    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="02869a16-ca70-4d6a-af63-34af5e484c05" containerName="manager"
Jul 13 19:07:50.571284 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:07:50.571247    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-f9b8d9b9b-s67kb"
Jul 13 19:07:50.574616 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:07:50.574574    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-jdrkn\""
Jul 13 19:07:50.574616 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:07:50.574601    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Jul 13 19:07:50.575966 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:07:50.575937    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-f9b8d9b9b-s67kb"]
Jul 13 19:07:50.667954 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:07:50.667910    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e93f0003-680f-4782-bb09-f56e5153051d-plugins-config-volume\") pod \"payload-processing-f9b8d9b9b-s67kb\" (UID: \"e93f0003-680f-4782-bb09-f56e5153051d\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-s67kb"
Jul 13 19:07:50.668155 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:07:50.668031    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nrgtw\" (UniqueName: \"kubernetes.io/projected/e93f0003-680f-4782-bb09-f56e5153051d-kube-api-access-nrgtw\") pod \"payload-processing-f9b8d9b9b-s67kb\" (UID: \"e93f0003-680f-4782-bb09-f56e5153051d\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-s67kb"
Jul 13 19:07:50.769428 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:07:50.769382    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e93f0003-680f-4782-bb09-f56e5153051d-plugins-config-volume\") pod \"payload-processing-f9b8d9b9b-s67kb\" (UID: \"e93f0003-680f-4782-bb09-f56e5153051d\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-s67kb"
Jul 13 19:07:50.769627 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:07:50.769473    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nrgtw\" (UniqueName: \"kubernetes.io/projected/e93f0003-680f-4782-bb09-f56e5153051d-kube-api-access-nrgtw\") pod \"payload-processing-f9b8d9b9b-s67kb\" (UID: \"e93f0003-680f-4782-bb09-f56e5153051d\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-s67kb"
Jul 13 19:07:50.770148 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:07:50.770127    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e93f0003-680f-4782-bb09-f56e5153051d-plugins-config-volume\") pod \"payload-processing-f9b8d9b9b-s67kb\" (UID: \"e93f0003-680f-4782-bb09-f56e5153051d\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-s67kb"
Jul 13 19:07:50.780082 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:07:50.780048    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nrgtw\" (UniqueName: \"kubernetes.io/projected/e93f0003-680f-4782-bb09-f56e5153051d-kube-api-access-nrgtw\") pod \"payload-processing-f9b8d9b9b-s67kb\" (UID: \"e93f0003-680f-4782-bb09-f56e5153051d\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-s67kb"
Jul 13 19:07:50.884269 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:07:50.884227    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-f9b8d9b9b-s67kb"
Jul 13 19:07:51.036057 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:07:51.035993    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-f9b8d9b9b-s67kb"]
Jul 13 19:07:51.038818 ip-10-0-135-38 kubenswrapper[2563]: W0713 19:07:51.038762    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode93f0003_680f_4782_bb09_f56e5153051d.slice/crio-988ffa7c756097f48975aff9a017fa0ea2894a73993f2ed1d269244bc3b9aeaa WatchSource:0}: Error finding container 988ffa7c756097f48975aff9a017fa0ea2894a73993f2ed1d269244bc3b9aeaa: Status 404 returned error can't find the container with id 988ffa7c756097f48975aff9a017fa0ea2894a73993f2ed1d269244bc3b9aeaa
Jul 13 19:07:51.207449 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:07:51.207326    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-f9b8d9b9b-s67kb" event={"ID":"e93f0003-680f-4782-bb09-f56e5153051d","Type":"ContainerStarted","Data":"988ffa7c756097f48975aff9a017fa0ea2894a73993f2ed1d269244bc3b9aeaa"}
Jul 13 19:07:53.223037 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:07:53.222973    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-f9b8d9b9b-s67kb" event={"ID":"e93f0003-680f-4782-bb09-f56e5153051d","Type":"ContainerStarted","Data":"379276febdcc2f33605cf68770c8552248ba7884982eda711e81d612cb07b776"}
Jul 13 19:07:53.223456 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:07:53.223075    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-f9b8d9b9b-s67kb"
Jul 13 19:07:53.242847 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:07:53.242778    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-f9b8d9b9b-s67kb" podStartSLOduration=1.5230223889999999 podStartE2EDuration="3.242757577s" totalImagesPullingTime="1.719735188s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 19:07:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 19:07:53.24148189 +0000 UTC m=+561.016358245" watchObservedRunningTime="2026-07-13 19:07:53.242757577 +0000 UTC m=+561.017633934"
Jul 13 19:07:59.259170 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:07:59.259132    2563 generic.go:356] "Generic (PLEG): container finished" podID="4acae5fb-5b4e-4393-b00d-dfedc5dfef9a" containerID="5ca510c08a15f17bfc0f4276ccc5146294abd744a5e6b5a4e636f2244b1e0044" exitCode=0
Jul 13 19:07:59.259728 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:07:59.259211    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-7s4bt" event={"ID":"4acae5fb-5b4e-4393-b00d-dfedc5dfef9a","Type":"ContainerDied","Data":"5ca510c08a15f17bfc0f4276ccc5146294abd744a5e6b5a4e636f2244b1e0044"}
Jul 13 19:07:59.259799 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:07:59.259735    2563 scope.go:117] "RemoveContainer" containerID="5ca510c08a15f17bfc0f4276ccc5146294abd744a5e6b5a4e636f2244b1e0044"
Jul 13 19:07:59.260868 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:07:59.260840    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 13 19:07:59.260972 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:07:59.260910    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 13 19:07:59.260972 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:07:59.260944    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 13 19:08:00.266011 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:08:00.265958    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-7s4bt" event={"ID":"4acae5fb-5b4e-4393-b00d-dfedc5dfef9a","Type":"ContainerStarted","Data":"e5e1d66f1e150efdf4c7928d80997815470805a75fd91b308c4af277f20d30f7"}
Jul 13 19:08:00.352831 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:08:00.352793    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-7s4bt"
Jul 13 19:08:00.353126 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:08:00.353100    2563 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-7s4bt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.32:15021/healthz/ready\": dial tcp 10.133.0.32:15021: connect: connection refused" start-of-body=
Jul 13 19:08:00.353215 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:08:00.353163    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-7s4bt" podUID="4acae5fb-5b4e-4393-b00d-dfedc5dfef9a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.32:15021/healthz/ready\": dial tcp 10.133.0.32:15021: connect: connection refused"
Jul 13 19:08:01.353377 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:08:01.353336    2563 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-7s4bt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.32:15021/healthz/ready\": dial tcp 10.133.0.32:15021: connect: connection refused" start-of-body=
Jul 13 19:08:01.353779 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:08:01.353434    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-7s4bt" podUID="4acae5fb-5b4e-4393-b00d-dfedc5dfef9a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.32:15021/healthz/ready\": dial tcp 10.133.0.32:15021: connect: connection refused"
Jul 13 19:08:02.352648 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:08:02.352608    2563 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-7s4bt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.32:15021/healthz/ready\": dial tcp 10.133.0.32:15021: connect: connection refused" start-of-body=
Jul 13 19:08:02.352844 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:08:02.352674    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-7s4bt" podUID="4acae5fb-5b4e-4393-b00d-dfedc5dfef9a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.32:15021/healthz/ready\": dial tcp 10.133.0.32:15021: connect: connection refused"
Jul 13 19:08:03.352842 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:08:03.352798    2563 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-7s4bt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.32:15021/healthz/ready\": dial tcp 10.133.0.32:15021: connect: connection refused" start-of-body=
Jul 13 19:08:03.353281 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:08:03.352857    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-7s4bt" podUID="4acae5fb-5b4e-4393-b00d-dfedc5dfef9a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.32:15021/healthz/ready\": dial tcp 10.133.0.32:15021: connect: connection refused"
Jul 13 19:08:04.230862 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:08:04.230828    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-f9b8d9b9b-s67kb"
Jul 13 19:08:04.352917 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:08:04.352866    2563 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-7s4bt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.32:15021/healthz/ready\": dial tcp 10.133.0.32:15021: connect: connection refused" start-of-body=
Jul 13 19:08:04.353371 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:08:04.352943    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-7s4bt" podUID="4acae5fb-5b4e-4393-b00d-dfedc5dfef9a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.32:15021/healthz/ready\": dial tcp 10.133.0.32:15021: connect: connection refused"
Jul 13 19:08:05.357052 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:08:05.357002    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-7s4bt"
Jul 13 19:08:05.357470 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:08:05.357310    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-7s4bt"
Jul 13 19:08:05.358219 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:08:05.358191    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-7s4bt"
Jul 13 19:08:23.053030 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:08:23.052980    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-qxvr5"]
Jul 13 19:08:23.056231 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:08:23.056210    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-qxvr5"
Jul 13 19:08:23.059534 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:08:23.059507    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 13 19:08:23.059678 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:08:23.059554    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-j6mtd\""
Jul 13 19:08:23.059678 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:08:23.059600    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
Jul 13 19:08:23.059678 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:08:23.059554    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 13 19:08:23.065859 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:08:23.065831    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-qxvr5"]
Jul 13 19:08:23.097356 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:08:23.097308    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/440ab4c8-a1b2-4a51-94d3-d23e3ae75b17-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-qxvr5\" (UID: \"440ab4c8-a1b2-4a51-94d3-d23e3ae75b17\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-qxvr5"
Jul 13 19:08:23.097356 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:08:23.097361    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jp852\" (UniqueName: \"kubernetes.io/projected/440ab4c8-a1b2-4a51-94d3-d23e3ae75b17-kube-api-access-jp852\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-qxvr5\" (UID: \"440ab4c8-a1b2-4a51-94d3-d23e3ae75b17\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-qxvr5"
Jul 13 19:08:23.097602 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:08:23.097432    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/440ab4c8-a1b2-4a51-94d3-d23e3ae75b17-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-qxvr5\" (UID: \"440ab4c8-a1b2-4a51-94d3-d23e3ae75b17\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-qxvr5"
Jul 13 19:08:23.097602 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:08:23.097467    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/440ab4c8-a1b2-4a51-94d3-d23e3ae75b17-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-qxvr5\" (UID: \"440ab4c8-a1b2-4a51-94d3-d23e3ae75b17\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-qxvr5"
Jul 13 19:08:23.097602 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:08:23.097495    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/440ab4c8-a1b2-4a51-94d3-d23e3ae75b17-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-qxvr5\" (UID: \"440ab4c8-a1b2-4a51-94d3-d23e3ae75b17\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-qxvr5"
Jul 13 19:08:23.097731 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:08:23.097592    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/440ab4c8-a1b2-4a51-94d3-d23e3ae75b17-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-qxvr5\" (UID: \"440ab4c8-a1b2-4a51-94d3-d23e3ae75b17\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-qxvr5"
Jul 13 19:08:23.198159 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:08:23.198116    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/440ab4c8-a1b2-4a51-94d3-d23e3ae75b17-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-qxvr5\" (UID: \"440ab4c8-a1b2-4a51-94d3-d23e3ae75b17\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-qxvr5"
Jul 13 19:08:23.198379 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:08:23.198180    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/440ab4c8-a1b2-4a51-94d3-d23e3ae75b17-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-qxvr5\" (UID: \"440ab4c8-a1b2-4a51-94d3-d23e3ae75b17\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-qxvr5"
Jul 13 19:08:23.198379 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:08:23.198209    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/440ab4c8-a1b2-4a51-94d3-d23e3ae75b17-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-qxvr5\" (UID: \"440ab4c8-a1b2-4a51-94d3-d23e3ae75b17\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-qxvr5"
Jul 13 19:08:23.198379 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:08:23.198252    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jp852\" (UniqueName: \"kubernetes.io/projected/440ab4c8-a1b2-4a51-94d3-d23e3ae75b17-kube-api-access-jp852\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-qxvr5\" (UID: \"440ab4c8-a1b2-4a51-94d3-d23e3ae75b17\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-qxvr5"
Jul 13 19:08:23.198379 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:08:23.198298    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/440ab4c8-a1b2-4a51-94d3-d23e3ae75b17-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-qxvr5\" (UID: \"440ab4c8-a1b2-4a51-94d3-d23e3ae75b17\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-qxvr5"
Jul 13 19:08:23.198379 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:08:23.198341    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/440ab4c8-a1b2-4a51-94d3-d23e3ae75b17-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-qxvr5\" (UID: \"440ab4c8-a1b2-4a51-94d3-d23e3ae75b17\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-qxvr5"
Jul 13 19:08:23.198729 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:08:23.198703    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/440ab4c8-a1b2-4a51-94d3-d23e3ae75b17-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-qxvr5\" (UID: \"440ab4c8-a1b2-4a51-94d3-d23e3ae75b17\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-qxvr5"
Jul 13 19:08:23.198806 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:08:23.198734    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/440ab4c8-a1b2-4a51-94d3-d23e3ae75b17-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-qxvr5\" (UID: \"440ab4c8-a1b2-4a51-94d3-d23e3ae75b17\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-qxvr5"
Jul 13 19:08:23.198806 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:08:23.198762    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/440ab4c8-a1b2-4a51-94d3-d23e3ae75b17-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-qxvr5\" (UID: \"440ab4c8-a1b2-4a51-94d3-d23e3ae75b17\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-qxvr5"
Jul 13 19:08:23.200589 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:08:23.200565    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/440ab4c8-a1b2-4a51-94d3-d23e3ae75b17-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-qxvr5\" (UID: \"440ab4c8-a1b2-4a51-94d3-d23e3ae75b17\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-qxvr5"
Jul 13 19:08:23.200724 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:08:23.200705    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/440ab4c8-a1b2-4a51-94d3-d23e3ae75b17-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-qxvr5\" (UID: \"440ab4c8-a1b2-4a51-94d3-d23e3ae75b17\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-qxvr5"
Jul 13 19:08:23.207345 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:08:23.207319    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jp852\" (UniqueName: \"kubernetes.io/projected/440ab4c8-a1b2-4a51-94d3-d23e3ae75b17-kube-api-access-jp852\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-qxvr5\" (UID: \"440ab4c8-a1b2-4a51-94d3-d23e3ae75b17\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-qxvr5"
Jul 13 19:08:23.367441 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:08:23.367392    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-qxvr5"
Jul 13 19:08:23.515700 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:08:23.515669    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-qxvr5"]
Jul 13 19:08:23.518106 ip-10-0-135-38 kubenswrapper[2563]: W0713 19:08:23.518076    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod440ab4c8_a1b2_4a51_94d3_d23e3ae75b17.slice/crio-4176512430d9fd1db0c2abb3514838ef5fb1b2268d336639fd9ab53c2183680e WatchSource:0}: Error finding container 4176512430d9fd1db0c2abb3514838ef5fb1b2268d336639fd9ab53c2183680e: Status 404 returned error can't find the container with id 4176512430d9fd1db0c2abb3514838ef5fb1b2268d336639fd9ab53c2183680e
Jul 13 19:08:24.379160 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:08:24.379121    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-qxvr5" event={"ID":"440ab4c8-a1b2-4a51-94d3-d23e3ae75b17","Type":"ContainerStarted","Data":"4176512430d9fd1db0c2abb3514838ef5fb1b2268d336639fd9ab53c2183680e"}
Jul 13 19:08:25.386124 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:08:25.386069    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-qxvr5" event={"ID":"440ab4c8-a1b2-4a51-94d3-d23e3ae75b17","Type":"ContainerStarted","Data":"3e1540ac74a2faf11bacaa88764de5e3c973f9fd9a089c3a64413c8393027843"}
Jul 13 19:08:25.403913 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:08:25.403853    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-qxvr5" podStartSLOduration=1.112054541 podStartE2EDuration="2.403834103s" totalImagesPullingTime="1.291779562s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 19:08:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 19:08:25.403202982 +0000 UTC m=+593.178079366" watchObservedRunningTime="2026-07-13 19:08:25.403834103 +0000 UTC m=+593.178710459"
Jul 13 19:08:31.140325 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:08:31.140285    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-cbc2b"]
Jul 13 19:08:31.144139 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:08:31.144113    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-cbc2b"
Jul 13 19:08:31.147334 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:08:31.147308    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\""
Jul 13 19:08:31.159435 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:08:31.157052    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-cbc2b"]
Jul 13 19:08:31.271588 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:08:31.271545    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0031a856-9806-4736-b465-077eace7191d-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-cbc2b\" (UID: \"0031a856-9806-4736-b465-077eace7191d\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-cbc2b"
Jul 13 19:08:31.271588 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:08:31.271595    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0031a856-9806-4736-b465-077eace7191d-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-cbc2b\" (UID: \"0031a856-9806-4736-b465-077eace7191d\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-cbc2b"
Jul 13 19:08:31.271825 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:08:31.271649    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jj8bl\" (UniqueName: \"kubernetes.io/projected/0031a856-9806-4736-b465-077eace7191d-kube-api-access-jj8bl\") pod \"e2e-distinct-simulated-kserve-59975d69f9-cbc2b\" (UID: \"0031a856-9806-4736-b465-077eace7191d\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-cbc2b"
Jul 13 19:08:31.271825 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:08:31.271687    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0031a856-9806-4736-b465-077eace7191d-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-cbc2b\" (UID: \"0031a856-9806-4736-b465-077eace7191d\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-cbc2b"
Jul 13 19:08:31.271825 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:08:31.271760    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0031a856-9806-4736-b465-077eace7191d-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-cbc2b\" (UID: \"0031a856-9806-4736-b465-077eace7191d\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-cbc2b"
Jul 13 19:08:31.271825 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:08:31.271804    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0031a856-9806-4736-b465-077eace7191d-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-cbc2b\" (UID: \"0031a856-9806-4736-b465-077eace7191d\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-cbc2b"
Jul 13 19:08:31.372377 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:08:31.372332    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jj8bl\" (UniqueName: \"kubernetes.io/projected/0031a856-9806-4736-b465-077eace7191d-kube-api-access-jj8bl\") pod \"e2e-distinct-simulated-kserve-59975d69f9-cbc2b\" (UID: \"0031a856-9806-4736-b465-077eace7191d\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-cbc2b"
Jul 13 19:08:31.372377 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:08:31.372388    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0031a856-9806-4736-b465-077eace7191d-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-cbc2b\" (UID: \"0031a856-9806-4736-b465-077eace7191d\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-cbc2b"
Jul 13 19:08:31.372658 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:08:31.372567    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0031a856-9806-4736-b465-077eace7191d-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-cbc2b\" (UID: \"0031a856-9806-4736-b465-077eace7191d\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-cbc2b"
Jul 13 19:08:31.372658 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:08:31.372618    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0031a856-9806-4736-b465-077eace7191d-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-cbc2b\" (UID: \"0031a856-9806-4736-b465-077eace7191d\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-cbc2b"
Jul 13 19:08:31.372773 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:08:31.372686    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0031a856-9806-4736-b465-077eace7191d-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-cbc2b\" (UID: \"0031a856-9806-4736-b465-077eace7191d\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-cbc2b"
Jul 13 19:08:31.372773 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:08:31.372726    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0031a856-9806-4736-b465-077eace7191d-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-cbc2b\" (UID: \"0031a856-9806-4736-b465-077eace7191d\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-cbc2b"
Jul 13 19:08:31.373077 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:08:31.373052    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0031a856-9806-4736-b465-077eace7191d-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-cbc2b\" (UID: \"0031a856-9806-4736-b465-077eace7191d\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-cbc2b"
Jul 13 19:08:31.373169 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:08:31.373117    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0031a856-9806-4736-b465-077eace7191d-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-cbc2b\" (UID: \"0031a856-9806-4736-b465-077eace7191d\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-cbc2b"
Jul 13 19:08:31.373169 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:08:31.373123    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0031a856-9806-4736-b465-077eace7191d-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-cbc2b\" (UID: \"0031a856-9806-4736-b465-077eace7191d\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-cbc2b"
Jul 13 19:08:31.374841 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:08:31.374803    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0031a856-9806-4736-b465-077eace7191d-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-cbc2b\" (UID: \"0031a856-9806-4736-b465-077eace7191d\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-cbc2b"
Jul 13 19:08:31.374976 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:08:31.374959    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0031a856-9806-4736-b465-077eace7191d-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-cbc2b\" (UID: \"0031a856-9806-4736-b465-077eace7191d\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-cbc2b"
Jul 13 19:08:31.381214 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:08:31.381180    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jj8bl\" (UniqueName: \"kubernetes.io/projected/0031a856-9806-4736-b465-077eace7191d-kube-api-access-jj8bl\") pod \"e2e-distinct-simulated-kserve-59975d69f9-cbc2b\" (UID: \"0031a856-9806-4736-b465-077eace7191d\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-cbc2b"
Jul 13 19:08:31.457629 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:08:31.457520    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-cbc2b"
Jul 13 19:08:31.602143 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:08:31.602108    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-cbc2b"]
Jul 13 19:08:31.605003 ip-10-0-135-38 kubenswrapper[2563]: W0713 19:08:31.604970    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0031a856_9806_4736_b465_077eace7191d.slice/crio-24675f0a9b3d71edb7f67409a1dc2aaca8eb17283bd5255310c35727d74cce93 WatchSource:0}: Error finding container 24675f0a9b3d71edb7f67409a1dc2aaca8eb17283bd5255310c35727d74cce93: Status 404 returned error can't find the container with id 24675f0a9b3d71edb7f67409a1dc2aaca8eb17283bd5255310c35727d74cce93
Jul 13 19:08:32.424207 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:08:32.424167    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-cbc2b" event={"ID":"0031a856-9806-4736-b465-077eace7191d","Type":"ContainerStarted","Data":"e84d00d3f8067310bece26019b493f3376722927f25ae3b2d55374880b120e29"}
Jul 13 19:08:32.424672 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:08:32.424228    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-cbc2b" event={"ID":"0031a856-9806-4736-b465-077eace7191d","Type":"ContainerStarted","Data":"24675f0a9b3d71edb7f67409a1dc2aaca8eb17283bd5255310c35727d74cce93"}
Jul 13 19:08:32.450188 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:08:32.450131    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-cbc2b" podStartSLOduration=1.182729097 podStartE2EDuration="1.450109999s" totalImagesPullingTime="267.380902ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 19:08:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 19:08:32.448489015 +0000 UTC m=+600.223365372" watchObservedRunningTime="2026-07-13 19:08:32.450109999 +0000 UTC m=+600.224986355"
Jul 13 19:08:32.645483 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:08:32.645447    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hwqhc_7ae2e1d0-8a16-4821-9cb7-353862cfbec8/ovn-acl-logging/0.log"
Jul 13 19:08:32.650123 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:08:32.650090    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hwqhc_7ae2e1d0-8a16-4821-9cb7-353862cfbec8/ovn-acl-logging/0.log"
Jul 13 19:08:33.367764 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:08:33.367700    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-qxvr5"
Jul 13 19:08:33.367764 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:08:33.367781    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-qxvr5"
Jul 13 19:08:33.380837 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:08:33.380806    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-qxvr5"
Jul 13 19:08:33.440298 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:08:33.440263    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-qxvr5"
Jul 13 19:08:41.458009 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:08:41.457951    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-cbc2b"
Jul 13 19:08:41.458009 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:08:41.458059    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-cbc2b"
Jul 13 19:08:41.471417 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:08:41.471380    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-cbc2b"
Jul 13 19:08:41.483223 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:08:41.483191    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-cbc2b"
Jul 13 19:10:19.908746 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:10:19.908702    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7cfd768f96-46tfq"]
Jul 13 19:10:19.912322 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:10:19.912294    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7cfd768f96-46tfq"
Jul 13 19:10:19.923640 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:10:19.923604    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7cfd768f96-46tfq"]
Jul 13 19:10:20.031061 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:10:20.030981    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pb8wh\" (UniqueName: \"kubernetes.io/projected/6cb5f50f-7cf1-46fe-a17e-e82f7a943edb-kube-api-access-pb8wh\") pod \"authorino-7cfd768f96-46tfq\" (UID: \"6cb5f50f-7cf1-46fe-a17e-e82f7a943edb\") " pod="kuadrant-system/authorino-7cfd768f96-46tfq"
Jul 13 19:10:20.031289 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:10:20.031201    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/6cb5f50f-7cf1-46fe-a17e-e82f7a943edb-tls-cert\") pod \"authorino-7cfd768f96-46tfq\" (UID: \"6cb5f50f-7cf1-46fe-a17e-e82f7a943edb\") " pod="kuadrant-system/authorino-7cfd768f96-46tfq"
Jul 13 19:10:20.131921 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:10:20.131870    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/6cb5f50f-7cf1-46fe-a17e-e82f7a943edb-tls-cert\") pod \"authorino-7cfd768f96-46tfq\" (UID: \"6cb5f50f-7cf1-46fe-a17e-e82f7a943edb\") " pod="kuadrant-system/authorino-7cfd768f96-46tfq"
Jul 13 19:10:20.132150 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:10:20.131942    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pb8wh\" (UniqueName: \"kubernetes.io/projected/6cb5f50f-7cf1-46fe-a17e-e82f7a943edb-kube-api-access-pb8wh\") pod \"authorino-7cfd768f96-46tfq\" (UID: \"6cb5f50f-7cf1-46fe-a17e-e82f7a943edb\") " pod="kuadrant-system/authorino-7cfd768f96-46tfq"
Jul 13 19:10:20.134688 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:10:20.134649    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/6cb5f50f-7cf1-46fe-a17e-e82f7a943edb-tls-cert\") pod \"authorino-7cfd768f96-46tfq\" (UID: \"6cb5f50f-7cf1-46fe-a17e-e82f7a943edb\") " pod="kuadrant-system/authorino-7cfd768f96-46tfq"
Jul 13 19:10:20.140414 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:10:20.140382    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pb8wh\" (UniqueName: \"kubernetes.io/projected/6cb5f50f-7cf1-46fe-a17e-e82f7a943edb-kube-api-access-pb8wh\") pod \"authorino-7cfd768f96-46tfq\" (UID: \"6cb5f50f-7cf1-46fe-a17e-e82f7a943edb\") " pod="kuadrant-system/authorino-7cfd768f96-46tfq"
Jul 13 19:10:20.222229 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:10:20.222136    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7cfd768f96-46tfq"
Jul 13 19:10:20.368641 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:10:20.368605    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7cfd768f96-46tfq"]
Jul 13 19:10:20.371457 ip-10-0-135-38 kubenswrapper[2563]: W0713 19:10:20.371411    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6cb5f50f_7cf1_46fe_a17e_e82f7a943edb.slice/crio-8f137bc30fc1c1042ce9254d47eb374d0aa4da547cebdabd96b3e50f1d4f47a1 WatchSource:0}: Error finding container 8f137bc30fc1c1042ce9254d47eb374d0aa4da547cebdabd96b3e50f1d4f47a1: Status 404 returned error can't find the container with id 8f137bc30fc1c1042ce9254d47eb374d0aa4da547cebdabd96b3e50f1d4f47a1
Jul 13 19:10:20.376316 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:10:20.376289    2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 13 19:10:20.953100 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:10:20.953054    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7cfd768f96-46tfq" event={"ID":"6cb5f50f-7cf1-46fe-a17e-e82f7a943edb","Type":"ContainerStarted","Data":"12b1af03fad04d65dcc80adbe7c9028727576f1a0e86140c313bbf16fa80a425"}
Jul 13 19:10:20.953618 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:10:20.953111    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7cfd768f96-46tfq" event={"ID":"6cb5f50f-7cf1-46fe-a17e-e82f7a943edb","Type":"ContainerStarted","Data":"8f137bc30fc1c1042ce9254d47eb374d0aa4da547cebdabd96b3e50f1d4f47a1"}
Jul 13 19:10:20.974247 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:10:20.974164    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-7cfd768f96-46tfq" podStartSLOduration=1.555004797 podStartE2EDuration="1.974136468s" totalImagesPullingTime="419.131671ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 19:10:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 19:10:20.972113186 +0000 UTC m=+708.746989555" watchObservedRunningTime="2026-07-13 19:10:20.974136468 +0000 UTC m=+708.749012825"
Jul 13 19:10:21.004550 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:10:21.004511    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-59d747569c-fqlwb"]
Jul 13 19:10:21.004745 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:10:21.004720    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-59d747569c-fqlwb" podUID="a61b77fb-185c-438c-89ca-9a5f30b57395" containerName="authorino" containerID="cri-o://8321a0173c09d93fd459ee4fffedadcb041657da2a2f7a14b9d58848d1082214" gracePeriod=30
Jul 13 19:10:21.284536 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:10:21.284504    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59d747569c-fqlwb"
Jul 13 19:10:21.446739 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:10:21.446643    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/a61b77fb-185c-438c-89ca-9a5f30b57395-tls-cert\") pod \"a61b77fb-185c-438c-89ca-9a5f30b57395\" (UID: \"a61b77fb-185c-438c-89ca-9a5f30b57395\") "
Jul 13 19:10:21.446739 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:10:21.446687    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cgmn2\" (UniqueName: \"kubernetes.io/projected/a61b77fb-185c-438c-89ca-9a5f30b57395-kube-api-access-cgmn2\") pod \"a61b77fb-185c-438c-89ca-9a5f30b57395\" (UID: \"a61b77fb-185c-438c-89ca-9a5f30b57395\") "
Jul 13 19:10:21.449530 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:10:21.449480    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a61b77fb-185c-438c-89ca-9a5f30b57395-kube-api-access-cgmn2" (OuterVolumeSpecName: "kube-api-access-cgmn2") pod "a61b77fb-185c-438c-89ca-9a5f30b57395" (UID: "a61b77fb-185c-438c-89ca-9a5f30b57395"). InnerVolumeSpecName "kube-api-access-cgmn2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 19:10:21.458475 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:10:21.458441    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a61b77fb-185c-438c-89ca-9a5f30b57395-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "a61b77fb-185c-438c-89ca-9a5f30b57395" (UID: "a61b77fb-185c-438c-89ca-9a5f30b57395"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 13 19:10:21.547871 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:10:21.547826    2563 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/a61b77fb-185c-438c-89ca-9a5f30b57395-tls-cert\") on node \"ip-10-0-135-38.ec2.internal\" DevicePath \"\""
Jul 13 19:10:21.547871 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:10:21.547868    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cgmn2\" (UniqueName: \"kubernetes.io/projected/a61b77fb-185c-438c-89ca-9a5f30b57395-kube-api-access-cgmn2\") on node \"ip-10-0-135-38.ec2.internal\" DevicePath \"\""
Jul 13 19:10:21.959751 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:10:21.959712    2563 generic.go:356] "Generic (PLEG): container finished" podID="a61b77fb-185c-438c-89ca-9a5f30b57395" containerID="8321a0173c09d93fd459ee4fffedadcb041657da2a2f7a14b9d58848d1082214" exitCode=0
Jul 13 19:10:21.960251 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:10:21.959768    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59d747569c-fqlwb"
Jul 13 19:10:21.960251 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:10:21.959798    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-59d747569c-fqlwb" event={"ID":"a61b77fb-185c-438c-89ca-9a5f30b57395","Type":"ContainerDied","Data":"8321a0173c09d93fd459ee4fffedadcb041657da2a2f7a14b9d58848d1082214"}
Jul 13 19:10:21.960251 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:10:21.959849    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-59d747569c-fqlwb" event={"ID":"a61b77fb-185c-438c-89ca-9a5f30b57395","Type":"ContainerDied","Data":"45de1f4ce8970512d1d036646f7a7fd25448134ac8a6a2d48e8b756e9a67a9a7"}
Jul 13 19:10:21.960251 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:10:21.959870    2563 scope.go:117] "RemoveContainer" containerID="8321a0173c09d93fd459ee4fffedadcb041657da2a2f7a14b9d58848d1082214"
Jul 13 19:10:21.969404 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:10:21.969370    2563 scope.go:117] "RemoveContainer" containerID="8321a0173c09d93fd459ee4fffedadcb041657da2a2f7a14b9d58848d1082214"
Jul 13 19:10:21.969761 ip-10-0-135-38 kubenswrapper[2563]: E0713 19:10:21.969741    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8321a0173c09d93fd459ee4fffedadcb041657da2a2f7a14b9d58848d1082214\": container with ID starting with 8321a0173c09d93fd459ee4fffedadcb041657da2a2f7a14b9d58848d1082214 not found: ID does not exist" containerID="8321a0173c09d93fd459ee4fffedadcb041657da2a2f7a14b9d58848d1082214"
Jul 13 19:10:21.969814 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:10:21.969772    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8321a0173c09d93fd459ee4fffedadcb041657da2a2f7a14b9d58848d1082214"} err="failed to get container status \"8321a0173c09d93fd459ee4fffedadcb041657da2a2f7a14b9d58848d1082214\": rpc error: code = NotFound desc = could not find container \"8321a0173c09d93fd459ee4fffedadcb041657da2a2f7a14b9d58848d1082214\": container with ID starting with 8321a0173c09d93fd459ee4fffedadcb041657da2a2f7a14b9d58848d1082214 not found: ID does not exist"
Jul 13 19:10:21.984811 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:10:21.984769    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-59d747569c-fqlwb"]
Jul 13 19:10:21.988751 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:10:21.988716    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-59d747569c-fqlwb"]
Jul 13 19:10:22.763448 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:10:22.763403    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a61b77fb-185c-438c-89ca-9a5f30b57395" path="/var/lib/kubelet/pods/a61b77fb-185c-438c-89ca-9a5f30b57395/volumes"
Jul 13 19:11:32.722806 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:11:32.722772    2563 scope.go:117] "RemoveContainer" containerID="159b495955ff8406a7cb8201754f2be3a53ce77def992df59631ce413c3a9d86"
Jul 13 19:11:36.516874 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:11:36.516833    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-54f69f5bc-6gjlf"]
Jul 13 19:11:36.517430 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:11:36.517406    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a61b77fb-185c-438c-89ca-9a5f30b57395" containerName="authorino"
Jul 13 19:11:36.517519 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:11:36.517434    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="a61b77fb-185c-438c-89ca-9a5f30b57395" containerName="authorino"
Jul 13 19:11:36.517572 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:11:36.517550    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="a61b77fb-185c-438c-89ca-9a5f30b57395" containerName="authorino"
Jul 13 19:11:36.521970 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:11:36.521940    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-54f69f5bc-6gjlf"
Jul 13 19:11:36.525427 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:11:36.525396    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-88m76\""
Jul 13 19:11:36.525573 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:11:36.525438    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 13 19:11:36.525573 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:11:36.525409    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 13 19:11:36.533735 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:11:36.533693    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-54f69f5bc-6gjlf"]
Jul 13 19:11:36.644349 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:11:36.644307    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8a3c5b14-c469-4c18-a057-efc5929d6540-webhook-cert\") pod \"maas-controller-54f69f5bc-6gjlf\" (UID: \"8a3c5b14-c469-4c18-a057-efc5929d6540\") " pod="opendatahub/maas-controller-54f69f5bc-6gjlf"
Jul 13 19:11:36.644349 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:11:36.644348    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2czcf\" (UniqueName: \"kubernetes.io/projected/8a3c5b14-c469-4c18-a057-efc5929d6540-kube-api-access-2czcf\") pod \"maas-controller-54f69f5bc-6gjlf\" (UID: \"8a3c5b14-c469-4c18-a057-efc5929d6540\") " pod="opendatahub/maas-controller-54f69f5bc-6gjlf"
Jul 13 19:11:36.745124 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:11:36.745085    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8a3c5b14-c469-4c18-a057-efc5929d6540-webhook-cert\") pod \"maas-controller-54f69f5bc-6gjlf\" (UID: \"8a3c5b14-c469-4c18-a057-efc5929d6540\") " pod="opendatahub/maas-controller-54f69f5bc-6gjlf"
Jul 13 19:11:36.745124 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:11:36.745124    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2czcf\" (UniqueName: \"kubernetes.io/projected/8a3c5b14-c469-4c18-a057-efc5929d6540-kube-api-access-2czcf\") pod \"maas-controller-54f69f5bc-6gjlf\" (UID: \"8a3c5b14-c469-4c18-a057-efc5929d6540\") " pod="opendatahub/maas-controller-54f69f5bc-6gjlf"
Jul 13 19:11:36.747639 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:11:36.747601    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8a3c5b14-c469-4c18-a057-efc5929d6540-webhook-cert\") pod \"maas-controller-54f69f5bc-6gjlf\" (UID: \"8a3c5b14-c469-4c18-a057-efc5929d6540\") " pod="opendatahub/maas-controller-54f69f5bc-6gjlf"
Jul 13 19:11:36.754379 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:11:36.754343    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2czcf\" (UniqueName: \"kubernetes.io/projected/8a3c5b14-c469-4c18-a057-efc5929d6540-kube-api-access-2czcf\") pod \"maas-controller-54f69f5bc-6gjlf\" (UID: \"8a3c5b14-c469-4c18-a057-efc5929d6540\") " pod="opendatahub/maas-controller-54f69f5bc-6gjlf"
Jul 13 19:11:36.833361 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:11:36.833256    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-54f69f5bc-6gjlf"
Jul 13 19:11:36.981829 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:11:36.981798    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-54f69f5bc-6gjlf"]
Jul 13 19:11:36.984464 ip-10-0-135-38 kubenswrapper[2563]: W0713 19:11:36.984431    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8a3c5b14_c469_4c18_a057_efc5929d6540.slice/crio-fd55061bcc94bd5d3b7f3945e40b330e3187acd4643d7f513798802d605471cd WatchSource:0}: Error finding container fd55061bcc94bd5d3b7f3945e40b330e3187acd4643d7f513798802d605471cd: Status 404 returned error can't find the container with id fd55061bcc94bd5d3b7f3945e40b330e3187acd4643d7f513798802d605471cd
Jul 13 19:11:37.330730 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:11:37.330692    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-54f69f5bc-6gjlf" event={"ID":"8a3c5b14-c469-4c18-a057-efc5929d6540","Type":"ContainerStarted","Data":"fd55061bcc94bd5d3b7f3945e40b330e3187acd4643d7f513798802d605471cd"}
Jul 13 19:11:38.337542 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:11:38.337501    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-54f69f5bc-6gjlf" event={"ID":"8a3c5b14-c469-4c18-a057-efc5929d6540","Type":"ContainerStarted","Data":"dc231f5e8875110907e50cec38c1e3dd558d0922eb27295e8d292f4d1c21eb95"}
Jul 13 19:11:38.337951 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:11:38.337597    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-54f69f5bc-6gjlf"
Jul 13 19:11:38.365130 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:11:38.365064    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-54f69f5bc-6gjlf" podStartSLOduration=1.797510521 podStartE2EDuration="2.365044849s" totalImagesPullingTime="567.534328ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 19:11:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 19:11:38.362601114 +0000 UTC m=+786.137477496" watchObservedRunningTime="2026-07-13 19:11:38.365044849 +0000 UTC m=+786.139921234"
Jul 13 19:11:49.344805 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:11:49.344759    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-54f69f5bc-6gjlf"
Jul 13 19:13:32.695253 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:13:32.695219    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hwqhc_7ae2e1d0-8a16-4821-9cb7-353862cfbec8/ovn-acl-logging/0.log"
Jul 13 19:13:32.696312 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:13:32.696282    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hwqhc_7ae2e1d0-8a16-4821-9cb7-353862cfbec8/ovn-acl-logging/0.log"
Jul 13 19:15:00.147691 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:15:00.147601    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29732835-5h2d2"]
Jul 13 19:15:00.151087 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:15:00.151066    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29732835-5h2d2"
Jul 13 19:15:00.153633 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:15:00.153604    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-llvfh\""
Jul 13 19:15:00.160763 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:15:00.160736    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29732835-5h2d2"
Jul 13 19:15:00.169890 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:15:00.169859    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29732835-5h2d2"]
Jul 13 19:15:00.317004 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:15:00.316976    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29732835-5h2d2"]
Jul 13 19:15:00.320245 ip-10-0-135-38 kubenswrapper[2563]: W0713 19:15:00.320214    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd2285c04_809f_49bd_8035_8270fd22c544.slice/crio-1b50e1c859338a7a7555200741bfd03af0166b0dd5aadb6be32d17ac13ba78e3 WatchSource:0}: Error finding container 1b50e1c859338a7a7555200741bfd03af0166b0dd5aadb6be32d17ac13ba78e3: Status 404 returned error can't find the container with id 1b50e1c859338a7a7555200741bfd03af0166b0dd5aadb6be32d17ac13ba78e3
Jul 13 19:15:01.323608 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:15:01.323570    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29732835-5h2d2" event={"ID":"d2285c04-809f-49bd-8035-8270fd22c544","Type":"ContainerStarted","Data":"1b50e1c859338a7a7555200741bfd03af0166b0dd5aadb6be32d17ac13ba78e3"}
Jul 13 19:15:04.341877 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:15:04.341832    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29732835-5h2d2" event={"ID":"d2285c04-809f-49bd-8035-8270fd22c544","Type":"ContainerStarted","Data":"b63dbf8da9c2cb1985994a046fc4d9561a7fb346b634aefd5bee253f607444ae"}
Jul 13 19:15:05.348551 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:15:05.348511    2563 generic.go:356] "Generic (PLEG): container finished" podID="d2285c04-809f-49bd-8035-8270fd22c544" containerID="b63dbf8da9c2cb1985994a046fc4d9561a7fb346b634aefd5bee253f607444ae" exitCode=0
Jul 13 19:15:05.348970 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:15:05.348597    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29732835-5h2d2" event={"ID":"d2285c04-809f-49bd-8035-8270fd22c544","Type":"ContainerDied","Data":"b63dbf8da9c2cb1985994a046fc4d9561a7fb346b634aefd5bee253f607444ae"}
Jul 13 19:15:06.517152 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:15:06.517122    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29732835-5h2d2"
Jul 13 19:15:07.360946 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:15:07.360913    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29732835-5h2d2"
Jul 13 19:15:07.361142 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:15:07.360954    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29732835-5h2d2" event={"ID":"d2285c04-809f-49bd-8035-8270fd22c544","Type":"ContainerDied","Data":"1b50e1c859338a7a7555200741bfd03af0166b0dd5aadb6be32d17ac13ba78e3"}
Jul 13 19:15:07.361142 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:15:07.361008    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1b50e1c859338a7a7555200741bfd03af0166b0dd5aadb6be32d17ac13ba78e3"
Jul 13 19:16:34.092249 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:16:34.092207    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vnjz8"]
Jul 13 19:16:34.092883 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:16:34.092458    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vnjz8" podUID="bbb51ea3-098c-478a-8e8c-abb8be2bb5ca" containerName="manager" containerID="cri-o://a5b665894326a4ce6b29e06a4a7e1d0233a405512e5e5e4b3ee31e4936aa7256" gracePeriod=10
Jul 13 19:16:37.349173 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:16:37.349143    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vnjz8"
Jul 13 19:16:37.461388 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:16:37.461284    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/bbb51ea3-098c-478a-8e8c-abb8be2bb5ca-extensions-socket-volume\") pod \"bbb51ea3-098c-478a-8e8c-abb8be2bb5ca\" (UID: \"bbb51ea3-098c-478a-8e8c-abb8be2bb5ca\") "
Jul 13 19:16:37.461388 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:16:37.461371    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-42wjb\" (UniqueName: \"kubernetes.io/projected/bbb51ea3-098c-478a-8e8c-abb8be2bb5ca-kube-api-access-42wjb\") pod \"bbb51ea3-098c-478a-8e8c-abb8be2bb5ca\" (UID: \"bbb51ea3-098c-478a-8e8c-abb8be2bb5ca\") "
Jul 13 19:16:37.461705 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:16:37.461679    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bbb51ea3-098c-478a-8e8c-abb8be2bb5ca-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "bbb51ea3-098c-478a-8e8c-abb8be2bb5ca" (UID: "bbb51ea3-098c-478a-8e8c-abb8be2bb5ca"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 19:16:37.463488 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:16:37.463460    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bbb51ea3-098c-478a-8e8c-abb8be2bb5ca-kube-api-access-42wjb" (OuterVolumeSpecName: "kube-api-access-42wjb") pod "bbb51ea3-098c-478a-8e8c-abb8be2bb5ca" (UID: "bbb51ea3-098c-478a-8e8c-abb8be2bb5ca"). InnerVolumeSpecName "kube-api-access-42wjb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 19:16:37.562000 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:16:37.561957    2563 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/bbb51ea3-098c-478a-8e8c-abb8be2bb5ca-extensions-socket-volume\") on node \"ip-10-0-135-38.ec2.internal\" DevicePath \"\""
Jul 13 19:16:37.562000 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:16:37.561991    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-42wjb\" (UniqueName: \"kubernetes.io/projected/bbb51ea3-098c-478a-8e8c-abb8be2bb5ca-kube-api-access-42wjb\") on node \"ip-10-0-135-38.ec2.internal\" DevicePath \"\""
Jul 13 19:16:37.810863 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:16:37.810762    2563 generic.go:356] "Generic (PLEG): container finished" podID="bbb51ea3-098c-478a-8e8c-abb8be2bb5ca" containerID="a5b665894326a4ce6b29e06a4a7e1d0233a405512e5e5e4b3ee31e4936aa7256" exitCode=0
Jul 13 19:16:37.810863 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:16:37.810820    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vnjz8"
Jul 13 19:16:37.810863 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:16:37.810839    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vnjz8" event={"ID":"bbb51ea3-098c-478a-8e8c-abb8be2bb5ca","Type":"ContainerDied","Data":"a5b665894326a4ce6b29e06a4a7e1d0233a405512e5e5e4b3ee31e4936aa7256"}
Jul 13 19:16:37.811168 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:16:37.810894    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vnjz8" event={"ID":"bbb51ea3-098c-478a-8e8c-abb8be2bb5ca","Type":"ContainerDied","Data":"181d41cddb368e57e295b050f2881bb83c59ec41774d06c8364e1b194c345c8e"}
Jul 13 19:16:37.811168 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:16:37.810919    2563 scope.go:117] "RemoveContainer" containerID="a5b665894326a4ce6b29e06a4a7e1d0233a405512e5e5e4b3ee31e4936aa7256"
Jul 13 19:16:37.821902 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:16:37.821877    2563 scope.go:117] "RemoveContainer" containerID="a5b665894326a4ce6b29e06a4a7e1d0233a405512e5e5e4b3ee31e4936aa7256"
Jul 13 19:16:37.822301 ip-10-0-135-38 kubenswrapper[2563]: E0713 19:16:37.822277    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a5b665894326a4ce6b29e06a4a7e1d0233a405512e5e5e4b3ee31e4936aa7256\": container with ID starting with a5b665894326a4ce6b29e06a4a7e1d0233a405512e5e5e4b3ee31e4936aa7256 not found: ID does not exist" containerID="a5b665894326a4ce6b29e06a4a7e1d0233a405512e5e5e4b3ee31e4936aa7256"
Jul 13 19:16:37.822386 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:16:37.822311    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a5b665894326a4ce6b29e06a4a7e1d0233a405512e5e5e4b3ee31e4936aa7256"} err="failed to get container status \"a5b665894326a4ce6b29e06a4a7e1d0233a405512e5e5e4b3ee31e4936aa7256\": rpc error: code = NotFound desc = could not find container \"a5b665894326a4ce6b29e06a4a7e1d0233a405512e5e5e4b3ee31e4936aa7256\": container with ID starting with a5b665894326a4ce6b29e06a4a7e1d0233a405512e5e5e4b3ee31e4936aa7256 not found: ID does not exist"
Jul 13 19:16:37.833563 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:16:37.833530    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vnjz8"]
Jul 13 19:16:37.837793 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:16:37.837765    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vnjz8"]
Jul 13 19:16:38.756186 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:16:38.756155    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bbb51ea3-098c-478a-8e8c-abb8be2bb5ca" path="/var/lib/kubelet/pods/bbb51ea3-098c-478a-8e8c-abb8be2bb5ca/volumes"
Jul 13 19:17:35.304318 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:17:35.304268    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cfrst"]
Jul 13 19:17:35.304760 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:17:35.304628    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d2285c04-809f-49bd-8035-8270fd22c544" containerName="cleanup"
Jul 13 19:17:35.304760 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:17:35.304641    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="d2285c04-809f-49bd-8035-8270fd22c544" containerName="cleanup"
Jul 13 19:17:35.304760 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:17:35.304653    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bbb51ea3-098c-478a-8e8c-abb8be2bb5ca" containerName="manager"
Jul 13 19:17:35.304760 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:17:35.304659    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="bbb51ea3-098c-478a-8e8c-abb8be2bb5ca" containerName="manager"
Jul 13 19:17:35.304760 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:17:35.304720    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="bbb51ea3-098c-478a-8e8c-abb8be2bb5ca" containerName="manager"
Jul 13 19:17:35.304760 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:17:35.304730    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="d2285c04-809f-49bd-8035-8270fd22c544" containerName="cleanup"
Jul 13 19:17:35.308209 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:17:35.308184    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cfrst"
Jul 13 19:17:35.310928 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:17:35.310907    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-blcgc\""
Jul 13 19:17:35.340248 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:17:35.340208    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cfrst"]
Jul 13 19:17:35.488562 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:17:35.488517    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f4wfz\" (UniqueName: \"kubernetes.io/projected/ff9b7113-7ecb-4995-9bba-c2d4059125b0-kube-api-access-f4wfz\") pod \"kuadrant-operator-controller-manager-86878c769f-cfrst\" (UID: \"ff9b7113-7ecb-4995-9bba-c2d4059125b0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cfrst"
Jul 13 19:17:35.488764 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:17:35.488574    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ff9b7113-7ecb-4995-9bba-c2d4059125b0-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-cfrst\" (UID: \"ff9b7113-7ecb-4995-9bba-c2d4059125b0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cfrst"
Jul 13 19:17:35.589460 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:17:35.589356    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f4wfz\" (UniqueName: \"kubernetes.io/projected/ff9b7113-7ecb-4995-9bba-c2d4059125b0-kube-api-access-f4wfz\") pod \"kuadrant-operator-controller-manager-86878c769f-cfrst\" (UID: \"ff9b7113-7ecb-4995-9bba-c2d4059125b0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cfrst"
Jul 13 19:17:35.589460 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:17:35.589404    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ff9b7113-7ecb-4995-9bba-c2d4059125b0-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-cfrst\" (UID: \"ff9b7113-7ecb-4995-9bba-c2d4059125b0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cfrst"
Jul 13 19:17:35.589794 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:17:35.589772    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ff9b7113-7ecb-4995-9bba-c2d4059125b0-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-cfrst\" (UID: \"ff9b7113-7ecb-4995-9bba-c2d4059125b0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cfrst"
Jul 13 19:17:35.598463 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:17:35.598426    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f4wfz\" (UniqueName: \"kubernetes.io/projected/ff9b7113-7ecb-4995-9bba-c2d4059125b0-kube-api-access-f4wfz\") pod \"kuadrant-operator-controller-manager-86878c769f-cfrst\" (UID: \"ff9b7113-7ecb-4995-9bba-c2d4059125b0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cfrst"
Jul 13 19:17:35.619326 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:17:35.619278    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cfrst"
Jul 13 19:17:35.775735 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:17:35.775692    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cfrst"]
Jul 13 19:17:35.778577 ip-10-0-135-38 kubenswrapper[2563]: W0713 19:17:35.778548    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podff9b7113_7ecb_4995_9bba_c2d4059125b0.slice/crio-704bb3031c6ed570b098681e32f72d0b69d9ff258dcd96dcbe0d23f120617688 WatchSource:0}: Error finding container 704bb3031c6ed570b098681e32f72d0b69d9ff258dcd96dcbe0d23f120617688: Status 404 returned error can't find the container with id 704bb3031c6ed570b098681e32f72d0b69d9ff258dcd96dcbe0d23f120617688
Jul 13 19:17:36.089662 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:17:36.089624    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cfrst" event={"ID":"ff9b7113-7ecb-4995-9bba-c2d4059125b0","Type":"ContainerStarted","Data":"187cc96311a57e7cf5669f0ceb0aaf03a75ec5260e2fcf8dd29a002ebba69f3e"}
Jul 13 19:17:36.089886 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:17:36.089677    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cfrst" event={"ID":"ff9b7113-7ecb-4995-9bba-c2d4059125b0","Type":"ContainerStarted","Data":"704bb3031c6ed570b098681e32f72d0b69d9ff258dcd96dcbe0d23f120617688"}
Jul 13 19:17:36.089886 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:17:36.089749    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cfrst"
Jul 13 19:17:36.115805 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:17:36.115693    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cfrst" podStartSLOduration=1.115674111 podStartE2EDuration="1.115674111s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 19:17:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 19:17:36.113270705 +0000 UTC m=+1143.888147062" watchObservedRunningTime="2026-07-13 19:17:36.115674111 +0000 UTC m=+1143.890550466"
Jul 13 19:17:47.097237 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:17:47.097205    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cfrst"
Jul 13 19:18:32.723993 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:18:32.723958    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hwqhc_7ae2e1d0-8a16-4821-9cb7-353862cfbec8/ovn-acl-logging/0.log"
Jul 13 19:18:32.726705 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:18:32.724548    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hwqhc_7ae2e1d0-8a16-4821-9cb7-353862cfbec8/ovn-acl-logging/0.log"
Jul 13 19:23:32.753523 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:23:32.753409    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hwqhc_7ae2e1d0-8a16-4821-9cb7-353862cfbec8/ovn-acl-logging/0.log"
Jul 13 19:23:32.757760 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:23:32.755533    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hwqhc_7ae2e1d0-8a16-4821-9cb7-353862cfbec8/ovn-acl-logging/0.log"
Jul 13 19:24:00.588560 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:24:00.588514    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-0b1b2151-openshift-default-658d89c795-mk7zf"]
Jul 13 19:24:00.592943 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:24:00.592911    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-0b1b2151-openshift-default-658d89c795-mk7zf"
Jul 13 19:24:00.596811 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:24:00.596775    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-0b1b2151-openshift-default-dockercfg-hq9w6\""
Jul 13 19:24:00.672930 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:24:00.672898    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-0b1b2151-openshift-default-658d89c795-mk7zf"]
Jul 13 19:24:00.718820 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:24:00.718777    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/603ad020-b087-4271-9a1d-fe1f7d83a5fc-istio-podinfo\") pod \"e2e-ait-0b1b2151-openshift-default-658d89c795-mk7zf\" (UID: \"603ad020-b087-4271-9a1d-fe1f7d83a5fc\") " pod="openshift-ingress/e2e-ait-0b1b2151-openshift-default-658d89c795-mk7zf"
Jul 13 19:24:00.718820 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:24:00.718826    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/603ad020-b087-4271-9a1d-fe1f7d83a5fc-workload-socket\") pod \"e2e-ait-0b1b2151-openshift-default-658d89c795-mk7zf\" (UID: \"603ad020-b087-4271-9a1d-fe1f7d83a5fc\") " pod="openshift-ingress/e2e-ait-0b1b2151-openshift-default-658d89c795-mk7zf"
Jul 13 19:24:00.719160 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:24:00.718911    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/603ad020-b087-4271-9a1d-fe1f7d83a5fc-istio-token\") pod \"e2e-ait-0b1b2151-openshift-default-658d89c795-mk7zf\" (UID: \"603ad020-b087-4271-9a1d-fe1f7d83a5fc\") " pod="openshift-ingress/e2e-ait-0b1b2151-openshift-default-658d89c795-mk7zf"
Jul 13 19:24:00.719160 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:24:00.719008    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pcxgg\" (UniqueName: \"kubernetes.io/projected/603ad020-b087-4271-9a1d-fe1f7d83a5fc-kube-api-access-pcxgg\") pod \"e2e-ait-0b1b2151-openshift-default-658d89c795-mk7zf\" (UID: \"603ad020-b087-4271-9a1d-fe1f7d83a5fc\") " pod="openshift-ingress/e2e-ait-0b1b2151-openshift-default-658d89c795-mk7zf"
Jul 13 19:24:00.719160 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:24:00.719086    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/603ad020-b087-4271-9a1d-fe1f7d83a5fc-istio-data\") pod \"e2e-ait-0b1b2151-openshift-default-658d89c795-mk7zf\" (UID: \"603ad020-b087-4271-9a1d-fe1f7d83a5fc\") " pod="openshift-ingress/e2e-ait-0b1b2151-openshift-default-658d89c795-mk7zf"
Jul 13 19:24:00.719160 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:24:00.719117    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/603ad020-b087-4271-9a1d-fe1f7d83a5fc-istiod-ca-cert\") pod \"e2e-ait-0b1b2151-openshift-default-658d89c795-mk7zf\" (UID: \"603ad020-b087-4271-9a1d-fe1f7d83a5fc\") " pod="openshift-ingress/e2e-ait-0b1b2151-openshift-default-658d89c795-mk7zf"
Jul 13 19:24:00.719160 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:24:00.719155    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/603ad020-b087-4271-9a1d-fe1f7d83a5fc-workload-certs\") pod \"e2e-ait-0b1b2151-openshift-default-658d89c795-mk7zf\" (UID: \"603ad020-b087-4271-9a1d-fe1f7d83a5fc\") " pod="openshift-ingress/e2e-ait-0b1b2151-openshift-default-658d89c795-mk7zf"
Jul 13 19:24:00.719432 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:24:00.719193    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/603ad020-b087-4271-9a1d-fe1f7d83a5fc-credential-socket\") pod \"e2e-ait-0b1b2151-openshift-default-658d89c795-mk7zf\" (UID: \"603ad020-b087-4271-9a1d-fe1f7d83a5fc\") " pod="openshift-ingress/e2e-ait-0b1b2151-openshift-default-658d89c795-mk7zf"
Jul 13 19:24:00.719432 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:24:00.719254    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/603ad020-b087-4271-9a1d-fe1f7d83a5fc-istio-envoy\") pod \"e2e-ait-0b1b2151-openshift-default-658d89c795-mk7zf\" (UID: \"603ad020-b087-4271-9a1d-fe1f7d83a5fc\") " pod="openshift-ingress/e2e-ait-0b1b2151-openshift-default-658d89c795-mk7zf"
Jul 13 19:24:00.820100 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:24:00.820054    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/603ad020-b087-4271-9a1d-fe1f7d83a5fc-credential-socket\") pod \"e2e-ait-0b1b2151-openshift-default-658d89c795-mk7zf\" (UID: \"603ad020-b087-4271-9a1d-fe1f7d83a5fc\") " pod="openshift-ingress/e2e-ait-0b1b2151-openshift-default-658d89c795-mk7zf"
Jul 13 19:24:00.820100 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:24:00.820112    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/603ad020-b087-4271-9a1d-fe1f7d83a5fc-istio-envoy\") pod \"e2e-ait-0b1b2151-openshift-default-658d89c795-mk7zf\" (UID: \"603ad020-b087-4271-9a1d-fe1f7d83a5fc\") " pod="openshift-ingress/e2e-ait-0b1b2151-openshift-default-658d89c795-mk7zf"
Jul 13 19:24:00.820372 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:24:00.820233    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/603ad020-b087-4271-9a1d-fe1f7d83a5fc-istio-podinfo\") pod \"e2e-ait-0b1b2151-openshift-default-658d89c795-mk7zf\" (UID: \"603ad020-b087-4271-9a1d-fe1f7d83a5fc\") " pod="openshift-ingress/e2e-ait-0b1b2151-openshift-default-658d89c795-mk7zf"
Jul 13 19:24:00.820372 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:24:00.820283    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/603ad020-b087-4271-9a1d-fe1f7d83a5fc-workload-socket\") pod \"e2e-ait-0b1b2151-openshift-default-658d89c795-mk7zf\" (UID: \"603ad020-b087-4271-9a1d-fe1f7d83a5fc\") " pod="openshift-ingress/e2e-ait-0b1b2151-openshift-default-658d89c795-mk7zf"
Jul 13 19:24:00.820372 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:24:00.820330    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/603ad020-b087-4271-9a1d-fe1f7d83a5fc-istio-token\") pod \"e2e-ait-0b1b2151-openshift-default-658d89c795-mk7zf\" (UID: \"603ad020-b087-4271-9a1d-fe1f7d83a5fc\") " pod="openshift-ingress/e2e-ait-0b1b2151-openshift-default-658d89c795-mk7zf"
Jul 13 19:24:00.820531 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:24:00.820396    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pcxgg\" (UniqueName: \"kubernetes.io/projected/603ad020-b087-4271-9a1d-fe1f7d83a5fc-kube-api-access-pcxgg\") pod \"e2e-ait-0b1b2151-openshift-default-658d89c795-mk7zf\" (UID: \"603ad020-b087-4271-9a1d-fe1f7d83a5fc\") " pod="openshift-ingress/e2e-ait-0b1b2151-openshift-default-658d89c795-mk7zf"
Jul 13 19:24:00.820531 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:24:00.820427    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/603ad020-b087-4271-9a1d-fe1f7d83a5fc-istio-data\") pod \"e2e-ait-0b1b2151-openshift-default-658d89c795-mk7zf\" (UID: \"603ad020-b087-4271-9a1d-fe1f7d83a5fc\") " pod="openshift-ingress/e2e-ait-0b1b2151-openshift-default-658d89c795-mk7zf"
Jul 13 19:24:00.820531 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:24:00.820456    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/603ad020-b087-4271-9a1d-fe1f7d83a5fc-istiod-ca-cert\") pod \"e2e-ait-0b1b2151-openshift-default-658d89c795-mk7zf\" (UID: \"603ad020-b087-4271-9a1d-fe1f7d83a5fc\") " pod="openshift-ingress/e2e-ait-0b1b2151-openshift-default-658d89c795-mk7zf"
Jul 13 19:24:00.820531 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:24:00.820490    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/603ad020-b087-4271-9a1d-fe1f7d83a5fc-workload-certs\") pod \"e2e-ait-0b1b2151-openshift-default-658d89c795-mk7zf\" (UID: \"603ad020-b087-4271-9a1d-fe1f7d83a5fc\") " pod="openshift-ingress/e2e-ait-0b1b2151-openshift-default-658d89c795-mk7zf"
Jul 13 19:24:00.820731 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:24:00.820591    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/603ad020-b087-4271-9a1d-fe1f7d83a5fc-credential-socket\") pod \"e2e-ait-0b1b2151-openshift-default-658d89c795-mk7zf\" (UID: \"603ad020-b087-4271-9a1d-fe1f7d83a5fc\") " pod="openshift-ingress/e2e-ait-0b1b2151-openshift-default-658d89c795-mk7zf"
Jul 13 19:24:00.820731 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:24:00.820678    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/603ad020-b087-4271-9a1d-fe1f7d83a5fc-workload-socket\") pod \"e2e-ait-0b1b2151-openshift-default-658d89c795-mk7zf\" (UID: \"603ad020-b087-4271-9a1d-fe1f7d83a5fc\") " pod="openshift-ingress/e2e-ait-0b1b2151-openshift-default-658d89c795-mk7zf"
Jul 13 19:24:00.820841 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:24:00.820816    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/603ad020-b087-4271-9a1d-fe1f7d83a5fc-workload-certs\") pod \"e2e-ait-0b1b2151-openshift-default-658d89c795-mk7zf\" (UID: \"603ad020-b087-4271-9a1d-fe1f7d83a5fc\") " pod="openshift-ingress/e2e-ait-0b1b2151-openshift-default-658d89c795-mk7zf"
Jul 13 19:24:00.820914 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:24:00.820890    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/603ad020-b087-4271-9a1d-fe1f7d83a5fc-istio-data\") pod \"e2e-ait-0b1b2151-openshift-default-658d89c795-mk7zf\" (UID: \"603ad020-b087-4271-9a1d-fe1f7d83a5fc\") " pod="openshift-ingress/e2e-ait-0b1b2151-openshift-default-658d89c795-mk7zf"
Jul 13 19:24:00.821376 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:24:00.821349    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/603ad020-b087-4271-9a1d-fe1f7d83a5fc-istiod-ca-cert\") pod \"e2e-ait-0b1b2151-openshift-default-658d89c795-mk7zf\" (UID: \"603ad020-b087-4271-9a1d-fe1f7d83a5fc\") " pod="openshift-ingress/e2e-ait-0b1b2151-openshift-default-658d89c795-mk7zf"
Jul 13 19:24:00.822617 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:24:00.822594    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/603ad020-b087-4271-9a1d-fe1f7d83a5fc-istio-envoy\") pod \"e2e-ait-0b1b2151-openshift-default-658d89c795-mk7zf\" (UID: \"603ad020-b087-4271-9a1d-fe1f7d83a5fc\") " pod="openshift-ingress/e2e-ait-0b1b2151-openshift-default-658d89c795-mk7zf"
Jul 13 19:24:00.822780 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:24:00.822760    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/603ad020-b087-4271-9a1d-fe1f7d83a5fc-istio-podinfo\") pod \"e2e-ait-0b1b2151-openshift-default-658d89c795-mk7zf\" (UID: \"603ad020-b087-4271-9a1d-fe1f7d83a5fc\") " pod="openshift-ingress/e2e-ait-0b1b2151-openshift-default-658d89c795-mk7zf"
Jul 13 19:24:00.832801 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:24:00.832727    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/603ad020-b087-4271-9a1d-fe1f7d83a5fc-istio-token\") pod \"e2e-ait-0b1b2151-openshift-default-658d89c795-mk7zf\" (UID: \"603ad020-b087-4271-9a1d-fe1f7d83a5fc\") " pod="openshift-ingress/e2e-ait-0b1b2151-openshift-default-658d89c795-mk7zf"
Jul 13 19:24:00.832913 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:24:00.832829    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pcxgg\" (UniqueName: \"kubernetes.io/projected/603ad020-b087-4271-9a1d-fe1f7d83a5fc-kube-api-access-pcxgg\") pod \"e2e-ait-0b1b2151-openshift-default-658d89c795-mk7zf\" (UID: \"603ad020-b087-4271-9a1d-fe1f7d83a5fc\") " pod="openshift-ingress/e2e-ait-0b1b2151-openshift-default-658d89c795-mk7zf"
Jul 13 19:24:00.905151 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:24:00.905109    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-0b1b2151-openshift-default-658d89c795-mk7zf"
Jul 13 19:24:01.067951 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:24:01.067917    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-0b1b2151-openshift-default-658d89c795-mk7zf"]
Jul 13 19:24:01.071835 ip-10-0-135-38 kubenswrapper[2563]: W0713 19:24:01.071806    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod603ad020_b087_4271_9a1d_fe1f7d83a5fc.slice/crio-614a6c372ac888abe236f03b0b1f76882b34ed7a347be198028be460ec6f3469 WatchSource:0}: Error finding container 614a6c372ac888abe236f03b0b1f76882b34ed7a347be198028be460ec6f3469: Status 404 returned error can't find the container with id 614a6c372ac888abe236f03b0b1f76882b34ed7a347be198028be460ec6f3469
Jul 13 19:24:01.073891 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:24:01.073859    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 13 19:24:01.073959 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:24:01.073927    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 13 19:24:01.073998 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:24:01.073955    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 13 19:24:01.999104 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:24:01.999063    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-0b1b2151-openshift-default-658d89c795-mk7zf" event={"ID":"603ad020-b087-4271-9a1d-fe1f7d83a5fc","Type":"ContainerStarted","Data":"99f63bd591626f5f22823c4abc73c1689689695a78fcbb5346588702e0d771f7"}
Jul 13 19:24:01.999541 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:24:01.999117    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-0b1b2151-openshift-default-658d89c795-mk7zf" event={"ID":"603ad020-b087-4271-9a1d-fe1f7d83a5fc","Type":"ContainerStarted","Data":"614a6c372ac888abe236f03b0b1f76882b34ed7a347be198028be460ec6f3469"}
Jul 13 19:24:02.051124 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:24:02.051055    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-0b1b2151-openshift-default-658d89c795-mk7zf" podStartSLOduration=2.051012218 podStartE2EDuration="2.051012218s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 19:24:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 19:24:02.047407253 +0000 UTC m=+1529.822283635" watchObservedRunningTime="2026-07-13 19:24:02.051012218 +0000 UTC m=+1529.825888574"
Jul 13 19:24:02.906353 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:24:02.906311    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-0b1b2151-openshift-default-658d89c795-mk7zf"
Jul 13 19:24:02.912862 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:24:02.912834    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-0b1b2151-openshift-default-658d89c795-mk7zf"
Jul 13 19:24:03.004857 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:24:03.004819    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-0b1b2151-openshift-default-658d89c795-mk7zf"
Jul 13 19:24:03.005852 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:24:03.005828    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-0b1b2151-openshift-default-658d89c795-mk7zf"
Jul 13 19:24:06.835042 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:24:06.834985    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0b1b2151-sdzjd"]
Jul 13 19:24:06.838655 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:24:06.838632    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0b1b2151-sdzjd"
Jul 13 19:24:06.842664 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:24:06.842635    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-llvfh\""
Jul 13 19:24:06.849826 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:24:06.849796    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0b1b2151-sdzjd"]
Jul 13 19:24:06.977391 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:24:06.977343    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/610cdef0-0f70-46d3-9766-277ab106e219-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-0b1b2151-sdzjd\" (UID: \"610cdef0-0f70-46d3-9766-277ab106e219\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0b1b2151-sdzjd"
Jul 13 19:24:07.078045 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:24:07.077987    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/610cdef0-0f70-46d3-9766-277ab106e219-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-0b1b2151-sdzjd\" (UID: \"610cdef0-0f70-46d3-9766-277ab106e219\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0b1b2151-sdzjd"
Jul 13 19:24:07.078692 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:24:07.078668    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/610cdef0-0f70-46d3-9766-277ab106e219-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-0b1b2151-sdzjd\" (UID: \"610cdef0-0f70-46d3-9766-277ab106e219\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0b1b2151-sdzjd"
Jul 13 19:24:07.151157 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:24:07.151110    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0b1b2151-sdzjd"
Jul 13 19:24:07.304494 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:24:07.304462    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0b1b2151-sdzjd"]
Jul 13 19:24:07.307123 ip-10-0-135-38 kubenswrapper[2563]: W0713 19:24:07.307080    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod610cdef0_0f70_46d3_9766_277ab106e219.slice/crio-79f7bb3b2f7d47d097d9269607594ee8c50c717cf686a3d8bb6225496e7a3d0d WatchSource:0}: Error finding container 79f7bb3b2f7d47d097d9269607594ee8c50c717cf686a3d8bb6225496e7a3d0d: Status 404 returned error can't find the container with id 79f7bb3b2f7d47d097d9269607594ee8c50c717cf686a3d8bb6225496e7a3d0d
Jul 13 19:24:08.030453 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:24:08.030416    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0b1b2151-sdzjd" event={"ID":"610cdef0-0f70-46d3-9766-277ab106e219","Type":"ContainerStarted","Data":"e1da457bb0cbcecab170b49e4476f44c08544f63745ba9c17af42f97dff0ae52"}
Jul 13 19:24:08.030872 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:24:08.030475    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0b1b2151-sdzjd" event={"ID":"610cdef0-0f70-46d3-9766-277ab106e219","Type":"ContainerStarted","Data":"79f7bb3b2f7d47d097d9269607594ee8c50c717cf686a3d8bb6225496e7a3d0d"}
Jul 13 19:24:08.048041 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:24:08.047975    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0b1b2151-sdzjd" podStartSLOduration=2.047957488 podStartE2EDuration="2.047957488s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 19:24:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 19:24:08.047717346 +0000 UTC m=+1535.822593701" watchObservedRunningTime="2026-07-13 19:24:08.047957488 +0000 UTC m=+1535.822833842"
Jul 13 19:24:09.036981 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:24:09.036943    2563 generic.go:356] "Generic (PLEG): container finished" podID="610cdef0-0f70-46d3-9766-277ab106e219" containerID="e1da457bb0cbcecab170b49e4476f44c08544f63745ba9c17af42f97dff0ae52" exitCode=7
Jul 13 19:24:09.037426 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:24:09.037064    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0b1b2151-sdzjd" event={"ID":"610cdef0-0f70-46d3-9766-277ab106e219","Type":"ContainerDied","Data":"e1da457bb0cbcecab170b49e4476f44c08544f63745ba9c17af42f97dff0ae52"}
Jul 13 19:24:09.037426 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:24:09.037226    2563 scope.go:117] "RemoveContainer" containerID="e1da457bb0cbcecab170b49e4476f44c08544f63745ba9c17af42f97dff0ae52"
Jul 13 19:24:10.044299 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:24:10.044261    2563 generic.go:356] "Generic (PLEG): container finished" podID="610cdef0-0f70-46d3-9766-277ab106e219" containerID="f9f810eaa0154a36ba818bb005b132d52799c7635e5e4943a95b3444abb6b837" exitCode=0
Jul 13 19:24:10.044689 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:24:10.044351    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0b1b2151-sdzjd" event={"ID":"610cdef0-0f70-46d3-9766-277ab106e219","Type":"ContainerDied","Data":"f9f810eaa0154a36ba818bb005b132d52799c7635e5e4943a95b3444abb6b837"}
Jul 13 19:24:10.044689 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:24:10.044421    2563 scope.go:117] "RemoveContainer" containerID="e1da457bb0cbcecab170b49e4476f44c08544f63745ba9c17af42f97dff0ae52"
Jul 13 19:24:11.241182 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:24:11.241155    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0b1b2151-sdzjd"
Jul 13 19:24:11.319468 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:24:11.319361    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/610cdef0-0f70-46d3-9766-277ab106e219-maas-api-service-ca\") pod \"610cdef0-0f70-46d3-9766-277ab106e219\" (UID: \"610cdef0-0f70-46d3-9766-277ab106e219\") "
Jul 13 19:24:11.319769 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:24:11.319737    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/610cdef0-0f70-46d3-9766-277ab106e219-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "610cdef0-0f70-46d3-9766-277ab106e219" (UID: "610cdef0-0f70-46d3-9766-277ab106e219"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 19:24:11.420882 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:24:11.420847    2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/610cdef0-0f70-46d3-9766-277ab106e219-maas-api-service-ca\") on node \"ip-10-0-135-38.ec2.internal\" DevicePath \"\""
Jul 13 19:24:12.057423 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:24:12.057384    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0b1b2151-sdzjd"
Jul 13 19:24:12.057586 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:24:12.057393    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0b1b2151-sdzjd" event={"ID":"610cdef0-0f70-46d3-9766-277ab106e219","Type":"ContainerDied","Data":"79f7bb3b2f7d47d097d9269607594ee8c50c717cf686a3d8bb6225496e7a3d0d"}
Jul 13 19:24:12.057586 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:24:12.057559    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="79f7bb3b2f7d47d097d9269607594ee8c50c717cf686a3d8bb6225496e7a3d0d"
Jul 13 19:24:16.084717 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:24:16.084679    2563 generic.go:356] "Generic (PLEG): container finished" podID="603ad020-b087-4271-9a1d-fe1f7d83a5fc" containerID="99f63bd591626f5f22823c4abc73c1689689695a78fcbb5346588702e0d771f7" exitCode=0
Jul 13 19:24:16.085179 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:24:16.084755    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-0b1b2151-openshift-default-658d89c795-mk7zf" event={"ID":"603ad020-b087-4271-9a1d-fe1f7d83a5fc","Type":"ContainerDied","Data":"99f63bd591626f5f22823c4abc73c1689689695a78fcbb5346588702e0d771f7"}
Jul 13 19:24:16.085252 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:24:16.085231    2563 scope.go:117] "RemoveContainer" containerID="99f63bd591626f5f22823c4abc73c1689689695a78fcbb5346588702e0d771f7"
Jul 13 19:24:16.086333 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:24:16.086297    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 13 19:24:16.086449 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:24:16.086375    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 13 19:24:16.086449 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:24:16.086407    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 13 19:24:17.098114 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:24:17.098068    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-0b1b2151-openshift-default-658d89c795-mk7zf" event={"ID":"603ad020-b087-4271-9a1d-fe1f7d83a5fc","Type":"ContainerStarted","Data":"c8f996fd5bbe2105e8eedd2ddb032be08bd36988ff8649c0757b9f5805886247"}
Jul 13 19:24:17.906262 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:24:17.906194    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-0b1b2151-openshift-default-658d89c795-mk7zf"
Jul 13 19:24:17.907435 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:24:17.907394    2563 patch_prober.go:28] interesting pod/e2e-ait-0b1b2151-openshift-default-658d89c795-mk7zf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused" start-of-body=
Jul 13 19:24:17.907592 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:24:17.907466    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-0b1b2151-openshift-default-658d89c795-mk7zf" podUID="603ad020-b087-4271-9a1d-fe1f7d83a5fc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused"
Jul 13 19:24:18.005683 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:24:18.005643    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-0b1b2151-openshift-default-658d89c795-mk7zf"
Jul 13 19:24:18.906560 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:24:18.906512    2563 patch_prober.go:28] interesting pod/e2e-ait-0b1b2151-openshift-default-658d89c795-mk7zf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused" start-of-body=
Jul 13 19:24:18.907239 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:24:18.907199    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-0b1b2151-openshift-default-658d89c795-mk7zf" podUID="603ad020-b087-4271-9a1d-fe1f7d83a5fc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused"
Jul 13 19:24:19.909045 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:24:19.908471    2563 patch_prober.go:28] interesting pod/e2e-ait-0b1b2151-openshift-default-658d89c795-mk7zf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused" start-of-body=
Jul 13 19:24:19.909045 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:24:19.908542    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-0b1b2151-openshift-default-658d89c795-mk7zf" podUID="603ad020-b087-4271-9a1d-fe1f7d83a5fc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused"
Jul 13 19:24:20.913059 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:24:20.912491    2563 patch_prober.go:28] interesting pod/e2e-ait-0b1b2151-openshift-default-658d89c795-mk7zf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused" start-of-body=
Jul 13 19:24:20.913059 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:24:20.912574    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-0b1b2151-openshift-default-658d89c795-mk7zf" podUID="603ad020-b087-4271-9a1d-fe1f7d83a5fc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused"
Jul 13 19:24:21.910255 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:24:21.910215    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-0b1b2151-openshift-default-658d89c795-mk7zf"
Jul 13 19:24:21.911282 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:24:21.911258    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-0b1b2151-openshift-default-658d89c795-mk7zf"
Jul 13 19:24:32.172613 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:24:32.172577    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-0b1b2151-openshift-default-658d89c795-mk7zf"]
Jul 13 19:24:32.173064 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:24:32.172808    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-0b1b2151-openshift-default-658d89c795-mk7zf" podUID="603ad020-b087-4271-9a1d-fe1f7d83a5fc" containerName="istio-proxy" containerID="cri-o://c8f996fd5bbe2105e8eedd2ddb032be08bd36988ff8649c0757b9f5805886247" gracePeriod=30
Jul 13 19:24:32.761064 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:24:32.760995    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-migrate-481cf1cb-gw-openshift-default-596b5b4ff9-4bczv"]
Jul 13 19:24:32.761592 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:24:32.761572    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="610cdef0-0f70-46d3-9766-277ab106e219" containerName="revoke-keys"
Jul 13 19:24:32.761592 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:24:32.761593    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="610cdef0-0f70-46d3-9766-277ab106e219" containerName="revoke-keys"
Jul 13 19:24:32.761759 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:24:32.761729    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="610cdef0-0f70-46d3-9766-277ab106e219" containerName="revoke-keys"
Jul 13 19:24:32.761759 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:24:32.761740    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="610cdef0-0f70-46d3-9766-277ab106e219" containerName="revoke-keys"
Jul 13 19:24:32.765293 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:24:32.765265    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-481cf1cb-gw-openshift-default-596b5b4ff9-4bczv"
Jul 13 19:24:32.770150 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:24:32.770120    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-migrate-481cf1cb-gw-openshift-default-dockercfg-85r5b\""
Jul 13 19:24:32.788292 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:24:32.788256    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-481cf1cb-gw-openshift-default-596b5b4ff9-4bczv"]
Jul 13 19:24:32.815458 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:24:32.815417    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0433e49e-2581-46e5-99eb-0ca8676ed5fc-istio-envoy\") pod \"e2e-migrate-481cf1cb-gw-openshift-default-596b5b4ff9-4bczv\" (UID: \"0433e49e-2581-46e5-99eb-0ca8676ed5fc\") " pod="openshift-ingress/e2e-migrate-481cf1cb-gw-openshift-default-596b5b4ff9-4bczv"
Jul 13 19:24:32.815643 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:24:32.815489    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0433e49e-2581-46e5-99eb-0ca8676ed5fc-istiod-ca-cert\") pod \"e2e-migrate-481cf1cb-gw-openshift-default-596b5b4ff9-4bczv\" (UID: \"0433e49e-2581-46e5-99eb-0ca8676ed5fc\") " pod="openshift-ingress/e2e-migrate-481cf1cb-gw-openshift-default-596b5b4ff9-4bczv"
Jul 13 19:24:32.815643 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:24:32.815568    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0433e49e-2581-46e5-99eb-0ca8676ed5fc-istio-podinfo\") pod \"e2e-migrate-481cf1cb-gw-openshift-default-596b5b4ff9-4bczv\" (UID: \"0433e49e-2581-46e5-99eb-0ca8676ed5fc\") " pod="openshift-ingress/e2e-migrate-481cf1cb-gw-openshift-default-596b5b4ff9-4bczv"
Jul 13 19:24:32.815643 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:24:32.815597    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0433e49e-2581-46e5-99eb-0ca8676ed5fc-istio-token\") pod \"e2e-migrate-481cf1cb-gw-openshift-default-596b5b4ff9-4bczv\" (UID: \"0433e49e-2581-46e5-99eb-0ca8676ed5fc\") " pod="openshift-ingress/e2e-migrate-481cf1cb-gw-openshift-default-596b5b4ff9-4bczv"
Jul 13 19:24:32.815643 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:24:32.815627    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xj7db\" (UniqueName: \"kubernetes.io/projected/0433e49e-2581-46e5-99eb-0ca8676ed5fc-kube-api-access-xj7db\") pod \"e2e-migrate-481cf1cb-gw-openshift-default-596b5b4ff9-4bczv\" (UID: \"0433e49e-2581-46e5-99eb-0ca8676ed5fc\") " pod="openshift-ingress/e2e-migrate-481cf1cb-gw-openshift-default-596b5b4ff9-4bczv"
Jul 13 19:24:32.815883 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:24:32.815656    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0433e49e-2581-46e5-99eb-0ca8676ed5fc-workload-certs\") pod \"e2e-migrate-481cf1cb-gw-openshift-default-596b5b4ff9-4bczv\" (UID: \"0433e49e-2581-46e5-99eb-0ca8676ed5fc\") " pod="openshift-ingress/e2e-migrate-481cf1cb-gw-openshift-default-596b5b4ff9-4bczv"
Jul 13 19:24:32.815883 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:24:32.815816    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0433e49e-2581-46e5-99eb-0ca8676ed5fc-workload-socket\") pod \"e2e-migrate-481cf1cb-gw-openshift-default-596b5b4ff9-4bczv\" (UID: \"0433e49e-2581-46e5-99eb-0ca8676ed5fc\") " pod="openshift-ingress/e2e-migrate-481cf1cb-gw-openshift-default-596b5b4ff9-4bczv"
Jul 13 19:24:32.815883 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:24:32.815843    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0433e49e-2581-46e5-99eb-0ca8676ed5fc-istio-data\") pod \"e2e-migrate-481cf1cb-gw-openshift-default-596b5b4ff9-4bczv\" (UID: \"0433e49e-2581-46e5-99eb-0ca8676ed5fc\") " pod="openshift-ingress/e2e-migrate-481cf1cb-gw-openshift-default-596b5b4ff9-4bczv"
Jul 13 19:24:32.815883 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:24:32.815865    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0433e49e-2581-46e5-99eb-0ca8676ed5fc-credential-socket\") pod \"e2e-migrate-481cf1cb-gw-openshift-default-596b5b4ff9-4bczv\" (UID: \"0433e49e-2581-46e5-99eb-0ca8676ed5fc\") " pod="openshift-ingress/e2e-migrate-481cf1cb-gw-openshift-default-596b5b4ff9-4bczv"
Jul 13 19:24:32.917203 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:24:32.917156    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0433e49e-2581-46e5-99eb-0ca8676ed5fc-istio-envoy\") pod \"e2e-migrate-481cf1cb-gw-openshift-default-596b5b4ff9-4bczv\" (UID: \"0433e49e-2581-46e5-99eb-0ca8676ed5fc\") " pod="openshift-ingress/e2e-migrate-481cf1cb-gw-openshift-default-596b5b4ff9-4bczv"
Jul 13 19:24:32.917203 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:24:32.917207    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0433e49e-2581-46e5-99eb-0ca8676ed5fc-istiod-ca-cert\") pod \"e2e-migrate-481cf1cb-gw-openshift-default-596b5b4ff9-4bczv\" (UID: \"0433e49e-2581-46e5-99eb-0ca8676ed5fc\") " pod="openshift-ingress/e2e-migrate-481cf1cb-gw-openshift-default-596b5b4ff9-4bczv"
Jul 13 19:24:32.917495 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:24:32.917236    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0433e49e-2581-46e5-99eb-0ca8676ed5fc-istio-podinfo\") pod \"e2e-migrate-481cf1cb-gw-openshift-default-596b5b4ff9-4bczv\" (UID: \"0433e49e-2581-46e5-99eb-0ca8676ed5fc\") " pod="openshift-ingress/e2e-migrate-481cf1cb-gw-openshift-default-596b5b4ff9-4bczv"
Jul 13 19:24:32.917495 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:24:32.917253    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0433e49e-2581-46e5-99eb-0ca8676ed5fc-istio-token\") pod \"e2e-migrate-481cf1cb-gw-openshift-default-596b5b4ff9-4bczv\" (UID: \"0433e49e-2581-46e5-99eb-0ca8676ed5fc\") " pod="openshift-ingress/e2e-migrate-481cf1cb-gw-openshift-default-596b5b4ff9-4bczv"
Jul 13 19:24:32.917495 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:24:32.917274    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xj7db\" (UniqueName: \"kubernetes.io/projected/0433e49e-2581-46e5-99eb-0ca8676ed5fc-kube-api-access-xj7db\") pod \"e2e-migrate-481cf1cb-gw-openshift-default-596b5b4ff9-4bczv\" (UID: \"0433e49e-2581-46e5-99eb-0ca8676ed5fc\") " pod="openshift-ingress/e2e-migrate-481cf1cb-gw-openshift-default-596b5b4ff9-4bczv"
Jul 13 19:24:32.917495 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:24:32.917304    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0433e49e-2581-46e5-99eb-0ca8676ed5fc-workload-certs\") pod \"e2e-migrate-481cf1cb-gw-openshift-default-596b5b4ff9-4bczv\" (UID: \"0433e49e-2581-46e5-99eb-0ca8676ed5fc\") " pod="openshift-ingress/e2e-migrate-481cf1cb-gw-openshift-default-596b5b4ff9-4bczv"
Jul 13 19:24:32.917495 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:24:32.917371    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0433e49e-2581-46e5-99eb-0ca8676ed5fc-workload-socket\") pod \"e2e-migrate-481cf1cb-gw-openshift-default-596b5b4ff9-4bczv\" (UID: \"0433e49e-2581-46e5-99eb-0ca8676ed5fc\") " pod="openshift-ingress/e2e-migrate-481cf1cb-gw-openshift-default-596b5b4ff9-4bczv"
Jul 13 19:24:32.917495 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:24:32.917397    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0433e49e-2581-46e5-99eb-0ca8676ed5fc-istio-data\") pod \"e2e-migrate-481cf1cb-gw-openshift-default-596b5b4ff9-4bczv\" (UID: \"0433e49e-2581-46e5-99eb-0ca8676ed5fc\") " pod="openshift-ingress/e2e-migrate-481cf1cb-gw-openshift-default-596b5b4ff9-4bczv"
Jul 13 19:24:32.917495 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:24:32.917426    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0433e49e-2581-46e5-99eb-0ca8676ed5fc-credential-socket\") pod \"e2e-migrate-481cf1cb-gw-openshift-default-596b5b4ff9-4bczv\" (UID: \"0433e49e-2581-46e5-99eb-0ca8676ed5fc\") " pod="openshift-ingress/e2e-migrate-481cf1cb-gw-openshift-default-596b5b4ff9-4bczv"
Jul 13 19:24:32.917843 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:24:32.917770    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0433e49e-2581-46e5-99eb-0ca8676ed5fc-workload-certs\") pod \"e2e-migrate-481cf1cb-gw-openshift-default-596b5b4ff9-4bczv\" (UID: \"0433e49e-2581-46e5-99eb-0ca8676ed5fc\") " pod="openshift-ingress/e2e-migrate-481cf1cb-gw-openshift-default-596b5b4ff9-4bczv"
Jul 13 19:24:32.917973 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:24:32.917882    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0433e49e-2581-46e5-99eb-0ca8676ed5fc-credential-socket\") pod \"e2e-migrate-481cf1cb-gw-openshift-default-596b5b4ff9-4bczv\" (UID: \"0433e49e-2581-46e5-99eb-0ca8676ed5fc\") " pod="openshift-ingress/e2e-migrate-481cf1cb-gw-openshift-default-596b5b4ff9-4bczv"
Jul 13 19:24:32.917973 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:24:32.917926    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0433e49e-2581-46e5-99eb-0ca8676ed5fc-istio-data\") pod \"e2e-migrate-481cf1cb-gw-openshift-default-596b5b4ff9-4bczv\" (UID: \"0433e49e-2581-46e5-99eb-0ca8676ed5fc\") " pod="openshift-ingress/e2e-migrate-481cf1cb-gw-openshift-default-596b5b4ff9-4bczv"
Jul 13 19:24:32.918132 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:24:32.918011    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0433e49e-2581-46e5-99eb-0ca8676ed5fc-workload-socket\") pod \"e2e-migrate-481cf1cb-gw-openshift-default-596b5b4ff9-4bczv\" (UID: \"0433e49e-2581-46e5-99eb-0ca8676ed5fc\") " pod="openshift-ingress/e2e-migrate-481cf1cb-gw-openshift-default-596b5b4ff9-4bczv"
Jul 13 19:24:32.918217 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:24:32.918195    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0433e49e-2581-46e5-99eb-0ca8676ed5fc-istiod-ca-cert\") pod \"e2e-migrate-481cf1cb-gw-openshift-default-596b5b4ff9-4bczv\" (UID: \"0433e49e-2581-46e5-99eb-0ca8676ed5fc\") " pod="openshift-ingress/e2e-migrate-481cf1cb-gw-openshift-default-596b5b4ff9-4bczv"
Jul 13 19:24:32.919801 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:24:32.919769    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0433e49e-2581-46e5-99eb-0ca8676ed5fc-istio-envoy\") pod \"e2e-migrate-481cf1cb-gw-openshift-default-596b5b4ff9-4bczv\" (UID: \"0433e49e-2581-46e5-99eb-0ca8676ed5fc\") " pod="openshift-ingress/e2e-migrate-481cf1cb-gw-openshift-default-596b5b4ff9-4bczv"
Jul 13 19:24:32.919907 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:24:32.919886    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0433e49e-2581-46e5-99eb-0ca8676ed5fc-istio-podinfo\") pod \"e2e-migrate-481cf1cb-gw-openshift-default-596b5b4ff9-4bczv\" (UID: \"0433e49e-2581-46e5-99eb-0ca8676ed5fc\") " pod="openshift-ingress/e2e-migrate-481cf1cb-gw-openshift-default-596b5b4ff9-4bczv"
Jul 13 19:24:32.932504 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:24:32.932465    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0433e49e-2581-46e5-99eb-0ca8676ed5fc-istio-token\") pod \"e2e-migrate-481cf1cb-gw-openshift-default-596b5b4ff9-4bczv\" (UID: \"0433e49e-2581-46e5-99eb-0ca8676ed5fc\") " pod="openshift-ingress/e2e-migrate-481cf1cb-gw-openshift-default-596b5b4ff9-4bczv"
Jul 13 19:24:32.933083 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:24:32.933001    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xj7db\" (UniqueName: \"kubernetes.io/projected/0433e49e-2581-46e5-99eb-0ca8676ed5fc-kube-api-access-xj7db\") pod \"e2e-migrate-481cf1cb-gw-openshift-default-596b5b4ff9-4bczv\" (UID: \"0433e49e-2581-46e5-99eb-0ca8676ed5fc\") " pod="openshift-ingress/e2e-migrate-481cf1cb-gw-openshift-default-596b5b4ff9-4bczv"
Jul 13 19:24:33.079587 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:24:33.079475    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-481cf1cb-gw-openshift-default-596b5b4ff9-4bczv"
Jul 13 19:24:33.238381 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:24:33.238352    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-481cf1cb-gw-openshift-default-596b5b4ff9-4bczv"]
Jul 13 19:24:33.242371 ip-10-0-135-38 kubenswrapper[2563]: W0713 19:24:33.242322    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0433e49e_2581_46e5_99eb_0ca8676ed5fc.slice/crio-64bd24cdb781a6d53130ffecff08d99f1d88b6d7f88e946ffa980e2781d0f298 WatchSource:0}: Error finding container 64bd24cdb781a6d53130ffecff08d99f1d88b6d7f88e946ffa980e2781d0f298: Status 404 returned error can't find the container with id 64bd24cdb781a6d53130ffecff08d99f1d88b6d7f88e946ffa980e2781d0f298
Jul 13 19:24:33.244880 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:24:33.244847    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 13 19:24:33.244952 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:24:33.244926    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 13 19:24:33.244996 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:24:33.244957    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 13 19:24:34.193264 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:24:34.193218    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-481cf1cb-gw-openshift-default-596b5b4ff9-4bczv" event={"ID":"0433e49e-2581-46e5-99eb-0ca8676ed5fc","Type":"ContainerStarted","Data":"768808cec08c0d7f2c4f76e4663c7379ec9167c98d2563c2498fc1db73613f20"}
Jul 13 19:24:34.193451 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:24:34.193290    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-481cf1cb-gw-openshift-default-596b5b4ff9-4bczv" event={"ID":"0433e49e-2581-46e5-99eb-0ca8676ed5fc","Type":"ContainerStarted","Data":"64bd24cdb781a6d53130ffecff08d99f1d88b6d7f88e946ffa980e2781d0f298"}
Jul 13 19:24:35.079663 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:24:35.079622    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-481cf1cb-gw-openshift-default-596b5b4ff9-4bczv"
Jul 13 19:24:35.090481 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:24:35.090452    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-481cf1cb-gw-openshift-default-596b5b4ff9-4bczv"
Jul 13 19:24:35.115643 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:24:35.115579    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-migrate-481cf1cb-gw-openshift-default-596b5b4ff9-4bczv" podStartSLOduration=3.115560331 podStartE2EDuration="3.115560331s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 19:24:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 19:24:34.266913821 +0000 UTC m=+1562.041790178" watchObservedRunningTime="2026-07-13 19:24:35.115560331 +0000 UTC m=+1562.890436687"
Jul 13 19:24:35.199189 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:24:35.199145    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-481cf1cb-gw-openshift-default-596b5b4ff9-4bczv"
Jul 13 19:24:35.200421 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:24:35.200401    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-481cf1cb-gw-openshift-default-596b5b4ff9-4bczv"
Jul 13 19:24:36.913111 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:24:36.913069    2563 patch_prober.go:28] interesting pod/e2e-ait-0b1b2151-openshift-default-658d89c795-mk7zf container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=upstream connect error or disconnect/reset before headers. reset reason: remote connection failure, transport failure reason: delayed connect error: Connection refused
Jul 13 19:24:36.913545 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:24:36.913148    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-0b1b2151-openshift-default-658d89c795-mk7zf" podUID="603ad020-b087-4271-9a1d-fe1f7d83a5fc" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 13 19:24:37.442961 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:24:37.442889    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-0b1b2151-openshift-default-658d89c795-mk7zf"
Jul 13 19:24:37.463576 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:24:37.463530    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/603ad020-b087-4271-9a1d-fe1f7d83a5fc-istio-envoy\") pod \"603ad020-b087-4271-9a1d-fe1f7d83a5fc\" (UID: \"603ad020-b087-4271-9a1d-fe1f7d83a5fc\") "
Jul 13 19:24:37.463963 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:24:37.463606    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pcxgg\" (UniqueName: \"kubernetes.io/projected/603ad020-b087-4271-9a1d-fe1f7d83a5fc-kube-api-access-pcxgg\") pod \"603ad020-b087-4271-9a1d-fe1f7d83a5fc\" (UID: \"603ad020-b087-4271-9a1d-fe1f7d83a5fc\") "
Jul 13 19:24:37.463963 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:24:37.463657    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/603ad020-b087-4271-9a1d-fe1f7d83a5fc-workload-certs\") pod \"603ad020-b087-4271-9a1d-fe1f7d83a5fc\" (UID: \"603ad020-b087-4271-9a1d-fe1f7d83a5fc\") "
Jul 13 19:24:37.463963 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:24:37.463682    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/603ad020-b087-4271-9a1d-fe1f7d83a5fc-istio-podinfo\") pod \"603ad020-b087-4271-9a1d-fe1f7d83a5fc\" (UID: \"603ad020-b087-4271-9a1d-fe1f7d83a5fc\") "
Jul 13 19:24:37.463963 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:24:37.463718    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/603ad020-b087-4271-9a1d-fe1f7d83a5fc-istio-data\") pod \"603ad020-b087-4271-9a1d-fe1f7d83a5fc\" (UID: \"603ad020-b087-4271-9a1d-fe1f7d83a5fc\") "
Jul 13 19:24:37.463963 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:24:37.463762    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/603ad020-b087-4271-9a1d-fe1f7d83a5fc-workload-socket\") pod \"603ad020-b087-4271-9a1d-fe1f7d83a5fc\" (UID: \"603ad020-b087-4271-9a1d-fe1f7d83a5fc\") "
Jul 13 19:24:37.463963 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:24:37.463788    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/603ad020-b087-4271-9a1d-fe1f7d83a5fc-credential-socket\") pod \"603ad020-b087-4271-9a1d-fe1f7d83a5fc\" (UID: \"603ad020-b087-4271-9a1d-fe1f7d83a5fc\") "
Jul 13 19:24:37.463963 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:24:37.463835    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/603ad020-b087-4271-9a1d-fe1f7d83a5fc-istio-token\") pod \"603ad020-b087-4271-9a1d-fe1f7d83a5fc\" (UID: \"603ad020-b087-4271-9a1d-fe1f7d83a5fc\") "
Jul 13 19:24:37.463963 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:24:37.463898    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/603ad020-b087-4271-9a1d-fe1f7d83a5fc-istiod-ca-cert\") pod \"603ad020-b087-4271-9a1d-fe1f7d83a5fc\" (UID: \"603ad020-b087-4271-9a1d-fe1f7d83a5fc\") "
Jul 13 19:24:37.464553 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:24:37.464003    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/603ad020-b087-4271-9a1d-fe1f7d83a5fc-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "603ad020-b087-4271-9a1d-fe1f7d83a5fc" (UID: "603ad020-b087-4271-9a1d-fe1f7d83a5fc"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 19:24:37.464553 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:24:37.464205    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/603ad020-b087-4271-9a1d-fe1f7d83a5fc-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "603ad020-b087-4271-9a1d-fe1f7d83a5fc" (UID: "603ad020-b087-4271-9a1d-fe1f7d83a5fc"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 19:24:37.464553 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:24:37.464259    2563 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/603ad020-b087-4271-9a1d-fe1f7d83a5fc-workload-certs\") on node \"ip-10-0-135-38.ec2.internal\" DevicePath \"\""
Jul 13 19:24:37.464553 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:24:37.464280    2563 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/603ad020-b087-4271-9a1d-fe1f7d83a5fc-credential-socket\") on node \"ip-10-0-135-38.ec2.internal\" DevicePath \"\""
Jul 13 19:24:37.464553 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:24:37.464426    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/603ad020-b087-4271-9a1d-fe1f7d83a5fc-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "603ad020-b087-4271-9a1d-fe1f7d83a5fc" (UID: "603ad020-b087-4271-9a1d-fe1f7d83a5fc"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 19:24:37.464794 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:24:37.464762    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/603ad020-b087-4271-9a1d-fe1f7d83a5fc-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "603ad020-b087-4271-9a1d-fe1f7d83a5fc" (UID: "603ad020-b087-4271-9a1d-fe1f7d83a5fc"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 19:24:37.465059 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:24:37.465014    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/603ad020-b087-4271-9a1d-fe1f7d83a5fc-istio-data" (OuterVolumeSpecName: "istio-data") pod "603ad020-b087-4271-9a1d-fe1f7d83a5fc" (UID: "603ad020-b087-4271-9a1d-fe1f7d83a5fc"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 19:24:37.467068 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:24:37.467038    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/603ad020-b087-4271-9a1d-fe1f7d83a5fc-istio-token" (OuterVolumeSpecName: "istio-token") pod "603ad020-b087-4271-9a1d-fe1f7d83a5fc" (UID: "603ad020-b087-4271-9a1d-fe1f7d83a5fc"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 19:24:37.467190 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:24:37.467169    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/603ad020-b087-4271-9a1d-fe1f7d83a5fc-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "603ad020-b087-4271-9a1d-fe1f7d83a5fc" (UID: "603ad020-b087-4271-9a1d-fe1f7d83a5fc"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 19:24:37.467398 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:24:37.467359    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/603ad020-b087-4271-9a1d-fe1f7d83a5fc-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "603ad020-b087-4271-9a1d-fe1f7d83a5fc" (UID: "603ad020-b087-4271-9a1d-fe1f7d83a5fc"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 13 19:24:37.467679 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:24:37.467654    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/603ad020-b087-4271-9a1d-fe1f7d83a5fc-kube-api-access-pcxgg" (OuterVolumeSpecName: "kube-api-access-pcxgg") pod "603ad020-b087-4271-9a1d-fe1f7d83a5fc" (UID: "603ad020-b087-4271-9a1d-fe1f7d83a5fc"). InnerVolumeSpecName "kube-api-access-pcxgg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 19:24:37.565257 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:24:37.565197    2563 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/603ad020-b087-4271-9a1d-fe1f7d83a5fc-istiod-ca-cert\") on node \"ip-10-0-135-38.ec2.internal\" DevicePath \"\""
Jul 13 19:24:37.565257 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:24:37.565249    2563 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/603ad020-b087-4271-9a1d-fe1f7d83a5fc-istio-envoy\") on node \"ip-10-0-135-38.ec2.internal\" DevicePath \"\""
Jul 13 19:24:37.565257 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:24:37.565263    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pcxgg\" (UniqueName: \"kubernetes.io/projected/603ad020-b087-4271-9a1d-fe1f7d83a5fc-kube-api-access-pcxgg\") on node \"ip-10-0-135-38.ec2.internal\" DevicePath \"\""
Jul 13 19:24:37.565564 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:24:37.565278    2563 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/603ad020-b087-4271-9a1d-fe1f7d83a5fc-istio-podinfo\") on node \"ip-10-0-135-38.ec2.internal\" DevicePath \"\""
Jul 13 19:24:37.565564 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:24:37.565290    2563 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/603ad020-b087-4271-9a1d-fe1f7d83a5fc-istio-data\") on node \"ip-10-0-135-38.ec2.internal\" DevicePath \"\""
Jul 13 19:24:37.565564 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:24:37.565302    2563 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/603ad020-b087-4271-9a1d-fe1f7d83a5fc-workload-socket\") on node \"ip-10-0-135-38.ec2.internal\" DevicePath \"\""
Jul 13 19:24:37.565564 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:24:37.565314    2563 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/603ad020-b087-4271-9a1d-fe1f7d83a5fc-istio-token\") on node \"ip-10-0-135-38.ec2.internal\" DevicePath \"\""
Jul 13 19:24:38.216459 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:24:38.216418    2563 generic.go:356] "Generic (PLEG): container finished" podID="603ad020-b087-4271-9a1d-fe1f7d83a5fc" containerID="c8f996fd5bbe2105e8eedd2ddb032be08bd36988ff8649c0757b9f5805886247" exitCode=0
Jul 13 19:24:38.216887 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:24:38.216476    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-0b1b2151-openshift-default-658d89c795-mk7zf"
Jul 13 19:24:38.216887 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:24:38.216471    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-0b1b2151-openshift-default-658d89c795-mk7zf" event={"ID":"603ad020-b087-4271-9a1d-fe1f7d83a5fc","Type":"ContainerDied","Data":"c8f996fd5bbe2105e8eedd2ddb032be08bd36988ff8649c0757b9f5805886247"}
Jul 13 19:24:38.216887 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:24:38.216599    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-0b1b2151-openshift-default-658d89c795-mk7zf" event={"ID":"603ad020-b087-4271-9a1d-fe1f7d83a5fc","Type":"ContainerDied","Data":"614a6c372ac888abe236f03b0b1f76882b34ed7a347be198028be460ec6f3469"}
Jul 13 19:24:38.216887 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:24:38.216630    2563 scope.go:117] "RemoveContainer" containerID="c8f996fd5bbe2105e8eedd2ddb032be08bd36988ff8649c0757b9f5805886247"
Jul 13 19:24:38.226395 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:24:38.226373    2563 scope.go:117] "RemoveContainer" containerID="99f63bd591626f5f22823c4abc73c1689689695a78fcbb5346588702e0d771f7"
Jul 13 19:24:38.235429 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:24:38.235408    2563 scope.go:117] "RemoveContainer" containerID="c8f996fd5bbe2105e8eedd2ddb032be08bd36988ff8649c0757b9f5805886247"
Jul 13 19:24:38.235731 ip-10-0-135-38 kubenswrapper[2563]: E0713 19:24:38.235711    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c8f996fd5bbe2105e8eedd2ddb032be08bd36988ff8649c0757b9f5805886247\": container with ID starting with c8f996fd5bbe2105e8eedd2ddb032be08bd36988ff8649c0757b9f5805886247 not found: ID does not exist" containerID="c8f996fd5bbe2105e8eedd2ddb032be08bd36988ff8649c0757b9f5805886247"
Jul 13 19:24:38.235804 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:24:38.235740    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c8f996fd5bbe2105e8eedd2ddb032be08bd36988ff8649c0757b9f5805886247"} err="failed to get container status \"c8f996fd5bbe2105e8eedd2ddb032be08bd36988ff8649c0757b9f5805886247\": rpc error: code = NotFound desc = could not find container \"c8f996fd5bbe2105e8eedd2ddb032be08bd36988ff8649c0757b9f5805886247\": container with ID starting with c8f996fd5bbe2105e8eedd2ddb032be08bd36988ff8649c0757b9f5805886247 not found: ID does not exist"
Jul 13 19:24:38.235804 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:24:38.235761    2563 scope.go:117] "RemoveContainer" containerID="99f63bd591626f5f22823c4abc73c1689689695a78fcbb5346588702e0d771f7"
Jul 13 19:24:38.235984 ip-10-0-135-38 kubenswrapper[2563]: E0713 19:24:38.235966    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"99f63bd591626f5f22823c4abc73c1689689695a78fcbb5346588702e0d771f7\": container with ID starting with 99f63bd591626f5f22823c4abc73c1689689695a78fcbb5346588702e0d771f7 not found: ID does not exist" containerID="99f63bd591626f5f22823c4abc73c1689689695a78fcbb5346588702e0d771f7"
Jul 13 19:24:38.236057 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:24:38.235988    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"99f63bd591626f5f22823c4abc73c1689689695a78fcbb5346588702e0d771f7"} err="failed to get container status \"99f63bd591626f5f22823c4abc73c1689689695a78fcbb5346588702e0d771f7\": rpc error: code = NotFound desc = could not find container \"99f63bd591626f5f22823c4abc73c1689689695a78fcbb5346588702e0d771f7\": container with ID starting with 99f63bd591626f5f22823c4abc73c1689689695a78fcbb5346588702e0d771f7 not found: ID does not exist"
Jul 13 19:24:38.238519 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:24:38.238491    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-0b1b2151-openshift-default-658d89c795-mk7zf"]
Jul 13 19:24:38.243155 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:24:38.243124    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-0b1b2151-openshift-default-658d89c795-mk7zf"]
Jul 13 19:24:38.562634 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:24:38.562536    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-481cf1cb-9vd8l"]
Jul 13 19:24:38.562939 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:24:38.562916    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="610cdef0-0f70-46d3-9766-277ab106e219" containerName="revoke-keys"
Jul 13 19:24:38.562939 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:24:38.562930    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="610cdef0-0f70-46d3-9766-277ab106e219" containerName="revoke-keys"
Jul 13 19:24:38.563014 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:24:38.562942    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="603ad020-b087-4271-9a1d-fe1f7d83a5fc" containerName="istio-proxy"
Jul 13 19:24:38.563014 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:24:38.562950    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="603ad020-b087-4271-9a1d-fe1f7d83a5fc" containerName="istio-proxy"
Jul 13 19:24:38.563107 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:24:38.563036    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="603ad020-b087-4271-9a1d-fe1f7d83a5fc" containerName="istio-proxy"
Jul 13 19:24:38.567757 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:24:38.567732    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-481cf1cb-9vd8l"
Jul 13 19:24:38.570174 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:24:38.570148    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-llvfh\""
Jul 13 19:24:38.574154 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:24:38.574121    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-481cf1cb-9vd8l"]
Jul 13 19:24:38.675400 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:24:38.675353    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7d4fcc40-0a08-4347-840a-aaa05dc411f8-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-481cf1cb-9vd8l\" (UID: \"7d4fcc40-0a08-4347-840a-aaa05dc411f8\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-481cf1cb-9vd8l"
Jul 13 19:24:38.756656 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:24:38.756604    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="603ad020-b087-4271-9a1d-fe1f7d83a5fc" path="/var/lib/kubelet/pods/603ad020-b087-4271-9a1d-fe1f7d83a5fc/volumes"
Jul 13 19:24:38.776427 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:24:38.776386    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7d4fcc40-0a08-4347-840a-aaa05dc411f8-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-481cf1cb-9vd8l\" (UID: \"7d4fcc40-0a08-4347-840a-aaa05dc411f8\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-481cf1cb-9vd8l"
Jul 13 19:24:38.777096 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:24:38.777075    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7d4fcc40-0a08-4347-840a-aaa05dc411f8-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-481cf1cb-9vd8l\" (UID: \"7d4fcc40-0a08-4347-840a-aaa05dc411f8\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-481cf1cb-9vd8l"
Jul 13 19:24:38.880689 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:24:38.880652    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-481cf1cb-9vd8l"
Jul 13 19:24:39.051135 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:24:39.051102    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-481cf1cb-9vd8l"]
Jul 13 19:24:39.054148 ip-10-0-135-38 kubenswrapper[2563]: W0713 19:24:39.054096    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7d4fcc40_0a08_4347_840a_aaa05dc411f8.slice/crio-44cbde174847d66fd29306e08d478025009ce85bd0cbf6b49e086010276d8302 WatchSource:0}: Error finding container 44cbde174847d66fd29306e08d478025009ce85bd0cbf6b49e086010276d8302: Status 404 returned error can't find the container with id 44cbde174847d66fd29306e08d478025009ce85bd0cbf6b49e086010276d8302
Jul 13 19:24:39.224286 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:24:39.224194    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-481cf1cb-9vd8l" event={"ID":"7d4fcc40-0a08-4347-840a-aaa05dc411f8","Type":"ContainerStarted","Data":"44cbde174847d66fd29306e08d478025009ce85bd0cbf6b49e086010276d8302"}
Jul 13 19:24:40.230329 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:24:40.230285    2563 generic.go:356] "Generic (PLEG): container finished" podID="7d4fcc40-0a08-4347-840a-aaa05dc411f8" containerID="941439b1c705308390a0bc3881ed97b7d7d7bfb1f6876378075ae7b4fb45001a" exitCode=7
Jul 13 19:24:40.230727 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:24:40.230343    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-481cf1cb-9vd8l" event={"ID":"7d4fcc40-0a08-4347-840a-aaa05dc411f8","Type":"ContainerDied","Data":"941439b1c705308390a0bc3881ed97b7d7d7bfb1f6876378075ae7b4fb45001a"}
Jul 13 19:24:40.230727 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:24:40.230601    2563 scope.go:117] "RemoveContainer" containerID="941439b1c705308390a0bc3881ed97b7d7d7bfb1f6876378075ae7b4fb45001a"
Jul 13 19:24:41.238100 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:24:41.237990    2563 generic.go:356] "Generic (PLEG): container finished" podID="7d4fcc40-0a08-4347-840a-aaa05dc411f8" containerID="32fdb08e90f20ea1f8e426adf94a37d7991e11bab60d83ff0d6df3fe4bbe9b40" exitCode=7
Jul 13 19:24:41.238100 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:24:41.238063    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-481cf1cb-9vd8l" event={"ID":"7d4fcc40-0a08-4347-840a-aaa05dc411f8","Type":"ContainerDied","Data":"32fdb08e90f20ea1f8e426adf94a37d7991e11bab60d83ff0d6df3fe4bbe9b40"}
Jul 13 19:24:41.238616 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:24:41.238140    2563 scope.go:117] "RemoveContainer" containerID="941439b1c705308390a0bc3881ed97b7d7d7bfb1f6876378075ae7b4fb45001a"
Jul 13 19:24:41.238616 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:24:41.238312    2563 scope.go:117] "RemoveContainer" containerID="32fdb08e90f20ea1f8e426adf94a37d7991e11bab60d83ff0d6df3fe4bbe9b40"
Jul 13 19:24:41.238616 ip-10-0-135-38 kubenswrapper[2563]: E0713 19:24:41.238570    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-migrate-481cf1cb-9vd8l_odh-ai-gateway-infra(7d4fcc40-0a08-4347-840a-aaa05dc411f8)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-481cf1cb-9vd8l" podUID="7d4fcc40-0a08-4347-840a-aaa05dc411f8"
Jul 13 19:24:42.247803 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:24:42.247707    2563 scope.go:117] "RemoveContainer" containerID="32fdb08e90f20ea1f8e426adf94a37d7991e11bab60d83ff0d6df3fe4bbe9b40"
Jul 13 19:24:42.248251 ip-10-0-135-38 kubenswrapper[2563]: E0713 19:24:42.247955    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-migrate-481cf1cb-9vd8l_odh-ai-gateway-infra(7d4fcc40-0a08-4347-840a-aaa05dc411f8)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-481cf1cb-9vd8l" podUID="7d4fcc40-0a08-4347-840a-aaa05dc411f8"
Jul 13 19:24:48.279895 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:24:48.279857    2563 generic.go:356] "Generic (PLEG): container finished" podID="0433e49e-2581-46e5-99eb-0ca8676ed5fc" containerID="768808cec08c0d7f2c4f76e4663c7379ec9167c98d2563c2498fc1db73613f20" exitCode=0
Jul 13 19:24:48.280365 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:24:48.279937    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-481cf1cb-gw-openshift-default-596b5b4ff9-4bczv" event={"ID":"0433e49e-2581-46e5-99eb-0ca8676ed5fc","Type":"ContainerDied","Data":"768808cec08c0d7f2c4f76e4663c7379ec9167c98d2563c2498fc1db73613f20"}
Jul 13 19:24:48.280409 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:24:48.280373    2563 scope.go:117] "RemoveContainer" containerID="768808cec08c0d7f2c4f76e4663c7379ec9167c98d2563c2498fc1db73613f20"
Jul 13 19:24:48.284004 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:24:48.282990    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 13 19:24:48.284004 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:24:48.283172    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 13 19:24:48.284004 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:24:48.283270    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 13 19:24:49.288051 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:24:49.287846    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-481cf1cb-gw-openshift-default-596b5b4ff9-4bczv" event={"ID":"0433e49e-2581-46e5-99eb-0ca8676ed5fc","Type":"ContainerStarted","Data":"990a2e8ed5f0ffc9c3d9728527cee39884cf21bba05e5064893b644ed6059b72"}
Jul 13 19:24:50.080460 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:24:50.080417    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-481cf1cb-gw-openshift-default-596b5b4ff9-4bczv"
Jul 13 19:24:50.081793 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:24:50.081762    2563 patch_prober.go:28] interesting pod/e2e-migrate-481cf1cb-gw-openshift-default-596b5b4ff9-4bczv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused" start-of-body=
Jul 13 19:24:50.081868 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:24:50.081823    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-481cf1cb-gw-openshift-default-596b5b4ff9-4bczv" podUID="0433e49e-2581-46e5-99eb-0ca8676ed5fc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused"
Jul 13 19:24:50.200125 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:24:50.200081    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-481cf1cb-gw-openshift-default-596b5b4ff9-4bczv"
Jul 13 19:24:51.080480 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:24:51.080443    2563 patch_prober.go:28] interesting pod/e2e-migrate-481cf1cb-gw-openshift-default-596b5b4ff9-4bczv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused" start-of-body=
Jul 13 19:24:51.080902 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:24:51.080502    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-481cf1cb-gw-openshift-default-596b5b4ff9-4bczv" podUID="0433e49e-2581-46e5-99eb-0ca8676ed5fc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused"
Jul 13 19:24:52.080243 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:24:52.080203    2563 patch_prober.go:28] interesting pod/e2e-migrate-481cf1cb-gw-openshift-default-596b5b4ff9-4bczv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused" start-of-body=
Jul 13 19:24:52.080448 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:24:52.080268    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-481cf1cb-gw-openshift-default-596b5b4ff9-4bczv" podUID="0433e49e-2581-46e5-99eb-0ca8676ed5fc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused"
Jul 13 19:24:53.080249 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:24:53.080211    2563 patch_prober.go:28] interesting pod/e2e-migrate-481cf1cb-gw-openshift-default-596b5b4ff9-4bczv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused" start-of-body=
Jul 13 19:24:53.080674 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:24:53.080268    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-481cf1cb-gw-openshift-default-596b5b4ff9-4bczv" podUID="0433e49e-2581-46e5-99eb-0ca8676ed5fc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused"
Jul 13 19:24:53.750723 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:24:53.750684    2563 scope.go:117] "RemoveContainer" containerID="32fdb08e90f20ea1f8e426adf94a37d7991e11bab60d83ff0d6df3fe4bbe9b40"
Jul 13 19:24:54.085570 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:24:54.085479    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-481cf1cb-gw-openshift-default-596b5b4ff9-4bczv"
Jul 13 19:24:54.086599 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:24:54.086570    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-481cf1cb-gw-openshift-default-596b5b4ff9-4bczv"
Jul 13 19:24:54.323852 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:24:54.323807    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-481cf1cb-9vd8l" event={"ID":"7d4fcc40-0a08-4347-840a-aaa05dc411f8","Type":"ContainerStarted","Data":"d8c3c6dbee88e0f2066104760b8936a148215d1c52f6a9ffc6ec9b51d9d438bc"}
Jul 13 19:24:55.331344 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:24:55.331307    2563 generic.go:356] "Generic (PLEG): container finished" podID="7d4fcc40-0a08-4347-840a-aaa05dc411f8" containerID="d8c3c6dbee88e0f2066104760b8936a148215d1c52f6a9ffc6ec9b51d9d438bc" exitCode=0
Jul 13 19:24:55.331771 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:24:55.331364    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-481cf1cb-9vd8l" event={"ID":"7d4fcc40-0a08-4347-840a-aaa05dc411f8","Type":"ContainerDied","Data":"d8c3c6dbee88e0f2066104760b8936a148215d1c52f6a9ffc6ec9b51d9d438bc"}
Jul 13 19:24:55.331771 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:24:55.331416    2563 scope.go:117] "RemoveContainer" containerID="32fdb08e90f20ea1f8e426adf94a37d7991e11bab60d83ff0d6df3fe4bbe9b40"
Jul 13 19:24:55.356269 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:24:55.356232    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-481cf1cb-9vd8l"]
Jul 13 19:24:56.489417 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:24:56.489386    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-481cf1cb-9vd8l"
Jul 13 19:24:56.549373 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:24:56.549333    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7d4fcc40-0a08-4347-840a-aaa05dc411f8-maas-api-service-ca\") pod \"7d4fcc40-0a08-4347-840a-aaa05dc411f8\" (UID: \"7d4fcc40-0a08-4347-840a-aaa05dc411f8\") "
Jul 13 19:24:56.549727 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:24:56.549699    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7d4fcc40-0a08-4347-840a-aaa05dc411f8-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "7d4fcc40-0a08-4347-840a-aaa05dc411f8" (UID: "7d4fcc40-0a08-4347-840a-aaa05dc411f8"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 19:24:56.650534 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:24:56.650494    2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7d4fcc40-0a08-4347-840a-aaa05dc411f8-maas-api-service-ca\") on node \"ip-10-0-135-38.ec2.internal\" DevicePath \"\""
Jul 13 19:24:57.344632 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:24:57.344597    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-481cf1cb-9vd8l"
Jul 13 19:24:57.344826 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:24:57.344603    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-481cf1cb-9vd8l" event={"ID":"7d4fcc40-0a08-4347-840a-aaa05dc411f8","Type":"ContainerDied","Data":"44cbde174847d66fd29306e08d478025009ce85bd0cbf6b49e086010276d8302"}
Jul 13 19:24:57.344826 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:24:57.344731    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="44cbde174847d66fd29306e08d478025009ce85bd0cbf6b49e086010276d8302"
Jul 13 19:24:57.375495 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:24:57.375457    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-481cf1cb-9vd8l"]
Jul 13 19:24:57.381879 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:24:57.381844    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-481cf1cb-9vd8l"]
Jul 13 19:24:58.756079 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:24:58.756045    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7d4fcc40-0a08-4347-840a-aaa05dc411f8" path="/var/lib/kubelet/pods/7d4fcc40-0a08-4347-840a-aaa05dc411f8/volumes"
Jul 13 19:25:28.622610 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:25:28.622566    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-481cf1cb-khbdp"]
Jul 13 19:25:28.623075 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:25:28.622964    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7d4fcc40-0a08-4347-840a-aaa05dc411f8" containerName="revoke-keys"
Jul 13 19:25:28.623075 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:25:28.622978    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="7d4fcc40-0a08-4347-840a-aaa05dc411f8" containerName="revoke-keys"
Jul 13 19:25:28.623075 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:25:28.622998    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="603ad020-b087-4271-9a1d-fe1f7d83a5fc" containerName="istio-proxy"
Jul 13 19:25:28.623075 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:25:28.623011    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="603ad020-b087-4271-9a1d-fe1f7d83a5fc" containerName="istio-proxy"
Jul 13 19:25:28.623075 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:25:28.623038    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7d4fcc40-0a08-4347-840a-aaa05dc411f8" containerName="revoke-keys"
Jul 13 19:25:28.623075 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:25:28.623045    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="7d4fcc40-0a08-4347-840a-aaa05dc411f8" containerName="revoke-keys"
Jul 13 19:25:28.623429 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:25:28.623115    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="7d4fcc40-0a08-4347-840a-aaa05dc411f8" containerName="revoke-keys"
Jul 13 19:25:28.623429 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:25:28.623125    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="7d4fcc40-0a08-4347-840a-aaa05dc411f8" containerName="revoke-keys"
Jul 13 19:25:28.623429 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:25:28.623132    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="603ad020-b087-4271-9a1d-fe1f7d83a5fc" containerName="istio-proxy"
Jul 13 19:25:28.623429 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:25:28.623138    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="7d4fcc40-0a08-4347-840a-aaa05dc411f8" containerName="revoke-keys"
Jul 13 19:25:28.626446 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:25:28.626426    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-481cf1cb-khbdp"
Jul 13 19:25:28.628817 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:25:28.628787    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-llvfh\""
Jul 13 19:25:28.635465 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:25:28.635430    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-481cf1cb-khbdp"]
Jul 13 19:25:28.743305 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:25:28.743267    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0d46caf3-569a-486e-9063-582e159700cb-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-481cf1cb-khbdp\" (UID: \"0d46caf3-569a-486e-9063-582e159700cb\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-481cf1cb-khbdp"
Jul 13 19:25:28.844542 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:25:28.844500    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0d46caf3-569a-486e-9063-582e159700cb-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-481cf1cb-khbdp\" (UID: \"0d46caf3-569a-486e-9063-582e159700cb\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-481cf1cb-khbdp"
Jul 13 19:25:28.845221 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:25:28.845198    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0d46caf3-569a-486e-9063-582e159700cb-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-481cf1cb-khbdp\" (UID: \"0d46caf3-569a-486e-9063-582e159700cb\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-481cf1cb-khbdp"
Jul 13 19:25:28.938193 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:25:28.938073    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-481cf1cb-khbdp"
Jul 13 19:25:29.084560 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:25:29.084507    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-481cf1cb-khbdp"]
Jul 13 19:25:29.086951 ip-10-0-135-38 kubenswrapper[2563]: W0713 19:25:29.086916    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0d46caf3_569a_486e_9063_582e159700cb.slice/crio-0ccbe188660e41463a6e5faf8c5a8de79d958dc1c3a1b988cc8808b150c7a74a WatchSource:0}: Error finding container 0ccbe188660e41463a6e5faf8c5a8de79d958dc1c3a1b988cc8808b150c7a74a: Status 404 returned error can't find the container with id 0ccbe188660e41463a6e5faf8c5a8de79d958dc1c3a1b988cc8808b150c7a74a
Jul 13 19:25:29.504578 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:25:29.504532    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-481cf1cb-khbdp" event={"ID":"0d46caf3-569a-486e-9063-582e159700cb","Type":"ContainerStarted","Data":"f3fd1d57ab37be4df004b0671fedba4a32bb4c842a521cfa8d2fcf5d16e5ba83"}
Jul 13 19:25:29.504783 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:25:29.504641    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-481cf1cb-khbdp" event={"ID":"0d46caf3-569a-486e-9063-582e159700cb","Type":"ContainerStarted","Data":"0ccbe188660e41463a6e5faf8c5a8de79d958dc1c3a1b988cc8808b150c7a74a"}
Jul 13 19:25:29.522821 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:25:29.522760    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-481cf1cb-khbdp" podStartSLOduration=1.522745661 podStartE2EDuration="1.522745661s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 19:25:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 19:25:29.521477606 +0000 UTC m=+1617.296353961" watchObservedRunningTime="2026-07-13 19:25:29.522745661 +0000 UTC m=+1617.297622017"
Jul 13 19:25:30.514113 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:25:30.514068    2563 generic.go:356] "Generic (PLEG): container finished" podID="0d46caf3-569a-486e-9063-582e159700cb" containerID="f3fd1d57ab37be4df004b0671fedba4a32bb4c842a521cfa8d2fcf5d16e5ba83" exitCode=0
Jul 13 19:25:30.514552 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:25:30.514142    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-481cf1cb-khbdp" event={"ID":"0d46caf3-569a-486e-9063-582e159700cb","Type":"ContainerDied","Data":"f3fd1d57ab37be4df004b0671fedba4a32bb4c842a521cfa8d2fcf5d16e5ba83"}
Jul 13 19:25:31.663748 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:25:31.663715    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-481cf1cb-khbdp"
Jul 13 19:25:31.772249 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:25:31.772129    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0d46caf3-569a-486e-9063-582e159700cb-maas-api-service-ca\") pod \"0d46caf3-569a-486e-9063-582e159700cb\" (UID: \"0d46caf3-569a-486e-9063-582e159700cb\") "
Jul 13 19:25:31.772488 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:25:31.772464    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0d46caf3-569a-486e-9063-582e159700cb-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "0d46caf3-569a-486e-9063-582e159700cb" (UID: "0d46caf3-569a-486e-9063-582e159700cb"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 19:25:31.873293 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:25:31.873253    2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0d46caf3-569a-486e-9063-582e159700cb-maas-api-service-ca\") on node \"ip-10-0-135-38.ec2.internal\" DevicePath \"\""
Jul 13 19:25:32.525623 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:25:32.525591    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-481cf1cb-khbdp"
Jul 13 19:25:32.525623 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:25:32.525606    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-481cf1cb-khbdp" event={"ID":"0d46caf3-569a-486e-9063-582e159700cb","Type":"ContainerDied","Data":"0ccbe188660e41463a6e5faf8c5a8de79d958dc1c3a1b988cc8808b150c7a74a"}
Jul 13 19:25:32.525856 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:25:32.525662    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0ccbe188660e41463a6e5faf8c5a8de79d958dc1c3a1b988cc8808b150c7a74a"
Jul 13 19:25:38.684660 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:25:38.684616    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-481cf1cb-gw-openshift-default-596b5b4ff9-4bczv"]
Jul 13 19:25:38.685098 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:25:38.684910    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-migrate-481cf1cb-gw-openshift-default-596b5b4ff9-4bczv" podUID="0433e49e-2581-46e5-99eb-0ca8676ed5fc" containerName="istio-proxy" containerID="cri-o://990a2e8ed5f0ffc9c3d9728527cee39884cf21bba05e5064893b644ed6059b72" gracePeriod=30
Jul 13 19:25:39.088886 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:25:39.088782    2563 patch_prober.go:28] interesting pod/e2e-migrate-481cf1cb-gw-openshift-default-596b5b4ff9-4bczv container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 13 19:25:39.088886 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:25:39.088856    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-migrate-481cf1cb-gw-openshift-default-596b5b4ff9-4bczv" podUID="0433e49e-2581-46e5-99eb-0ca8676ed5fc" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 13 19:25:43.949455 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:25:43.949369    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-481cf1cb-gw-openshift-default-596b5b4ff9-4bczv"
Jul 13 19:25:44.086425 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:25:44.086384    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0433e49e-2581-46e5-99eb-0ca8676ed5fc-istiod-ca-cert\") pod \"0433e49e-2581-46e5-99eb-0ca8676ed5fc\" (UID: \"0433e49e-2581-46e5-99eb-0ca8676ed5fc\") "
Jul 13 19:25:44.086425 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:25:44.086428    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0433e49e-2581-46e5-99eb-0ca8676ed5fc-istio-token\") pod \"0433e49e-2581-46e5-99eb-0ca8676ed5fc\" (UID: \"0433e49e-2581-46e5-99eb-0ca8676ed5fc\") "
Jul 13 19:25:44.086841 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:25:44.086482    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0433e49e-2581-46e5-99eb-0ca8676ed5fc-istio-envoy\") pod \"0433e49e-2581-46e5-99eb-0ca8676ed5fc\" (UID: \"0433e49e-2581-46e5-99eb-0ca8676ed5fc\") "
Jul 13 19:25:44.086841 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:25:44.086511    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0433e49e-2581-46e5-99eb-0ca8676ed5fc-istio-data\") pod \"0433e49e-2581-46e5-99eb-0ca8676ed5fc\" (UID: \"0433e49e-2581-46e5-99eb-0ca8676ed5fc\") "
Jul 13 19:25:44.086841 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:25:44.086539    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0433e49e-2581-46e5-99eb-0ca8676ed5fc-workload-certs\") pod \"0433e49e-2581-46e5-99eb-0ca8676ed5fc\" (UID: \"0433e49e-2581-46e5-99eb-0ca8676ed5fc\") "
Jul 13 19:25:44.086841 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:25:44.086622    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0433e49e-2581-46e5-99eb-0ca8676ed5fc-credential-socket\") pod \"0433e49e-2581-46e5-99eb-0ca8676ed5fc\" (UID: \"0433e49e-2581-46e5-99eb-0ca8676ed5fc\") "
Jul 13 19:25:44.086841 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:25:44.086671    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xj7db\" (UniqueName: \"kubernetes.io/projected/0433e49e-2581-46e5-99eb-0ca8676ed5fc-kube-api-access-xj7db\") pod \"0433e49e-2581-46e5-99eb-0ca8676ed5fc\" (UID: \"0433e49e-2581-46e5-99eb-0ca8676ed5fc\") "
Jul 13 19:25:44.086841 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:25:44.086695    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0433e49e-2581-46e5-99eb-0ca8676ed5fc-workload-socket\") pod \"0433e49e-2581-46e5-99eb-0ca8676ed5fc\" (UID: \"0433e49e-2581-46e5-99eb-0ca8676ed5fc\") "
Jul 13 19:25:44.086841 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:25:44.086744    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0433e49e-2581-46e5-99eb-0ca8676ed5fc-istio-podinfo\") pod \"0433e49e-2581-46e5-99eb-0ca8676ed5fc\" (UID: \"0433e49e-2581-46e5-99eb-0ca8676ed5fc\") "
Jul 13 19:25:44.087229 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:25:44.086929    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0433e49e-2581-46e5-99eb-0ca8676ed5fc-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "0433e49e-2581-46e5-99eb-0ca8676ed5fc" (UID: "0433e49e-2581-46e5-99eb-0ca8676ed5fc"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 19:25:44.087229 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:25:44.087093    2563 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0433e49e-2581-46e5-99eb-0ca8676ed5fc-istiod-ca-cert\") on node \"ip-10-0-135-38.ec2.internal\" DevicePath \"\""
Jul 13 19:25:44.087229 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:25:44.087212    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0433e49e-2581-46e5-99eb-0ca8676ed5fc-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "0433e49e-2581-46e5-99eb-0ca8676ed5fc" (UID: "0433e49e-2581-46e5-99eb-0ca8676ed5fc"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 19:25:44.087407 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:25:44.087329    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0433e49e-2581-46e5-99eb-0ca8676ed5fc-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "0433e49e-2581-46e5-99eb-0ca8676ed5fc" (UID: "0433e49e-2581-46e5-99eb-0ca8676ed5fc"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 19:25:44.087407 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:25:44.087369    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0433e49e-2581-46e5-99eb-0ca8676ed5fc-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "0433e49e-2581-46e5-99eb-0ca8676ed5fc" (UID: "0433e49e-2581-46e5-99eb-0ca8676ed5fc"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 19:25:44.087556 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:25:44.087530    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0433e49e-2581-46e5-99eb-0ca8676ed5fc-istio-data" (OuterVolumeSpecName: "istio-data") pod "0433e49e-2581-46e5-99eb-0ca8676ed5fc" (UID: "0433e49e-2581-46e5-99eb-0ca8676ed5fc"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 19:25:44.089370 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:25:44.089337    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0433e49e-2581-46e5-99eb-0ca8676ed5fc-istio-token" (OuterVolumeSpecName: "istio-token") pod "0433e49e-2581-46e5-99eb-0ca8676ed5fc" (UID: "0433e49e-2581-46e5-99eb-0ca8676ed5fc"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 19:25:44.089616 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:25:44.089591    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0433e49e-2581-46e5-99eb-0ca8676ed5fc-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "0433e49e-2581-46e5-99eb-0ca8676ed5fc" (UID: "0433e49e-2581-46e5-99eb-0ca8676ed5fc"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 19:25:44.089692 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:25:44.089611    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/0433e49e-2581-46e5-99eb-0ca8676ed5fc-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "0433e49e-2581-46e5-99eb-0ca8676ed5fc" (UID: "0433e49e-2581-46e5-99eb-0ca8676ed5fc"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 13 19:25:44.089753 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:25:44.089684    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0433e49e-2581-46e5-99eb-0ca8676ed5fc-kube-api-access-xj7db" (OuterVolumeSpecName: "kube-api-access-xj7db") pod "0433e49e-2581-46e5-99eb-0ca8676ed5fc" (UID: "0433e49e-2581-46e5-99eb-0ca8676ed5fc"). InnerVolumeSpecName "kube-api-access-xj7db". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 19:25:44.188500 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:25:44.188440    2563 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0433e49e-2581-46e5-99eb-0ca8676ed5fc-credential-socket\") on node \"ip-10-0-135-38.ec2.internal\" DevicePath \"\""
Jul 13 19:25:44.188500 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:25:44.188490    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xj7db\" (UniqueName: \"kubernetes.io/projected/0433e49e-2581-46e5-99eb-0ca8676ed5fc-kube-api-access-xj7db\") on node \"ip-10-0-135-38.ec2.internal\" DevicePath \"\""
Jul 13 19:25:44.188500 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:25:44.188506    2563 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0433e49e-2581-46e5-99eb-0ca8676ed5fc-workload-socket\") on node \"ip-10-0-135-38.ec2.internal\" DevicePath \"\""
Jul 13 19:25:44.188835 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:25:44.188521    2563 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0433e49e-2581-46e5-99eb-0ca8676ed5fc-istio-podinfo\") on node \"ip-10-0-135-38.ec2.internal\" DevicePath \"\""
Jul 13 19:25:44.188835 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:25:44.188535    2563 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0433e49e-2581-46e5-99eb-0ca8676ed5fc-istio-token\") on node \"ip-10-0-135-38.ec2.internal\" DevicePath \"\""
Jul 13 19:25:44.188835 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:25:44.188548    2563 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0433e49e-2581-46e5-99eb-0ca8676ed5fc-istio-envoy\") on node \"ip-10-0-135-38.ec2.internal\" DevicePath \"\""
Jul 13 19:25:44.188835 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:25:44.188560    2563 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0433e49e-2581-46e5-99eb-0ca8676ed5fc-istio-data\") on node \"ip-10-0-135-38.ec2.internal\" DevicePath \"\""
Jul 13 19:25:44.188835 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:25:44.188572    2563 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0433e49e-2581-46e5-99eb-0ca8676ed5fc-workload-certs\") on node \"ip-10-0-135-38.ec2.internal\" DevicePath \"\""
Jul 13 19:25:44.587837 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:25:44.587801    2563 generic.go:356] "Generic (PLEG): container finished" podID="0433e49e-2581-46e5-99eb-0ca8676ed5fc" containerID="990a2e8ed5f0ffc9c3d9728527cee39884cf21bba05e5064893b644ed6059b72" exitCode=0
Jul 13 19:25:44.588053 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:25:44.587851    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-481cf1cb-gw-openshift-default-596b5b4ff9-4bczv"
Jul 13 19:25:44.588053 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:25:44.587892    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-481cf1cb-gw-openshift-default-596b5b4ff9-4bczv" event={"ID":"0433e49e-2581-46e5-99eb-0ca8676ed5fc","Type":"ContainerDied","Data":"990a2e8ed5f0ffc9c3d9728527cee39884cf21bba05e5064893b644ed6059b72"}
Jul 13 19:25:44.588053 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:25:44.587965    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-481cf1cb-gw-openshift-default-596b5b4ff9-4bczv" event={"ID":"0433e49e-2581-46e5-99eb-0ca8676ed5fc","Type":"ContainerDied","Data":"64bd24cdb781a6d53130ffecff08d99f1d88b6d7f88e946ffa980e2781d0f298"}
Jul 13 19:25:44.588053 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:25:44.588002    2563 scope.go:117] "RemoveContainer" containerID="990a2e8ed5f0ffc9c3d9728527cee39884cf21bba05e5064893b644ed6059b72"
Jul 13 19:25:44.598569 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:25:44.598542    2563 scope.go:117] "RemoveContainer" containerID="768808cec08c0d7f2c4f76e4663c7379ec9167c98d2563c2498fc1db73613f20"
Jul 13 19:25:44.607526 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:25:44.607502    2563 scope.go:117] "RemoveContainer" containerID="990a2e8ed5f0ffc9c3d9728527cee39884cf21bba05e5064893b644ed6059b72"
Jul 13 19:25:44.607845 ip-10-0-135-38 kubenswrapper[2563]: E0713 19:25:44.607823    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"990a2e8ed5f0ffc9c3d9728527cee39884cf21bba05e5064893b644ed6059b72\": container with ID starting with 990a2e8ed5f0ffc9c3d9728527cee39884cf21bba05e5064893b644ed6059b72 not found: ID does not exist" containerID="990a2e8ed5f0ffc9c3d9728527cee39884cf21bba05e5064893b644ed6059b72"
Jul 13 19:25:44.607912 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:25:44.607854    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"990a2e8ed5f0ffc9c3d9728527cee39884cf21bba05e5064893b644ed6059b72"} err="failed to get container status \"990a2e8ed5f0ffc9c3d9728527cee39884cf21bba05e5064893b644ed6059b72\": rpc error: code = NotFound desc = could not find container \"990a2e8ed5f0ffc9c3d9728527cee39884cf21bba05e5064893b644ed6059b72\": container with ID starting with 990a2e8ed5f0ffc9c3d9728527cee39884cf21bba05e5064893b644ed6059b72 not found: ID does not exist"
Jul 13 19:25:44.607912 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:25:44.607875    2563 scope.go:117] "RemoveContainer" containerID="768808cec08c0d7f2c4f76e4663c7379ec9167c98d2563c2498fc1db73613f20"
Jul 13 19:25:44.608339 ip-10-0-135-38 kubenswrapper[2563]: E0713 19:25:44.608278    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"768808cec08c0d7f2c4f76e4663c7379ec9167c98d2563c2498fc1db73613f20\": container with ID starting with 768808cec08c0d7f2c4f76e4663c7379ec9167c98d2563c2498fc1db73613f20 not found: ID does not exist" containerID="768808cec08c0d7f2c4f76e4663c7379ec9167c98d2563c2498fc1db73613f20"
Jul 13 19:25:44.608468 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:25:44.608346    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"768808cec08c0d7f2c4f76e4663c7379ec9167c98d2563c2498fc1db73613f20"} err="failed to get container status \"768808cec08c0d7f2c4f76e4663c7379ec9167c98d2563c2498fc1db73613f20\": rpc error: code = NotFound desc = could not find container \"768808cec08c0d7f2c4f76e4663c7379ec9167c98d2563c2498fc1db73613f20\": container with ID starting with 768808cec08c0d7f2c4f76e4663c7379ec9167c98d2563c2498fc1db73613f20 not found: ID does not exist"
Jul 13 19:25:44.610814 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:25:44.610791    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-481cf1cb-gw-openshift-default-596b5b4ff9-4bczv"]
Jul 13 19:25:44.614966 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:25:44.614943    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-migrate-481cf1cb-gw-openshift-default-596b5b4ff9-4bczv"]
Jul 13 19:25:44.756204 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:25:44.756170    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0433e49e-2581-46e5-99eb-0ca8676ed5fc" path="/var/lib/kubelet/pods/0433e49e-2581-46e5-99eb-0ca8676ed5fc/volumes"
Jul 13 19:25:45.300107 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:25:45.300068    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-84c88922-openshift-default-bfd9f748c-h97ck"]
Jul 13 19:25:45.300601 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:25:45.300462    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7d4fcc40-0a08-4347-840a-aaa05dc411f8" containerName="revoke-keys"
Jul 13 19:25:45.300601 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:25:45.300476    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="7d4fcc40-0a08-4347-840a-aaa05dc411f8" containerName="revoke-keys"
Jul 13 19:25:45.300601 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:25:45.300495    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0433e49e-2581-46e5-99eb-0ca8676ed5fc" containerName="istio-proxy"
Jul 13 19:25:45.300601 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:25:45.300501    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="0433e49e-2581-46e5-99eb-0ca8676ed5fc" containerName="istio-proxy"
Jul 13 19:25:45.300601 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:25:45.300516    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0433e49e-2581-46e5-99eb-0ca8676ed5fc" containerName="istio-proxy"
Jul 13 19:25:45.300601 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:25:45.300522    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="0433e49e-2581-46e5-99eb-0ca8676ed5fc" containerName="istio-proxy"
Jul 13 19:25:45.300601 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:25:45.300546    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0d46caf3-569a-486e-9063-582e159700cb" containerName="revoke-keys"
Jul 13 19:25:45.300601 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:25:45.300551    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="0d46caf3-569a-486e-9063-582e159700cb" containerName="revoke-keys"
Jul 13 19:25:45.300601 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:25:45.300606    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="0433e49e-2581-46e5-99eb-0ca8676ed5fc" containerName="istio-proxy"
Jul 13 19:25:45.301091 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:25:45.300614    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="0d46caf3-569a-486e-9063-582e159700cb" containerName="revoke-keys"
Jul 13 19:25:45.301091 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:25:45.300626    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="0433e49e-2581-46e5-99eb-0ca8676ed5fc" containerName="istio-proxy"
Jul 13 19:25:45.304946 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:25:45.304920    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-84c88922-openshift-default-bfd9f748c-h97ck"
Jul 13 19:25:45.307660 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:25:45.307629    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-84c88922-openshift-default-dockercfg-tzcvl\""
Jul 13 19:25:45.318620 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:25:45.318587    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-84c88922-openshift-default-bfd9f748c-h97ck"]
Jul 13 19:25:45.401198 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:25:45.401094    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4078abc1-c8a4-487e-b0b7-78a89b0a795b-istiod-ca-cert\") pod \"e2e-ait-84c88922-openshift-default-bfd9f748c-h97ck\" (UID: \"4078abc1-c8a4-487e-b0b7-78a89b0a795b\") " pod="openshift-ingress/e2e-ait-84c88922-openshift-default-bfd9f748c-h97ck"
Jul 13 19:25:45.401198 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:25:45.401159    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4078abc1-c8a4-487e-b0b7-78a89b0a795b-credential-socket\") pod \"e2e-ait-84c88922-openshift-default-bfd9f748c-h97ck\" (UID: \"4078abc1-c8a4-487e-b0b7-78a89b0a795b\") " pod="openshift-ingress/e2e-ait-84c88922-openshift-default-bfd9f748c-h97ck"
Jul 13 19:25:45.401198 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:25:45.401192    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4078abc1-c8a4-487e-b0b7-78a89b0a795b-workload-socket\") pod \"e2e-ait-84c88922-openshift-default-bfd9f748c-h97ck\" (UID: \"4078abc1-c8a4-487e-b0b7-78a89b0a795b\") " pod="openshift-ingress/e2e-ait-84c88922-openshift-default-bfd9f748c-h97ck"
Jul 13 19:25:45.401515 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:25:45.401270    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4078abc1-c8a4-487e-b0b7-78a89b0a795b-workload-certs\") pod \"e2e-ait-84c88922-openshift-default-bfd9f748c-h97ck\" (UID: \"4078abc1-c8a4-487e-b0b7-78a89b0a795b\") " pod="openshift-ingress/e2e-ait-84c88922-openshift-default-bfd9f748c-h97ck"
Jul 13 19:25:45.401515 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:25:45.401313    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4078abc1-c8a4-487e-b0b7-78a89b0a795b-istio-token\") pod \"e2e-ait-84c88922-openshift-default-bfd9f748c-h97ck\" (UID: \"4078abc1-c8a4-487e-b0b7-78a89b0a795b\") " pod="openshift-ingress/e2e-ait-84c88922-openshift-default-bfd9f748c-h97ck"
Jul 13 19:25:45.401515 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:25:45.401367    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ppff7\" (UniqueName: \"kubernetes.io/projected/4078abc1-c8a4-487e-b0b7-78a89b0a795b-kube-api-access-ppff7\") pod \"e2e-ait-84c88922-openshift-default-bfd9f748c-h97ck\" (UID: \"4078abc1-c8a4-487e-b0b7-78a89b0a795b\") " pod="openshift-ingress/e2e-ait-84c88922-openshift-default-bfd9f748c-h97ck"
Jul 13 19:25:45.401515 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:25:45.401431    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4078abc1-c8a4-487e-b0b7-78a89b0a795b-istio-podinfo\") pod \"e2e-ait-84c88922-openshift-default-bfd9f748c-h97ck\" (UID: \"4078abc1-c8a4-487e-b0b7-78a89b0a795b\") " pod="openshift-ingress/e2e-ait-84c88922-openshift-default-bfd9f748c-h97ck"
Jul 13 19:25:45.401515 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:25:45.401472    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4078abc1-c8a4-487e-b0b7-78a89b0a795b-istio-data\") pod \"e2e-ait-84c88922-openshift-default-bfd9f748c-h97ck\" (UID: \"4078abc1-c8a4-487e-b0b7-78a89b0a795b\") " pod="openshift-ingress/e2e-ait-84c88922-openshift-default-bfd9f748c-h97ck"
Jul 13 19:25:45.401515 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:25:45.401503    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4078abc1-c8a4-487e-b0b7-78a89b0a795b-istio-envoy\") pod \"e2e-ait-84c88922-openshift-default-bfd9f748c-h97ck\" (UID: \"4078abc1-c8a4-487e-b0b7-78a89b0a795b\") " pod="openshift-ingress/e2e-ait-84c88922-openshift-default-bfd9f748c-h97ck"
Jul 13 19:25:45.502444 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:25:45.502401    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4078abc1-c8a4-487e-b0b7-78a89b0a795b-istiod-ca-cert\") pod \"e2e-ait-84c88922-openshift-default-bfd9f748c-h97ck\" (UID: \"4078abc1-c8a4-487e-b0b7-78a89b0a795b\") " pod="openshift-ingress/e2e-ait-84c88922-openshift-default-bfd9f748c-h97ck"
Jul 13 19:25:45.502663 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:25:45.502464    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4078abc1-c8a4-487e-b0b7-78a89b0a795b-credential-socket\") pod \"e2e-ait-84c88922-openshift-default-bfd9f748c-h97ck\" (UID: \"4078abc1-c8a4-487e-b0b7-78a89b0a795b\") " pod="openshift-ingress/e2e-ait-84c88922-openshift-default-bfd9f748c-h97ck"
Jul 13 19:25:45.502663 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:25:45.502487    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4078abc1-c8a4-487e-b0b7-78a89b0a795b-workload-socket\") pod \"e2e-ait-84c88922-openshift-default-bfd9f748c-h97ck\" (UID: \"4078abc1-c8a4-487e-b0b7-78a89b0a795b\") " pod="openshift-ingress/e2e-ait-84c88922-openshift-default-bfd9f748c-h97ck"
Jul 13 19:25:45.502663 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:25:45.502507    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4078abc1-c8a4-487e-b0b7-78a89b0a795b-workload-certs\") pod \"e2e-ait-84c88922-openshift-default-bfd9f748c-h97ck\" (UID: \"4078abc1-c8a4-487e-b0b7-78a89b0a795b\") " pod="openshift-ingress/e2e-ait-84c88922-openshift-default-bfd9f748c-h97ck"
Jul 13 19:25:45.502663 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:25:45.502525    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4078abc1-c8a4-487e-b0b7-78a89b0a795b-istio-token\") pod \"e2e-ait-84c88922-openshift-default-bfd9f748c-h97ck\" (UID: \"4078abc1-c8a4-487e-b0b7-78a89b0a795b\") " pod="openshift-ingress/e2e-ait-84c88922-openshift-default-bfd9f748c-h97ck"
Jul 13 19:25:45.502663 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:25:45.502556    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ppff7\" (UniqueName: \"kubernetes.io/projected/4078abc1-c8a4-487e-b0b7-78a89b0a795b-kube-api-access-ppff7\") pod \"e2e-ait-84c88922-openshift-default-bfd9f748c-h97ck\" (UID: \"4078abc1-c8a4-487e-b0b7-78a89b0a795b\") " pod="openshift-ingress/e2e-ait-84c88922-openshift-default-bfd9f748c-h97ck"
Jul 13 19:25:45.502663 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:25:45.502611    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4078abc1-c8a4-487e-b0b7-78a89b0a795b-istio-podinfo\") pod \"e2e-ait-84c88922-openshift-default-bfd9f748c-h97ck\" (UID: \"4078abc1-c8a4-487e-b0b7-78a89b0a795b\") " pod="openshift-ingress/e2e-ait-84c88922-openshift-default-bfd9f748c-h97ck"
Jul 13 19:25:45.502663 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:25:45.502648    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4078abc1-c8a4-487e-b0b7-78a89b0a795b-istio-data\") pod \"e2e-ait-84c88922-openshift-default-bfd9f748c-h97ck\" (UID: \"4078abc1-c8a4-487e-b0b7-78a89b0a795b\") " pod="openshift-ingress/e2e-ait-84c88922-openshift-default-bfd9f748c-h97ck"
Jul 13 19:25:45.503080 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:25:45.502676    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4078abc1-c8a4-487e-b0b7-78a89b0a795b-istio-envoy\") pod \"e2e-ait-84c88922-openshift-default-bfd9f748c-h97ck\" (UID: \"4078abc1-c8a4-487e-b0b7-78a89b0a795b\") " pod="openshift-ingress/e2e-ait-84c88922-openshift-default-bfd9f748c-h97ck"
Jul 13 19:25:45.503080 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:25:45.502980    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4078abc1-c8a4-487e-b0b7-78a89b0a795b-credential-socket\") pod \"e2e-ait-84c88922-openshift-default-bfd9f748c-h97ck\" (UID: \"4078abc1-c8a4-487e-b0b7-78a89b0a795b\") " pod="openshift-ingress/e2e-ait-84c88922-openshift-default-bfd9f748c-h97ck"
Jul 13 19:25:45.503207 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:25:45.503116    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4078abc1-c8a4-487e-b0b7-78a89b0a795b-workload-certs\") pod \"e2e-ait-84c88922-openshift-default-bfd9f748c-h97ck\" (UID: \"4078abc1-c8a4-487e-b0b7-78a89b0a795b\") " pod="openshift-ingress/e2e-ait-84c88922-openshift-default-bfd9f748c-h97ck"
Jul 13 19:25:45.503269 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:25:45.503230    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4078abc1-c8a4-487e-b0b7-78a89b0a795b-workload-socket\") pod \"e2e-ait-84c88922-openshift-default-bfd9f748c-h97ck\" (UID: \"4078abc1-c8a4-487e-b0b7-78a89b0a795b\") " pod="openshift-ingress/e2e-ait-84c88922-openshift-default-bfd9f748c-h97ck"
Jul 13 19:25:45.503269 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:25:45.503252    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4078abc1-c8a4-487e-b0b7-78a89b0a795b-istio-data\") pod \"e2e-ait-84c88922-openshift-default-bfd9f748c-h97ck\" (UID: \"4078abc1-c8a4-487e-b0b7-78a89b0a795b\") " pod="openshift-ingress/e2e-ait-84c88922-openshift-default-bfd9f748c-h97ck"
Jul 13 19:25:45.503383 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:25:45.503327    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4078abc1-c8a4-487e-b0b7-78a89b0a795b-istiod-ca-cert\") pod \"e2e-ait-84c88922-openshift-default-bfd9f748c-h97ck\" (UID: \"4078abc1-c8a4-487e-b0b7-78a89b0a795b\") " pod="openshift-ingress/e2e-ait-84c88922-openshift-default-bfd9f748c-h97ck"
Jul 13 19:25:45.505119 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:25:45.505091    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4078abc1-c8a4-487e-b0b7-78a89b0a795b-istio-envoy\") pod \"e2e-ait-84c88922-openshift-default-bfd9f748c-h97ck\" (UID: \"4078abc1-c8a4-487e-b0b7-78a89b0a795b\") " pod="openshift-ingress/e2e-ait-84c88922-openshift-default-bfd9f748c-h97ck"
Jul 13 19:25:45.505240 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:25:45.505208    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4078abc1-c8a4-487e-b0b7-78a89b0a795b-istio-podinfo\") pod \"e2e-ait-84c88922-openshift-default-bfd9f748c-h97ck\" (UID: \"4078abc1-c8a4-487e-b0b7-78a89b0a795b\") " pod="openshift-ingress/e2e-ait-84c88922-openshift-default-bfd9f748c-h97ck"
Jul 13 19:25:45.526197 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:25:45.526165    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ppff7\" (UniqueName: \"kubernetes.io/projected/4078abc1-c8a4-487e-b0b7-78a89b0a795b-kube-api-access-ppff7\") pod \"e2e-ait-84c88922-openshift-default-bfd9f748c-h97ck\" (UID: \"4078abc1-c8a4-487e-b0b7-78a89b0a795b\") " pod="openshift-ingress/e2e-ait-84c88922-openshift-default-bfd9f748c-h97ck"
Jul 13 19:25:45.527412 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:25:45.527387    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4078abc1-c8a4-487e-b0b7-78a89b0a795b-istio-token\") pod \"e2e-ait-84c88922-openshift-default-bfd9f748c-h97ck\" (UID: \"4078abc1-c8a4-487e-b0b7-78a89b0a795b\") " pod="openshift-ingress/e2e-ait-84c88922-openshift-default-bfd9f748c-h97ck"
Jul 13 19:25:45.616096 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:25:45.616050    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-84c88922-openshift-default-bfd9f748c-h97ck"
Jul 13 19:25:45.795731 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:25:45.795693    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-84c88922-openshift-default-bfd9f748c-h97ck"]
Jul 13 19:25:45.796054 ip-10-0-135-38 kubenswrapper[2563]: W0713 19:25:45.796006    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4078abc1_c8a4_487e_b0b7_78a89b0a795b.slice/crio-a6f7ee2bf85f53466eaec8a75e3a1f2536b9dab58fe6ddb00657f2a4a2dce2d9 WatchSource:0}: Error finding container a6f7ee2bf85f53466eaec8a75e3a1f2536b9dab58fe6ddb00657f2a4a2dce2d9: Status 404 returned error can't find the container with id a6f7ee2bf85f53466eaec8a75e3a1f2536b9dab58fe6ddb00657f2a4a2dce2d9
Jul 13 19:25:45.798683 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:25:45.798624    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 13 19:25:45.798778 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:25:45.798724    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 13 19:25:45.798778 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:25:45.798753    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 13 19:25:46.602706 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:25:46.602669    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-84c88922-openshift-default-bfd9f748c-h97ck" event={"ID":"4078abc1-c8a4-487e-b0b7-78a89b0a795b","Type":"ContainerStarted","Data":"f90b7b3d0b354fe27f25f8e1324ba5b52ace1ca2db683af7b9cd2fb0511e8b45"}
Jul 13 19:25:46.603139 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:25:46.602725    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-84c88922-openshift-default-bfd9f748c-h97ck" event={"ID":"4078abc1-c8a4-487e-b0b7-78a89b0a795b","Type":"ContainerStarted","Data":"a6f7ee2bf85f53466eaec8a75e3a1f2536b9dab58fe6ddb00657f2a4a2dce2d9"}
Jul 13 19:25:46.616495 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:25:46.616465    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-84c88922-openshift-default-bfd9f748c-h97ck"
Jul 13 19:25:46.621866 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:25:46.621838    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-84c88922-openshift-default-bfd9f748c-h97ck"
Jul 13 19:25:46.628218 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:25:46.628171    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-84c88922-openshift-default-bfd9f748c-h97ck" podStartSLOduration=1.6281551890000001 podStartE2EDuration="1.628155189s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 19:25:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 19:25:46.627013518 +0000 UTC m=+1634.401889875" watchObservedRunningTime="2026-07-13 19:25:46.628155189 +0000 UTC m=+1634.403031544"
Jul 13 19:25:47.608732 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:25:47.608694    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-84c88922-openshift-default-bfd9f748c-h97ck"
Jul 13 19:25:47.609911 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:25:47.609892    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-84c88922-openshift-default-bfd9f748c-h97ck"
Jul 13 19:25:51.580229 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:25:51.580182    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-84c88922-8wjcm"]
Jul 13 19:25:51.585553 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:25:51.585523    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-84c88922-8wjcm"
Jul 13 19:25:51.593583 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:25:51.593548    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-llvfh\""
Jul 13 19:25:51.602771 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:25:51.600159    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-84c88922-8wjcm"]
Jul 13 19:25:51.764009 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:25:51.763967    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/37c17773-ff3e-494a-aced-60c668bad8a5-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-84c88922-8wjcm\" (UID: \"37c17773-ff3e-494a-aced-60c668bad8a5\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-84c88922-8wjcm"
Jul 13 19:25:51.865232 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:25:51.865188    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/37c17773-ff3e-494a-aced-60c668bad8a5-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-84c88922-8wjcm\" (UID: \"37c17773-ff3e-494a-aced-60c668bad8a5\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-84c88922-8wjcm"
Jul 13 19:25:51.865882 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:25:51.865860    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/37c17773-ff3e-494a-aced-60c668bad8a5-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-84c88922-8wjcm\" (UID: \"37c17773-ff3e-494a-aced-60c668bad8a5\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-84c88922-8wjcm"
Jul 13 19:25:51.904272 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:25:51.904229    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-84c88922-8wjcm"
Jul 13 19:25:52.075326 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:25:52.075291    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-84c88922-8wjcm"]
Jul 13 19:25:52.077771 ip-10-0-135-38 kubenswrapper[2563]: W0713 19:25:52.077738    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod37c17773_ff3e_494a_aced_60c668bad8a5.slice/crio-5c0a562623d24f313137f85e3e75e411a1a5f403418537f65add97f624538109 WatchSource:0}: Error finding container 5c0a562623d24f313137f85e3e75e411a1a5f403418537f65add97f624538109: Status 404 returned error can't find the container with id 5c0a562623d24f313137f85e3e75e411a1a5f403418537f65add97f624538109
Jul 13 19:25:52.639652 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:25:52.639615    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-84c88922-8wjcm" event={"ID":"37c17773-ff3e-494a-aced-60c668bad8a5","Type":"ContainerStarted","Data":"45f9d9fb41c777b24cfb5fd0bf79aa4849856353ae5bc76144d91e01c4976802"}
Jul 13 19:25:52.640094 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:25:52.639676    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-84c88922-8wjcm" event={"ID":"37c17773-ff3e-494a-aced-60c668bad8a5","Type":"ContainerStarted","Data":"5c0a562623d24f313137f85e3e75e411a1a5f403418537f65add97f624538109"}
Jul 13 19:25:52.657146 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:25:52.657087    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-84c88922-8wjcm" podStartSLOduration=1.657067052 podStartE2EDuration="1.657067052s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 19:25:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 19:25:52.655200807 +0000 UTC m=+1640.430077164" watchObservedRunningTime="2026-07-13 19:25:52.657067052 +0000 UTC m=+1640.431943408"
Jul 13 19:25:53.645812 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:25:53.645771    2563 generic.go:356] "Generic (PLEG): container finished" podID="37c17773-ff3e-494a-aced-60c668bad8a5" containerID="45f9d9fb41c777b24cfb5fd0bf79aa4849856353ae5bc76144d91e01c4976802" exitCode=7
Jul 13 19:25:53.646308 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:25:53.645859    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-84c88922-8wjcm" event={"ID":"37c17773-ff3e-494a-aced-60c668bad8a5","Type":"ContainerDied","Data":"45f9d9fb41c777b24cfb5fd0bf79aa4849856353ae5bc76144d91e01c4976802"}
Jul 13 19:25:53.646308 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:25:53.646076    2563 scope.go:117] "RemoveContainer" containerID="45f9d9fb41c777b24cfb5fd0bf79aa4849856353ae5bc76144d91e01c4976802"
Jul 13 19:25:54.654037 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:25:54.653977    2563 generic.go:356] "Generic (PLEG): container finished" podID="37c17773-ff3e-494a-aced-60c668bad8a5" containerID="f541691c05caf11e0b9959b735bd92edc34991419382c37b7416a535c6839fa2" exitCode=7
Jul 13 19:25:54.654494 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:25:54.654065    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-84c88922-8wjcm" event={"ID":"37c17773-ff3e-494a-aced-60c668bad8a5","Type":"ContainerDied","Data":"f541691c05caf11e0b9959b735bd92edc34991419382c37b7416a535c6839fa2"}
Jul 13 19:25:54.654494 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:25:54.654130    2563 scope.go:117] "RemoveContainer" containerID="45f9d9fb41c777b24cfb5fd0bf79aa4849856353ae5bc76144d91e01c4976802"
Jul 13 19:25:54.654494 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:25:54.654313    2563 scope.go:117] "RemoveContainer" containerID="f541691c05caf11e0b9959b735bd92edc34991419382c37b7416a535c6839fa2"
Jul 13 19:25:54.654650 ip-10-0-135-38 kubenswrapper[2563]: E0713 19:25:54.654574    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-84c88922-8wjcm_odh-ai-gateway-infra(37c17773-ff3e-494a-aced-60c668bad8a5)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-84c88922-8wjcm" podUID="37c17773-ff3e-494a-aced-60c668bad8a5"
Jul 13 19:25:55.662177 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:25:55.662148    2563 scope.go:117] "RemoveContainer" containerID="f541691c05caf11e0b9959b735bd92edc34991419382c37b7416a535c6839fa2"
Jul 13 19:25:55.662567 ip-10-0-135-38 kubenswrapper[2563]: E0713 19:25:55.662360    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-84c88922-8wjcm_odh-ai-gateway-infra(37c17773-ff3e-494a-aced-60c668bad8a5)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-84c88922-8wjcm" podUID="37c17773-ff3e-494a-aced-60c668bad8a5"
Jul 13 19:25:58.684284 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:25:58.684240    2563 generic.go:356] "Generic (PLEG): container finished" podID="4078abc1-c8a4-487e-b0b7-78a89b0a795b" containerID="f90b7b3d0b354fe27f25f8e1324ba5b52ace1ca2db683af7b9cd2fb0511e8b45" exitCode=0
Jul 13 19:25:58.684716 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:25:58.684312    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-84c88922-openshift-default-bfd9f748c-h97ck" event={"ID":"4078abc1-c8a4-487e-b0b7-78a89b0a795b","Type":"ContainerDied","Data":"f90b7b3d0b354fe27f25f8e1324ba5b52ace1ca2db683af7b9cd2fb0511e8b45"}
Jul 13 19:25:58.684821 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:25:58.684801    2563 scope.go:117] "RemoveContainer" containerID="f90b7b3d0b354fe27f25f8e1324ba5b52ace1ca2db683af7b9cd2fb0511e8b45"
Jul 13 19:25:58.686043 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:25:58.685983    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 13 19:25:58.686133 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:25:58.686118    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 13 19:25:58.686185 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:25:58.686173    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 13 19:25:59.692238 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:25:59.692202    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-84c88922-openshift-default-bfd9f748c-h97ck" event={"ID":"4078abc1-c8a4-487e-b0b7-78a89b0a795b","Type":"ContainerStarted","Data":"2e4b0d96633b5f2a3e9359955f523dd6b0db30e05a4c37121747b01b29c8cc15"}
Jul 13 19:26:00.616556 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:26:00.616512    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-84c88922-openshift-default-bfd9f748c-h97ck"
Jul 13 19:26:00.617764 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:26:00.617730    2563 patch_prober.go:28] interesting pod/e2e-ait-84c88922-openshift-default-bfd9f748c-h97ck container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" start-of-body=
Jul 13 19:26:00.617917 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:26:00.617785    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-84c88922-openshift-default-bfd9f748c-h97ck" podUID="4078abc1-c8a4-487e-b0b7-78a89b0a795b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused"
Jul 13 19:26:01.617083 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:26:01.617039    2563 patch_prober.go:28] interesting pod/e2e-ait-84c88922-openshift-default-bfd9f748c-h97ck container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" start-of-body=
Jul 13 19:26:01.617510 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:26:01.617117    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-84c88922-openshift-default-bfd9f748c-h97ck" podUID="4078abc1-c8a4-487e-b0b7-78a89b0a795b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused"
Jul 13 19:26:02.608745 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:26:02.608694    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-84c88922-openshift-default-bfd9f748c-h97ck"
Jul 13 19:26:02.616778 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:26:02.616736    2563 patch_prober.go:28] interesting pod/e2e-ait-84c88922-openshift-default-bfd9f748c-h97ck container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" start-of-body=
Jul 13 19:26:02.617007 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:26:02.616814    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-84c88922-openshift-default-bfd9f748c-h97ck" podUID="4078abc1-c8a4-487e-b0b7-78a89b0a795b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused"
Jul 13 19:26:03.617105 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:26:03.617061    2563 patch_prober.go:28] interesting pod/e2e-ait-84c88922-openshift-default-bfd9f748c-h97ck container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" start-of-body=
Jul 13 19:26:03.617508 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:26:03.617136    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-84c88922-openshift-default-bfd9f748c-h97ck" podUID="4078abc1-c8a4-487e-b0b7-78a89b0a795b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused"
Jul 13 19:26:04.620664 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:26:04.620630    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-84c88922-openshift-default-bfd9f748c-h97ck"
Jul 13 19:26:04.621697 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:26:04.621675    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-84c88922-openshift-default-bfd9f748c-h97ck"
Jul 13 19:26:07.750578 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:26:07.750544    2563 scope.go:117] "RemoveContainer" containerID="f541691c05caf11e0b9959b735bd92edc34991419382c37b7416a535c6839fa2"
Jul 13 19:26:08.749561 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:26:08.749462    2563 generic.go:356] "Generic (PLEG): container finished" podID="37c17773-ff3e-494a-aced-60c668bad8a5" containerID="35c036b8a7b8cde64301a6d8c95c6c2ebcf4f6e543f5d11ff4668326e62b4faa" exitCode=0
Jul 13 19:26:08.755306 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:26:08.755272    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-84c88922-8wjcm" event={"ID":"37c17773-ff3e-494a-aced-60c668bad8a5","Type":"ContainerDied","Data":"35c036b8a7b8cde64301a6d8c95c6c2ebcf4f6e543f5d11ff4668326e62b4faa"}
Jul 13 19:26:08.755733 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:26:08.755342    2563 scope.go:117] "RemoveContainer" containerID="f541691c05caf11e0b9959b735bd92edc34991419382c37b7416a535c6839fa2"
Jul 13 19:26:09.786931 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:26:09.786822    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-84c88922-8wjcm"]
Jul 13 19:26:09.899841 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:26:09.899810    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-84c88922-8wjcm"
Jul 13 19:26:09.928250 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:26:09.928217    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/37c17773-ff3e-494a-aced-60c668bad8a5-maas-api-service-ca\") pod \"37c17773-ff3e-494a-aced-60c668bad8a5\" (UID: \"37c17773-ff3e-494a-aced-60c668bad8a5\") "
Jul 13 19:26:09.928614 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:26:09.928591    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/37c17773-ff3e-494a-aced-60c668bad8a5-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "37c17773-ff3e-494a-aced-60c668bad8a5" (UID: "37c17773-ff3e-494a-aced-60c668bad8a5"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 19:26:10.029129 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:26:10.028996    2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/37c17773-ff3e-494a-aced-60c668bad8a5-maas-api-service-ca\") on node \"ip-10-0-135-38.ec2.internal\" DevicePath \"\""
Jul 13 19:26:10.763165 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:26:10.763125    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-84c88922-8wjcm" event={"ID":"37c17773-ff3e-494a-aced-60c668bad8a5","Type":"ContainerDied","Data":"5c0a562623d24f313137f85e3e75e411a1a5f403418537f65add97f624538109"}
Jul 13 19:26:10.763165 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:26:10.763150    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-84c88922-8wjcm"
Jul 13 19:26:10.763421 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:26:10.763194    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5c0a562623d24f313137f85e3e75e411a1a5f403418537f65add97f624538109"
Jul 13 19:26:10.796402 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:26:10.796365    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-84c88922-8wjcm"]
Jul 13 19:26:10.799978 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:26:10.799948    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-84c88922-8wjcm"]
Jul 13 19:26:12.756547 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:26:12.756508    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="37c17773-ff3e-494a-aced-60c668bad8a5" path="/var/lib/kubelet/pods/37c17773-ff3e-494a-aced-60c668bad8a5/volumes"
Jul 13 19:26:41.628839 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:26:41.628800    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-84c88922-565ds"]
Jul 13 19:26:41.629348 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:26:41.629196    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="37c17773-ff3e-494a-aced-60c668bad8a5" containerName="revoke-keys"
Jul 13 19:26:41.629348 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:26:41.629209    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="37c17773-ff3e-494a-aced-60c668bad8a5" containerName="revoke-keys"
Jul 13 19:26:41.629348 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:26:41.629223    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="37c17773-ff3e-494a-aced-60c668bad8a5" containerName="revoke-keys"
Jul 13 19:26:41.629348 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:26:41.629229    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="37c17773-ff3e-494a-aced-60c668bad8a5" containerName="revoke-keys"
Jul 13 19:26:41.629348 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:26:41.629243    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="37c17773-ff3e-494a-aced-60c668bad8a5" containerName="revoke-keys"
Jul 13 19:26:41.629348 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:26:41.629248    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="37c17773-ff3e-494a-aced-60c668bad8a5" containerName="revoke-keys"
Jul 13 19:26:41.629348 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:26:41.629303    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="37c17773-ff3e-494a-aced-60c668bad8a5" containerName="revoke-keys"
Jul 13 19:26:41.629348 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:26:41.629313    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="37c17773-ff3e-494a-aced-60c668bad8a5" containerName="revoke-keys"
Jul 13 19:26:41.631305 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:26:41.631286    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-84c88922-565ds"
Jul 13 19:26:41.635228 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:26:41.635211    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-llvfh\""
Jul 13 19:26:41.650948 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:26:41.650913    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-84c88922-565ds"]
Jul 13 19:26:41.710924 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:26:41.710874    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8dad2404-cf74-4960-9968-c1ec077d71a4-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-84c88922-565ds\" (UID: \"8dad2404-cf74-4960-9968-c1ec077d71a4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-84c88922-565ds"
Jul 13 19:26:41.811780 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:26:41.811734    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8dad2404-cf74-4960-9968-c1ec077d71a4-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-84c88922-565ds\" (UID: \"8dad2404-cf74-4960-9968-c1ec077d71a4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-84c88922-565ds"
Jul 13 19:26:41.812488 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:26:41.812458    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8dad2404-cf74-4960-9968-c1ec077d71a4-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-84c88922-565ds\" (UID: \"8dad2404-cf74-4960-9968-c1ec077d71a4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-84c88922-565ds"
Jul 13 19:26:41.942493 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:26:41.942383    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-84c88922-565ds"
Jul 13 19:26:42.110330 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:26:42.110156    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-84c88922-565ds"]
Jul 13 19:26:42.112635 ip-10-0-135-38 kubenswrapper[2563]: W0713 19:26:42.112600    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8dad2404_cf74_4960_9968_c1ec077d71a4.slice/crio-6d9cf533cef0c6e652762ed63416149237c5b001c5918fc87f2a6bf5586b4cad WatchSource:0}: Error finding container 6d9cf533cef0c6e652762ed63416149237c5b001c5918fc87f2a6bf5586b4cad: Status 404 returned error can't find the container with id 6d9cf533cef0c6e652762ed63416149237c5b001c5918fc87f2a6bf5586b4cad
Jul 13 19:26:42.925954 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:26:42.925915    2563 generic.go:356] "Generic (PLEG): container finished" podID="8dad2404-cf74-4960-9968-c1ec077d71a4" containerID="4baaf8b6f3fb0720ca8da1094df17bb3fff47433cd4bc76175f9d0941059d55b" exitCode=0
Jul 13 19:26:42.926384 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:26:42.926003    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-84c88922-565ds" event={"ID":"8dad2404-cf74-4960-9968-c1ec077d71a4","Type":"ContainerDied","Data":"4baaf8b6f3fb0720ca8da1094df17bb3fff47433cd4bc76175f9d0941059d55b"}
Jul 13 19:26:42.926384 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:26:42.926101    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-84c88922-565ds" event={"ID":"8dad2404-cf74-4960-9968-c1ec077d71a4","Type":"ContainerStarted","Data":"6d9cf533cef0c6e652762ed63416149237c5b001c5918fc87f2a6bf5586b4cad"}
Jul 13 19:26:44.073008 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:26:44.072974    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-84c88922-565ds"
Jul 13 19:26:44.134401 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:26:44.134365    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8dad2404-cf74-4960-9968-c1ec077d71a4-maas-api-service-ca\") pod \"8dad2404-cf74-4960-9968-c1ec077d71a4\" (UID: \"8dad2404-cf74-4960-9968-c1ec077d71a4\") "
Jul 13 19:26:44.134742 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:26:44.134718    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8dad2404-cf74-4960-9968-c1ec077d71a4-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "8dad2404-cf74-4960-9968-c1ec077d71a4" (UID: "8dad2404-cf74-4960-9968-c1ec077d71a4"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 19:26:44.235383 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:26:44.235277    2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8dad2404-cf74-4960-9968-c1ec077d71a4-maas-api-service-ca\") on node \"ip-10-0-135-38.ec2.internal\" DevicePath \"\""
Jul 13 19:26:44.936957 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:26:44.936927    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-84c88922-565ds"
Jul 13 19:26:44.937175 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:26:44.936962    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-84c88922-565ds" event={"ID":"8dad2404-cf74-4960-9968-c1ec077d71a4","Type":"ContainerDied","Data":"6d9cf533cef0c6e652762ed63416149237c5b001c5918fc87f2a6bf5586b4cad"}
Jul 13 19:26:44.937175 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:26:44.937005    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6d9cf533cef0c6e652762ed63416149237c5b001c5918fc87f2a6bf5586b4cad"
Jul 13 19:27:07.783501 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:27:07.783394    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-84c88922-openshift-default-bfd9f748c-h97ck"]
Jul 13 19:27:07.784399 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:27:07.783706    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-84c88922-openshift-default-bfd9f748c-h97ck" podUID="4078abc1-c8a4-487e-b0b7-78a89b0a795b" containerName="istio-proxy" containerID="cri-o://2e4b0d96633b5f2a3e9359955f523dd6b0db30e05a4c37121747b01b29c8cc15" gracePeriod=30
Jul 13 19:27:08.052535 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:27:08.052434    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-c7ee59ed-openshift-default-647cff5487-vxnzw"]
Jul 13 19:27:08.052865 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:27:08.052849    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8dad2404-cf74-4960-9968-c1ec077d71a4" containerName="revoke-keys"
Jul 13 19:27:08.052936 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:27:08.052866    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="8dad2404-cf74-4960-9968-c1ec077d71a4" containerName="revoke-keys"
Jul 13 19:27:08.052992 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:27:08.052941    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="37c17773-ff3e-494a-aced-60c668bad8a5" containerName="revoke-keys"
Jul 13 19:27:08.052992 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:27:08.052950    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="8dad2404-cf74-4960-9968-c1ec077d71a4" containerName="revoke-keys"
Jul 13 19:27:08.055000 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:27:08.054975    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-c7ee59ed-openshift-default-647cff5487-vxnzw"
Jul 13 19:27:08.057469 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:27:08.057438    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-c7ee59ed-openshift-default-dockercfg-sk2k5\""
Jul 13 19:27:08.071666 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:27:08.071632    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-c7ee59ed-openshift-default-647cff5487-vxnzw"]
Jul 13 19:27:08.145574 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:27:08.145531    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5c9523a6-7bfd-43a8-9227-f744c49fce83-credential-socket\") pod \"e2e-derive-c7ee59ed-openshift-default-647cff5487-vxnzw\" (UID: \"5c9523a6-7bfd-43a8-9227-f744c49fce83\") " pod="openshift-ingress/e2e-derive-c7ee59ed-openshift-default-647cff5487-vxnzw"
Jul 13 19:27:08.145574 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:27:08.145573    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5c9523a6-7bfd-43a8-9227-f744c49fce83-istio-envoy\") pod \"e2e-derive-c7ee59ed-openshift-default-647cff5487-vxnzw\" (UID: \"5c9523a6-7bfd-43a8-9227-f744c49fce83\") " pod="openshift-ingress/e2e-derive-c7ee59ed-openshift-default-647cff5487-vxnzw"
Jul 13 19:27:08.145808 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:27:08.145607    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5c9523a6-7bfd-43a8-9227-f744c49fce83-workload-certs\") pod \"e2e-derive-c7ee59ed-openshift-default-647cff5487-vxnzw\" (UID: \"5c9523a6-7bfd-43a8-9227-f744c49fce83\") " pod="openshift-ingress/e2e-derive-c7ee59ed-openshift-default-647cff5487-vxnzw"
Jul 13 19:27:08.145808 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:27:08.145624    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5c9523a6-7bfd-43a8-9227-f744c49fce83-istiod-ca-cert\") pod \"e2e-derive-c7ee59ed-openshift-default-647cff5487-vxnzw\" (UID: \"5c9523a6-7bfd-43a8-9227-f744c49fce83\") " pod="openshift-ingress/e2e-derive-c7ee59ed-openshift-default-647cff5487-vxnzw"
Jul 13 19:27:08.145808 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:27:08.145641    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5c9523a6-7bfd-43a8-9227-f744c49fce83-istio-token\") pod \"e2e-derive-c7ee59ed-openshift-default-647cff5487-vxnzw\" (UID: \"5c9523a6-7bfd-43a8-9227-f744c49fce83\") " pod="openshift-ingress/e2e-derive-c7ee59ed-openshift-default-647cff5487-vxnzw"
Jul 13 19:27:08.145808 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:27:08.145662    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5c9523a6-7bfd-43a8-9227-f744c49fce83-istio-data\") pod \"e2e-derive-c7ee59ed-openshift-default-647cff5487-vxnzw\" (UID: \"5c9523a6-7bfd-43a8-9227-f744c49fce83\") " pod="openshift-ingress/e2e-derive-c7ee59ed-openshift-default-647cff5487-vxnzw"
Jul 13 19:27:08.145808 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:27:08.145739    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5c9523a6-7bfd-43a8-9227-f744c49fce83-workload-socket\") pod \"e2e-derive-c7ee59ed-openshift-default-647cff5487-vxnzw\" (UID: \"5c9523a6-7bfd-43a8-9227-f744c49fce83\") " pod="openshift-ingress/e2e-derive-c7ee59ed-openshift-default-647cff5487-vxnzw"
Jul 13 19:27:08.145808 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:27:08.145765    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5c9523a6-7bfd-43a8-9227-f744c49fce83-istio-podinfo\") pod \"e2e-derive-c7ee59ed-openshift-default-647cff5487-vxnzw\" (UID: \"5c9523a6-7bfd-43a8-9227-f744c49fce83\") " pod="openshift-ingress/e2e-derive-c7ee59ed-openshift-default-647cff5487-vxnzw"
Jul 13 19:27:08.145808 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:27:08.145796    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zgd7b\" (UniqueName: \"kubernetes.io/projected/5c9523a6-7bfd-43a8-9227-f744c49fce83-kube-api-access-zgd7b\") pod \"e2e-derive-c7ee59ed-openshift-default-647cff5487-vxnzw\" (UID: \"5c9523a6-7bfd-43a8-9227-f744c49fce83\") " pod="openshift-ingress/e2e-derive-c7ee59ed-openshift-default-647cff5487-vxnzw"
Jul 13 19:27:08.247042 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:27:08.246995    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5c9523a6-7bfd-43a8-9227-f744c49fce83-credential-socket\") pod \"e2e-derive-c7ee59ed-openshift-default-647cff5487-vxnzw\" (UID: \"5c9523a6-7bfd-43a8-9227-f744c49fce83\") " pod="openshift-ingress/e2e-derive-c7ee59ed-openshift-default-647cff5487-vxnzw"
Jul 13 19:27:08.247252 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:27:08.247069    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5c9523a6-7bfd-43a8-9227-f744c49fce83-istio-envoy\") pod \"e2e-derive-c7ee59ed-openshift-default-647cff5487-vxnzw\" (UID: \"5c9523a6-7bfd-43a8-9227-f744c49fce83\") " pod="openshift-ingress/e2e-derive-c7ee59ed-openshift-default-647cff5487-vxnzw"
Jul 13 19:27:08.247252 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:27:08.247108    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5c9523a6-7bfd-43a8-9227-f744c49fce83-workload-certs\") pod \"e2e-derive-c7ee59ed-openshift-default-647cff5487-vxnzw\" (UID: \"5c9523a6-7bfd-43a8-9227-f744c49fce83\") " pod="openshift-ingress/e2e-derive-c7ee59ed-openshift-default-647cff5487-vxnzw"
Jul 13 19:27:08.247252 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:27:08.247126    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5c9523a6-7bfd-43a8-9227-f744c49fce83-istiod-ca-cert\") pod \"e2e-derive-c7ee59ed-openshift-default-647cff5487-vxnzw\" (UID: \"5c9523a6-7bfd-43a8-9227-f744c49fce83\") " pod="openshift-ingress/e2e-derive-c7ee59ed-openshift-default-647cff5487-vxnzw"
Jul 13 19:27:08.247252 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:27:08.247147    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5c9523a6-7bfd-43a8-9227-f744c49fce83-istio-token\") pod \"e2e-derive-c7ee59ed-openshift-default-647cff5487-vxnzw\" (UID: \"5c9523a6-7bfd-43a8-9227-f744c49fce83\") " pod="openshift-ingress/e2e-derive-c7ee59ed-openshift-default-647cff5487-vxnzw"
Jul 13 19:27:08.247252 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:27:08.247182    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5c9523a6-7bfd-43a8-9227-f744c49fce83-istio-data\") pod \"e2e-derive-c7ee59ed-openshift-default-647cff5487-vxnzw\" (UID: \"5c9523a6-7bfd-43a8-9227-f744c49fce83\") " pod="openshift-ingress/e2e-derive-c7ee59ed-openshift-default-647cff5487-vxnzw"
Jul 13 19:27:08.247252 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:27:08.247215    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5c9523a6-7bfd-43a8-9227-f744c49fce83-workload-socket\") pod \"e2e-derive-c7ee59ed-openshift-default-647cff5487-vxnzw\" (UID: \"5c9523a6-7bfd-43a8-9227-f744c49fce83\") " pod="openshift-ingress/e2e-derive-c7ee59ed-openshift-default-647cff5487-vxnzw"
Jul 13 19:27:08.247252 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:27:08.247239    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5c9523a6-7bfd-43a8-9227-f744c49fce83-istio-podinfo\") pod \"e2e-derive-c7ee59ed-openshift-default-647cff5487-vxnzw\" (UID: \"5c9523a6-7bfd-43a8-9227-f744c49fce83\") " pod="openshift-ingress/e2e-derive-c7ee59ed-openshift-default-647cff5487-vxnzw"
Jul 13 19:27:08.247657 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:27:08.247266    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zgd7b\" (UniqueName: \"kubernetes.io/projected/5c9523a6-7bfd-43a8-9227-f744c49fce83-kube-api-access-zgd7b\") pod \"e2e-derive-c7ee59ed-openshift-default-647cff5487-vxnzw\" (UID: \"5c9523a6-7bfd-43a8-9227-f744c49fce83\") " pod="openshift-ingress/e2e-derive-c7ee59ed-openshift-default-647cff5487-vxnzw"
Jul 13 19:27:08.247657 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:27:08.247457    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5c9523a6-7bfd-43a8-9227-f744c49fce83-credential-socket\") pod \"e2e-derive-c7ee59ed-openshift-default-647cff5487-vxnzw\" (UID: \"5c9523a6-7bfd-43a8-9227-f744c49fce83\") " pod="openshift-ingress/e2e-derive-c7ee59ed-openshift-default-647cff5487-vxnzw"
Jul 13 19:27:08.247766 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:27:08.247665    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5c9523a6-7bfd-43a8-9227-f744c49fce83-workload-certs\") pod \"e2e-derive-c7ee59ed-openshift-default-647cff5487-vxnzw\" (UID: \"5c9523a6-7bfd-43a8-9227-f744c49fce83\") " pod="openshift-ingress/e2e-derive-c7ee59ed-openshift-default-647cff5487-vxnzw"
Jul 13 19:27:08.247766 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:27:08.247665    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5c9523a6-7bfd-43a8-9227-f744c49fce83-istio-data\") pod \"e2e-derive-c7ee59ed-openshift-default-647cff5487-vxnzw\" (UID: \"5c9523a6-7bfd-43a8-9227-f744c49fce83\") " pod="openshift-ingress/e2e-derive-c7ee59ed-openshift-default-647cff5487-vxnzw"
Jul 13 19:27:08.247877 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:27:08.247839    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5c9523a6-7bfd-43a8-9227-f744c49fce83-workload-socket\") pod \"e2e-derive-c7ee59ed-openshift-default-647cff5487-vxnzw\" (UID: \"5c9523a6-7bfd-43a8-9227-f744c49fce83\") " pod="openshift-ingress/e2e-derive-c7ee59ed-openshift-default-647cff5487-vxnzw"
Jul 13 19:27:08.247932 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:27:08.247913    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5c9523a6-7bfd-43a8-9227-f744c49fce83-istiod-ca-cert\") pod \"e2e-derive-c7ee59ed-openshift-default-647cff5487-vxnzw\" (UID: \"5c9523a6-7bfd-43a8-9227-f744c49fce83\") " pod="openshift-ingress/e2e-derive-c7ee59ed-openshift-default-647cff5487-vxnzw"
Jul 13 19:27:08.249523 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:27:08.249501    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5c9523a6-7bfd-43a8-9227-f744c49fce83-istio-envoy\") pod \"e2e-derive-c7ee59ed-openshift-default-647cff5487-vxnzw\" (UID: \"5c9523a6-7bfd-43a8-9227-f744c49fce83\") " pod="openshift-ingress/e2e-derive-c7ee59ed-openshift-default-647cff5487-vxnzw"
Jul 13 19:27:08.249798 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:27:08.249763    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5c9523a6-7bfd-43a8-9227-f744c49fce83-istio-podinfo\") pod \"e2e-derive-c7ee59ed-openshift-default-647cff5487-vxnzw\" (UID: \"5c9523a6-7bfd-43a8-9227-f744c49fce83\") " pod="openshift-ingress/e2e-derive-c7ee59ed-openshift-default-647cff5487-vxnzw"
Jul 13 19:27:08.257326 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:27:08.257297    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zgd7b\" (UniqueName: \"kubernetes.io/projected/5c9523a6-7bfd-43a8-9227-f744c49fce83-kube-api-access-zgd7b\") pod \"e2e-derive-c7ee59ed-openshift-default-647cff5487-vxnzw\" (UID: \"5c9523a6-7bfd-43a8-9227-f744c49fce83\") " pod="openshift-ingress/e2e-derive-c7ee59ed-openshift-default-647cff5487-vxnzw"
Jul 13 19:27:08.258977 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:27:08.258957    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5c9523a6-7bfd-43a8-9227-f744c49fce83-istio-token\") pod \"e2e-derive-c7ee59ed-openshift-default-647cff5487-vxnzw\" (UID: \"5c9523a6-7bfd-43a8-9227-f744c49fce83\") " pod="openshift-ingress/e2e-derive-c7ee59ed-openshift-default-647cff5487-vxnzw"
Jul 13 19:27:08.367153 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:27:08.367089    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-c7ee59ed-openshift-default-647cff5487-vxnzw"
Jul 13 19:27:08.519901 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:27:08.519872    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-c7ee59ed-openshift-default-647cff5487-vxnzw"]
Jul 13 19:27:08.522344 ip-10-0-135-38 kubenswrapper[2563]: W0713 19:27:08.522305    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5c9523a6_7bfd_43a8_9227_f744c49fce83.slice/crio-e9682798557f769bffc29b4312233fbda5789901d11af8303d561a244f3c1ef9 WatchSource:0}: Error finding container e9682798557f769bffc29b4312233fbda5789901d11af8303d561a244f3c1ef9: Status 404 returned error can't find the container with id e9682798557f769bffc29b4312233fbda5789901d11af8303d561a244f3c1ef9
Jul 13 19:27:08.524694 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:27:08.524657    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 13 19:27:08.524802 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:27:08.524733    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 13 19:27:08.524802 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:27:08.524761    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 13 19:27:09.060364 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:27:09.060317    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-c7ee59ed-openshift-default-647cff5487-vxnzw" event={"ID":"5c9523a6-7bfd-43a8-9227-f744c49fce83","Type":"ContainerStarted","Data":"0b573cd02c59f920ed61447009a61642f6902d74236ab3071b6f0bb1e1734611"}
Jul 13 19:27:09.060768 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:27:09.060385    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-c7ee59ed-openshift-default-647cff5487-vxnzw" event={"ID":"5c9523a6-7bfd-43a8-9227-f744c49fce83","Type":"ContainerStarted","Data":"e9682798557f769bffc29b4312233fbda5789901d11af8303d561a244f3c1ef9"}
Jul 13 19:27:09.086918 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:27:09.086857    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-c7ee59ed-openshift-default-647cff5487-vxnzw" podStartSLOduration=1.086834172 podStartE2EDuration="1.086834172s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 19:27:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 19:27:09.084255583 +0000 UTC m=+1716.859131938" watchObservedRunningTime="2026-07-13 19:27:09.086834172 +0000 UTC m=+1716.861710527"
Jul 13 19:27:09.367793 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:27:09.367748    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-c7ee59ed-openshift-default-647cff5487-vxnzw"
Jul 13 19:27:09.372945 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:27:09.372916    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-c7ee59ed-openshift-default-647cff5487-vxnzw"
Jul 13 19:27:10.065611 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:27:10.065584    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-c7ee59ed-openshift-default-647cff5487-vxnzw"
Jul 13 19:27:10.066910 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:27:10.066885    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-c7ee59ed-openshift-default-647cff5487-vxnzw"
Jul 13 19:27:13.048296 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:27:13.048228    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-84c88922-openshift-default-bfd9f748c-h97ck"
Jul 13 19:27:13.082288 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:27:13.082251    2563 generic.go:356] "Generic (PLEG): container finished" podID="4078abc1-c8a4-487e-b0b7-78a89b0a795b" containerID="2e4b0d96633b5f2a3e9359955f523dd6b0db30e05a4c37121747b01b29c8cc15" exitCode=0
Jul 13 19:27:13.082464 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:27:13.082302    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-84c88922-openshift-default-bfd9f748c-h97ck"
Jul 13 19:27:13.082464 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:27:13.082331    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-84c88922-openshift-default-bfd9f748c-h97ck" event={"ID":"4078abc1-c8a4-487e-b0b7-78a89b0a795b","Type":"ContainerDied","Data":"2e4b0d96633b5f2a3e9359955f523dd6b0db30e05a4c37121747b01b29c8cc15"}
Jul 13 19:27:13.082464 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:27:13.082393    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-84c88922-openshift-default-bfd9f748c-h97ck" event={"ID":"4078abc1-c8a4-487e-b0b7-78a89b0a795b","Type":"ContainerDied","Data":"a6f7ee2bf85f53466eaec8a75e3a1f2536b9dab58fe6ddb00657f2a4a2dce2d9"}
Jul 13 19:27:13.082464 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:27:13.082421    2563 scope.go:117] "RemoveContainer" containerID="2e4b0d96633b5f2a3e9359955f523dd6b0db30e05a4c37121747b01b29c8cc15"
Jul 13 19:27:13.092866 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:27:13.092830    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4078abc1-c8a4-487e-b0b7-78a89b0a795b-istio-token\") pod \"4078abc1-c8a4-487e-b0b7-78a89b0a795b\" (UID: \"4078abc1-c8a4-487e-b0b7-78a89b0a795b\") "
Jul 13 19:27:13.093112 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:27:13.092975    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4078abc1-c8a4-487e-b0b7-78a89b0a795b-workload-socket\") pod \"4078abc1-c8a4-487e-b0b7-78a89b0a795b\" (UID: \"4078abc1-c8a4-487e-b0b7-78a89b0a795b\") "
Jul 13 19:27:13.093275 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:27:13.093254    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ppff7\" (UniqueName: \"kubernetes.io/projected/4078abc1-c8a4-487e-b0b7-78a89b0a795b-kube-api-access-ppff7\") pod \"4078abc1-c8a4-487e-b0b7-78a89b0a795b\" (UID: \"4078abc1-c8a4-487e-b0b7-78a89b0a795b\") "
Jul 13 19:27:13.093406 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:27:13.093329    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4078abc1-c8a4-487e-b0b7-78a89b0a795b-workload-certs\") pod \"4078abc1-c8a4-487e-b0b7-78a89b0a795b\" (UID: \"4078abc1-c8a4-487e-b0b7-78a89b0a795b\") "
Jul 13 19:27:13.093406 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:27:13.093369    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4078abc1-c8a4-487e-b0b7-78a89b0a795b-istiod-ca-cert\") pod \"4078abc1-c8a4-487e-b0b7-78a89b0a795b\" (UID: \"4078abc1-c8a4-487e-b0b7-78a89b0a795b\") "
Jul 13 19:27:13.093522 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:27:13.093415    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4078abc1-c8a4-487e-b0b7-78a89b0a795b-credential-socket\") pod \"4078abc1-c8a4-487e-b0b7-78a89b0a795b\" (UID: \"4078abc1-c8a4-487e-b0b7-78a89b0a795b\") "
Jul 13 19:27:13.093522 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:27:13.093421    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4078abc1-c8a4-487e-b0b7-78a89b0a795b-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "4078abc1-c8a4-487e-b0b7-78a89b0a795b" (UID: "4078abc1-c8a4-487e-b0b7-78a89b0a795b"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 19:27:13.093522 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:27:13.093437    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4078abc1-c8a4-487e-b0b7-78a89b0a795b-istio-data\") pod \"4078abc1-c8a4-487e-b0b7-78a89b0a795b\" (UID: \"4078abc1-c8a4-487e-b0b7-78a89b0a795b\") "
Jul 13 19:27:13.093522 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:27:13.093502    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4078abc1-c8a4-487e-b0b7-78a89b0a795b-istio-podinfo\") pod \"4078abc1-c8a4-487e-b0b7-78a89b0a795b\" (UID: \"4078abc1-c8a4-487e-b0b7-78a89b0a795b\") "
Jul 13 19:27:13.093720 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:27:13.093537    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4078abc1-c8a4-487e-b0b7-78a89b0a795b-istio-envoy\") pod \"4078abc1-c8a4-487e-b0b7-78a89b0a795b\" (UID: \"4078abc1-c8a4-487e-b0b7-78a89b0a795b\") "
Jul 13 19:27:13.093720 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:27:13.093651    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4078abc1-c8a4-487e-b0b7-78a89b0a795b-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "4078abc1-c8a4-487e-b0b7-78a89b0a795b" (UID: "4078abc1-c8a4-487e-b0b7-78a89b0a795b"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 19:27:13.093822 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:27:13.093718    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4078abc1-c8a4-487e-b0b7-78a89b0a795b-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "4078abc1-c8a4-487e-b0b7-78a89b0a795b" (UID: "4078abc1-c8a4-487e-b0b7-78a89b0a795b"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 19:27:13.093897 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:27:13.093866    2563 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4078abc1-c8a4-487e-b0b7-78a89b0a795b-workload-socket\") on node \"ip-10-0-135-38.ec2.internal\" DevicePath \"\""
Jul 13 19:27:13.093952 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:27:13.093903    2563 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4078abc1-c8a4-487e-b0b7-78a89b0a795b-workload-certs\") on node \"ip-10-0-135-38.ec2.internal\" DevicePath \"\""
Jul 13 19:27:13.093952 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:27:13.093921    2563 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4078abc1-c8a4-487e-b0b7-78a89b0a795b-istiod-ca-cert\") on node \"ip-10-0-135-38.ec2.internal\" DevicePath \"\""
Jul 13 19:27:13.095199 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:27:13.094654    2563 scope.go:117] "RemoveContainer" containerID="f90b7b3d0b354fe27f25f8e1324ba5b52ace1ca2db683af7b9cd2fb0511e8b45"
Jul 13 19:27:13.095199 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:27:13.094768    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4078abc1-c8a4-487e-b0b7-78a89b0a795b-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "4078abc1-c8a4-487e-b0b7-78a89b0a795b" (UID: "4078abc1-c8a4-487e-b0b7-78a89b0a795b"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 19:27:13.096816 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:27:13.095970    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4078abc1-c8a4-487e-b0b7-78a89b0a795b-istio-data" (OuterVolumeSpecName: "istio-data") pod "4078abc1-c8a4-487e-b0b7-78a89b0a795b" (UID: "4078abc1-c8a4-487e-b0b7-78a89b0a795b"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 19:27:13.096816 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:27:13.096423    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4078abc1-c8a4-487e-b0b7-78a89b0a795b-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "4078abc1-c8a4-487e-b0b7-78a89b0a795b" (UID: "4078abc1-c8a4-487e-b0b7-78a89b0a795b"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 19:27:13.096816 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:27:13.096429    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4078abc1-c8a4-487e-b0b7-78a89b0a795b-kube-api-access-ppff7" (OuterVolumeSpecName: "kube-api-access-ppff7") pod "4078abc1-c8a4-487e-b0b7-78a89b0a795b" (UID: "4078abc1-c8a4-487e-b0b7-78a89b0a795b"). InnerVolumeSpecName "kube-api-access-ppff7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 19:27:13.097078 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:27:13.096822    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4078abc1-c8a4-487e-b0b7-78a89b0a795b-istio-token" (OuterVolumeSpecName: "istio-token") pod "4078abc1-c8a4-487e-b0b7-78a89b0a795b" (UID: "4078abc1-c8a4-487e-b0b7-78a89b0a795b"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 19:27:13.097461 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:27:13.097415    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/4078abc1-c8a4-487e-b0b7-78a89b0a795b-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "4078abc1-c8a4-487e-b0b7-78a89b0a795b" (UID: "4078abc1-c8a4-487e-b0b7-78a89b0a795b"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 13 19:27:13.121055 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:27:13.121009    2563 scope.go:117] "RemoveContainer" containerID="2e4b0d96633b5f2a3e9359955f523dd6b0db30e05a4c37121747b01b29c8cc15"
Jul 13 19:27:13.121516 ip-10-0-135-38 kubenswrapper[2563]: E0713 19:27:13.121489    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2e4b0d96633b5f2a3e9359955f523dd6b0db30e05a4c37121747b01b29c8cc15\": container with ID starting with 2e4b0d96633b5f2a3e9359955f523dd6b0db30e05a4c37121747b01b29c8cc15 not found: ID does not exist" containerID="2e4b0d96633b5f2a3e9359955f523dd6b0db30e05a4c37121747b01b29c8cc15"
Jul 13 19:27:13.121636 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:27:13.121526    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2e4b0d96633b5f2a3e9359955f523dd6b0db30e05a4c37121747b01b29c8cc15"} err="failed to get container status \"2e4b0d96633b5f2a3e9359955f523dd6b0db30e05a4c37121747b01b29c8cc15\": rpc error: code = NotFound desc = could not find container \"2e4b0d96633b5f2a3e9359955f523dd6b0db30e05a4c37121747b01b29c8cc15\": container with ID starting with 2e4b0d96633b5f2a3e9359955f523dd6b0db30e05a4c37121747b01b29c8cc15 not found: ID does not exist"
Jul 13 19:27:13.121636 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:27:13.121546    2563 scope.go:117] "RemoveContainer" containerID="f90b7b3d0b354fe27f25f8e1324ba5b52ace1ca2db683af7b9cd2fb0511e8b45"
Jul 13 19:27:13.121885 ip-10-0-135-38 kubenswrapper[2563]: E0713 19:27:13.121853    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f90b7b3d0b354fe27f25f8e1324ba5b52ace1ca2db683af7b9cd2fb0511e8b45\": container with ID starting with f90b7b3d0b354fe27f25f8e1324ba5b52ace1ca2db683af7b9cd2fb0511e8b45 not found: ID does not exist" containerID="f90b7b3d0b354fe27f25f8e1324ba5b52ace1ca2db683af7b9cd2fb0511e8b45"
Jul 13 19:27:13.121957 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:27:13.121881    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f90b7b3d0b354fe27f25f8e1324ba5b52ace1ca2db683af7b9cd2fb0511e8b45"} err="failed to get container status \"f90b7b3d0b354fe27f25f8e1324ba5b52ace1ca2db683af7b9cd2fb0511e8b45\": rpc error: code = NotFound desc = could not find container \"f90b7b3d0b354fe27f25f8e1324ba5b52ace1ca2db683af7b9cd2fb0511e8b45\": container with ID starting with f90b7b3d0b354fe27f25f8e1324ba5b52ace1ca2db683af7b9cd2fb0511e8b45 not found: ID does not exist"
Jul 13 19:27:13.195252 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:27:13.195207    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ppff7\" (UniqueName: \"kubernetes.io/projected/4078abc1-c8a4-487e-b0b7-78a89b0a795b-kube-api-access-ppff7\") on node \"ip-10-0-135-38.ec2.internal\" DevicePath \"\""
Jul 13 19:27:13.195252 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:27:13.195242    2563 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4078abc1-c8a4-487e-b0b7-78a89b0a795b-credential-socket\") on node \"ip-10-0-135-38.ec2.internal\" DevicePath \"\""
Jul 13 19:27:13.195252 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:27:13.195257    2563 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4078abc1-c8a4-487e-b0b7-78a89b0a795b-istio-data\") on node \"ip-10-0-135-38.ec2.internal\" DevicePath \"\""
Jul 13 19:27:13.195524 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:27:13.195268    2563 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4078abc1-c8a4-487e-b0b7-78a89b0a795b-istio-podinfo\") on node \"ip-10-0-135-38.ec2.internal\" DevicePath \"\""
Jul 13 19:27:13.195524 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:27:13.195282    2563 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4078abc1-c8a4-487e-b0b7-78a89b0a795b-istio-envoy\") on node \"ip-10-0-135-38.ec2.internal\" DevicePath \"\""
Jul 13 19:27:13.195524 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:27:13.195292    2563 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4078abc1-c8a4-487e-b0b7-78a89b0a795b-istio-token\") on node \"ip-10-0-135-38.ec2.internal\" DevicePath \"\""
Jul 13 19:27:13.409474 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:27:13.409429    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-84c88922-openshift-default-bfd9f748c-h97ck"]
Jul 13 19:27:13.418170 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:27:13.418142    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-84c88922-openshift-default-bfd9f748c-h97ck"]
Jul 13 19:27:13.610987 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:27:13.610943    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c7ee59ed-kw6z5"]
Jul 13 19:27:13.611392 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:27:13.611378    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4078abc1-c8a4-487e-b0b7-78a89b0a795b" containerName="istio-proxy"
Jul 13 19:27:13.611469 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:27:13.611394    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="4078abc1-c8a4-487e-b0b7-78a89b0a795b" containerName="istio-proxy"
Jul 13 19:27:13.611469 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:27:13.611406    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4078abc1-c8a4-487e-b0b7-78a89b0a795b" containerName="istio-proxy"
Jul 13 19:27:13.611469 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:27:13.611412    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="4078abc1-c8a4-487e-b0b7-78a89b0a795b" containerName="istio-proxy"
Jul 13 19:27:13.611560 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:27:13.611494    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="4078abc1-c8a4-487e-b0b7-78a89b0a795b" containerName="istio-proxy"
Jul 13 19:27:13.614577 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:27:13.614555    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c7ee59ed-kw6z5"
Jul 13 19:27:13.616902 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:27:13.616880    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-llvfh\""
Jul 13 19:27:13.623709 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:27:13.623680    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c7ee59ed-kw6z5"]
Jul 13 19:27:13.699308 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:27:13.699214    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fef36d2f-b581-4b87-a8d9-fa27e6847cd1-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-c7ee59ed-kw6z5\" (UID: \"fef36d2f-b581-4b87-a8d9-fa27e6847cd1\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c7ee59ed-kw6z5"
Jul 13 19:27:13.800334 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:27:13.800289    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fef36d2f-b581-4b87-a8d9-fa27e6847cd1-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-c7ee59ed-kw6z5\" (UID: \"fef36d2f-b581-4b87-a8d9-fa27e6847cd1\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c7ee59ed-kw6z5"
Jul 13 19:27:13.800996 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:27:13.800971    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fef36d2f-b581-4b87-a8d9-fa27e6847cd1-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-c7ee59ed-kw6z5\" (UID: \"fef36d2f-b581-4b87-a8d9-fa27e6847cd1\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c7ee59ed-kw6z5"
Jul 13 19:27:13.926363 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:27:13.926323    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c7ee59ed-kw6z5"
Jul 13 19:27:14.075820 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:27:14.075793    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c7ee59ed-kw6z5"]
Jul 13 19:27:14.078051 ip-10-0-135-38 kubenswrapper[2563]: W0713 19:27:14.077999    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfef36d2f_b581_4b87_a8d9_fa27e6847cd1.slice/crio-416bd9bbc385a9e21a0e2711854ee3e9d12e2c3f36f2e37c6cd59e3b9988d227 WatchSource:0}: Error finding container 416bd9bbc385a9e21a0e2711854ee3e9d12e2c3f36f2e37c6cd59e3b9988d227: Status 404 returned error can't find the container with id 416bd9bbc385a9e21a0e2711854ee3e9d12e2c3f36f2e37c6cd59e3b9988d227
Jul 13 19:27:14.092524 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:27:14.092485    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c7ee59ed-kw6z5" event={"ID":"fef36d2f-b581-4b87-a8d9-fa27e6847cd1","Type":"ContainerStarted","Data":"416bd9bbc385a9e21a0e2711854ee3e9d12e2c3f36f2e37c6cd59e3b9988d227"}
Jul 13 19:27:14.762528 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:27:14.762436    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4078abc1-c8a4-487e-b0b7-78a89b0a795b" path="/var/lib/kubelet/pods/4078abc1-c8a4-487e-b0b7-78a89b0a795b/volumes"
Jul 13 19:27:15.103651 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:27:15.102694    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c7ee59ed-kw6z5" event={"ID":"fef36d2f-b581-4b87-a8d9-fa27e6847cd1","Type":"ContainerStarted","Data":"0449dc205dca034d1d918356ad65aec872d7d295545cd5848997c6da402b8b1b"}
Jul 13 19:27:15.120554 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:27:15.120462    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c7ee59ed-kw6z5" podStartSLOduration=2.12043871 podStartE2EDuration="2.12043871s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 19:27:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 19:27:15.119909994 +0000 UTC m=+1722.894786372" watchObservedRunningTime="2026-07-13 19:27:15.12043871 +0000 UTC m=+1722.895315063"
Jul 13 19:27:16.113598 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:27:16.113481    2563 generic.go:356] "Generic (PLEG): container finished" podID="fef36d2f-b581-4b87-a8d9-fa27e6847cd1" containerID="0449dc205dca034d1d918356ad65aec872d7d295545cd5848997c6da402b8b1b" exitCode=7
Jul 13 19:27:16.113598 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:27:16.113560    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c7ee59ed-kw6z5" event={"ID":"fef36d2f-b581-4b87-a8d9-fa27e6847cd1","Type":"ContainerDied","Data":"0449dc205dca034d1d918356ad65aec872d7d295545cd5848997c6da402b8b1b"}
Jul 13 19:27:16.114151 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:27:16.113809    2563 scope.go:117] "RemoveContainer" containerID="0449dc205dca034d1d918356ad65aec872d7d295545cd5848997c6da402b8b1b"
Jul 13 19:27:17.123251 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:27:17.123199    2563 generic.go:356] "Generic (PLEG): container finished" podID="fef36d2f-b581-4b87-a8d9-fa27e6847cd1" containerID="fc7596b635e24610f54bd94c0f45471f5e08382c4b1e30f3a3967b894c58c5fc" exitCode=7
Jul 13 19:27:17.123765 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:27:17.123276    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c7ee59ed-kw6z5" event={"ID":"fef36d2f-b581-4b87-a8d9-fa27e6847cd1","Type":"ContainerDied","Data":"fc7596b635e24610f54bd94c0f45471f5e08382c4b1e30f3a3967b894c58c5fc"}
Jul 13 19:27:17.123765 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:27:17.123337    2563 scope.go:117] "RemoveContainer" containerID="0449dc205dca034d1d918356ad65aec872d7d295545cd5848997c6da402b8b1b"
Jul 13 19:27:17.124528 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:27:17.123957    2563 scope.go:117] "RemoveContainer" containerID="fc7596b635e24610f54bd94c0f45471f5e08382c4b1e30f3a3967b894c58c5fc"
Jul 13 19:27:17.124528 ip-10-0-135-38 kubenswrapper[2563]: E0713 19:27:17.124315    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-derive-c7ee59ed-kw6z5_odh-ai-gateway-infra(fef36d2f-b581-4b87-a8d9-fa27e6847cd1)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c7ee59ed-kw6z5" podUID="fef36d2f-b581-4b87-a8d9-fa27e6847cd1"
Jul 13 19:27:18.131122 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:27:18.131096    2563 scope.go:117] "RemoveContainer" containerID="fc7596b635e24610f54bd94c0f45471f5e08382c4b1e30f3a3967b894c58c5fc"
Jul 13 19:27:18.131805 ip-10-0-135-38 kubenswrapper[2563]: E0713 19:27:18.131778    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-derive-c7ee59ed-kw6z5_odh-ai-gateway-infra(fef36d2f-b581-4b87-a8d9-fa27e6847cd1)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c7ee59ed-kw6z5" podUID="fef36d2f-b581-4b87-a8d9-fa27e6847cd1"
Jul 13 19:27:22.152676 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:27:22.152636    2563 generic.go:356] "Generic (PLEG): container finished" podID="5c9523a6-7bfd-43a8-9227-f744c49fce83" containerID="0b573cd02c59f920ed61447009a61642f6902d74236ab3071b6f0bb1e1734611" exitCode=0
Jul 13 19:27:22.153126 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:27:22.152683    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-c7ee59ed-openshift-default-647cff5487-vxnzw" event={"ID":"5c9523a6-7bfd-43a8-9227-f744c49fce83","Type":"ContainerDied","Data":"0b573cd02c59f920ed61447009a61642f6902d74236ab3071b6f0bb1e1734611"}
Jul 13 19:27:22.153126 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:27:22.153104    2563 scope.go:117] "RemoveContainer" containerID="0b573cd02c59f920ed61447009a61642f6902d74236ab3071b6f0bb1e1734611"
Jul 13 19:27:22.154152 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:27:22.154124    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 13 19:27:22.154269 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:27:22.154200    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 13 19:27:22.154269 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:27:22.154252    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 13 19:27:23.159514 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:27:23.159477    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-c7ee59ed-openshift-default-647cff5487-vxnzw" event={"ID":"5c9523a6-7bfd-43a8-9227-f744c49fce83","Type":"ContainerStarted","Data":"fedf5b5a334c73e47994e3a674309e11ff84a96272d0bbb6787ec9221f70809a"}
Jul 13 19:27:23.367938 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:27:23.367899    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-c7ee59ed-openshift-default-647cff5487-vxnzw"
Jul 13 19:27:23.369223 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:27:23.369195    2563 patch_prober.go:28] interesting pod/e2e-derive-c7ee59ed-openshift-default-647cff5487-vxnzw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused" start-of-body=
Jul 13 19:27:23.369357 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:27:23.369248    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-c7ee59ed-openshift-default-647cff5487-vxnzw" podUID="5c9523a6-7bfd-43a8-9227-f744c49fce83" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused"
Jul 13 19:27:24.367689 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:27:24.367640    2563 patch_prober.go:28] interesting pod/e2e-derive-c7ee59ed-openshift-default-647cff5487-vxnzw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused" start-of-body=
Jul 13 19:27:24.368217 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:27:24.367710    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-c7ee59ed-openshift-default-647cff5487-vxnzw" podUID="5c9523a6-7bfd-43a8-9227-f744c49fce83" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused"
Jul 13 19:27:25.066438 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:27:25.066389    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-c7ee59ed-openshift-default-647cff5487-vxnzw"
Jul 13 19:27:25.367699 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:27:25.367664    2563 patch_prober.go:28] interesting pod/e2e-derive-c7ee59ed-openshift-default-647cff5487-vxnzw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused" start-of-body=
Jul 13 19:27:25.368189 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:27:25.367728    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-c7ee59ed-openshift-default-647cff5487-vxnzw" podUID="5c9523a6-7bfd-43a8-9227-f744c49fce83" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused"
Jul 13 19:27:26.368417 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:27:26.368373    2563 patch_prober.go:28] interesting pod/e2e-derive-c7ee59ed-openshift-default-647cff5487-vxnzw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused" start-of-body=
Jul 13 19:27:26.368825 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:27:26.368435    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-c7ee59ed-openshift-default-647cff5487-vxnzw" podUID="5c9523a6-7bfd-43a8-9227-f744c49fce83" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused"
Jul 13 19:27:27.372522 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:27:27.372483    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-c7ee59ed-openshift-default-647cff5487-vxnzw"
Jul 13 19:27:27.373536 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:27:27.373511    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-c7ee59ed-openshift-default-647cff5487-vxnzw"
Jul 13 19:27:29.749953 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:27:29.749916    2563 scope.go:117] "RemoveContainer" containerID="fc7596b635e24610f54bd94c0f45471f5e08382c4b1e30f3a3967b894c58c5fc"
Jul 13 19:27:30.197395 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:27:30.197357    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c7ee59ed-kw6z5" event={"ID":"fef36d2f-b581-4b87-a8d9-fa27e6847cd1","Type":"ContainerStarted","Data":"5e1336d8cb758ac97558c2fd6ca28f79c613882718078fa5ef39df3a7ff5b063"}
Jul 13 19:27:31.204440 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:27:31.204403    2563 generic.go:356] "Generic (PLEG): container finished" podID="fef36d2f-b581-4b87-a8d9-fa27e6847cd1" containerID="5e1336d8cb758ac97558c2fd6ca28f79c613882718078fa5ef39df3a7ff5b063" exitCode=0
Jul 13 19:27:31.204929 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:27:31.204472    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c7ee59ed-kw6z5" event={"ID":"fef36d2f-b581-4b87-a8d9-fa27e6847cd1","Type":"ContainerDied","Data":"5e1336d8cb758ac97558c2fd6ca28f79c613882718078fa5ef39df3a7ff5b063"}
Jul 13 19:27:31.204929 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:27:31.204537    2563 scope.go:117] "RemoveContainer" containerID="fc7596b635e24610f54bd94c0f45471f5e08382c4b1e30f3a3967b894c58c5fc"
Jul 13 19:27:31.255032 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:27:31.254992    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c7ee59ed-kw6z5"]
Jul 13 19:27:32.357187 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:27:32.357157    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c7ee59ed-kw6z5"
Jul 13 19:27:32.487455 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:27:32.487332    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fef36d2f-b581-4b87-a8d9-fa27e6847cd1-maas-api-service-ca\") pod \"fef36d2f-b581-4b87-a8d9-fa27e6847cd1\" (UID: \"fef36d2f-b581-4b87-a8d9-fa27e6847cd1\") "
Jul 13 19:27:32.487766 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:27:32.487737    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fef36d2f-b581-4b87-a8d9-fa27e6847cd1-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "fef36d2f-b581-4b87-a8d9-fa27e6847cd1" (UID: "fef36d2f-b581-4b87-a8d9-fa27e6847cd1"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 19:27:32.588429 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:27:32.588397    2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fef36d2f-b581-4b87-a8d9-fa27e6847cd1-maas-api-service-ca\") on node \"ip-10-0-135-38.ec2.internal\" DevicePath \"\""
Jul 13 19:27:33.217407 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:27:33.217377    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c7ee59ed-kw6z5"
Jul 13 19:27:33.217593 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:27:33.217376    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c7ee59ed-kw6z5" event={"ID":"fef36d2f-b581-4b87-a8d9-fa27e6847cd1","Type":"ContainerDied","Data":"416bd9bbc385a9e21a0e2711854ee3e9d12e2c3f36f2e37c6cd59e3b9988d227"}
Jul 13 19:27:33.217593 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:27:33.217502    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="416bd9bbc385a9e21a0e2711854ee3e9d12e2c3f36f2e37c6cd59e3b9988d227"
Jul 13 19:27:33.298479 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:27:33.298447    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c7ee59ed-kw6z5"]
Jul 13 19:27:33.305456 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:27:33.305424    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c7ee59ed-kw6z5"]
Jul 13 19:27:34.756136 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:27:34.756099    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fef36d2f-b581-4b87-a8d9-fa27e6847cd1" path="/var/lib/kubelet/pods/fef36d2f-b581-4b87-a8d9-fa27e6847cd1/volumes"
Jul 13 19:28:03.689654 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:28:03.689611    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c7ee59ed-lllf8"]
Jul 13 19:28:03.690343 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:28:03.690204    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fef36d2f-b581-4b87-a8d9-fa27e6847cd1" containerName="revoke-keys"
Jul 13 19:28:03.690343 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:28:03.690241    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="fef36d2f-b581-4b87-a8d9-fa27e6847cd1" containerName="revoke-keys"
Jul 13 19:28:03.690343 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:28:03.690274    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fef36d2f-b581-4b87-a8d9-fa27e6847cd1" containerName="revoke-keys"
Jul 13 19:28:03.690343 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:28:03.690283    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="fef36d2f-b581-4b87-a8d9-fa27e6847cd1" containerName="revoke-keys"
Jul 13 19:28:03.690516 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:28:03.690408    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="4078abc1-c8a4-487e-b0b7-78a89b0a795b" containerName="istio-proxy"
Jul 13 19:28:03.690516 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:28:03.690426    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="fef36d2f-b581-4b87-a8d9-fa27e6847cd1" containerName="revoke-keys"
Jul 13 19:28:03.690516 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:28:03.690437    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="fef36d2f-b581-4b87-a8d9-fa27e6847cd1" containerName="revoke-keys"
Jul 13 19:28:03.690516 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:28:03.690447    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="fef36d2f-b581-4b87-a8d9-fa27e6847cd1" containerName="revoke-keys"
Jul 13 19:28:03.694956 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:28:03.694937    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c7ee59ed-lllf8"
Jul 13 19:28:03.698468 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:28:03.698446    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-llvfh\""
Jul 13 19:28:03.705368 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:28:03.705339    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c7ee59ed-lllf8"]
Jul 13 19:28:03.764103 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:28:03.764067    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/91d43f1f-0c21-4fbc-ba5b-82d708a14d0f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-c7ee59ed-lllf8\" (UID: \"91d43f1f-0c21-4fbc-ba5b-82d708a14d0f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c7ee59ed-lllf8"
Jul 13 19:28:03.865241 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:28:03.865199    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/91d43f1f-0c21-4fbc-ba5b-82d708a14d0f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-c7ee59ed-lllf8\" (UID: \"91d43f1f-0c21-4fbc-ba5b-82d708a14d0f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c7ee59ed-lllf8"
Jul 13 19:28:03.865933 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:28:03.865913    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/91d43f1f-0c21-4fbc-ba5b-82d708a14d0f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-c7ee59ed-lllf8\" (UID: \"91d43f1f-0c21-4fbc-ba5b-82d708a14d0f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c7ee59ed-lllf8"
Jul 13 19:28:04.007278 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:28:04.007184    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c7ee59ed-lllf8"
Jul 13 19:28:04.154778 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:28:04.154746    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c7ee59ed-lllf8"]
Jul 13 19:28:04.156553 ip-10-0-135-38 kubenswrapper[2563]: W0713 19:28:04.156524    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod91d43f1f_0c21_4fbc_ba5b_82d708a14d0f.slice/crio-fa4afa3868f3c586d2f03d46ed6911b13f745ea1ddeb9fe6e94d84506d690de6 WatchSource:0}: Error finding container fa4afa3868f3c586d2f03d46ed6911b13f745ea1ddeb9fe6e94d84506d690de6: Status 404 returned error can't find the container with id fa4afa3868f3c586d2f03d46ed6911b13f745ea1ddeb9fe6e94d84506d690de6
Jul 13 19:28:04.378106 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:28:04.378056    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c7ee59ed-lllf8" event={"ID":"91d43f1f-0c21-4fbc-ba5b-82d708a14d0f","Type":"ContainerStarted","Data":"fa4afa3868f3c586d2f03d46ed6911b13f745ea1ddeb9fe6e94d84506d690de6"}
Jul 13 19:28:05.385170 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:28:05.385134    2563 generic.go:356] "Generic (PLEG): container finished" podID="91d43f1f-0c21-4fbc-ba5b-82d708a14d0f" containerID="7cdaac4b10b391602b317004f4eb690d5a391794a6fe881e6516516d6b4a74ad" exitCode=0
Jul 13 19:28:05.385573 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:28:05.385202    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c7ee59ed-lllf8" event={"ID":"91d43f1f-0c21-4fbc-ba5b-82d708a14d0f","Type":"ContainerDied","Data":"7cdaac4b10b391602b317004f4eb690d5a391794a6fe881e6516516d6b4a74ad"}
Jul 13 19:28:06.523819 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:28:06.523789    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c7ee59ed-lllf8"
Jul 13 19:28:06.590259 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:28:06.590200    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/91d43f1f-0c21-4fbc-ba5b-82d708a14d0f-maas-api-service-ca\") pod \"91d43f1f-0c21-4fbc-ba5b-82d708a14d0f\" (UID: \"91d43f1f-0c21-4fbc-ba5b-82d708a14d0f\") "
Jul 13 19:28:06.590582 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:28:06.590557    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/91d43f1f-0c21-4fbc-ba5b-82d708a14d0f-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "91d43f1f-0c21-4fbc-ba5b-82d708a14d0f" (UID: "91d43f1f-0c21-4fbc-ba5b-82d708a14d0f"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 19:28:06.691902 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:28:06.691803    2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/91d43f1f-0c21-4fbc-ba5b-82d708a14d0f-maas-api-service-ca\") on node \"ip-10-0-135-38.ec2.internal\" DevicePath \"\""
Jul 13 19:28:07.400395 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:28:07.400368    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c7ee59ed-lllf8"
Jul 13 19:28:07.400570 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:28:07.400358    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c7ee59ed-lllf8" event={"ID":"91d43f1f-0c21-4fbc-ba5b-82d708a14d0f","Type":"ContainerDied","Data":"fa4afa3868f3c586d2f03d46ed6911b13f745ea1ddeb9fe6e94d84506d690de6"}
Jul 13 19:28:07.400570 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:28:07.400502    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="fa4afa3868f3c586d2f03d46ed6911b13f745ea1ddeb9fe6e94d84506d690de6"
Jul 13 19:28:28.990950 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:28:28.990902    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-c7ee59ed-openshift-default-647cff5487-vxnzw"]
Jul 13 19:28:28.991508 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:28:28.991196    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-c7ee59ed-openshift-default-647cff5487-vxnzw" podUID="5c9523a6-7bfd-43a8-9227-f744c49fce83" containerName="istio-proxy" containerID="cri-o://fedf5b5a334c73e47994e3a674309e11ff84a96272d0bbb6787ec9221f70809a" gracePeriod=30
Jul 13 19:28:32.784810 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:28:32.784780    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hwqhc_7ae2e1d0-8a16-4821-9cb7-353862cfbec8/ovn-acl-logging/0.log"
Jul 13 19:28:32.788359 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:28:32.788335    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hwqhc_7ae2e1d0-8a16-4821-9cb7-353862cfbec8/ovn-acl-logging/0.log"
Jul 13 19:28:34.272379 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:28:34.272344    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-c7ee59ed-openshift-default-647cff5487-vxnzw"
Jul 13 19:28:34.362992 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:28:34.362950    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5c9523a6-7bfd-43a8-9227-f744c49fce83-istio-data\") pod \"5c9523a6-7bfd-43a8-9227-f744c49fce83\" (UID: \"5c9523a6-7bfd-43a8-9227-f744c49fce83\") "
Jul 13 19:28:34.363219 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:28:34.363039    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5c9523a6-7bfd-43a8-9227-f744c49fce83-istio-podinfo\") pod \"5c9523a6-7bfd-43a8-9227-f744c49fce83\" (UID: \"5c9523a6-7bfd-43a8-9227-f744c49fce83\") "
Jul 13 19:28:34.363219 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:28:34.363080    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5c9523a6-7bfd-43a8-9227-f744c49fce83-credential-socket\") pod \"5c9523a6-7bfd-43a8-9227-f744c49fce83\" (UID: \"5c9523a6-7bfd-43a8-9227-f744c49fce83\") "
Jul 13 19:28:34.363219 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:28:34.363098    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5c9523a6-7bfd-43a8-9227-f744c49fce83-workload-socket\") pod \"5c9523a6-7bfd-43a8-9227-f744c49fce83\" (UID: \"5c9523a6-7bfd-43a8-9227-f744c49fce83\") "
Jul 13 19:28:34.363219 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:28:34.363132    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5c9523a6-7bfd-43a8-9227-f744c49fce83-istiod-ca-cert\") pod \"5c9523a6-7bfd-43a8-9227-f744c49fce83\" (UID: \"5c9523a6-7bfd-43a8-9227-f744c49fce83\") "
Jul 13 19:28:34.363219 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:28:34.363161    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5c9523a6-7bfd-43a8-9227-f744c49fce83-istio-envoy\") pod \"5c9523a6-7bfd-43a8-9227-f744c49fce83\" (UID: \"5c9523a6-7bfd-43a8-9227-f744c49fce83\") "
Jul 13 19:28:34.363219 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:28:34.363217    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5c9523a6-7bfd-43a8-9227-f744c49fce83-istio-token\") pod \"5c9523a6-7bfd-43a8-9227-f744c49fce83\" (UID: \"5c9523a6-7bfd-43a8-9227-f744c49fce83\") "
Jul 13 19:28:34.363470 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:28:34.363271    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5c9523a6-7bfd-43a8-9227-f744c49fce83-workload-certs\") pod \"5c9523a6-7bfd-43a8-9227-f744c49fce83\" (UID: \"5c9523a6-7bfd-43a8-9227-f744c49fce83\") "
Jul 13 19:28:34.363470 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:28:34.363298    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zgd7b\" (UniqueName: \"kubernetes.io/projected/5c9523a6-7bfd-43a8-9227-f744c49fce83-kube-api-access-zgd7b\") pod \"5c9523a6-7bfd-43a8-9227-f744c49fce83\" (UID: \"5c9523a6-7bfd-43a8-9227-f744c49fce83\") "
Jul 13 19:28:34.363625 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:28:34.363598    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5c9523a6-7bfd-43a8-9227-f744c49fce83-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "5c9523a6-7bfd-43a8-9227-f744c49fce83" (UID: "5c9523a6-7bfd-43a8-9227-f744c49fce83"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 19:28:34.363781 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:28:34.363763    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5c9523a6-7bfd-43a8-9227-f744c49fce83-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "5c9523a6-7bfd-43a8-9227-f744c49fce83" (UID: "5c9523a6-7bfd-43a8-9227-f744c49fce83"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 19:28:34.363861 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:28:34.363830    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5c9523a6-7bfd-43a8-9227-f744c49fce83-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "5c9523a6-7bfd-43a8-9227-f744c49fce83" (UID: "5c9523a6-7bfd-43a8-9227-f744c49fce83"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 19:28:34.364095 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:28:34.364070    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5c9523a6-7bfd-43a8-9227-f744c49fce83-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "5c9523a6-7bfd-43a8-9227-f744c49fce83" (UID: "5c9523a6-7bfd-43a8-9227-f744c49fce83"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 19:28:34.364178 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:28:34.364131    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5c9523a6-7bfd-43a8-9227-f744c49fce83-istio-data" (OuterVolumeSpecName: "istio-data") pod "5c9523a6-7bfd-43a8-9227-f744c49fce83" (UID: "5c9523a6-7bfd-43a8-9227-f744c49fce83"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 19:28:34.365901 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:28:34.365876    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5c9523a6-7bfd-43a8-9227-f744c49fce83-kube-api-access-zgd7b" (OuterVolumeSpecName: "kube-api-access-zgd7b") pod "5c9523a6-7bfd-43a8-9227-f744c49fce83" (UID: "5c9523a6-7bfd-43a8-9227-f744c49fce83"). InnerVolumeSpecName "kube-api-access-zgd7b". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 19:28:34.365974 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:28:34.365915    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/5c9523a6-7bfd-43a8-9227-f744c49fce83-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "5c9523a6-7bfd-43a8-9227-f744c49fce83" (UID: "5c9523a6-7bfd-43a8-9227-f744c49fce83"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 13 19:28:34.365974 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:28:34.365923    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5c9523a6-7bfd-43a8-9227-f744c49fce83-istio-token" (OuterVolumeSpecName: "istio-token") pod "5c9523a6-7bfd-43a8-9227-f744c49fce83" (UID: "5c9523a6-7bfd-43a8-9227-f744c49fce83"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 19:28:34.366112 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:28:34.366087    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5c9523a6-7bfd-43a8-9227-f744c49fce83-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "5c9523a6-7bfd-43a8-9227-f744c49fce83" (UID: "5c9523a6-7bfd-43a8-9227-f744c49fce83"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 19:28:34.464969 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:28:34.464929    2563 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5c9523a6-7bfd-43a8-9227-f744c49fce83-istio-data\") on node \"ip-10-0-135-38.ec2.internal\" DevicePath \"\""
Jul 13 19:28:34.464969 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:28:34.464961    2563 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5c9523a6-7bfd-43a8-9227-f744c49fce83-istio-podinfo\") on node \"ip-10-0-135-38.ec2.internal\" DevicePath \"\""
Jul 13 19:28:34.464969 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:28:34.464971    2563 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5c9523a6-7bfd-43a8-9227-f744c49fce83-credential-socket\") on node \"ip-10-0-135-38.ec2.internal\" DevicePath \"\""
Jul 13 19:28:34.464969 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:28:34.464981    2563 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5c9523a6-7bfd-43a8-9227-f744c49fce83-workload-socket\") on node \"ip-10-0-135-38.ec2.internal\" DevicePath \"\""
Jul 13 19:28:34.465259 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:28:34.464990    2563 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5c9523a6-7bfd-43a8-9227-f744c49fce83-istiod-ca-cert\") on node \"ip-10-0-135-38.ec2.internal\" DevicePath \"\""
Jul 13 19:28:34.465259 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:28:34.464998    2563 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5c9523a6-7bfd-43a8-9227-f744c49fce83-istio-envoy\") on node \"ip-10-0-135-38.ec2.internal\" DevicePath \"\""
Jul 13 19:28:34.465259 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:28:34.465005    2563 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5c9523a6-7bfd-43a8-9227-f744c49fce83-istio-token\") on node \"ip-10-0-135-38.ec2.internal\" DevicePath \"\""
Jul 13 19:28:34.465259 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:28:34.465012    2563 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5c9523a6-7bfd-43a8-9227-f744c49fce83-workload-certs\") on node \"ip-10-0-135-38.ec2.internal\" DevicePath \"\""
Jul 13 19:28:34.465259 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:28:34.465041    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zgd7b\" (UniqueName: \"kubernetes.io/projected/5c9523a6-7bfd-43a8-9227-f744c49fce83-kube-api-access-zgd7b\") on node \"ip-10-0-135-38.ec2.internal\" DevicePath \"\""
Jul 13 19:28:34.543049 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:28:34.542919    2563 generic.go:356] "Generic (PLEG): container finished" podID="5c9523a6-7bfd-43a8-9227-f744c49fce83" containerID="fedf5b5a334c73e47994e3a674309e11ff84a96272d0bbb6787ec9221f70809a" exitCode=0
Jul 13 19:28:34.543049 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:28:34.542971    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-c7ee59ed-openshift-default-647cff5487-vxnzw"
Jul 13 19:28:34.543049 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:28:34.543011    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-c7ee59ed-openshift-default-647cff5487-vxnzw" event={"ID":"5c9523a6-7bfd-43a8-9227-f744c49fce83","Type":"ContainerDied","Data":"fedf5b5a334c73e47994e3a674309e11ff84a96272d0bbb6787ec9221f70809a"}
Jul 13 19:28:34.543375 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:28:34.543130    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-c7ee59ed-openshift-default-647cff5487-vxnzw" event={"ID":"5c9523a6-7bfd-43a8-9227-f744c49fce83","Type":"ContainerDied","Data":"e9682798557f769bffc29b4312233fbda5789901d11af8303d561a244f3c1ef9"}
Jul 13 19:28:34.543375 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:28:34.543166    2563 scope.go:117] "RemoveContainer" containerID="fedf5b5a334c73e47994e3a674309e11ff84a96272d0bbb6787ec9221f70809a"
Jul 13 19:28:34.553274 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:28:34.553256    2563 scope.go:117] "RemoveContainer" containerID="0b573cd02c59f920ed61447009a61642f6902d74236ab3071b6f0bb1e1734611"
Jul 13 19:28:34.561918 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:28:34.561896    2563 scope.go:117] "RemoveContainer" containerID="fedf5b5a334c73e47994e3a674309e11ff84a96272d0bbb6787ec9221f70809a"
Jul 13 19:28:34.562306 ip-10-0-135-38 kubenswrapper[2563]: E0713 19:28:34.562283    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fedf5b5a334c73e47994e3a674309e11ff84a96272d0bbb6787ec9221f70809a\": container with ID starting with fedf5b5a334c73e47994e3a674309e11ff84a96272d0bbb6787ec9221f70809a not found: ID does not exist" containerID="fedf5b5a334c73e47994e3a674309e11ff84a96272d0bbb6787ec9221f70809a"
Jul 13 19:28:34.562371 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:28:34.562315    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fedf5b5a334c73e47994e3a674309e11ff84a96272d0bbb6787ec9221f70809a"} err="failed to get container status \"fedf5b5a334c73e47994e3a674309e11ff84a96272d0bbb6787ec9221f70809a\": rpc error: code = NotFound desc = could not find container \"fedf5b5a334c73e47994e3a674309e11ff84a96272d0bbb6787ec9221f70809a\": container with ID starting with fedf5b5a334c73e47994e3a674309e11ff84a96272d0bbb6787ec9221f70809a not found: ID does not exist"
Jul 13 19:28:34.562371 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:28:34.562338    2563 scope.go:117] "RemoveContainer" containerID="0b573cd02c59f920ed61447009a61642f6902d74236ab3071b6f0bb1e1734611"
Jul 13 19:28:34.562595 ip-10-0-135-38 kubenswrapper[2563]: E0713 19:28:34.562578    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0b573cd02c59f920ed61447009a61642f6902d74236ab3071b6f0bb1e1734611\": container with ID starting with 0b573cd02c59f920ed61447009a61642f6902d74236ab3071b6f0bb1e1734611 not found: ID does not exist" containerID="0b573cd02c59f920ed61447009a61642f6902d74236ab3071b6f0bb1e1734611"
Jul 13 19:28:34.562633 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:28:34.562604    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0b573cd02c59f920ed61447009a61642f6902d74236ab3071b6f0bb1e1734611"} err="failed to get container status \"0b573cd02c59f920ed61447009a61642f6902d74236ab3071b6f0bb1e1734611\": rpc error: code = NotFound desc = could not find container \"0b573cd02c59f920ed61447009a61642f6902d74236ab3071b6f0bb1e1734611\": container with ID starting with 0b573cd02c59f920ed61447009a61642f6902d74236ab3071b6f0bb1e1734611 not found: ID does not exist"
Jul 13 19:28:34.566350 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:28:34.566324    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-c7ee59ed-openshift-default-647cff5487-vxnzw"]
Jul 13 19:28:34.572250 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:28:34.572222    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-c7ee59ed-openshift-default-647cff5487-vxnzw"]
Jul 13 19:28:34.756035 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:28:34.755989    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5c9523a6-7bfd-43a8-9227-f744c49fce83" path="/var/lib/kubelet/pods/5c9523a6-7bfd-43a8-9227-f744c49fce83/volumes"
Jul 13 19:30:00.147878 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:30:00.147777    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29732850-h5clk"]
Jul 13 19:30:00.148402 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:30:00.148203    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="91d43f1f-0c21-4fbc-ba5b-82d708a14d0f" containerName="revoke-keys"
Jul 13 19:30:00.148402 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:30:00.148215    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="91d43f1f-0c21-4fbc-ba5b-82d708a14d0f" containerName="revoke-keys"
Jul 13 19:30:00.148402 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:30:00.148231    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fef36d2f-b581-4b87-a8d9-fa27e6847cd1" containerName="revoke-keys"
Jul 13 19:30:00.148402 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:30:00.148236    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="fef36d2f-b581-4b87-a8d9-fa27e6847cd1" containerName="revoke-keys"
Jul 13 19:30:00.148402 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:30:00.148243    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5c9523a6-7bfd-43a8-9227-f744c49fce83" containerName="istio-proxy"
Jul 13 19:30:00.148402 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:30:00.148249    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="5c9523a6-7bfd-43a8-9227-f744c49fce83" containerName="istio-proxy"
Jul 13 19:30:00.148402 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:30:00.148258    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5c9523a6-7bfd-43a8-9227-f744c49fce83" containerName="istio-proxy"
Jul 13 19:30:00.148402 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:30:00.148263    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="5c9523a6-7bfd-43a8-9227-f744c49fce83" containerName="istio-proxy"
Jul 13 19:30:00.148402 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:30:00.148319    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="91d43f1f-0c21-4fbc-ba5b-82d708a14d0f" containerName="revoke-keys"
Jul 13 19:30:00.148402 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:30:00.148326    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="5c9523a6-7bfd-43a8-9227-f744c49fce83" containerName="istio-proxy"
Jul 13 19:30:00.148402 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:30:00.148333    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="5c9523a6-7bfd-43a8-9227-f744c49fce83" containerName="istio-proxy"
Jul 13 19:30:00.151483 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:30:00.151440    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29732850-h5clk"
Jul 13 19:30:00.153900 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:30:00.153874    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-llvfh\""
Jul 13 19:30:00.160886 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:30:00.160852    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29732850-h5clk"]
Jul 13 19:30:00.162277 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:30:00.162256    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29732850-h5clk"
Jul 13 19:30:00.318289 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:30:00.318263    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29732850-h5clk"]
Jul 13 19:30:00.321237 ip-10-0-135-38 kubenswrapper[2563]: W0713 19:30:00.321209    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod700c4b18_72c3_4500_accd_457b12a57547.slice/crio-164b4d0649bcafd3f25163f3454af93c0e1fcd03b3d57b136cd968d1addbb77d WatchSource:0}: Error finding container 164b4d0649bcafd3f25163f3454af93c0e1fcd03b3d57b136cd968d1addbb77d: Status 404 returned error can't find the container with id 164b4d0649bcafd3f25163f3454af93c0e1fcd03b3d57b136cd968d1addbb77d
Jul 13 19:30:00.988371 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:30:00.988326    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29732850-h5clk" event={"ID":"700c4b18-72c3-4500-accd-457b12a57547","Type":"ContainerStarted","Data":"d9babe7e16f09e007299ede9b0e233e1343f0e3a2cb37fc5608a77db2aa5a990"}
Jul 13 19:30:00.988596 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:30:00.988395    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29732850-h5clk" event={"ID":"700c4b18-72c3-4500-accd-457b12a57547","Type":"ContainerStarted","Data":"164b4d0649bcafd3f25163f3454af93c0e1fcd03b3d57b136cd968d1addbb77d"}
Jul 13 19:30:01.007543 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:30:01.007487    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29732850-h5clk" podStartSLOduration=1.007466332 podStartE2EDuration="1.007466332s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 19:30:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 19:30:01.007269464 +0000 UTC m=+1888.782145821" watchObservedRunningTime="2026-07-13 19:30:01.007466332 +0000 UTC m=+1888.782342687"
Jul 13 19:30:01.995415 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:30:01.995375    2563 generic.go:356] "Generic (PLEG): container finished" podID="700c4b18-72c3-4500-accd-457b12a57547" containerID="d9babe7e16f09e007299ede9b0e233e1343f0e3a2cb37fc5608a77db2aa5a990" exitCode=0
Jul 13 19:30:01.995891 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:30:01.995501    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29732850-h5clk" event={"ID":"700c4b18-72c3-4500-accd-457b12a57547","Type":"ContainerDied","Data":"d9babe7e16f09e007299ede9b0e233e1343f0e3a2cb37fc5608a77db2aa5a990"}
Jul 13 19:30:03.138420 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:30:03.138386    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29732850-h5clk"
Jul 13 19:30:04.007455 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:30:04.007425    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29732850-h5clk"
Jul 13 19:30:04.007683 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:30:04.007472    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29732850-h5clk" event={"ID":"700c4b18-72c3-4500-accd-457b12a57547","Type":"ContainerDied","Data":"164b4d0649bcafd3f25163f3454af93c0e1fcd03b3d57b136cd968d1addbb77d"}
Jul 13 19:30:04.007683 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:30:04.007534    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="164b4d0649bcafd3f25163f3454af93c0e1fcd03b3d57b136cd968d1addbb77d"
Jul 13 19:30:06.812839 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:30:06.812792    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-be9a1497-openshift-default-75d6669dc5-rr7vq"]
Jul 13 19:30:06.813335 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:30:06.813157    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="700c4b18-72c3-4500-accd-457b12a57547" containerName="cleanup"
Jul 13 19:30:06.813335 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:30:06.813170    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="700c4b18-72c3-4500-accd-457b12a57547" containerName="cleanup"
Jul 13 19:30:06.813335 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:30:06.813246    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="700c4b18-72c3-4500-accd-457b12a57547" containerName="cleanup"
Jul 13 19:30:06.816340 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:30:06.816309    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-be9a1497-openshift-default-75d6669dc5-rr7vq"
Jul 13 19:30:06.819562 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:30:06.819538    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-be9a1497-openshift-default-dockercfg-pb4zt\""
Jul 13 19:30:06.833929 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:30:06.833897    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-be9a1497-openshift-default-75d6669dc5-rr7vq"]
Jul 13 19:30:07.002177 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:30:07.002132    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b3fa8a89-a584-4184-9b97-6b2c56f9fd21-istio-podinfo\") pod \"e2e-mt-be9a1497-openshift-default-75d6669dc5-rr7vq\" (UID: \"b3fa8a89-a584-4184-9b97-6b2c56f9fd21\") " pod="openshift-ingress/e2e-mt-be9a1497-openshift-default-75d6669dc5-rr7vq"
Jul 13 19:30:07.002441 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:30:07.002185    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b3fa8a89-a584-4184-9b97-6b2c56f9fd21-credential-socket\") pod \"e2e-mt-be9a1497-openshift-default-75d6669dc5-rr7vq\" (UID: \"b3fa8a89-a584-4184-9b97-6b2c56f9fd21\") " pod="openshift-ingress/e2e-mt-be9a1497-openshift-default-75d6669dc5-rr7vq"
Jul 13 19:30:07.002441 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:30:07.002223    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b3fa8a89-a584-4184-9b97-6b2c56f9fd21-istio-token\") pod \"e2e-mt-be9a1497-openshift-default-75d6669dc5-rr7vq\" (UID: \"b3fa8a89-a584-4184-9b97-6b2c56f9fd21\") " pod="openshift-ingress/e2e-mt-be9a1497-openshift-default-75d6669dc5-rr7vq"
Jul 13 19:30:07.002441 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:30:07.002287    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b3fa8a89-a584-4184-9b97-6b2c56f9fd21-istio-data\") pod \"e2e-mt-be9a1497-openshift-default-75d6669dc5-rr7vq\" (UID: \"b3fa8a89-a584-4184-9b97-6b2c56f9fd21\") " pod="openshift-ingress/e2e-mt-be9a1497-openshift-default-75d6669dc5-rr7vq"
Jul 13 19:30:07.002441 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:30:07.002362    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b3fa8a89-a584-4184-9b97-6b2c56f9fd21-workload-socket\") pod \"e2e-mt-be9a1497-openshift-default-75d6669dc5-rr7vq\" (UID: \"b3fa8a89-a584-4184-9b97-6b2c56f9fd21\") " pod="openshift-ingress/e2e-mt-be9a1497-openshift-default-75d6669dc5-rr7vq"
Jul 13 19:30:07.002441 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:30:07.002406    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b3fa8a89-a584-4184-9b97-6b2c56f9fd21-istio-envoy\") pod \"e2e-mt-be9a1497-openshift-default-75d6669dc5-rr7vq\" (UID: \"b3fa8a89-a584-4184-9b97-6b2c56f9fd21\") " pod="openshift-ingress/e2e-mt-be9a1497-openshift-default-75d6669dc5-rr7vq"
Jul 13 19:30:07.002441 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:30:07.002436    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b3fa8a89-a584-4184-9b97-6b2c56f9fd21-istiod-ca-cert\") pod \"e2e-mt-be9a1497-openshift-default-75d6669dc5-rr7vq\" (UID: \"b3fa8a89-a584-4184-9b97-6b2c56f9fd21\") " pod="openshift-ingress/e2e-mt-be9a1497-openshift-default-75d6669dc5-rr7vq"
Jul 13 19:30:07.002764 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:30:07.002523    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b3fa8a89-a584-4184-9b97-6b2c56f9fd21-workload-certs\") pod \"e2e-mt-be9a1497-openshift-default-75d6669dc5-rr7vq\" (UID: \"b3fa8a89-a584-4184-9b97-6b2c56f9fd21\") " pod="openshift-ingress/e2e-mt-be9a1497-openshift-default-75d6669dc5-rr7vq"
Jul 13 19:30:07.002764 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:30:07.002565    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nrc6m\" (UniqueName: \"kubernetes.io/projected/b3fa8a89-a584-4184-9b97-6b2c56f9fd21-kube-api-access-nrc6m\") pod \"e2e-mt-be9a1497-openshift-default-75d6669dc5-rr7vq\" (UID: \"b3fa8a89-a584-4184-9b97-6b2c56f9fd21\") " pod="openshift-ingress/e2e-mt-be9a1497-openshift-default-75d6669dc5-rr7vq"
Jul 13 19:30:07.103490 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:30:07.103448    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b3fa8a89-a584-4184-9b97-6b2c56f9fd21-istio-data\") pod \"e2e-mt-be9a1497-openshift-default-75d6669dc5-rr7vq\" (UID: \"b3fa8a89-a584-4184-9b97-6b2c56f9fd21\") " pod="openshift-ingress/e2e-mt-be9a1497-openshift-default-75d6669dc5-rr7vq"
Jul 13 19:30:07.103723 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:30:07.103526    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b3fa8a89-a584-4184-9b97-6b2c56f9fd21-workload-socket\") pod \"e2e-mt-be9a1497-openshift-default-75d6669dc5-rr7vq\" (UID: \"b3fa8a89-a584-4184-9b97-6b2c56f9fd21\") " pod="openshift-ingress/e2e-mt-be9a1497-openshift-default-75d6669dc5-rr7vq"
Jul 13 19:30:07.103723 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:30:07.103558    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b3fa8a89-a584-4184-9b97-6b2c56f9fd21-istio-envoy\") pod \"e2e-mt-be9a1497-openshift-default-75d6669dc5-rr7vq\" (UID: \"b3fa8a89-a584-4184-9b97-6b2c56f9fd21\") " pod="openshift-ingress/e2e-mt-be9a1497-openshift-default-75d6669dc5-rr7vq"
Jul 13 19:30:07.103723 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:30:07.103576    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b3fa8a89-a584-4184-9b97-6b2c56f9fd21-istiod-ca-cert\") pod \"e2e-mt-be9a1497-openshift-default-75d6669dc5-rr7vq\" (UID: \"b3fa8a89-a584-4184-9b97-6b2c56f9fd21\") " pod="openshift-ingress/e2e-mt-be9a1497-openshift-default-75d6669dc5-rr7vq"
Jul 13 19:30:07.103723 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:30:07.103614    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b3fa8a89-a584-4184-9b97-6b2c56f9fd21-workload-certs\") pod \"e2e-mt-be9a1497-openshift-default-75d6669dc5-rr7vq\" (UID: \"b3fa8a89-a584-4184-9b97-6b2c56f9fd21\") " pod="openshift-ingress/e2e-mt-be9a1497-openshift-default-75d6669dc5-rr7vq"
Jul 13 19:30:07.103723 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:30:07.103645    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nrc6m\" (UniqueName: \"kubernetes.io/projected/b3fa8a89-a584-4184-9b97-6b2c56f9fd21-kube-api-access-nrc6m\") pod \"e2e-mt-be9a1497-openshift-default-75d6669dc5-rr7vq\" (UID: \"b3fa8a89-a584-4184-9b97-6b2c56f9fd21\") " pod="openshift-ingress/e2e-mt-be9a1497-openshift-default-75d6669dc5-rr7vq"
Jul 13 19:30:07.103723 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:30:07.103682    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b3fa8a89-a584-4184-9b97-6b2c56f9fd21-istio-podinfo\") pod \"e2e-mt-be9a1497-openshift-default-75d6669dc5-rr7vq\" (UID: \"b3fa8a89-a584-4184-9b97-6b2c56f9fd21\") " pod="openshift-ingress/e2e-mt-be9a1497-openshift-default-75d6669dc5-rr7vq"
Jul 13 19:30:07.103723 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:30:07.103713    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b3fa8a89-a584-4184-9b97-6b2c56f9fd21-credential-socket\") pod \"e2e-mt-be9a1497-openshift-default-75d6669dc5-rr7vq\" (UID: \"b3fa8a89-a584-4184-9b97-6b2c56f9fd21\") " pod="openshift-ingress/e2e-mt-be9a1497-openshift-default-75d6669dc5-rr7vq"
Jul 13 19:30:07.104147 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:30:07.103940    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b3fa8a89-a584-4184-9b97-6b2c56f9fd21-istio-data\") pod \"e2e-mt-be9a1497-openshift-default-75d6669dc5-rr7vq\" (UID: \"b3fa8a89-a584-4184-9b97-6b2c56f9fd21\") " pod="openshift-ingress/e2e-mt-be9a1497-openshift-default-75d6669dc5-rr7vq"
Jul 13 19:30:07.104147 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:30:07.103996    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b3fa8a89-a584-4184-9b97-6b2c56f9fd21-istio-token\") pod \"e2e-mt-be9a1497-openshift-default-75d6669dc5-rr7vq\" (UID: \"b3fa8a89-a584-4184-9b97-6b2c56f9fd21\") " pod="openshift-ingress/e2e-mt-be9a1497-openshift-default-75d6669dc5-rr7vq"
Jul 13 19:30:07.104147 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:30:07.104127    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b3fa8a89-a584-4184-9b97-6b2c56f9fd21-workload-certs\") pod \"e2e-mt-be9a1497-openshift-default-75d6669dc5-rr7vq\" (UID: \"b3fa8a89-a584-4184-9b97-6b2c56f9fd21\") " pod="openshift-ingress/e2e-mt-be9a1497-openshift-default-75d6669dc5-rr7vq"
Jul 13 19:30:07.104292 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:30:07.104190    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b3fa8a89-a584-4184-9b97-6b2c56f9fd21-credential-socket\") pod \"e2e-mt-be9a1497-openshift-default-75d6669dc5-rr7vq\" (UID: \"b3fa8a89-a584-4184-9b97-6b2c56f9fd21\") " pod="openshift-ingress/e2e-mt-be9a1497-openshift-default-75d6669dc5-rr7vq"
Jul 13 19:30:07.104347 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:30:07.104307    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b3fa8a89-a584-4184-9b97-6b2c56f9fd21-workload-socket\") pod \"e2e-mt-be9a1497-openshift-default-75d6669dc5-rr7vq\" (UID: \"b3fa8a89-a584-4184-9b97-6b2c56f9fd21\") " pod="openshift-ingress/e2e-mt-be9a1497-openshift-default-75d6669dc5-rr7vq"
Jul 13 19:30:07.104390 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:30:07.104363    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b3fa8a89-a584-4184-9b97-6b2c56f9fd21-istiod-ca-cert\") pod \"e2e-mt-be9a1497-openshift-default-75d6669dc5-rr7vq\" (UID: \"b3fa8a89-a584-4184-9b97-6b2c56f9fd21\") " pod="openshift-ingress/e2e-mt-be9a1497-openshift-default-75d6669dc5-rr7vq"
Jul 13 19:30:07.106103 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:30:07.106083    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b3fa8a89-a584-4184-9b97-6b2c56f9fd21-istio-envoy\") pod \"e2e-mt-be9a1497-openshift-default-75d6669dc5-rr7vq\" (UID: \"b3fa8a89-a584-4184-9b97-6b2c56f9fd21\") " pod="openshift-ingress/e2e-mt-be9a1497-openshift-default-75d6669dc5-rr7vq"
Jul 13 19:30:07.106376 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:30:07.106356    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b3fa8a89-a584-4184-9b97-6b2c56f9fd21-istio-podinfo\") pod \"e2e-mt-be9a1497-openshift-default-75d6669dc5-rr7vq\" (UID: \"b3fa8a89-a584-4184-9b97-6b2c56f9fd21\") " pod="openshift-ingress/e2e-mt-be9a1497-openshift-default-75d6669dc5-rr7vq"
Jul 13 19:30:07.112924 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:30:07.112894    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b3fa8a89-a584-4184-9b97-6b2c56f9fd21-istio-token\") pod \"e2e-mt-be9a1497-openshift-default-75d6669dc5-rr7vq\" (UID: \"b3fa8a89-a584-4184-9b97-6b2c56f9fd21\") " pod="openshift-ingress/e2e-mt-be9a1497-openshift-default-75d6669dc5-rr7vq"
Jul 13 19:30:07.113075 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:30:07.113054    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nrc6m\" (UniqueName: \"kubernetes.io/projected/b3fa8a89-a584-4184-9b97-6b2c56f9fd21-kube-api-access-nrc6m\") pod \"e2e-mt-be9a1497-openshift-default-75d6669dc5-rr7vq\" (UID: \"b3fa8a89-a584-4184-9b97-6b2c56f9fd21\") " pod="openshift-ingress/e2e-mt-be9a1497-openshift-default-75d6669dc5-rr7vq"
Jul 13 19:30:07.126740 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:30:07.126711    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-be9a1497-openshift-default-75d6669dc5-rr7vq"
Jul 13 19:30:07.284998 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:30:07.284815    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-be9a1497-openshift-default-75d6669dc5-rr7vq"]
Jul 13 19:30:07.287897 ip-10-0-135-38 kubenswrapper[2563]: W0713 19:30:07.287850    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb3fa8a89_a584_4184_9b97_6b2c56f9fd21.slice/crio-c762429a5c09223454cfd01f678e5882cda7081e3cc450749b07ced6da5f8259 WatchSource:0}: Error finding container c762429a5c09223454cfd01f678e5882cda7081e3cc450749b07ced6da5f8259: Status 404 returned error can't find the container with id c762429a5c09223454cfd01f678e5882cda7081e3cc450749b07ced6da5f8259
Jul 13 19:30:07.290138 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:30:07.290100    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 13 19:30:07.290271 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:30:07.290175    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 13 19:30:07.290271 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:30:07.290219    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 13 19:30:08.029939 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:30:08.029892    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-be9a1497-openshift-default-75d6669dc5-rr7vq" event={"ID":"b3fa8a89-a584-4184-9b97-6b2c56f9fd21","Type":"ContainerStarted","Data":"85a2406f7a303b9a2e9b4336c1a8b7a227bfa9d230ab7ce94dbd8629b5af5865"}
Jul 13 19:30:08.030460 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:30:08.029989    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-be9a1497-openshift-default-75d6669dc5-rr7vq" event={"ID":"b3fa8a89-a584-4184-9b97-6b2c56f9fd21","Type":"ContainerStarted","Data":"c762429a5c09223454cfd01f678e5882cda7081e3cc450749b07ced6da5f8259"}
Jul 13 19:30:08.057709 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:30:08.057651    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-be9a1497-openshift-default-75d6669dc5-rr7vq" podStartSLOduration=2.057632945 podStartE2EDuration="2.057632945s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 19:30:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 19:30:08.055674338 +0000 UTC m=+1895.830550694" watchObservedRunningTime="2026-07-13 19:30:08.057632945 +0000 UTC m=+1895.832509364"
Jul 13 19:30:08.127409 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:30:08.127364    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-be9a1497-openshift-default-75d6669dc5-rr7vq"
Jul 13 19:30:08.132742 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:30:08.132708    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-be9a1497-openshift-default-75d6669dc5-rr7vq"
Jul 13 19:30:09.035238 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:30:09.035199    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-be9a1497-openshift-default-75d6669dc5-rr7vq"
Jul 13 19:30:09.036152 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:30:09.036134    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-be9a1497-openshift-default-75d6669dc5-rr7vq"
Jul 13 19:30:21.836271 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:30:21.836227    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-be9a1497-p4kkg"]
Jul 13 19:30:21.840655 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:30:21.840631    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-be9a1497-p4kkg"
Jul 13 19:30:21.842893 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:30:21.842866    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-llvfh\""
Jul 13 19:30:21.847780 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:30:21.847747    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-be9a1497-p4kkg"]
Jul 13 19:30:21.940047 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:30:21.939998    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/05af24a8-1169-4437-9dcf-bc3f4998a9f5-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-be9a1497-p4kkg\" (UID: \"05af24a8-1169-4437-9dcf-bc3f4998a9f5\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-be9a1497-p4kkg"
Jul 13 19:30:22.041040 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:30:22.040981    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/05af24a8-1169-4437-9dcf-bc3f4998a9f5-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-be9a1497-p4kkg\" (UID: \"05af24a8-1169-4437-9dcf-bc3f4998a9f5\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-be9a1497-p4kkg"
Jul 13 19:30:22.041810 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:30:22.041774    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/05af24a8-1169-4437-9dcf-bc3f4998a9f5-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-be9a1497-p4kkg\" (UID: \"05af24a8-1169-4437-9dcf-bc3f4998a9f5\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-be9a1497-p4kkg"
Jul 13 19:30:22.155106 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:30:22.155061    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-be9a1497-p4kkg"
Jul 13 19:30:22.315213 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:30:22.315171    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-be9a1497-p4kkg"]
Jul 13 19:30:22.318147 ip-10-0-135-38 kubenswrapper[2563]: W0713 19:30:22.318112    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod05af24a8_1169_4437_9dcf_bc3f4998a9f5.slice/crio-00529d2d0a11a755d5fa3710e0a327be89300991a30b119730d9dbe1ddaa5753 WatchSource:0}: Error finding container 00529d2d0a11a755d5fa3710e0a327be89300991a30b119730d9dbe1ddaa5753: Status 404 returned error can't find the container with id 00529d2d0a11a755d5fa3710e0a327be89300991a30b119730d9dbe1ddaa5753
Jul 13 19:30:23.117775 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:30:23.117733    2563 generic.go:356] "Generic (PLEG): container finished" podID="05af24a8-1169-4437-9dcf-bc3f4998a9f5" containerID="6c3cc354fb3928e3e98c5bc6e47e87dc68bccb08a99467ceb57cfedcf303f1c1" exitCode=0
Jul 13 19:30:23.118228 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:30:23.117782    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-be9a1497-p4kkg" event={"ID":"05af24a8-1169-4437-9dcf-bc3f4998a9f5","Type":"ContainerDied","Data":"6c3cc354fb3928e3e98c5bc6e47e87dc68bccb08a99467ceb57cfedcf303f1c1"}
Jul 13 19:30:23.118228 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:30:23.117830    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-be9a1497-p4kkg" event={"ID":"05af24a8-1169-4437-9dcf-bc3f4998a9f5","Type":"ContainerStarted","Data":"00529d2d0a11a755d5fa3710e0a327be89300991a30b119730d9dbe1ddaa5753"}
Jul 13 19:30:24.036689 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:30:24.036649    2563 patch_prober.go:28] interesting pod/e2e-mt-be9a1497-openshift-default-75d6669dc5-rr7vq container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused" start-of-body=
Jul 13 19:30:24.036954 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:30:24.036717    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-be9a1497-openshift-default-75d6669dc5-rr7vq" podUID="b3fa8a89-a584-4184-9b97-6b2c56f9fd21" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused"
Jul 13 19:30:24.124857 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:30:24.124823    2563 generic.go:356] "Generic (PLEG): container finished" podID="b3fa8a89-a584-4184-9b97-6b2c56f9fd21" containerID="85a2406f7a303b9a2e9b4336c1a8b7a227bfa9d230ab7ce94dbd8629b5af5865" exitCode=0
Jul 13 19:30:24.125303 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:30:24.124906    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-be9a1497-openshift-default-75d6669dc5-rr7vq" event={"ID":"b3fa8a89-a584-4184-9b97-6b2c56f9fd21","Type":"ContainerDied","Data":"85a2406f7a303b9a2e9b4336c1a8b7a227bfa9d230ab7ce94dbd8629b5af5865"}
Jul 13 19:30:24.125661 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:30:24.125451    2563 scope.go:117] "RemoveContainer" containerID="85a2406f7a303b9a2e9b4336c1a8b7a227bfa9d230ab7ce94dbd8629b5af5865"
Jul 13 19:30:24.126593 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:30:24.126558    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 13 19:30:24.126686 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:30:24.126654    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 13 19:30:24.126724 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:30:24.126693    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 13 19:30:24.280851 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:30:24.280822    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-be9a1497-p4kkg"
Jul 13 19:30:24.365491 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:30:24.365436    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/05af24a8-1169-4437-9dcf-bc3f4998a9f5-maas-api-service-ca\") pod \"05af24a8-1169-4437-9dcf-bc3f4998a9f5\" (UID: \"05af24a8-1169-4437-9dcf-bc3f4998a9f5\") "
Jul 13 19:30:24.365821 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:30:24.365791    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/05af24a8-1169-4437-9dcf-bc3f4998a9f5-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "05af24a8-1169-4437-9dcf-bc3f4998a9f5" (UID: "05af24a8-1169-4437-9dcf-bc3f4998a9f5"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 19:30:24.466386 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:30:24.466340    2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/05af24a8-1169-4437-9dcf-bc3f4998a9f5-maas-api-service-ca\") on node \"ip-10-0-135-38.ec2.internal\" DevicePath \"\""
Jul 13 19:30:25.137157 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:30:25.137118    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-be9a1497-openshift-default-75d6669dc5-rr7vq" event={"ID":"b3fa8a89-a584-4184-9b97-6b2c56f9fd21","Type":"ContainerStarted","Data":"293005d071bc5f0e1bb06e6e0a924d3017e8d74223bcbe8395be7df71090e2f1"}
Jul 13 19:30:25.139767 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:30:25.139742    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-be9a1497-p4kkg"
Jul 13 19:30:25.139951 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:30:25.139746    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-be9a1497-p4kkg" event={"ID":"05af24a8-1169-4437-9dcf-bc3f4998a9f5","Type":"ContainerDied","Data":"00529d2d0a11a755d5fa3710e0a327be89300991a30b119730d9dbe1ddaa5753"}
Jul 13 19:30:25.139951 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:30:25.139863    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="00529d2d0a11a755d5fa3710e0a327be89300991a30b119730d9dbe1ddaa5753"
Jul 13 19:30:26.127935 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:30:26.127891    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-be9a1497-openshift-default-75d6669dc5-rr7vq"
Jul 13 19:30:26.128209 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:30:26.128182    2563 patch_prober.go:28] interesting pod/e2e-mt-be9a1497-openshift-default-75d6669dc5-rr7vq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused" start-of-body=
Jul 13 19:30:26.128266 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:30:26.128239    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-be9a1497-openshift-default-75d6669dc5-rr7vq" podUID="b3fa8a89-a584-4184-9b97-6b2c56f9fd21" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused"
Jul 13 19:30:27.127427 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:30:27.127383    2563 patch_prober.go:28] interesting pod/e2e-mt-be9a1497-openshift-default-75d6669dc5-rr7vq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused" start-of-body=
Jul 13 19:30:27.127860 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:30:27.127448    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-be9a1497-openshift-default-75d6669dc5-rr7vq" podUID="b3fa8a89-a584-4184-9b97-6b2c56f9fd21" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused"
Jul 13 19:30:28.128247 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:30:28.128201    2563 patch_prober.go:28] interesting pod/e2e-mt-be9a1497-openshift-default-75d6669dc5-rr7vq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused" start-of-body=
Jul 13 19:30:28.128759 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:30:28.128287    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-be9a1497-openshift-default-75d6669dc5-rr7vq" podUID="b3fa8a89-a584-4184-9b97-6b2c56f9fd21" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused"
Jul 13 19:30:29.127361 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:30:29.127318    2563 patch_prober.go:28] interesting pod/e2e-mt-be9a1497-openshift-default-75d6669dc5-rr7vq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused" start-of-body=
Jul 13 19:30:29.127570 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:30:29.127394    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-be9a1497-openshift-default-75d6669dc5-rr7vq" podUID="b3fa8a89-a584-4184-9b97-6b2c56f9fd21" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused"
Jul 13 19:30:30.131304 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:30:30.131266    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-be9a1497-openshift-default-75d6669dc5-rr7vq"
Jul 13 19:30:30.131711 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:30:30.131562    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-be9a1497-openshift-default-75d6669dc5-rr7vq"
Jul 13 19:30:30.132343 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:30:30.132322    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-be9a1497-openshift-default-75d6669dc5-rr7vq"
Jul 13 19:30:47.635940 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:30:47.635896    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-be9a1497-openshift-default-75d6669dc5-rr7vq"]
Jul 13 19:30:47.636614 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:30:47.636180    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-be9a1497-openshift-default-75d6669dc5-rr7vq" podUID="b3fa8a89-a584-4184-9b97-6b2c56f9fd21" containerName="istio-proxy" containerID="cri-o://293005d071bc5f0e1bb06e6e0a924d3017e8d74223bcbe8395be7df71090e2f1" gracePeriod=30
Jul 13 19:30:52.892433 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:30:52.892401    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-be9a1497-openshift-default-75d6669dc5-rr7vq"
Jul 13 19:30:53.047198 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:30:53.047102    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b3fa8a89-a584-4184-9b97-6b2c56f9fd21-workload-socket\") pod \"b3fa8a89-a584-4184-9b97-6b2c56f9fd21\" (UID: \"b3fa8a89-a584-4184-9b97-6b2c56f9fd21\") "
Jul 13 19:30:53.047198 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:30:53.047168    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nrc6m\" (UniqueName: \"kubernetes.io/projected/b3fa8a89-a584-4184-9b97-6b2c56f9fd21-kube-api-access-nrc6m\") pod \"b3fa8a89-a584-4184-9b97-6b2c56f9fd21\" (UID: \"b3fa8a89-a584-4184-9b97-6b2c56f9fd21\") "
Jul 13 19:30:53.047412 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:30:53.047205    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b3fa8a89-a584-4184-9b97-6b2c56f9fd21-istio-podinfo\") pod \"b3fa8a89-a584-4184-9b97-6b2c56f9fd21\" (UID: \"b3fa8a89-a584-4184-9b97-6b2c56f9fd21\") "
Jul 13 19:30:53.047412 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:30:53.047237    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b3fa8a89-a584-4184-9b97-6b2c56f9fd21-workload-certs\") pod \"b3fa8a89-a584-4184-9b97-6b2c56f9fd21\" (UID: \"b3fa8a89-a584-4184-9b97-6b2c56f9fd21\") "
Jul 13 19:30:53.047412 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:30:53.047260    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b3fa8a89-a584-4184-9b97-6b2c56f9fd21-istiod-ca-cert\") pod \"b3fa8a89-a584-4184-9b97-6b2c56f9fd21\" (UID: \"b3fa8a89-a584-4184-9b97-6b2c56f9fd21\") "
Jul 13 19:30:53.047412 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:30:53.047307    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b3fa8a89-a584-4184-9b97-6b2c56f9fd21-istio-envoy\") pod \"b3fa8a89-a584-4184-9b97-6b2c56f9fd21\" (UID: \"b3fa8a89-a584-4184-9b97-6b2c56f9fd21\") "
Jul 13 19:30:53.047412 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:30:53.047350    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b3fa8a89-a584-4184-9b97-6b2c56f9fd21-istio-data\") pod \"b3fa8a89-a584-4184-9b97-6b2c56f9fd21\" (UID: \"b3fa8a89-a584-4184-9b97-6b2c56f9fd21\") "
Jul 13 19:30:53.047412 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:30:53.047390    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b3fa8a89-a584-4184-9b97-6b2c56f9fd21-istio-token\") pod \"b3fa8a89-a584-4184-9b97-6b2c56f9fd21\" (UID: \"b3fa8a89-a584-4184-9b97-6b2c56f9fd21\") "
Jul 13 19:30:53.047699 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:30:53.047423    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b3fa8a89-a584-4184-9b97-6b2c56f9fd21-credential-socket\") pod \"b3fa8a89-a584-4184-9b97-6b2c56f9fd21\" (UID: \"b3fa8a89-a584-4184-9b97-6b2c56f9fd21\") "
Jul 13 19:30:53.047699 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:30:53.047428    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b3fa8a89-a584-4184-9b97-6b2c56f9fd21-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "b3fa8a89-a584-4184-9b97-6b2c56f9fd21" (UID: "b3fa8a89-a584-4184-9b97-6b2c56f9fd21"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 19:30:53.047699 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:30:53.047526    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b3fa8a89-a584-4184-9b97-6b2c56f9fd21-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "b3fa8a89-a584-4184-9b97-6b2c56f9fd21" (UID: "b3fa8a89-a584-4184-9b97-6b2c56f9fd21"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 19:30:53.047865 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:30:53.047727    2563 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b3fa8a89-a584-4184-9b97-6b2c56f9fd21-workload-socket\") on node \"ip-10-0-135-38.ec2.internal\" DevicePath \"\""
Jul 13 19:30:53.047865 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:30:53.047750    2563 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b3fa8a89-a584-4184-9b97-6b2c56f9fd21-workload-certs\") on node \"ip-10-0-135-38.ec2.internal\" DevicePath \"\""
Jul 13 19:30:53.047865 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:30:53.047763    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b3fa8a89-a584-4184-9b97-6b2c56f9fd21-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "b3fa8a89-a584-4184-9b97-6b2c56f9fd21" (UID: "b3fa8a89-a584-4184-9b97-6b2c56f9fd21"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 19:30:53.047865 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:30:53.047795    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b3fa8a89-a584-4184-9b97-6b2c56f9fd21-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "b3fa8a89-a584-4184-9b97-6b2c56f9fd21" (UID: "b3fa8a89-a584-4184-9b97-6b2c56f9fd21"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 19:30:53.048383 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:30:53.048354    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b3fa8a89-a584-4184-9b97-6b2c56f9fd21-istio-data" (OuterVolumeSpecName: "istio-data") pod "b3fa8a89-a584-4184-9b97-6b2c56f9fd21" (UID: "b3fa8a89-a584-4184-9b97-6b2c56f9fd21"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 19:30:53.049593 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:30:53.049568    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b3fa8a89-a584-4184-9b97-6b2c56f9fd21-kube-api-access-nrc6m" (OuterVolumeSpecName: "kube-api-access-nrc6m") pod "b3fa8a89-a584-4184-9b97-6b2c56f9fd21" (UID: "b3fa8a89-a584-4184-9b97-6b2c56f9fd21"). InnerVolumeSpecName "kube-api-access-nrc6m". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 19:30:53.049680 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:30:53.049587    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b3fa8a89-a584-4184-9b97-6b2c56f9fd21-istio-token" (OuterVolumeSpecName: "istio-token") pod "b3fa8a89-a584-4184-9b97-6b2c56f9fd21" (UID: "b3fa8a89-a584-4184-9b97-6b2c56f9fd21"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 19:30:53.049869 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:30:53.049847    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b3fa8a89-a584-4184-9b97-6b2c56f9fd21-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "b3fa8a89-a584-4184-9b97-6b2c56f9fd21" (UID: "b3fa8a89-a584-4184-9b97-6b2c56f9fd21"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 19:30:53.049965 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:30:53.049946    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/b3fa8a89-a584-4184-9b97-6b2c56f9fd21-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "b3fa8a89-a584-4184-9b97-6b2c56f9fd21" (UID: "b3fa8a89-a584-4184-9b97-6b2c56f9fd21"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 13 19:30:53.148269 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:30:53.148222    2563 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b3fa8a89-a584-4184-9b97-6b2c56f9fd21-istio-data\") on node \"ip-10-0-135-38.ec2.internal\" DevicePath \"\""
Jul 13 19:30:53.148269 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:30:53.148260    2563 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b3fa8a89-a584-4184-9b97-6b2c56f9fd21-istio-token\") on node \"ip-10-0-135-38.ec2.internal\" DevicePath \"\""
Jul 13 19:30:53.148269 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:30:53.148270    2563 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b3fa8a89-a584-4184-9b97-6b2c56f9fd21-credential-socket\") on node \"ip-10-0-135-38.ec2.internal\" DevicePath \"\""
Jul 13 19:30:53.148269 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:30:53.148280    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nrc6m\" (UniqueName: \"kubernetes.io/projected/b3fa8a89-a584-4184-9b97-6b2c56f9fd21-kube-api-access-nrc6m\") on node \"ip-10-0-135-38.ec2.internal\" DevicePath \"\""
Jul 13 19:30:53.148573 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:30:53.148290    2563 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b3fa8a89-a584-4184-9b97-6b2c56f9fd21-istio-podinfo\") on node \"ip-10-0-135-38.ec2.internal\" DevicePath \"\""
Jul 13 19:30:53.148573 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:30:53.148298    2563 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b3fa8a89-a584-4184-9b97-6b2c56f9fd21-istiod-ca-cert\") on node \"ip-10-0-135-38.ec2.internal\" DevicePath \"\""
Jul 13 19:30:53.148573 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:30:53.148307    2563 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b3fa8a89-a584-4184-9b97-6b2c56f9fd21-istio-envoy\") on node \"ip-10-0-135-38.ec2.internal\" DevicePath \"\""
Jul 13 19:30:53.290666 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:30:53.290620    2563 generic.go:356] "Generic (PLEG): container finished" podID="b3fa8a89-a584-4184-9b97-6b2c56f9fd21" containerID="293005d071bc5f0e1bb06e6e0a924d3017e8d74223bcbe8395be7df71090e2f1" exitCode=0
Jul 13 19:30:53.290895 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:30:53.290700    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-be9a1497-openshift-default-75d6669dc5-rr7vq"
Jul 13 19:30:53.290895 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:30:53.290718    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-be9a1497-openshift-default-75d6669dc5-rr7vq" event={"ID":"b3fa8a89-a584-4184-9b97-6b2c56f9fd21","Type":"ContainerDied","Data":"293005d071bc5f0e1bb06e6e0a924d3017e8d74223bcbe8395be7df71090e2f1"}
Jul 13 19:30:53.290895 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:30:53.290801    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-be9a1497-openshift-default-75d6669dc5-rr7vq" event={"ID":"b3fa8a89-a584-4184-9b97-6b2c56f9fd21","Type":"ContainerDied","Data":"c762429a5c09223454cfd01f678e5882cda7081e3cc450749b07ced6da5f8259"}
Jul 13 19:30:53.290895 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:30:53.290834    2563 scope.go:117] "RemoveContainer" containerID="293005d071bc5f0e1bb06e6e0a924d3017e8d74223bcbe8395be7df71090e2f1"
Jul 13 19:30:53.302045 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:30:53.302000    2563 scope.go:117] "RemoveContainer" containerID="85a2406f7a303b9a2e9b4336c1a8b7a227bfa9d230ab7ce94dbd8629b5af5865"
Jul 13 19:30:53.311450 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:30:53.311430    2563 scope.go:117] "RemoveContainer" containerID="293005d071bc5f0e1bb06e6e0a924d3017e8d74223bcbe8395be7df71090e2f1"
Jul 13 19:30:53.311804 ip-10-0-135-38 kubenswrapper[2563]: E0713 19:30:53.311783    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"293005d071bc5f0e1bb06e6e0a924d3017e8d74223bcbe8395be7df71090e2f1\": container with ID starting with 293005d071bc5f0e1bb06e6e0a924d3017e8d74223bcbe8395be7df71090e2f1 not found: ID does not exist" containerID="293005d071bc5f0e1bb06e6e0a924d3017e8d74223bcbe8395be7df71090e2f1"
Jul 13 19:30:53.311878 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:30:53.311814    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"293005d071bc5f0e1bb06e6e0a924d3017e8d74223bcbe8395be7df71090e2f1"} err="failed to get container status \"293005d071bc5f0e1bb06e6e0a924d3017e8d74223bcbe8395be7df71090e2f1\": rpc error: code = NotFound desc = could not find container \"293005d071bc5f0e1bb06e6e0a924d3017e8d74223bcbe8395be7df71090e2f1\": container with ID starting with 293005d071bc5f0e1bb06e6e0a924d3017e8d74223bcbe8395be7df71090e2f1 not found: ID does not exist"
Jul 13 19:30:53.311878 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:30:53.311837    2563 scope.go:117] "RemoveContainer" containerID="85a2406f7a303b9a2e9b4336c1a8b7a227bfa9d230ab7ce94dbd8629b5af5865"
Jul 13 19:30:53.312317 ip-10-0-135-38 kubenswrapper[2563]: E0713 19:30:53.312280    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"85a2406f7a303b9a2e9b4336c1a8b7a227bfa9d230ab7ce94dbd8629b5af5865\": container with ID starting with 85a2406f7a303b9a2e9b4336c1a8b7a227bfa9d230ab7ce94dbd8629b5af5865 not found: ID does not exist" containerID="85a2406f7a303b9a2e9b4336c1a8b7a227bfa9d230ab7ce94dbd8629b5af5865"
Jul 13 19:30:53.312440 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:30:53.312322    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"85a2406f7a303b9a2e9b4336c1a8b7a227bfa9d230ab7ce94dbd8629b5af5865"} err="failed to get container status \"85a2406f7a303b9a2e9b4336c1a8b7a227bfa9d230ab7ce94dbd8629b5af5865\": rpc error: code = NotFound desc = could not find container \"85a2406f7a303b9a2e9b4336c1a8b7a227bfa9d230ab7ce94dbd8629b5af5865\": container with ID starting with 85a2406f7a303b9a2e9b4336c1a8b7a227bfa9d230ab7ce94dbd8629b5af5865 not found: ID does not exist"
Jul 13 19:30:53.314679 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:30:53.314652    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-be9a1497-openshift-default-75d6669dc5-rr7vq"]
Jul 13 19:30:53.319429 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:30:53.319401    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-be9a1497-openshift-default-75d6669dc5-rr7vq"]
Jul 13 19:30:54.756448 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:30:54.756410    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b3fa8a89-a584-4184-9b97-6b2c56f9fd21" path="/var/lib/kubelet/pods/b3fa8a89-a584-4184-9b97-6b2c56f9fd21/volumes"
Jul 13 19:31:07.893468 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:31:07.893429    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-97bb288c-openshift-default-c9dc66875-zsfzz"]
Jul 13 19:31:07.894116 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:31:07.893789    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b3fa8a89-a584-4184-9b97-6b2c56f9fd21" containerName="istio-proxy"
Jul 13 19:31:07.894116 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:31:07.893799    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="b3fa8a89-a584-4184-9b97-6b2c56f9fd21" containerName="istio-proxy"
Jul 13 19:31:07.894116 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:31:07.893808    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="05af24a8-1169-4437-9dcf-bc3f4998a9f5" containerName="revoke-keys"
Jul 13 19:31:07.894116 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:31:07.893814    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="05af24a8-1169-4437-9dcf-bc3f4998a9f5" containerName="revoke-keys"
Jul 13 19:31:07.894116 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:31:07.893827    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b3fa8a89-a584-4184-9b97-6b2c56f9fd21" containerName="istio-proxy"
Jul 13 19:31:07.894116 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:31:07.893832    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="b3fa8a89-a584-4184-9b97-6b2c56f9fd21" containerName="istio-proxy"
Jul 13 19:31:07.894116 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:31:07.893911    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="05af24a8-1169-4437-9dcf-bc3f4998a9f5" containerName="revoke-keys"
Jul 13 19:31:07.894116 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:31:07.893919    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="b3fa8a89-a584-4184-9b97-6b2c56f9fd21" containerName="istio-proxy"
Jul 13 19:31:07.894116 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:31:07.893926    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="b3fa8a89-a584-4184-9b97-6b2c56f9fd21" containerName="istio-proxy"
Jul 13 19:31:07.896215 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:31:07.896191    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-97bb288c-openshift-default-c9dc66875-zsfzz"
Jul 13 19:31:07.898737 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:31:07.898707    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-97bb288c-openshift-default-dockercfg-9mz5r\""
Jul 13 19:31:07.927387 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:31:07.927342    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-97bb288c-openshift-default-c9dc66875-zsfzz"]
Jul 13 19:31:07.977417 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:31:07.977376    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dc5c7417-8f65-402c-b3f5-6a9fc50cc22a-workload-certs\") pod \"e2e-mt-97bb288c-openshift-default-c9dc66875-zsfzz\" (UID: \"dc5c7417-8f65-402c-b3f5-6a9fc50cc22a\") " pod="openshift-ingress/e2e-mt-97bb288c-openshift-default-c9dc66875-zsfzz"
Jul 13 19:31:07.977417 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:31:07.977417    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dc5c7417-8f65-402c-b3f5-6a9fc50cc22a-istio-podinfo\") pod \"e2e-mt-97bb288c-openshift-default-c9dc66875-zsfzz\" (UID: \"dc5c7417-8f65-402c-b3f5-6a9fc50cc22a\") " pod="openshift-ingress/e2e-mt-97bb288c-openshift-default-c9dc66875-zsfzz"
Jul 13 19:31:07.977691 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:31:07.977443    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dc5c7417-8f65-402c-b3f5-6a9fc50cc22a-istiod-ca-cert\") pod \"e2e-mt-97bb288c-openshift-default-c9dc66875-zsfzz\" (UID: \"dc5c7417-8f65-402c-b3f5-6a9fc50cc22a\") " pod="openshift-ingress/e2e-mt-97bb288c-openshift-default-c9dc66875-zsfzz"
Jul 13 19:31:07.977691 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:31:07.977487    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dc5c7417-8f65-402c-b3f5-6a9fc50cc22a-istio-envoy\") pod \"e2e-mt-97bb288c-openshift-default-c9dc66875-zsfzz\" (UID: \"dc5c7417-8f65-402c-b3f5-6a9fc50cc22a\") " pod="openshift-ingress/e2e-mt-97bb288c-openshift-default-c9dc66875-zsfzz"
Jul 13 19:31:07.977691 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:31:07.977560    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mxz4g\" (UniqueName: \"kubernetes.io/projected/dc5c7417-8f65-402c-b3f5-6a9fc50cc22a-kube-api-access-mxz4g\") pod \"e2e-mt-97bb288c-openshift-default-c9dc66875-zsfzz\" (UID: \"dc5c7417-8f65-402c-b3f5-6a9fc50cc22a\") " pod="openshift-ingress/e2e-mt-97bb288c-openshift-default-c9dc66875-zsfzz"
Jul 13 19:31:07.977691 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:31:07.977646    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dc5c7417-8f65-402c-b3f5-6a9fc50cc22a-istio-token\") pod \"e2e-mt-97bb288c-openshift-default-c9dc66875-zsfzz\" (UID: \"dc5c7417-8f65-402c-b3f5-6a9fc50cc22a\") " pod="openshift-ingress/e2e-mt-97bb288c-openshift-default-c9dc66875-zsfzz"
Jul 13 19:31:07.977933 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:31:07.977698    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dc5c7417-8f65-402c-b3f5-6a9fc50cc22a-credential-socket\") pod \"e2e-mt-97bb288c-openshift-default-c9dc66875-zsfzz\" (UID: \"dc5c7417-8f65-402c-b3f5-6a9fc50cc22a\") " pod="openshift-ingress/e2e-mt-97bb288c-openshift-default-c9dc66875-zsfzz"
Jul 13 19:31:07.977933 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:31:07.977728    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dc5c7417-8f65-402c-b3f5-6a9fc50cc22a-istio-data\") pod \"e2e-mt-97bb288c-openshift-default-c9dc66875-zsfzz\" (UID: \"dc5c7417-8f65-402c-b3f5-6a9fc50cc22a\") " pod="openshift-ingress/e2e-mt-97bb288c-openshift-default-c9dc66875-zsfzz"
Jul 13 19:31:07.977933 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:31:07.977795    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dc5c7417-8f65-402c-b3f5-6a9fc50cc22a-workload-socket\") pod \"e2e-mt-97bb288c-openshift-default-c9dc66875-zsfzz\" (UID: \"dc5c7417-8f65-402c-b3f5-6a9fc50cc22a\") " pod="openshift-ingress/e2e-mt-97bb288c-openshift-default-c9dc66875-zsfzz"
Jul 13 19:31:08.079342 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:31:08.079303    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dc5c7417-8f65-402c-b3f5-6a9fc50cc22a-workload-certs\") pod \"e2e-mt-97bb288c-openshift-default-c9dc66875-zsfzz\" (UID: \"dc5c7417-8f65-402c-b3f5-6a9fc50cc22a\") " pod="openshift-ingress/e2e-mt-97bb288c-openshift-default-c9dc66875-zsfzz"
Jul 13 19:31:08.079560 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:31:08.079353    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dc5c7417-8f65-402c-b3f5-6a9fc50cc22a-istio-podinfo\") pod \"e2e-mt-97bb288c-openshift-default-c9dc66875-zsfzz\" (UID: \"dc5c7417-8f65-402c-b3f5-6a9fc50cc22a\") " pod="openshift-ingress/e2e-mt-97bb288c-openshift-default-c9dc66875-zsfzz"
Jul 13 19:31:08.079560 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:31:08.079375    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dc5c7417-8f65-402c-b3f5-6a9fc50cc22a-istiod-ca-cert\") pod \"e2e-mt-97bb288c-openshift-default-c9dc66875-zsfzz\" (UID: \"dc5c7417-8f65-402c-b3f5-6a9fc50cc22a\") " pod="openshift-ingress/e2e-mt-97bb288c-openshift-default-c9dc66875-zsfzz"
Jul 13 19:31:08.079560 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:31:08.079396    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dc5c7417-8f65-402c-b3f5-6a9fc50cc22a-istio-envoy\") pod \"e2e-mt-97bb288c-openshift-default-c9dc66875-zsfzz\" (UID: \"dc5c7417-8f65-402c-b3f5-6a9fc50cc22a\") " pod="openshift-ingress/e2e-mt-97bb288c-openshift-default-c9dc66875-zsfzz"
Jul 13 19:31:08.079560 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:31:08.079420    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mxz4g\" (UniqueName: \"kubernetes.io/projected/dc5c7417-8f65-402c-b3f5-6a9fc50cc22a-kube-api-access-mxz4g\") pod \"e2e-mt-97bb288c-openshift-default-c9dc66875-zsfzz\" (UID: \"dc5c7417-8f65-402c-b3f5-6a9fc50cc22a\") " pod="openshift-ingress/e2e-mt-97bb288c-openshift-default-c9dc66875-zsfzz"
Jul 13 19:31:08.079560 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:31:08.079458    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dc5c7417-8f65-402c-b3f5-6a9fc50cc22a-istio-token\") pod \"e2e-mt-97bb288c-openshift-default-c9dc66875-zsfzz\" (UID: \"dc5c7417-8f65-402c-b3f5-6a9fc50cc22a\") " pod="openshift-ingress/e2e-mt-97bb288c-openshift-default-c9dc66875-zsfzz"
Jul 13 19:31:08.079560 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:31:08.079521    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dc5c7417-8f65-402c-b3f5-6a9fc50cc22a-credential-socket\") pod \"e2e-mt-97bb288c-openshift-default-c9dc66875-zsfzz\" (UID: \"dc5c7417-8f65-402c-b3f5-6a9fc50cc22a\") " pod="openshift-ingress/e2e-mt-97bb288c-openshift-default-c9dc66875-zsfzz"
Jul 13 19:31:08.079927 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:31:08.079564    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dc5c7417-8f65-402c-b3f5-6a9fc50cc22a-istio-data\") pod \"e2e-mt-97bb288c-openshift-default-c9dc66875-zsfzz\" (UID: \"dc5c7417-8f65-402c-b3f5-6a9fc50cc22a\") " pod="openshift-ingress/e2e-mt-97bb288c-openshift-default-c9dc66875-zsfzz"
Jul 13 19:31:08.079927 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:31:08.079598    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dc5c7417-8f65-402c-b3f5-6a9fc50cc22a-workload-socket\") pod \"e2e-mt-97bb288c-openshift-default-c9dc66875-zsfzz\" (UID: \"dc5c7417-8f65-402c-b3f5-6a9fc50cc22a\") " pod="openshift-ingress/e2e-mt-97bb288c-openshift-default-c9dc66875-zsfzz"
Jul 13 19:31:08.079927 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:31:08.079793    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dc5c7417-8f65-402c-b3f5-6a9fc50cc22a-workload-certs\") pod \"e2e-mt-97bb288c-openshift-default-c9dc66875-zsfzz\" (UID: \"dc5c7417-8f65-402c-b3f5-6a9fc50cc22a\") " pod="openshift-ingress/e2e-mt-97bb288c-openshift-default-c9dc66875-zsfzz"
Jul 13 19:31:08.080115 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:31:08.080082    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dc5c7417-8f65-402c-b3f5-6a9fc50cc22a-workload-socket\") pod \"e2e-mt-97bb288c-openshift-default-c9dc66875-zsfzz\" (UID: \"dc5c7417-8f65-402c-b3f5-6a9fc50cc22a\") " pod="openshift-ingress/e2e-mt-97bb288c-openshift-default-c9dc66875-zsfzz"
Jul 13 19:31:08.080181 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:31:08.080149    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dc5c7417-8f65-402c-b3f5-6a9fc50cc22a-istiod-ca-cert\") pod \"e2e-mt-97bb288c-openshift-default-c9dc66875-zsfzz\" (UID: \"dc5c7417-8f65-402c-b3f5-6a9fc50cc22a\") " pod="openshift-ingress/e2e-mt-97bb288c-openshift-default-c9dc66875-zsfzz"
Jul 13 19:31:08.080423 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:31:08.080401    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dc5c7417-8f65-402c-b3f5-6a9fc50cc22a-credential-socket\") pod \"e2e-mt-97bb288c-openshift-default-c9dc66875-zsfzz\" (UID: \"dc5c7417-8f65-402c-b3f5-6a9fc50cc22a\") " pod="openshift-ingress/e2e-mt-97bb288c-openshift-default-c9dc66875-zsfzz"
Jul 13 19:31:08.080489 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:31:08.080447    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dc5c7417-8f65-402c-b3f5-6a9fc50cc22a-istio-data\") pod \"e2e-mt-97bb288c-openshift-default-c9dc66875-zsfzz\" (UID: \"dc5c7417-8f65-402c-b3f5-6a9fc50cc22a\") " pod="openshift-ingress/e2e-mt-97bb288c-openshift-default-c9dc66875-zsfzz"
Jul 13 19:31:08.082013 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:31:08.081992    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dc5c7417-8f65-402c-b3f5-6a9fc50cc22a-istio-envoy\") pod \"e2e-mt-97bb288c-openshift-default-c9dc66875-zsfzz\" (UID: \"dc5c7417-8f65-402c-b3f5-6a9fc50cc22a\") " pod="openshift-ingress/e2e-mt-97bb288c-openshift-default-c9dc66875-zsfzz"
Jul 13 19:31:08.082293 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:31:08.082256    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dc5c7417-8f65-402c-b3f5-6a9fc50cc22a-istio-podinfo\") pod \"e2e-mt-97bb288c-openshift-default-c9dc66875-zsfzz\" (UID: \"dc5c7417-8f65-402c-b3f5-6a9fc50cc22a\") " pod="openshift-ingress/e2e-mt-97bb288c-openshift-default-c9dc66875-zsfzz"
Jul 13 19:31:08.092257 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:31:08.092172    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dc5c7417-8f65-402c-b3f5-6a9fc50cc22a-istio-token\") pod \"e2e-mt-97bb288c-openshift-default-c9dc66875-zsfzz\" (UID: \"dc5c7417-8f65-402c-b3f5-6a9fc50cc22a\") " pod="openshift-ingress/e2e-mt-97bb288c-openshift-default-c9dc66875-zsfzz"
Jul 13 19:31:08.093164 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:31:08.093131    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mxz4g\" (UniqueName: \"kubernetes.io/projected/dc5c7417-8f65-402c-b3f5-6a9fc50cc22a-kube-api-access-mxz4g\") pod \"e2e-mt-97bb288c-openshift-default-c9dc66875-zsfzz\" (UID: \"dc5c7417-8f65-402c-b3f5-6a9fc50cc22a\") " pod="openshift-ingress/e2e-mt-97bb288c-openshift-default-c9dc66875-zsfzz"
Jul 13 19:31:08.207833 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:31:08.207730    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-97bb288c-openshift-default-c9dc66875-zsfzz"
Jul 13 19:31:08.365344 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:31:08.365314    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-97bb288c-openshift-default-c9dc66875-zsfzz"]
Jul 13 19:31:08.367298 ip-10-0-135-38 kubenswrapper[2563]: W0713 19:31:08.367266    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddc5c7417_8f65_402c_b3f5_6a9fc50cc22a.slice/crio-533943bde3ddaa48169949d52599296188303195dc1dd58b2664018cd26f5427 WatchSource:0}: Error finding container 533943bde3ddaa48169949d52599296188303195dc1dd58b2664018cd26f5427: Status 404 returned error can't find the container with id 533943bde3ddaa48169949d52599296188303195dc1dd58b2664018cd26f5427
Jul 13 19:31:08.369680 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:31:08.369647    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 13 19:31:08.369773 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:31:08.369715    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 13 19:31:08.369773 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:31:08.369763    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 13 19:31:09.377462 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:31:09.377422    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-97bb288c-openshift-default-c9dc66875-zsfzz" event={"ID":"dc5c7417-8f65-402c-b3f5-6a9fc50cc22a","Type":"ContainerStarted","Data":"6a274fc39251bb5055a0a6b1fae0cc59527b95542aba52c1ec13bd29b772e461"}
Jul 13 19:31:09.378003 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:31:09.377495    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-97bb288c-openshift-default-c9dc66875-zsfzz" event={"ID":"dc5c7417-8f65-402c-b3f5-6a9fc50cc22a","Type":"ContainerStarted","Data":"533943bde3ddaa48169949d52599296188303195dc1dd58b2664018cd26f5427"}
Jul 13 19:31:09.411974 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:31:09.411901    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-97bb288c-openshift-default-c9dc66875-zsfzz" podStartSLOduration=2.41187576 podStartE2EDuration="2.41187576s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 19:31:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 19:31:09.408971909 +0000 UTC m=+1957.183848266" watchObservedRunningTime="2026-07-13 19:31:09.41187576 +0000 UTC m=+1957.186752117"
Jul 13 19:31:10.208360 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:31:10.208309    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-97bb288c-openshift-default-c9dc66875-zsfzz"
Jul 13 19:31:10.213637 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:31:10.213604    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-97bb288c-openshift-default-c9dc66875-zsfzz"
Jul 13 19:31:10.383197 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:31:10.383163    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-97bb288c-openshift-default-c9dc66875-zsfzz"
Jul 13 19:31:10.384226 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:31:10.384202    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-97bb288c-openshift-default-c9dc66875-zsfzz"
Jul 13 19:31:23.461411 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:31:23.461372    2563 generic.go:356] "Generic (PLEG): container finished" podID="dc5c7417-8f65-402c-b3f5-6a9fc50cc22a" containerID="6a274fc39251bb5055a0a6b1fae0cc59527b95542aba52c1ec13bd29b772e461" exitCode=0
Jul 13 19:31:23.461894 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:31:23.461446    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-97bb288c-openshift-default-c9dc66875-zsfzz" event={"ID":"dc5c7417-8f65-402c-b3f5-6a9fc50cc22a","Type":"ContainerDied","Data":"6a274fc39251bb5055a0a6b1fae0cc59527b95542aba52c1ec13bd29b772e461"}
Jul 13 19:31:23.461894 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:31:23.461879    2563 scope.go:117] "RemoveContainer" containerID="6a274fc39251bb5055a0a6b1fae0cc59527b95542aba52c1ec13bd29b772e461"
Jul 13 19:31:23.463005 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:31:23.462972    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 13 19:31:23.463135 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:31:23.463079    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 13 19:31:23.463201 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:31:23.463134    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 13 19:31:24.468833 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:31:24.468747    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-97bb288c-openshift-default-c9dc66875-zsfzz" event={"ID":"dc5c7417-8f65-402c-b3f5-6a9fc50cc22a","Type":"ContainerStarted","Data":"8b808f73d6af9dff633cdd95a6343942a93c64d3a8f89b4930c9a4f1b709a60e"}
Jul 13 19:31:25.209928 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:31:25.209878    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-97bb288c-openshift-default-c9dc66875-zsfzz"
Jul 13 19:31:25.210409 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:31:25.210113    2563 patch_prober.go:28] interesting pod/e2e-mt-97bb288c-openshift-default-c9dc66875-zsfzz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused" start-of-body=
Jul 13 19:31:25.210409 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:31:25.210163    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-97bb288c-openshift-default-c9dc66875-zsfzz" podUID="dc5c7417-8f65-402c-b3f5-6a9fc50cc22a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused"
Jul 13 19:31:25.383141 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:31:25.383098    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-97bb288c-openshift-default-c9dc66875-zsfzz"
Jul 13 19:31:26.208724 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:31:26.208668    2563 patch_prober.go:28] interesting pod/e2e-mt-97bb288c-openshift-default-c9dc66875-zsfzz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused" start-of-body=
Jul 13 19:31:26.209301 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:31:26.208769    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-97bb288c-openshift-default-c9dc66875-zsfzz" podUID="dc5c7417-8f65-402c-b3f5-6a9fc50cc22a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused"
Jul 13 19:31:27.208670 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:31:27.208627    2563 patch_prober.go:28] interesting pod/e2e-mt-97bb288c-openshift-default-c9dc66875-zsfzz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused" start-of-body=
Jul 13 19:31:27.209038 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:31:27.208984    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-97bb288c-openshift-default-c9dc66875-zsfzz" podUID="dc5c7417-8f65-402c-b3f5-6a9fc50cc22a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused"
Jul 13 19:31:28.209426 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:31:28.209382    2563 patch_prober.go:28] interesting pod/e2e-mt-97bb288c-openshift-default-c9dc66875-zsfzz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused" start-of-body=
Jul 13 19:31:28.210491 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:31:28.210452    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-97bb288c-openshift-default-c9dc66875-zsfzz" podUID="dc5c7417-8f65-402c-b3f5-6a9fc50cc22a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused"
Jul 13 19:31:29.213377 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:31:29.213338    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-97bb288c-openshift-default-c9dc66875-zsfzz"
Jul 13 19:31:29.214532 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:31:29.214511    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-97bb288c-openshift-default-c9dc66875-zsfzz"
Jul 13 19:31:32.923043 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:31:32.922988    2563 scope.go:117] "RemoveContainer" containerID="d8c3c6dbee88e0f2066104760b8936a148215d1c52f6a9ffc6ec9b51d9d438bc"
Jul 13 19:31:49.210640 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:31:49.210582    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-97bb288c-6xln8"]
Jul 13 19:31:49.213857 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:31:49.213829    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-97bb288c-6xln8"
Jul 13 19:31:49.216058 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:31:49.216007    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-llvfh\""
Jul 13 19:31:49.221790 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:31:49.221758    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-97bb288c-6xln8"]
Jul 13 19:31:49.272700 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:31:49.272652    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/cddc99f3-c8b6-406b-be16-0fcb0a26b9bf-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-97bb288c-6xln8\" (UID: \"cddc99f3-c8b6-406b-be16-0fcb0a26b9bf\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-97bb288c-6xln8"
Jul 13 19:31:49.374175 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:31:49.374133    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/cddc99f3-c8b6-406b-be16-0fcb0a26b9bf-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-97bb288c-6xln8\" (UID: \"cddc99f3-c8b6-406b-be16-0fcb0a26b9bf\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-97bb288c-6xln8"
Jul 13 19:31:49.374858 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:31:49.374829    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/cddc99f3-c8b6-406b-be16-0fcb0a26b9bf-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-97bb288c-6xln8\" (UID: \"cddc99f3-c8b6-406b-be16-0fcb0a26b9bf\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-97bb288c-6xln8"
Jul 13 19:31:49.526944 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:31:49.526847    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-97bb288c-6xln8"
Jul 13 19:31:49.685777 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:31:49.685749    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-97bb288c-6xln8"]
Jul 13 19:31:49.688216 ip-10-0-135-38 kubenswrapper[2563]: W0713 19:31:49.688179    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcddc99f3_c8b6_406b_be16_0fcb0a26b9bf.slice/crio-a407f957137b0f7b3610ae93b7e30e172ed47d436fb60161c8bb57cd48182161 WatchSource:0}: Error finding container a407f957137b0f7b3610ae93b7e30e172ed47d436fb60161c8bb57cd48182161: Status 404 returned error can't find the container with id a407f957137b0f7b3610ae93b7e30e172ed47d436fb60161c8bb57cd48182161
Jul 13 19:31:50.618009 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:31:50.617973    2563 generic.go:356] "Generic (PLEG): container finished" podID="cddc99f3-c8b6-406b-be16-0fcb0a26b9bf" containerID="bda9afb77f8c4fba63b41937957b89eb7ebad77e943892fa697c7a72e5195637" exitCode=0
Jul 13 19:31:50.618477 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:31:50.618059    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-97bb288c-6xln8" event={"ID":"cddc99f3-c8b6-406b-be16-0fcb0a26b9bf","Type":"ContainerDied","Data":"bda9afb77f8c4fba63b41937957b89eb7ebad77e943892fa697c7a72e5195637"}
Jul 13 19:31:50.618477 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:31:50.618129    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-97bb288c-6xln8" event={"ID":"cddc99f3-c8b6-406b-be16-0fcb0a26b9bf","Type":"ContainerStarted","Data":"a407f957137b0f7b3610ae93b7e30e172ed47d436fb60161c8bb57cd48182161"}
Jul 13 19:31:51.767506 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:31:51.767471    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-97bb288c-6xln8"
Jul 13 19:31:51.798577 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:31:51.798525    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/cddc99f3-c8b6-406b-be16-0fcb0a26b9bf-maas-api-service-ca\") pod \"cddc99f3-c8b6-406b-be16-0fcb0a26b9bf\" (UID: \"cddc99f3-c8b6-406b-be16-0fcb0a26b9bf\") "
Jul 13 19:31:51.798921 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:31:51.798897    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cddc99f3-c8b6-406b-be16-0fcb0a26b9bf-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "cddc99f3-c8b6-406b-be16-0fcb0a26b9bf" (UID: "cddc99f3-c8b6-406b-be16-0fcb0a26b9bf"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 19:31:51.900421 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:31:51.900310    2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/cddc99f3-c8b6-406b-be16-0fcb0a26b9bf-maas-api-service-ca\") on node \"ip-10-0-135-38.ec2.internal\" DevicePath \"\""
Jul 13 19:31:52.629241 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:31:52.629208    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-97bb288c-6xln8"
Jul 13 19:31:52.629445 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:31:52.629209    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-97bb288c-6xln8" event={"ID":"cddc99f3-c8b6-406b-be16-0fcb0a26b9bf","Type":"ContainerDied","Data":"a407f957137b0f7b3610ae93b7e30e172ed47d436fb60161c8bb57cd48182161"}
Jul 13 19:31:52.629445 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:31:52.629338    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a407f957137b0f7b3610ae93b7e30e172ed47d436fb60161c8bb57cd48182161"
Jul 13 19:32:32.949245 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:32:32.949208    2563 scope.go:117] "RemoveContainer" containerID="35c036b8a7b8cde64301a6d8c95c6c2ebcf4f6e543f5d11ff4668326e62b4faa"
Jul 13 19:32:56.534336 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:32:56.534235    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-97bb288c-openshift-default-c9dc66875-zsfzz"]
Jul 13 19:32:56.534933 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:32:56.534528    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-97bb288c-openshift-default-c9dc66875-zsfzz" podUID="dc5c7417-8f65-402c-b3f5-6a9fc50cc22a" containerName="istio-proxy" containerID="cri-o://8b808f73d6af9dff633cdd95a6343942a93c64d3a8f89b4930c9a4f1b709a60e" gracePeriod=30
Jul 13 19:32:59.216646 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:32:59.216600    2563 patch_prober.go:28] interesting pod/e2e-mt-97bb288c-openshift-default-c9dc66875-zsfzz container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 13 19:32:59.217098 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:32:59.216671    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-97bb288c-openshift-default-c9dc66875-zsfzz" podUID="dc5c7417-8f65-402c-b3f5-6a9fc50cc22a" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 13 19:33:01.809550 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:33:01.809474    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-97bb288c-openshift-default-c9dc66875-zsfzz"
Jul 13 19:33:01.944191 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:33:01.944149    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dc5c7417-8f65-402c-b3f5-6a9fc50cc22a-istio-token\") pod \"dc5c7417-8f65-402c-b3f5-6a9fc50cc22a\" (UID: \"dc5c7417-8f65-402c-b3f5-6a9fc50cc22a\") "
Jul 13 19:33:01.944191 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:33:01.944200    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dc5c7417-8f65-402c-b3f5-6a9fc50cc22a-istio-data\") pod \"dc5c7417-8f65-402c-b3f5-6a9fc50cc22a\" (UID: \"dc5c7417-8f65-402c-b3f5-6a9fc50cc22a\") "
Jul 13 19:33:01.944459 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:33:01.944220    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dc5c7417-8f65-402c-b3f5-6a9fc50cc22a-istiod-ca-cert\") pod \"dc5c7417-8f65-402c-b3f5-6a9fc50cc22a\" (UID: \"dc5c7417-8f65-402c-b3f5-6a9fc50cc22a\") "
Jul 13 19:33:01.944459 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:33:01.944250    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dc5c7417-8f65-402c-b3f5-6a9fc50cc22a-credential-socket\") pod \"dc5c7417-8f65-402c-b3f5-6a9fc50cc22a\" (UID: \"dc5c7417-8f65-402c-b3f5-6a9fc50cc22a\") "
Jul 13 19:33:01.944459 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:33:01.944389    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dc5c7417-8f65-402c-b3f5-6a9fc50cc22a-istio-podinfo\") pod \"dc5c7417-8f65-402c-b3f5-6a9fc50cc22a\" (UID: \"dc5c7417-8f65-402c-b3f5-6a9fc50cc22a\") "
Jul 13 19:33:01.944627 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:33:01.944460    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mxz4g\" (UniqueName: \"kubernetes.io/projected/dc5c7417-8f65-402c-b3f5-6a9fc50cc22a-kube-api-access-mxz4g\") pod \"dc5c7417-8f65-402c-b3f5-6a9fc50cc22a\" (UID: \"dc5c7417-8f65-402c-b3f5-6a9fc50cc22a\") "
Jul 13 19:33:01.944627 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:33:01.944482    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dc5c7417-8f65-402c-b3f5-6a9fc50cc22a-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "dc5c7417-8f65-402c-b3f5-6a9fc50cc22a" (UID: "dc5c7417-8f65-402c-b3f5-6a9fc50cc22a"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 19:33:01.944627 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:33:01.944527    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dc5c7417-8f65-402c-b3f5-6a9fc50cc22a-workload-certs\") pod \"dc5c7417-8f65-402c-b3f5-6a9fc50cc22a\" (UID: \"dc5c7417-8f65-402c-b3f5-6a9fc50cc22a\") "
Jul 13 19:33:01.944627 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:33:01.944588    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dc5c7417-8f65-402c-b3f5-6a9fc50cc22a-istio-envoy\") pod \"dc5c7417-8f65-402c-b3f5-6a9fc50cc22a\" (UID: \"dc5c7417-8f65-402c-b3f5-6a9fc50cc22a\") "
Jul 13 19:33:01.944627 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:33:01.944619    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dc5c7417-8f65-402c-b3f5-6a9fc50cc22a-workload-socket\") pod \"dc5c7417-8f65-402c-b3f5-6a9fc50cc22a\" (UID: \"dc5c7417-8f65-402c-b3f5-6a9fc50cc22a\") "
Jul 13 19:33:01.944897 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:33:01.944627    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dc5c7417-8f65-402c-b3f5-6a9fc50cc22a-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "dc5c7417-8f65-402c-b3f5-6a9fc50cc22a" (UID: "dc5c7417-8f65-402c-b3f5-6a9fc50cc22a"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 19:33:01.944897 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:33:01.944809    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dc5c7417-8f65-402c-b3f5-6a9fc50cc22a-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "dc5c7417-8f65-402c-b3f5-6a9fc50cc22a" (UID: "dc5c7417-8f65-402c-b3f5-6a9fc50cc22a"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 19:33:01.945010 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:33:01.944937    2563 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dc5c7417-8f65-402c-b3f5-6a9fc50cc22a-istiod-ca-cert\") on node \"ip-10-0-135-38.ec2.internal\" DevicePath \"\""
Jul 13 19:33:01.945010 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:33:01.944957    2563 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dc5c7417-8f65-402c-b3f5-6a9fc50cc22a-credential-socket\") on node \"ip-10-0-135-38.ec2.internal\" DevicePath \"\""
Jul 13 19:33:01.945010 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:33:01.944973    2563 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dc5c7417-8f65-402c-b3f5-6a9fc50cc22a-workload-certs\") on node \"ip-10-0-135-38.ec2.internal\" DevicePath \"\""
Jul 13 19:33:01.945010 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:33:01.944972    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dc5c7417-8f65-402c-b3f5-6a9fc50cc22a-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "dc5c7417-8f65-402c-b3f5-6a9fc50cc22a" (UID: "dc5c7417-8f65-402c-b3f5-6a9fc50cc22a"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 19:33:01.945010 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:33:01.944986    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dc5c7417-8f65-402c-b3f5-6a9fc50cc22a-istio-data" (OuterVolumeSpecName: "istio-data") pod "dc5c7417-8f65-402c-b3f5-6a9fc50cc22a" (UID: "dc5c7417-8f65-402c-b3f5-6a9fc50cc22a"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 19:33:01.946879 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:33:01.946846    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/dc5c7417-8f65-402c-b3f5-6a9fc50cc22a-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "dc5c7417-8f65-402c-b3f5-6a9fc50cc22a" (UID: "dc5c7417-8f65-402c-b3f5-6a9fc50cc22a"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 13 19:33:01.947055 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:33:01.946875    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dc5c7417-8f65-402c-b3f5-6a9fc50cc22a-istio-token" (OuterVolumeSpecName: "istio-token") pod "dc5c7417-8f65-402c-b3f5-6a9fc50cc22a" (UID: "dc5c7417-8f65-402c-b3f5-6a9fc50cc22a"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 19:33:01.947055 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:33:01.946990    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dc5c7417-8f65-402c-b3f5-6a9fc50cc22a-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "dc5c7417-8f65-402c-b3f5-6a9fc50cc22a" (UID: "dc5c7417-8f65-402c-b3f5-6a9fc50cc22a"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 19:33:01.947292 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:33:01.947272    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dc5c7417-8f65-402c-b3f5-6a9fc50cc22a-kube-api-access-mxz4g" (OuterVolumeSpecName: "kube-api-access-mxz4g") pod "dc5c7417-8f65-402c-b3f5-6a9fc50cc22a" (UID: "dc5c7417-8f65-402c-b3f5-6a9fc50cc22a"). InnerVolumeSpecName "kube-api-access-mxz4g". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 19:33:01.997727 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:33:01.997682    2563 generic.go:356] "Generic (PLEG): container finished" podID="dc5c7417-8f65-402c-b3f5-6a9fc50cc22a" containerID="8b808f73d6af9dff633cdd95a6343942a93c64d3a8f89b4930c9a4f1b709a60e" exitCode=0
Jul 13 19:33:01.997993 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:33:01.997741    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-97bb288c-openshift-default-c9dc66875-zsfzz"
Jul 13 19:33:01.998158 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:33:01.997756    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-97bb288c-openshift-default-c9dc66875-zsfzz" event={"ID":"dc5c7417-8f65-402c-b3f5-6a9fc50cc22a","Type":"ContainerDied","Data":"8b808f73d6af9dff633cdd95a6343942a93c64d3a8f89b4930c9a4f1b709a60e"}
Jul 13 19:33:01.998248 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:33:01.998154    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-97bb288c-openshift-default-c9dc66875-zsfzz" event={"ID":"dc5c7417-8f65-402c-b3f5-6a9fc50cc22a","Type":"ContainerDied","Data":"533943bde3ddaa48169949d52599296188303195dc1dd58b2664018cd26f5427"}
Jul 13 19:33:01.998248 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:33:01.998191    2563 scope.go:117] "RemoveContainer" containerID="8b808f73d6af9dff633cdd95a6343942a93c64d3a8f89b4930c9a4f1b709a60e"
Jul 13 19:33:02.011469 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:33:02.011362    2563 scope.go:117] "RemoveContainer" containerID="6a274fc39251bb5055a0a6b1fae0cc59527b95542aba52c1ec13bd29b772e461"
Jul 13 19:33:02.023568 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:33:02.023534    2563 scope.go:117] "RemoveContainer" containerID="8b808f73d6af9dff633cdd95a6343942a93c64d3a8f89b4930c9a4f1b709a60e"
Jul 13 19:33:02.024079 ip-10-0-135-38 kubenswrapper[2563]: E0713 19:33:02.024046    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8b808f73d6af9dff633cdd95a6343942a93c64d3a8f89b4930c9a4f1b709a60e\": container with ID starting with 8b808f73d6af9dff633cdd95a6343942a93c64d3a8f89b4930c9a4f1b709a60e not found: ID does not exist" containerID="8b808f73d6af9dff633cdd95a6343942a93c64d3a8f89b4930c9a4f1b709a60e"
Jul 13 19:33:02.024217 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:33:02.024090    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8b808f73d6af9dff633cdd95a6343942a93c64d3a8f89b4930c9a4f1b709a60e"} err="failed to get container status \"8b808f73d6af9dff633cdd95a6343942a93c64d3a8f89b4930c9a4f1b709a60e\": rpc error: code = NotFound desc = could not find container \"8b808f73d6af9dff633cdd95a6343942a93c64d3a8f89b4930c9a4f1b709a60e\": container with ID starting with 8b808f73d6af9dff633cdd95a6343942a93c64d3a8f89b4930c9a4f1b709a60e not found: ID does not exist"
Jul 13 19:33:02.024217 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:33:02.024120    2563 scope.go:117] "RemoveContainer" containerID="6a274fc39251bb5055a0a6b1fae0cc59527b95542aba52c1ec13bd29b772e461"
Jul 13 19:33:02.024560 ip-10-0-135-38 kubenswrapper[2563]: E0713 19:33:02.024532    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6a274fc39251bb5055a0a6b1fae0cc59527b95542aba52c1ec13bd29b772e461\": container with ID starting with 6a274fc39251bb5055a0a6b1fae0cc59527b95542aba52c1ec13bd29b772e461 not found: ID does not exist" containerID="6a274fc39251bb5055a0a6b1fae0cc59527b95542aba52c1ec13bd29b772e461"
Jul 13 19:33:02.024641 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:33:02.024572    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6a274fc39251bb5055a0a6b1fae0cc59527b95542aba52c1ec13bd29b772e461"} err="failed to get container status \"6a274fc39251bb5055a0a6b1fae0cc59527b95542aba52c1ec13bd29b772e461\": rpc error: code = NotFound desc = could not find container \"6a274fc39251bb5055a0a6b1fae0cc59527b95542aba52c1ec13bd29b772e461\": container with ID starting with 6a274fc39251bb5055a0a6b1fae0cc59527b95542aba52c1ec13bd29b772e461 not found: ID does not exist"
Jul 13 19:33:02.026042 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:33:02.025985    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-97bb288c-openshift-default-c9dc66875-zsfzz"]
Jul 13 19:33:02.029987 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:33:02.029954    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-97bb288c-openshift-default-c9dc66875-zsfzz"]
Jul 13 19:33:02.045710 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:33:02.045673    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mxz4g\" (UniqueName: \"kubernetes.io/projected/dc5c7417-8f65-402c-b3f5-6a9fc50cc22a-kube-api-access-mxz4g\") on node \"ip-10-0-135-38.ec2.internal\" DevicePath \"\""
Jul 13 19:33:02.045710 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:33:02.045706    2563 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dc5c7417-8f65-402c-b3f5-6a9fc50cc22a-istio-envoy\") on node \"ip-10-0-135-38.ec2.internal\" DevicePath \"\""
Jul 13 19:33:02.045710 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:33:02.045716    2563 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dc5c7417-8f65-402c-b3f5-6a9fc50cc22a-workload-socket\") on node \"ip-10-0-135-38.ec2.internal\" DevicePath \"\""
Jul 13 19:33:02.045973 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:33:02.045724    2563 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dc5c7417-8f65-402c-b3f5-6a9fc50cc22a-istio-token\") on node \"ip-10-0-135-38.ec2.internal\" DevicePath \"\""
Jul 13 19:33:02.045973 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:33:02.045734    2563 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dc5c7417-8f65-402c-b3f5-6a9fc50cc22a-istio-data\") on node \"ip-10-0-135-38.ec2.internal\" DevicePath \"\""
Jul 13 19:33:02.045973 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:33:02.045743    2563 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dc5c7417-8f65-402c-b3f5-6a9fc50cc22a-istio-podinfo\") on node \"ip-10-0-135-38.ec2.internal\" DevicePath \"\""
Jul 13 19:33:02.757694 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:33:02.757646    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dc5c7417-8f65-402c-b3f5-6a9fc50cc22a" path="/var/lib/kubelet/pods/dc5c7417-8f65-402c-b3f5-6a9fc50cc22a/volumes"
Jul 13 19:33:32.821191 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:33:32.821161    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hwqhc_7ae2e1d0-8a16-4821-9cb7-353862cfbec8/ovn-acl-logging/0.log"
Jul 13 19:33:32.826808 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:33:32.826784    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hwqhc_7ae2e1d0-8a16-4821-9cb7-353862cfbec8/ovn-acl-logging/0.log"
Jul 13 19:33:32.971803 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:33:32.971765    2563 scope.go:117] "RemoveContainer" containerID="5e1336d8cb758ac97558c2fd6ca28f79c613882718078fa5ef39df3a7ff5b063"
Jul 13 19:33:51.991582 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:33:51.991541    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-d0bb2f-openshift-default-7f784fcc4f-tbl6z"]
Jul 13 19:33:51.992058 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:33:51.991929    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dc5c7417-8f65-402c-b3f5-6a9fc50cc22a" containerName="istio-proxy"
Jul 13 19:33:51.992058 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:33:51.991940    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="dc5c7417-8f65-402c-b3f5-6a9fc50cc22a" containerName="istio-proxy"
Jul 13 19:33:51.992058 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:33:51.991950    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dc5c7417-8f65-402c-b3f5-6a9fc50cc22a" containerName="istio-proxy"
Jul 13 19:33:51.992058 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:33:51.991956    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="dc5c7417-8f65-402c-b3f5-6a9fc50cc22a" containerName="istio-proxy"
Jul 13 19:33:51.992058 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:33:51.991971    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cddc99f3-c8b6-406b-be16-0fcb0a26b9bf" containerName="revoke-keys"
Jul 13 19:33:51.992058 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:33:51.991976    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="cddc99f3-c8b6-406b-be16-0fcb0a26b9bf" containerName="revoke-keys"
Jul 13 19:33:51.992058 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:33:51.992052    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="dc5c7417-8f65-402c-b3f5-6a9fc50cc22a" containerName="istio-proxy"
Jul 13 19:33:51.992058 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:33:51.992062    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="dc5c7417-8f65-402c-b3f5-6a9fc50cc22a" containerName="istio-proxy"
Jul 13 19:33:51.992310 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:33:51.992068    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="cddc99f3-c8b6-406b-be16-0fcb0a26b9bf" containerName="revoke-keys"
Jul 13 19:33:51.995287 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:33:51.995266    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-d0bb2f-openshift-default-7f784fcc4f-tbl6z"
Jul 13 19:33:51.997689 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:33:51.997662    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-d0bb2f-openshift-default-dockercfg-6phg2\""
Jul 13 19:33:52.016043 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:33:52.012482    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-d0bb2f-openshift-default-7f784fcc4f-tbl6z"]
Jul 13 19:33:52.090297 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:33:52.090249    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c0ab7b32-c230-464e-9604-399a422f988d-istio-podinfo\") pod \"e2e-inf-a-d0bb2f-openshift-default-7f784fcc4f-tbl6z\" (UID: \"c0ab7b32-c230-464e-9604-399a422f988d\") " pod="openshift-ingress/e2e-inf-a-d0bb2f-openshift-default-7f784fcc4f-tbl6z"
Jul 13 19:33:52.090600 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:33:52.090324    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c0ab7b32-c230-464e-9604-399a422f988d-workload-socket\") pod \"e2e-inf-a-d0bb2f-openshift-default-7f784fcc4f-tbl6z\" (UID: \"c0ab7b32-c230-464e-9604-399a422f988d\") " pod="openshift-ingress/e2e-inf-a-d0bb2f-openshift-default-7f784fcc4f-tbl6z"
Jul 13 19:33:52.090600 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:33:52.090360    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c0ab7b32-c230-464e-9604-399a422f988d-credential-socket\") pod \"e2e-inf-a-d0bb2f-openshift-default-7f784fcc4f-tbl6z\" (UID: \"c0ab7b32-c230-464e-9604-399a422f988d\") " pod="openshift-ingress/e2e-inf-a-d0bb2f-openshift-default-7f784fcc4f-tbl6z"
Jul 13 19:33:52.090600 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:33:52.090472    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bkwq5\" (UniqueName: \"kubernetes.io/projected/c0ab7b32-c230-464e-9604-399a422f988d-kube-api-access-bkwq5\") pod \"e2e-inf-a-d0bb2f-openshift-default-7f784fcc4f-tbl6z\" (UID: \"c0ab7b32-c230-464e-9604-399a422f988d\") " pod="openshift-ingress/e2e-inf-a-d0bb2f-openshift-default-7f784fcc4f-tbl6z"
Jul 13 19:33:52.090600 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:33:52.090530    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c0ab7b32-c230-464e-9604-399a422f988d-istiod-ca-cert\") pod \"e2e-inf-a-d0bb2f-openshift-default-7f784fcc4f-tbl6z\" (UID: \"c0ab7b32-c230-464e-9604-399a422f988d\") " pod="openshift-ingress/e2e-inf-a-d0bb2f-openshift-default-7f784fcc4f-tbl6z"
Jul 13 19:33:52.090600 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:33:52.090560    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c0ab7b32-c230-464e-9604-399a422f988d-workload-certs\") pod \"e2e-inf-a-d0bb2f-openshift-default-7f784fcc4f-tbl6z\" (UID: \"c0ab7b32-c230-464e-9604-399a422f988d\") " pod="openshift-ingress/e2e-inf-a-d0bb2f-openshift-default-7f784fcc4f-tbl6z"
Jul 13 19:33:52.090887 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:33:52.090679    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c0ab7b32-c230-464e-9604-399a422f988d-istio-token\") pod \"e2e-inf-a-d0bb2f-openshift-default-7f784fcc4f-tbl6z\" (UID: \"c0ab7b32-c230-464e-9604-399a422f988d\") " pod="openshift-ingress/e2e-inf-a-d0bb2f-openshift-default-7f784fcc4f-tbl6z"
Jul 13 19:33:52.090887 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:33:52.090726    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c0ab7b32-c230-464e-9604-399a422f988d-istio-data\") pod \"e2e-inf-a-d0bb2f-openshift-default-7f784fcc4f-tbl6z\" (UID: \"c0ab7b32-c230-464e-9604-399a422f988d\") " pod="openshift-ingress/e2e-inf-a-d0bb2f-openshift-default-7f784fcc4f-tbl6z"
Jul 13 19:33:52.090887 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:33:52.090855    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c0ab7b32-c230-464e-9604-399a422f988d-istio-envoy\") pod \"e2e-inf-a-d0bb2f-openshift-default-7f784fcc4f-tbl6z\" (UID: \"c0ab7b32-c230-464e-9604-399a422f988d\") " pod="openshift-ingress/e2e-inf-a-d0bb2f-openshift-default-7f784fcc4f-tbl6z"
Jul 13 19:33:52.191980 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:33:52.191924    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c0ab7b32-c230-464e-9604-399a422f988d-workload-certs\") pod \"e2e-inf-a-d0bb2f-openshift-default-7f784fcc4f-tbl6z\" (UID: \"c0ab7b32-c230-464e-9604-399a422f988d\") " pod="openshift-ingress/e2e-inf-a-d0bb2f-openshift-default-7f784fcc4f-tbl6z"
Jul 13 19:33:52.192234 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:33:52.192041    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c0ab7b32-c230-464e-9604-399a422f988d-istio-token\") pod \"e2e-inf-a-d0bb2f-openshift-default-7f784fcc4f-tbl6z\" (UID: \"c0ab7b32-c230-464e-9604-399a422f988d\") " pod="openshift-ingress/e2e-inf-a-d0bb2f-openshift-default-7f784fcc4f-tbl6z"
Jul 13 19:33:52.192234 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:33:52.192084    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c0ab7b32-c230-464e-9604-399a422f988d-istio-data\") pod \"e2e-inf-a-d0bb2f-openshift-default-7f784fcc4f-tbl6z\" (UID: \"c0ab7b32-c230-464e-9604-399a422f988d\") " pod="openshift-ingress/e2e-inf-a-d0bb2f-openshift-default-7f784fcc4f-tbl6z"
Jul 13 19:33:52.192234 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:33:52.192142    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c0ab7b32-c230-464e-9604-399a422f988d-istio-envoy\") pod \"e2e-inf-a-d0bb2f-openshift-default-7f784fcc4f-tbl6z\" (UID: \"c0ab7b32-c230-464e-9604-399a422f988d\") " pod="openshift-ingress/e2e-inf-a-d0bb2f-openshift-default-7f784fcc4f-tbl6z"
Jul 13 19:33:52.192234 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:33:52.192172    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c0ab7b32-c230-464e-9604-399a422f988d-istio-podinfo\") pod \"e2e-inf-a-d0bb2f-openshift-default-7f784fcc4f-tbl6z\" (UID: \"c0ab7b32-c230-464e-9604-399a422f988d\") " pod="openshift-ingress/e2e-inf-a-d0bb2f-openshift-default-7f784fcc4f-tbl6z"
Jul 13 19:33:52.192234 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:33:52.192212    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c0ab7b32-c230-464e-9604-399a422f988d-workload-socket\") pod \"e2e-inf-a-d0bb2f-openshift-default-7f784fcc4f-tbl6z\" (UID: \"c0ab7b32-c230-464e-9604-399a422f988d\") " pod="openshift-ingress/e2e-inf-a-d0bb2f-openshift-default-7f784fcc4f-tbl6z"
Jul 13 19:33:52.192532 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:33:52.192241    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c0ab7b32-c230-464e-9604-399a422f988d-credential-socket\") pod \"e2e-inf-a-d0bb2f-openshift-default-7f784fcc4f-tbl6z\" (UID: \"c0ab7b32-c230-464e-9604-399a422f988d\") " pod="openshift-ingress/e2e-inf-a-d0bb2f-openshift-default-7f784fcc4f-tbl6z"
Jul 13 19:33:52.192532 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:33:52.192271    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bkwq5\" (UniqueName: \"kubernetes.io/projected/c0ab7b32-c230-464e-9604-399a422f988d-kube-api-access-bkwq5\") pod \"e2e-inf-a-d0bb2f-openshift-default-7f784fcc4f-tbl6z\" (UID: \"c0ab7b32-c230-464e-9604-399a422f988d\") " pod="openshift-ingress/e2e-inf-a-d0bb2f-openshift-default-7f784fcc4f-tbl6z"
Jul 13 19:33:52.192532 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:33:52.192311    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c0ab7b32-c230-464e-9604-399a422f988d-istiod-ca-cert\") pod \"e2e-inf-a-d0bb2f-openshift-default-7f784fcc4f-tbl6z\" (UID: \"c0ab7b32-c230-464e-9604-399a422f988d\") " pod="openshift-ingress/e2e-inf-a-d0bb2f-openshift-default-7f784fcc4f-tbl6z"
Jul 13 19:33:52.192532 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:33:52.192477    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c0ab7b32-c230-464e-9604-399a422f988d-workload-certs\") pod \"e2e-inf-a-d0bb2f-openshift-default-7f784fcc4f-tbl6z\" (UID: \"c0ab7b32-c230-464e-9604-399a422f988d\") " pod="openshift-ingress/e2e-inf-a-d0bb2f-openshift-default-7f784fcc4f-tbl6z"
Jul 13 19:33:52.192744 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:33:52.192684    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c0ab7b32-c230-464e-9604-399a422f988d-workload-socket\") pod \"e2e-inf-a-d0bb2f-openshift-default-7f784fcc4f-tbl6z\" (UID: \"c0ab7b32-c230-464e-9604-399a422f988d\") " pod="openshift-ingress/e2e-inf-a-d0bb2f-openshift-default-7f784fcc4f-tbl6z"
Jul 13 19:33:52.192799 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:33:52.192744    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c0ab7b32-c230-464e-9604-399a422f988d-credential-socket\") pod \"e2e-inf-a-d0bb2f-openshift-default-7f784fcc4f-tbl6z\" (UID: \"c0ab7b32-c230-464e-9604-399a422f988d\") " pod="openshift-ingress/e2e-inf-a-d0bb2f-openshift-default-7f784fcc4f-tbl6z"
Jul 13 19:33:52.193180 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:33:52.193148    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c0ab7b32-c230-464e-9604-399a422f988d-istiod-ca-cert\") pod \"e2e-inf-a-d0bb2f-openshift-default-7f784fcc4f-tbl6z\" (UID: \"c0ab7b32-c230-464e-9604-399a422f988d\") " pod="openshift-ingress/e2e-inf-a-d0bb2f-openshift-default-7f784fcc4f-tbl6z"
Jul 13 19:33:52.193336 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:33:52.193285    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c0ab7b32-c230-464e-9604-399a422f988d-istio-data\") pod \"e2e-inf-a-d0bb2f-openshift-default-7f784fcc4f-tbl6z\" (UID: \"c0ab7b32-c230-464e-9604-399a422f988d\") " pod="openshift-ingress/e2e-inf-a-d0bb2f-openshift-default-7f784fcc4f-tbl6z"
Jul 13 19:33:52.195650 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:33:52.195612    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c0ab7b32-c230-464e-9604-399a422f988d-istio-envoy\") pod \"e2e-inf-a-d0bb2f-openshift-default-7f784fcc4f-tbl6z\" (UID: \"c0ab7b32-c230-464e-9604-399a422f988d\") " pod="openshift-ingress/e2e-inf-a-d0bb2f-openshift-default-7f784fcc4f-tbl6z"
Jul 13 19:33:52.195792 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:33:52.195772    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c0ab7b32-c230-464e-9604-399a422f988d-istio-podinfo\") pod \"e2e-inf-a-d0bb2f-openshift-default-7f784fcc4f-tbl6z\" (UID: \"c0ab7b32-c230-464e-9604-399a422f988d\") " pod="openshift-ingress/e2e-inf-a-d0bb2f-openshift-default-7f784fcc4f-tbl6z"
Jul 13 19:33:52.201222 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:33:52.201192    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bkwq5\" (UniqueName: \"kubernetes.io/projected/c0ab7b32-c230-464e-9604-399a422f988d-kube-api-access-bkwq5\") pod \"e2e-inf-a-d0bb2f-openshift-default-7f784fcc4f-tbl6z\" (UID: \"c0ab7b32-c230-464e-9604-399a422f988d\") " pod="openshift-ingress/e2e-inf-a-d0bb2f-openshift-default-7f784fcc4f-tbl6z"
Jul 13 19:33:52.201372 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:33:52.201352    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c0ab7b32-c230-464e-9604-399a422f988d-istio-token\") pod \"e2e-inf-a-d0bb2f-openshift-default-7f784fcc4f-tbl6z\" (UID: \"c0ab7b32-c230-464e-9604-399a422f988d\") " pod="openshift-ingress/e2e-inf-a-d0bb2f-openshift-default-7f784fcc4f-tbl6z"
Jul 13 19:33:52.306582 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:33:52.306481    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-d0bb2f-openshift-default-7f784fcc4f-tbl6z"
Jul 13 19:33:52.479739 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:33:52.479710    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-d0bb2f-openshift-default-7f784fcc4f-tbl6z"]
Jul 13 19:33:52.481600 ip-10-0-135-38 kubenswrapper[2563]: W0713 19:33:52.481567    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc0ab7b32_c230_464e_9604_399a422f988d.slice/crio-96201a03c8682bf6f1f1dbe9fdb562797208666ecf4360beb0e4a8c3ca64d83a WatchSource:0}: Error finding container 96201a03c8682bf6f1f1dbe9fdb562797208666ecf4360beb0e4a8c3ca64d83a: Status 404 returned error can't find the container with id 96201a03c8682bf6f1f1dbe9fdb562797208666ecf4360beb0e4a8c3ca64d83a
Jul 13 19:33:52.483767 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:33:52.483729    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 13 19:33:52.483874 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:33:52.483803    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 13 19:33:52.483874 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:33:52.483829    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 13 19:33:53.271816 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:33:53.271779    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-d0bb2f-openshift-default-7f784fcc4f-tbl6z" event={"ID":"c0ab7b32-c230-464e-9604-399a422f988d","Type":"ContainerStarted","Data":"c926eab0def7f8deed55fa37770e2d2c6455b7be353d4d8be1803ad93fac5d43"}
Jul 13 19:33:53.272344 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:33:53.271849    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-d0bb2f-openshift-default-7f784fcc4f-tbl6z" event={"ID":"c0ab7b32-c230-464e-9604-399a422f988d","Type":"ContainerStarted","Data":"96201a03c8682bf6f1f1dbe9fdb562797208666ecf4360beb0e4a8c3ca64d83a"}
Jul 13 19:33:53.298734 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:33:53.298678    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-d0bb2f-openshift-default-7f784fcc4f-tbl6z" podStartSLOduration=2.298658022 podStartE2EDuration="2.298658022s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 19:33:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 19:33:53.296044464 +0000 UTC m=+2121.070920818" watchObservedRunningTime="2026-07-13 19:33:53.298658022 +0000 UTC m=+2121.073534446"
Jul 13 19:33:53.306702 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:33:53.306668    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-d0bb2f-openshift-default-7f784fcc4f-tbl6z"
Jul 13 19:33:53.311857 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:33:53.311829    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-d0bb2f-openshift-default-7f784fcc4f-tbl6z"
Jul 13 19:33:54.277718 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:33:54.277686    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-d0bb2f-openshift-default-7f784fcc4f-tbl6z"
Jul 13 19:33:54.278693 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:33:54.278675    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-d0bb2f-openshift-default-7f784fcc4f-tbl6z"
Jul 13 19:34:00.575675 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:34:00.575638    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-0a1747-openshift-default-689755fc55-xr52v"]
Jul 13 19:34:00.579285 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:34:00.579263    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-0a1747-openshift-default-689755fc55-xr52v"
Jul 13 19:34:00.582571 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:34:00.582540    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-0a1747-openshift-default-dockercfg-bsztl\""
Jul 13 19:34:00.622355 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:34:00.622312    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-0a1747-openshift-default-689755fc55-xr52v"]
Jul 13 19:34:00.669421 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:34:00.669384    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f8ad0415-198a-4ff9-bf8d-a91c6e7929eb-istio-data\") pod \"e2e-inf-b-0a1747-openshift-default-689755fc55-xr52v\" (UID: \"f8ad0415-198a-4ff9-bf8d-a91c6e7929eb\") " pod="openshift-ingress/e2e-inf-b-0a1747-openshift-default-689755fc55-xr52v"
Jul 13 19:34:00.669636 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:34:00.669435    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f8ad0415-198a-4ff9-bf8d-a91c6e7929eb-credential-socket\") pod \"e2e-inf-b-0a1747-openshift-default-689755fc55-xr52v\" (UID: \"f8ad0415-198a-4ff9-bf8d-a91c6e7929eb\") " pod="openshift-ingress/e2e-inf-b-0a1747-openshift-default-689755fc55-xr52v"
Jul 13 19:34:00.669636 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:34:00.669456    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f8ad0415-198a-4ff9-bf8d-a91c6e7929eb-workload-certs\") pod \"e2e-inf-b-0a1747-openshift-default-689755fc55-xr52v\" (UID: \"f8ad0415-198a-4ff9-bf8d-a91c6e7929eb\") " pod="openshift-ingress/e2e-inf-b-0a1747-openshift-default-689755fc55-xr52v"
Jul 13 19:34:00.669636 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:34:00.669473    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f8ad0415-198a-4ff9-bf8d-a91c6e7929eb-istio-podinfo\") pod \"e2e-inf-b-0a1747-openshift-default-689755fc55-xr52v\" (UID: \"f8ad0415-198a-4ff9-bf8d-a91c6e7929eb\") " pod="openshift-ingress/e2e-inf-b-0a1747-openshift-default-689755fc55-xr52v"
Jul 13 19:34:00.669636 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:34:00.669570    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f8ad0415-198a-4ff9-bf8d-a91c6e7929eb-istiod-ca-cert\") pod \"e2e-inf-b-0a1747-openshift-default-689755fc55-xr52v\" (UID: \"f8ad0415-198a-4ff9-bf8d-a91c6e7929eb\") " pod="openshift-ingress/e2e-inf-b-0a1747-openshift-default-689755fc55-xr52v"
Jul 13 19:34:00.669636 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:34:00.669631    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f8ad0415-198a-4ff9-bf8d-a91c6e7929eb-istio-envoy\") pod \"e2e-inf-b-0a1747-openshift-default-689755fc55-xr52v\" (UID: \"f8ad0415-198a-4ff9-bf8d-a91c6e7929eb\") " pod="openshift-ingress/e2e-inf-b-0a1747-openshift-default-689755fc55-xr52v"
Jul 13 19:34:00.669883 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:34:00.669658    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f8ad0415-198a-4ff9-bf8d-a91c6e7929eb-istio-token\") pod \"e2e-inf-b-0a1747-openshift-default-689755fc55-xr52v\" (UID: \"f8ad0415-198a-4ff9-bf8d-a91c6e7929eb\") " pod="openshift-ingress/e2e-inf-b-0a1747-openshift-default-689755fc55-xr52v"
Jul 13 19:34:00.669883 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:34:00.669683    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f8ad0415-198a-4ff9-bf8d-a91c6e7929eb-workload-socket\") pod \"e2e-inf-b-0a1747-openshift-default-689755fc55-xr52v\" (UID: \"f8ad0415-198a-4ff9-bf8d-a91c6e7929eb\") " pod="openshift-ingress/e2e-inf-b-0a1747-openshift-default-689755fc55-xr52v"
Jul 13 19:34:00.669883 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:34:00.669710    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4jk8f\" (UniqueName: \"kubernetes.io/projected/f8ad0415-198a-4ff9-bf8d-a91c6e7929eb-kube-api-access-4jk8f\") pod \"e2e-inf-b-0a1747-openshift-default-689755fc55-xr52v\" (UID: \"f8ad0415-198a-4ff9-bf8d-a91c6e7929eb\") " pod="openshift-ingress/e2e-inf-b-0a1747-openshift-default-689755fc55-xr52v"
Jul 13 19:34:00.771429 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:34:00.771373    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f8ad0415-198a-4ff9-bf8d-a91c6e7929eb-istio-data\") pod \"e2e-inf-b-0a1747-openshift-default-689755fc55-xr52v\" (UID: \"f8ad0415-198a-4ff9-bf8d-a91c6e7929eb\") " pod="openshift-ingress/e2e-inf-b-0a1747-openshift-default-689755fc55-xr52v"
Jul 13 19:34:00.771607 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:34:00.771446    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f8ad0415-198a-4ff9-bf8d-a91c6e7929eb-credential-socket\") pod \"e2e-inf-b-0a1747-openshift-default-689755fc55-xr52v\" (UID: \"f8ad0415-198a-4ff9-bf8d-a91c6e7929eb\") " pod="openshift-ingress/e2e-inf-b-0a1747-openshift-default-689755fc55-xr52v"
Jul 13 19:34:00.771607 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:34:00.771473    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f8ad0415-198a-4ff9-bf8d-a91c6e7929eb-workload-certs\") pod \"e2e-inf-b-0a1747-openshift-default-689755fc55-xr52v\" (UID: \"f8ad0415-198a-4ff9-bf8d-a91c6e7929eb\") " pod="openshift-ingress/e2e-inf-b-0a1747-openshift-default-689755fc55-xr52v"
Jul 13 19:34:00.771607 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:34:00.771498    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f8ad0415-198a-4ff9-bf8d-a91c6e7929eb-istio-podinfo\") pod \"e2e-inf-b-0a1747-openshift-default-689755fc55-xr52v\" (UID: \"f8ad0415-198a-4ff9-bf8d-a91c6e7929eb\") " pod="openshift-ingress/e2e-inf-b-0a1747-openshift-default-689755fc55-xr52v"
Jul 13 19:34:00.771607 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:34:00.771538    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f8ad0415-198a-4ff9-bf8d-a91c6e7929eb-istiod-ca-cert\") pod \"e2e-inf-b-0a1747-openshift-default-689755fc55-xr52v\" (UID: \"f8ad0415-198a-4ff9-bf8d-a91c6e7929eb\") " pod="openshift-ingress/e2e-inf-b-0a1747-openshift-default-689755fc55-xr52v"
Jul 13 19:34:00.771607 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:34:00.771584    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f8ad0415-198a-4ff9-bf8d-a91c6e7929eb-istio-envoy\") pod \"e2e-inf-b-0a1747-openshift-default-689755fc55-xr52v\" (UID: \"f8ad0415-198a-4ff9-bf8d-a91c6e7929eb\") " pod="openshift-ingress/e2e-inf-b-0a1747-openshift-default-689755fc55-xr52v"
Jul 13 19:34:00.771897 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:34:00.771608    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f8ad0415-198a-4ff9-bf8d-a91c6e7929eb-istio-token\") pod \"e2e-inf-b-0a1747-openshift-default-689755fc55-xr52v\" (UID: \"f8ad0415-198a-4ff9-bf8d-a91c6e7929eb\") " pod="openshift-ingress/e2e-inf-b-0a1747-openshift-default-689755fc55-xr52v"
Jul 13 19:34:00.771897 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:34:00.771636    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f8ad0415-198a-4ff9-bf8d-a91c6e7929eb-workload-socket\") pod \"e2e-inf-b-0a1747-openshift-default-689755fc55-xr52v\" (UID: \"f8ad0415-198a-4ff9-bf8d-a91c6e7929eb\") " pod="openshift-ingress/e2e-inf-b-0a1747-openshift-default-689755fc55-xr52v"
Jul 13 19:34:00.771897 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:34:00.771660    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4jk8f\" (UniqueName: \"kubernetes.io/projected/f8ad0415-198a-4ff9-bf8d-a91c6e7929eb-kube-api-access-4jk8f\") pod \"e2e-inf-b-0a1747-openshift-default-689755fc55-xr52v\" (UID: \"f8ad0415-198a-4ff9-bf8d-a91c6e7929eb\") " pod="openshift-ingress/e2e-inf-b-0a1747-openshift-default-689755fc55-xr52v"
Jul 13 19:34:00.772094 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:34:00.771918    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f8ad0415-198a-4ff9-bf8d-a91c6e7929eb-istio-data\") pod \"e2e-inf-b-0a1747-openshift-default-689755fc55-xr52v\" (UID: \"f8ad0415-198a-4ff9-bf8d-a91c6e7929eb\") " pod="openshift-ingress/e2e-inf-b-0a1747-openshift-default-689755fc55-xr52v"
Jul 13 19:34:00.772094 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:34:00.771968    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f8ad0415-198a-4ff9-bf8d-a91c6e7929eb-workload-certs\") pod \"e2e-inf-b-0a1747-openshift-default-689755fc55-xr52v\" (UID: \"f8ad0415-198a-4ff9-bf8d-a91c6e7929eb\") " pod="openshift-ingress/e2e-inf-b-0a1747-openshift-default-689755fc55-xr52v"
Jul 13 19:34:00.772094 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:34:00.771990    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f8ad0415-198a-4ff9-bf8d-a91c6e7929eb-credential-socket\") pod \"e2e-inf-b-0a1747-openshift-default-689755fc55-xr52v\" (UID: \"f8ad0415-198a-4ff9-bf8d-a91c6e7929eb\") " pod="openshift-ingress/e2e-inf-b-0a1747-openshift-default-689755fc55-xr52v"
Jul 13 19:34:00.772293 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:34:00.772264    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f8ad0415-198a-4ff9-bf8d-a91c6e7929eb-workload-socket\") pod \"e2e-inf-b-0a1747-openshift-default-689755fc55-xr52v\" (UID: \"f8ad0415-198a-4ff9-bf8d-a91c6e7929eb\") " pod="openshift-ingress/e2e-inf-b-0a1747-openshift-default-689755fc55-xr52v"
Jul 13 19:34:00.772698 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:34:00.772672    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f8ad0415-198a-4ff9-bf8d-a91c6e7929eb-istiod-ca-cert\") pod \"e2e-inf-b-0a1747-openshift-default-689755fc55-xr52v\" (UID: \"f8ad0415-198a-4ff9-bf8d-a91c6e7929eb\") " pod="openshift-ingress/e2e-inf-b-0a1747-openshift-default-689755fc55-xr52v"
Jul 13 19:34:00.774145 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:34:00.774114    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f8ad0415-198a-4ff9-bf8d-a91c6e7929eb-istio-envoy\") pod \"e2e-inf-b-0a1747-openshift-default-689755fc55-xr52v\" (UID: \"f8ad0415-198a-4ff9-bf8d-a91c6e7929eb\") " pod="openshift-ingress/e2e-inf-b-0a1747-openshift-default-689755fc55-xr52v"
Jul 13 19:34:00.774327 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:34:00.774310    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f8ad0415-198a-4ff9-bf8d-a91c6e7929eb-istio-podinfo\") pod \"e2e-inf-b-0a1747-openshift-default-689755fc55-xr52v\" (UID: \"f8ad0415-198a-4ff9-bf8d-a91c6e7929eb\") " pod="openshift-ingress/e2e-inf-b-0a1747-openshift-default-689755fc55-xr52v"
Jul 13 19:34:00.782559 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:34:00.782528    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f8ad0415-198a-4ff9-bf8d-a91c6e7929eb-istio-token\") pod \"e2e-inf-b-0a1747-openshift-default-689755fc55-xr52v\" (UID: \"f8ad0415-198a-4ff9-bf8d-a91c6e7929eb\") " pod="openshift-ingress/e2e-inf-b-0a1747-openshift-default-689755fc55-xr52v"
Jul 13 19:34:00.782703 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:34:00.782684    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4jk8f\" (UniqueName: \"kubernetes.io/projected/f8ad0415-198a-4ff9-bf8d-a91c6e7929eb-kube-api-access-4jk8f\") pod \"e2e-inf-b-0a1747-openshift-default-689755fc55-xr52v\" (UID: \"f8ad0415-198a-4ff9-bf8d-a91c6e7929eb\") " pod="openshift-ingress/e2e-inf-b-0a1747-openshift-default-689755fc55-xr52v"
Jul 13 19:34:00.891918 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:34:00.891612    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-0a1747-openshift-default-689755fc55-xr52v"
Jul 13 19:34:01.081905 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:34:01.081872    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-0a1747-openshift-default-689755fc55-xr52v"]
Jul 13 19:34:01.083890 ip-10-0-135-38 kubenswrapper[2563]: W0713 19:34:01.083861    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf8ad0415_198a_4ff9_bf8d_a91c6e7929eb.slice/crio-0ac9488ea4c47066141b125dbfbca88a3dedccbcbb522d81d45b16fa2424ca36 WatchSource:0}: Error finding container 0ac9488ea4c47066141b125dbfbca88a3dedccbcbb522d81d45b16fa2424ca36: Status 404 returned error can't find the container with id 0ac9488ea4c47066141b125dbfbca88a3dedccbcbb522d81d45b16fa2424ca36
Jul 13 19:34:01.099054 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:34:01.086759    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 13 19:34:01.099054 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:34:01.086869    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 13 19:34:01.099054 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:34:01.086914    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 13 19:34:01.320407 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:34:01.320357    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-0a1747-openshift-default-689755fc55-xr52v" event={"ID":"f8ad0415-198a-4ff9-bf8d-a91c6e7929eb","Type":"ContainerStarted","Data":"c2a270a7bcf66aae8b39c5eb306cad97362ae406e958497afc69632d8714627f"}
Jul 13 19:34:01.320640 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:34:01.320437    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-0a1747-openshift-default-689755fc55-xr52v" event={"ID":"f8ad0415-198a-4ff9-bf8d-a91c6e7929eb","Type":"ContainerStarted","Data":"0ac9488ea4c47066141b125dbfbca88a3dedccbcbb522d81d45b16fa2424ca36"}
Jul 13 19:34:01.344902 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:34:01.344832    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-0a1747-openshift-default-689755fc55-xr52v" podStartSLOduration=1.344806191 podStartE2EDuration="1.344806191s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 19:34:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 19:34:01.34339565 +0000 UTC m=+2129.118272006" watchObservedRunningTime="2026-07-13 19:34:01.344806191 +0000 UTC m=+2129.119682549"
Jul 13 19:34:01.892614 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:34:01.892567    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-0a1747-openshift-default-689755fc55-xr52v"
Jul 13 19:34:02.909656 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:34:02.909372    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-0a1747-openshift-default-689755fc55-xr52v"
Jul 13 19:34:03.330587 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:34:03.330484    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-0a1747-openshift-default-689755fc55-xr52v"
Jul 13 19:34:03.331796 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:34:03.331773    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-0a1747-openshift-default-689755fc55-xr52v"
Jul 13 19:34:08.361404 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:34:08.361371    2563 generic.go:356] "Generic (PLEG): container finished" podID="c0ab7b32-c230-464e-9604-399a422f988d" containerID="c926eab0def7f8deed55fa37770e2d2c6455b7be353d4d8be1803ad93fac5d43" exitCode=0
Jul 13 19:34:08.361844 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:34:08.361445    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-d0bb2f-openshift-default-7f784fcc4f-tbl6z" event={"ID":"c0ab7b32-c230-464e-9604-399a422f988d","Type":"ContainerDied","Data":"c926eab0def7f8deed55fa37770e2d2c6455b7be353d4d8be1803ad93fac5d43"}
Jul 13 19:34:08.361934 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:34:08.361913    2563 scope.go:117] "RemoveContainer" containerID="c926eab0def7f8deed55fa37770e2d2c6455b7be353d4d8be1803ad93fac5d43"
Jul 13 19:34:08.363070 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:34:08.363041    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 13 19:34:08.363192 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:34:08.363108    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 13 19:34:08.363192 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:34:08.363139    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 13 19:34:09.278450 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:34:09.278404    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-d0bb2f-openshift-default-7f784fcc4f-tbl6z"
Jul 13 19:34:09.370810 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:34:09.370763    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-d0bb2f-openshift-default-7f784fcc4f-tbl6z" event={"ID":"c0ab7b32-c230-464e-9604-399a422f988d","Type":"ContainerStarted","Data":"d3f76a43af6aec36bcb6c30db30b9d64c839e07f8a716ef44c5b84c7b66849bb"}
Jul 13 19:34:10.307723 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:34:10.307676    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-d0bb2f-openshift-default-7f784fcc4f-tbl6z"
Jul 13 19:34:10.309044 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:34:10.308985    2563 patch_prober.go:28] interesting pod/e2e-inf-a-d0bb2f-openshift-default-7f784fcc4f-tbl6z container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused" start-of-body=
Jul 13 19:34:10.309224 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:34:10.309077    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-d0bb2f-openshift-default-7f784fcc4f-tbl6z" podUID="c0ab7b32-c230-464e-9604-399a422f988d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused"
Jul 13 19:34:11.307672 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:34:11.307124    2563 patch_prober.go:28] interesting pod/e2e-inf-a-d0bb2f-openshift-default-7f784fcc4f-tbl6z container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused" start-of-body=
Jul 13 19:34:11.307672 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:34:11.307206    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-d0bb2f-openshift-default-7f784fcc4f-tbl6z" podUID="c0ab7b32-c230-464e-9604-399a422f988d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused"
Jul 13 19:34:12.306960 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:34:12.306904    2563 patch_prober.go:28] interesting pod/e2e-inf-a-d0bb2f-openshift-default-7f784fcc4f-tbl6z container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused" start-of-body=
Jul 13 19:34:12.307235 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:34:12.306987    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-d0bb2f-openshift-default-7f784fcc4f-tbl6z" podUID="c0ab7b32-c230-464e-9604-399a422f988d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused"
Jul 13 19:34:13.307326 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:34:13.307281    2563 patch_prober.go:28] interesting pod/e2e-inf-a-d0bb2f-openshift-default-7f784fcc4f-tbl6z container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused" start-of-body=
Jul 13 19:34:13.307841 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:34:13.307357    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-d0bb2f-openshift-default-7f784fcc4f-tbl6z" podUID="c0ab7b32-c230-464e-9604-399a422f988d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused"
Jul 13 19:34:14.311356 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:34:14.311320    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-d0bb2f-openshift-default-7f784fcc4f-tbl6z"
Jul 13 19:34:14.311866 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:34:14.311739    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-d0bb2f-openshift-default-7f784fcc4f-tbl6z"
Jul 13 19:34:14.312559 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:34:14.312540    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-d0bb2f-openshift-default-7f784fcc4f-tbl6z"
Jul 13 19:34:17.421041 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:34:17.420979    2563 generic.go:356] "Generic (PLEG): container finished" podID="f8ad0415-198a-4ff9-bf8d-a91c6e7929eb" containerID="c2a270a7bcf66aae8b39c5eb306cad97362ae406e958497afc69632d8714627f" exitCode=0
Jul 13 19:34:17.421489 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:34:17.421061    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-0a1747-openshift-default-689755fc55-xr52v" event={"ID":"f8ad0415-198a-4ff9-bf8d-a91c6e7929eb","Type":"ContainerDied","Data":"c2a270a7bcf66aae8b39c5eb306cad97362ae406e958497afc69632d8714627f"}
Jul 13 19:34:17.421545 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:34:17.421511    2563 scope.go:117] "RemoveContainer" containerID="c2a270a7bcf66aae8b39c5eb306cad97362ae406e958497afc69632d8714627f"
Jul 13 19:34:17.422681 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:34:17.422648    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 13 19:34:17.422743 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:34:17.422728    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 13 19:34:17.422780 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:34:17.422762    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 13 19:34:18.331182 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:34:18.331130    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-0a1747-openshift-default-689755fc55-xr52v"
Jul 13 19:34:18.429005 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:34:18.428961    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-0a1747-openshift-default-689755fc55-xr52v" event={"ID":"f8ad0415-198a-4ff9-bf8d-a91c6e7929eb","Type":"ContainerStarted","Data":"7b4739da9d0861b9900b4aa57ea6c7a3f43c7b53b52df0fd60f92362681b221c"}
Jul 13 19:34:18.893298 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:34:18.893253    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-0a1747-openshift-default-689755fc55-xr52v"
Jul 13 19:34:18.894930 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:34:18.894582    2563 patch_prober.go:28] interesting pod/e2e-inf-b-0a1747-openshift-default-689755fc55-xr52v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused" start-of-body=
Jul 13 19:34:18.894930 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:34:18.894639    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-0a1747-openshift-default-689755fc55-xr52v" podUID="f8ad0415-198a-4ff9-bf8d-a91c6e7929eb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused"
Jul 13 19:34:19.894043 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:34:19.893437    2563 patch_prober.go:28] interesting pod/e2e-inf-b-0a1747-openshift-default-689755fc55-xr52v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused" start-of-body=
Jul 13 19:34:19.894043 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:34:19.893515    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-0a1747-openshift-default-689755fc55-xr52v" podUID="f8ad0415-198a-4ff9-bf8d-a91c6e7929eb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused"
Jul 13 19:34:20.893163 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:34:20.893114    2563 patch_prober.go:28] interesting pod/e2e-inf-b-0a1747-openshift-default-689755fc55-xr52v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused" start-of-body=
Jul 13 19:34:20.893365 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:34:20.893188    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-0a1747-openshift-default-689755fc55-xr52v" podUID="f8ad0415-198a-4ff9-bf8d-a91c6e7929eb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused"
Jul 13 19:34:21.893371 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:34:21.893325    2563 patch_prober.go:28] interesting pod/e2e-inf-b-0a1747-openshift-default-689755fc55-xr52v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused" start-of-body=
Jul 13 19:34:21.894052 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:34:21.893989    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-0a1747-openshift-default-689755fc55-xr52v" podUID="f8ad0415-198a-4ff9-bf8d-a91c6e7929eb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused"
Jul 13 19:34:22.896747 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:34:22.896711    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-0a1747-openshift-default-689755fc55-xr52v"
Jul 13 19:34:22.897200 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:34:22.897056    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-0a1747-openshift-default-689755fc55-xr52v"
Jul 13 19:34:22.897931 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:34:22.897909    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-0a1747-openshift-default-689755fc55-xr52v"
Jul 13 19:34:57.461054 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:34:57.460994    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-d0bb2f-sch89"]
Jul 13 19:34:57.463701 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:34:57.463682    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-d0bb2f-sch89"
Jul 13 19:34:57.466274 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:34:57.466228    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-llvfh\""
Jul 13 19:34:57.472177 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:34:57.472083    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-d0bb2f-sch89"]
Jul 13 19:34:57.555807 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:34:57.555758    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4c9300c7-7e99-4dca-98ad-37443399f9e4-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-d0bb2f-sch89\" (UID: \"4c9300c7-7e99-4dca-98ad-37443399f9e4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-d0bb2f-sch89"
Jul 13 19:34:57.656802 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:34:57.656759    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4c9300c7-7e99-4dca-98ad-37443399f9e4-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-d0bb2f-sch89\" (UID: \"4c9300c7-7e99-4dca-98ad-37443399f9e4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-d0bb2f-sch89"
Jul 13 19:34:57.657466 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:34:57.657443    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4c9300c7-7e99-4dca-98ad-37443399f9e4-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-d0bb2f-sch89\" (UID: \"4c9300c7-7e99-4dca-98ad-37443399f9e4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-d0bb2f-sch89"
Jul 13 19:34:57.777850 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:34:57.777730    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-d0bb2f-sch89"
Jul 13 19:34:57.931976 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:34:57.931941    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-d0bb2f-sch89"]
Jul 13 19:34:57.933923 ip-10-0-135-38 kubenswrapper[2563]: W0713 19:34:57.933893    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4c9300c7_7e99_4dca_98ad_37443399f9e4.slice/crio-9019b0f38aec5412af90666044ff4177c4fe98aa4b5490afa06ec3b649a4d547 WatchSource:0}: Error finding container 9019b0f38aec5412af90666044ff4177c4fe98aa4b5490afa06ec3b649a4d547: Status 404 returned error can't find the container with id 9019b0f38aec5412af90666044ff4177c4fe98aa4b5490afa06ec3b649a4d547
Jul 13 19:34:58.645697 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:34:58.645651    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-d0bb2f-sch89" event={"ID":"4c9300c7-7e99-4dca-98ad-37443399f9e4","Type":"ContainerStarted","Data":"53927a0c860d6bb5663e6163b958fa566f895ff21a7f0412b31a607278af96d4"}
Jul 13 19:34:58.646317 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:34:58.645748    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-d0bb2f-sch89" event={"ID":"4c9300c7-7e99-4dca-98ad-37443399f9e4","Type":"ContainerStarted","Data":"9019b0f38aec5412af90666044ff4177c4fe98aa4b5490afa06ec3b649a4d547"}
Jul 13 19:34:58.669255 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:34:58.669201    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-d0bb2f-sch89" podStartSLOduration=1.669185166 podStartE2EDuration="1.669185166s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 19:34:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 19:34:58.667675399 +0000 UTC m=+2186.442551753" watchObservedRunningTime="2026-07-13 19:34:58.669185166 +0000 UTC m=+2186.444061520"
Jul 13 19:34:59.652591 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:34:59.652530    2563 generic.go:356] "Generic (PLEG): container finished" podID="4c9300c7-7e99-4dca-98ad-37443399f9e4" containerID="53927a0c860d6bb5663e6163b958fa566f895ff21a7f0412b31a607278af96d4" exitCode=0
Jul 13 19:34:59.653002 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:34:59.652617    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-d0bb2f-sch89" event={"ID":"4c9300c7-7e99-4dca-98ad-37443399f9e4","Type":"ContainerDied","Data":"53927a0c860d6bb5663e6163b958fa566f895ff21a7f0412b31a607278af96d4"}
Jul 13 19:35:00.795577 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:35:00.795549    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-d0bb2f-sch89"
Jul 13 19:35:00.890188 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:35:00.890152    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4c9300c7-7e99-4dca-98ad-37443399f9e4-maas-api-service-ca\") pod \"4c9300c7-7e99-4dca-98ad-37443399f9e4\" (UID: \"4c9300c7-7e99-4dca-98ad-37443399f9e4\") "
Jul 13 19:35:00.890602 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:35:00.890580    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4c9300c7-7e99-4dca-98ad-37443399f9e4-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "4c9300c7-7e99-4dca-98ad-37443399f9e4" (UID: "4c9300c7-7e99-4dca-98ad-37443399f9e4"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 19:35:00.991172 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:35:00.991067    2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4c9300c7-7e99-4dca-98ad-37443399f9e4-maas-api-service-ca\") on node \"ip-10-0-135-38.ec2.internal\" DevicePath \"\""
Jul 13 19:35:01.665588 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:35:01.665546    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-d0bb2f-sch89" event={"ID":"4c9300c7-7e99-4dca-98ad-37443399f9e4","Type":"ContainerDied","Data":"9019b0f38aec5412af90666044ff4177c4fe98aa4b5490afa06ec3b649a4d547"}
Jul 13 19:35:01.665753 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:35:01.665565    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-d0bb2f-sch89"
Jul 13 19:35:01.665753 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:35:01.665595    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9019b0f38aec5412af90666044ff4177c4fe98aa4b5490afa06ec3b649a4d547"
Jul 13 19:35:23.296567 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:35:23.296529    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-d0bb2f-openshift-default-7f784fcc4f-tbl6z"]
Jul 13 19:35:23.297543 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:35:23.296770    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-d0bb2f-openshift-default-7f784fcc4f-tbl6z" podUID="c0ab7b32-c230-464e-9604-399a422f988d" containerName="istio-proxy" containerID="cri-o://d3f76a43af6aec36bcb6c30db30b9d64c839e07f8a716ef44c5b84c7b66849bb" gracePeriod=30
Jul 13 19:35:28.565714 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:35:28.565636    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-d0bb2f-openshift-default-7f784fcc4f-tbl6z"
Jul 13 19:35:28.663467 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:35:28.663427    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c0ab7b32-c230-464e-9604-399a422f988d-credential-socket\") pod \"c0ab7b32-c230-464e-9604-399a422f988d\" (UID: \"c0ab7b32-c230-464e-9604-399a422f988d\") "
Jul 13 19:35:28.663689 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:35:28.663505    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c0ab7b32-c230-464e-9604-399a422f988d-istio-token\") pod \"c0ab7b32-c230-464e-9604-399a422f988d\" (UID: \"c0ab7b32-c230-464e-9604-399a422f988d\") "
Jul 13 19:35:28.663689 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:35:28.663531    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c0ab7b32-c230-464e-9604-399a422f988d-workload-socket\") pod \"c0ab7b32-c230-464e-9604-399a422f988d\" (UID: \"c0ab7b32-c230-464e-9604-399a422f988d\") "
Jul 13 19:35:28.663689 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:35:28.663550    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bkwq5\" (UniqueName: \"kubernetes.io/projected/c0ab7b32-c230-464e-9604-399a422f988d-kube-api-access-bkwq5\") pod \"c0ab7b32-c230-464e-9604-399a422f988d\" (UID: \"c0ab7b32-c230-464e-9604-399a422f988d\") "
Jul 13 19:35:28.663689 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:35:28.663610    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c0ab7b32-c230-464e-9604-399a422f988d-istio-podinfo\") pod \"c0ab7b32-c230-464e-9604-399a422f988d\" (UID: \"c0ab7b32-c230-464e-9604-399a422f988d\") "
Jul 13 19:35:28.663689 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:35:28.663651    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c0ab7b32-c230-464e-9604-399a422f988d-istio-envoy\") pod \"c0ab7b32-c230-464e-9604-399a422f988d\" (UID: \"c0ab7b32-c230-464e-9604-399a422f988d\") "
Jul 13 19:35:28.664011 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:35:28.663703    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c0ab7b32-c230-464e-9604-399a422f988d-istiod-ca-cert\") pod \"c0ab7b32-c230-464e-9604-399a422f988d\" (UID: \"c0ab7b32-c230-464e-9604-399a422f988d\") "
Jul 13 19:35:28.664011 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:35:28.663742    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c0ab7b32-c230-464e-9604-399a422f988d-workload-certs\") pod \"c0ab7b32-c230-464e-9604-399a422f988d\" (UID: \"c0ab7b32-c230-464e-9604-399a422f988d\") "
Jul 13 19:35:28.664011 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:35:28.663768    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c0ab7b32-c230-464e-9604-399a422f988d-istio-data\") pod \"c0ab7b32-c230-464e-9604-399a422f988d\" (UID: \"c0ab7b32-c230-464e-9604-399a422f988d\") "
Jul 13 19:35:28.664209 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:35:28.663759    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c0ab7b32-c230-464e-9604-399a422f988d-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "c0ab7b32-c230-464e-9604-399a422f988d" (UID: "c0ab7b32-c230-464e-9604-399a422f988d"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 19:35:28.664209 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:35:28.664087    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c0ab7b32-c230-464e-9604-399a422f988d-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "c0ab7b32-c230-464e-9604-399a422f988d" (UID: "c0ab7b32-c230-464e-9604-399a422f988d"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 19:35:28.664209 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:35:28.663850    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c0ab7b32-c230-464e-9604-399a422f988d-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "c0ab7b32-c230-464e-9604-399a422f988d" (UID: "c0ab7b32-c230-464e-9604-399a422f988d"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 19:35:28.664368 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:35:28.664210    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c0ab7b32-c230-464e-9604-399a422f988d-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "c0ab7b32-c230-464e-9604-399a422f988d" (UID: "c0ab7b32-c230-464e-9604-399a422f988d"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 19:35:28.664999 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:35:28.664962    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c0ab7b32-c230-464e-9604-399a422f988d-istio-data" (OuterVolumeSpecName: "istio-data") pod "c0ab7b32-c230-464e-9604-399a422f988d" (UID: "c0ab7b32-c230-464e-9604-399a422f988d"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 19:35:28.665985 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:35:28.665952    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c0ab7b32-c230-464e-9604-399a422f988d-istio-token" (OuterVolumeSpecName: "istio-token") pod "c0ab7b32-c230-464e-9604-399a422f988d" (UID: "c0ab7b32-c230-464e-9604-399a422f988d"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 19:35:28.666133 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:35:28.666036    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c0ab7b32-c230-464e-9604-399a422f988d-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "c0ab7b32-c230-464e-9604-399a422f988d" (UID: "c0ab7b32-c230-464e-9604-399a422f988d"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 19:35:28.666380 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:35:28.666358    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/c0ab7b32-c230-464e-9604-399a422f988d-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "c0ab7b32-c230-464e-9604-399a422f988d" (UID: "c0ab7b32-c230-464e-9604-399a422f988d"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 13 19:35:28.666467 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:35:28.666385    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c0ab7b32-c230-464e-9604-399a422f988d-kube-api-access-bkwq5" (OuterVolumeSpecName: "kube-api-access-bkwq5") pod "c0ab7b32-c230-464e-9604-399a422f988d" (UID: "c0ab7b32-c230-464e-9604-399a422f988d"). InnerVolumeSpecName "kube-api-access-bkwq5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 19:35:28.764652 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:35:28.764627    2563 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c0ab7b32-c230-464e-9604-399a422f988d-istio-token\") on node \"ip-10-0-135-38.ec2.internal\" DevicePath \"\""
Jul 13 19:35:28.764758 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:35:28.764656    2563 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c0ab7b32-c230-464e-9604-399a422f988d-workload-socket\") on node \"ip-10-0-135-38.ec2.internal\" DevicePath \"\""
Jul 13 19:35:28.764758 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:35:28.764666    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bkwq5\" (UniqueName: \"kubernetes.io/projected/c0ab7b32-c230-464e-9604-399a422f988d-kube-api-access-bkwq5\") on node \"ip-10-0-135-38.ec2.internal\" DevicePath \"\""
Jul 13 19:35:28.764758 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:35:28.764676    2563 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c0ab7b32-c230-464e-9604-399a422f988d-istio-podinfo\") on node \"ip-10-0-135-38.ec2.internal\" DevicePath \"\""
Jul 13 19:35:28.764758 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:35:28.764685    2563 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c0ab7b32-c230-464e-9604-399a422f988d-istio-envoy\") on node \"ip-10-0-135-38.ec2.internal\" DevicePath \"\""
Jul 13 19:35:28.764758 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:35:28.764692    2563 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c0ab7b32-c230-464e-9604-399a422f988d-istiod-ca-cert\") on node \"ip-10-0-135-38.ec2.internal\" DevicePath \"\""
Jul 13 19:35:28.764758 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:35:28.764701    2563 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c0ab7b32-c230-464e-9604-399a422f988d-workload-certs\") on node \"ip-10-0-135-38.ec2.internal\" DevicePath \"\""
Jul 13 19:35:28.764758 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:35:28.764708    2563 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c0ab7b32-c230-464e-9604-399a422f988d-istio-data\") on node \"ip-10-0-135-38.ec2.internal\" DevicePath \"\""
Jul 13 19:35:28.764758 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:35:28.764716    2563 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c0ab7b32-c230-464e-9604-399a422f988d-credential-socket\") on node \"ip-10-0-135-38.ec2.internal\" DevicePath \"\""
Jul 13 19:35:28.821470 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:35:28.821358    2563 generic.go:356] "Generic (PLEG): container finished" podID="c0ab7b32-c230-464e-9604-399a422f988d" containerID="d3f76a43af6aec36bcb6c30db30b9d64c839e07f8a716ef44c5b84c7b66849bb" exitCode=0
Jul 13 19:35:28.821470 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:35:28.821414    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-d0bb2f-openshift-default-7f784fcc4f-tbl6z"
Jul 13 19:35:28.821470 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:35:28.821451    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-d0bb2f-openshift-default-7f784fcc4f-tbl6z" event={"ID":"c0ab7b32-c230-464e-9604-399a422f988d","Type":"ContainerDied","Data":"d3f76a43af6aec36bcb6c30db30b9d64c839e07f8a716ef44c5b84c7b66849bb"}
Jul 13 19:35:28.821738 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:35:28.821510    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-d0bb2f-openshift-default-7f784fcc4f-tbl6z" event={"ID":"c0ab7b32-c230-464e-9604-399a422f988d","Type":"ContainerDied","Data":"96201a03c8682bf6f1f1dbe9fdb562797208666ecf4360beb0e4a8c3ca64d83a"}
Jul 13 19:35:28.821738 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:35:28.821537    2563 scope.go:117] "RemoveContainer" containerID="d3f76a43af6aec36bcb6c30db30b9d64c839e07f8a716ef44c5b84c7b66849bb"
Jul 13 19:35:28.831372 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:35:28.831350    2563 scope.go:117] "RemoveContainer" containerID="c926eab0def7f8deed55fa37770e2d2c6455b7be353d4d8be1803ad93fac5d43"
Jul 13 19:35:28.841813 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:35:28.841785    2563 scope.go:117] "RemoveContainer" containerID="d3f76a43af6aec36bcb6c30db30b9d64c839e07f8a716ef44c5b84c7b66849bb"
Jul 13 19:35:28.842186 ip-10-0-135-38 kubenswrapper[2563]: E0713 19:35:28.842165    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d3f76a43af6aec36bcb6c30db30b9d64c839e07f8a716ef44c5b84c7b66849bb\": container with ID starting with d3f76a43af6aec36bcb6c30db30b9d64c839e07f8a716ef44c5b84c7b66849bb not found: ID does not exist" containerID="d3f76a43af6aec36bcb6c30db30b9d64c839e07f8a716ef44c5b84c7b66849bb"
Jul 13 19:35:28.842266 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:35:28.842199    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d3f76a43af6aec36bcb6c30db30b9d64c839e07f8a716ef44c5b84c7b66849bb"} err="failed to get container status \"d3f76a43af6aec36bcb6c30db30b9d64c839e07f8a716ef44c5b84c7b66849bb\": rpc error: code = NotFound desc = could not find container \"d3f76a43af6aec36bcb6c30db30b9d64c839e07f8a716ef44c5b84c7b66849bb\": container with ID starting with d3f76a43af6aec36bcb6c30db30b9d64c839e07f8a716ef44c5b84c7b66849bb not found: ID does not exist"
Jul 13 19:35:28.842266 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:35:28.842231    2563 scope.go:117] "RemoveContainer" containerID="c926eab0def7f8deed55fa37770e2d2c6455b7be353d4d8be1803ad93fac5d43"
Jul 13 19:35:28.842560 ip-10-0-135-38 kubenswrapper[2563]: E0713 19:35:28.842534    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c926eab0def7f8deed55fa37770e2d2c6455b7be353d4d8be1803ad93fac5d43\": container with ID starting with c926eab0def7f8deed55fa37770e2d2c6455b7be353d4d8be1803ad93fac5d43 not found: ID does not exist" containerID="c926eab0def7f8deed55fa37770e2d2c6455b7be353d4d8be1803ad93fac5d43"
Jul 13 19:35:28.842672 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:35:28.842564    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c926eab0def7f8deed55fa37770e2d2c6455b7be353d4d8be1803ad93fac5d43"} err="failed to get container status \"c926eab0def7f8deed55fa37770e2d2c6455b7be353d4d8be1803ad93fac5d43\": rpc error: code = NotFound desc = could not find container \"c926eab0def7f8deed55fa37770e2d2c6455b7be353d4d8be1803ad93fac5d43\": container with ID starting with c926eab0def7f8deed55fa37770e2d2c6455b7be353d4d8be1803ad93fac5d43 not found: ID does not exist"
Jul 13 19:35:28.843135 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:35:28.843116    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-d0bb2f-openshift-default-7f784fcc4f-tbl6z"]
Jul 13 19:35:28.848507 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:35:28.848476    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-d0bb2f-openshift-default-7f784fcc4f-tbl6z"]
Jul 13 19:35:30.756221 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:35:30.756183    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c0ab7b32-c230-464e-9604-399a422f988d" path="/var/lib/kubelet/pods/c0ab7b32-c230-464e-9604-399a422f988d/volumes"
Jul 13 19:35:49.433379 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:35:49.433333    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-0a1747-openshift-default-689755fc55-xr52v"]
Jul 13 19:35:49.433854 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:35:49.433602    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-0a1747-openshift-default-689755fc55-xr52v" podUID="f8ad0415-198a-4ff9-bf8d-a91c6e7929eb" containerName="istio-proxy" containerID="cri-o://7b4739da9d0861b9900b4aa57ea6c7a3f43c7b53b52df0fd60f92362681b221c" gracePeriod=30
Jul 13 19:35:50.358115 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:35:50.358069    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-868895-openshift-default-8598b649ff-n6qbx"]
Jul 13 19:35:50.358625 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:35:50.358601    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c0ab7b32-c230-464e-9604-399a422f988d" containerName="istio-proxy"
Jul 13 19:35:50.358625 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:35:50.358625    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="c0ab7b32-c230-464e-9604-399a422f988d" containerName="istio-proxy"
Jul 13 19:35:50.358794 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:35:50.358640    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c0ab7b32-c230-464e-9604-399a422f988d" containerName="istio-proxy"
Jul 13 19:35:50.358794 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:35:50.358649    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="c0ab7b32-c230-464e-9604-399a422f988d" containerName="istio-proxy"
Jul 13 19:35:50.358794 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:35:50.358671    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4c9300c7-7e99-4dca-98ad-37443399f9e4" containerName="revoke-keys"
Jul 13 19:35:50.358794 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:35:50.358681    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="4c9300c7-7e99-4dca-98ad-37443399f9e4" containerName="revoke-keys"
Jul 13 19:35:50.358794 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:35:50.358778    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="c0ab7b32-c230-464e-9604-399a422f988d" containerName="istio-proxy"
Jul 13 19:35:50.358794 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:35:50.358790    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="c0ab7b32-c230-464e-9604-399a422f988d" containerName="istio-proxy"
Jul 13 19:35:50.359117 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:35:50.358798    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="4c9300c7-7e99-4dca-98ad-37443399f9e4" containerName="revoke-keys"
Jul 13 19:35:50.361182 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:35:50.361158    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-868895-openshift-default-8598b649ff-n6qbx"
Jul 13 19:35:50.363411 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:35:50.363388    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-868895-openshift-default-dockercfg-ztdzp\""
Jul 13 19:35:50.373039 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:35:50.372986    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-868895-openshift-default-8598b649ff-n6qbx"]
Jul 13 19:35:50.461625 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:35:50.461588    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0864c894-19c8-4073-ab92-2b33ca5bb20d-istio-data\") pod \"e2e-api-a-868895-openshift-default-8598b649ff-n6qbx\" (UID: \"0864c894-19c8-4073-ab92-2b33ca5bb20d\") " pod="openshift-ingress/e2e-api-a-868895-openshift-default-8598b649ff-n6qbx"
Jul 13 19:35:50.461625 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:35:50.461626    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0864c894-19c8-4073-ab92-2b33ca5bb20d-istio-podinfo\") pod \"e2e-api-a-868895-openshift-default-8598b649ff-n6qbx\" (UID: \"0864c894-19c8-4073-ab92-2b33ca5bb20d\") " pod="openshift-ingress/e2e-api-a-868895-openshift-default-8598b649ff-n6qbx"
Jul 13 19:35:50.462181 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:35:50.461650    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0864c894-19c8-4073-ab92-2b33ca5bb20d-istio-token\") pod \"e2e-api-a-868895-openshift-default-8598b649ff-n6qbx\" (UID: \"0864c894-19c8-4073-ab92-2b33ca5bb20d\") " pod="openshift-ingress/e2e-api-a-868895-openshift-default-8598b649ff-n6qbx"
Jul 13 19:35:50.462181 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:35:50.461797    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0864c894-19c8-4073-ab92-2b33ca5bb20d-credential-socket\") pod \"e2e-api-a-868895-openshift-default-8598b649ff-n6qbx\" (UID: \"0864c894-19c8-4073-ab92-2b33ca5bb20d\") " pod="openshift-ingress/e2e-api-a-868895-openshift-default-8598b649ff-n6qbx"
Jul 13 19:35:50.462181 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:35:50.461847    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0864c894-19c8-4073-ab92-2b33ca5bb20d-workload-certs\") pod \"e2e-api-a-868895-openshift-default-8598b649ff-n6qbx\" (UID: \"0864c894-19c8-4073-ab92-2b33ca5bb20d\") " pod="openshift-ingress/e2e-api-a-868895-openshift-default-8598b649ff-n6qbx"
Jul 13 19:35:50.462181 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:35:50.461881    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0864c894-19c8-4073-ab92-2b33ca5bb20d-istiod-ca-cert\") pod \"e2e-api-a-868895-openshift-default-8598b649ff-n6qbx\" (UID: \"0864c894-19c8-4073-ab92-2b33ca5bb20d\") " pod="openshift-ingress/e2e-api-a-868895-openshift-default-8598b649ff-n6qbx"
Jul 13 19:35:50.462181 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:35:50.461921    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0864c894-19c8-4073-ab92-2b33ca5bb20d-workload-socket\") pod \"e2e-api-a-868895-openshift-default-8598b649ff-n6qbx\" (UID: \"0864c894-19c8-4073-ab92-2b33ca5bb20d\") " pod="openshift-ingress/e2e-api-a-868895-openshift-default-8598b649ff-n6qbx"
Jul 13 19:35:50.462181 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:35:50.461980    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0864c894-19c8-4073-ab92-2b33ca5bb20d-istio-envoy\") pod \"e2e-api-a-868895-openshift-default-8598b649ff-n6qbx\" (UID: \"0864c894-19c8-4073-ab92-2b33ca5bb20d\") " pod="openshift-ingress/e2e-api-a-868895-openshift-default-8598b649ff-n6qbx"
Jul 13 19:35:50.462181 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:35:50.462048    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xrszw\" (UniqueName: \"kubernetes.io/projected/0864c894-19c8-4073-ab92-2b33ca5bb20d-kube-api-access-xrszw\") pod \"e2e-api-a-868895-openshift-default-8598b649ff-n6qbx\" (UID: \"0864c894-19c8-4073-ab92-2b33ca5bb20d\") " pod="openshift-ingress/e2e-api-a-868895-openshift-default-8598b649ff-n6qbx"
Jul 13 19:35:50.563197 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:35:50.563136    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0864c894-19c8-4073-ab92-2b33ca5bb20d-istio-podinfo\") pod \"e2e-api-a-868895-openshift-default-8598b649ff-n6qbx\" (UID: \"0864c894-19c8-4073-ab92-2b33ca5bb20d\") " pod="openshift-ingress/e2e-api-a-868895-openshift-default-8598b649ff-n6qbx"
Jul 13 19:35:50.563197 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:35:50.563201    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0864c894-19c8-4073-ab92-2b33ca5bb20d-istio-token\") pod \"e2e-api-a-868895-openshift-default-8598b649ff-n6qbx\" (UID: \"0864c894-19c8-4073-ab92-2b33ca5bb20d\") " pod="openshift-ingress/e2e-api-a-868895-openshift-default-8598b649ff-n6qbx"
Jul 13 19:35:50.563478 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:35:50.563244    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0864c894-19c8-4073-ab92-2b33ca5bb20d-credential-socket\") pod \"e2e-api-a-868895-openshift-default-8598b649ff-n6qbx\" (UID: \"0864c894-19c8-4073-ab92-2b33ca5bb20d\") " pod="openshift-ingress/e2e-api-a-868895-openshift-default-8598b649ff-n6qbx"
Jul 13 19:35:50.563478 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:35:50.563268    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0864c894-19c8-4073-ab92-2b33ca5bb20d-workload-certs\") pod \"e2e-api-a-868895-openshift-default-8598b649ff-n6qbx\" (UID: \"0864c894-19c8-4073-ab92-2b33ca5bb20d\") " pod="openshift-ingress/e2e-api-a-868895-openshift-default-8598b649ff-n6qbx"
Jul 13 19:35:50.563478 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:35:50.563440    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0864c894-19c8-4073-ab92-2b33ca5bb20d-istiod-ca-cert\") pod \"e2e-api-a-868895-openshift-default-8598b649ff-n6qbx\" (UID: \"0864c894-19c8-4073-ab92-2b33ca5bb20d\") " pod="openshift-ingress/e2e-api-a-868895-openshift-default-8598b649ff-n6qbx"
Jul 13 19:35:50.563622 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:35:50.563509    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0864c894-19c8-4073-ab92-2b33ca5bb20d-workload-socket\") pod \"e2e-api-a-868895-openshift-default-8598b649ff-n6qbx\" (UID: \"0864c894-19c8-4073-ab92-2b33ca5bb20d\") " pod="openshift-ingress/e2e-api-a-868895-openshift-default-8598b649ff-n6qbx"
Jul 13 19:35:50.563622 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:35:50.563544    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0864c894-19c8-4073-ab92-2b33ca5bb20d-istio-envoy\") pod \"e2e-api-a-868895-openshift-default-8598b649ff-n6qbx\" (UID: \"0864c894-19c8-4073-ab92-2b33ca5bb20d\") " pod="openshift-ingress/e2e-api-a-868895-openshift-default-8598b649ff-n6qbx"
Jul 13 19:35:50.563622 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:35:50.563589    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xrszw\" (UniqueName: \"kubernetes.io/projected/0864c894-19c8-4073-ab92-2b33ca5bb20d-kube-api-access-xrszw\") pod \"e2e-api-a-868895-openshift-default-8598b649ff-n6qbx\" (UID: \"0864c894-19c8-4073-ab92-2b33ca5bb20d\") " pod="openshift-ingress/e2e-api-a-868895-openshift-default-8598b649ff-n6qbx"
Jul 13 19:35:50.563776 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:35:50.563670    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0864c894-19c8-4073-ab92-2b33ca5bb20d-istio-data\") pod \"e2e-api-a-868895-openshift-default-8598b649ff-n6qbx\" (UID: \"0864c894-19c8-4073-ab92-2b33ca5bb20d\") " pod="openshift-ingress/e2e-api-a-868895-openshift-default-8598b649ff-n6qbx"
Jul 13 19:35:50.563776 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:35:50.563676    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0864c894-19c8-4073-ab92-2b33ca5bb20d-workload-certs\") pod \"e2e-api-a-868895-openshift-default-8598b649ff-n6qbx\" (UID: \"0864c894-19c8-4073-ab92-2b33ca5bb20d\") " pod="openshift-ingress/e2e-api-a-868895-openshift-default-8598b649ff-n6qbx"
Jul 13 19:35:50.563776 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:35:50.563733    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0864c894-19c8-4073-ab92-2b33ca5bb20d-credential-socket\") pod \"e2e-api-a-868895-openshift-default-8598b649ff-n6qbx\" (UID: \"0864c894-19c8-4073-ab92-2b33ca5bb20d\") " pod="openshift-ingress/e2e-api-a-868895-openshift-default-8598b649ff-n6qbx"
Jul 13 19:35:50.563984 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:35:50.563949    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0864c894-19c8-4073-ab92-2b33ca5bb20d-workload-socket\") pod \"e2e-api-a-868895-openshift-default-8598b649ff-n6qbx\" (UID: \"0864c894-19c8-4073-ab92-2b33ca5bb20d\") " pod="openshift-ingress/e2e-api-a-868895-openshift-default-8598b649ff-n6qbx"
Jul 13 19:35:50.564148 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:35:50.564004    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0864c894-19c8-4073-ab92-2b33ca5bb20d-istio-data\") pod \"e2e-api-a-868895-openshift-default-8598b649ff-n6qbx\" (UID: \"0864c894-19c8-4073-ab92-2b33ca5bb20d\") " pod="openshift-ingress/e2e-api-a-868895-openshift-default-8598b649ff-n6qbx"
Jul 13 19:35:50.564216 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:35:50.564176    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0864c894-19c8-4073-ab92-2b33ca5bb20d-istiod-ca-cert\") pod \"e2e-api-a-868895-openshift-default-8598b649ff-n6qbx\" (UID: \"0864c894-19c8-4073-ab92-2b33ca5bb20d\") " pod="openshift-ingress/e2e-api-a-868895-openshift-default-8598b649ff-n6qbx"
Jul 13 19:35:50.566212 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:35:50.566179    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0864c894-19c8-4073-ab92-2b33ca5bb20d-istio-envoy\") pod \"e2e-api-a-868895-openshift-default-8598b649ff-n6qbx\" (UID: \"0864c894-19c8-4073-ab92-2b33ca5bb20d\") " pod="openshift-ingress/e2e-api-a-868895-openshift-default-8598b649ff-n6qbx"
Jul 13 19:35:50.566442 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:35:50.566427    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0864c894-19c8-4073-ab92-2b33ca5bb20d-istio-podinfo\") pod \"e2e-api-a-868895-openshift-default-8598b649ff-n6qbx\" (UID: \"0864c894-19c8-4073-ab92-2b33ca5bb20d\") " pod="openshift-ingress/e2e-api-a-868895-openshift-default-8598b649ff-n6qbx"
Jul 13 19:35:50.578321 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:35:50.578293    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0864c894-19c8-4073-ab92-2b33ca5bb20d-istio-token\") pod \"e2e-api-a-868895-openshift-default-8598b649ff-n6qbx\" (UID: \"0864c894-19c8-4073-ab92-2b33ca5bb20d\") " pod="openshift-ingress/e2e-api-a-868895-openshift-default-8598b649ff-n6qbx"
Jul 13 19:35:50.578466 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:35:50.578316    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xrszw\" (UniqueName: \"kubernetes.io/projected/0864c894-19c8-4073-ab92-2b33ca5bb20d-kube-api-access-xrszw\") pod \"e2e-api-a-868895-openshift-default-8598b649ff-n6qbx\" (UID: \"0864c894-19c8-4073-ab92-2b33ca5bb20d\") " pod="openshift-ingress/e2e-api-a-868895-openshift-default-8598b649ff-n6qbx"
Jul 13 19:35:50.672618 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:35:50.672516    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-868895-openshift-default-8598b649ff-n6qbx"
Jul 13 19:35:50.838071 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:35:50.838012    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-868895-openshift-default-8598b649ff-n6qbx"]
Jul 13 19:35:50.841045 ip-10-0-135-38 kubenswrapper[2563]: W0713 19:35:50.840981    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0864c894_19c8_4073_ab92_2b33ca5bb20d.slice/crio-e606514ca498524142fd5a1bde259617de8c4a83b584a9b2f72cad07dcb68cbc WatchSource:0}: Error finding container e606514ca498524142fd5a1bde259617de8c4a83b584a9b2f72cad07dcb68cbc: Status 404 returned error can't find the container with id e606514ca498524142fd5a1bde259617de8c4a83b584a9b2f72cad07dcb68cbc
Jul 13 19:35:50.843628 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:35:50.843589    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 13 19:35:50.843713 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:35:50.843665    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 13 19:35:50.843713 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:35:50.843695    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 13 19:35:50.940914 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:35:50.940798    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-868895-openshift-default-8598b649ff-n6qbx" event={"ID":"0864c894-19c8-4073-ab92-2b33ca5bb20d","Type":"ContainerStarted","Data":"5a0b734d4fbc364b745e18d5f778e912b8c99b8f47256b6c6ffaefdfc934054d"}
Jul 13 19:35:50.940914 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:35:50.940877    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-868895-openshift-default-8598b649ff-n6qbx" event={"ID":"0864c894-19c8-4073-ab92-2b33ca5bb20d","Type":"ContainerStarted","Data":"e606514ca498524142fd5a1bde259617de8c4a83b584a9b2f72cad07dcb68cbc"}
Jul 13 19:35:50.962101 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:35:50.962003    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-868895-openshift-default-8598b649ff-n6qbx" podStartSLOduration=0.961981069 podStartE2EDuration="961.981069ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 19:35:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 19:35:50.960664618 +0000 UTC m=+2238.735540990" watchObservedRunningTime="2026-07-13 19:35:50.961981069 +0000 UTC m=+2238.736857497"
Jul 13 19:35:51.673296 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:35:51.673252    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-868895-openshift-default-8598b649ff-n6qbx"
Jul 13 19:35:51.678804 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:35:51.678770    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-868895-openshift-default-8598b649ff-n6qbx"
Jul 13 19:35:51.947240 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:35:51.947142    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-868895-openshift-default-8598b649ff-n6qbx"
Jul 13 19:35:51.948212 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:35:51.948190    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-868895-openshift-default-8598b649ff-n6qbx"
Jul 13 19:35:52.899856 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:35:52.899816    2563 patch_prober.go:28] interesting pod/e2e-inf-b-0a1747-openshift-default-689755fc55-xr52v container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 13 19:35:52.900349 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:35:52.899900    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-0a1747-openshift-default-689755fc55-xr52v" podUID="f8ad0415-198a-4ff9-bf8d-a91c6e7929eb" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 13 19:35:54.699697 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:35:54.699604    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-0a1747-openshift-default-689755fc55-xr52v"
Jul 13 19:35:54.805898 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:35:54.805857    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f8ad0415-198a-4ff9-bf8d-a91c6e7929eb-istio-envoy\") pod \"f8ad0415-198a-4ff9-bf8d-a91c6e7929eb\" (UID: \"f8ad0415-198a-4ff9-bf8d-a91c6e7929eb\") "
Jul 13 19:35:54.805898 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:35:54.805908    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f8ad0415-198a-4ff9-bf8d-a91c6e7929eb-istio-data\") pod \"f8ad0415-198a-4ff9-bf8d-a91c6e7929eb\" (UID: \"f8ad0415-198a-4ff9-bf8d-a91c6e7929eb\") "
Jul 13 19:35:54.806247 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:35:54.805933    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f8ad0415-198a-4ff9-bf8d-a91c6e7929eb-istio-token\") pod \"f8ad0415-198a-4ff9-bf8d-a91c6e7929eb\" (UID: \"f8ad0415-198a-4ff9-bf8d-a91c6e7929eb\") "
Jul 13 19:35:54.806247 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:35:54.805958    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f8ad0415-198a-4ff9-bf8d-a91c6e7929eb-istio-podinfo\") pod \"f8ad0415-198a-4ff9-bf8d-a91c6e7929eb\" (UID: \"f8ad0415-198a-4ff9-bf8d-a91c6e7929eb\") "
Jul 13 19:35:54.806247 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:35:54.806006    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f8ad0415-198a-4ff9-bf8d-a91c6e7929eb-istiod-ca-cert\") pod \"f8ad0415-198a-4ff9-bf8d-a91c6e7929eb\" (UID: \"f8ad0415-198a-4ff9-bf8d-a91c6e7929eb\") "
Jul 13 19:35:54.806247 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:35:54.806070    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f8ad0415-198a-4ff9-bf8d-a91c6e7929eb-workload-socket\") pod \"f8ad0415-198a-4ff9-bf8d-a91c6e7929eb\" (UID: \"f8ad0415-198a-4ff9-bf8d-a91c6e7929eb\") "
Jul 13 19:35:54.806247 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:35:54.806093    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4jk8f\" (UniqueName: \"kubernetes.io/projected/f8ad0415-198a-4ff9-bf8d-a91c6e7929eb-kube-api-access-4jk8f\") pod \"f8ad0415-198a-4ff9-bf8d-a91c6e7929eb\" (UID: \"f8ad0415-198a-4ff9-bf8d-a91c6e7929eb\") "
Jul 13 19:35:54.806247 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:35:54.806135    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f8ad0415-198a-4ff9-bf8d-a91c6e7929eb-credential-socket\") pod \"f8ad0415-198a-4ff9-bf8d-a91c6e7929eb\" (UID: \"f8ad0415-198a-4ff9-bf8d-a91c6e7929eb\") "
Jul 13 19:35:54.806247 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:35:54.806182    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f8ad0415-198a-4ff9-bf8d-a91c6e7929eb-workload-certs\") pod \"f8ad0415-198a-4ff9-bf8d-a91c6e7929eb\" (UID: \"f8ad0415-198a-4ff9-bf8d-a91c6e7929eb\") "
Jul 13 19:35:54.806592 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:35:54.806419    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f8ad0415-198a-4ff9-bf8d-a91c6e7929eb-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "f8ad0415-198a-4ff9-bf8d-a91c6e7929eb" (UID: "f8ad0415-198a-4ff9-bf8d-a91c6e7929eb"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 19:35:54.806592 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:35:54.806507    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f8ad0415-198a-4ff9-bf8d-a91c6e7929eb-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "f8ad0415-198a-4ff9-bf8d-a91c6e7929eb" (UID: "f8ad0415-198a-4ff9-bf8d-a91c6e7929eb"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 19:35:54.806701 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:35:54.806666    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f8ad0415-198a-4ff9-bf8d-a91c6e7929eb-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "f8ad0415-198a-4ff9-bf8d-a91c6e7929eb" (UID: "f8ad0415-198a-4ff9-bf8d-a91c6e7929eb"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 19:35:54.806759 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:35:54.806694    2563 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f8ad0415-198a-4ff9-bf8d-a91c6e7929eb-istiod-ca-cert\") on node \"ip-10-0-135-38.ec2.internal\" DevicePath \"\""
Jul 13 19:35:54.806759 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:35:54.806718    2563 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f8ad0415-198a-4ff9-bf8d-a91c6e7929eb-workload-socket\") on node \"ip-10-0-135-38.ec2.internal\" DevicePath \"\""
Jul 13 19:35:54.806846 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:35:54.806774    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f8ad0415-198a-4ff9-bf8d-a91c6e7929eb-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "f8ad0415-198a-4ff9-bf8d-a91c6e7929eb" (UID: "f8ad0415-198a-4ff9-bf8d-a91c6e7929eb"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 19:35:54.806910 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:35:54.806883    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f8ad0415-198a-4ff9-bf8d-a91c6e7929eb-istio-data" (OuterVolumeSpecName: "istio-data") pod "f8ad0415-198a-4ff9-bf8d-a91c6e7929eb" (UID: "f8ad0415-198a-4ff9-bf8d-a91c6e7929eb"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 19:35:54.808392 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:35:54.808355    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f8ad0415-198a-4ff9-bf8d-a91c6e7929eb-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "f8ad0415-198a-4ff9-bf8d-a91c6e7929eb" (UID: "f8ad0415-198a-4ff9-bf8d-a91c6e7929eb"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 19:35:54.808531 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:35:54.808441    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/f8ad0415-198a-4ff9-bf8d-a91c6e7929eb-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "f8ad0415-198a-4ff9-bf8d-a91c6e7929eb" (UID: "f8ad0415-198a-4ff9-bf8d-a91c6e7929eb"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 13 19:35:54.808666 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:35:54.808644    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f8ad0415-198a-4ff9-bf8d-a91c6e7929eb-kube-api-access-4jk8f" (OuterVolumeSpecName: "kube-api-access-4jk8f") pod "f8ad0415-198a-4ff9-bf8d-a91c6e7929eb" (UID: "f8ad0415-198a-4ff9-bf8d-a91c6e7929eb"). InnerVolumeSpecName "kube-api-access-4jk8f". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 19:35:54.808710 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:35:54.808662    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f8ad0415-198a-4ff9-bf8d-a91c6e7929eb-istio-token" (OuterVolumeSpecName: "istio-token") pod "f8ad0415-198a-4ff9-bf8d-a91c6e7929eb" (UID: "f8ad0415-198a-4ff9-bf8d-a91c6e7929eb"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 19:35:54.907993 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:35:54.907951    2563 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f8ad0415-198a-4ff9-bf8d-a91c6e7929eb-istio-envoy\") on node \"ip-10-0-135-38.ec2.internal\" DevicePath \"\""
Jul 13 19:35:54.907993 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:35:54.907985    2563 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f8ad0415-198a-4ff9-bf8d-a91c6e7929eb-istio-data\") on node \"ip-10-0-135-38.ec2.internal\" DevicePath \"\""
Jul 13 19:35:54.907993 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:35:54.907994    2563 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f8ad0415-198a-4ff9-bf8d-a91c6e7929eb-istio-token\") on node \"ip-10-0-135-38.ec2.internal\" DevicePath \"\""
Jul 13 19:35:54.907993 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:35:54.908002    2563 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f8ad0415-198a-4ff9-bf8d-a91c6e7929eb-istio-podinfo\") on node \"ip-10-0-135-38.ec2.internal\" DevicePath \"\""
Jul 13 19:35:54.908303 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:35:54.908011    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4jk8f\" (UniqueName: \"kubernetes.io/projected/f8ad0415-198a-4ff9-bf8d-a91c6e7929eb-kube-api-access-4jk8f\") on node \"ip-10-0-135-38.ec2.internal\" DevicePath \"\""
Jul 13 19:35:54.908303 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:35:54.908032    2563 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f8ad0415-198a-4ff9-bf8d-a91c6e7929eb-credential-socket\") on node \"ip-10-0-135-38.ec2.internal\" DevicePath \"\""
Jul 13 19:35:54.908303 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:35:54.908040    2563 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f8ad0415-198a-4ff9-bf8d-a91c6e7929eb-workload-certs\") on node \"ip-10-0-135-38.ec2.internal\" DevicePath \"\""
Jul 13 19:35:54.966128 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:35:54.966008    2563 generic.go:356] "Generic (PLEG): container finished" podID="f8ad0415-198a-4ff9-bf8d-a91c6e7929eb" containerID="7b4739da9d0861b9900b4aa57ea6c7a3f43c7b53b52df0fd60f92362681b221c" exitCode=0
Jul 13 19:35:54.966128 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:35:54.966098    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-0a1747-openshift-default-689755fc55-xr52v"
Jul 13 19:35:54.966321 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:35:54.966090    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-0a1747-openshift-default-689755fc55-xr52v" event={"ID":"f8ad0415-198a-4ff9-bf8d-a91c6e7929eb","Type":"ContainerDied","Data":"7b4739da9d0861b9900b4aa57ea6c7a3f43c7b53b52df0fd60f92362681b221c"}
Jul 13 19:35:54.966321 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:35:54.966229    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-0a1747-openshift-default-689755fc55-xr52v" event={"ID":"f8ad0415-198a-4ff9-bf8d-a91c6e7929eb","Type":"ContainerDied","Data":"0ac9488ea4c47066141b125dbfbca88a3dedccbcbb522d81d45b16fa2424ca36"}
Jul 13 19:35:54.966321 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:35:54.966253    2563 scope.go:117] "RemoveContainer" containerID="7b4739da9d0861b9900b4aa57ea6c7a3f43c7b53b52df0fd60f92362681b221c"
Jul 13 19:35:54.976851 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:35:54.976824    2563 scope.go:117] "RemoveContainer" containerID="c2a270a7bcf66aae8b39c5eb306cad97362ae406e958497afc69632d8714627f"
Jul 13 19:35:54.989435 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:35:54.989399    2563 scope.go:117] "RemoveContainer" containerID="7b4739da9d0861b9900b4aa57ea6c7a3f43c7b53b52df0fd60f92362681b221c"
Jul 13 19:35:54.989865 ip-10-0-135-38 kubenswrapper[2563]: E0713 19:35:54.989840    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7b4739da9d0861b9900b4aa57ea6c7a3f43c7b53b52df0fd60f92362681b221c\": container with ID starting with 7b4739da9d0861b9900b4aa57ea6c7a3f43c7b53b52df0fd60f92362681b221c not found: ID does not exist" containerID="7b4739da9d0861b9900b4aa57ea6c7a3f43c7b53b52df0fd60f92362681b221c"
Jul 13 19:35:54.989976 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:35:54.989880    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7b4739da9d0861b9900b4aa57ea6c7a3f43c7b53b52df0fd60f92362681b221c"} err="failed to get container status \"7b4739da9d0861b9900b4aa57ea6c7a3f43c7b53b52df0fd60f92362681b221c\": rpc error: code = NotFound desc = could not find container \"7b4739da9d0861b9900b4aa57ea6c7a3f43c7b53b52df0fd60f92362681b221c\": container with ID starting with 7b4739da9d0861b9900b4aa57ea6c7a3f43c7b53b52df0fd60f92362681b221c not found: ID does not exist"
Jul 13 19:35:54.989976 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:35:54.989908    2563 scope.go:117] "RemoveContainer" containerID="c2a270a7bcf66aae8b39c5eb306cad97362ae406e958497afc69632d8714627f"
Jul 13 19:35:54.990510 ip-10-0-135-38 kubenswrapper[2563]: E0713 19:35:54.990446    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c2a270a7bcf66aae8b39c5eb306cad97362ae406e958497afc69632d8714627f\": container with ID starting with c2a270a7bcf66aae8b39c5eb306cad97362ae406e958497afc69632d8714627f not found: ID does not exist" containerID="c2a270a7bcf66aae8b39c5eb306cad97362ae406e958497afc69632d8714627f"
Jul 13 19:35:54.990510 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:35:54.990500    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c2a270a7bcf66aae8b39c5eb306cad97362ae406e958497afc69632d8714627f"} err="failed to get container status \"c2a270a7bcf66aae8b39c5eb306cad97362ae406e958497afc69632d8714627f\": rpc error: code = NotFound desc = could not find container \"c2a270a7bcf66aae8b39c5eb306cad97362ae406e958497afc69632d8714627f\": container with ID starting with c2a270a7bcf66aae8b39c5eb306cad97362ae406e958497afc69632d8714627f not found: ID does not exist"
Jul 13 19:35:54.992986 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:35:54.992958    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-0a1747-openshift-default-689755fc55-xr52v"]
Jul 13 19:35:54.995148 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:35:54.995121    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-0a1747-openshift-default-689755fc55-xr52v"]
Jul 13 19:35:56.756274 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:35:56.756240    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f8ad0415-198a-4ff9-bf8d-a91c6e7929eb" path="/var/lib/kubelet/pods/f8ad0415-198a-4ff9-bf8d-a91c6e7929eb/volumes"
Jul 13 19:35:58.095244 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:35:58.095199    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-f2d389-openshift-default-5fb684d7cc-492ld"]
Jul 13 19:35:58.095800 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:35:58.095769    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f8ad0415-198a-4ff9-bf8d-a91c6e7929eb" containerName="istio-proxy"
Jul 13 19:35:58.095800 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:35:58.095790    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="f8ad0415-198a-4ff9-bf8d-a91c6e7929eb" containerName="istio-proxy"
Jul 13 19:35:58.095948 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:35:58.095901    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="f8ad0415-198a-4ff9-bf8d-a91c6e7929eb" containerName="istio-proxy"
Jul 13 19:35:58.095948 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:35:58.095914    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="f8ad0415-198a-4ff9-bf8d-a91c6e7929eb" containerName="istio-proxy"
Jul 13 19:35:58.100465 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:35:58.100434    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-f2d389-openshift-default-5fb684d7cc-492ld"
Jul 13 19:35:58.102744 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:35:58.102720    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-f2d389-openshift-default-dockercfg-kh98l\""
Jul 13 19:35:58.110484 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:35:58.110447    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-f2d389-openshift-default-5fb684d7cc-492ld"]
Jul 13 19:35:58.239139 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:35:58.239083    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c0ee89bc-23f4-41af-be6f-326becf7fdcc-workload-socket\") pod \"e2e-api-b-f2d389-openshift-default-5fb684d7cc-492ld\" (UID: \"c0ee89bc-23f4-41af-be6f-326becf7fdcc\") " pod="openshift-ingress/e2e-api-b-f2d389-openshift-default-5fb684d7cc-492ld"
Jul 13 19:35:58.239386 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:35:58.239146    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c0ee89bc-23f4-41af-be6f-326becf7fdcc-istio-envoy\") pod \"e2e-api-b-f2d389-openshift-default-5fb684d7cc-492ld\" (UID: \"c0ee89bc-23f4-41af-be6f-326becf7fdcc\") " pod="openshift-ingress/e2e-api-b-f2d389-openshift-default-5fb684d7cc-492ld"
Jul 13 19:35:58.239386 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:35:58.239231    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c0ee89bc-23f4-41af-be6f-326becf7fdcc-istio-data\") pod \"e2e-api-b-f2d389-openshift-default-5fb684d7cc-492ld\" (UID: \"c0ee89bc-23f4-41af-be6f-326becf7fdcc\") " pod="openshift-ingress/e2e-api-b-f2d389-openshift-default-5fb684d7cc-492ld"
Jul 13 19:35:58.239386 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:35:58.239317    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c0ee89bc-23f4-41af-be6f-326becf7fdcc-workload-certs\") pod \"e2e-api-b-f2d389-openshift-default-5fb684d7cc-492ld\" (UID: \"c0ee89bc-23f4-41af-be6f-326becf7fdcc\") " pod="openshift-ingress/e2e-api-b-f2d389-openshift-default-5fb684d7cc-492ld"
Jul 13 19:35:58.239386 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:35:58.239356    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c0ee89bc-23f4-41af-be6f-326becf7fdcc-credential-socket\") pod \"e2e-api-b-f2d389-openshift-default-5fb684d7cc-492ld\" (UID: \"c0ee89bc-23f4-41af-be6f-326becf7fdcc\") " pod="openshift-ingress/e2e-api-b-f2d389-openshift-default-5fb684d7cc-492ld"
Jul 13 19:35:58.239386 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:35:58.239386    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c0ee89bc-23f4-41af-be6f-326becf7fdcc-istio-podinfo\") pod \"e2e-api-b-f2d389-openshift-default-5fb684d7cc-492ld\" (UID: \"c0ee89bc-23f4-41af-be6f-326becf7fdcc\") " pod="openshift-ingress/e2e-api-b-f2d389-openshift-default-5fb684d7cc-492ld"
Jul 13 19:35:58.239607 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:35:58.239404    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c0ee89bc-23f4-41af-be6f-326becf7fdcc-istio-token\") pod \"e2e-api-b-f2d389-openshift-default-5fb684d7cc-492ld\" (UID: \"c0ee89bc-23f4-41af-be6f-326becf7fdcc\") " pod="openshift-ingress/e2e-api-b-f2d389-openshift-default-5fb684d7cc-492ld"
Jul 13 19:35:58.239607 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:35:58.239420    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t66z7\" (UniqueName: \"kubernetes.io/projected/c0ee89bc-23f4-41af-be6f-326becf7fdcc-kube-api-access-t66z7\") pod \"e2e-api-b-f2d389-openshift-default-5fb684d7cc-492ld\" (UID: \"c0ee89bc-23f4-41af-be6f-326becf7fdcc\") " pod="openshift-ingress/e2e-api-b-f2d389-openshift-default-5fb684d7cc-492ld"
Jul 13 19:35:58.239607 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:35:58.239448    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c0ee89bc-23f4-41af-be6f-326becf7fdcc-istiod-ca-cert\") pod \"e2e-api-b-f2d389-openshift-default-5fb684d7cc-492ld\" (UID: \"c0ee89bc-23f4-41af-be6f-326becf7fdcc\") " pod="openshift-ingress/e2e-api-b-f2d389-openshift-default-5fb684d7cc-492ld"
Jul 13 19:35:58.340759 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:35:58.340712    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c0ee89bc-23f4-41af-be6f-326becf7fdcc-workload-certs\") pod \"e2e-api-b-f2d389-openshift-default-5fb684d7cc-492ld\" (UID: \"c0ee89bc-23f4-41af-be6f-326becf7fdcc\") " pod="openshift-ingress/e2e-api-b-f2d389-openshift-default-5fb684d7cc-492ld"
Jul 13 19:35:58.341043 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:35:58.340764    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c0ee89bc-23f4-41af-be6f-326becf7fdcc-credential-socket\") pod \"e2e-api-b-f2d389-openshift-default-5fb684d7cc-492ld\" (UID: \"c0ee89bc-23f4-41af-be6f-326becf7fdcc\") " pod="openshift-ingress/e2e-api-b-f2d389-openshift-default-5fb684d7cc-492ld"
Jul 13 19:35:58.341043 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:35:58.340792    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c0ee89bc-23f4-41af-be6f-326becf7fdcc-istio-podinfo\") pod \"e2e-api-b-f2d389-openshift-default-5fb684d7cc-492ld\" (UID: \"c0ee89bc-23f4-41af-be6f-326becf7fdcc\") " pod="openshift-ingress/e2e-api-b-f2d389-openshift-default-5fb684d7cc-492ld"
Jul 13 19:35:58.341043 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:35:58.340811    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c0ee89bc-23f4-41af-be6f-326becf7fdcc-istio-token\") pod \"e2e-api-b-f2d389-openshift-default-5fb684d7cc-492ld\" (UID: \"c0ee89bc-23f4-41af-be6f-326becf7fdcc\") " pod="openshift-ingress/e2e-api-b-f2d389-openshift-default-5fb684d7cc-492ld"
Jul 13 19:35:58.341043 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:35:58.340833    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t66z7\" (UniqueName: \"kubernetes.io/projected/c0ee89bc-23f4-41af-be6f-326becf7fdcc-kube-api-access-t66z7\") pod \"e2e-api-b-f2d389-openshift-default-5fb684d7cc-492ld\" (UID: \"c0ee89bc-23f4-41af-be6f-326becf7fdcc\") " pod="openshift-ingress/e2e-api-b-f2d389-openshift-default-5fb684d7cc-492ld"
Jul 13 19:35:58.341043 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:35:58.340861    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c0ee89bc-23f4-41af-be6f-326becf7fdcc-istiod-ca-cert\") pod \"e2e-api-b-f2d389-openshift-default-5fb684d7cc-492ld\" (UID: \"c0ee89bc-23f4-41af-be6f-326becf7fdcc\") " pod="openshift-ingress/e2e-api-b-f2d389-openshift-default-5fb684d7cc-492ld"
Jul 13 19:35:58.341043 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:35:58.340912    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c0ee89bc-23f4-41af-be6f-326becf7fdcc-workload-socket\") pod \"e2e-api-b-f2d389-openshift-default-5fb684d7cc-492ld\" (UID: \"c0ee89bc-23f4-41af-be6f-326becf7fdcc\") " pod="openshift-ingress/e2e-api-b-f2d389-openshift-default-5fb684d7cc-492ld"
Jul 13 19:35:58.341043 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:35:58.340959    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c0ee89bc-23f4-41af-be6f-326becf7fdcc-istio-envoy\") pod \"e2e-api-b-f2d389-openshift-default-5fb684d7cc-492ld\" (UID: \"c0ee89bc-23f4-41af-be6f-326becf7fdcc\") " pod="openshift-ingress/e2e-api-b-f2d389-openshift-default-5fb684d7cc-492ld"
Jul 13 19:35:58.341043 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:35:58.341001    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c0ee89bc-23f4-41af-be6f-326becf7fdcc-istio-data\") pod \"e2e-api-b-f2d389-openshift-default-5fb684d7cc-492ld\" (UID: \"c0ee89bc-23f4-41af-be6f-326becf7fdcc\") " pod="openshift-ingress/e2e-api-b-f2d389-openshift-default-5fb684d7cc-492ld"
Jul 13 19:35:58.341481 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:35:58.341317    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c0ee89bc-23f4-41af-be6f-326becf7fdcc-workload-certs\") pod \"e2e-api-b-f2d389-openshift-default-5fb684d7cc-492ld\" (UID: \"c0ee89bc-23f4-41af-be6f-326becf7fdcc\") " pod="openshift-ingress/e2e-api-b-f2d389-openshift-default-5fb684d7cc-492ld"
Jul 13 19:35:58.341481 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:35:58.341341    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c0ee89bc-23f4-41af-be6f-326becf7fdcc-credential-socket\") pod \"e2e-api-b-f2d389-openshift-default-5fb684d7cc-492ld\" (UID: \"c0ee89bc-23f4-41af-be6f-326becf7fdcc\") " pod="openshift-ingress/e2e-api-b-f2d389-openshift-default-5fb684d7cc-492ld"
Jul 13 19:35:58.341481 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:35:58.341439    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c0ee89bc-23f4-41af-be6f-326becf7fdcc-workload-socket\") pod \"e2e-api-b-f2d389-openshift-default-5fb684d7cc-492ld\" (UID: \"c0ee89bc-23f4-41af-be6f-326becf7fdcc\") " pod="openshift-ingress/e2e-api-b-f2d389-openshift-default-5fb684d7cc-492ld"
Jul 13 19:35:58.341639 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:35:58.341573    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c0ee89bc-23f4-41af-be6f-326becf7fdcc-istio-data\") pod \"e2e-api-b-f2d389-openshift-default-5fb684d7cc-492ld\" (UID: \"c0ee89bc-23f4-41af-be6f-326becf7fdcc\") " pod="openshift-ingress/e2e-api-b-f2d389-openshift-default-5fb684d7cc-492ld"
Jul 13 19:35:58.341906 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:35:58.341884    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c0ee89bc-23f4-41af-be6f-326becf7fdcc-istiod-ca-cert\") pod \"e2e-api-b-f2d389-openshift-default-5fb684d7cc-492ld\" (UID: \"c0ee89bc-23f4-41af-be6f-326becf7fdcc\") " pod="openshift-ingress/e2e-api-b-f2d389-openshift-default-5fb684d7cc-492ld"
Jul 13 19:35:58.343576 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:35:58.343549    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c0ee89bc-23f4-41af-be6f-326becf7fdcc-istio-envoy\") pod \"e2e-api-b-f2d389-openshift-default-5fb684d7cc-492ld\" (UID: \"c0ee89bc-23f4-41af-be6f-326becf7fdcc\") " pod="openshift-ingress/e2e-api-b-f2d389-openshift-default-5fb684d7cc-492ld"
Jul 13 19:35:58.343697 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:35:58.343606    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c0ee89bc-23f4-41af-be6f-326becf7fdcc-istio-podinfo\") pod \"e2e-api-b-f2d389-openshift-default-5fb684d7cc-492ld\" (UID: \"c0ee89bc-23f4-41af-be6f-326becf7fdcc\") " pod="openshift-ingress/e2e-api-b-f2d389-openshift-default-5fb684d7cc-492ld"
Jul 13 19:35:58.351205 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:35:58.351115    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c0ee89bc-23f4-41af-be6f-326becf7fdcc-istio-token\") pod \"e2e-api-b-f2d389-openshift-default-5fb684d7cc-492ld\" (UID: \"c0ee89bc-23f4-41af-be6f-326becf7fdcc\") " pod="openshift-ingress/e2e-api-b-f2d389-openshift-default-5fb684d7cc-492ld"
Jul 13 19:35:58.351205 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:35:58.351178    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t66z7\" (UniqueName: \"kubernetes.io/projected/c0ee89bc-23f4-41af-be6f-326becf7fdcc-kube-api-access-t66z7\") pod \"e2e-api-b-f2d389-openshift-default-5fb684d7cc-492ld\" (UID: \"c0ee89bc-23f4-41af-be6f-326becf7fdcc\") " pod="openshift-ingress/e2e-api-b-f2d389-openshift-default-5fb684d7cc-492ld"
Jul 13 19:35:58.413141 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:35:58.413086    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-f2d389-openshift-default-5fb684d7cc-492ld"
Jul 13 19:35:58.573805 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:35:58.573772    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-f2d389-openshift-default-5fb684d7cc-492ld"]
Jul 13 19:35:58.575913 ip-10-0-135-38 kubenswrapper[2563]: W0713 19:35:58.575876    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc0ee89bc_23f4_41af_be6f_326becf7fdcc.slice/crio-308d2780ff61bfb9e4c014556618cfd1d2523c9da49be8dd4d73f8df350119c3 WatchSource:0}: Error finding container 308d2780ff61bfb9e4c014556618cfd1d2523c9da49be8dd4d73f8df350119c3: Status 404 returned error can't find the container with id 308d2780ff61bfb9e4c014556618cfd1d2523c9da49be8dd4d73f8df350119c3
Jul 13 19:35:58.578363 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:35:58.578327    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 13 19:35:58.578455 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:35:58.578408    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 13 19:35:58.578455 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:35:58.578441    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 13 19:35:58.992617 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:35:58.992514    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-f2d389-openshift-default-5fb684d7cc-492ld" event={"ID":"c0ee89bc-23f4-41af-be6f-326becf7fdcc","Type":"ContainerStarted","Data":"19644005e134ee88cd9055db19a6b9ee297027b6134f78b3334968e65cd9b355"}
Jul 13 19:35:58.992617 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:35:58.992570    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-f2d389-openshift-default-5fb684d7cc-492ld" event={"ID":"c0ee89bc-23f4-41af-be6f-326becf7fdcc","Type":"ContainerStarted","Data":"308d2780ff61bfb9e4c014556618cfd1d2523c9da49be8dd4d73f8df350119c3"}
Jul 13 19:35:59.012144 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:35:59.012087    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-f2d389-openshift-default-5fb684d7cc-492ld" podStartSLOduration=1.012067375 podStartE2EDuration="1.012067375s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 19:35:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 19:35:59.010720992 +0000 UTC m=+2246.785597349" watchObservedRunningTime="2026-07-13 19:35:59.012067375 +0000 UTC m=+2246.786943730"
Jul 13 19:35:59.413708 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:35:59.413663    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-f2d389-openshift-default-5fb684d7cc-492ld"
Jul 13 19:35:59.419116 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:35:59.419085    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-f2d389-openshift-default-5fb684d7cc-492ld"
Jul 13 19:35:59.998953 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:35:59.998908    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-f2d389-openshift-default-5fb684d7cc-492ld"
Jul 13 19:36:00.000105 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:36:00.000077    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-f2d389-openshift-default-5fb684d7cc-492ld"
Jul 13 19:36:07.989317 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:36:07.989263    2563 patch_prober.go:28] interesting pod/e2e-api-a-868895-openshift-default-8598b649ff-n6qbx container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.67:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 13 19:36:07.989870 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:36:07.989371    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-868895-openshift-default-8598b649ff-n6qbx" podUID="0864c894-19c8-4073-ab92-2b33ca5bb20d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.67:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 13 19:36:10.060408 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:36:10.060371    2563 generic.go:356] "Generic (PLEG): container finished" podID="0864c894-19c8-4073-ab92-2b33ca5bb20d" containerID="5a0b734d4fbc364b745e18d5f778e912b8c99b8f47256b6c6ffaefdfc934054d" exitCode=0
Jul 13 19:36:10.060860 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:36:10.060442    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-868895-openshift-default-8598b649ff-n6qbx" event={"ID":"0864c894-19c8-4073-ab92-2b33ca5bb20d","Type":"ContainerDied","Data":"5a0b734d4fbc364b745e18d5f778e912b8c99b8f47256b6c6ffaefdfc934054d"}
Jul 13 19:36:10.060860 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:36:10.060849    2563 scope.go:117] "RemoveContainer" containerID="5a0b734d4fbc364b745e18d5f778e912b8c99b8f47256b6c6ffaefdfc934054d"
Jul 13 19:36:10.062010 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:36:10.061975    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 13 19:36:10.062149 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:36:10.062082    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 13 19:36:10.062149 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:36:10.062131    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 13 19:36:11.069233 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:36:11.069196    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-868895-openshift-default-8598b649ff-n6qbx" event={"ID":"0864c894-19c8-4073-ab92-2b33ca5bb20d","Type":"ContainerStarted","Data":"704d5482a93c97dbd40154be2ba7750bf11f8f0ac06c1274243674ec049a847e"}
Jul 13 19:36:11.673801 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:36:11.673756    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-868895-openshift-default-8598b649ff-n6qbx"
Jul 13 19:36:11.674080 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:36:11.673987    2563 patch_prober.go:28] interesting pod/e2e-api-a-868895-openshift-default-8598b649ff-n6qbx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused" start-of-body=
Jul 13 19:36:11.674186 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:36:11.674083    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-868895-openshift-default-8598b649ff-n6qbx" podUID="0864c894-19c8-4073-ab92-2b33ca5bb20d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused"
Jul 13 19:36:12.673232 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:36:12.673189    2563 patch_prober.go:28] interesting pod/e2e-api-a-868895-openshift-default-8598b649ff-n6qbx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused" start-of-body=
Jul 13 19:36:12.673667 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:36:12.673258    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-868895-openshift-default-8598b649ff-n6qbx" podUID="0864c894-19c8-4073-ab92-2b33ca5bb20d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused"
Jul 13 19:36:13.673470 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:36:13.673429    2563 patch_prober.go:28] interesting pod/e2e-api-a-868895-openshift-default-8598b649ff-n6qbx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused" start-of-body=
Jul 13 19:36:13.673970 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:36:13.673941    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-868895-openshift-default-8598b649ff-n6qbx" podUID="0864c894-19c8-4073-ab92-2b33ca5bb20d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused"
Jul 13 19:36:14.673456 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:36:14.673412    2563 patch_prober.go:28] interesting pod/e2e-api-a-868895-openshift-default-8598b649ff-n6qbx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused" start-of-body=
Jul 13 19:36:14.673657 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:36:14.673486    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-868895-openshift-default-8598b649ff-n6qbx" podUID="0864c894-19c8-4073-ab92-2b33ca5bb20d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused"
Jul 13 19:36:15.677892 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:36:15.677858    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-868895-openshift-default-8598b649ff-n6qbx"
Jul 13 19:36:15.678406 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:36:15.678261    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-868895-openshift-default-8598b649ff-n6qbx"
Jul 13 19:36:15.679209 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:36:15.679189    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-868895-openshift-default-8598b649ff-n6qbx"
Jul 13 19:36:20.131486 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:36:20.131451    2563 generic.go:356] "Generic (PLEG): container finished" podID="c0ee89bc-23f4-41af-be6f-326becf7fdcc" containerID="19644005e134ee88cd9055db19a6b9ee297027b6134f78b3334968e65cd9b355" exitCode=0
Jul 13 19:36:20.131963 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:36:20.131526    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-f2d389-openshift-default-5fb684d7cc-492ld" event={"ID":"c0ee89bc-23f4-41af-be6f-326becf7fdcc","Type":"ContainerDied","Data":"19644005e134ee88cd9055db19a6b9ee297027b6134f78b3334968e65cd9b355"}
Jul 13 19:36:20.131963 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:36:20.131926    2563 scope.go:117] "RemoveContainer" containerID="19644005e134ee88cd9055db19a6b9ee297027b6134f78b3334968e65cd9b355"
Jul 13 19:36:20.133105 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:36:20.133074    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 13 19:36:20.133185 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:36:20.133151    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 13 19:36:20.133224 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:36:20.133187    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 13 19:36:21.139544 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:36:21.139507    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-f2d389-openshift-default-5fb684d7cc-492ld" event={"ID":"c0ee89bc-23f4-41af-be6f-326becf7fdcc","Type":"ContainerStarted","Data":"5c92fdcf3dadd34d7389dd1694934794f705ac31fe06b80285f4b276cc6528f9"}
Jul 13 19:36:21.413805 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:36:21.413692    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-f2d389-openshift-default-5fb684d7cc-492ld"
Jul 13 19:36:21.414062 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:36:21.414005    2563 patch_prober.go:28] interesting pod/e2e-api-b-f2d389-openshift-default-5fb684d7cc-492ld container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused" start-of-body=
Jul 13 19:36:21.414220 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:36:21.414094    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-f2d389-openshift-default-5fb684d7cc-492ld" podUID="c0ee89bc-23f4-41af-be6f-326becf7fdcc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused"
Jul 13 19:36:22.414243 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:36:22.414190    2563 patch_prober.go:28] interesting pod/e2e-api-b-f2d389-openshift-default-5fb684d7cc-492ld container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused" start-of-body=
Jul 13 19:36:22.414769 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:36:22.414269    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-f2d389-openshift-default-5fb684d7cc-492ld" podUID="c0ee89bc-23f4-41af-be6f-326becf7fdcc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused"
Jul 13 19:36:23.413994 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:36:23.413938    2563 patch_prober.go:28] interesting pod/e2e-api-b-f2d389-openshift-default-5fb684d7cc-492ld container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused" start-of-body=
Jul 13 19:36:23.414284 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:36:23.414054    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-f2d389-openshift-default-5fb684d7cc-492ld" podUID="c0ee89bc-23f4-41af-be6f-326becf7fdcc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused"
Jul 13 19:36:24.413921 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:36:24.413871    2563 patch_prober.go:28] interesting pod/e2e-api-b-f2d389-openshift-default-5fb684d7cc-492ld container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused" start-of-body=
Jul 13 19:36:24.414298 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:36:24.414261    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-f2d389-openshift-default-5fb684d7cc-492ld" podUID="c0ee89bc-23f4-41af-be6f-326becf7fdcc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused"
Jul 13 19:36:25.413665 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:36:25.413618    2563 patch_prober.go:28] interesting pod/e2e-api-b-f2d389-openshift-default-5fb684d7cc-492ld container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused" start-of-body=
Jul 13 19:36:25.414113 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:36:25.414067    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-f2d389-openshift-default-5fb684d7cc-492ld" podUID="c0ee89bc-23f4-41af-be6f-326becf7fdcc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused"
Jul 13 19:36:26.414073 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:36:26.414005    2563 patch_prober.go:28] interesting pod/e2e-api-b-f2d389-openshift-default-5fb684d7cc-492ld container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused" start-of-body=
Jul 13 19:36:26.414515 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:36:26.414095    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-f2d389-openshift-default-5fb684d7cc-492ld" podUID="c0ee89bc-23f4-41af-be6f-326becf7fdcc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused"
Jul 13 19:36:27.418391 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:36:27.418354    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-f2d389-openshift-default-5fb684d7cc-492ld"
Jul 13 19:36:27.418814 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:36:27.418746    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-f2d389-openshift-default-5fb684d7cc-492ld"
Jul 13 19:36:27.419638 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:36:27.419614    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-f2d389-openshift-default-5fb684d7cc-492ld"
Jul 13 19:36:39.239227 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:36:39.239182    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-868895-openshift-default-8598b649ff-n6qbx"]
Jul 13 19:36:39.239796 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:36:39.239448    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-868895-openshift-default-8598b649ff-n6qbx" podUID="0864c894-19c8-4073-ab92-2b33ca5bb20d" containerName="istio-proxy" containerID="cri-o://704d5482a93c97dbd40154be2ba7750bf11f8f0ac06c1274243674ec049a847e" gracePeriod=30
Jul 13 19:36:44.497679 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:36:44.497648    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-868895-openshift-default-8598b649ff-n6qbx"
Jul 13 19:36:44.524770 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:36:44.524671    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0864c894-19c8-4073-ab92-2b33ca5bb20d-istio-token\") pod \"0864c894-19c8-4073-ab92-2b33ca5bb20d\" (UID: \"0864c894-19c8-4073-ab92-2b33ca5bb20d\") "
Jul 13 19:36:44.524770 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:36:44.524735    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0864c894-19c8-4073-ab92-2b33ca5bb20d-istio-data\") pod \"0864c894-19c8-4073-ab92-2b33ca5bb20d\" (UID: \"0864c894-19c8-4073-ab92-2b33ca5bb20d\") "
Jul 13 19:36:44.525009 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:36:44.524789    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0864c894-19c8-4073-ab92-2b33ca5bb20d-workload-socket\") pod \"0864c894-19c8-4073-ab92-2b33ca5bb20d\" (UID: \"0864c894-19c8-4073-ab92-2b33ca5bb20d\") "
Jul 13 19:36:44.525009 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:36:44.524849    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xrszw\" (UniqueName: \"kubernetes.io/projected/0864c894-19c8-4073-ab92-2b33ca5bb20d-kube-api-access-xrszw\") pod \"0864c894-19c8-4073-ab92-2b33ca5bb20d\" (UID: \"0864c894-19c8-4073-ab92-2b33ca5bb20d\") "
Jul 13 19:36:44.525139 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:36:44.525116    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0864c894-19c8-4073-ab92-2b33ca5bb20d-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "0864c894-19c8-4073-ab92-2b33ca5bb20d" (UID: "0864c894-19c8-4073-ab92-2b33ca5bb20d"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 19:36:44.525670 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:36:44.525640    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0864c894-19c8-4073-ab92-2b33ca5bb20d-istio-data" (OuterVolumeSpecName: "istio-data") pod "0864c894-19c8-4073-ab92-2b33ca5bb20d" (UID: "0864c894-19c8-4073-ab92-2b33ca5bb20d"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 19:36:44.527073 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:36:44.527038    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0864c894-19c8-4073-ab92-2b33ca5bb20d-istio-token" (OuterVolumeSpecName: "istio-token") pod "0864c894-19c8-4073-ab92-2b33ca5bb20d" (UID: "0864c894-19c8-4073-ab92-2b33ca5bb20d"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 19:36:44.527073 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:36:44.527065    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0864c894-19c8-4073-ab92-2b33ca5bb20d-kube-api-access-xrszw" (OuterVolumeSpecName: "kube-api-access-xrszw") pod "0864c894-19c8-4073-ab92-2b33ca5bb20d" (UID: "0864c894-19c8-4073-ab92-2b33ca5bb20d"). InnerVolumeSpecName "kube-api-access-xrszw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 19:36:44.625723 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:36:44.625677    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0864c894-19c8-4073-ab92-2b33ca5bb20d-istio-envoy\") pod \"0864c894-19c8-4073-ab92-2b33ca5bb20d\" (UID: \"0864c894-19c8-4073-ab92-2b33ca5bb20d\") "
Jul 13 19:36:44.625902 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:36:44.625733    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0864c894-19c8-4073-ab92-2b33ca5bb20d-credential-socket\") pod \"0864c894-19c8-4073-ab92-2b33ca5bb20d\" (UID: \"0864c894-19c8-4073-ab92-2b33ca5bb20d\") "
Jul 13 19:36:44.625902 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:36:44.625753    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0864c894-19c8-4073-ab92-2b33ca5bb20d-workload-certs\") pod \"0864c894-19c8-4073-ab92-2b33ca5bb20d\" (UID: \"0864c894-19c8-4073-ab92-2b33ca5bb20d\") "
Jul 13 19:36:44.625902 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:36:44.625778    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0864c894-19c8-4073-ab92-2b33ca5bb20d-istiod-ca-cert\") pod \"0864c894-19c8-4073-ab92-2b33ca5bb20d\" (UID: \"0864c894-19c8-4073-ab92-2b33ca5bb20d\") "
Jul 13 19:36:44.625902 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:36:44.625806    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0864c894-19c8-4073-ab92-2b33ca5bb20d-istio-podinfo\") pod \"0864c894-19c8-4073-ab92-2b33ca5bb20d\" (UID: \"0864c894-19c8-4073-ab92-2b33ca5bb20d\") "
Jul 13 19:36:44.626115 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:36:44.626014    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0864c894-19c8-4073-ab92-2b33ca5bb20d-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "0864c894-19c8-4073-ab92-2b33ca5bb20d" (UID: "0864c894-19c8-4073-ab92-2b33ca5bb20d"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 19:36:44.626115 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:36:44.626064    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0864c894-19c8-4073-ab92-2b33ca5bb20d-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "0864c894-19c8-4073-ab92-2b33ca5bb20d" (UID: "0864c894-19c8-4073-ab92-2b33ca5bb20d"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 19:36:44.626115 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:36:44.626069    2563 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0864c894-19c8-4073-ab92-2b33ca5bb20d-istio-token\") on node \"ip-10-0-135-38.ec2.internal\" DevicePath \"\""
Jul 13 19:36:44.626233 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:36:44.626125    2563 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0864c894-19c8-4073-ab92-2b33ca5bb20d-istio-data\") on node \"ip-10-0-135-38.ec2.internal\" DevicePath \"\""
Jul 13 19:36:44.626233 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:36:44.626138    2563 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0864c894-19c8-4073-ab92-2b33ca5bb20d-workload-socket\") on node \"ip-10-0-135-38.ec2.internal\" DevicePath \"\""
Jul 13 19:36:44.626233 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:36:44.626147    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xrszw\" (UniqueName: \"kubernetes.io/projected/0864c894-19c8-4073-ab92-2b33ca5bb20d-kube-api-access-xrszw\") on node \"ip-10-0-135-38.ec2.internal\" DevicePath \"\""
Jul 13 19:36:44.626233 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:36:44.626213    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0864c894-19c8-4073-ab92-2b33ca5bb20d-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "0864c894-19c8-4073-ab92-2b33ca5bb20d" (UID: "0864c894-19c8-4073-ab92-2b33ca5bb20d"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 19:36:44.627969 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:36:44.627933    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/0864c894-19c8-4073-ab92-2b33ca5bb20d-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "0864c894-19c8-4073-ab92-2b33ca5bb20d" (UID: "0864c894-19c8-4073-ab92-2b33ca5bb20d"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 13 19:36:44.628042 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:36:44.627977    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0864c894-19c8-4073-ab92-2b33ca5bb20d-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "0864c894-19c8-4073-ab92-2b33ca5bb20d" (UID: "0864c894-19c8-4073-ab92-2b33ca5bb20d"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 19:36:44.727462 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:36:44.727415    2563 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0864c894-19c8-4073-ab92-2b33ca5bb20d-credential-socket\") on node \"ip-10-0-135-38.ec2.internal\" DevicePath \"\""
Jul 13 19:36:44.727462 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:36:44.727452    2563 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0864c894-19c8-4073-ab92-2b33ca5bb20d-workload-certs\") on node \"ip-10-0-135-38.ec2.internal\" DevicePath \"\""
Jul 13 19:36:44.727462 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:36:44.727465    2563 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0864c894-19c8-4073-ab92-2b33ca5bb20d-istiod-ca-cert\") on node \"ip-10-0-135-38.ec2.internal\" DevicePath \"\""
Jul 13 19:36:44.727462 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:36:44.727477    2563 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0864c894-19c8-4073-ab92-2b33ca5bb20d-istio-podinfo\") on node \"ip-10-0-135-38.ec2.internal\" DevicePath \"\""
Jul 13 19:36:44.727757 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:36:44.727488    2563 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0864c894-19c8-4073-ab92-2b33ca5bb20d-istio-envoy\") on node \"ip-10-0-135-38.ec2.internal\" DevicePath \"\""
Jul 13 19:36:45.274173 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:36:45.274139    2563 generic.go:356] "Generic (PLEG): container finished" podID="0864c894-19c8-4073-ab92-2b33ca5bb20d" containerID="704d5482a93c97dbd40154be2ba7750bf11f8f0ac06c1274243674ec049a847e" exitCode=0
Jul 13 19:36:45.274363 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:36:45.274186    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-868895-openshift-default-8598b649ff-n6qbx"
Jul 13 19:36:45.274363 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:36:45.274216    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-868895-openshift-default-8598b649ff-n6qbx" event={"ID":"0864c894-19c8-4073-ab92-2b33ca5bb20d","Type":"ContainerDied","Data":"704d5482a93c97dbd40154be2ba7750bf11f8f0ac06c1274243674ec049a847e"}
Jul 13 19:36:45.274363 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:36:45.274282    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-868895-openshift-default-8598b649ff-n6qbx" event={"ID":"0864c894-19c8-4073-ab92-2b33ca5bb20d","Type":"ContainerDied","Data":"e606514ca498524142fd5a1bde259617de8c4a83b584a9b2f72cad07dcb68cbc"}
Jul 13 19:36:45.274363 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:36:45.274310    2563 scope.go:117] "RemoveContainer" containerID="704d5482a93c97dbd40154be2ba7750bf11f8f0ac06c1274243674ec049a847e"
Jul 13 19:36:45.284755 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:36:45.284730    2563 scope.go:117] "RemoveContainer" containerID="5a0b734d4fbc364b745e18d5f778e912b8c99b8f47256b6c6ffaefdfc934054d"
Jul 13 19:36:45.293303 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:36:45.293274    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-868895-openshift-default-8598b649ff-n6qbx"]
Jul 13 19:36:45.294402 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:36:45.294364    2563 scope.go:117] "RemoveContainer" containerID="704d5482a93c97dbd40154be2ba7750bf11f8f0ac06c1274243674ec049a847e"
Jul 13 19:36:45.295284 ip-10-0-135-38 kubenswrapper[2563]: E0713 19:36:45.295251    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"704d5482a93c97dbd40154be2ba7750bf11f8f0ac06c1274243674ec049a847e\": container with ID starting with 704d5482a93c97dbd40154be2ba7750bf11f8f0ac06c1274243674ec049a847e not found: ID does not exist" containerID="704d5482a93c97dbd40154be2ba7750bf11f8f0ac06c1274243674ec049a847e"
Jul 13 19:36:45.295404 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:36:45.295297    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"704d5482a93c97dbd40154be2ba7750bf11f8f0ac06c1274243674ec049a847e"} err="failed to get container status \"704d5482a93c97dbd40154be2ba7750bf11f8f0ac06c1274243674ec049a847e\": rpc error: code = NotFound desc = could not find container \"704d5482a93c97dbd40154be2ba7750bf11f8f0ac06c1274243674ec049a847e\": container with ID starting with 704d5482a93c97dbd40154be2ba7750bf11f8f0ac06c1274243674ec049a847e not found: ID does not exist"
Jul 13 19:36:45.295404 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:36:45.295325    2563 scope.go:117] "RemoveContainer" containerID="5a0b734d4fbc364b745e18d5f778e912b8c99b8f47256b6c6ffaefdfc934054d"
Jul 13 19:36:45.295678 ip-10-0-135-38 kubenswrapper[2563]: E0713 19:36:45.295653    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5a0b734d4fbc364b745e18d5f778e912b8c99b8f47256b6c6ffaefdfc934054d\": container with ID starting with 5a0b734d4fbc364b745e18d5f778e912b8c99b8f47256b6c6ffaefdfc934054d not found: ID does not exist" containerID="5a0b734d4fbc364b745e18d5f778e912b8c99b8f47256b6c6ffaefdfc934054d"
Jul 13 19:36:45.295761 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:36:45.295688    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5a0b734d4fbc364b745e18d5f778e912b8c99b8f47256b6c6ffaefdfc934054d"} err="failed to get container status \"5a0b734d4fbc364b745e18d5f778e912b8c99b8f47256b6c6ffaefdfc934054d\": rpc error: code = NotFound desc = could not find container \"5a0b734d4fbc364b745e18d5f778e912b8c99b8f47256b6c6ffaefdfc934054d\": container with ID starting with 5a0b734d4fbc364b745e18d5f778e912b8c99b8f47256b6c6ffaefdfc934054d not found: ID does not exist"
Jul 13 19:36:45.297099 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:36:45.297078    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-868895-openshift-default-8598b649ff-n6qbx"]
Jul 13 19:36:46.756713 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:36:46.756674    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0864c894-19c8-4073-ab92-2b33ca5bb20d" path="/var/lib/kubelet/pods/0864c894-19c8-4073-ab92-2b33ca5bb20d/volumes"
Jul 13 19:37:05.366627 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:37:05.366582    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-f2d389-openshift-default-5fb684d7cc-492ld"]
Jul 13 19:37:05.367188 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:37:05.366817    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-f2d389-openshift-default-5fb684d7cc-492ld" podUID="c0ee89bc-23f4-41af-be6f-326becf7fdcc" containerName="istio-proxy" containerID="cri-o://5c92fdcf3dadd34d7389dd1694934794f705ac31fe06b80285f4b276cc6528f9" gracePeriod=30
Jul 13 19:37:06.298112 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:37:06.298070    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-196ed1-openshift-default-7ddd7d66b7-tkdq7"]
Jul 13 19:37:06.298515 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:37:06.298499    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0864c894-19c8-4073-ab92-2b33ca5bb20d" containerName="istio-proxy"
Jul 13 19:37:06.298593 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:37:06.298516    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="0864c894-19c8-4073-ab92-2b33ca5bb20d" containerName="istio-proxy"
Jul 13 19:37:06.298633 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:37:06.298588    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f8ad0415-198a-4ff9-bf8d-a91c6e7929eb" containerName="istio-proxy"
Jul 13 19:37:06.298633 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:37:06.298602    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="f8ad0415-198a-4ff9-bf8d-a91c6e7929eb" containerName="istio-proxy"
Jul 13 19:37:06.298727 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:37:06.298717    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="0864c894-19c8-4073-ab92-2b33ca5bb20d" containerName="istio-proxy"
Jul 13 19:37:06.301180 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:37:06.301151    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-196ed1-openshift-default-7ddd7d66b7-tkdq7"
Jul 13 19:37:06.303459 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:37:06.303432    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-196ed1-openshift-default-dockercfg-rlh2g\""
Jul 13 19:37:06.313379 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:37:06.313346    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-196ed1-openshift-default-7ddd7d66b7-tkdq7"]
Jul 13 19:37:06.420437 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:37:06.420390    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e19906f3-7342-4f6f-bb79-f32dc0e39e74-workload-socket\") pod \"e2e-shared-a-196ed1-openshift-default-7ddd7d66b7-tkdq7\" (UID: \"e19906f3-7342-4f6f-bb79-f32dc0e39e74\") " pod="openshift-ingress/e2e-shared-a-196ed1-openshift-default-7ddd7d66b7-tkdq7"
Jul 13 19:37:06.420437 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:37:06.420440    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e19906f3-7342-4f6f-bb79-f32dc0e39e74-istio-envoy\") pod \"e2e-shared-a-196ed1-openshift-default-7ddd7d66b7-tkdq7\" (UID: \"e19906f3-7342-4f6f-bb79-f32dc0e39e74\") " pod="openshift-ingress/e2e-shared-a-196ed1-openshift-default-7ddd7d66b7-tkdq7"
Jul 13 19:37:06.420893 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:37:06.420506    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e19906f3-7342-4f6f-bb79-f32dc0e39e74-istiod-ca-cert\") pod \"e2e-shared-a-196ed1-openshift-default-7ddd7d66b7-tkdq7\" (UID: \"e19906f3-7342-4f6f-bb79-f32dc0e39e74\") " pod="openshift-ingress/e2e-shared-a-196ed1-openshift-default-7ddd7d66b7-tkdq7"
Jul 13 19:37:06.420893 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:37:06.420552    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e19906f3-7342-4f6f-bb79-f32dc0e39e74-istio-podinfo\") pod \"e2e-shared-a-196ed1-openshift-default-7ddd7d66b7-tkdq7\" (UID: \"e19906f3-7342-4f6f-bb79-f32dc0e39e74\") " pod="openshift-ingress/e2e-shared-a-196ed1-openshift-default-7ddd7d66b7-tkdq7"
Jul 13 19:37:06.420893 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:37:06.420614    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e19906f3-7342-4f6f-bb79-f32dc0e39e74-istio-data\") pod \"e2e-shared-a-196ed1-openshift-default-7ddd7d66b7-tkdq7\" (UID: \"e19906f3-7342-4f6f-bb79-f32dc0e39e74\") " pod="openshift-ingress/e2e-shared-a-196ed1-openshift-default-7ddd7d66b7-tkdq7"
Jul 13 19:37:06.420893 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:37:06.420634    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e19906f3-7342-4f6f-bb79-f32dc0e39e74-istio-token\") pod \"e2e-shared-a-196ed1-openshift-default-7ddd7d66b7-tkdq7\" (UID: \"e19906f3-7342-4f6f-bb79-f32dc0e39e74\") " pod="openshift-ingress/e2e-shared-a-196ed1-openshift-default-7ddd7d66b7-tkdq7"
Jul 13 19:37:06.420893 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:37:06.420651    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e19906f3-7342-4f6f-bb79-f32dc0e39e74-credential-socket\") pod \"e2e-shared-a-196ed1-openshift-default-7ddd7d66b7-tkdq7\" (UID: \"e19906f3-7342-4f6f-bb79-f32dc0e39e74\") " pod="openshift-ingress/e2e-shared-a-196ed1-openshift-default-7ddd7d66b7-tkdq7"
Jul 13 19:37:06.420893 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:37:06.420675    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lh8w4\" (UniqueName: \"kubernetes.io/projected/e19906f3-7342-4f6f-bb79-f32dc0e39e74-kube-api-access-lh8w4\") pod \"e2e-shared-a-196ed1-openshift-default-7ddd7d66b7-tkdq7\" (UID: \"e19906f3-7342-4f6f-bb79-f32dc0e39e74\") " pod="openshift-ingress/e2e-shared-a-196ed1-openshift-default-7ddd7d66b7-tkdq7"
Jul 13 19:37:06.420893 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:37:06.420733    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e19906f3-7342-4f6f-bb79-f32dc0e39e74-workload-certs\") pod \"e2e-shared-a-196ed1-openshift-default-7ddd7d66b7-tkdq7\" (UID: \"e19906f3-7342-4f6f-bb79-f32dc0e39e74\") " pod="openshift-ingress/e2e-shared-a-196ed1-openshift-default-7ddd7d66b7-tkdq7"
Jul 13 19:37:06.521676 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:37:06.521627    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e19906f3-7342-4f6f-bb79-f32dc0e39e74-istio-data\") pod \"e2e-shared-a-196ed1-openshift-default-7ddd7d66b7-tkdq7\" (UID: \"e19906f3-7342-4f6f-bb79-f32dc0e39e74\") " pod="openshift-ingress/e2e-shared-a-196ed1-openshift-default-7ddd7d66b7-tkdq7"
Jul 13 19:37:06.521676 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:37:06.521676    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e19906f3-7342-4f6f-bb79-f32dc0e39e74-istio-token\") pod \"e2e-shared-a-196ed1-openshift-default-7ddd7d66b7-tkdq7\" (UID: \"e19906f3-7342-4f6f-bb79-f32dc0e39e74\") " pod="openshift-ingress/e2e-shared-a-196ed1-openshift-default-7ddd7d66b7-tkdq7"
Jul 13 19:37:06.521977 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:37:06.521706    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e19906f3-7342-4f6f-bb79-f32dc0e39e74-credential-socket\") pod \"e2e-shared-a-196ed1-openshift-default-7ddd7d66b7-tkdq7\" (UID: \"e19906f3-7342-4f6f-bb79-f32dc0e39e74\") " pod="openshift-ingress/e2e-shared-a-196ed1-openshift-default-7ddd7d66b7-tkdq7"
Jul 13 19:37:06.521977 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:37:06.521732    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lh8w4\" (UniqueName: \"kubernetes.io/projected/e19906f3-7342-4f6f-bb79-f32dc0e39e74-kube-api-access-lh8w4\") pod \"e2e-shared-a-196ed1-openshift-default-7ddd7d66b7-tkdq7\" (UID: \"e19906f3-7342-4f6f-bb79-f32dc0e39e74\") " pod="openshift-ingress/e2e-shared-a-196ed1-openshift-default-7ddd7d66b7-tkdq7"
Jul 13 19:37:06.521977 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:37:06.521783    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e19906f3-7342-4f6f-bb79-f32dc0e39e74-workload-certs\") pod \"e2e-shared-a-196ed1-openshift-default-7ddd7d66b7-tkdq7\" (UID: \"e19906f3-7342-4f6f-bb79-f32dc0e39e74\") " pod="openshift-ingress/e2e-shared-a-196ed1-openshift-default-7ddd7d66b7-tkdq7"
Jul 13 19:37:06.521977 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:37:06.521841    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e19906f3-7342-4f6f-bb79-f32dc0e39e74-workload-socket\") pod \"e2e-shared-a-196ed1-openshift-default-7ddd7d66b7-tkdq7\" (UID: \"e19906f3-7342-4f6f-bb79-f32dc0e39e74\") " pod="openshift-ingress/e2e-shared-a-196ed1-openshift-default-7ddd7d66b7-tkdq7"
Jul 13 19:37:06.521977 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:37:06.521865    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e19906f3-7342-4f6f-bb79-f32dc0e39e74-istio-envoy\") pod \"e2e-shared-a-196ed1-openshift-default-7ddd7d66b7-tkdq7\" (UID: \"e19906f3-7342-4f6f-bb79-f32dc0e39e74\") " pod="openshift-ingress/e2e-shared-a-196ed1-openshift-default-7ddd7d66b7-tkdq7"
Jul 13 19:37:06.521977 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:37:06.521908    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e19906f3-7342-4f6f-bb79-f32dc0e39e74-istiod-ca-cert\") pod \"e2e-shared-a-196ed1-openshift-default-7ddd7d66b7-tkdq7\" (UID: \"e19906f3-7342-4f6f-bb79-f32dc0e39e74\") " pod="openshift-ingress/e2e-shared-a-196ed1-openshift-default-7ddd7d66b7-tkdq7"
Jul 13 19:37:06.521977 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:37:06.521945    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e19906f3-7342-4f6f-bb79-f32dc0e39e74-istio-podinfo\") pod \"e2e-shared-a-196ed1-openshift-default-7ddd7d66b7-tkdq7\" (UID: \"e19906f3-7342-4f6f-bb79-f32dc0e39e74\") " pod="openshift-ingress/e2e-shared-a-196ed1-openshift-default-7ddd7d66b7-tkdq7"
Jul 13 19:37:06.522424 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:37:06.522156    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e19906f3-7342-4f6f-bb79-f32dc0e39e74-istio-data\") pod \"e2e-shared-a-196ed1-openshift-default-7ddd7d66b7-tkdq7\" (UID: \"e19906f3-7342-4f6f-bb79-f32dc0e39e74\") " pod="openshift-ingress/e2e-shared-a-196ed1-openshift-default-7ddd7d66b7-tkdq7"
Jul 13 19:37:06.522424 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:37:06.522195    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e19906f3-7342-4f6f-bb79-f32dc0e39e74-credential-socket\") pod \"e2e-shared-a-196ed1-openshift-default-7ddd7d66b7-tkdq7\" (UID: \"e19906f3-7342-4f6f-bb79-f32dc0e39e74\") " pod="openshift-ingress/e2e-shared-a-196ed1-openshift-default-7ddd7d66b7-tkdq7"
Jul 13 19:37:06.522424 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:37:06.522319    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e19906f3-7342-4f6f-bb79-f32dc0e39e74-workload-certs\") pod \"e2e-shared-a-196ed1-openshift-default-7ddd7d66b7-tkdq7\" (UID: \"e19906f3-7342-4f6f-bb79-f32dc0e39e74\") " pod="openshift-ingress/e2e-shared-a-196ed1-openshift-default-7ddd7d66b7-tkdq7"
Jul 13 19:37:06.522572 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:37:06.522462    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e19906f3-7342-4f6f-bb79-f32dc0e39e74-workload-socket\") pod \"e2e-shared-a-196ed1-openshift-default-7ddd7d66b7-tkdq7\" (UID: \"e19906f3-7342-4f6f-bb79-f32dc0e39e74\") " pod="openshift-ingress/e2e-shared-a-196ed1-openshift-default-7ddd7d66b7-tkdq7"
Jul 13 19:37:06.522666 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:37:06.522645    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e19906f3-7342-4f6f-bb79-f32dc0e39e74-istiod-ca-cert\") pod \"e2e-shared-a-196ed1-openshift-default-7ddd7d66b7-tkdq7\" (UID: \"e19906f3-7342-4f6f-bb79-f32dc0e39e74\") " pod="openshift-ingress/e2e-shared-a-196ed1-openshift-default-7ddd7d66b7-tkdq7"
Jul 13 19:37:06.524429 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:37:06.524404    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e19906f3-7342-4f6f-bb79-f32dc0e39e74-istio-envoy\") pod \"e2e-shared-a-196ed1-openshift-default-7ddd7d66b7-tkdq7\" (UID: \"e19906f3-7342-4f6f-bb79-f32dc0e39e74\") " pod="openshift-ingress/e2e-shared-a-196ed1-openshift-default-7ddd7d66b7-tkdq7"
Jul 13 19:37:06.524690 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:37:06.524671    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e19906f3-7342-4f6f-bb79-f32dc0e39e74-istio-podinfo\") pod \"e2e-shared-a-196ed1-openshift-default-7ddd7d66b7-tkdq7\" (UID: \"e19906f3-7342-4f6f-bb79-f32dc0e39e74\") " pod="openshift-ingress/e2e-shared-a-196ed1-openshift-default-7ddd7d66b7-tkdq7"
Jul 13 19:37:06.529495 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:37:06.529469    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e19906f3-7342-4f6f-bb79-f32dc0e39e74-istio-token\") pod \"e2e-shared-a-196ed1-openshift-default-7ddd7d66b7-tkdq7\" (UID: \"e19906f3-7342-4f6f-bb79-f32dc0e39e74\") " pod="openshift-ingress/e2e-shared-a-196ed1-openshift-default-7ddd7d66b7-tkdq7"
Jul 13 19:37:06.529617 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:37:06.529545    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lh8w4\" (UniqueName: \"kubernetes.io/projected/e19906f3-7342-4f6f-bb79-f32dc0e39e74-kube-api-access-lh8w4\") pod \"e2e-shared-a-196ed1-openshift-default-7ddd7d66b7-tkdq7\" (UID: \"e19906f3-7342-4f6f-bb79-f32dc0e39e74\") " pod="openshift-ingress/e2e-shared-a-196ed1-openshift-default-7ddd7d66b7-tkdq7"
Jul 13 19:37:06.613079 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:37:06.612991    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-196ed1-openshift-default-7ddd7d66b7-tkdq7"
Jul 13 19:37:06.760126 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:37:06.760091    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-196ed1-openshift-default-7ddd7d66b7-tkdq7"]
Jul 13 19:37:06.761823 ip-10-0-135-38 kubenswrapper[2563]: W0713 19:37:06.761786    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode19906f3_7342_4f6f_bb79_f32dc0e39e74.slice/crio-7ab8184243514d7bbbe0645597d2ac5d3848e09380d878b73d4b44b98acdcfbb WatchSource:0}: Error finding container 7ab8184243514d7bbbe0645597d2ac5d3848e09380d878b73d4b44b98acdcfbb: Status 404 returned error can't find the container with id 7ab8184243514d7bbbe0645597d2ac5d3848e09380d878b73d4b44b98acdcfbb
Jul 13 19:37:06.764565 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:37:06.764526    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 13 19:37:06.764639 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:37:06.764611    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 13 19:37:06.764681 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:37:06.764646    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 13 19:37:07.394336 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:37:07.394295    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-196ed1-openshift-default-7ddd7d66b7-tkdq7" event={"ID":"e19906f3-7342-4f6f-bb79-f32dc0e39e74","Type":"ContainerStarted","Data":"f4630b13b6ef3348d04f46e1b9685518196e936f67c1efce608d9d460793b6ec"}
Jul 13 19:37:07.394545 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:37:07.394362    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-196ed1-openshift-default-7ddd7d66b7-tkdq7" event={"ID":"e19906f3-7342-4f6f-bb79-f32dc0e39e74","Type":"ContainerStarted","Data":"7ab8184243514d7bbbe0645597d2ac5d3848e09380d878b73d4b44b98acdcfbb"}
Jul 13 19:37:07.417878 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:37:07.417820    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-196ed1-openshift-default-7ddd7d66b7-tkdq7" podStartSLOduration=1.41780017 podStartE2EDuration="1.41780017s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 19:37:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 19:37:07.41254326 +0000 UTC m=+2315.187419616" watchObservedRunningTime="2026-07-13 19:37:07.41780017 +0000 UTC m=+2315.192676595"
Jul 13 19:37:07.613540 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:37:07.613494    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-196ed1-openshift-default-7ddd7d66b7-tkdq7"
Jul 13 19:37:07.618983 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:37:07.618956    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-196ed1-openshift-default-7ddd7d66b7-tkdq7"
Jul 13 19:37:08.400482 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:37:08.400442    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-196ed1-openshift-default-7ddd7d66b7-tkdq7"
Jul 13 19:37:08.401425 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:37:08.401398    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-196ed1-openshift-default-7ddd7d66b7-tkdq7"
Jul 13 19:37:10.617422 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:37:10.617392    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-f2d389-openshift-default-5fb684d7cc-492ld"
Jul 13 19:37:10.658575 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:37:10.658484    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c0ee89bc-23f4-41af-be6f-326becf7fdcc-istio-token\") pod \"c0ee89bc-23f4-41af-be6f-326becf7fdcc\" (UID: \"c0ee89bc-23f4-41af-be6f-326becf7fdcc\") "
Jul 13 19:37:10.658575 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:37:10.658527    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c0ee89bc-23f4-41af-be6f-326becf7fdcc-workload-certs\") pod \"c0ee89bc-23f4-41af-be6f-326becf7fdcc\" (UID: \"c0ee89bc-23f4-41af-be6f-326becf7fdcc\") "
Jul 13 19:37:10.658575 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:37:10.658550    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t66z7\" (UniqueName: \"kubernetes.io/projected/c0ee89bc-23f4-41af-be6f-326becf7fdcc-kube-api-access-t66z7\") pod \"c0ee89bc-23f4-41af-be6f-326becf7fdcc\" (UID: \"c0ee89bc-23f4-41af-be6f-326becf7fdcc\") "
Jul 13 19:37:10.658836 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:37:10.658589    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c0ee89bc-23f4-41af-be6f-326becf7fdcc-istio-envoy\") pod \"c0ee89bc-23f4-41af-be6f-326becf7fdcc\" (UID: \"c0ee89bc-23f4-41af-be6f-326becf7fdcc\") "
Jul 13 19:37:10.658836 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:37:10.658756    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c0ee89bc-23f4-41af-be6f-326becf7fdcc-istiod-ca-cert\") pod \"c0ee89bc-23f4-41af-be6f-326becf7fdcc\" (UID: \"c0ee89bc-23f4-41af-be6f-326becf7fdcc\") "
Jul 13 19:37:10.658836 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:37:10.658830    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c0ee89bc-23f4-41af-be6f-326becf7fdcc-istio-podinfo\") pod \"c0ee89bc-23f4-41af-be6f-326becf7fdcc\" (UID: \"c0ee89bc-23f4-41af-be6f-326becf7fdcc\") "
Jul 13 19:37:10.659053 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:37:10.658874    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c0ee89bc-23f4-41af-be6f-326becf7fdcc-istio-data\") pod \"c0ee89bc-23f4-41af-be6f-326becf7fdcc\" (UID: \"c0ee89bc-23f4-41af-be6f-326becf7fdcc\") "
Jul 13 19:37:10.659053 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:37:10.658931    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c0ee89bc-23f4-41af-be6f-326becf7fdcc-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "c0ee89bc-23f4-41af-be6f-326becf7fdcc" (UID: "c0ee89bc-23f4-41af-be6f-326becf7fdcc"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 19:37:10.659244 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:37:10.659173    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c0ee89bc-23f4-41af-be6f-326becf7fdcc-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "c0ee89bc-23f4-41af-be6f-326becf7fdcc" (UID: "c0ee89bc-23f4-41af-be6f-326becf7fdcc"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 19:37:10.659400 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:37:10.659319    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c0ee89bc-23f4-41af-be6f-326becf7fdcc-credential-socket\") pod \"c0ee89bc-23f4-41af-be6f-326becf7fdcc\" (UID: \"c0ee89bc-23f4-41af-be6f-326becf7fdcc\") "
Jul 13 19:37:10.659400 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:37:10.659363    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c0ee89bc-23f4-41af-be6f-326becf7fdcc-workload-socket\") pod \"c0ee89bc-23f4-41af-be6f-326becf7fdcc\" (UID: \"c0ee89bc-23f4-41af-be6f-326becf7fdcc\") "
Jul 13 19:37:10.659793 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:37:10.659733    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c0ee89bc-23f4-41af-be6f-326becf7fdcc-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "c0ee89bc-23f4-41af-be6f-326becf7fdcc" (UID: "c0ee89bc-23f4-41af-be6f-326becf7fdcc"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 19:37:10.659879 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:37:10.659839    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c0ee89bc-23f4-41af-be6f-326becf7fdcc-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "c0ee89bc-23f4-41af-be6f-326becf7fdcc" (UID: "c0ee89bc-23f4-41af-be6f-326becf7fdcc"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 19:37:10.659879 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:37:10.659853    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c0ee89bc-23f4-41af-be6f-326becf7fdcc-istio-data" (OuterVolumeSpecName: "istio-data") pod "c0ee89bc-23f4-41af-be6f-326becf7fdcc" (UID: "c0ee89bc-23f4-41af-be6f-326becf7fdcc"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 19:37:10.660173 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:37:10.660151    2563 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c0ee89bc-23f4-41af-be6f-326becf7fdcc-istio-data\") on node \"ip-10-0-135-38.ec2.internal\" DevicePath \"\""
Jul 13 19:37:10.660261 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:37:10.660179    2563 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c0ee89bc-23f4-41af-be6f-326becf7fdcc-credential-socket\") on node \"ip-10-0-135-38.ec2.internal\" DevicePath \"\""
Jul 13 19:37:10.660261 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:37:10.660193    2563 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c0ee89bc-23f4-41af-be6f-326becf7fdcc-workload-socket\") on node \"ip-10-0-135-38.ec2.internal\" DevicePath \"\""
Jul 13 19:37:10.660261 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:37:10.660209    2563 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c0ee89bc-23f4-41af-be6f-326becf7fdcc-workload-certs\") on node \"ip-10-0-135-38.ec2.internal\" DevicePath \"\""
Jul 13 19:37:10.660261 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:37:10.660223    2563 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c0ee89bc-23f4-41af-be6f-326becf7fdcc-istiod-ca-cert\") on node \"ip-10-0-135-38.ec2.internal\" DevicePath \"\""
Jul 13 19:37:10.661090 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:37:10.661059    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c0ee89bc-23f4-41af-be6f-326becf7fdcc-istio-token" (OuterVolumeSpecName: "istio-token") pod "c0ee89bc-23f4-41af-be6f-326becf7fdcc" (UID: "c0ee89bc-23f4-41af-be6f-326becf7fdcc"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 19:37:10.661311 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:37:10.661287    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c0ee89bc-23f4-41af-be6f-326becf7fdcc-kube-api-access-t66z7" (OuterVolumeSpecName: "kube-api-access-t66z7") pod "c0ee89bc-23f4-41af-be6f-326becf7fdcc" (UID: "c0ee89bc-23f4-41af-be6f-326becf7fdcc"). InnerVolumeSpecName "kube-api-access-t66z7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 19:37:10.661455 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:37:10.661433    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/c0ee89bc-23f4-41af-be6f-326becf7fdcc-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "c0ee89bc-23f4-41af-be6f-326becf7fdcc" (UID: "c0ee89bc-23f4-41af-be6f-326becf7fdcc"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 13 19:37:10.661501 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:37:10.661440    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c0ee89bc-23f4-41af-be6f-326becf7fdcc-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "c0ee89bc-23f4-41af-be6f-326becf7fdcc" (UID: "c0ee89bc-23f4-41af-be6f-326becf7fdcc"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 19:37:10.760844 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:37:10.760807    2563 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c0ee89bc-23f4-41af-be6f-326becf7fdcc-istio-token\") on node \"ip-10-0-135-38.ec2.internal\" DevicePath \"\""
Jul 13 19:37:10.760844 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:37:10.760836    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t66z7\" (UniqueName: \"kubernetes.io/projected/c0ee89bc-23f4-41af-be6f-326becf7fdcc-kube-api-access-t66z7\") on node \"ip-10-0-135-38.ec2.internal\" DevicePath \"\""
Jul 13 19:37:10.760844 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:37:10.760846    2563 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c0ee89bc-23f4-41af-be6f-326becf7fdcc-istio-envoy\") on node \"ip-10-0-135-38.ec2.internal\" DevicePath \"\""
Jul 13 19:37:10.760844 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:37:10.760855    2563 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c0ee89bc-23f4-41af-be6f-326becf7fdcc-istio-podinfo\") on node \"ip-10-0-135-38.ec2.internal\" DevicePath \"\""
Jul 13 19:37:11.422563 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:37:11.422527    2563 generic.go:356] "Generic (PLEG): container finished" podID="c0ee89bc-23f4-41af-be6f-326becf7fdcc" containerID="5c92fdcf3dadd34d7389dd1694934794f705ac31fe06b80285f4b276cc6528f9" exitCode=0
Jul 13 19:37:11.422733 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:37:11.422599    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-f2d389-openshift-default-5fb684d7cc-492ld"
Jul 13 19:37:11.422733 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:37:11.422607    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-f2d389-openshift-default-5fb684d7cc-492ld" event={"ID":"c0ee89bc-23f4-41af-be6f-326becf7fdcc","Type":"ContainerDied","Data":"5c92fdcf3dadd34d7389dd1694934794f705ac31fe06b80285f4b276cc6528f9"}
Jul 13 19:37:11.422733 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:37:11.422666    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-f2d389-openshift-default-5fb684d7cc-492ld" event={"ID":"c0ee89bc-23f4-41af-be6f-326becf7fdcc","Type":"ContainerDied","Data":"308d2780ff61bfb9e4c014556618cfd1d2523c9da49be8dd4d73f8df350119c3"}
Jul 13 19:37:11.422733 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:37:11.422689    2563 scope.go:117] "RemoveContainer" containerID="5c92fdcf3dadd34d7389dd1694934794f705ac31fe06b80285f4b276cc6528f9"
Jul 13 19:37:11.432438 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:37:11.432410    2563 scope.go:117] "RemoveContainer" containerID="19644005e134ee88cd9055db19a6b9ee297027b6134f78b3334968e65cd9b355"
Jul 13 19:37:11.441552 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:37:11.441517    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-f2d389-openshift-default-5fb684d7cc-492ld"]
Jul 13 19:37:11.442824 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:37:11.442792    2563 scope.go:117] "RemoveContainer" containerID="5c92fdcf3dadd34d7389dd1694934794f705ac31fe06b80285f4b276cc6528f9"
Jul 13 19:37:11.443244 ip-10-0-135-38 kubenswrapper[2563]: E0713 19:37:11.443216    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5c92fdcf3dadd34d7389dd1694934794f705ac31fe06b80285f4b276cc6528f9\": container with ID starting with 5c92fdcf3dadd34d7389dd1694934794f705ac31fe06b80285f4b276cc6528f9 not found: ID does not exist" containerID="5c92fdcf3dadd34d7389dd1694934794f705ac31fe06b80285f4b276cc6528f9"
Jul 13 19:37:11.443333 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:37:11.443259    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5c92fdcf3dadd34d7389dd1694934794f705ac31fe06b80285f4b276cc6528f9"} err="failed to get container status \"5c92fdcf3dadd34d7389dd1694934794f705ac31fe06b80285f4b276cc6528f9\": rpc error: code = NotFound desc = could not find container \"5c92fdcf3dadd34d7389dd1694934794f705ac31fe06b80285f4b276cc6528f9\": container with ID starting with 5c92fdcf3dadd34d7389dd1694934794f705ac31fe06b80285f4b276cc6528f9 not found: ID does not exist"
Jul 13 19:37:11.443333 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:37:11.443286    2563 scope.go:117] "RemoveContainer" containerID="19644005e134ee88cd9055db19a6b9ee297027b6134f78b3334968e65cd9b355"
Jul 13 19:37:11.443609 ip-10-0-135-38 kubenswrapper[2563]: E0713 19:37:11.443587    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"19644005e134ee88cd9055db19a6b9ee297027b6134f78b3334968e65cd9b355\": container with ID starting with 19644005e134ee88cd9055db19a6b9ee297027b6134f78b3334968e65cd9b355 not found: ID does not exist" containerID="19644005e134ee88cd9055db19a6b9ee297027b6134f78b3334968e65cd9b355"
Jul 13 19:37:11.443686 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:37:11.443619    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"19644005e134ee88cd9055db19a6b9ee297027b6134f78b3334968e65cd9b355"} err="failed to get container status \"19644005e134ee88cd9055db19a6b9ee297027b6134f78b3334968e65cd9b355\": rpc error: code = NotFound desc = could not find container \"19644005e134ee88cd9055db19a6b9ee297027b6134f78b3334968e65cd9b355\": container with ID starting with 19644005e134ee88cd9055db19a6b9ee297027b6134f78b3334968e65cd9b355 not found: ID does not exist"
Jul 13 19:37:11.444777 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:37:11.444757    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-f2d389-openshift-default-5fb684d7cc-492ld"]
Jul 13 19:37:12.756588 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:37:12.756548    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c0ee89bc-23f4-41af-be6f-326becf7fdcc" path="/var/lib/kubelet/pods/c0ee89bc-23f4-41af-be6f-326becf7fdcc/volumes"
Jul 13 19:37:14.490047 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:37:14.488701    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-2555bb-openshift-default-5c9fdf49b7-bfzmp"]
Jul 13 19:37:14.496184 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:37:14.495418    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0864c894-19c8-4073-ab92-2b33ca5bb20d" containerName="istio-proxy"
Jul 13 19:37:14.496184 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:37:14.495456    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="0864c894-19c8-4073-ab92-2b33ca5bb20d" containerName="istio-proxy"
Jul 13 19:37:14.496184 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:37:14.495486    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c0ee89bc-23f4-41af-be6f-326becf7fdcc" containerName="istio-proxy"
Jul 13 19:37:14.496184 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:37:14.495497    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="c0ee89bc-23f4-41af-be6f-326becf7fdcc" containerName="istio-proxy"
Jul 13 19:37:14.496184 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:37:14.495515    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c0ee89bc-23f4-41af-be6f-326becf7fdcc" containerName="istio-proxy"
Jul 13 19:37:14.496184 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:37:14.495525    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="c0ee89bc-23f4-41af-be6f-326becf7fdcc" containerName="istio-proxy"
Jul 13 19:37:14.496184 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:37:14.495630    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="c0ee89bc-23f4-41af-be6f-326becf7fdcc" containerName="istio-proxy"
Jul 13 19:37:14.496184 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:37:14.495643    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="c0ee89bc-23f4-41af-be6f-326becf7fdcc" containerName="istio-proxy"
Jul 13 19:37:14.496184 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:37:14.495654    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="0864c894-19c8-4073-ab92-2b33ca5bb20d" containerName="istio-proxy"
Jul 13 19:37:14.509708 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:37:14.509671    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-2555bb-openshift-default-5c9fdf49b7-bfzmp"]
Jul 13 19:37:14.510122 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:37:14.510054    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-2555bb-openshift-default-5c9fdf49b7-bfzmp"
Jul 13 19:37:14.513678 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:37:14.513649    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-2555bb-openshift-default-dockercfg-xfsfx\""
Jul 13 19:37:14.598637 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:37:14.598590    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c5919c33-b035-4613-968f-8d6b7ee239f4-istio-podinfo\") pod \"e2e-shared-b-2555bb-openshift-default-5c9fdf49b7-bfzmp\" (UID: \"c5919c33-b035-4613-968f-8d6b7ee239f4\") " pod="openshift-ingress/e2e-shared-b-2555bb-openshift-default-5c9fdf49b7-bfzmp"
Jul 13 19:37:14.598924 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:37:14.598904    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c5919c33-b035-4613-968f-8d6b7ee239f4-istiod-ca-cert\") pod \"e2e-shared-b-2555bb-openshift-default-5c9fdf49b7-bfzmp\" (UID: \"c5919c33-b035-4613-968f-8d6b7ee239f4\") " pod="openshift-ingress/e2e-shared-b-2555bb-openshift-default-5c9fdf49b7-bfzmp"
Jul 13 19:37:14.599085 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:37:14.599062    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c5919c33-b035-4613-968f-8d6b7ee239f4-workload-certs\") pod \"e2e-shared-b-2555bb-openshift-default-5c9fdf49b7-bfzmp\" (UID: \"c5919c33-b035-4613-968f-8d6b7ee239f4\") " pod="openshift-ingress/e2e-shared-b-2555bb-openshift-default-5c9fdf49b7-bfzmp"
Jul 13 19:37:14.599266 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:37:14.599247    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c5919c33-b035-4613-968f-8d6b7ee239f4-istio-token\") pod \"e2e-shared-b-2555bb-openshift-default-5c9fdf49b7-bfzmp\" (UID: \"c5919c33-b035-4613-968f-8d6b7ee239f4\") " pod="openshift-ingress/e2e-shared-b-2555bb-openshift-default-5c9fdf49b7-bfzmp"
Jul 13 19:37:14.599396 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:37:14.599381    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c5919c33-b035-4613-968f-8d6b7ee239f4-istio-data\") pod \"e2e-shared-b-2555bb-openshift-default-5c9fdf49b7-bfzmp\" (UID: \"c5919c33-b035-4613-968f-8d6b7ee239f4\") " pod="openshift-ingress/e2e-shared-b-2555bb-openshift-default-5c9fdf49b7-bfzmp"
Jul 13 19:37:14.599544 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:37:14.599524    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c5919c33-b035-4613-968f-8d6b7ee239f4-workload-socket\") pod \"e2e-shared-b-2555bb-openshift-default-5c9fdf49b7-bfzmp\" (UID: \"c5919c33-b035-4613-968f-8d6b7ee239f4\") " pod="openshift-ingress/e2e-shared-b-2555bb-openshift-default-5c9fdf49b7-bfzmp"
Jul 13 19:37:14.599689 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:37:14.599674    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c5919c33-b035-4613-968f-8d6b7ee239f4-credential-socket\") pod \"e2e-shared-b-2555bb-openshift-default-5c9fdf49b7-bfzmp\" (UID: \"c5919c33-b035-4613-968f-8d6b7ee239f4\") " pod="openshift-ingress/e2e-shared-b-2555bb-openshift-default-5c9fdf49b7-bfzmp"
Jul 13 19:37:14.599816 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:37:14.599801    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nmjgp\" (UniqueName: \"kubernetes.io/projected/c5919c33-b035-4613-968f-8d6b7ee239f4-kube-api-access-nmjgp\") pod \"e2e-shared-b-2555bb-openshift-default-5c9fdf49b7-bfzmp\" (UID: \"c5919c33-b035-4613-968f-8d6b7ee239f4\") " pod="openshift-ingress/e2e-shared-b-2555bb-openshift-default-5c9fdf49b7-bfzmp"
Jul 13 19:37:14.599929 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:37:14.599915    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c5919c33-b035-4613-968f-8d6b7ee239f4-istio-envoy\") pod \"e2e-shared-b-2555bb-openshift-default-5c9fdf49b7-bfzmp\" (UID: \"c5919c33-b035-4613-968f-8d6b7ee239f4\") " pod="openshift-ingress/e2e-shared-b-2555bb-openshift-default-5c9fdf49b7-bfzmp"
Jul 13 19:37:14.700925 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:37:14.700872    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c5919c33-b035-4613-968f-8d6b7ee239f4-istio-podinfo\") pod \"e2e-shared-b-2555bb-openshift-default-5c9fdf49b7-bfzmp\" (UID: \"c5919c33-b035-4613-968f-8d6b7ee239f4\") " pod="openshift-ingress/e2e-shared-b-2555bb-openshift-default-5c9fdf49b7-bfzmp"
Jul 13 19:37:14.700925 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:37:14.700934    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c5919c33-b035-4613-968f-8d6b7ee239f4-istiod-ca-cert\") pod \"e2e-shared-b-2555bb-openshift-default-5c9fdf49b7-bfzmp\" (UID: \"c5919c33-b035-4613-968f-8d6b7ee239f4\") " pod="openshift-ingress/e2e-shared-b-2555bb-openshift-default-5c9fdf49b7-bfzmp"
Jul 13 19:37:14.701234 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:37:14.700969    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c5919c33-b035-4613-968f-8d6b7ee239f4-workload-certs\") pod \"e2e-shared-b-2555bb-openshift-default-5c9fdf49b7-bfzmp\" (UID: \"c5919c33-b035-4613-968f-8d6b7ee239f4\") " pod="openshift-ingress/e2e-shared-b-2555bb-openshift-default-5c9fdf49b7-bfzmp"
Jul 13 19:37:14.701234 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:37:14.701003    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c5919c33-b035-4613-968f-8d6b7ee239f4-istio-token\") pod \"e2e-shared-b-2555bb-openshift-default-5c9fdf49b7-bfzmp\" (UID: \"c5919c33-b035-4613-968f-8d6b7ee239f4\") " pod="openshift-ingress/e2e-shared-b-2555bb-openshift-default-5c9fdf49b7-bfzmp"
Jul 13 19:37:14.701234 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:37:14.701062    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c5919c33-b035-4613-968f-8d6b7ee239f4-istio-data\") pod \"e2e-shared-b-2555bb-openshift-default-5c9fdf49b7-bfzmp\" (UID: \"c5919c33-b035-4613-968f-8d6b7ee239f4\") " pod="openshift-ingress/e2e-shared-b-2555bb-openshift-default-5c9fdf49b7-bfzmp"
Jul 13 19:37:14.701234 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:37:14.701117    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c5919c33-b035-4613-968f-8d6b7ee239f4-workload-socket\") pod \"e2e-shared-b-2555bb-openshift-default-5c9fdf49b7-bfzmp\" (UID: \"c5919c33-b035-4613-968f-8d6b7ee239f4\") " pod="openshift-ingress/e2e-shared-b-2555bb-openshift-default-5c9fdf49b7-bfzmp"
Jul 13 19:37:14.701234 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:37:14.701177    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c5919c33-b035-4613-968f-8d6b7ee239f4-credential-socket\") pod \"e2e-shared-b-2555bb-openshift-default-5c9fdf49b7-bfzmp\" (UID: \"c5919c33-b035-4613-968f-8d6b7ee239f4\") " pod="openshift-ingress/e2e-shared-b-2555bb-openshift-default-5c9fdf49b7-bfzmp"
Jul 13 19:37:14.701234 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:37:14.701213    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nmjgp\" (UniqueName: \"kubernetes.io/projected/c5919c33-b035-4613-968f-8d6b7ee239f4-kube-api-access-nmjgp\") pod \"e2e-shared-b-2555bb-openshift-default-5c9fdf49b7-bfzmp\" (UID: \"c5919c33-b035-4613-968f-8d6b7ee239f4\") " pod="openshift-ingress/e2e-shared-b-2555bb-openshift-default-5c9fdf49b7-bfzmp"
Jul 13 19:37:14.701575 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:37:14.701248    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c5919c33-b035-4613-968f-8d6b7ee239f4-istio-envoy\") pod \"e2e-shared-b-2555bb-openshift-default-5c9fdf49b7-bfzmp\" (UID: \"c5919c33-b035-4613-968f-8d6b7ee239f4\") " pod="openshift-ingress/e2e-shared-b-2555bb-openshift-default-5c9fdf49b7-bfzmp"
Jul 13 19:37:14.701797 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:37:14.701759    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c5919c33-b035-4613-968f-8d6b7ee239f4-istio-data\") pod \"e2e-shared-b-2555bb-openshift-default-5c9fdf49b7-bfzmp\" (UID: \"c5919c33-b035-4613-968f-8d6b7ee239f4\") " pod="openshift-ingress/e2e-shared-b-2555bb-openshift-default-5c9fdf49b7-bfzmp"
Jul 13 19:37:14.702360 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:37:14.702325    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c5919c33-b035-4613-968f-8d6b7ee239f4-workload-socket\") pod \"e2e-shared-b-2555bb-openshift-default-5c9fdf49b7-bfzmp\" (UID: \"c5919c33-b035-4613-968f-8d6b7ee239f4\") " pod="openshift-ingress/e2e-shared-b-2555bb-openshift-default-5c9fdf49b7-bfzmp"
Jul 13 19:37:14.702543 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:37:14.702515    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c5919c33-b035-4613-968f-8d6b7ee239f4-istiod-ca-cert\") pod \"e2e-shared-b-2555bb-openshift-default-5c9fdf49b7-bfzmp\" (UID: \"c5919c33-b035-4613-968f-8d6b7ee239f4\") " pod="openshift-ingress/e2e-shared-b-2555bb-openshift-default-5c9fdf49b7-bfzmp"
Jul 13 19:37:14.702642 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:37:14.702613    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c5919c33-b035-4613-968f-8d6b7ee239f4-credential-socket\") pod \"e2e-shared-b-2555bb-openshift-default-5c9fdf49b7-bfzmp\" (UID: \"c5919c33-b035-4613-968f-8d6b7ee239f4\") " pod="openshift-ingress/e2e-shared-b-2555bb-openshift-default-5c9fdf49b7-bfzmp"
Jul 13 19:37:14.702797 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:37:14.702773    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c5919c33-b035-4613-968f-8d6b7ee239f4-workload-certs\") pod \"e2e-shared-b-2555bb-openshift-default-5c9fdf49b7-bfzmp\" (UID: \"c5919c33-b035-4613-968f-8d6b7ee239f4\") " pod="openshift-ingress/e2e-shared-b-2555bb-openshift-default-5c9fdf49b7-bfzmp"
Jul 13 19:37:14.706042 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:37:14.705822    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c5919c33-b035-4613-968f-8d6b7ee239f4-istio-podinfo\") pod \"e2e-shared-b-2555bb-openshift-default-5c9fdf49b7-bfzmp\" (UID: \"c5919c33-b035-4613-968f-8d6b7ee239f4\") " pod="openshift-ingress/e2e-shared-b-2555bb-openshift-default-5c9fdf49b7-bfzmp"
Jul 13 19:37:14.710044 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:37:14.709781    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c5919c33-b035-4613-968f-8d6b7ee239f4-istio-envoy\") pod \"e2e-shared-b-2555bb-openshift-default-5c9fdf49b7-bfzmp\" (UID: \"c5919c33-b035-4613-968f-8d6b7ee239f4\") " pod="openshift-ingress/e2e-shared-b-2555bb-openshift-default-5c9fdf49b7-bfzmp"
Jul 13 19:37:14.713160 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:37:14.711593    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c5919c33-b035-4613-968f-8d6b7ee239f4-istio-token\") pod \"e2e-shared-b-2555bb-openshift-default-5c9fdf49b7-bfzmp\" (UID: \"c5919c33-b035-4613-968f-8d6b7ee239f4\") " pod="openshift-ingress/e2e-shared-b-2555bb-openshift-default-5c9fdf49b7-bfzmp"
Jul 13 19:37:14.715679 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:37:14.715645    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nmjgp\" (UniqueName: \"kubernetes.io/projected/c5919c33-b035-4613-968f-8d6b7ee239f4-kube-api-access-nmjgp\") pod \"e2e-shared-b-2555bb-openshift-default-5c9fdf49b7-bfzmp\" (UID: \"c5919c33-b035-4613-968f-8d6b7ee239f4\") " pod="openshift-ingress/e2e-shared-b-2555bb-openshift-default-5c9fdf49b7-bfzmp"
Jul 13 19:37:14.829504 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:37:14.829403    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-2555bb-openshift-default-5c9fdf49b7-bfzmp"
Jul 13 19:37:15.017265 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:37:15.017210    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-2555bb-openshift-default-5c9fdf49b7-bfzmp"]
Jul 13 19:37:15.021136 ip-10-0-135-38 kubenswrapper[2563]: W0713 19:37:15.021094    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc5919c33_b035_4613_968f_8d6b7ee239f4.slice/crio-0da3613acdebe5c4c7186906136e06836a0e4f744e7bef384a030cb21e7e1f34 WatchSource:0}: Error finding container 0da3613acdebe5c4c7186906136e06836a0e4f744e7bef384a030cb21e7e1f34: Status 404 returned error can't find the container with id 0da3613acdebe5c4c7186906136e06836a0e4f744e7bef384a030cb21e7e1f34
Jul 13 19:37:15.023665 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:37:15.023633    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 13 19:37:15.023760 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:37:15.023725    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 13 19:37:15.023760 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:37:15.023756    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 13 19:37:15.448508 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:37:15.448470    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-2555bb-openshift-default-5c9fdf49b7-bfzmp" event={"ID":"c5919c33-b035-4613-968f-8d6b7ee239f4","Type":"ContainerStarted","Data":"7948370a72da781917dda37558c410c9860fa2880ae39629d3c5c1158a7c34fc"}
Jul 13 19:37:15.448745 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:37:15.448519    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-2555bb-openshift-default-5c9fdf49b7-bfzmp" event={"ID":"c5919c33-b035-4613-968f-8d6b7ee239f4","Type":"ContainerStarted","Data":"0da3613acdebe5c4c7186906136e06836a0e4f744e7bef384a030cb21e7e1f34"}
Jul 13 19:37:15.829947 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:37:15.829838    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-2555bb-openshift-default-5c9fdf49b7-bfzmp"
Jul 13 19:37:16.835014 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:37:16.834982    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-2555bb-openshift-default-5c9fdf49b7-bfzmp"
Jul 13 19:37:16.856229 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:37:16.856174    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-2555bb-openshift-default-5c9fdf49b7-bfzmp" podStartSLOduration=2.856154725 podStartE2EDuration="2.856154725s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 19:37:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 19:37:15.496430064 +0000 UTC m=+2323.271306421" watchObservedRunningTime="2026-07-13 19:37:16.856154725 +0000 UTC m=+2324.631031080"
Jul 13 19:37:17.459461 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:37:17.459425    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-2555bb-openshift-default-5c9fdf49b7-bfzmp"
Jul 13 19:37:17.460678 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:37:17.460653    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-2555bb-openshift-default-5c9fdf49b7-bfzmp"
Jul 13 19:37:20.485121 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:37:20.479563    2563 generic.go:356] "Generic (PLEG): container finished" podID="e19906f3-7342-4f6f-bb79-f32dc0e39e74" containerID="f4630b13b6ef3348d04f46e1b9685518196e936f67c1efce608d9d460793b6ec" exitCode=0
Jul 13 19:37:20.485121 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:37:20.479799    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-196ed1-openshift-default-7ddd7d66b7-tkdq7" event={"ID":"e19906f3-7342-4f6f-bb79-f32dc0e39e74","Type":"ContainerDied","Data":"f4630b13b6ef3348d04f46e1b9685518196e936f67c1efce608d9d460793b6ec"}
Jul 13 19:37:20.485121 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:37:20.480470    2563 scope.go:117] "RemoveContainer" containerID="f4630b13b6ef3348d04f46e1b9685518196e936f67c1efce608d9d460793b6ec"
Jul 13 19:37:20.485121 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:37:20.484294    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 13 19:37:20.485121 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:37:20.484484    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 13 19:37:20.485121 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:37:20.484617    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 13 19:37:21.514806 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:37:21.514762    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-196ed1-openshift-default-7ddd7d66b7-tkdq7" event={"ID":"e19906f3-7342-4f6f-bb79-f32dc0e39e74","Type":"ContainerStarted","Data":"1456c777335fb3d8ab25ec6ac768622abb8b6cb8a8eac02e8f79c83d1bc41b02"}
Jul 13 19:37:21.614188 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:37:21.614137    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-196ed1-openshift-default-7ddd7d66b7-tkdq7"
Jul 13 19:37:21.615356 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:37:21.615327    2563 patch_prober.go:28] interesting pod/e2e-shared-a-196ed1-openshift-default-7ddd7d66b7-tkdq7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.69:15021/healthz/ready\": dial tcp 10.133.0.69:15021: connect: connection refused" start-of-body=
Jul 13 19:37:21.615498 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:37:21.615379    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-196ed1-openshift-default-7ddd7d66b7-tkdq7" podUID="e19906f3-7342-4f6f-bb79-f32dc0e39e74" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.69:15021/healthz/ready\": dial tcp 10.133.0.69:15021: connect: connection refused"
Jul 13 19:37:22.614379 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:37:22.614338    2563 patch_prober.go:28] interesting pod/e2e-shared-a-196ed1-openshift-default-7ddd7d66b7-tkdq7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.69:15021/healthz/ready\": dial tcp 10.133.0.69:15021: connect: connection refused" start-of-body=
Jul 13 19:37:22.615064 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:37:22.614991    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-196ed1-openshift-default-7ddd7d66b7-tkdq7" podUID="e19906f3-7342-4f6f-bb79-f32dc0e39e74" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.69:15021/healthz/ready\": dial tcp 10.133.0.69:15021: connect: connection refused"
Jul 13 19:37:23.400920 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:37:23.400873    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-196ed1-openshift-default-7ddd7d66b7-tkdq7"
Jul 13 19:37:23.614086 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:37:23.614053    2563 patch_prober.go:28] interesting pod/e2e-shared-a-196ed1-openshift-default-7ddd7d66b7-tkdq7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.69:15021/healthz/ready\": dial tcp 10.133.0.69:15021: connect: connection refused" start-of-body=
Jul 13 19:37:23.614360 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:37:23.614336    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-196ed1-openshift-default-7ddd7d66b7-tkdq7" podUID="e19906f3-7342-4f6f-bb79-f32dc0e39e74" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.69:15021/healthz/ready\": dial tcp 10.133.0.69:15021: connect: connection refused"
Jul 13 19:37:24.613525 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:37:24.613428    2563 patch_prober.go:28] interesting pod/e2e-shared-a-196ed1-openshift-default-7ddd7d66b7-tkdq7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.69:15021/healthz/ready\": dial tcp 10.133.0.69:15021: connect: connection refused" start-of-body=
Jul 13 19:37:24.613525 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:37:24.613495    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-196ed1-openshift-default-7ddd7d66b7-tkdq7" podUID="e19906f3-7342-4f6f-bb79-f32dc0e39e74" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.69:15021/healthz/ready\": dial tcp 10.133.0.69:15021: connect: connection refused"
Jul 13 19:37:25.619816 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:37:25.619783    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-196ed1-openshift-default-7ddd7d66b7-tkdq7"
Jul 13 19:37:25.620857 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:37:25.620836    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-196ed1-openshift-default-7ddd7d66b7-tkdq7"
Jul 13 19:37:31.578499 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:37:31.578397    2563 generic.go:356] "Generic (PLEG): container finished" podID="c5919c33-b035-4613-968f-8d6b7ee239f4" containerID="7948370a72da781917dda37558c410c9860fa2880ae39629d3c5c1158a7c34fc" exitCode=0
Jul 13 19:37:31.578499 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:37:31.578470    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-2555bb-openshift-default-5c9fdf49b7-bfzmp" event={"ID":"c5919c33-b035-4613-968f-8d6b7ee239f4","Type":"ContainerDied","Data":"7948370a72da781917dda37558c410c9860fa2880ae39629d3c5c1158a7c34fc"}
Jul 13 19:37:31.578977 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:37:31.578961    2563 scope.go:117] "RemoveContainer" containerID="7948370a72da781917dda37558c410c9860fa2880ae39629d3c5c1158a7c34fc"
Jul 13 19:37:31.580232 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:37:31.580194    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 13 19:37:31.580313 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:37:31.580284    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 13 19:37:31.580352 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:37:31.580337    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 13 19:37:32.460105 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:37:32.460061    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-2555bb-openshift-default-5c9fdf49b7-bfzmp"
Jul 13 19:37:32.586038 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:37:32.585982    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-2555bb-openshift-default-5c9fdf49b7-bfzmp" event={"ID":"c5919c33-b035-4613-968f-8d6b7ee239f4","Type":"ContainerStarted","Data":"826dac51af66b93e65709b5c8d907029ddfe841b428c279e4f7d43ede2fd3d52"}
Jul 13 19:37:32.829990 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:37:32.829906    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-2555bb-openshift-default-5c9fdf49b7-bfzmp"
Jul 13 19:37:32.831224 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:37:32.831193    2563 patch_prober.go:28] interesting pod/e2e-shared-b-2555bb-openshift-default-5c9fdf49b7-bfzmp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused" start-of-body=
Jul 13 19:37:32.831387 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:37:32.831268    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-2555bb-openshift-default-5c9fdf49b7-bfzmp" podUID="c5919c33-b035-4613-968f-8d6b7ee239f4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused"
Jul 13 19:37:33.830188 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:37:33.830146    2563 patch_prober.go:28] interesting pod/e2e-shared-b-2555bb-openshift-default-5c9fdf49b7-bfzmp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused" start-of-body=
Jul 13 19:37:33.830600 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:37:33.830210    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-2555bb-openshift-default-5c9fdf49b7-bfzmp" podUID="c5919c33-b035-4613-968f-8d6b7ee239f4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused"
Jul 13 19:37:34.830796 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:37:34.830755    2563 patch_prober.go:28] interesting pod/e2e-shared-b-2555bb-openshift-default-5c9fdf49b7-bfzmp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused" start-of-body=
Jul 13 19:37:34.831335 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:37:34.830822    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-2555bb-openshift-default-5c9fdf49b7-bfzmp" podUID="c5919c33-b035-4613-968f-8d6b7ee239f4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused"
Jul 13 19:37:35.830097 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:37:35.830056    2563 patch_prober.go:28] interesting pod/e2e-shared-b-2555bb-openshift-default-5c9fdf49b7-bfzmp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused" start-of-body=
Jul 13 19:37:35.830331 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:37:35.830122    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-2555bb-openshift-default-5c9fdf49b7-bfzmp" podUID="c5919c33-b035-4613-968f-8d6b7ee239f4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused"
Jul 13 19:37:36.835181 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:37:36.835146    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-2555bb-openshift-default-5c9fdf49b7-bfzmp"
Jul 13 19:37:36.835650 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:37:36.835521    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-2555bb-openshift-default-5c9fdf49b7-bfzmp"
Jul 13 19:37:36.836196 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:37:36.836178    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-2555bb-openshift-default-5c9fdf49b7-bfzmp"
Jul 13 19:38:32.853538 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:38:32.853502    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hwqhc_7ae2e1d0-8a16-4821-9cb7-353862cfbec8/ovn-acl-logging/0.log"
Jul 13 19:38:32.860677 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:38:32.860651    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hwqhc_7ae2e1d0-8a16-4821-9cb7-353862cfbec8/ovn-acl-logging/0.log"
Jul 13 19:40:37.658441 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:40:37.658403    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-196ed1/sub-test-model-196ed1-kserve-9b46bcbc-6x97m"]
Jul 13 19:40:37.661272 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:40:37.661251    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-196ed1/sub-test-model-196ed1-kserve-9b46bcbc-6x97m"
Jul 13 19:40:37.663912 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:40:37.663890    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-196ed1\"/\"sub-test-model-196ed1-kserve-self-signed-certs\""
Jul 13 19:40:37.664666 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:40:37.664646    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-196ed1\"/\"kube-root-ca.crt\""
Jul 13 19:40:37.664804 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:40:37.664784    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-196ed1\"/\"default-dockercfg-x8ddf\""
Jul 13 19:40:37.664883 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:40:37.664859    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-196ed1\"/\"openshift-service-ca.crt\""
Jul 13 19:40:37.680392 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:40:37.680362    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-196ed1/sub-test-model-196ed1-kserve-9b46bcbc-6x97m"]
Jul 13 19:40:37.726079 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:40:37.726039    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/51d25d7e-dfe4-4fb6-9857-f2f8a888220c-dshm\") pod \"sub-test-model-196ed1-kserve-9b46bcbc-6x97m\" (UID: \"51d25d7e-dfe4-4fb6-9857-f2f8a888220c\") " pod="ai-tenant-e2e-shared-a-196ed1/sub-test-model-196ed1-kserve-9b46bcbc-6x97m"
Jul 13 19:40:37.726261 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:40:37.726124    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/51d25d7e-dfe4-4fb6-9857-f2f8a888220c-tmp-dir\") pod \"sub-test-model-196ed1-kserve-9b46bcbc-6x97m\" (UID: \"51d25d7e-dfe4-4fb6-9857-f2f8a888220c\") " pod="ai-tenant-e2e-shared-a-196ed1/sub-test-model-196ed1-kserve-9b46bcbc-6x97m"
Jul 13 19:40:37.726261 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:40:37.726147    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z5thp\" (UniqueName: \"kubernetes.io/projected/51d25d7e-dfe4-4fb6-9857-f2f8a888220c-kube-api-access-z5thp\") pod \"sub-test-model-196ed1-kserve-9b46bcbc-6x97m\" (UID: \"51d25d7e-dfe4-4fb6-9857-f2f8a888220c\") " pod="ai-tenant-e2e-shared-a-196ed1/sub-test-model-196ed1-kserve-9b46bcbc-6x97m"
Jul 13 19:40:37.726261 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:40:37.726201    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/51d25d7e-dfe4-4fb6-9857-f2f8a888220c-tls-certs\") pod \"sub-test-model-196ed1-kserve-9b46bcbc-6x97m\" (UID: \"51d25d7e-dfe4-4fb6-9857-f2f8a888220c\") " pod="ai-tenant-e2e-shared-a-196ed1/sub-test-model-196ed1-kserve-9b46bcbc-6x97m"
Jul 13 19:40:37.726261 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:40:37.726223    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/51d25d7e-dfe4-4fb6-9857-f2f8a888220c-home\") pod \"sub-test-model-196ed1-kserve-9b46bcbc-6x97m\" (UID: \"51d25d7e-dfe4-4fb6-9857-f2f8a888220c\") " pod="ai-tenant-e2e-shared-a-196ed1/sub-test-model-196ed1-kserve-9b46bcbc-6x97m"
Jul 13 19:40:37.726261 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:40:37.726246    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/51d25d7e-dfe4-4fb6-9857-f2f8a888220c-model-cache\") pod \"sub-test-model-196ed1-kserve-9b46bcbc-6x97m\" (UID: \"51d25d7e-dfe4-4fb6-9857-f2f8a888220c\") " pod="ai-tenant-e2e-shared-a-196ed1/sub-test-model-196ed1-kserve-9b46bcbc-6x97m"
Jul 13 19:40:37.827278 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:40:37.827235    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/51d25d7e-dfe4-4fb6-9857-f2f8a888220c-model-cache\") pod \"sub-test-model-196ed1-kserve-9b46bcbc-6x97m\" (UID: \"51d25d7e-dfe4-4fb6-9857-f2f8a888220c\") " pod="ai-tenant-e2e-shared-a-196ed1/sub-test-model-196ed1-kserve-9b46bcbc-6x97m"
Jul 13 19:40:37.827493 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:40:37.827327    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/51d25d7e-dfe4-4fb6-9857-f2f8a888220c-dshm\") pod \"sub-test-model-196ed1-kserve-9b46bcbc-6x97m\" (UID: \"51d25d7e-dfe4-4fb6-9857-f2f8a888220c\") " pod="ai-tenant-e2e-shared-a-196ed1/sub-test-model-196ed1-kserve-9b46bcbc-6x97m"
Jul 13 19:40:37.827493 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:40:37.827381    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/51d25d7e-dfe4-4fb6-9857-f2f8a888220c-tmp-dir\") pod \"sub-test-model-196ed1-kserve-9b46bcbc-6x97m\" (UID: \"51d25d7e-dfe4-4fb6-9857-f2f8a888220c\") " pod="ai-tenant-e2e-shared-a-196ed1/sub-test-model-196ed1-kserve-9b46bcbc-6x97m"
Jul 13 19:40:37.827493 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:40:37.827403    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z5thp\" (UniqueName: \"kubernetes.io/projected/51d25d7e-dfe4-4fb6-9857-f2f8a888220c-kube-api-access-z5thp\") pod \"sub-test-model-196ed1-kserve-9b46bcbc-6x97m\" (UID: \"51d25d7e-dfe4-4fb6-9857-f2f8a888220c\") " pod="ai-tenant-e2e-shared-a-196ed1/sub-test-model-196ed1-kserve-9b46bcbc-6x97m"
Jul 13 19:40:37.827493 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:40:37.827452    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/51d25d7e-dfe4-4fb6-9857-f2f8a888220c-tls-certs\") pod \"sub-test-model-196ed1-kserve-9b46bcbc-6x97m\" (UID: \"51d25d7e-dfe4-4fb6-9857-f2f8a888220c\") " pod="ai-tenant-e2e-shared-a-196ed1/sub-test-model-196ed1-kserve-9b46bcbc-6x97m"
Jul 13 19:40:37.827493 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:40:37.827479    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/51d25d7e-dfe4-4fb6-9857-f2f8a888220c-home\") pod \"sub-test-model-196ed1-kserve-9b46bcbc-6x97m\" (UID: \"51d25d7e-dfe4-4fb6-9857-f2f8a888220c\") " pod="ai-tenant-e2e-shared-a-196ed1/sub-test-model-196ed1-kserve-9b46bcbc-6x97m"
Jul 13 19:40:37.827825 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:40:37.827711    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/51d25d7e-dfe4-4fb6-9857-f2f8a888220c-model-cache\") pod \"sub-test-model-196ed1-kserve-9b46bcbc-6x97m\" (UID: \"51d25d7e-dfe4-4fb6-9857-f2f8a888220c\") " pod="ai-tenant-e2e-shared-a-196ed1/sub-test-model-196ed1-kserve-9b46bcbc-6x97m"
Jul 13 19:40:37.827825 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:40:37.827754    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/51d25d7e-dfe4-4fb6-9857-f2f8a888220c-tmp-dir\") pod \"sub-test-model-196ed1-kserve-9b46bcbc-6x97m\" (UID: \"51d25d7e-dfe4-4fb6-9857-f2f8a888220c\") " pod="ai-tenant-e2e-shared-a-196ed1/sub-test-model-196ed1-kserve-9b46bcbc-6x97m"
Jul 13 19:40:37.827825 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:40:37.827780    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/51d25d7e-dfe4-4fb6-9857-f2f8a888220c-home\") pod \"sub-test-model-196ed1-kserve-9b46bcbc-6x97m\" (UID: \"51d25d7e-dfe4-4fb6-9857-f2f8a888220c\") " pod="ai-tenant-e2e-shared-a-196ed1/sub-test-model-196ed1-kserve-9b46bcbc-6x97m"
Jul 13 19:40:37.829938 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:40:37.829910    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/51d25d7e-dfe4-4fb6-9857-f2f8a888220c-dshm\") pod \"sub-test-model-196ed1-kserve-9b46bcbc-6x97m\" (UID: \"51d25d7e-dfe4-4fb6-9857-f2f8a888220c\") " pod="ai-tenant-e2e-shared-a-196ed1/sub-test-model-196ed1-kserve-9b46bcbc-6x97m"
Jul 13 19:40:37.830106 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:40:37.830057    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/51d25d7e-dfe4-4fb6-9857-f2f8a888220c-tls-certs\") pod \"sub-test-model-196ed1-kserve-9b46bcbc-6x97m\" (UID: \"51d25d7e-dfe4-4fb6-9857-f2f8a888220c\") " pod="ai-tenant-e2e-shared-a-196ed1/sub-test-model-196ed1-kserve-9b46bcbc-6x97m"
Jul 13 19:40:37.836853 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:40:37.836827    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z5thp\" (UniqueName: \"kubernetes.io/projected/51d25d7e-dfe4-4fb6-9857-f2f8a888220c-kube-api-access-z5thp\") pod \"sub-test-model-196ed1-kserve-9b46bcbc-6x97m\" (UID: \"51d25d7e-dfe4-4fb6-9857-f2f8a888220c\") " pod="ai-tenant-e2e-shared-a-196ed1/sub-test-model-196ed1-kserve-9b46bcbc-6x97m"
Jul 13 19:40:37.970666 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:40:37.970571    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-196ed1/sub-test-model-196ed1-kserve-9b46bcbc-6x97m"
Jul 13 19:40:38.115367 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:40:38.115328    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-196ed1/sub-test-model-196ed1-kserve-9b46bcbc-6x97m"]
Jul 13 19:40:38.116904 ip-10-0-135-38 kubenswrapper[2563]: W0713 19:40:38.116876    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod51d25d7e_dfe4_4fb6_9857_f2f8a888220c.slice/crio-2af003d2567c4bb1bac96624a8b1c910eb0a8e9823c6d0c0c033a90f64c8eb6b WatchSource:0}: Error finding container 2af003d2567c4bb1bac96624a8b1c910eb0a8e9823c6d0c0c033a90f64c8eb6b: Status 404 returned error can't find the container with id 2af003d2567c4bb1bac96624a8b1c910eb0a8e9823c6d0c0c033a90f64c8eb6b
Jul 13 19:40:38.617905 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:40:38.617862    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-196ed1/sub-test-model-196ed1-kserve-9b46bcbc-6x97m" event={"ID":"51d25d7e-dfe4-4fb6-9857-f2f8a888220c","Type":"ContainerStarted","Data":"811cfe61ac7965d41d21f64f8b7675025a58a31e18c9235ab0faf75bb76e45dd"}
Jul 13 19:40:38.618163 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:40:38.617915    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-196ed1/sub-test-model-196ed1-kserve-9b46bcbc-6x97m" event={"ID":"51d25d7e-dfe4-4fb6-9857-f2f8a888220c","Type":"ContainerStarted","Data":"2af003d2567c4bb1bac96624a8b1c910eb0a8e9823c6d0c0c033a90f64c8eb6b"}
Jul 13 19:40:38.636771 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:40:38.636711    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-196ed1/sub-test-model-196ed1-kserve-9b46bcbc-6x97m" podStartSLOduration=1.6366924840000001 podStartE2EDuration="1.636692484s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 19:40:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 19:40:38.63508648 +0000 UTC m=+2526.409962839" watchObservedRunningTime="2026-07-13 19:40:38.636692484 +0000 UTC m=+2526.411568839"
Jul 13 19:40:47.971540 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:40:47.971485    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-196ed1/sub-test-model-196ed1-kserve-9b46bcbc-6x97m"
Jul 13 19:40:47.972038 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:40:47.971582    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-196ed1/sub-test-model-196ed1-kserve-9b46bcbc-6x97m"
Jul 13 19:40:47.984322 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:40:47.984290    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-196ed1/sub-test-model-196ed1-kserve-9b46bcbc-6x97m"
Jul 13 19:40:48.684817 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:40:48.684786    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-196ed1/sub-test-model-196ed1-kserve-9b46bcbc-6x97m"
Jul 13 19:41:43.988276 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:41:43.988236    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-196ed1/sub-test-model-196ed1-kserve-9b46bcbc-6x97m"]
Jul 13 19:41:59.009925 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:41:59.009826    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-196ed1/sub-test-model-196ed1-kserve-9b46bcbc-6x97m" podUID="51d25d7e-dfe4-4fb6-9857-f2f8a888220c" containerName="main" containerID="cri-o://811cfe61ac7965d41d21f64f8b7675025a58a31e18c9235ab0faf75bb76e45dd" gracePeriod=45
Jul 13 19:41:59.281075 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:41:59.281046    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-196ed1/sub-test-model-196ed1-kserve-9b46bcbc-6x97m"
Jul 13 19:41:59.303423 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:41:59.303378    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/51d25d7e-dfe4-4fb6-9857-f2f8a888220c-dshm\") pod \"51d25d7e-dfe4-4fb6-9857-f2f8a888220c\" (UID: \"51d25d7e-dfe4-4fb6-9857-f2f8a888220c\") "
Jul 13 19:41:59.303423 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:41:59.303424    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/51d25d7e-dfe4-4fb6-9857-f2f8a888220c-model-cache\") pod \"51d25d7e-dfe4-4fb6-9857-f2f8a888220c\" (UID: \"51d25d7e-dfe4-4fb6-9857-f2f8a888220c\") "
Jul 13 19:41:59.303678 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:41:59.303483    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/51d25d7e-dfe4-4fb6-9857-f2f8a888220c-home\") pod \"51d25d7e-dfe4-4fb6-9857-f2f8a888220c\" (UID: \"51d25d7e-dfe4-4fb6-9857-f2f8a888220c\") "
Jul 13 19:41:59.303678 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:41:59.303544    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/51d25d7e-dfe4-4fb6-9857-f2f8a888220c-tmp-dir\") pod \"51d25d7e-dfe4-4fb6-9857-f2f8a888220c\" (UID: \"51d25d7e-dfe4-4fb6-9857-f2f8a888220c\") "
Jul 13 19:41:59.303678 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:41:59.303594    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z5thp\" (UniqueName: \"kubernetes.io/projected/51d25d7e-dfe4-4fb6-9857-f2f8a888220c-kube-api-access-z5thp\") pod \"51d25d7e-dfe4-4fb6-9857-f2f8a888220c\" (UID: \"51d25d7e-dfe4-4fb6-9857-f2f8a888220c\") "
Jul 13 19:41:59.303678 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:41:59.303636    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/51d25d7e-dfe4-4fb6-9857-f2f8a888220c-tls-certs\") pod \"51d25d7e-dfe4-4fb6-9857-f2f8a888220c\" (UID: \"51d25d7e-dfe4-4fb6-9857-f2f8a888220c\") "
Jul 13 19:41:59.303886 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:41:59.303705    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/51d25d7e-dfe4-4fb6-9857-f2f8a888220c-model-cache" (OuterVolumeSpecName: "model-cache") pod "51d25d7e-dfe4-4fb6-9857-f2f8a888220c" (UID: "51d25d7e-dfe4-4fb6-9857-f2f8a888220c"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 19:41:59.303886 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:41:59.303814    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/51d25d7e-dfe4-4fb6-9857-f2f8a888220c-home" (OuterVolumeSpecName: "home") pod "51d25d7e-dfe4-4fb6-9857-f2f8a888220c" (UID: "51d25d7e-dfe4-4fb6-9857-f2f8a888220c"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 19:41:59.303994 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:41:59.303968    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/51d25d7e-dfe4-4fb6-9857-f2f8a888220c-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "51d25d7e-dfe4-4fb6-9857-f2f8a888220c" (UID: "51d25d7e-dfe4-4fb6-9857-f2f8a888220c"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 19:41:59.304075 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:41:59.303996    2563 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/51d25d7e-dfe4-4fb6-9857-f2f8a888220c-model-cache\") on node \"ip-10-0-135-38.ec2.internal\" DevicePath \"\""
Jul 13 19:41:59.304075 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:41:59.304052    2563 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/51d25d7e-dfe4-4fb6-9857-f2f8a888220c-home\") on node \"ip-10-0-135-38.ec2.internal\" DevicePath \"\""
Jul 13 19:41:59.306250 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:41:59.306219    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/51d25d7e-dfe4-4fb6-9857-f2f8a888220c-dshm" (OuterVolumeSpecName: "dshm") pod "51d25d7e-dfe4-4fb6-9857-f2f8a888220c" (UID: "51d25d7e-dfe4-4fb6-9857-f2f8a888220c"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 19:41:59.306400 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:41:59.306219    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/51d25d7e-dfe4-4fb6-9857-f2f8a888220c-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "51d25d7e-dfe4-4fb6-9857-f2f8a888220c" (UID: "51d25d7e-dfe4-4fb6-9857-f2f8a888220c"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 13 19:41:59.306400 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:41:59.306337    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/51d25d7e-dfe4-4fb6-9857-f2f8a888220c-kube-api-access-z5thp" (OuterVolumeSpecName: "kube-api-access-z5thp") pod "51d25d7e-dfe4-4fb6-9857-f2f8a888220c" (UID: "51d25d7e-dfe4-4fb6-9857-f2f8a888220c"). InnerVolumeSpecName "kube-api-access-z5thp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 19:41:59.405342 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:41:59.405304    2563 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/51d25d7e-dfe4-4fb6-9857-f2f8a888220c-tmp-dir\") on node \"ip-10-0-135-38.ec2.internal\" DevicePath \"\""
Jul 13 19:41:59.405342 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:41:59.405336    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z5thp\" (UniqueName: \"kubernetes.io/projected/51d25d7e-dfe4-4fb6-9857-f2f8a888220c-kube-api-access-z5thp\") on node \"ip-10-0-135-38.ec2.internal\" DevicePath \"\""
Jul 13 19:41:59.405342 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:41:59.405346    2563 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/51d25d7e-dfe4-4fb6-9857-f2f8a888220c-tls-certs\") on node \"ip-10-0-135-38.ec2.internal\" DevicePath \"\""
Jul 13 19:41:59.405342 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:41:59.405356    2563 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/51d25d7e-dfe4-4fb6-9857-f2f8a888220c-dshm\") on node \"ip-10-0-135-38.ec2.internal\" DevicePath \"\""
Jul 13 19:42:00.074582 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:42:00.074545    2563 generic.go:356] "Generic (PLEG): container finished" podID="51d25d7e-dfe4-4fb6-9857-f2f8a888220c" containerID="811cfe61ac7965d41d21f64f8b7675025a58a31e18c9235ab0faf75bb76e45dd" exitCode=0
Jul 13 19:42:00.075055 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:42:00.074599    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-196ed1/sub-test-model-196ed1-kserve-9b46bcbc-6x97m"
Jul 13 19:42:00.075055 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:42:00.074626    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-196ed1/sub-test-model-196ed1-kserve-9b46bcbc-6x97m" event={"ID":"51d25d7e-dfe4-4fb6-9857-f2f8a888220c","Type":"ContainerDied","Data":"811cfe61ac7965d41d21f64f8b7675025a58a31e18c9235ab0faf75bb76e45dd"}
Jul 13 19:42:00.075055 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:42:00.074676    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-196ed1/sub-test-model-196ed1-kserve-9b46bcbc-6x97m" event={"ID":"51d25d7e-dfe4-4fb6-9857-f2f8a888220c","Type":"ContainerDied","Data":"2af003d2567c4bb1bac96624a8b1c910eb0a8e9823c6d0c0c033a90f64c8eb6b"}
Jul 13 19:42:00.075055 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:42:00.074701    2563 scope.go:117] "RemoveContainer" containerID="811cfe61ac7965d41d21f64f8b7675025a58a31e18c9235ab0faf75bb76e45dd"
Jul 13 19:42:00.085526 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:42:00.085490    2563 scope.go:117] "RemoveContainer" containerID="811cfe61ac7965d41d21f64f8b7675025a58a31e18c9235ab0faf75bb76e45dd"
Jul 13 19:42:00.086267 ip-10-0-135-38 kubenswrapper[2563]: E0713 19:42:00.085927    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"811cfe61ac7965d41d21f64f8b7675025a58a31e18c9235ab0faf75bb76e45dd\": container with ID starting with 811cfe61ac7965d41d21f64f8b7675025a58a31e18c9235ab0faf75bb76e45dd not found: ID does not exist" containerID="811cfe61ac7965d41d21f64f8b7675025a58a31e18c9235ab0faf75bb76e45dd"
Jul 13 19:42:00.086267 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:42:00.085971    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"811cfe61ac7965d41d21f64f8b7675025a58a31e18c9235ab0faf75bb76e45dd"} err="failed to get container status \"811cfe61ac7965d41d21f64f8b7675025a58a31e18c9235ab0faf75bb76e45dd\": rpc error: code = NotFound desc = could not find container \"811cfe61ac7965d41d21f64f8b7675025a58a31e18c9235ab0faf75bb76e45dd\": container with ID starting with 811cfe61ac7965d41d21f64f8b7675025a58a31e18c9235ab0faf75bb76e45dd not found: ID does not exist"
Jul 13 19:42:00.108423 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:42:00.108389    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-196ed1/sub-test-model-196ed1-kserve-9b46bcbc-6x97m"]
Jul 13 19:42:00.113648 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:42:00.113611    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-196ed1/sub-test-model-196ed1-kserve-9b46bcbc-6x97m"]
Jul 13 19:42:00.756557 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:42:00.756518    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="51d25d7e-dfe4-4fb6-9857-f2f8a888220c" path="/var/lib/kubelet/pods/51d25d7e-dfe4-4fb6-9857-f2f8a888220c/volumes"
Jul 13 19:43:29.652619 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:43:29.652581    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/test-curl-7640-140178893631792"]
Jul 13 19:43:29.653165 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:43:29.652990    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="51d25d7e-dfe4-4fb6-9857-f2f8a888220c" containerName="main"
Jul 13 19:43:29.653165 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:43:29.653002    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="51d25d7e-dfe4-4fb6-9857-f2f8a888220c" containerName="main"
Jul 13 19:43:29.653165 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:43:29.653109    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="51d25d7e-dfe4-4fb6-9857-f2f8a888220c" containerName="main"
Jul 13 19:43:29.656270 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:43:29.656247    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7640-140178893631792"
Jul 13 19:43:29.659082 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:43:29.659052    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-dockercfg-wtckq\""
Jul 13 19:43:29.662347 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:43:29.662322    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7640-140178893631792"]
Jul 13 19:43:29.757460 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:43:29.757424    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hmmc6\" (UniqueName: \"kubernetes.io/projected/9c42619d-3e30-4826-b40a-8ae09e385b59-kube-api-access-hmmc6\") pod \"test-curl-7640-140178893631792\" (UID: \"9c42619d-3e30-4826-b40a-8ae09e385b59\") " pod="openshift-ingress/test-curl-7640-140178893631792"
Jul 13 19:43:29.858656 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:43:29.858608    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hmmc6\" (UniqueName: \"kubernetes.io/projected/9c42619d-3e30-4826-b40a-8ae09e385b59-kube-api-access-hmmc6\") pod \"test-curl-7640-140178893631792\" (UID: \"9c42619d-3e30-4826-b40a-8ae09e385b59\") " pod="openshift-ingress/test-curl-7640-140178893631792"
Jul 13 19:43:29.866719 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:43:29.866680    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hmmc6\" (UniqueName: \"kubernetes.io/projected/9c42619d-3e30-4826-b40a-8ae09e385b59-kube-api-access-hmmc6\") pod \"test-curl-7640-140178893631792\" (UID: \"9c42619d-3e30-4826-b40a-8ae09e385b59\") " pod="openshift-ingress/test-curl-7640-140178893631792"
Jul 13 19:43:29.967933 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:43:29.967826    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7640-140178893631792"
Jul 13 19:43:30.117676 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:43:30.117644    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7640-140178893631792"]
Jul 13 19:43:30.120294 ip-10-0-135-38 kubenswrapper[2563]: W0713 19:43:30.120261    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9c42619d_3e30_4826_b40a_8ae09e385b59.slice/crio-51390f199c51338dc1a2d2f90747786f14594fd8a9cba56472baa49f5a2d2fac WatchSource:0}: Error finding container 51390f199c51338dc1a2d2f90747786f14594fd8a9cba56472baa49f5a2d2fac: Status 404 returned error can't find the container with id 51390f199c51338dc1a2d2f90747786f14594fd8a9cba56472baa49f5a2d2fac
Jul 13 19:43:30.122085 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:43:30.122062    2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 13 19:43:30.568222 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:43:30.568178    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7640-140178893631792" event={"ID":"9c42619d-3e30-4826-b40a-8ae09e385b59","Type":"ContainerStarted","Data":"51390f199c51338dc1a2d2f90747786f14594fd8a9cba56472baa49f5a2d2fac"}
Jul 13 19:43:31.574670 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:43:31.574629    2563 generic.go:356] "Generic (PLEG): container finished" podID="9c42619d-3e30-4826-b40a-8ae09e385b59" containerID="a69faaf3029712d308e8ba91005c1c355f9a975dfdf40069475df886ca1e8cd7" exitCode=0
Jul 13 19:43:31.575145 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:43:31.574723    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7640-140178893631792" event={"ID":"9c42619d-3e30-4826-b40a-8ae09e385b59","Type":"ContainerDied","Data":"a69faaf3029712d308e8ba91005c1c355f9a975dfdf40069475df886ca1e8cd7"}
Jul 13 19:43:32.739271 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:43:32.739233    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7640-140178893631792"
Jul 13 19:43:32.774860 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:43:32.774823    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_test-curl-7640-140178893631792_9c42619d-3e30-4826-b40a-8ae09e385b59/test-curl-7640-140178893631792/0.log"
Jul 13 19:43:32.784251 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:43:32.784219    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hmmc6\" (UniqueName: \"kubernetes.io/projected/9c42619d-3e30-4826-b40a-8ae09e385b59-kube-api-access-hmmc6\") pod \"9c42619d-3e30-4826-b40a-8ae09e385b59\" (UID: \"9c42619d-3e30-4826-b40a-8ae09e385b59\") "
Jul 13 19:43:32.786421 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:43:32.786387    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9c42619d-3e30-4826-b40a-8ae09e385b59-kube-api-access-hmmc6" (OuterVolumeSpecName: "kube-api-access-hmmc6") pod "9c42619d-3e30-4826-b40a-8ae09e385b59" (UID: "9c42619d-3e30-4826-b40a-8ae09e385b59"). InnerVolumeSpecName "kube-api-access-hmmc6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 19:43:32.799229 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:43:32.799194    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/test-curl-7640-140178893631792"]
Jul 13 19:43:32.804899 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:43:32.804868    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/test-curl-7640-140178893631792"]
Jul 13 19:43:32.884869 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:43:32.884833    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hmmc6\" (UniqueName: \"kubernetes.io/projected/9c42619d-3e30-4826-b40a-8ae09e385b59-kube-api-access-hmmc6\") on node \"ip-10-0-135-38.ec2.internal\" DevicePath \"\""
Jul 13 19:43:32.894421 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:43:32.894396    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hwqhc_7ae2e1d0-8a16-4821-9cb7-353862cfbec8/ovn-acl-logging/0.log"
Jul 13 19:43:32.899500 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:43:32.899475    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hwqhc_7ae2e1d0-8a16-4821-9cb7-353862cfbec8/ovn-acl-logging/0.log"
Jul 13 19:43:33.588331 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:43:33.588302    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="51390f199c51338dc1a2d2f90747786f14594fd8a9cba56472baa49f5a2d2fac"
Jul 13 19:43:33.588331 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:43:33.588333    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7640-140178893631792"
Jul 13 19:43:33.598512 ip-10-0-135-38 kubenswrapper[2563]: E0713 19:43:33.598477    2563 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7640-140178893631792\" is forbidden: User \"system:node:ip-10-0-135-38.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-135-38.ec2.internal' and this object" podUID="9c42619d-3e30-4826-b40a-8ae09e385b59" pod="openshift-ingress/test-curl-7640-140178893631792"
Jul 13 19:43:34.756170 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:43:34.756134    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9c42619d-3e30-4826-b40a-8ae09e385b59" path="/var/lib/kubelet/pods/9c42619d-3e30-4826-b40a-8ae09e385b59/volumes"
Jul 13 19:43:38.718508 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:43:38.718466    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/test-curl-7640-140178893796384"]
Jul 13 19:43:38.719088 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:43:38.719067    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9c42619d-3e30-4826-b40a-8ae09e385b59" containerName="test-curl-7640-140178893631792"
Jul 13 19:43:38.719210 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:43:38.719090    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="9c42619d-3e30-4826-b40a-8ae09e385b59" containerName="test-curl-7640-140178893631792"
Jul 13 19:43:38.719263 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:43:38.719221    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="9c42619d-3e30-4826-b40a-8ae09e385b59" containerName="test-curl-7640-140178893631792"
Jul 13 19:43:38.722570 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:43:38.722543    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7640-140178893796384"
Jul 13 19:43:38.725138 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:43:38.725111    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-dockercfg-wtckq\""
Jul 13 19:43:38.728613 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:43:38.728581    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7640-140178893796384"]
Jul 13 19:43:38.739526 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:43:38.739487    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-km4bf\" (UniqueName: \"kubernetes.io/projected/e326cc9f-51c7-45b2-9172-7546853ece45-kube-api-access-km4bf\") pod \"test-curl-7640-140178893796384\" (UID: \"e326cc9f-51c7-45b2-9172-7546853ece45\") " pod="openshift-ingress/test-curl-7640-140178893796384"
Jul 13 19:43:38.840573 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:43:38.840531    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-km4bf\" (UniqueName: \"kubernetes.io/projected/e326cc9f-51c7-45b2-9172-7546853ece45-kube-api-access-km4bf\") pod \"test-curl-7640-140178893796384\" (UID: \"e326cc9f-51c7-45b2-9172-7546853ece45\") " pod="openshift-ingress/test-curl-7640-140178893796384"
Jul 13 19:43:38.849180 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:43:38.849138    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-km4bf\" (UniqueName: \"kubernetes.io/projected/e326cc9f-51c7-45b2-9172-7546853ece45-kube-api-access-km4bf\") pod \"test-curl-7640-140178893796384\" (UID: \"e326cc9f-51c7-45b2-9172-7546853ece45\") " pod="openshift-ingress/test-curl-7640-140178893796384"
Jul 13 19:43:39.033141 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:43:39.032998    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7640-140178893796384"
Jul 13 19:43:39.181561 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:43:39.181533    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7640-140178893796384"]
Jul 13 19:43:39.184210 ip-10-0-135-38 kubenswrapper[2563]: W0713 19:43:39.184175    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode326cc9f_51c7_45b2_9172_7546853ece45.slice/crio-972353813cb98153726aa621477ab9ed05f52bfc3a7a1889679c71332783cac6 WatchSource:0}: Error finding container 972353813cb98153726aa621477ab9ed05f52bfc3a7a1889679c71332783cac6: Status 404 returned error can't find the container with id 972353813cb98153726aa621477ab9ed05f52bfc3a7a1889679c71332783cac6
Jul 13 19:43:39.623591 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:43:39.623550    2563 generic.go:356] "Generic (PLEG): container finished" podID="e326cc9f-51c7-45b2-9172-7546853ece45" containerID="d6febb53ff1a009d647912b0e7b22bf5af843ea7b0fad625671c396f16cff880" exitCode=0
Jul 13 19:43:39.623800 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:43:39.623630    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7640-140178893796384" event={"ID":"e326cc9f-51c7-45b2-9172-7546853ece45","Type":"ContainerDied","Data":"d6febb53ff1a009d647912b0e7b22bf5af843ea7b0fad625671c396f16cff880"}
Jul 13 19:43:39.623800 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:43:39.623672    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7640-140178893796384" event={"ID":"e326cc9f-51c7-45b2-9172-7546853ece45","Type":"ContainerStarted","Data":"972353813cb98153726aa621477ab9ed05f52bfc3a7a1889679c71332783cac6"}
Jul 13 19:43:40.773574 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:43:40.773546    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7640-140178893796384"
Jul 13 19:43:40.793991 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:43:40.793913    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_test-curl-7640-140178893796384_e326cc9f-51c7-45b2-9172-7546853ece45/test-curl-7640-140178893796384/0.log"
Jul 13 19:43:40.817402 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:43:40.817355    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/test-curl-7640-140178893796384"]
Jul 13 19:43:40.821593 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:43:40.821557    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/test-curl-7640-140178893796384"]
Jul 13 19:43:40.860616 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:43:40.860576    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-km4bf\" (UniqueName: \"kubernetes.io/projected/e326cc9f-51c7-45b2-9172-7546853ece45-kube-api-access-km4bf\") pod \"e326cc9f-51c7-45b2-9172-7546853ece45\" (UID: \"e326cc9f-51c7-45b2-9172-7546853ece45\") "
Jul 13 19:43:40.862858 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:43:40.862828    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e326cc9f-51c7-45b2-9172-7546853ece45-kube-api-access-km4bf" (OuterVolumeSpecName: "kube-api-access-km4bf") pod "e326cc9f-51c7-45b2-9172-7546853ece45" (UID: "e326cc9f-51c7-45b2-9172-7546853ece45"). InnerVolumeSpecName "kube-api-access-km4bf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 19:43:40.962436 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:43:40.962336    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-km4bf\" (UniqueName: \"kubernetes.io/projected/e326cc9f-51c7-45b2-9172-7546853ece45-kube-api-access-km4bf\") on node \"ip-10-0-135-38.ec2.internal\" DevicePath \"\""
Jul 13 19:43:41.634975 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:43:41.634944    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7640-140178893796384"
Jul 13 19:43:41.635201 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:43:41.634950    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="972353813cb98153726aa621477ab9ed05f52bfc3a7a1889679c71332783cac6"
Jul 13 19:43:41.644774 ip-10-0-135-38 kubenswrapper[2563]: E0713 19:43:41.644744    2563 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7640-140178893796384\" is forbidden: User \"system:node:ip-10-0-135-38.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-135-38.ec2.internal' and this object" podUID="e326cc9f-51c7-45b2-9172-7546853ece45" pod="openshift-ingress/test-curl-7640-140178893796384"
Jul 13 19:43:42.754910 ip-10-0-135-38 kubenswrapper[2563]: E0713 19:43:42.754863    2563 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7640-140178893796384\" is forbidden: User \"system:node:ip-10-0-135-38.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-135-38.ec2.internal' and this object" podUID="e326cc9f-51c7-45b2-9172-7546853ece45" pod="openshift-ingress/test-curl-7640-140178893796384"
Jul 13 19:43:42.756410 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:43:42.756386    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e326cc9f-51c7-45b2-9172-7546853ece45" path="/var/lib/kubelet/pods/e326cc9f-51c7-45b2-9172-7546853ece45/volumes"
Jul 13 19:44:09.573103 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:44:09.573065    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-196ed1-openshift-default-7ddd7d66b7-tkdq7"]
Jul 13 19:44:09.573740 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:44:09.573295    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-196ed1-openshift-default-7ddd7d66b7-tkdq7" podUID="e19906f3-7342-4f6f-bb79-f32dc0e39e74" containerName="istio-proxy" containerID="cri-o://1456c777335fb3d8ab25ec6ac768622abb8b6cb8a8eac02e8f79c83d1bc41b02" gracePeriod=30
Jul 13 19:44:10.622759 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:44:10.622702    2563 patch_prober.go:28] interesting pod/e2e-shared-a-196ed1-openshift-default-7ddd7d66b7-tkdq7 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 13 19:44:10.623284 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:44:10.622889    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-196ed1-openshift-default-7ddd7d66b7-tkdq7" podUID="e19906f3-7342-4f6f-bb79-f32dc0e39e74" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 13 19:44:14.817980 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:44:14.817935    2563 generic.go:356] "Generic (PLEG): container finished" podID="e19906f3-7342-4f6f-bb79-f32dc0e39e74" containerID="1456c777335fb3d8ab25ec6ac768622abb8b6cb8a8eac02e8f79c83d1bc41b02" exitCode=0
Jul 13 19:44:14.818426 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:44:14.818002    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-196ed1-openshift-default-7ddd7d66b7-tkdq7" event={"ID":"e19906f3-7342-4f6f-bb79-f32dc0e39e74","Type":"ContainerDied","Data":"1456c777335fb3d8ab25ec6ac768622abb8b6cb8a8eac02e8f79c83d1bc41b02"}
Jul 13 19:44:14.818426 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:44:14.818107    2563 scope.go:117] "RemoveContainer" containerID="f4630b13b6ef3348d04f46e1b9685518196e936f67c1efce608d9d460793b6ec"
Jul 13 19:44:14.842782 ip-10-0-135-38 kubenswrapper[2563]: E0713 19:44:14.842758    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f4630b13b6ef3348d04f46e1b9685518196e936f67c1efce608d9d460793b6ec\": container with ID starting with f4630b13b6ef3348d04f46e1b9685518196e936f67c1efce608d9d460793b6ec not found: ID does not exist" containerID="f4630b13b6ef3348d04f46e1b9685518196e936f67c1efce608d9d460793b6ec"
Jul 13 19:44:14.846004 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:44:14.845985    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-196ed1-openshift-default-7ddd7d66b7-tkdq7"
Jul 13 19:44:14.892677 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:44:14.892637    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e19906f3-7342-4f6f-bb79-f32dc0e39e74-workload-socket\") pod \"e19906f3-7342-4f6f-bb79-f32dc0e39e74\" (UID: \"e19906f3-7342-4f6f-bb79-f32dc0e39e74\") "
Jul 13 19:44:14.892677 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:44:14.892679    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e19906f3-7342-4f6f-bb79-f32dc0e39e74-istio-token\") pod \"e19906f3-7342-4f6f-bb79-f32dc0e39e74\" (UID: \"e19906f3-7342-4f6f-bb79-f32dc0e39e74\") "
Jul 13 19:44:14.892959 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:44:14.892723    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e19906f3-7342-4f6f-bb79-f32dc0e39e74-credential-socket\") pod \"e19906f3-7342-4f6f-bb79-f32dc0e39e74\" (UID: \"e19906f3-7342-4f6f-bb79-f32dc0e39e74\") "
Jul 13 19:44:14.892959 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:44:14.892754    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e19906f3-7342-4f6f-bb79-f32dc0e39e74-istiod-ca-cert\") pod \"e19906f3-7342-4f6f-bb79-f32dc0e39e74\" (UID: \"e19906f3-7342-4f6f-bb79-f32dc0e39e74\") "
Jul 13 19:44:14.892959 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:44:14.892778    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e19906f3-7342-4f6f-bb79-f32dc0e39e74-workload-certs\") pod \"e19906f3-7342-4f6f-bb79-f32dc0e39e74\" (UID: \"e19906f3-7342-4f6f-bb79-f32dc0e39e74\") "
Jul 13 19:44:14.892959 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:44:14.892822    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e19906f3-7342-4f6f-bb79-f32dc0e39e74-istio-envoy\") pod \"e19906f3-7342-4f6f-bb79-f32dc0e39e74\" (UID: \"e19906f3-7342-4f6f-bb79-f32dc0e39e74\") "
Jul 13 19:44:14.892959 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:44:14.892857    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e19906f3-7342-4f6f-bb79-f32dc0e39e74-istio-data\") pod \"e19906f3-7342-4f6f-bb79-f32dc0e39e74\" (UID: \"e19906f3-7342-4f6f-bb79-f32dc0e39e74\") "
Jul 13 19:44:14.892959 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:44:14.892926    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e19906f3-7342-4f6f-bb79-f32dc0e39e74-istio-podinfo\") pod \"e19906f3-7342-4f6f-bb79-f32dc0e39e74\" (UID: \"e19906f3-7342-4f6f-bb79-f32dc0e39e74\") "
Jul 13 19:44:14.892959 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:44:14.892943    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e19906f3-7342-4f6f-bb79-f32dc0e39e74-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "e19906f3-7342-4f6f-bb79-f32dc0e39e74" (UID: "e19906f3-7342-4f6f-bb79-f32dc0e39e74"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 19:44:14.892959 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:44:14.892962    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lh8w4\" (UniqueName: \"kubernetes.io/projected/e19906f3-7342-4f6f-bb79-f32dc0e39e74-kube-api-access-lh8w4\") pod \"e19906f3-7342-4f6f-bb79-f32dc0e39e74\" (UID: \"e19906f3-7342-4f6f-bb79-f32dc0e39e74\") "
Jul 13 19:44:14.893426 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:44:14.893189    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e19906f3-7342-4f6f-bb79-f32dc0e39e74-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "e19906f3-7342-4f6f-bb79-f32dc0e39e74" (UID: "e19906f3-7342-4f6f-bb79-f32dc0e39e74"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 19:44:14.893426 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:44:14.893210    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e19906f3-7342-4f6f-bb79-f32dc0e39e74-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "e19906f3-7342-4f6f-bb79-f32dc0e39e74" (UID: "e19906f3-7342-4f6f-bb79-f32dc0e39e74"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 19:44:14.893426 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:44:14.893337    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e19906f3-7342-4f6f-bb79-f32dc0e39e74-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "e19906f3-7342-4f6f-bb79-f32dc0e39e74" (UID: "e19906f3-7342-4f6f-bb79-f32dc0e39e74"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 19:44:14.893597 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:44:14.893478    2563 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e19906f3-7342-4f6f-bb79-f32dc0e39e74-workload-socket\") on node \"ip-10-0-135-38.ec2.internal\" DevicePath \"\""
Jul 13 19:44:14.893597 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:44:14.893502    2563 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e19906f3-7342-4f6f-bb79-f32dc0e39e74-credential-socket\") on node \"ip-10-0-135-38.ec2.internal\" DevicePath \"\""
Jul 13 19:44:14.893597 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:44:14.893516    2563 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e19906f3-7342-4f6f-bb79-f32dc0e39e74-istiod-ca-cert\") on node \"ip-10-0-135-38.ec2.internal\" DevicePath \"\""
Jul 13 19:44:14.893597 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:44:14.893531    2563 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e19906f3-7342-4f6f-bb79-f32dc0e39e74-workload-certs\") on node \"ip-10-0-135-38.ec2.internal\" DevicePath \"\""
Jul 13 19:44:14.893843 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:44:14.893823    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e19906f3-7342-4f6f-bb79-f32dc0e39e74-istio-data" (OuterVolumeSpecName: "istio-data") pod "e19906f3-7342-4f6f-bb79-f32dc0e39e74" (UID: "e19906f3-7342-4f6f-bb79-f32dc0e39e74"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 19:44:14.895417 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:44:14.895380    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e19906f3-7342-4f6f-bb79-f32dc0e39e74-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "e19906f3-7342-4f6f-bb79-f32dc0e39e74" (UID: "e19906f3-7342-4f6f-bb79-f32dc0e39e74"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 19:44:14.895562 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:44:14.895541    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e19906f3-7342-4f6f-bb79-f32dc0e39e74-kube-api-access-lh8w4" (OuterVolumeSpecName: "kube-api-access-lh8w4") pod "e19906f3-7342-4f6f-bb79-f32dc0e39e74" (UID: "e19906f3-7342-4f6f-bb79-f32dc0e39e74"). InnerVolumeSpecName "kube-api-access-lh8w4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 19:44:14.895615 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:44:14.895560    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e19906f3-7342-4f6f-bb79-f32dc0e39e74-istio-token" (OuterVolumeSpecName: "istio-token") pod "e19906f3-7342-4f6f-bb79-f32dc0e39e74" (UID: "e19906f3-7342-4f6f-bb79-f32dc0e39e74"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 19:44:14.895615 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:44:14.895594    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/e19906f3-7342-4f6f-bb79-f32dc0e39e74-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "e19906f3-7342-4f6f-bb79-f32dc0e39e74" (UID: "e19906f3-7342-4f6f-bb79-f32dc0e39e74"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 13 19:44:14.994117 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:44:14.994078    2563 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e19906f3-7342-4f6f-bb79-f32dc0e39e74-istio-token\") on node \"ip-10-0-135-38.ec2.internal\" DevicePath \"\""
Jul 13 19:44:14.994117 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:44:14.994113    2563 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e19906f3-7342-4f6f-bb79-f32dc0e39e74-istio-envoy\") on node \"ip-10-0-135-38.ec2.internal\" DevicePath \"\""
Jul 13 19:44:14.994117 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:44:14.994124    2563 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e19906f3-7342-4f6f-bb79-f32dc0e39e74-istio-data\") on node \"ip-10-0-135-38.ec2.internal\" DevicePath \"\""
Jul 13 19:44:14.994385 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:44:14.994135    2563 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e19906f3-7342-4f6f-bb79-f32dc0e39e74-istio-podinfo\") on node \"ip-10-0-135-38.ec2.internal\" DevicePath \"\""
Jul 13 19:44:14.994385 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:44:14.994154    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lh8w4\" (UniqueName: \"kubernetes.io/projected/e19906f3-7342-4f6f-bb79-f32dc0e39e74-kube-api-access-lh8w4\") on node \"ip-10-0-135-38.ec2.internal\" DevicePath \"\""
Jul 13 19:44:15.824680 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:44:15.824646    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-196ed1-openshift-default-7ddd7d66b7-tkdq7"
Jul 13 19:44:15.825164 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:44:15.824683    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-196ed1-openshift-default-7ddd7d66b7-tkdq7" event={"ID":"e19906f3-7342-4f6f-bb79-f32dc0e39e74","Type":"ContainerDied","Data":"7ab8184243514d7bbbe0645597d2ac5d3848e09380d878b73d4b44b98acdcfbb"}
Jul 13 19:44:15.825164 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:44:15.824759    2563 scope.go:117] "RemoveContainer" containerID="1456c777335fb3d8ab25ec6ac768622abb8b6cb8a8eac02e8f79c83d1bc41b02"
Jul 13 19:44:15.849283 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:44:15.849246    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-196ed1-openshift-default-7ddd7d66b7-tkdq7"]
Jul 13 19:44:15.853311 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:44:15.853280    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-196ed1-openshift-default-7ddd7d66b7-tkdq7"]
Jul 13 19:44:16.757494 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:44:16.757454    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e19906f3-7342-4f6f-bb79-f32dc0e39e74" path="/var/lib/kubelet/pods/e19906f3-7342-4f6f-bb79-f32dc0e39e74/volumes"
Jul 13 19:44:35.733369 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:44:35.733309    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-2555bb-openshift-default-5c9fdf49b7-bfzmp"]
Jul 13 19:44:35.733909 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:44:35.733600    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-2555bb-openshift-default-5c9fdf49b7-bfzmp" podUID="c5919c33-b035-4613-968f-8d6b7ee239f4" containerName="istio-proxy" containerID="cri-o://826dac51af66b93e65709b5c8d907029ddfe841b428c279e4f7d43ede2fd3d52" gracePeriod=30
Jul 13 19:44:36.414424 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:44:36.414387    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-7cfd768f96-46tfq_6cb5f50f-7cf1-46fe-a17e-e82f7a943edb/authorino/0.log"
Jul 13 19:44:36.837543 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:44:36.837449    2563 patch_prober.go:28] interesting pod/e2e-shared-b-2555bb-openshift-default-5c9fdf49b7-bfzmp container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 13 19:44:36.837543 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:44:36.837521    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-2555bb-openshift-default-5c9fdf49b7-bfzmp" podUID="c5919c33-b035-4613-968f-8d6b7ee239f4" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 13 19:44:40.965742 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:44:40.965706    2563 generic.go:356] "Generic (PLEG): container finished" podID="c5919c33-b035-4613-968f-8d6b7ee239f4" containerID="826dac51af66b93e65709b5c8d907029ddfe841b428c279e4f7d43ede2fd3d52" exitCode=0
Jul 13 19:44:40.966223 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:44:40.965779    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-2555bb-openshift-default-5c9fdf49b7-bfzmp" event={"ID":"c5919c33-b035-4613-968f-8d6b7ee239f4","Type":"ContainerDied","Data":"826dac51af66b93e65709b5c8d907029ddfe841b428c279e4f7d43ede2fd3d52"}
Jul 13 19:44:40.966223 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:44:40.965848    2563 scope.go:117] "RemoveContainer" containerID="7948370a72da781917dda37558c410c9860fa2880ae39629d3c5c1158a7c34fc"
Jul 13 19:44:41.001150 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:44:41.001072    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-2555bb-openshift-default-5c9fdf49b7-bfzmp"
Jul 13 19:44:41.120009 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:44:41.119962    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c5919c33-b035-4613-968f-8d6b7ee239f4-istio-envoy\") pod \"c5919c33-b035-4613-968f-8d6b7ee239f4\" (UID: \"c5919c33-b035-4613-968f-8d6b7ee239f4\") "
Jul 13 19:44:41.120254 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:44:41.120074    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c5919c33-b035-4613-968f-8d6b7ee239f4-istio-token\") pod \"c5919c33-b035-4613-968f-8d6b7ee239f4\" (UID: \"c5919c33-b035-4613-968f-8d6b7ee239f4\") "
Jul 13 19:44:41.120254 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:44:41.120093    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c5919c33-b035-4613-968f-8d6b7ee239f4-istio-data\") pod \"c5919c33-b035-4613-968f-8d6b7ee239f4\" (UID: \"c5919c33-b035-4613-968f-8d6b7ee239f4\") "
Jul 13 19:44:41.120254 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:44:41.120122    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c5919c33-b035-4613-968f-8d6b7ee239f4-workload-certs\") pod \"c5919c33-b035-4613-968f-8d6b7ee239f4\" (UID: \"c5919c33-b035-4613-968f-8d6b7ee239f4\") "
Jul 13 19:44:41.120254 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:44:41.120155    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c5919c33-b035-4613-968f-8d6b7ee239f4-istiod-ca-cert\") pod \"c5919c33-b035-4613-968f-8d6b7ee239f4\" (UID: \"c5919c33-b035-4613-968f-8d6b7ee239f4\") "
Jul 13 19:44:41.120254 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:44:41.120178    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c5919c33-b035-4613-968f-8d6b7ee239f4-istio-podinfo\") pod \"c5919c33-b035-4613-968f-8d6b7ee239f4\" (UID: \"c5919c33-b035-4613-968f-8d6b7ee239f4\") "
Jul 13 19:44:41.120254 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:44:41.120224    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c5919c33-b035-4613-968f-8d6b7ee239f4-credential-socket\") pod \"c5919c33-b035-4613-968f-8d6b7ee239f4\" (UID: \"c5919c33-b035-4613-968f-8d6b7ee239f4\") "
Jul 13 19:44:41.120579 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:44:41.120275    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c5919c33-b035-4613-968f-8d6b7ee239f4-workload-socket\") pod \"c5919c33-b035-4613-968f-8d6b7ee239f4\" (UID: \"c5919c33-b035-4613-968f-8d6b7ee239f4\") "
Jul 13 19:44:41.120579 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:44:41.120298    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nmjgp\" (UniqueName: \"kubernetes.io/projected/c5919c33-b035-4613-968f-8d6b7ee239f4-kube-api-access-nmjgp\") pod \"c5919c33-b035-4613-968f-8d6b7ee239f4\" (UID: \"c5919c33-b035-4613-968f-8d6b7ee239f4\") "
Jul 13 19:44:41.120579 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:44:41.120473    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c5919c33-b035-4613-968f-8d6b7ee239f4-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "c5919c33-b035-4613-968f-8d6b7ee239f4" (UID: "c5919c33-b035-4613-968f-8d6b7ee239f4"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 19:44:41.120749 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:44:41.120576    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c5919c33-b035-4613-968f-8d6b7ee239f4-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "c5919c33-b035-4613-968f-8d6b7ee239f4" (UID: "c5919c33-b035-4613-968f-8d6b7ee239f4"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 19:44:41.120749 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:44:41.120606    2563 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c5919c33-b035-4613-968f-8d6b7ee239f4-workload-certs\") on node \"ip-10-0-135-38.ec2.internal\" DevicePath \"\""
Jul 13 19:44:41.120749 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:44:41.120662    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c5919c33-b035-4613-968f-8d6b7ee239f4-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "c5919c33-b035-4613-968f-8d6b7ee239f4" (UID: "c5919c33-b035-4613-968f-8d6b7ee239f4"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 19:44:41.120904 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:44:41.120829    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c5919c33-b035-4613-968f-8d6b7ee239f4-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "c5919c33-b035-4613-968f-8d6b7ee239f4" (UID: "c5919c33-b035-4613-968f-8d6b7ee239f4"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 19:44:41.121156 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:44:41.121126    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c5919c33-b035-4613-968f-8d6b7ee239f4-istio-data" (OuterVolumeSpecName: "istio-data") pod "c5919c33-b035-4613-968f-8d6b7ee239f4" (UID: "c5919c33-b035-4613-968f-8d6b7ee239f4"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 19:44:41.122355 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:44:41.122336    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c5919c33-b035-4613-968f-8d6b7ee239f4-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "c5919c33-b035-4613-968f-8d6b7ee239f4" (UID: "c5919c33-b035-4613-968f-8d6b7ee239f4"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 19:44:41.122782 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:44:41.122745    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/c5919c33-b035-4613-968f-8d6b7ee239f4-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "c5919c33-b035-4613-968f-8d6b7ee239f4" (UID: "c5919c33-b035-4613-968f-8d6b7ee239f4"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 13 19:44:41.122881 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:44:41.122809    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c5919c33-b035-4613-968f-8d6b7ee239f4-kube-api-access-nmjgp" (OuterVolumeSpecName: "kube-api-access-nmjgp") pod "c5919c33-b035-4613-968f-8d6b7ee239f4" (UID: "c5919c33-b035-4613-968f-8d6b7ee239f4"). InnerVolumeSpecName "kube-api-access-nmjgp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 19:44:41.122881 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:44:41.122821    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c5919c33-b035-4613-968f-8d6b7ee239f4-istio-token" (OuterVolumeSpecName: "istio-token") pod "c5919c33-b035-4613-968f-8d6b7ee239f4" (UID: "c5919c33-b035-4613-968f-8d6b7ee239f4"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 19:44:41.221595 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:44:41.221553    2563 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c5919c33-b035-4613-968f-8d6b7ee239f4-credential-socket\") on node \"ip-10-0-135-38.ec2.internal\" DevicePath \"\""
Jul 13 19:44:41.221595 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:44:41.221592    2563 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c5919c33-b035-4613-968f-8d6b7ee239f4-workload-socket\") on node \"ip-10-0-135-38.ec2.internal\" DevicePath \"\""
Jul 13 19:44:41.221595 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:44:41.221602    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nmjgp\" (UniqueName: \"kubernetes.io/projected/c5919c33-b035-4613-968f-8d6b7ee239f4-kube-api-access-nmjgp\") on node \"ip-10-0-135-38.ec2.internal\" DevicePath \"\""
Jul 13 19:44:41.221845 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:44:41.221612    2563 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c5919c33-b035-4613-968f-8d6b7ee239f4-istio-envoy\") on node \"ip-10-0-135-38.ec2.internal\" DevicePath \"\""
Jul 13 19:44:41.221845 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:44:41.221622    2563 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c5919c33-b035-4613-968f-8d6b7ee239f4-istio-token\") on node \"ip-10-0-135-38.ec2.internal\" DevicePath \"\""
Jul 13 19:44:41.221845 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:44:41.221630    2563 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c5919c33-b035-4613-968f-8d6b7ee239f4-istio-data\") on node \"ip-10-0-135-38.ec2.internal\" DevicePath \"\""
Jul 13 19:44:41.221845 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:44:41.221637    2563 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c5919c33-b035-4613-968f-8d6b7ee239f4-istiod-ca-cert\") on node \"ip-10-0-135-38.ec2.internal\" DevicePath \"\""
Jul 13 19:44:41.221845 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:44:41.221645    2563 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c5919c33-b035-4613-968f-8d6b7ee239f4-istio-podinfo\") on node \"ip-10-0-135-38.ec2.internal\" DevicePath \"\""
Jul 13 19:44:41.331364 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:44:41.331239    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-hl862_13f19b88-2eb9-4628-8780-bca323393344/manager/0.log"
Jul 13 19:44:41.453561 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:44:41.453526    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-wjnk2_cc5fca4f-78c6-4aec-9c96-0948352cfc2a/manager/0.log"
Jul 13 19:44:41.592909 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:44:41.592859    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-54f69f5bc-6gjlf_8a3c5b14-c469-4c18-a057-efc5929d6540/manager/0.log"
Jul 13 19:44:41.701475 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:44:41.701439    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-gpln8_937d7db5-088a-4878-8791-f08fb94d3c5d/server/0.log"
Jul 13 19:44:41.822122 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:44:41.822080    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-qd8xv_bb5e6d86-d9aa-4f76-80dc-c977031d23c8/manager/0.log"
Jul 13 19:44:41.972589 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:44:41.972494    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-2555bb-openshift-default-5c9fdf49b7-bfzmp" event={"ID":"c5919c33-b035-4613-968f-8d6b7ee239f4","Type":"ContainerDied","Data":"0da3613acdebe5c4c7186906136e06836a0e4f744e7bef384a030cb21e7e1f34"}
Jul 13 19:44:41.972589 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:44:41.972529    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-2555bb-openshift-default-5c9fdf49b7-bfzmp"
Jul 13 19:44:41.972589 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:44:41.972561    2563 scope.go:117] "RemoveContainer" containerID="826dac51af66b93e65709b5c8d907029ddfe841b428c279e4f7d43ede2fd3d52"
Jul 13 19:44:41.994547 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:44:41.994493    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-2555bb-openshift-default-5c9fdf49b7-bfzmp"]
Jul 13 19:44:41.998844 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:44:41.998815    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-2555bb-openshift-default-5c9fdf49b7-bfzmp"]
Jul 13 19:44:42.084322 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:44:42.084294    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-559f5498f-sc6bc_c4ad9c42-34fc-4532-ab29-e2fbfc5daba0/copy-manifests/0.log"
Jul 13 19:44:42.103078 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:44:42.103041    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-559f5498f-sc6bc_c4ad9c42-34fc-4532-ab29-e2fbfc5daba0/manager/0.log"
Jul 13 19:44:42.715711 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:44:42.715680    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29732835-5h2d2_d2285c04-809f-49bd-8035-8270fd22c544/cleanup/0.log"
Jul 13 19:44:42.755849 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:44:42.755809    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c5919c33-b035-4613-968f-8d6b7ee239f4" path="/var/lib/kubelet/pods/c5919c33-b035-4613-968f-8d6b7ee239f4/volumes"
Jul 13 19:44:42.825572 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:44:42.825543    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29732850-h5clk_700c4b18-72c3-4500-accd-457b12a57547/cleanup/0.log"
Jul 13 19:44:42.930876 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:44:42.930843    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-ait-0b1b2151-sdzjd_610cdef0-0f70-46d3-9766-277ab106e219/revoke-keys/1.log"
Jul 13 19:44:43.039489 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:44:43.039405    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-ait-84c88922-565ds_8dad2404-cf74-4960-9968-c1ec077d71a4/revoke-keys/0.log"
Jul 13 19:44:43.379693 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:44:43.379654    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-derive-c7ee59ed-lllf8_91d43f1f-0c21-4fbc-ba5b-82d708a14d0f/revoke-keys/0.log"
Jul 13 19:44:43.496297 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:44:43.496263    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-inf-a-d0bb2f-sch89_4c9300c7-7e99-4dca-98ad-37443399f9e4/revoke-keys/0.log"
Jul 13 19:44:43.727362 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:44:43.727268    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-migrate-481cf1cb-khbdp_0d46caf3-569a-486e-9063-582e159700cb/revoke-keys/0.log"
Jul 13 19:44:43.852197 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:44:43.852165    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-mt-97bb288c-6xln8_cddc99f3-c8b6-406b-be16-0fcb0a26b9bf/revoke-keys/0.log"
Jul 13 19:44:43.962110 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:44:43.962082    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-mt-be9a1497-p4kkg_05af24a8-1169-4437-9dcf-bc3f4998a9f5/revoke-keys/0.log"
Jul 13 19:44:44.297638 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:44:44.297603    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-69fb4594cf-rhpwb_58a2af2f-d24d-4944-a748-fbf2a6b1d796/postgres/0.log"
Jul 13 19:44:45.691419 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:44:45.691372    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-7cfd768f96-46tfq_6cb5f50f-7cf1-46fe-a17e-e82f7a943edb/authorino/0.log"
Jul 13 19:44:45.814744 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:44:45.814715    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-5sj5k_d53364f6-3e19-4780-aaf2-98967f9b26a9/manager/0.log"
Jul 13 19:44:45.934733 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:44:45.934700    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-knvxb_2bd6e0af-9a31-4376-aa3b-34b7084998c2/manager/0.log"
Jul 13 19:44:46.045731 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:44:46.045635    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-4f54b_0def2810-edcf-4e02-af68-35d4d55c228e/kuadrant-console-plugin/0.log"
Jul 13 19:44:46.171534 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:44:46.171499    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-nd95j_eaae9c37-a1a4-448c-b323-aa129e8ff55a/registry-server/0.log"
Jul 13 19:44:46.294286 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:44:46.294251    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-cfrst_ff9b7113-7ecb-4995-9bba-c2d4059125b0/manager/0.log"
Jul 13 19:44:47.228300 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:44:47.228261    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-85c9d98b58-tkb7k_f25c59ac-409e-4d56-9280-3a278164a11a/kube-auth-proxy/0.log"
Jul 13 19:44:47.353134 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:44:47.353098    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-7s4bt_4acae5fb-5b4e-4393-b00d-dfedc5dfef9a/istio-proxy/1.log"
Jul 13 19:44:47.604233 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:44:47.604199    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-f9b8d9b9b-s67kb_e93f0003-680f-4782-bb09-f56e5153051d/payload-processing/0.log"
Jul 13 19:44:48.059091 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:44:48.058994    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-qxvr5_440ab4c8-a1b2-4a51-94d3-d23e3ae75b17/main/0.log"
Jul 13 19:44:48.174567 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:44:48.174531    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-cbc2b_0031a856-9806-4736-b465-077eace7191d/main/0.log"
Jul 13 19:44:52.505790 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:44:52.505750    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-hts9g/must-gather-zpskn"]
Jul 13 19:44:52.506233 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:44:52.506149    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e326cc9f-51c7-45b2-9172-7546853ece45" containerName="test-curl-7640-140178893796384"
Jul 13 19:44:52.506233 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:44:52.506162    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="e326cc9f-51c7-45b2-9172-7546853ece45" containerName="test-curl-7640-140178893796384"
Jul 13 19:44:52.506233 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:44:52.506172    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e19906f3-7342-4f6f-bb79-f32dc0e39e74" containerName="istio-proxy"
Jul 13 19:44:52.506233 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:44:52.506178    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="e19906f3-7342-4f6f-bb79-f32dc0e39e74" containerName="istio-proxy"
Jul 13 19:44:52.506233 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:44:52.506185    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e19906f3-7342-4f6f-bb79-f32dc0e39e74" containerName="istio-proxy"
Jul 13 19:44:52.506233 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:44:52.506191    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="e19906f3-7342-4f6f-bb79-f32dc0e39e74" containerName="istio-proxy"
Jul 13 19:44:52.506233 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:44:52.506199    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c5919c33-b035-4613-968f-8d6b7ee239f4" containerName="istio-proxy"
Jul 13 19:44:52.506233 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:44:52.506204    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="c5919c33-b035-4613-968f-8d6b7ee239f4" containerName="istio-proxy"
Jul 13 19:44:52.506233 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:44:52.506212    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c5919c33-b035-4613-968f-8d6b7ee239f4" containerName="istio-proxy"
Jul 13 19:44:52.506233 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:44:52.506219    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="c5919c33-b035-4613-968f-8d6b7ee239f4" containerName="istio-proxy"
Jul 13 19:44:52.506541 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:44:52.506271    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="e326cc9f-51c7-45b2-9172-7546853ece45" containerName="test-curl-7640-140178893796384"
Jul 13 19:44:52.506541 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:44:52.506281    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="c5919c33-b035-4613-968f-8d6b7ee239f4" containerName="istio-proxy"
Jul 13 19:44:52.506541 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:44:52.506286    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="c5919c33-b035-4613-968f-8d6b7ee239f4" containerName="istio-proxy"
Jul 13 19:44:52.506541 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:44:52.506292    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="e19906f3-7342-4f6f-bb79-f32dc0e39e74" containerName="istio-proxy"
Jul 13 19:44:52.506541 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:44:52.506298    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="e19906f3-7342-4f6f-bb79-f32dc0e39e74" containerName="istio-proxy"
Jul 13 19:44:52.510870 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:44:52.510849    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-hts9g/must-gather-zpskn"
Jul 13 19:44:52.513440 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:44:52.513412    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-hts9g\"/\"kube-root-ca.crt\""
Jul 13 19:44:52.513596 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:44:52.513412    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-hts9g\"/\"openshift-service-ca.crt\""
Jul 13 19:44:52.514051 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:44:52.514034    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-hts9g\"/\"default-dockercfg-jhzhj\""
Jul 13 19:44:52.520668 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:44:52.520643    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-hts9g/must-gather-zpskn"]
Jul 13 19:44:52.624112 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:44:52.624069    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-45twb\" (UniqueName: \"kubernetes.io/projected/120f4b20-6d89-4696-9b12-0f45e2c168f2-kube-api-access-45twb\") pod \"must-gather-zpskn\" (UID: \"120f4b20-6d89-4696-9b12-0f45e2c168f2\") " pod="openshift-must-gather-hts9g/must-gather-zpskn"
Jul 13 19:44:52.624314 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:44:52.624217    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/120f4b20-6d89-4696-9b12-0f45e2c168f2-must-gather-output\") pod \"must-gather-zpskn\" (UID: \"120f4b20-6d89-4696-9b12-0f45e2c168f2\") " pod="openshift-must-gather-hts9g/must-gather-zpskn"
Jul 13 19:44:52.725610 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:44:52.725550    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/120f4b20-6d89-4696-9b12-0f45e2c168f2-must-gather-output\") pod \"must-gather-zpskn\" (UID: \"120f4b20-6d89-4696-9b12-0f45e2c168f2\") " pod="openshift-must-gather-hts9g/must-gather-zpskn"
Jul 13 19:44:52.725610 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:44:52.725622    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-45twb\" (UniqueName: \"kubernetes.io/projected/120f4b20-6d89-4696-9b12-0f45e2c168f2-kube-api-access-45twb\") pod \"must-gather-zpskn\" (UID: \"120f4b20-6d89-4696-9b12-0f45e2c168f2\") " pod="openshift-must-gather-hts9g/must-gather-zpskn"
Jul 13 19:44:52.725921 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:44:52.725899    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/120f4b20-6d89-4696-9b12-0f45e2c168f2-must-gather-output\") pod \"must-gather-zpskn\" (UID: \"120f4b20-6d89-4696-9b12-0f45e2c168f2\") " pod="openshift-must-gather-hts9g/must-gather-zpskn"
Jul 13 19:44:52.743292 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:44:52.743261    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-45twb\" (UniqueName: \"kubernetes.io/projected/120f4b20-6d89-4696-9b12-0f45e2c168f2-kube-api-access-45twb\") pod \"must-gather-zpskn\" (UID: \"120f4b20-6d89-4696-9b12-0f45e2c168f2\") " pod="openshift-must-gather-hts9g/must-gather-zpskn"
Jul 13 19:44:52.822065 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:44:52.821953    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-hts9g/must-gather-zpskn"
Jul 13 19:44:52.962770 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:44:52.962744    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-hts9g/must-gather-zpskn"]
Jul 13 19:44:52.964978 ip-10-0-135-38 kubenswrapper[2563]: W0713 19:44:52.964947    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod120f4b20_6d89_4696_9b12_0f45e2c168f2.slice/crio-d0570a211c570291f5a277623fcbf49df43f70d5ce3c21decca86bde301c4b39 WatchSource:0}: Error finding container d0570a211c570291f5a277623fcbf49df43f70d5ce3c21decca86bde301c4b39: Status 404 returned error can't find the container with id d0570a211c570291f5a277623fcbf49df43f70d5ce3c21decca86bde301c4b39
Jul 13 19:44:53.032292 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:44:53.032255    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-hts9g/must-gather-zpskn" event={"ID":"120f4b20-6d89-4696-9b12-0f45e2c168f2","Type":"ContainerStarted","Data":"d0570a211c570291f5a277623fcbf49df43f70d5ce3c21decca86bde301c4b39"}
Jul 13 19:44:55.051175 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:44:55.051127    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-hts9g/must-gather-zpskn" event={"ID":"120f4b20-6d89-4696-9b12-0f45e2c168f2","Type":"ContainerStarted","Data":"e72dbf0310a6c6cdc10385d5d2e361504cccfeead81490512586f1f386ea28fa"}
Jul 13 19:44:55.051693 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:44:55.051192    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-hts9g/must-gather-zpskn" event={"ID":"120f4b20-6d89-4696-9b12-0f45e2c168f2","Type":"ContainerStarted","Data":"13729533c72aaf5b7c424443e846eacf67fa3ed3986720e38af8581c6263f0a3"}
Jul 13 19:44:55.070732 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:44:55.070664    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-hts9g/must-gather-zpskn" podStartSLOduration=1.984602643 podStartE2EDuration="3.070642111s" totalImagesPullingTime="1.086039468s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 19:44:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 19:44:55.067522012 +0000 UTC m=+2782.842398369" watchObservedRunningTime="2026-07-13 19:44:55.070642111 +0000 UTC m=+2782.845518466"
Jul 13 19:44:55.695007 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:44:55.694966    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-b7ptz_aba89b91-cc04-4c11-8692-1c17006f5f7a/global-pull-secret-syncer/0.log"
Jul 13 19:44:55.982289 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:44:55.982180    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-n59kb_7223a804-aca6-480f-9443-f129f82d33b5/konnectivity-agent/0.log"
Jul 13 19:44:56.075532 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:44:56.075497    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-135-38.ec2.internal_9c30996778b0a4a51abebd056dde6bd9/haproxy/0.log"
Jul 13 19:45:00.965288 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:45:00.964393    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-7cfd768f96-46tfq_6cb5f50f-7cf1-46fe-a17e-e82f7a943edb/authorino/0.log"
Jul 13 19:45:01.003476 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:45:01.003434    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-5sj5k_d53364f6-3e19-4780-aaf2-98967f9b26a9/manager/0.log"
Jul 13 19:45:01.036233 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:45:01.036196    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-knvxb_2bd6e0af-9a31-4376-aa3b-34b7084998c2/manager/0.log"
Jul 13 19:45:01.066359 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:45:01.066324    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-4f54b_0def2810-edcf-4e02-af68-35d4d55c228e/kuadrant-console-plugin/0.log"
Jul 13 19:45:01.126045 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:45:01.125233    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-nd95j_eaae9c37-a1a4-448c-b323-aa129e8ff55a/registry-server/0.log"
Jul 13 19:45:01.322465 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:45:01.322361    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-cfrst_ff9b7113-7ecb-4995-9bba-c2d4059125b0/manager/0.log"
Jul 13 19:45:03.828281 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:45:03.828240    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-jc5v8_68b03403-477c-48c2-9bd6-dc8836fcbdfa/node-exporter/0.log"
Jul 13 19:45:03.852465 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:45:03.852429    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-jc5v8_68b03403-477c-48c2-9bd6-dc8836fcbdfa/kube-rbac-proxy/0.log"
Jul 13 19:45:03.875268 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:45:03.875168    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-jc5v8_68b03403-477c-48c2-9bd6-dc8836fcbdfa/init-textfile/0.log"
Jul 13 19:45:06.649188 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:45:06.649139    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-hts9g/perf-node-gather-daemonset-dpbg8"]
Jul 13 19:45:06.656985 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:45:06.656942    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-hts9g/perf-node-gather-daemonset-dpbg8"
Jul 13 19:45:06.659866 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:45:06.659786    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-hts9g/perf-node-gather-daemonset-dpbg8"]
Jul 13 19:45:06.712112 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:45:06.712061    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/b07495f1-0aa6-4049-8b7b-d482c7a5c8a0-proc\") pod \"perf-node-gather-daemonset-dpbg8\" (UID: \"b07495f1-0aa6-4049-8b7b-d482c7a5c8a0\") " pod="openshift-must-gather-hts9g/perf-node-gather-daemonset-dpbg8"
Jul 13 19:45:06.712330 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:45:06.712188    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b07495f1-0aa6-4049-8b7b-d482c7a5c8a0-sys\") pod \"perf-node-gather-daemonset-dpbg8\" (UID: \"b07495f1-0aa6-4049-8b7b-d482c7a5c8a0\") " pod="openshift-must-gather-hts9g/perf-node-gather-daemonset-dpbg8"
Jul 13 19:45:06.712400 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:45:06.712340    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q9mbf\" (UniqueName: \"kubernetes.io/projected/b07495f1-0aa6-4049-8b7b-d482c7a5c8a0-kube-api-access-q9mbf\") pod \"perf-node-gather-daemonset-dpbg8\" (UID: \"b07495f1-0aa6-4049-8b7b-d482c7a5c8a0\") " pod="openshift-must-gather-hts9g/perf-node-gather-daemonset-dpbg8"
Jul 13 19:45:06.712461 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:45:06.712414    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b07495f1-0aa6-4049-8b7b-d482c7a5c8a0-lib-modules\") pod \"perf-node-gather-daemonset-dpbg8\" (UID: \"b07495f1-0aa6-4049-8b7b-d482c7a5c8a0\") " pod="openshift-must-gather-hts9g/perf-node-gather-daemonset-dpbg8"
Jul 13 19:45:06.712516 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:45:06.712488    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/b07495f1-0aa6-4049-8b7b-d482c7a5c8a0-podres\") pod \"perf-node-gather-daemonset-dpbg8\" (UID: \"b07495f1-0aa6-4049-8b7b-d482c7a5c8a0\") " pod="openshift-must-gather-hts9g/perf-node-gather-daemonset-dpbg8"
Jul 13 19:45:06.813374 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:45:06.813321    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q9mbf\" (UniqueName: \"kubernetes.io/projected/b07495f1-0aa6-4049-8b7b-d482c7a5c8a0-kube-api-access-q9mbf\") pod \"perf-node-gather-daemonset-dpbg8\" (UID: \"b07495f1-0aa6-4049-8b7b-d482c7a5c8a0\") " pod="openshift-must-gather-hts9g/perf-node-gather-daemonset-dpbg8"
Jul 13 19:45:06.813593 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:45:06.813400    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b07495f1-0aa6-4049-8b7b-d482c7a5c8a0-lib-modules\") pod \"perf-node-gather-daemonset-dpbg8\" (UID: \"b07495f1-0aa6-4049-8b7b-d482c7a5c8a0\") " pod="openshift-must-gather-hts9g/perf-node-gather-daemonset-dpbg8"
Jul 13 19:45:06.813593 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:45:06.813446    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/b07495f1-0aa6-4049-8b7b-d482c7a5c8a0-podres\") pod \"perf-node-gather-daemonset-dpbg8\" (UID: \"b07495f1-0aa6-4049-8b7b-d482c7a5c8a0\") " pod="openshift-must-gather-hts9g/perf-node-gather-daemonset-dpbg8"
Jul 13 19:45:06.813593 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:45:06.813487    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/b07495f1-0aa6-4049-8b7b-d482c7a5c8a0-proc\") pod \"perf-node-gather-daemonset-dpbg8\" (UID: \"b07495f1-0aa6-4049-8b7b-d482c7a5c8a0\") " pod="openshift-must-gather-hts9g/perf-node-gather-daemonset-dpbg8"
Jul 13 19:45:06.813593 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:45:06.813541    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b07495f1-0aa6-4049-8b7b-d482c7a5c8a0-sys\") pod \"perf-node-gather-daemonset-dpbg8\" (UID: \"b07495f1-0aa6-4049-8b7b-d482c7a5c8a0\") " pod="openshift-must-gather-hts9g/perf-node-gather-daemonset-dpbg8"
Jul 13 19:45:06.813829 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:45:06.813683    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b07495f1-0aa6-4049-8b7b-d482c7a5c8a0-sys\") pod \"perf-node-gather-daemonset-dpbg8\" (UID: \"b07495f1-0aa6-4049-8b7b-d482c7a5c8a0\") " pod="openshift-must-gather-hts9g/perf-node-gather-daemonset-dpbg8"
Jul 13 19:45:06.814256 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:45:06.814225    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b07495f1-0aa6-4049-8b7b-d482c7a5c8a0-lib-modules\") pod \"perf-node-gather-daemonset-dpbg8\" (UID: \"b07495f1-0aa6-4049-8b7b-d482c7a5c8a0\") " pod="openshift-must-gather-hts9g/perf-node-gather-daemonset-dpbg8"
Jul 13 19:45:06.814405 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:45:06.814325    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/b07495f1-0aa6-4049-8b7b-d482c7a5c8a0-podres\") pod \"perf-node-gather-daemonset-dpbg8\" (UID: \"b07495f1-0aa6-4049-8b7b-d482c7a5c8a0\") " pod="openshift-must-gather-hts9g/perf-node-gather-daemonset-dpbg8"
Jul 13 19:45:06.814405 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:45:06.814375    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/b07495f1-0aa6-4049-8b7b-d482c7a5c8a0-proc\") pod \"perf-node-gather-daemonset-dpbg8\" (UID: \"b07495f1-0aa6-4049-8b7b-d482c7a5c8a0\") " pod="openshift-must-gather-hts9g/perf-node-gather-daemonset-dpbg8"
Jul 13 19:45:06.823187 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:45:06.823151    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q9mbf\" (UniqueName: \"kubernetes.io/projected/b07495f1-0aa6-4049-8b7b-d482c7a5c8a0-kube-api-access-q9mbf\") pod \"perf-node-gather-daemonset-dpbg8\" (UID: \"b07495f1-0aa6-4049-8b7b-d482c7a5c8a0\") " pod="openshift-must-gather-hts9g/perf-node-gather-daemonset-dpbg8"
Jul 13 19:45:06.972806 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:45:06.972693    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-hts9g/perf-node-gather-daemonset-dpbg8"
Jul 13 19:45:07.157103 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:45:07.156666    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-hts9g/perf-node-gather-daemonset-dpbg8"]
Jul 13 19:45:07.161664 ip-10-0-135-38 kubenswrapper[2563]: W0713 19:45:07.161623    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podb07495f1_0aa6_4049_8b7b_d482c7a5c8a0.slice/crio-042fa882b5e39ae5787fd9406e14fc31a0ad40947bee2c159e7b0b424d81e536 WatchSource:0}: Error finding container 042fa882b5e39ae5787fd9406e14fc31a0ad40947bee2c159e7b0b424d81e536: Status 404 returned error can't find the container with id 042fa882b5e39ae5787fd9406e14fc31a0ad40947bee2c159e7b0b424d81e536
Jul 13 19:45:08.160482 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:45:08.160432    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-hts9g/perf-node-gather-daemonset-dpbg8" event={"ID":"b07495f1-0aa6-4049-8b7b-d482c7a5c8a0","Type":"ContainerStarted","Data":"4341d52a50d887d90b6cdcb94851c507ebdff8e0b80e15c0f215370fedda47e2"}
Jul 13 19:45:08.160977 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:45:08.160517    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-hts9g/perf-node-gather-daemonset-dpbg8" event={"ID":"b07495f1-0aa6-4049-8b7b-d482c7a5c8a0","Type":"ContainerStarted","Data":"042fa882b5e39ae5787fd9406e14fc31a0ad40947bee2c159e7b0b424d81e536"}
Jul 13 19:45:08.161143 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:45:08.160967    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-hts9g/perf-node-gather-daemonset-dpbg8"
Jul 13 19:45:08.181638 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:45:08.181568    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-hts9g/perf-node-gather-daemonset-dpbg8" podStartSLOduration=2.181545482 podStartE2EDuration="2.181545482s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 19:45:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 19:45:08.17916079 +0000 UTC m=+2795.954037167" watchObservedRunningTime="2026-07-13 19:45:08.181545482 +0000 UTC m=+2795.956421839"
Jul 13 19:45:08.761425 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:45:08.761392    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-99pgk_9d10d62c-2d07-4e0f-886d-c2655493b867/dns/0.log"
Jul 13 19:45:08.787377 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:45:08.787341    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-99pgk_9d10d62c-2d07-4e0f-886d-c2655493b867/kube-rbac-proxy/0.log"
Jul 13 19:45:09.048967 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:45:09.048875    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-jrzv2_09aa4086-5243-477a-aa13-3b0c054d764a/dns-node-resolver/0.log"
Jul 13 19:45:09.612076 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:45:09.612041    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-7dc86c76b9-z2vt7_53a3c346-54ba-4102-b222-db8a5c3f303f/registry/0.log"
Jul 13 19:45:09.655960 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:45:09.655924    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-ghl52_f5d7f580-f8e8-42f5-8d25-0fdb212f30c8/node-ca/0.log"
Jul 13 19:45:10.863750 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:45:10.863722    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-85c9d98b58-tkb7k_f25c59ac-409e-4d56-9280-3a278164a11a/kube-auth-proxy/0.log"
Jul 13 19:45:10.893568 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:45:10.893536    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-7s4bt_4acae5fb-5b4e-4393-b00d-dfedc5dfef9a/istio-proxy/0.log"
Jul 13 19:45:10.961827 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:45:10.961790    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-7s4bt_4acae5fb-5b4e-4393-b00d-dfedc5dfef9a/istio-proxy/1.log"
Jul 13 19:45:11.034755 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:45:11.034721    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-f9b8d9b9b-s67kb_e93f0003-680f-4782-bb09-f56e5153051d/payload-processing/0.log"
Jul 13 19:45:11.786777 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:45:11.786742    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-lfx47_aac9bfb1-117e-40fa-ac83-d47cc1a55908/serve-healthcheck-canary/0.log"
Jul 13 19:45:12.345663 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:45:12.345632    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-2lg9f_5ada439c-465d-4679-93ee-b2bd1271a4c0/kube-rbac-proxy/0.log"
Jul 13 19:45:12.367520 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:45:12.367483    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-2lg9f_5ada439c-465d-4679-93ee-b2bd1271a4c0/exporter/0.log"
Jul 13 19:45:12.391267 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:45:12.391223    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-2lg9f_5ada439c-465d-4679-93ee-b2bd1271a4c0/extractor/0.log"
Jul 13 19:45:14.182598 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:45:14.182560    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-hts9g/perf-node-gather-daemonset-dpbg8"
Jul 13 19:45:14.727437 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:45:14.727398    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-hl862_13f19b88-2eb9-4628-8780-bca323393344/manager/0.log"
Jul 13 19:45:14.992432 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:45:14.992346    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-wjnk2_cc5fca4f-78c6-4aec-9c96-0948352cfc2a/manager/0.log"
Jul 13 19:45:15.280642 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:45:15.280549    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-54f69f5bc-6gjlf_8a3c5b14-c469-4c18-a057-efc5929d6540/manager/0.log"
Jul 13 19:45:15.311267 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:45:15.311232    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-gpln8_937d7db5-088a-4878-8791-f08fb94d3c5d/server/0.log"
Jul 13 19:45:15.458270 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:45:15.458228    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-qd8xv_bb5e6d86-d9aa-4f76-80dc-c977031d23c8/manager/0.log"
Jul 13 19:45:15.654244 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:45:15.654205    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-559f5498f-sc6bc_c4ad9c42-34fc-4532-ab29-e2fbfc5daba0/manager/0.log"
Jul 13 19:45:15.685271 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:45:15.685220    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-559f5498f-sc6bc_c4ad9c42-34fc-4532-ab29-e2fbfc5daba0/copy-manifests/0.log"
Jul 13 19:45:18.056168 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:45:18.056134    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-85c9d98b58-tkb7k_f25c59ac-409e-4d56-9280-3a278164a11a/kube-auth-proxy/0.log"
Jul 13 19:45:18.080104 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:45:18.080059    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-7s4bt_4acae5fb-5b4e-4393-b00d-dfedc5dfef9a/istio-proxy/0.log"
Jul 13 19:45:18.156473 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:45:18.156329    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-7s4bt_4acae5fb-5b4e-4393-b00d-dfedc5dfef9a/istio-proxy/1.log"
Jul 13 19:45:18.211100 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:45:18.211061    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-f9b8d9b9b-s67kb_e93f0003-680f-4782-bb09-f56e5153051d/payload-processing/0.log"
Jul 13 19:45:19.707740 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:45:19.707696    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-85c9d98b58-tkb7k_f25c59ac-409e-4d56-9280-3a278164a11a/kube-auth-proxy/0.log"
Jul 13 19:45:19.735403 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:45:19.735357    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-7s4bt_4acae5fb-5b4e-4393-b00d-dfedc5dfef9a/istio-proxy/0.log"
Jul 13 19:45:19.802694 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:45:19.802647    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-7s4bt_4acae5fb-5b4e-4393-b00d-dfedc5dfef9a/istio-proxy/1.log"
Jul 13 19:45:19.863415 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:45:19.863362    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-f9b8d9b9b-s67kb_e93f0003-680f-4782-bb09-f56e5153051d/payload-processing/0.log"
Jul 13 19:45:24.372134 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:45:24.372098    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-nkdq7_b26f5a70-1ec7-4056-9658-25878216543f/kube-multus-additional-cni-plugins/0.log"
Jul 13 19:45:24.396712 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:45:24.396684    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-nkdq7_b26f5a70-1ec7-4056-9658-25878216543f/egress-router-binary-copy/0.log"
Jul 13 19:45:24.420099 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:45:24.420061    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-nkdq7_b26f5a70-1ec7-4056-9658-25878216543f/cni-plugins/0.log"
Jul 13 19:45:24.442896 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:45:24.442861    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-nkdq7_b26f5a70-1ec7-4056-9658-25878216543f/bond-cni-plugin/0.log"
Jul 13 19:45:24.465243 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:45:24.465191    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-nkdq7_b26f5a70-1ec7-4056-9658-25878216543f/routeoverride-cni/0.log"
Jul 13 19:45:24.491871 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:45:24.491837    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-nkdq7_b26f5a70-1ec7-4056-9658-25878216543f/whereabouts-cni-bincopy/0.log"
Jul 13 19:45:24.513976 ip-10-0-135-38 kubenswrapper[2563]: I0713 19:45:24.513949    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-nkdq7_b26f5a70-1ec7-4056-9658-25878216543f/whereabouts-cni/0.log"