Jul 18 11:19:40.255245 ip-10-0-133-122 systemd[1]: Starting Kubernetes Kubelet...
Jul 18 11:19:40.722693 ip-10-0-133-122 kubenswrapper[2579]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 18 11:19:40.722693 ip-10-0-133-122 kubenswrapper[2579]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 18 11:19:40.722693 ip-10-0-133-122 kubenswrapper[2579]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 18 11:19:40.722693 ip-10-0-133-122 kubenswrapper[2579]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 18 11:19:40.722693 ip-10-0-133-122 kubenswrapper[2579]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 18 11:19:40.722693 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:40.718289    2579 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 18 11:19:40.742989 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.724297    2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 18 11:19:40.742989 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.724310    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 18 11:19:40.742989 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.724313    2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 18 11:19:40.742989 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.724317    2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 18 11:19:40.742989 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.724321    2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 18 11:19:40.742989 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.724323    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 18 11:19:40.742989 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.724326    2579 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 18 11:19:40.742989 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.724329    2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 18 11:19:40.742989 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.724331    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 18 11:19:40.742989 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.724335    2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 18 11:19:40.742989 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.724337    2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 18 11:19:40.742989 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.724340    2579 feature_gate.go:328] unrecognized feature gate: Example2
Jul 18 11:19:40.742989 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.724343    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 18 11:19:40.742989 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.724346    2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 18 11:19:40.742989 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.724348    2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 18 11:19:40.742989 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.724351    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 18 11:19:40.742989 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.724353    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 18 11:19:40.742989 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.724356    2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 18 11:19:40.742989 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.724358    2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 18 11:19:40.746522 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.724363    2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 18 11:19:40.746522 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.724367    2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 18 11:19:40.746522 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.724376    2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 18 11:19:40.746522 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.724380    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 18 11:19:40.746522 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.724383    2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 18 11:19:40.746522 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.724386    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 18 11:19:40.746522 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.724389    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 18 11:19:40.746522 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.724392    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 18 11:19:40.746522 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.724395    2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 18 11:19:40.746522 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.724397    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 18 11:19:40.746522 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.724400    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 18 11:19:40.746522 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.724403    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 18 11:19:40.746522 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.724406    2579 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 18 11:19:40.746522 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.724409    2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 18 11:19:40.746522 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.724412    2579 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 18 11:19:40.746522 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.724414    2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 18 11:19:40.746522 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.724418    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 18 11:19:40.746522 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.724421    2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 18 11:19:40.746522 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.724424    2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 18 11:19:40.760933 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.724426    2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 18 11:19:40.760933 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.724429    2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 18 11:19:40.760933 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.724432    2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 18 11:19:40.760933 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.724435    2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 18 11:19:40.760933 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.724437    2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 18 11:19:40.760933 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.724440    2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 18 11:19:40.760933 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.724442    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 18 11:19:40.760933 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.724446    2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 18 11:19:40.760933 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.724450    2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 18 11:19:40.760933 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.724453    2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 18 11:19:40.760933 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.724456    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 18 11:19:40.760933 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.724458    2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 18 11:19:40.760933 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.724461    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 18 11:19:40.760933 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.724464    2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 18 11:19:40.760933 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.724466    2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 18 11:19:40.760933 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.724469    2579 feature_gate.go:328] unrecognized feature gate: Example
Jul 18 11:19:40.760933 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.724472    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 18 11:19:40.760933 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.724474    2579 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 18 11:19:40.760933 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.724477    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 18 11:19:40.763696 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.724479    2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 18 11:19:40.763696 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.724482    2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 18 11:19:40.763696 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.724484    2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 18 11:19:40.763696 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.724487    2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 18 11:19:40.763696 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.724489    2579 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 18 11:19:40.763696 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.724492    2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 18 11:19:40.763696 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.724495    2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 18 11:19:40.763696 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.724498    2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 18 11:19:40.763696 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.724502    2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 18 11:19:40.763696 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.724505    2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 18 11:19:40.763696 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.724508    2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 18 11:19:40.763696 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.724510    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 18 11:19:40.763696 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.724513    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 18 11:19:40.763696 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.724515    2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 18 11:19:40.763696 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.724518    2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 18 11:19:40.763696 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.724522    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 18 11:19:40.763696 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.724524    2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 18 11:19:40.763696 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.724527    2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 18 11:19:40.763696 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.724529    2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 18 11:19:40.794665 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.724532    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 18 11:19:40.794665 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.724534    2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 18 11:19:40.794665 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.724537    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 18 11:19:40.794665 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.724539    2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 18 11:19:40.794665 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.724542    2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 18 11:19:40.794665 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.724544    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 18 11:19:40.794665 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.724547    2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 18 11:19:40.794665 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.724549    2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 18 11:19:40.794665 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.724551    2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 18 11:19:40.794665 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.724554    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 18 11:19:40.794665 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.724556    2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 18 11:19:40.794665 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.724559    2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 18 11:19:40.794665 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.724562    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 18 11:19:40.794665 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.724565    2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 18 11:19:40.794665 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.724567    2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 18 11:19:40.794665 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.724570    2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 18 11:19:40.794665 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.724572    2579 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 18 11:19:40.794665 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.724575    2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 18 11:19:40.794665 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.724578    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 18 11:19:40.794665 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.724581    2579 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 18 11:19:40.809954 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.724583    2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 18 11:19:40.809954 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.724586    2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 18 11:19:40.809954 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.724588    2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 18 11:19:40.809954 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.727780    2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 18 11:19:40.809954 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.727794    2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 18 11:19:40.809954 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.727800    2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 18 11:19:40.809954 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.727804    2579 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 18 11:19:40.809954 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.727807    2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 18 11:19:40.809954 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.727810    2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 18 11:19:40.809954 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.727813    2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 18 11:19:40.809954 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.727816    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 18 11:19:40.809954 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.727818    2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 18 11:19:40.809954 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.727821    2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 18 11:19:40.809954 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.727824    2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 18 11:19:40.809954 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.727827    2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 18 11:19:40.809954 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.727829    2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 18 11:19:40.809954 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.727832    2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 18 11:19:40.809954 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.727835    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 18 11:19:40.809954 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.727838    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 18 11:19:40.808573 ip-10-0-133-122 systemd[1]: Started Kubernetes Kubelet.
Jul 18 11:19:40.812226 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.727842    2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 18 11:19:40.812226 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.727847    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 18 11:19:40.812226 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.727850    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 18 11:19:40.812226 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.727853    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 18 11:19:40.812226 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.727856    2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 18 11:19:40.812226 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.727859    2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 18 11:19:40.812226 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.727862    2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 18 11:19:40.812226 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.727865    2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 18 11:19:40.812226 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.727868    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 18 11:19:40.812226 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.727871    2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 18 11:19:40.812226 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.727874    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 18 11:19:40.812226 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.727879    2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 18 11:19:40.812226 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.727883    2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 18 11:19:40.812226 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.727896    2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 18 11:19:40.812226 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.727901    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 18 11:19:40.812226 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.727903    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 18 11:19:40.812226 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.727906    2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 18 11:19:40.812226 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.727909    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 18 11:19:40.812226 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.727912    2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 18 11:19:40.813727 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.727914    2579 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 18 11:19:40.813727 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.727917    2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 18 11:19:40.813727 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.727919    2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 18 11:19:40.813727 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.727922    2579 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 18 11:19:40.813727 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.727925    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 18 11:19:40.813727 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.727927    2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 18 11:19:40.813727 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.727930    2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 18 11:19:40.813727 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.727932    2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 18 11:19:40.813727 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.727935    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 18 11:19:40.813727 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.727938    2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 18 11:19:40.813727 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.727941    2579 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 18 11:19:40.813727 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.727944    2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 18 11:19:40.813727 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.727947    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 18 11:19:40.813727 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.727949    2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 18 11:19:40.813727 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.727952    2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 18 11:19:40.813727 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.727962    2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 18 11:19:40.813727 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.727965    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 18 11:19:40.813727 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.727968    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 18 11:19:40.813727 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.727971    2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 18 11:19:40.813727 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.727973    2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 18 11:19:40.829144 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.727975    2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 18 11:19:40.829144 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.727978    2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 18 11:19:40.829144 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.727981    2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 18 11:19:40.829144 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.727984    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 18 11:19:40.829144 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.727986    2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 18 11:19:40.829144 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.727989    2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 18 11:19:40.829144 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.727991    2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 18 11:19:40.829144 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.727994    2579 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 18 11:19:40.829144 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.727997    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 18 11:19:40.829144 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.727999    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 18 11:19:40.829144 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.728002    2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 18 11:19:40.829144 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.728005    2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 18 11:19:40.829144 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.728007    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 18 11:19:40.829144 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.728010    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 18 11:19:40.829144 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.728013    2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 18 11:19:40.829144 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.728016    2579 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 18 11:19:40.829144 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.728018    2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 18 11:19:40.829144 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.728021    2579 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 18 11:19:40.829144 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.728024    2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 18 11:19:40.829144 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.728026    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 18 11:19:40.832543 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.728029    2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 18 11:19:40.832543 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.728032    2579 feature_gate.go:328] unrecognized feature gate: Example2
Jul 18 11:19:40.832543 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.728034    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 18 11:19:40.832543 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.728038    2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 18 11:19:40.832543 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.728041    2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 18 11:19:40.832543 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.728044    2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 18 11:19:40.832543 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.728046    2579 feature_gate.go:328] unrecognized feature gate: Example
Jul 18 11:19:40.832543 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.728049    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 18 11:19:40.832543 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.728056    2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 18 11:19:40.832543 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.728060    2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 18 11:19:40.832543 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.728064    2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 18 11:19:40.832543 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.728067    2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 18 11:19:40.832543 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.728070    2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 18 11:19:40.832543 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.728073    2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 18 11:19:40.832543 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.728075    2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 18 11:19:40.832543 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.728078    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 18 11:19:40.832543 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.728081    2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 18 11:19:40.832543 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.728083    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 18 11:19:40.832543 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.728086    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 18 11:19:40.989860 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.728088    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 18 11:19:40.989860 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.728091    2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 18 11:19:40.989860 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.728093    2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 18 11:19:40.989860 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.728096    2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 18 11:19:40.989860 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.728098    2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 18 11:19:40.989860 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.728496    2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 18 11:19:40.989860 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.728503    2579 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 18 11:19:40.989860 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.728506    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 18 11:19:40.989860 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.728509    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 18 11:19:40.989860 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.728512    2579 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 18 11:19:40.989860 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.728514    2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 18 11:19:40.989860 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.728517    2579 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 18 11:19:40.989860 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.728520    2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 18 11:19:40.989860 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.728524    2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 18 11:19:40.989860 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.728527    2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 18 11:19:40.989860 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.728530    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 18 11:19:40.989860 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.728533    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 18 11:19:40.989860 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.728536    2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 18 11:19:40.989860 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.728539    2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 18 11:19:40.989860 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.728542    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 18 11:19:40.990686 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.728545    2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 18 11:19:40.990686 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.728548    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 18 11:19:40.990686 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.728551    2579 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 18 11:19:40.990686 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.728553    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 18 11:19:40.990686 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.728556    2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 18 11:19:40.990686 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.728559    2579 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 18 11:19:40.990686 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.728563    2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 18 11:19:40.990686 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.728566    2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 18 11:19:40.990686 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.728568    2579 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 18 11:19:40.990686 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.728571    2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 18 11:19:40.990686 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.728574    2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 18 11:19:40.990686 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.728576    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 18 11:19:40.990686 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.728579    2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 18 11:19:40.990686 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.728581    2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 18 11:19:40.990686 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.728584    2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 18 11:19:40.990686 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.728586    2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 18 11:19:40.990686 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.728591    2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 18 11:19:40.990686 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.728594    2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 18 11:19:40.990686 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.728597    2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 18 11:19:40.990686 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.728600    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 18 11:19:40.991402 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.728603    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 18 11:19:40.991402 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.728605    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 18 11:19:40.991402 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.728607    2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 18 11:19:40.991402 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.728610    2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 18 11:19:40.991402 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.728613    2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 18 11:19:40.991402 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.728615    2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 18 11:19:40.991402 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.728618    2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 18 11:19:40.991402 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.728620    2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 18 11:19:40.991402 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.728623    2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 18 11:19:40.991402 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.728625    2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 18 11:19:40.991402 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.728628    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 18 11:19:40.991402 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.728630    2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 18 11:19:40.991402 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.728633    2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 18 11:19:40.991402 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.728635    2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 18 11:19:40.991402 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.728639    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 18 11:19:40.991402 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.728641    2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 18 11:19:40.991402 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.728644    2579 feature_gate.go:328] unrecognized feature gate: Example
Jul 18 11:19:40.991402 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.728646    2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 18 11:19:40.991402 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.728649    2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 18 11:19:40.991402 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.728652    2579 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 18 11:19:40.992056 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.728654    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 18 11:19:40.992056 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.728657    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 18 11:19:40.992056 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.728660    2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 18 11:19:40.992056 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.728662    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 18 11:19:40.992056 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.728665    2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 18 11:19:40.992056 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.728668    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 18 11:19:40.992056 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.728670    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 18 11:19:40.992056 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.728673    2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 18 11:19:40.992056 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.728675    2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 18 11:19:40.992056 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.728678    2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 18 11:19:40.992056 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.728681    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 18 11:19:40.992056 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.728683    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 18 11:19:40.992056 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.728685    2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 18 11:19:40.992056 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.728688    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 18 11:19:40.992056 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.728691    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 18 11:19:40.992056 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.728693    2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 18 11:19:40.992056 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.728696    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 18 11:19:40.992056 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.728698    2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 18 11:19:40.992056 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.728701    2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 18 11:19:40.992756 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.728703    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 18 11:19:40.992756 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.728706    2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 18 11:19:40.992756 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.728708    2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 18 11:19:40.992756 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.728711    2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 18 11:19:40.992756 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.728714    2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 18 11:19:40.992756 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.728717    2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 18 11:19:40.992756 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.728720    2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 18 11:19:40.992756 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.728722    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 18 11:19:40.992756 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.728725    2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 18 11:19:40.992756 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.728728    2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 18 11:19:40.992756 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.728731    2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 18 11:19:40.992756 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.728734    2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 18 11:19:40.992756 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.728736    2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 18 11:19:40.992756 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.728738    2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 18 11:19:40.992756 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.728741    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 18 11:19:40.992756 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.728743    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 18 11:19:40.992756 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.728746    2579 feature_gate.go:328] unrecognized feature gate: Example2
Jul 18 11:19:40.992756 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.728748    2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 18 11:19:40.992756 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.728751    2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 18 11:19:40.992756 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.728753    2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 18 11:19:40.993618 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.728756    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 18 11:19:40.993618 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.728758    2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 18 11:19:40.993618 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.728762    2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 18 11:19:40.993618 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.728766    2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 18 11:19:40.993618 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.728769    2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 18 11:19:40.993618 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:40.728835    2579 flags.go:64] FLAG: --address="0.0.0.0"
Jul 18 11:19:40.993618 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:40.728842    2579 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 18 11:19:40.993618 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:40.728850    2579 flags.go:64] FLAG: --anonymous-auth="true"
Jul 18 11:19:40.993618 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:40.728855    2579 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 18 11:19:40.993618 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:40.728859    2579 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 18 11:19:40.993618 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:40.728862    2579 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 18 11:19:40.993618 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:40.728866    2579 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 18 11:19:40.993618 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:40.728871    2579 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 18 11:19:40.993618 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:40.728874    2579 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 18 11:19:40.993618 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:40.728878    2579 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 18 11:19:40.993618 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:40.728881    2579 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 18 11:19:40.993618 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:40.728901    2579 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 18 11:19:40.993618 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:40.728906    2579 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 18 11:19:40.993618 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:40.728909    2579 flags.go:64] FLAG: --cgroup-root=""
Jul 18 11:19:40.993618 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:40.728912    2579 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 18 11:19:40.993618 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:40.728917    2579 flags.go:64] FLAG: --client-ca-file=""
Jul 18 11:19:40.993618 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:40.728921    2579 flags.go:64] FLAG: --cloud-provider="external"
Jul 18 11:19:40.993618 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:40.728924    2579 flags.go:64] FLAG: --cluster-dns="[]"
Jul 18 11:19:40.995321 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:40.728928    2579 flags.go:64] FLAG: --cluster-domain=""
Jul 18 11:19:40.995321 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:40.728931    2579 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 18 11:19:40.995321 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:40.728934    2579 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 18 11:19:40.995321 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:40.728937    2579 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 18 11:19:40.995321 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:40.728941    2579 flags.go:64] FLAG: --container-log-max-files="5"
Jul 18 11:19:40.995321 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:40.728944    2579 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 18 11:19:40.995321 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:40.728947    2579 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 18 11:19:40.995321 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:40.728950    2579 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 18 11:19:40.995321 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:40.728954    2579 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 18 11:19:40.995321 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:40.728957    2579 flags.go:64] FLAG: --contention-profiling="false"
Jul 18 11:19:40.995321 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:40.728960    2579 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 18 11:19:40.995321 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:40.728964    2579 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 18 11:19:40.995321 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:40.728967    2579 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 18 11:19:40.995321 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:40.728970    2579 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 18 11:19:40.995321 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:40.728974    2579 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 18 11:19:40.995321 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:40.728977    2579 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 18 11:19:40.995321 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:40.728980    2579 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 18 11:19:40.995321 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:40.728982    2579 flags.go:64] FLAG: --enable-load-reader="false"
Jul 18 11:19:40.995321 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:40.728985    2579 flags.go:64] FLAG: --enable-server="true"
Jul 18 11:19:40.995321 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:40.728988    2579 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 18 11:19:40.995321 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:40.728993    2579 flags.go:64] FLAG: --event-burst="100"
Jul 18 11:19:40.995321 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:40.728996    2579 flags.go:64] FLAG: --event-qps="50"
Jul 18 11:19:40.995321 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:40.728999    2579 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 18 11:19:40.995321 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:40.729002    2579 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 18 11:19:40.996191 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:40.729005    2579 flags.go:64] FLAG: --eviction-hard=""
Jul 18 11:19:40.996191 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:40.729010    2579 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 18 11:19:40.996191 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:40.729014    2579 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 18 11:19:40.996191 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:40.729017    2579 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 18 11:19:40.996191 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:40.729020    2579 flags.go:64] FLAG: --eviction-soft=""
Jul 18 11:19:40.996191 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:40.729025    2579 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 18 11:19:40.996191 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:40.729028    2579 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 18 11:19:40.996191 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:40.729031    2579 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 18 11:19:40.996191 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:40.729034    2579 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 18 11:19:40.996191 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:40.729037    2579 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 18 11:19:40.996191 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:40.729040    2579 flags.go:64] FLAG: --fail-swap-on="true"
Jul 18 11:19:40.996191 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:40.729043    2579 flags.go:64] FLAG: --feature-gates=""
Jul 18 11:19:40.996191 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:40.729047    2579 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 18 11:19:40.996191 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:40.729050    2579 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 18 11:19:40.996191 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:40.729053    2579 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 18 11:19:40.996191 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:40.729056    2579 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 18 11:19:40.996191 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:40.729059    2579 flags.go:64] FLAG: --healthz-port="10248"
Jul 18 11:19:40.996191 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:40.729062    2579 flags.go:64] FLAG: --help="false"
Jul 18 11:19:40.996191 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:40.729065    2579 flags.go:64] FLAG: --hostname-override="ip-10-0-133-122.ec2.internal"
Jul 18 11:19:40.996191 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:40.729068    2579 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 18 11:19:40.996191 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:40.729071    2579 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 18 11:19:40.996191 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:40.729073    2579 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 18 11:19:40.996191 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:40.729077    2579 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 18 11:19:40.996191 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:40.729080    2579 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 18 11:19:40.997820 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:40.729083    2579 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 18 11:19:40.997820 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:40.729086    2579 flags.go:64] FLAG: --image-service-endpoint=""
Jul 18 11:19:40.997820 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:40.729089    2579 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 18 11:19:40.997820 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:40.729092    2579 flags.go:64] FLAG: --kube-api-burst="100"
Jul 18 11:19:40.997820 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:40.729095    2579 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 18 11:19:40.997820 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:40.729097    2579 flags.go:64] FLAG: --kube-api-qps="50"
Jul 18 11:19:40.997820 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:40.729101    2579 flags.go:64] FLAG: --kube-reserved=""
Jul 18 11:19:40.997820 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:40.729104    2579 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 18 11:19:40.997820 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:40.729107    2579 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 18 11:19:40.997820 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:40.729110    2579 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 18 11:19:40.997820 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:40.729112    2579 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 18 11:19:40.997820 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:40.729115    2579 flags.go:64] FLAG: --lock-file=""
Jul 18 11:19:40.997820 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:40.729118    2579 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 18 11:19:40.997820 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:40.729122    2579 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 18 11:19:40.997820 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:40.729125    2579 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 18 11:19:40.997820 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:40.729133    2579 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 18 11:19:40.997820 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:40.729139    2579 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 18 11:19:40.997820 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:40.729143    2579 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 18 11:19:40.997820 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:40.729145    2579 flags.go:64] FLAG: --logging-format="text"
Jul 18 11:19:40.997820 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:40.729148    2579 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 18 11:19:40.997820 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:40.729151    2579 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 18 11:19:40.997820 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:40.729154    2579 flags.go:64] FLAG: --manifest-url=""
Jul 18 11:19:40.997820 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:40.729157    2579 flags.go:64] FLAG: --manifest-url-header=""
Jul 18 11:19:40.997820 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:40.729161    2579 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 18 11:19:40.997820 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:40.729164    2579 flags.go:64] FLAG: --max-open-files="1000000"
Jul 18 11:19:40.998667 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:40.729168    2579 flags.go:64] FLAG: --max-pods="110"
Jul 18 11:19:40.998667 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:40.729171    2579 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 18 11:19:40.998667 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:40.729174    2579 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 18 11:19:40.998667 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:40.729177    2579 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 18 11:19:40.998667 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:40.729180    2579 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 18 11:19:40.998667 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:40.729183    2579 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 18 11:19:40.998667 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:40.729186    2579 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 18 11:19:40.998667 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:40.729189    2579 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 18 11:19:40.998667 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:40.729196    2579 flags.go:64] FLAG: --node-status-max-images="50"
Jul 18 11:19:40.998667 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:40.729199    2579 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 18 11:19:40.998667 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:40.729202    2579 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 18 11:19:40.998667 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:40.729205    2579 flags.go:64] FLAG: --pod-cidr=""
Jul 18 11:19:40.998667 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:40.729208    2579 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4017e99d76d7b91598d3a3430cd0eba6eda8b33653addd3838fdfe3cca69c5a0"
Jul 18 11:19:40.998667 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:40.729213    2579 flags.go:64] FLAG: --pod-manifest-path=""
Jul 18 11:19:40.998667 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:40.729216    2579 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 18 11:19:40.998667 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:40.729219    2579 flags.go:64] FLAG: --pods-per-core="0"
Jul 18 11:19:40.998667 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:40.729222    2579 flags.go:64] FLAG: --port="10250"
Jul 18 11:19:40.998667 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:40.729225    2579 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 18 11:19:40.998667 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:40.729228    2579 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-02fa3e7a89b98f184"
Jul 18 11:19:40.998667 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:40.729231    2579 flags.go:64] FLAG: --qos-reserved=""
Jul 18 11:19:40.998667 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:40.729234    2579 flags.go:64] FLAG: --read-only-port="10255"
Jul 18 11:19:40.998667 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:40.729238    2579 flags.go:64] FLAG: --register-node="true"
Jul 18 11:19:40.998667 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:40.729241    2579 flags.go:64] FLAG: --register-with-taints=""
Jul 18 11:19:40.998667 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:40.729246    2579 flags.go:64] FLAG: --registry-burst="10"
Jul 18 11:19:41.000162 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:40.729250    2579 flags.go:64] FLAG: --registry-qps="5"
Jul 18 11:19:41.000162 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:40.729253    2579 flags.go:64] FLAG: --reserved-cpus=""
Jul 18 11:19:41.000162 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:40.729255    2579 flags.go:64] FLAG: --reserved-memory=""
Jul 18 11:19:41.000162 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:40.729259    2579 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 18 11:19:41.000162 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:40.729262    2579 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 18 11:19:41.000162 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:40.729265    2579 flags.go:64] FLAG: --rotate-certificates="false"
Jul 18 11:19:41.000162 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:40.729268    2579 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 18 11:19:41.000162 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:40.729271    2579 flags.go:64] FLAG: --runonce="false"
Jul 18 11:19:41.000162 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:40.729274    2579 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 18 11:19:41.000162 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:40.729277    2579 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 18 11:19:41.000162 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:40.729279    2579 flags.go:64] FLAG: --seccomp-default="false"
Jul 18 11:19:41.000162 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:40.729282    2579 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 18 11:19:41.000162 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:40.729285    2579 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 18 11:19:41.000162 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:40.729288    2579 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 18 11:19:41.000162 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:40.729291    2579 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 18 11:19:41.000162 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:40.729294    2579 flags.go:64] FLAG: --storage-driver-password="root"
Jul 18 11:19:41.000162 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:40.729297    2579 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 18 11:19:41.000162 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:40.729300    2579 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 18 11:19:41.000162 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:40.729302    2579 flags.go:64] FLAG: --storage-driver-user="root"
Jul 18 11:19:41.000162 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:40.729305    2579 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 18 11:19:41.000162 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:40.729308    2579 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 18 11:19:41.000162 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:40.729310    2579 flags.go:64] FLAG: --system-cgroups=""
Jul 18 11:19:41.000162 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:40.729313    2579 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 18 11:19:41.000162 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:40.729318    2579 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 18 11:19:41.000162 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:40.729321    2579 flags.go:64] FLAG: --tls-cert-file=""
Jul 18 11:19:41.001218 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:40.729324    2579 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 18 11:19:41.001218 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:40.729328    2579 flags.go:64] FLAG: --tls-min-version=""
Jul 18 11:19:41.001218 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:40.729330    2579 flags.go:64] FLAG: --tls-private-key-file=""
Jul 18 11:19:41.001218 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:40.729333    2579 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 18 11:19:41.001218 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:40.729338    2579 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 18 11:19:41.001218 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:40.729341    2579 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 18 11:19:41.001218 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:40.729345    2579 flags.go:64] FLAG: --v="2"
Jul 18 11:19:41.001218 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:40.729349    2579 flags.go:64] FLAG: --version="false"
Jul 18 11:19:41.001218 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:40.729353    2579 flags.go:64] FLAG: --vmodule=""
Jul 18 11:19:41.001218 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:40.729357    2579 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 18 11:19:41.001218 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:40.729360    2579 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 18 11:19:41.001218 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.729473    2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 18 11:19:41.001218 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.729478    2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 18 11:19:41.001218 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.729481    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 18 11:19:41.001218 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.729484    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 18 11:19:41.001218 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.729487    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 18 11:19:41.001218 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.729490    2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 18 11:19:41.001218 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.729492    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 18 11:19:41.001218 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.729495    2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 18 11:19:41.001218 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.729497    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 18 11:19:41.001218 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.729500    2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 18 11:19:41.002274 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.729502    2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 18 11:19:41.002274 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.729505    2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 18 11:19:41.002274 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.729508    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 18 11:19:41.002274 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.729510    2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 18 11:19:41.002274 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.729513    2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 18 11:19:41.002274 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.729515    2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 18 11:19:41.002274 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.729518    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 18 11:19:41.002274 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.729521    2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 18 11:19:41.002274 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.729523    2579 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 18 11:19:41.002274 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.729526    2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 18 11:19:41.002274 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.729528    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 18 11:19:41.002274 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.729531    2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 18 11:19:41.002274 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.729533    2579 feature_gate.go:328] unrecognized feature gate: Example2
Jul 18 11:19:41.002274 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.729536    2579 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 18 11:19:41.002274 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.729538    2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 18 11:19:41.002274 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.729542    2579 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 18 11:19:41.002274 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.729545    2579 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 18 11:19:41.002274 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.729549    2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 18 11:19:41.002274 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.729551    2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 18 11:19:41.002274 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.729554    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 18 11:19:41.002911 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.729557    2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 18 11:19:41.002911 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.729560    2579 feature_gate.go:328] unrecognized feature gate: Example
Jul 18 11:19:41.002911 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.729562    2579 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 18 11:19:41.002911 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.729565    2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 18 11:19:41.002911 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.729569    2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 18 11:19:41.002911 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.729572    2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 18 11:19:41.002911 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.729576    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 18 11:19:41.002911 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.729578    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 18 11:19:41.002911 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.729582    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 18 11:19:41.002911 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.729584    2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 18 11:19:41.002911 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.729587    2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 18 11:19:41.002911 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.729590    2579 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 18 11:19:41.002911 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.729593    2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 18 11:19:41.002911 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.729596    2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 18 11:19:41.002911 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.729598    2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 18 11:19:41.002911 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.729601    2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 18 11:19:41.002911 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.729604    2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 18 11:19:41.002911 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.729607    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 18 11:19:41.002911 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.729609    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 18 11:19:41.002911 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.729612    2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 18 11:19:41.003521 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.729614    2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 18 11:19:41.003521 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.729617    2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 18 11:19:41.003521 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.729619    2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 18 11:19:41.003521 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.729622    2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 18 11:19:41.003521 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.729625    2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 18 11:19:41.003521 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.729627    2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 18 11:19:41.003521 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.729630    2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 18 11:19:41.003521 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.729634    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 18 11:19:41.003521 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.729636    2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 18 11:19:41.003521 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.729641    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 18 11:19:41.003521 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.729643    2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 18 11:19:41.003521 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.729646    2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 18 11:19:41.003521 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.729648    2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 18 11:19:41.003521 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.729652    2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 18 11:19:41.003521 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.729654    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 18 11:19:41.003521 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.729657    2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 18 11:19:41.003521 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.729659    2579 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 18 11:19:41.003521 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.729662    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 18 11:19:41.003521 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.729664    2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 18 11:19:41.003521 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.729667    2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 18 11:19:41.005420 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.729669    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 18 11:19:41.005420 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.729672    2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 18 11:19:41.005420 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.729675    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 18 11:19:41.005420 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.729677    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 18 11:19:41.005420 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.729680    2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 18 11:19:41.005420 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.729682    2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 18 11:19:41.005420 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.729685    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 18 11:19:41.005420 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.729687    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 18 11:19:41.005420 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.729690    2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 18 11:19:41.005420 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.729693    2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 18 11:19:41.005420 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.729695    2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 18 11:19:41.005420 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.729698    2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 18 11:19:41.005420 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.729700    2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 18 11:19:41.005420 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.729703    2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 18 11:19:41.005420 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.729705    2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 18 11:19:41.005420 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.729708    2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 18 11:19:41.005420 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.729710    2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 18 11:19:41.005420 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.729713    2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 18 11:19:41.005420 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.729716    2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 18 11:19:41.005420 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.729720    2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 18 11:19:41.006296 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.729724    2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 18 11:19:41.006296 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.729728    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 18 11:19:41.006296 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.729731    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 18 11:19:41.006296 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.729734    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 18 11:19:41.006296 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.729737    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 18 11:19:41.006296 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.729740    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 18 11:19:41.006296 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.729743    2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 18 11:19:41.006296 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.729746    2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 18 11:19:41.006296 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.729748    2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 18 11:19:41.006296 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:40.730412    2579 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 18 11:19:41.006296 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:40.737630    2579 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 18 11:19:41.006296 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:40.737647    2579 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 18 11:19:41.006296 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:40.737667    2579 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 18 11:19:41.006296 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:40.737676    2579 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 18 11:19:41.006714 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.737732    2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 18 11:19:41.006714 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.737738    2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 18 11:19:41.006714 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.737741    2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 18 11:19:41.006714 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.737744    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 18 11:19:41.006714 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.737747    2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 18 11:19:41.006714 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.737750    2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 18 11:19:41.006714 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.737752    2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 18 11:19:41.006714 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.737755    2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 18 11:19:41.006714 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.737758    2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 18 11:19:41.006714 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.737762    2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 18 11:19:41.006714 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.737766    2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 18 11:19:41.006714 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.737769    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 18 11:19:41.006714 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.737772    2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 18 11:19:41.006714 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.737775    2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 18 11:19:41.006714 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.737777    2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 18 11:19:41.006714 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.737780    2579 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 18 11:19:41.006714 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.737783    2579 feature_gate.go:328] unrecognized feature gate: Example
Jul 18 11:19:41.006714 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.737785    2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 18 11:19:41.006714 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.737788    2579 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 18 11:19:41.007540 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.737790    2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 18 11:19:41.007540 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.737793    2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 18 11:19:41.007540 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.737796    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 18 11:19:41.007540 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.737799    2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 18 11:19:41.007540 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.737802    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 18 11:19:41.007540 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.737805    2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 18 11:19:41.007540 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.737808    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 18 11:19:41.007540 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.737811    2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 18 11:19:41.007540 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.737813    2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 18 11:19:41.007540 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.737816    2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 18 11:19:41.007540 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.737820    2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 18 11:19:41.007540 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.737822    2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 18 11:19:41.007540 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.737825    2579 feature_gate.go:328] unrecognized feature gate: Example2
Jul 18 11:19:41.007540 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.737827    2579 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 18 11:19:41.007540 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.737830    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 18 11:19:41.007540 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.737833    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 18 11:19:41.007540 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.737835    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 18 11:19:41.007540 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.737838    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 18 11:19:41.007540 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.737840    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 18 11:19:41.007540 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.737843    2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 18 11:19:41.009202 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.737848    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 18 11:19:41.009202 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.737850    2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 18 11:19:41.009202 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.737853    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 18 11:19:41.009202 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.737856    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 18 11:19:41.009202 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.737858    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 18 11:19:41.009202 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.737861    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 18 11:19:41.009202 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.737863    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 18 11:19:41.009202 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.737866    2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 18 11:19:41.009202 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.737869    2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 18 11:19:41.009202 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.737871    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 18 11:19:41.009202 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.737874    2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 18 11:19:41.009202 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.737876    2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 18 11:19:41.009202 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.737878    2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 18 11:19:41.009202 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.737881    2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 18 11:19:41.009202 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.737884    2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 18 11:19:41.009202 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.737902    2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 18 11:19:41.009202 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.737905    2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 18 11:19:41.009202 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.737907    2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 18 11:19:41.009202 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.737910    2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 18 11:19:41.009202 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.737913    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 18 11:19:41.010019 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.737915    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 18 11:19:41.010019 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.737918    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 18 11:19:41.010019 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.737920    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 18 11:19:41.010019 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.737923    2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 18 11:19:41.010019 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.737926    2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 18 11:19:41.010019 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.737929    2579 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 18 11:19:41.010019 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.737931    2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 18 11:19:41.010019 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.737934    2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 18 11:19:41.010019 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.737937    2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 18 11:19:41.010019 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.737939    2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 18 11:19:41.010019 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.737942    2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 18 11:19:41.010019 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.737944    2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 18 11:19:41.010019 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.737950    2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 18 11:19:41.010019 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.737954    2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 18 11:19:41.010019 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.737957    2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 18 11:19:41.010019 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.737959    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 18 11:19:41.010019 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.737963    2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 18 11:19:41.010019 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.737965    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 18 11:19:41.010019 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.737968    2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 18 11:19:41.010019 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.737971    2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 18 11:19:41.011667 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.737973    2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 18 11:19:41.011667 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.737976    2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 18 11:19:41.011667 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.737979    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 18 11:19:41.011667 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.737982    2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 18 11:19:41.011667 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.737986    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 18 11:19:41.011667 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.737989    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 18 11:19:41.011667 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.737992    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 18 11:19:41.011667 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.737997    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 18 11:19:41.011667 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.738000    2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 18 11:19:41.011667 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.738003    2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 18 11:19:41.011667 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.738006    2579 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 18 11:19:41.011667 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.738008    2579 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 18 11:19:41.011667 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.738011    2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 18 11:19:41.011667 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.738014    2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 18 11:19:41.011667 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.738016    2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 18 11:19:41.011667 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.738019    2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 18 11:19:41.011667 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.738022    2579 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 18 11:19:41.011667 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.738025    2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 18 11:19:41.011667 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.738027    2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 18 11:19:41.012510 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.738030    2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 18 11:19:41.012510 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:40.738035    2579 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 18 11:19:41.012510 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.738153    2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 18 11:19:41.012510 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.738157    2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 18 11:19:41.012510 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.738160    2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 18 11:19:41.012510 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.738165    2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 18 11:19:41.012510 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.738168    2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 18 11:19:41.012510 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.738172    2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 18 11:19:41.012510 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.738175    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 18 11:19:41.012510 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.738178    2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 18 11:19:41.012510 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.738181    2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 18 11:19:41.012510 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.738184    2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 18 11:19:41.012510 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.738187    2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 18 11:19:41.012510 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.738189    2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 18 11:19:41.013745 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.738192    2579 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 18 11:19:41.013745 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.738195    2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 18 11:19:41.013745 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.738198    2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 18 11:19:41.013745 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.738200    2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 18 11:19:41.013745 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.738203    2579 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 18 11:19:41.013745 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.738205    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 18 11:19:41.013745 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.738207    2579 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 18 11:19:41.013745 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.738212    2579 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 18 11:19:41.013745 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.738214    2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 18 11:19:41.013745 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.738217    2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 18 11:19:41.013745 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.738219    2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 18 11:19:41.013745 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.738222    2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 18 11:19:41.013745 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.738224    2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 18 11:19:41.013745 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.738227    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 18 11:19:41.013745 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.738229    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 18 11:19:41.013745 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.738232    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 18 11:19:41.013745 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.738235    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 18 11:19:41.013745 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.738237    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 18 11:19:41.013745 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.738240    2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 18 11:19:41.013745 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.738242    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 18 11:19:41.014572 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.738245    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 18 11:19:41.014572 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.738247    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 18 11:19:41.014572 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.738250    2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 18 11:19:41.014572 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.738255    2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 18 11:19:41.014572 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.738258    2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 18 11:19:41.014572 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.738260    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 18 11:19:41.014572 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.738263    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 18 11:19:41.014572 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.738265    2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 18 11:19:41.014572 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.738268    2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 18 11:19:41.014572 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.738270    2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 18 11:19:41.014572 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.738273    2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 18 11:19:41.014572 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.738275    2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 18 11:19:41.014572 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.738278    2579 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 18 11:19:41.014572 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.738281    2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 18 11:19:41.014572 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.738283    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 18 11:19:41.014572 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.738286    2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 18 11:19:41.014572 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.738289    2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 18 11:19:41.014572 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.738291    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 18 11:19:41.014572 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.738294    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 18 11:19:41.016272 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.738298    2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 18 11:19:41.016272 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.738300    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 18 11:19:41.016272 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.738303    2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 18 11:19:41.016272 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.738306    2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 18 11:19:41.016272 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.738308    2579 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 18 11:19:41.016272 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.738311    2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 18 11:19:41.016272 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.738313    2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 18 11:19:41.016272 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.738316    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 18 11:19:41.016272 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.738318    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 18 11:19:41.016272 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.738321    2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 18 11:19:41.016272 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.738324    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 18 11:19:41.016272 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.738327    2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 18 11:19:41.016272 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.738329    2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 18 11:19:41.016272 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.738332    2579 feature_gate.go:328] unrecognized feature gate: Example
Jul 18 11:19:41.016272 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.738335    2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 18 11:19:41.016272 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.738338    2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 18 11:19:41.016272 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.738342    2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 18 11:19:41.016272 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.738344    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 18 11:19:41.016272 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.738347    2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 18 11:19:41.016272 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.738349    2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 18 11:19:41.017100 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.738352    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 18 11:19:41.017100 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.738354    2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 18 11:19:41.017100 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.738357    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 18 11:19:41.017100 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.738359    2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 18 11:19:41.017100 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.738362    2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 18 11:19:41.017100 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.738365    2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 18 11:19:41.017100 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.738367    2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 18 11:19:41.017100 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.738370    2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 18 11:19:41.017100 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.738372    2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 18 11:19:41.017100 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.738375    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 18 11:19:41.017100 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.738377    2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 18 11:19:41.017100 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.738380    2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 18 11:19:41.017100 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.738384    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 18 11:19:41.017100 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.738386    2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 18 11:19:41.017100 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.738389    2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 18 11:19:41.017100 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.738391    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 18 11:19:41.017100 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.738394    2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 18 11:19:41.017100 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.738396    2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 18 11:19:41.017100 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.738399    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 18 11:19:41.018752 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.738402    2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 18 11:19:41.018752 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.738404    2579 feature_gate.go:328] unrecognized feature gate: Example2
Jul 18 11:19:41.018752 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.738408    2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 18 11:19:41.018752 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.738412    2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 18 11:19:41.018752 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.738416    2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 18 11:19:41.018752 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.738418    2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 18 11:19:41.018752 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.738421    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 18 11:19:41.018752 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.738424    2579 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 18 11:19:41.018752 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:40.738427    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 18 11:19:41.018752 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:40.738433    2579 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 18 11:19:41.018752 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:40.738550    2579 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 18 11:19:41.018752 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:40.741131    2579 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 18 11:19:41.018752 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:40.742814    2579 server.go:1019] "Starting client certificate rotation"
Jul 18 11:19:41.018752 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:40.743038    2579 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 18 11:19:41.019600 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:40.743074    2579 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 18 11:19:41.019600 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:40.746610    2579 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 18 11:19:41.019600 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:40.747719    2579 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 18 11:19:41.019600 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:40.768839    2579 log.go:25] "Validated CRI v1 runtime API"
Jul 18 11:19:41.019600 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:40.772419    2579 log.go:25] "Validated CRI v1 image API"
Jul 18 11:19:41.019600 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:40.773280    2579 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 18 11:19:41.019600 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:40.775749    2579 fs.go:135] Filesystem UUIDs: map[0580f75d-8a0a-424f-9c15-1d253e7e6684:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 f1446fdf-163d-410d-bebd-2b8541956cf3:/dev/nvme0n1p3]
Jul 18 11:19:41.019600 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:40.775763    2579 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 18 11:19:41.019600 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:40.781737    2579 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 18 11:19:41.121701 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:40.781997    2579 manager.go:216] Machine: {Timestamp:2026-07-18 11:19:40.780620446 +0000 UTC m=+0.395656739 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100885 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2ec1737a29991c12651d6df3d94dbe SystemUUID:ec2ec173-7a29-991c-1265-1d6df3d94dbe BootID:bdc55b50-2423-4341-bd02-e9d55c9274b3 Filesystems:[{Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:77:67:17:46:f7 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:77:67:17:46:f7 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:a6:c5:ad:19:b0:2e Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 18 11:19:41.121701 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:40.782096    2579 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 18 11:19:41.121701 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:40.782175    2579 manager.go:232] Version: {KernelVersion:5.14.0-570.128.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260715-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 18 11:19:41.121701 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:40.785696    2579 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 18 11:19:41.121701 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:40.785721    2579 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-133-122.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 18 11:19:41.121701 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:40.786541    2579 topology_manager.go:138] "Creating topology manager with none policy"
Jul 18 11:19:41.121701 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:40.786552    2579 container_manager_linux.go:309] "Creating device plugin manager"
Jul 18 11:19:41.121701 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:40.786560    2579 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 18 11:19:41.121701 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:40.786578    2579 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 18 11:19:41.121701 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:40.788370    2579 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 18 11:19:41.121701 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:40.792781    2579 state_mem.go:36] "Initialized new in-memory state store"
Jul 18 11:19:41.121701 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:40.792908    2579 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 18 11:19:41.121701 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:40.792935    2579 kubelet.go:486] "Attempting to sync node with API server"
Jul 18 11:19:41.121701 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:40.792950    2579 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 18 11:19:41.121701 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:40.792966    2579 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 18 11:19:41.121701 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:40.792976    2579 kubelet.go:398] "Adding apiserver pod source"
Jul 18 11:19:41.121701 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:40.792985    2579 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 18 11:19:41.121701 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:40.793292    2579 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 18 11:19:41.122524 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:40.793306    2579 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 18 11:19:41.122524 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:40.795761    2579 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 18 11:19:41.122524 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:40.798276    2579 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 18 11:19:41.122524 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:40.798302    2579 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 18 11:19:41.122524 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:40.799623    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 18 11:19:41.122524 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:40.799636    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 18 11:19:41.122524 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:40.799642    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 18 11:19:41.122524 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:40.799648    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 18 11:19:41.122524 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:40.799658    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 18 11:19:41.122524 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:40.799664    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 18 11:19:41.122524 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:40.799672    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 18 11:19:41.122524 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:40.799677    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 18 11:19:41.122524 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:40.799685    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 18 11:19:41.122524 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:40.799691    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 18 11:19:41.122524 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:40.799708    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 18 11:19:41.122524 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:40.799717    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 18 11:19:41.122524 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:40.800627    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 18 11:19:41.122524 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:40.800634    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 18 11:19:41.122524 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:40.803726    2579 server.go:1268] "Started kubelet"
Jul 18 11:19:41.122524 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:40.803814    2579 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 18 11:19:41.122524 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:40.803882    2579 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 18 11:19:41.122524 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:40.804048    2579 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 18 11:19:41.122524 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:40.808828    2579 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-133-122.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 18 11:19:41.122524 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:40.809920    2579 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 18 11:19:41.122524 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:40.811113    2579 server.go:310] "Adding debug handlers to kubelet server"
Jul 18 11:19:41.122524 ip-10-0-133-122 kubenswrapper[2579]: E0718 11:19:40.811481    2579 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 18 11:19:41.122524 ip-10-0-133-122 kubenswrapper[2579]: E0718 11:19:40.811436    2579 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-133-122.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 18 11:19:41.122524 ip-10-0-133-122 kubenswrapper[2579]: E0718 11:19:40.813612    2579 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 18 11:19:41.122524 ip-10-0-133-122 kubenswrapper[2579]: E0718 11:19:40.815198    2579 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-133-122.ec2.internal.18c35e5156657867  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-133-122.ec2.internal,UID:ip-10-0-133-122.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-133-122.ec2.internal,},FirstTimestamp:2026-07-18 11:19:40.803700839 +0000 UTC m=+0.418737131,LastTimestamp:2026-07-18 11:19:40.803700839 +0000 UTC m=+0.418737131,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-133-122.ec2.internal,}"
Jul 18 11:19:41.122524 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:40.822187    2579 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 18 11:19:41.122524 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:40.822193    2579 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 18 11:19:41.122524 ip-10-0-133-122 kubenswrapper[2579]: E0718 11:19:40.822259    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-122.ec2.internal\" not found"
Jul 18 11:19:41.122524 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:40.822994    2579 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 18 11:19:41.122524 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:40.822996    2579 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 18 11:19:41.122524 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:40.823016    2579 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 18 11:19:41.122524 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:40.823079    2579 factory.go:55] Registering systemd factory
Jul 18 11:19:41.122524 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:40.823096    2579 factory.go:223] Registration of the systemd container factory successfully
Jul 18 11:19:41.122524 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:40.823139    2579 reconstruct.go:97] "Volume reconstruction finished"
Jul 18 11:19:41.122524 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:40.823148    2579 reconciler.go:29] "Reconciler: start to sync state"
Jul 18 11:19:41.122524 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:40.823348    2579 factory.go:153] Registering CRI-O factory
Jul 18 11:19:41.122524 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:40.823363    2579 factory.go:223] Registration of the crio container factory successfully
Jul 18 11:19:41.123761 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:40.823416    2579 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 18 11:19:41.123761 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:40.823436    2579 factory.go:103] Registering Raw factory
Jul 18 11:19:41.123761 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:40.823447    2579 manager.go:1196] Started watching for new ooms in manager
Jul 18 11:19:41.123761 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:40.823879    2579 manager.go:349] Starting recovery of all containers
Jul 18 11:19:41.123761 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:40.824350    2579 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-g5xgc"
Jul 18 11:19:41.123761 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:40.832723    2579 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-g5xgc"
Jul 18 11:19:41.123761 ip-10-0-133-122 kubenswrapper[2579]: E0718 11:19:40.833263    2579 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 18 11:19:41.123761 ip-10-0-133-122 kubenswrapper[2579]: E0718 11:19:40.833428    2579 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-133-122.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 18 11:19:41.123761 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:40.838646    2579 manager.go:354] Recovery completed
Jul 18 11:19:41.123761 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:40.843220    2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 18 11:19:41.123761 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:40.845469    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-122.ec2.internal" event="NodeHasSufficientMemory"
Jul 18 11:19:41.123761 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:40.845498    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-122.ec2.internal" event="NodeHasNoDiskPressure"
Jul 18 11:19:41.123761 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:40.845512    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-122.ec2.internal" event="NodeHasSufficientPID"
Jul 18 11:19:41.123761 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:40.846805    2579 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 18 11:19:41.123761 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:40.846817    2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 18 11:19:41.123761 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:40.846817    2579 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 18 11:19:41.123761 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:40.846882    2579 state_mem.go:36] "Initialized new in-memory state store"
Jul 18 11:19:41.123761 ip-10-0-133-122 kubenswrapper[2579]: E0718 11:19:40.847215    2579 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-133-122.ec2.internal.18c35e5158e3015a  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-133-122.ec2.internal,UID:ip-10-0-133-122.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-133-122.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-133-122.ec2.internal,},FirstTimestamp:2026-07-18 11:19:40.84548233 +0000 UTC m=+0.460518627,LastTimestamp:2026-07-18 11:19:40.84548233 +0000 UTC m=+0.460518627,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-133-122.ec2.internal,}"
Jul 18 11:19:41.123761 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:40.847670    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-122.ec2.internal" event="NodeHasSufficientMemory"
Jul 18 11:19:41.123761 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:40.847694    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-122.ec2.internal" event="NodeHasNoDiskPressure"
Jul 18 11:19:41.123761 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:40.847704    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-122.ec2.internal" event="NodeHasSufficientPID"
Jul 18 11:19:41.123761 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:40.848906    2579 policy_none.go:49] "None policy: Start"
Jul 18 11:19:41.123761 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:40.848919    2579 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 18 11:19:41.123761 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:40.848930    2579 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 18 11:19:41.123761 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:40.851606    2579 policy_none.go:47] "Start"
Jul 18 11:19:41.123761 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:40.886415    2579 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 18 11:19:41.123761 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:40.887634    2579 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 18 11:19:41.123761 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:40.887669    2579 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 18 11:19:41.123761 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:40.887689    2579 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 18 11:19:41.123761 ip-10-0-133-122 kubenswrapper[2579]: E0718 11:19:40.887719    2579 kubelet.go:2472] "Skipping pod synchronization" err="[container runtime status check may not have completed yet, PLEG is not healthy: pleg has yet to be successful]"
Jul 18 11:19:41.123761 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:40.888711    2579 manager.go:337] "Starting Device Plugin manager"
Jul 18 11:19:41.123761 ip-10-0-133-122 kubenswrapper[2579]: E0718 11:19:40.888750    2579 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 18 11:19:41.123761 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:40.888760    2579 server.go:87] "Starting device plugin registration server"
Jul 18 11:19:41.123761 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:40.889074    2579 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 18 11:19:41.123761 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:40.889088    2579 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 18 11:19:41.123761 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:40.889167    2579 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 18 11:19:41.123761 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:40.889242    2579 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 18 11:19:41.123761 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:40.889250    2579 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 18 11:19:41.123761 ip-10-0-133-122 kubenswrapper[2579]: E0718 11:19:40.889776    2579 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 18 11:19:41.125441 ip-10-0-133-122 kubenswrapper[2579]: E0718 11:19:40.889823    2579 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-133-122.ec2.internal\" not found"
Jul 18 11:19:41.125441 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:40.889821    2579 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 18 11:19:41.125441 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:40.987988    2579 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["kube-system/kube-apiserver-proxy-ip-10-0-133-122.ec2.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-122.ec2.internal"]
Jul 18 11:19:41.125441 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:40.988064    2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 18 11:19:41.125441 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:40.989224    2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 18 11:19:41.125441 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:40.989595    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-122.ec2.internal" event="NodeHasSufficientMemory"
Jul 18 11:19:41.125441 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:40.989625    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-122.ec2.internal" event="NodeHasNoDiskPressure"
Jul 18 11:19:41.125441 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:40.989640    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-122.ec2.internal" event="NodeHasSufficientPID"
Jul 18 11:19:41.125441 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:40.990301    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-122.ec2.internal" event="NodeHasSufficientMemory"
Jul 18 11:19:41.125441 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:40.990327    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-122.ec2.internal" event="NodeHasNoDiskPressure"
Jul 18 11:19:41.125441 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:40.990351    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-122.ec2.internal" event="NodeHasSufficientPID"
Jul 18 11:19:41.125441 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:40.990373    2579 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-133-122.ec2.internal"
Jul 18 11:19:41.125441 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:40.992403    2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 18 11:19:41.125441 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:40.992519    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-122.ec2.internal"
Jul 18 11:19:41.125441 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:40.992557    2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 18 11:19:41.125441 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:40.993415    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-122.ec2.internal" event="NodeHasSufficientMemory"
Jul 18 11:19:41.125441 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:40.993437    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-122.ec2.internal" event="NodeHasSufficientMemory"
Jul 18 11:19:41.125441 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:40.993458    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-122.ec2.internal" event="NodeHasNoDiskPressure"
Jul 18 11:19:41.125441 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:40.993467    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-122.ec2.internal" event="NodeHasSufficientPID"
Jul 18 11:19:41.125441 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:40.993440    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-122.ec2.internal" event="NodeHasNoDiskPressure"
Jul 18 11:19:41.125441 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:40.993528    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-122.ec2.internal" event="NodeHasSufficientPID"
Jul 18 11:19:41.125441 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:40.995580    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-122.ec2.internal"
Jul 18 11:19:41.125441 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:40.995604    2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 18 11:19:41.125441 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:40.996459    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-122.ec2.internal" event="NodeHasSufficientMemory"
Jul 18 11:19:41.125441 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:40.996482    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-122.ec2.internal" event="NodeHasNoDiskPressure"
Jul 18 11:19:41.125441 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:40.996496    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-122.ec2.internal" event="NodeHasSufficientPID"
Jul 18 11:19:41.125441 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:40.998980    2579 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-133-122.ec2.internal"
Jul 18 11:19:41.125441 ip-10-0-133-122 kubenswrapper[2579]: E0718 11:19:40.998996    2579 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-133-122.ec2.internal\": node \"ip-10-0-133-122.ec2.internal\" not found"
Jul 18 11:19:41.125441 ip-10-0-133-122 kubenswrapper[2579]: E0718 11:19:41.043855    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-122.ec2.internal\" not found"
Jul 18 11:19:41.125441 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:41.124765    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/2a172972fbb39a4c6031f848e0d266ff-config\") pod \"kube-apiserver-proxy-ip-10-0-133-122.ec2.internal\" (UID: \"2a172972fbb39a4c6031f848e0d266ff\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-122.ec2.internal"
Jul 18 11:19:41.125441 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:41.124797    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/b7129788cc0ed725bc5853009237d25d-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-122.ec2.internal\" (UID: \"b7129788cc0ed725bc5853009237d25d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-122.ec2.internal"
Jul 18 11:19:41.125441 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:41.124815    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b7129788cc0ed725bc5853009237d25d-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-122.ec2.internal\" (UID: \"b7129788cc0ed725bc5853009237d25d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-122.ec2.internal"
Jul 18 11:19:41.146106 ip-10-0-133-122 kubenswrapper[2579]: E0718 11:19:41.144855    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-122.ec2.internal\" not found"
Jul 18 11:19:41.246692 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:41.225721    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/2a172972fbb39a4c6031f848e0d266ff-config\") pod \"kube-apiserver-proxy-ip-10-0-133-122.ec2.internal\" (UID: \"2a172972fbb39a4c6031f848e0d266ff\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-122.ec2.internal"
Jul 18 11:19:41.246692 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:41.225751    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/b7129788cc0ed725bc5853009237d25d-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-122.ec2.internal\" (UID: \"b7129788cc0ed725bc5853009237d25d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-122.ec2.internal"
Jul 18 11:19:41.246692 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:41.225767    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b7129788cc0ed725bc5853009237d25d-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-122.ec2.internal\" (UID: \"b7129788cc0ed725bc5853009237d25d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-122.ec2.internal"
Jul 18 11:19:41.246692 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:41.225813    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b7129788cc0ed725bc5853009237d25d-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-122.ec2.internal\" (UID: \"b7129788cc0ed725bc5853009237d25d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-122.ec2.internal"
Jul 18 11:19:41.246692 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:41.225830    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/b7129788cc0ed725bc5853009237d25d-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-122.ec2.internal\" (UID: \"b7129788cc0ed725bc5853009237d25d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-122.ec2.internal"
Jul 18 11:19:41.246692 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:41.225830    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/2a172972fbb39a4c6031f848e0d266ff-config\") pod \"kube-apiserver-proxy-ip-10-0-133-122.ec2.internal\" (UID: \"2a172972fbb39a4c6031f848e0d266ff\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-122.ec2.internal"
Jul 18 11:19:41.246692 ip-10-0-133-122 kubenswrapper[2579]: E0718 11:19:41.245821    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-122.ec2.internal\" not found"
Jul 18 11:19:41.375413 ip-10-0-133-122 kubenswrapper[2579]: E0718 11:19:41.346496    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-122.ec2.internal\" not found"
Jul 18 11:19:41.495488 ip-10-0-133-122 kubenswrapper[2579]: E0718 11:19:41.446990    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-122.ec2.internal\" not found"
Jul 18 11:19:41.621581 ip-10-0-133-122 kubenswrapper[2579]: E0718 11:19:41.547435    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-122.ec2.internal\" not found"
Jul 18 11:19:41.749632 ip-10-0-133-122 kubenswrapper[2579]: E0718 11:19:41.648158    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-122.ec2.internal\" not found"
Jul 18 11:19:41.749632 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:41.669594    2579 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 18 11:19:41.749632 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:41.742164    2579 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 18 11:19:41.749632 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:41.742329    2579 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 18 11:19:41.749632 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:41.742364    2579 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 18 11:19:41.749632 ip-10-0-133-122 kubenswrapper[2579]: E0718 11:19:41.748459    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-122.ec2.internal\" not found"
Jul 18 11:19:41.857753 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:41.840203    2579 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-17 11:14:41 +0000 UTC" deadline="2028-04-07 15:08:11.246315698 +0000 UTC"
Jul 18 11:19:41.857753 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:41.840231    2579 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15099h48m29.406088667s"
Jul 18 11:19:41.857753 ip-10-0-133-122 kubenswrapper[2579]: E0718 11:19:41.848546    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-122.ec2.internal\" not found"
Jul 18 11:19:41.903781 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:41.903756    2579 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 18 11:19:41.933650 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:41.933628    2579 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 18 11:19:41.941999 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:41.941979    2579 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-122.ec2.internal"
Jul 18 11:19:41.948887 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:41.948868    2579 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-122.ec2.internal"
Jul 18 11:19:41.954094 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:41.954078    2579 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 18 11:19:41.959422 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:41.959407    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-122.ec2.internal"
Jul 18 11:19:42.013024 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:42.012938    2579 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 18 11:19:42.016393 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:42.016376    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-122.ec2.internal"
Jul 18 11:19:42.022641 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:42.022610    2579 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-122.ec2.internal"
Jul 18 11:19:42.032462 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:42.032440    2579 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 18 11:19:42.032549 ip-10-0-133-122 kubenswrapper[2579]: E0718 11:19:42.032492    2579 kubelet.go:3250] "Failed creating a mirror pod" err="pods \"kube-apiserver-proxy-ip-10-0-133-122.ec2.internal\" already exists" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-122.ec2.internal"
Jul 18 11:19:42.032549 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:42.032508    2579 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-122.ec2.internal"
Jul 18 11:19:42.043171 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:42.043152    2579 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 18 11:19:42.043253 ip-10-0-133-122 kubenswrapper[2579]: E0718 11:19:42.043198    2579 kubelet.go:3250] "Failed creating a mirror pod" err="pods \"kube-rbac-proxy-crio-ip-10-0-133-122.ec2.internal\" already exists" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-122.ec2.internal"
Jul 18 11:19:42.794294 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:42.794267    2579 apiserver.go:52] "Watching apiserver"
Jul 18 11:19:42.802582 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:42.802557    2579 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 18 11:19:42.802978 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:42.802954    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-6j4vg","openshift-cluster-node-tuning-operator/tuned-kcmrw","openshift-image-registry/node-ca-bz5mq","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-122.ec2.internal","openshift-multus/multus-additional-cni-plugins-lmf4l","openshift-multus/network-metrics-daemon-ljhk6","openshift-network-operator/iptables-alerter-mj8nl","openshift-ovn-kubernetes/ovnkube-node-58jnn","kube-system/konnectivity-agent-hnt7j","kube-system/kube-apiserver-proxy-ip-10-0-133-122.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lvgzl","openshift-dns/node-resolver-4522z","openshift-multus/multus-rc6td","openshift-network-diagnostics/network-check-target-cj4nh"]
Jul 18 11:19:42.805699 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:42.805680    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-rc6td"
Jul 18 11:19:42.808070 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:42.808048    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 18 11:19:42.808188 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:42.808166    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 18 11:19:42.808248 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:42.808194    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 18 11:19:42.808316 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:42.808301    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-km8qn\""
Jul 18 11:19:42.808499 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:42.808481    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 18 11:19:42.809268 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:42.809250    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-kcmrw"
Jul 18 11:19:42.811277 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:42.811252    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 18 11:19:42.811387 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:42.811264    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 18 11:19:42.811540 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:42.811409    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-6j56s\""
Jul 18 11:19:42.811732 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:42.811717    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-bz5mq"
Jul 18 11:19:42.813832 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:42.813810    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 18 11:19:42.814026 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:42.814008    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 18 11:19:42.814108 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:42.814039    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 18 11:19:42.814108 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:42.814011    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-vxztn\""
Jul 18 11:19:42.814206 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:42.814149    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6j4vg"
Jul 18 11:19:42.814246 ip-10-0-133-122 kubenswrapper[2579]: E0718 11:19:42.814229    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6j4vg" podUID="b4c72690-9e6e-4826-8ff8-95eeea44b5d0"
Jul 18 11:19:42.816144 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:42.816121    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2a172972fbb39a4c6031f848e0d266ff.slice/crio-663cfa19e12d4fb776996425b79cf95d9a0e6eb0798ca98e5b2fb3e6642357e8 WatchSource:0}: Error finding container 663cfa19e12d4fb776996425b79cf95d9a0e6eb0798ca98e5b2fb3e6642357e8: Status 404 returned error can't find the container with id 663cfa19e12d4fb776996425b79cf95d9a0e6eb0798ca98e5b2fb3e6642357e8
Jul 18 11:19:42.816379 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:42.816356    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb7129788cc0ed725bc5853009237d25d.slice/crio-8f5f952c514738e5a421c8e0d91835e03b7b6e73e512f4fbbe9165807c060c94 WatchSource:0}: Error finding container 8f5f952c514738e5a421c8e0d91835e03b7b6e73e512f4fbbe9165807c060c94: Status 404 returned error can't find the container with id 8f5f952c514738e5a421c8e0d91835e03b7b6e73e512f4fbbe9165807c060c94
Jul 18 11:19:42.816461 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:42.816424    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-lmf4l"
Jul 18 11:19:42.818553 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:42.818508    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 18 11:19:42.818682 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:42.818564    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 18 11:19:42.818849 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:42.818835    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ljhk6"
Jul 18 11:19:42.818952 ip-10-0-133-122 kubenswrapper[2579]: E0718 11:19:42.818888    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ljhk6" podUID="0e090c50-e996-4eda-b8c0-46d7f7d7dde3"
Jul 18 11:19:42.819008 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:42.818838    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-p985n\""
Jul 18 11:19:42.821298 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:42.821278    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-mj8nl"
Jul 18 11:19:42.823335 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:42.823314    2579 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 18 11:19:42.823625 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:42.823604    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 18 11:19:42.823805 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:42.823774    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-58jnn"
Jul 18 11:19:42.825831 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:42.824770    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 18 11:19:42.825831 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:42.825561    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-hd8fs\""
Jul 18 11:19:42.825831 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:42.825791    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 18 11:19:42.827094 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:42.827048    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 18 11:19:42.827321 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:42.827298    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-6wgth\""
Jul 18 11:19:42.827575 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:42.827558    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 18 11:19:42.827655 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:42.827634    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 18 11:19:42.827972 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:42.827952    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-hnt7j"
Jul 18 11:19:42.828315 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:42.828296    2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 18 11:19:42.829307 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:42.828671    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 18 11:19:42.829307 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:42.828959    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 18 11:19:42.829307 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:42.829190    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 18 11:19:42.830379 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:42.830360    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 18 11:19:42.830639 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:42.830619    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-rgcdx\""
Jul 18 11:19:42.830731 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:42.830667    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 18 11:19:42.830898 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:42.830878    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cj4nh"
Jul 18 11:19:42.831021 ip-10-0-133-122 kubenswrapper[2579]: E0718 11:19:42.830991    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cj4nh" podUID="17f689f0-ceae-4eb8-acaa-922caaa8e3f8"
Jul 18 11:19:42.833434 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:42.833414    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lvgzl"
Jul 18 11:19:42.834237 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:42.834215    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/40e8e19c-87b3-4cd6-81c1-0f404971a282-host-slash\") pod \"ovnkube-node-58jnn\" (UID: \"40e8e19c-87b3-4cd6-81c1-0f404971a282\") " pod="openshift-ovn-kubernetes/ovnkube-node-58jnn"
Jul 18 11:19:42.834342 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:42.834242    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/40e8e19c-87b3-4cd6-81c1-0f404971a282-node-log\") pod \"ovnkube-node-58jnn\" (UID: \"40e8e19c-87b3-4cd6-81c1-0f404971a282\") " pod="openshift-ovn-kubernetes/ovnkube-node-58jnn"
Jul 18 11:19:42.834342 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:42.834264    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fz4l9\" (UniqueName: \"kubernetes.io/projected/40e8e19c-87b3-4cd6-81c1-0f404971a282-kube-api-access-fz4l9\") pod \"ovnkube-node-58jnn\" (UID: \"40e8e19c-87b3-4cd6-81c1-0f404971a282\") " pod="openshift-ovn-kubernetes/ovnkube-node-58jnn"
Jul 18 11:19:42.834342 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:42.834309    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/914d8131-27d9-481c-b7e2-484f467526dc-host-run-multus-certs\") pod \"multus-rc6td\" (UID: \"914d8131-27d9-481c-b7e2-484f467526dc\") " pod="openshift-multus/multus-rc6td"
Jul 18 11:19:42.834505 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:42.834369    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a80be958-508f-454a-b7ae-6db432c34ccf-etc-kubernetes\") pod \"tuned-kcmrw\" (UID: \"a80be958-508f-454a-b7ae-6db432c34ccf\") " pod="openshift-cluster-node-tuning-operator/tuned-kcmrw"
Jul 18 11:19:42.834505 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:42.834395    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/49f40ae2-d33c-4284-a889-0d9b27421bf4-cni-binary-copy\") pod \"multus-additional-cni-plugins-lmf4l\" (UID: \"49f40ae2-d33c-4284-a889-0d9b27421bf4\") " pod="openshift-multus/multus-additional-cni-plugins-lmf4l"
Jul 18 11:19:42.834505 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:42.834412    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/914d8131-27d9-481c-b7e2-484f467526dc-host-run-netns\") pod \"multus-rc6td\" (UID: \"914d8131-27d9-481c-b7e2-484f467526dc\") " pod="openshift-multus/multus-rc6td"
Jul 18 11:19:42.834505 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:42.834435    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/914d8131-27d9-481c-b7e2-484f467526dc-host-var-lib-cni-bin\") pod \"multus-rc6td\" (UID: \"914d8131-27d9-481c-b7e2-484f467526dc\") " pod="openshift-multus/multus-rc6td"
Jul 18 11:19:42.834505 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:42.834463    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/914d8131-27d9-481c-b7e2-484f467526dc-hostroot\") pod \"multus-rc6td\" (UID: \"914d8131-27d9-481c-b7e2-484f467526dc\") " pod="openshift-multus/multus-rc6td"
Jul 18 11:19:42.834505 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:42.834486    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/40e8e19c-87b3-4cd6-81c1-0f404971a282-systemd-units\") pod \"ovnkube-node-58jnn\" (UID: \"40e8e19c-87b3-4cd6-81c1-0f404971a282\") " pod="openshift-ovn-kubernetes/ovnkube-node-58jnn"
Jul 18 11:19:42.834833 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:42.834510    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/40e8e19c-87b3-4cd6-81c1-0f404971a282-var-lib-openvswitch\") pod \"ovnkube-node-58jnn\" (UID: \"40e8e19c-87b3-4cd6-81c1-0f404971a282\") " pod="openshift-ovn-kubernetes/ovnkube-node-58jnn"
Jul 18 11:19:42.834833 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:42.834532    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/914d8131-27d9-481c-b7e2-484f467526dc-system-cni-dir\") pod \"multus-rc6td\" (UID: \"914d8131-27d9-481c-b7e2-484f467526dc\") " pod="openshift-multus/multus-rc6td"
Jul 18 11:19:42.834833 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:42.834586    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/914d8131-27d9-481c-b7e2-484f467526dc-cnibin\") pod \"multus-rc6td\" (UID: \"914d8131-27d9-481c-b7e2-484f467526dc\") " pod="openshift-multus/multus-rc6td"
Jul 18 11:19:42.834833 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:42.834622    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/49f40ae2-d33c-4284-a889-0d9b27421bf4-os-release\") pod \"multus-additional-cni-plugins-lmf4l\" (UID: \"49f40ae2-d33c-4284-a889-0d9b27421bf4\") " pod="openshift-multus/multus-additional-cni-plugins-lmf4l"
Jul 18 11:19:42.834833 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:42.834651    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/a80be958-508f-454a-b7ae-6db432c34ccf-etc-sysconfig\") pod \"tuned-kcmrw\" (UID: \"a80be958-508f-454a-b7ae-6db432c34ccf\") " pod="openshift-cluster-node-tuning-operator/tuned-kcmrw"
Jul 18 11:19:42.834833 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:42.834678    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/40e8e19c-87b3-4cd6-81c1-0f404971a282-etc-openvswitch\") pod \"ovnkube-node-58jnn\" (UID: \"40e8e19c-87b3-4cd6-81c1-0f404971a282\") " pod="openshift-ovn-kubernetes/ovnkube-node-58jnn"
Jul 18 11:19:42.834833 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:42.834720    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/914d8131-27d9-481c-b7e2-484f467526dc-multus-socket-dir-parent\") pod \"multus-rc6td\" (UID: \"914d8131-27d9-481c-b7e2-484f467526dc\") " pod="openshift-multus/multus-rc6td"
Jul 18 11:19:42.834833 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:42.834746    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/914d8131-27d9-481c-b7e2-484f467526dc-multus-daemon-config\") pod \"multus-rc6td\" (UID: \"914d8131-27d9-481c-b7e2-484f467526dc\") " pod="openshift-multus/multus-rc6td"
Jul 18 11:19:42.834833 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:42.834769    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a80be958-508f-454a-b7ae-6db432c34ccf-host\") pod \"tuned-kcmrw\" (UID: \"a80be958-508f-454a-b7ae-6db432c34ccf\") " pod="openshift-cluster-node-tuning-operator/tuned-kcmrw"
Jul 18 11:19:42.834833 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:42.834794    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a80be958-508f-454a-b7ae-6db432c34ccf-tmp\") pod \"tuned-kcmrw\" (UID: \"a80be958-508f-454a-b7ae-6db432c34ccf\") " pod="openshift-cluster-node-tuning-operator/tuned-kcmrw"
Jul 18 11:19:42.835491 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:42.834847    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/b4c72690-9e6e-4826-8ff8-95eeea44b5d0-kubelet-config\") pod \"global-pull-secret-syncer-6j4vg\" (UID: \"b4c72690-9e6e-4826-8ff8-95eeea44b5d0\") " pod="kube-system/global-pull-secret-syncer-6j4vg"
Jul 18 11:19:42.835491 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:42.834922    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v2r7x\" (UniqueName: \"kubernetes.io/projected/49f40ae2-d33c-4284-a889-0d9b27421bf4-kube-api-access-v2r7x\") pod \"multus-additional-cni-plugins-lmf4l\" (UID: \"49f40ae2-d33c-4284-a889-0d9b27421bf4\") " pod="openshift-multus/multus-additional-cni-plugins-lmf4l"
Jul 18 11:19:42.835491 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:42.834959    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/40e8e19c-87b3-4cd6-81c1-0f404971a282-host-run-ovn-kubernetes\") pod \"ovnkube-node-58jnn\" (UID: \"40e8e19c-87b3-4cd6-81c1-0f404971a282\") " pod="openshift-ovn-kubernetes/ovnkube-node-58jnn"
Jul 18 11:19:42.835491 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:42.834986    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/914d8131-27d9-481c-b7e2-484f467526dc-multus-cni-dir\") pod \"multus-rc6td\" (UID: \"914d8131-27d9-481c-b7e2-484f467526dc\") " pod="openshift-multus/multus-rc6td"
Jul 18 11:19:42.835491 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:42.835012    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zpnqf\" (UniqueName: \"kubernetes.io/projected/a80be958-508f-454a-b7ae-6db432c34ccf-kube-api-access-zpnqf\") pod \"tuned-kcmrw\" (UID: \"a80be958-508f-454a-b7ae-6db432c34ccf\") " pod="openshift-cluster-node-tuning-operator/tuned-kcmrw"
Jul 18 11:19:42.835491 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:42.835047    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/49f40ae2-d33c-4284-a889-0d9b27421bf4-system-cni-dir\") pod \"multus-additional-cni-plugins-lmf4l\" (UID: \"49f40ae2-d33c-4284-a889-0d9b27421bf4\") " pod="openshift-multus/multus-additional-cni-plugins-lmf4l"
Jul 18 11:19:42.835491 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:42.835072    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/40e8e19c-87b3-4cd6-81c1-0f404971a282-host-cni-netd\") pod \"ovnkube-node-58jnn\" (UID: \"40e8e19c-87b3-4cd6-81c1-0f404971a282\") " pod="openshift-ovn-kubernetes/ovnkube-node-58jnn"
Jul 18 11:19:42.835491 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:42.835101    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/40e8e19c-87b3-4cd6-81c1-0f404971a282-env-overrides\") pod \"ovnkube-node-58jnn\" (UID: \"40e8e19c-87b3-4cd6-81c1-0f404971a282\") " pod="openshift-ovn-kubernetes/ovnkube-node-58jnn"
Jul 18 11:19:42.835491 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:42.835129    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/40e8e19c-87b3-4cd6-81c1-0f404971a282-ovn-node-metrics-cert\") pod \"ovnkube-node-58jnn\" (UID: \"40e8e19c-87b3-4cd6-81c1-0f404971a282\") " pod="openshift-ovn-kubernetes/ovnkube-node-58jnn"
Jul 18 11:19:42.835491 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:42.835184    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/914d8131-27d9-481c-b7e2-484f467526dc-host-var-lib-cni-multus\") pod \"multus-rc6td\" (UID: \"914d8131-27d9-481c-b7e2-484f467526dc\") " pod="openshift-multus/multus-rc6td"
Jul 18 11:19:42.835491 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:42.835230    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/914d8131-27d9-481c-b7e2-484f467526dc-etc-kubernetes\") pod \"multus-rc6td\" (UID: \"914d8131-27d9-481c-b7e2-484f467526dc\") " pod="openshift-multus/multus-rc6td"
Jul 18 11:19:42.835491 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:42.835260    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b4c72690-9e6e-4826-8ff8-95eeea44b5d0-original-pull-secret\") pod \"global-pull-secret-syncer-6j4vg\" (UID: \"b4c72690-9e6e-4826-8ff8-95eeea44b5d0\") " pod="kube-system/global-pull-secret-syncer-6j4vg"
Jul 18 11:19:42.835491 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:42.835287    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jn8r5\" (UniqueName: \"kubernetes.io/projected/8c337674-d048-4107-ae53-0dfdbccf2176-kube-api-access-jn8r5\") pod \"iptables-alerter-mj8nl\" (UID: \"8c337674-d048-4107-ae53-0dfdbccf2176\") " pod="openshift-network-operator/iptables-alerter-mj8nl"
Jul 18 11:19:42.835491 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:42.835376    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/8c337674-d048-4107-ae53-0dfdbccf2176-iptables-alerter-script\") pod \"iptables-alerter-mj8nl\" (UID: \"8c337674-d048-4107-ae53-0dfdbccf2176\") " pod="openshift-network-operator/iptables-alerter-mj8nl"
Jul 18 11:19:42.835491 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:42.835405    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/a80be958-508f-454a-b7ae-6db432c34ccf-etc-systemd\") pod \"tuned-kcmrw\" (UID: \"a80be958-508f-454a-b7ae-6db432c34ccf\") " pod="openshift-cluster-node-tuning-operator/tuned-kcmrw"
Jul 18 11:19:42.835491 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:42.835431    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0e090c50-e996-4eda-b8c0-46d7f7d7dde3-metrics-certs\") pod \"network-metrics-daemon-ljhk6\" (UID: \"0e090c50-e996-4eda-b8c0-46d7f7d7dde3\") " pod="openshift-multus/network-metrics-daemon-ljhk6"
Jul 18 11:19:42.836371 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:42.835457    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/40e8e19c-87b3-4cd6-81c1-0f404971a282-run-systemd\") pod \"ovnkube-node-58jnn\" (UID: \"40e8e19c-87b3-4cd6-81c1-0f404971a282\") " pod="openshift-ovn-kubernetes/ovnkube-node-58jnn"
Jul 18 11:19:42.836371 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:42.835504    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a80be958-508f-454a-b7ae-6db432c34ccf-var-lib-kubelet\") pod \"tuned-kcmrw\" (UID: \"a80be958-508f-454a-b7ae-6db432c34ccf\") " pod="openshift-cluster-node-tuning-operator/tuned-kcmrw"
Jul 18 11:19:42.836371 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:42.835545    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/b4c72690-9e6e-4826-8ff8-95eeea44b5d0-dbus\") pod \"global-pull-secret-syncer-6j4vg\" (UID: \"b4c72690-9e6e-4826-8ff8-95eeea44b5d0\") " pod="kube-system/global-pull-secret-syncer-6j4vg"
Jul 18 11:19:42.836371 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:42.835569    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/40e8e19c-87b3-4cd6-81c1-0f404971a282-run-ovn\") pod \"ovnkube-node-58jnn\" (UID: \"40e8e19c-87b3-4cd6-81c1-0f404971a282\") " pod="openshift-ovn-kubernetes/ovnkube-node-58jnn"
Jul 18 11:19:42.836371 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:42.835592    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/40e8e19c-87b3-4cd6-81c1-0f404971a282-ovnkube-config\") pod \"ovnkube-node-58jnn\" (UID: \"40e8e19c-87b3-4cd6-81c1-0f404971a282\") " pod="openshift-ovn-kubernetes/ovnkube-node-58jnn"
Jul 18 11:19:42.836371 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:42.835593    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 18 11:19:42.836371 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:42.835642    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/40e8e19c-87b3-4cd6-81c1-0f404971a282-ovnkube-script-lib\") pod \"ovnkube-node-58jnn\" (UID: \"40e8e19c-87b3-4cd6-81c1-0f404971a282\") " pod="openshift-ovn-kubernetes/ovnkube-node-58jnn"
Jul 18 11:19:42.836371 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:42.835680    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/914d8131-27d9-481c-b7e2-484f467526dc-cni-binary-copy\") pod \"multus-rc6td\" (UID: \"914d8131-27d9-481c-b7e2-484f467526dc\") " pod="openshift-multus/multus-rc6td"
Jul 18 11:19:42.836371 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:42.835707    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/49f40ae2-d33c-4284-a889-0d9b27421bf4-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-lmf4l\" (UID: \"49f40ae2-d33c-4284-a889-0d9b27421bf4\") " pod="openshift-multus/multus-additional-cni-plugins-lmf4l"
Jul 18 11:19:42.836371 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:42.835706    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-krv7n\""
Jul 18 11:19:42.836371 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:42.835745    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6kxkb\" (UniqueName: \"kubernetes.io/projected/e24556f0-f108-4c9d-a3b1-5d0548925197-kube-api-access-6kxkb\") pod \"node-ca-bz5mq\" (UID: \"e24556f0-f108-4c9d-a3b1-5d0548925197\") " pod="openshift-image-registry/node-ca-bz5mq"
Jul 18 11:19:42.836371 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:42.835717    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 18 11:19:42.836371 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:42.835779    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8c337674-d048-4107-ae53-0dfdbccf2176-host-slash\") pod \"iptables-alerter-mj8nl\" (UID: \"8c337674-d048-4107-ae53-0dfdbccf2176\") " pod="openshift-network-operator/iptables-alerter-mj8nl"
Jul 18 11:19:42.836371 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:42.835808    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/40e8e19c-87b3-4cd6-81c1-0f404971a282-host-run-netns\") pod \"ovnkube-node-58jnn\" (UID: \"40e8e19c-87b3-4cd6-81c1-0f404971a282\") " pod="openshift-ovn-kubernetes/ovnkube-node-58jnn"
Jul 18 11:19:42.836371 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:42.835835    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/a80be958-508f-454a-b7ae-6db432c34ccf-etc-modprobe-d\") pod \"tuned-kcmrw\" (UID: \"a80be958-508f-454a-b7ae-6db432c34ccf\") " pod="openshift-cluster-node-tuning-operator/tuned-kcmrw"
Jul 18 11:19:42.836371 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:42.835916    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/a80be958-508f-454a-b7ae-6db432c34ccf-etc-tuned\") pod \"tuned-kcmrw\" (UID: \"a80be958-508f-454a-b7ae-6db432c34ccf\") " pod="openshift-cluster-node-tuning-operator/tuned-kcmrw"
Jul 18 11:19:42.836371 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:42.835945    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-4522z"
Jul 18 11:19:42.836371 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:42.835958    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e24556f0-f108-4c9d-a3b1-5d0548925197-host\") pod \"node-ca-bz5mq\" (UID: \"e24556f0-f108-4c9d-a3b1-5d0548925197\") " pod="openshift-image-registry/node-ca-bz5mq"
Jul 18 11:19:42.836371 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:42.836033    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/49f40ae2-d33c-4284-a889-0d9b27421bf4-cnibin\") pod \"multus-additional-cni-plugins-lmf4l\" (UID: \"49f40ae2-d33c-4284-a889-0d9b27421bf4\") " pod="openshift-multus/multus-additional-cni-plugins-lmf4l"
Jul 18 11:19:42.837255 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:42.836038    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 18 11:19:42.837255 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:42.836059    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/49f40ae2-d33c-4284-a889-0d9b27421bf4-tuning-conf-dir\") pod \"multus-additional-cni-plugins-lmf4l\" (UID: \"49f40ae2-d33c-4284-a889-0d9b27421bf4\") " pod="openshift-multus/multus-additional-cni-plugins-lmf4l"
Jul 18 11:19:42.837255 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:42.836083    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/40e8e19c-87b3-4cd6-81c1-0f404971a282-host-cni-bin\") pod \"ovnkube-node-58jnn\" (UID: \"40e8e19c-87b3-4cd6-81c1-0f404971a282\") " pod="openshift-ovn-kubernetes/ovnkube-node-58jnn"
Jul 18 11:19:42.837255 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:42.836116    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/914d8131-27d9-481c-b7e2-484f467526dc-os-release\") pod \"multus-rc6td\" (UID: \"914d8131-27d9-481c-b7e2-484f467526dc\") " pod="openshift-multus/multus-rc6td"
Jul 18 11:19:42.837255 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:42.836144    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/914d8131-27d9-481c-b7e2-484f467526dc-host-var-lib-kubelet\") pod \"multus-rc6td\" (UID: \"914d8131-27d9-481c-b7e2-484f467526dc\") " pod="openshift-multus/multus-rc6td"
Jul 18 11:19:42.837255 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:42.836171    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t6f7x\" (UniqueName: \"kubernetes.io/projected/914d8131-27d9-481c-b7e2-484f467526dc-kube-api-access-t6f7x\") pod \"multus-rc6td\" (UID: \"914d8131-27d9-481c-b7e2-484f467526dc\") " pod="openshift-multus/multus-rc6td"
Jul 18 11:19:42.837255 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:42.836199    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/a80be958-508f-454a-b7ae-6db432c34ccf-etc-sysctl-d\") pod \"tuned-kcmrw\" (UID: \"a80be958-508f-454a-b7ae-6db432c34ccf\") " pod="openshift-cluster-node-tuning-operator/tuned-kcmrw"
Jul 18 11:19:42.837255 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:42.836220    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/a80be958-508f-454a-b7ae-6db432c34ccf-run\") pod \"tuned-kcmrw\" (UID: \"a80be958-508f-454a-b7ae-6db432c34ccf\") " pod="openshift-cluster-node-tuning-operator/tuned-kcmrw"
Jul 18 11:19:42.837255 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:42.836241    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/40e8e19c-87b3-4cd6-81c1-0f404971a282-host-kubelet\") pod \"ovnkube-node-58jnn\" (UID: \"40e8e19c-87b3-4cd6-81c1-0f404971a282\") " pod="openshift-ovn-kubernetes/ovnkube-node-58jnn"
Jul 18 11:19:42.837255 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:42.836265    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/40e8e19c-87b3-4cd6-81c1-0f404971a282-log-socket\") pod \"ovnkube-node-58jnn\" (UID: \"40e8e19c-87b3-4cd6-81c1-0f404971a282\") " pod="openshift-ovn-kubernetes/ovnkube-node-58jnn"
Jul 18 11:19:42.837255 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:42.836285    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/40e8e19c-87b3-4cd6-81c1-0f404971a282-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-58jnn\" (UID: \"40e8e19c-87b3-4cd6-81c1-0f404971a282\") " pod="openshift-ovn-kubernetes/ovnkube-node-58jnn"
Jul 18 11:19:42.837255 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:42.836308    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/914d8131-27d9-481c-b7e2-484f467526dc-host-run-k8s-cni-cncf-io\") pod \"multus-rc6td\" (UID: \"914d8131-27d9-481c-b7e2-484f467526dc\") " pod="openshift-multus/multus-rc6td"
Jul 18 11:19:42.837255 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:42.836335    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a80be958-508f-454a-b7ae-6db432c34ccf-sys\") pod \"tuned-kcmrw\" (UID: \"a80be958-508f-454a-b7ae-6db432c34ccf\") " pod="openshift-cluster-node-tuning-operator/tuned-kcmrw"
Jul 18 11:19:42.837255 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:42.836358    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/e24556f0-f108-4c9d-a3b1-5d0548925197-serviceca\") pod \"node-ca-bz5mq\" (UID: \"e24556f0-f108-4c9d-a3b1-5d0548925197\") " pod="openshift-image-registry/node-ca-bz5mq"
Jul 18 11:19:42.837255 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:42.836404    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/914d8131-27d9-481c-b7e2-484f467526dc-multus-conf-dir\") pod \"multus-rc6td\" (UID: \"914d8131-27d9-481c-b7e2-484f467526dc\") " pod="openshift-multus/multus-rc6td"
Jul 18 11:19:42.837255 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:42.836428    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/a80be958-508f-454a-b7ae-6db432c34ccf-etc-sysctl-conf\") pod \"tuned-kcmrw\" (UID: \"a80be958-508f-454a-b7ae-6db432c34ccf\") " pod="openshift-cluster-node-tuning-operator/tuned-kcmrw"
Jul 18 11:19:42.837255 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:42.836448    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a80be958-508f-454a-b7ae-6db432c34ccf-lib-modules\") pod \"tuned-kcmrw\" (UID: \"a80be958-508f-454a-b7ae-6db432c34ccf\") " pod="openshift-cluster-node-tuning-operator/tuned-kcmrw"
Jul 18 11:19:42.837844 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:42.836505    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/49f40ae2-d33c-4284-a889-0d9b27421bf4-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-lmf4l\" (UID: \"49f40ae2-d33c-4284-a889-0d9b27421bf4\") " pod="openshift-multus/multus-additional-cni-plugins-lmf4l"
Jul 18 11:19:42.837844 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:42.836513    2579 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 18 11:19:42.837844 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:42.836535    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/40e8e19c-87b3-4cd6-81c1-0f404971a282-run-openvswitch\") pod \"ovnkube-node-58jnn\" (UID: \"40e8e19c-87b3-4cd6-81c1-0f404971a282\") " pod="openshift-ovn-kubernetes/ovnkube-node-58jnn"
Jul 18 11:19:42.837844 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:42.836561    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rcrx2\" (UniqueName: \"kubernetes.io/projected/0e090c50-e996-4eda-b8c0-46d7f7d7dde3-kube-api-access-rcrx2\") pod \"network-metrics-daemon-ljhk6\" (UID: \"0e090c50-e996-4eda-b8c0-46d7f7d7dde3\") " pod="openshift-multus/network-metrics-daemon-ljhk6"
Jul 18 11:19:42.838285 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:42.838268    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 18 11:19:42.838404 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:42.838384    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-ztfqj\""
Jul 18 11:19:42.838447 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:42.838388    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 18 11:19:42.855834 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:42.855805    2579 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-mw7q7"
Jul 18 11:19:42.862069 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:42.862051    2579 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-mw7q7"
Jul 18 11:19:42.923945 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:42.923852    2579 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 18 11:19:42.924718 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:42.924675    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-122.ec2.internal" event={"ID":"b7129788cc0ed725bc5853009237d25d","Type":"ContainerStarted","Data":"8f5f952c514738e5a421c8e0d91835e03b7b6e73e512f4fbbe9165807c060c94"}
Jul 18 11:19:42.925800 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:42.925777    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-122.ec2.internal" event={"ID":"2a172972fbb39a4c6031f848e0d266ff","Type":"ContainerStarted","Data":"663cfa19e12d4fb776996425b79cf95d9a0e6eb0798ca98e5b2fb3e6642357e8"}
Jul 18 11:19:42.936789 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:42.936758    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/40e8e19c-87b3-4cd6-81c1-0f404971a282-run-systemd\") pod \"ovnkube-node-58jnn\" (UID: \"40e8e19c-87b3-4cd6-81c1-0f404971a282\") " pod="openshift-ovn-kubernetes/ovnkube-node-58jnn"
Jul 18 11:19:42.936936 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:42.936799    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a80be958-508f-454a-b7ae-6db432c34ccf-var-lib-kubelet\") pod \"tuned-kcmrw\" (UID: \"a80be958-508f-454a-b7ae-6db432c34ccf\") " pod="openshift-cluster-node-tuning-operator/tuned-kcmrw"
Jul 18 11:19:42.936936 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:42.936849    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/40e8e19c-87b3-4cd6-81c1-0f404971a282-run-systemd\") pod \"ovnkube-node-58jnn\" (UID: \"40e8e19c-87b3-4cd6-81c1-0f404971a282\") " pod="openshift-ovn-kubernetes/ovnkube-node-58jnn"
Jul 18 11:19:42.936936 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:42.936862    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a80be958-508f-454a-b7ae-6db432c34ccf-var-lib-kubelet\") pod \"tuned-kcmrw\" (UID: \"a80be958-508f-454a-b7ae-6db432c34ccf\") " pod="openshift-cluster-node-tuning-operator/tuned-kcmrw"
Jul 18 11:19:42.936936 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:42.936904    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/b4c72690-9e6e-4826-8ff8-95eeea44b5d0-dbus\") pod \"global-pull-secret-syncer-6j4vg\" (UID: \"b4c72690-9e6e-4826-8ff8-95eeea44b5d0\") " pod="kube-system/global-pull-secret-syncer-6j4vg"
Jul 18 11:19:42.936936 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:42.936933    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/40e8e19c-87b3-4cd6-81c1-0f404971a282-run-ovn\") pod \"ovnkube-node-58jnn\" (UID: \"40e8e19c-87b3-4cd6-81c1-0f404971a282\") " pod="openshift-ovn-kubernetes/ovnkube-node-58jnn"
Jul 18 11:19:42.937185 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:42.936950    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/40e8e19c-87b3-4cd6-81c1-0f404971a282-ovnkube-config\") pod \"ovnkube-node-58jnn\" (UID: \"40e8e19c-87b3-4cd6-81c1-0f404971a282\") " pod="openshift-ovn-kubernetes/ovnkube-node-58jnn"
Jul 18 11:19:42.937185 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:42.936969    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/40e8e19c-87b3-4cd6-81c1-0f404971a282-ovnkube-script-lib\") pod \"ovnkube-node-58jnn\" (UID: \"40e8e19c-87b3-4cd6-81c1-0f404971a282\") " pod="openshift-ovn-kubernetes/ovnkube-node-58jnn"
Jul 18 11:19:42.937185 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:42.936986    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/914d8131-27d9-481c-b7e2-484f467526dc-cni-binary-copy\") pod \"multus-rc6td\" (UID: \"914d8131-27d9-481c-b7e2-484f467526dc\") " pod="openshift-multus/multus-rc6td"
Jul 18 11:19:42.937185 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:42.937005    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/e0f67788-e972-49ff-b611-b9835f528d81-konnectivity-ca\") pod \"konnectivity-agent-hnt7j\" (UID: \"e0f67788-e972-49ff-b611-b9835f528d81\") " pod="kube-system/konnectivity-agent-hnt7j"
Jul 18 11:19:42.937185 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:42.937020    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/40e8e19c-87b3-4cd6-81c1-0f404971a282-run-ovn\") pod \"ovnkube-node-58jnn\" (UID: \"40e8e19c-87b3-4cd6-81c1-0f404971a282\") " pod="openshift-ovn-kubernetes/ovnkube-node-58jnn"
Jul 18 11:19:42.937185 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:42.937028    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/49f40ae2-d33c-4284-a889-0d9b27421bf4-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-lmf4l\" (UID: \"49f40ae2-d33c-4284-a889-0d9b27421bf4\") " pod="openshift-multus/multus-additional-cni-plugins-lmf4l"
Jul 18 11:19:42.937185 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:42.937086    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6kxkb\" (UniqueName: \"kubernetes.io/projected/e24556f0-f108-4c9d-a3b1-5d0548925197-kube-api-access-6kxkb\") pod \"node-ca-bz5mq\" (UID: \"e24556f0-f108-4c9d-a3b1-5d0548925197\") " pod="openshift-image-registry/node-ca-bz5mq"
Jul 18 11:19:42.937185 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:42.937135    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/b4c72690-9e6e-4826-8ff8-95eeea44b5d0-dbus\") pod \"global-pull-secret-syncer-6j4vg\" (UID: \"b4c72690-9e6e-4826-8ff8-95eeea44b5d0\") " pod="kube-system/global-pull-secret-syncer-6j4vg"
Jul 18 11:19:42.937185 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:42.937158    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/aa392a6c-12d5-4e00-beda-a16aed7a5e09-registration-dir\") pod \"aws-ebs-csi-driver-node-lvgzl\" (UID: \"aa392a6c-12d5-4e00-beda-a16aed7a5e09\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lvgzl"
Jul 18 11:19:42.937638 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:42.937192    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8c337674-d048-4107-ae53-0dfdbccf2176-host-slash\") pod \"iptables-alerter-mj8nl\" (UID: \"8c337674-d048-4107-ae53-0dfdbccf2176\") " pod="openshift-network-operator/iptables-alerter-mj8nl"
Jul 18 11:19:42.937638 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:42.937218    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/40e8e19c-87b3-4cd6-81c1-0f404971a282-host-run-netns\") pod \"ovnkube-node-58jnn\" (UID: \"40e8e19c-87b3-4cd6-81c1-0f404971a282\") " pod="openshift-ovn-kubernetes/ovnkube-node-58jnn"
Jul 18 11:19:42.937638 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:42.937245    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/a80be958-508f-454a-b7ae-6db432c34ccf-etc-modprobe-d\") pod \"tuned-kcmrw\" (UID: \"a80be958-508f-454a-b7ae-6db432c34ccf\") " pod="openshift-cluster-node-tuning-operator/tuned-kcmrw"
Jul 18 11:19:42.937638 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:42.937271    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8c337674-d048-4107-ae53-0dfdbccf2176-host-slash\") pod \"iptables-alerter-mj8nl\" (UID: \"8c337674-d048-4107-ae53-0dfdbccf2176\") " pod="openshift-network-operator/iptables-alerter-mj8nl"
Jul 18 11:19:42.937638 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:42.937272    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/a80be958-508f-454a-b7ae-6db432c34ccf-etc-tuned\") pod \"tuned-kcmrw\" (UID: \"a80be958-508f-454a-b7ae-6db432c34ccf\") " pod="openshift-cluster-node-tuning-operator/tuned-kcmrw"
Jul 18 11:19:42.937638 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:42.937331    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e24556f0-f108-4c9d-a3b1-5d0548925197-host\") pod \"node-ca-bz5mq\" (UID: \"e24556f0-f108-4c9d-a3b1-5d0548925197\") " pod="openshift-image-registry/node-ca-bz5mq"
Jul 18 11:19:42.937638 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:42.937364    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/899ed5f2-c702-4904-82e7-0ab5570dd7d3-hosts-file\") pod \"node-resolver-4522z\" (UID: \"899ed5f2-c702-4904-82e7-0ab5570dd7d3\") " pod="openshift-dns/node-resolver-4522z"
Jul 18 11:19:42.937638 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:42.937404    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e24556f0-f108-4c9d-a3b1-5d0548925197-host\") pod \"node-ca-bz5mq\" (UID: \"e24556f0-f108-4c9d-a3b1-5d0548925197\") " pod="openshift-image-registry/node-ca-bz5mq"
Jul 18 11:19:42.937638 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:42.937438    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/49f40ae2-d33c-4284-a889-0d9b27421bf4-cnibin\") pod \"multus-additional-cni-plugins-lmf4l\" (UID: \"49f40ae2-d33c-4284-a889-0d9b27421bf4\") " pod="openshift-multus/multus-additional-cni-plugins-lmf4l"
Jul 18 11:19:42.937638 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:42.937463    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/49f40ae2-d33c-4284-a889-0d9b27421bf4-tuning-conf-dir\") pod \"multus-additional-cni-plugins-lmf4l\" (UID: \"49f40ae2-d33c-4284-a889-0d9b27421bf4\") " pod="openshift-multus/multus-additional-cni-plugins-lmf4l"
Jul 18 11:19:42.937638 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:42.937503    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/40e8e19c-87b3-4cd6-81c1-0f404971a282-host-cni-bin\") pod \"ovnkube-node-58jnn\" (UID: \"40e8e19c-87b3-4cd6-81c1-0f404971a282\") " pod="openshift-ovn-kubernetes/ovnkube-node-58jnn"
Jul 18 11:19:42.937638 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:42.937520    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/a80be958-508f-454a-b7ae-6db432c34ccf-etc-modprobe-d\") pod \"tuned-kcmrw\" (UID: \"a80be958-508f-454a-b7ae-6db432c34ccf\") " pod="openshift-cluster-node-tuning-operator/tuned-kcmrw"
Jul 18 11:19:42.937638 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:42.937531    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/914d8131-27d9-481c-b7e2-484f467526dc-os-release\") pod \"multus-rc6td\" (UID: \"914d8131-27d9-481c-b7e2-484f467526dc\") " pod="openshift-multus/multus-rc6td"
Jul 18 11:19:42.937638 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:42.937557    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/914d8131-27d9-481c-b7e2-484f467526dc-host-var-lib-kubelet\") pod \"multus-rc6td\" (UID: \"914d8131-27d9-481c-b7e2-484f467526dc\") " pod="openshift-multus/multus-rc6td"
Jul 18 11:19:42.937638 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:42.937557    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/40e8e19c-87b3-4cd6-81c1-0f404971a282-host-run-netns\") pod \"ovnkube-node-58jnn\" (UID: \"40e8e19c-87b3-4cd6-81c1-0f404971a282\") " pod="openshift-ovn-kubernetes/ovnkube-node-58jnn"
Jul 18 11:19:42.937638 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:42.937573    2579 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 18 11:19:42.937638 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:42.937615    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/40e8e19c-87b3-4cd6-81c1-0f404971a282-host-cni-bin\") pod \"ovnkube-node-58jnn\" (UID: \"40e8e19c-87b3-4cd6-81c1-0f404971a282\") " pod="openshift-ovn-kubernetes/ovnkube-node-58jnn"
Jul 18 11:19:42.937638 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:42.937608    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t6f7x\" (UniqueName: \"kubernetes.io/projected/914d8131-27d9-481c-b7e2-484f467526dc-kube-api-access-t6f7x\") pod \"multus-rc6td\" (UID: \"914d8131-27d9-481c-b7e2-484f467526dc\") " pod="openshift-multus/multus-rc6td"
Jul 18 11:19:42.938596 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:42.937728    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/914d8131-27d9-481c-b7e2-484f467526dc-os-release\") pod \"multus-rc6td\" (UID: \"914d8131-27d9-481c-b7e2-484f467526dc\") " pod="openshift-multus/multus-rc6td"
Jul 18 11:19:42.938596 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:42.937743    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/49f40ae2-d33c-4284-a889-0d9b27421bf4-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-lmf4l\" (UID: \"49f40ae2-d33c-4284-a889-0d9b27421bf4\") " pod="openshift-multus/multus-additional-cni-plugins-lmf4l"
Jul 18 11:19:42.938596 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:42.937757    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/914d8131-27d9-481c-b7e2-484f467526dc-cni-binary-copy\") pod \"multus-rc6td\" (UID: \"914d8131-27d9-481c-b7e2-484f467526dc\") " pod="openshift-multus/multus-rc6td"
Jul 18 11:19:42.938596 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:42.937757    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/40e8e19c-87b3-4cd6-81c1-0f404971a282-ovnkube-script-lib\") pod \"ovnkube-node-58jnn\" (UID: \"40e8e19c-87b3-4cd6-81c1-0f404971a282\") " pod="openshift-ovn-kubernetes/ovnkube-node-58jnn"
Jul 18 11:19:42.938596 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:42.937783    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/914d8131-27d9-481c-b7e2-484f467526dc-host-var-lib-kubelet\") pod \"multus-rc6td\" (UID: \"914d8131-27d9-481c-b7e2-484f467526dc\") " pod="openshift-multus/multus-rc6td"
Jul 18 11:19:42.938596 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:42.937781    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/40e8e19c-87b3-4cd6-81c1-0f404971a282-ovnkube-config\") pod \"ovnkube-node-58jnn\" (UID: \"40e8e19c-87b3-4cd6-81c1-0f404971a282\") " pod="openshift-ovn-kubernetes/ovnkube-node-58jnn"
Jul 18 11:19:42.938596 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:42.937800    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/49f40ae2-d33c-4284-a889-0d9b27421bf4-cnibin\") pod \"multus-additional-cni-plugins-lmf4l\" (UID: \"49f40ae2-d33c-4284-a889-0d9b27421bf4\") " pod="openshift-multus/multus-additional-cni-plugins-lmf4l"
Jul 18 11:19:42.938596 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:42.937814    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/a80be958-508f-454a-b7ae-6db432c34ccf-etc-sysctl-d\") pod \"tuned-kcmrw\" (UID: \"a80be958-508f-454a-b7ae-6db432c34ccf\") " pod="openshift-cluster-node-tuning-operator/tuned-kcmrw"
Jul 18 11:19:42.938596 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:42.937898    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/49f40ae2-d33c-4284-a889-0d9b27421bf4-tuning-conf-dir\") pod \"multus-additional-cni-plugins-lmf4l\" (UID: \"49f40ae2-d33c-4284-a889-0d9b27421bf4\") " pod="openshift-multus/multus-additional-cni-plugins-lmf4l"
Jul 18 11:19:42.938596 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:42.937908    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/a80be958-508f-454a-b7ae-6db432c34ccf-run\") pod \"tuned-kcmrw\" (UID: \"a80be958-508f-454a-b7ae-6db432c34ccf\") " pod="openshift-cluster-node-tuning-operator/tuned-kcmrw"
Jul 18 11:19:42.938596 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:42.937923    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/a80be958-508f-454a-b7ae-6db432c34ccf-etc-sysctl-d\") pod \"tuned-kcmrw\" (UID: \"a80be958-508f-454a-b7ae-6db432c34ccf\") " pod="openshift-cluster-node-tuning-operator/tuned-kcmrw"
Jul 18 11:19:42.938596 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:42.937945    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/40e8e19c-87b3-4cd6-81c1-0f404971a282-host-kubelet\") pod \"ovnkube-node-58jnn\" (UID: \"40e8e19c-87b3-4cd6-81c1-0f404971a282\") " pod="openshift-ovn-kubernetes/ovnkube-node-58jnn"
Jul 18 11:19:42.938596 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:42.937974    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/40e8e19c-87b3-4cd6-81c1-0f404971a282-log-socket\") pod \"ovnkube-node-58jnn\" (UID: \"40e8e19c-87b3-4cd6-81c1-0f404971a282\") " pod="openshift-ovn-kubernetes/ovnkube-node-58jnn"
Jul 18 11:19:42.938596 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:42.937980    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/a80be958-508f-454a-b7ae-6db432c34ccf-run\") pod \"tuned-kcmrw\" (UID: \"a80be958-508f-454a-b7ae-6db432c34ccf\") " pod="openshift-cluster-node-tuning-operator/tuned-kcmrw"
Jul 18 11:19:42.938596 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:42.937997    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/40e8e19c-87b3-4cd6-81c1-0f404971a282-host-kubelet\") pod \"ovnkube-node-58jnn\" (UID: \"40e8e19c-87b3-4cd6-81c1-0f404971a282\") " pod="openshift-ovn-kubernetes/ovnkube-node-58jnn"
Jul 18 11:19:42.938596 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:42.938001    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/40e8e19c-87b3-4cd6-81c1-0f404971a282-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-58jnn\" (UID: \"40e8e19c-87b3-4cd6-81c1-0f404971a282\") " pod="openshift-ovn-kubernetes/ovnkube-node-58jnn"
Jul 18 11:19:42.938596 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:42.938026    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/40e8e19c-87b3-4cd6-81c1-0f404971a282-log-socket\") pod \"ovnkube-node-58jnn\" (UID: \"40e8e19c-87b3-4cd6-81c1-0f404971a282\") " pod="openshift-ovn-kubernetes/ovnkube-node-58jnn"
Jul 18 11:19:42.938596 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:42.938032    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/914d8131-27d9-481c-b7e2-484f467526dc-host-run-k8s-cni-cncf-io\") pod \"multus-rc6td\" (UID: \"914d8131-27d9-481c-b7e2-484f467526dc\") " pod="openshift-multus/multus-rc6td"
Jul 18 11:19:42.939543 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:42.938056    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a80be958-508f-454a-b7ae-6db432c34ccf-sys\") pod \"tuned-kcmrw\" (UID: \"a80be958-508f-454a-b7ae-6db432c34ccf\") " pod="openshift-cluster-node-tuning-operator/tuned-kcmrw"
Jul 18 11:19:42.939543 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:42.938080    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/e24556f0-f108-4c9d-a3b1-5d0548925197-serviceca\") pod \"node-ca-bz5mq\" (UID: \"e24556f0-f108-4c9d-a3b1-5d0548925197\") " pod="openshift-image-registry/node-ca-bz5mq"
Jul 18 11:19:42.939543 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:42.938108    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/e0f67788-e972-49ff-b611-b9835f528d81-agent-certs\") pod \"konnectivity-agent-hnt7j\" (UID: \"e0f67788-e972-49ff-b611-b9835f528d81\") " pod="kube-system/konnectivity-agent-hnt7j"
Jul 18 11:19:42.939543 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:42.938124    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a80be958-508f-454a-b7ae-6db432c34ccf-sys\") pod \"tuned-kcmrw\" (UID: \"a80be958-508f-454a-b7ae-6db432c34ccf\") " pod="openshift-cluster-node-tuning-operator/tuned-kcmrw"
Jul 18 11:19:42.939543 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:42.938135    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/aa392a6c-12d5-4e00-beda-a16aed7a5e09-socket-dir\") pod \"aws-ebs-csi-driver-node-lvgzl\" (UID: \"aa392a6c-12d5-4e00-beda-a16aed7a5e09\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lvgzl"
Jul 18 11:19:42.939543 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:42.938131    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/914d8131-27d9-481c-b7e2-484f467526dc-host-run-k8s-cni-cncf-io\") pod \"multus-rc6td\" (UID: \"914d8131-27d9-481c-b7e2-484f467526dc\") " pod="openshift-multus/multus-rc6td"
Jul 18 11:19:42.939543 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:42.938107    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/40e8e19c-87b3-4cd6-81c1-0f404971a282-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-58jnn\" (UID: \"40e8e19c-87b3-4cd6-81c1-0f404971a282\") " pod="openshift-ovn-kubernetes/ovnkube-node-58jnn"
Jul 18 11:19:42.939543 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:42.938169    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/914d8131-27d9-481c-b7e2-484f467526dc-multus-conf-dir\") pod \"multus-rc6td\" (UID: \"914d8131-27d9-481c-b7e2-484f467526dc\") " pod="openshift-multus/multus-rc6td"
Jul 18 11:19:42.939543 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:42.938193    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/a80be958-508f-454a-b7ae-6db432c34ccf-etc-sysctl-conf\") pod \"tuned-kcmrw\" (UID: \"a80be958-508f-454a-b7ae-6db432c34ccf\") " pod="openshift-cluster-node-tuning-operator/tuned-kcmrw"
Jul 18 11:19:42.939543 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:42.938197    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/914d8131-27d9-481c-b7e2-484f467526dc-multus-conf-dir\") pod \"multus-rc6td\" (UID: \"914d8131-27d9-481c-b7e2-484f467526dc\") " pod="openshift-multus/multus-rc6td"
Jul 18 11:19:42.939543 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:42.938213    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a80be958-508f-454a-b7ae-6db432c34ccf-lib-modules\") pod \"tuned-kcmrw\" (UID: \"a80be958-508f-454a-b7ae-6db432c34ccf\") " pod="openshift-cluster-node-tuning-operator/tuned-kcmrw"
Jul 18 11:19:42.939543 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:42.938236    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/899ed5f2-c702-4904-82e7-0ab5570dd7d3-tmp-dir\") pod \"node-resolver-4522z\" (UID: \"899ed5f2-c702-4904-82e7-0ab5570dd7d3\") " pod="openshift-dns/node-resolver-4522z"
Jul 18 11:19:42.939543 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:42.938258    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/49f40ae2-d33c-4284-a889-0d9b27421bf4-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-lmf4l\" (UID: \"49f40ae2-d33c-4284-a889-0d9b27421bf4\") " pod="openshift-multus/multus-additional-cni-plugins-lmf4l"
Jul 18 11:19:42.939543 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:42.938281    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/40e8e19c-87b3-4cd6-81c1-0f404971a282-run-openvswitch\") pod \"ovnkube-node-58jnn\" (UID: \"40e8e19c-87b3-4cd6-81c1-0f404971a282\") " pod="openshift-ovn-kubernetes/ovnkube-node-58jnn"
Jul 18 11:19:42.939543 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:42.938304    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/a80be958-508f-454a-b7ae-6db432c34ccf-etc-sysctl-conf\") pod \"tuned-kcmrw\" (UID: \"a80be958-508f-454a-b7ae-6db432c34ccf\") " pod="openshift-cluster-node-tuning-operator/tuned-kcmrw"
Jul 18 11:19:42.939543 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:42.938324    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rcrx2\" (UniqueName: \"kubernetes.io/projected/0e090c50-e996-4eda-b8c0-46d7f7d7dde3-kube-api-access-rcrx2\") pod \"network-metrics-daemon-ljhk6\" (UID: \"0e090c50-e996-4eda-b8c0-46d7f7d7dde3\") " pod="openshift-multus/network-metrics-daemon-ljhk6"
Jul 18 11:19:42.939543 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:42.938346    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a80be958-508f-454a-b7ae-6db432c34ccf-lib-modules\") pod \"tuned-kcmrw\" (UID: \"a80be958-508f-454a-b7ae-6db432c34ccf\") " pod="openshift-cluster-node-tuning-operator/tuned-kcmrw"
Jul 18 11:19:42.940484 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:42.938332    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/40e8e19c-87b3-4cd6-81c1-0f404971a282-run-openvswitch\") pod \"ovnkube-node-58jnn\" (UID: \"40e8e19c-87b3-4cd6-81c1-0f404971a282\") " pod="openshift-ovn-kubernetes/ovnkube-node-58jnn"
Jul 18 11:19:42.940484 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:42.938363    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/aa392a6c-12d5-4e00-beda-a16aed7a5e09-kubelet-dir\") pod \"aws-ebs-csi-driver-node-lvgzl\" (UID: \"aa392a6c-12d5-4e00-beda-a16aed7a5e09\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lvgzl"
Jul 18 11:19:42.940484 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:42.938394    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/40e8e19c-87b3-4cd6-81c1-0f404971a282-host-slash\") pod \"ovnkube-node-58jnn\" (UID: \"40e8e19c-87b3-4cd6-81c1-0f404971a282\") " pod="openshift-ovn-kubernetes/ovnkube-node-58jnn"
Jul 18 11:19:42.940484 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:42.938420    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/40e8e19c-87b3-4cd6-81c1-0f404971a282-node-log\") pod \"ovnkube-node-58jnn\" (UID: \"40e8e19c-87b3-4cd6-81c1-0f404971a282\") " pod="openshift-ovn-kubernetes/ovnkube-node-58jnn"
Jul 18 11:19:42.940484 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:42.938440    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fz4l9\" (UniqueName: \"kubernetes.io/projected/40e8e19c-87b3-4cd6-81c1-0f404971a282-kube-api-access-fz4l9\") pod \"ovnkube-node-58jnn\" (UID: \"40e8e19c-87b3-4cd6-81c1-0f404971a282\") " pod="openshift-ovn-kubernetes/ovnkube-node-58jnn"
Jul 18 11:19:42.940484 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:42.938466    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/914d8131-27d9-481c-b7e2-484f467526dc-host-run-multus-certs\") pod \"multus-rc6td\" (UID: \"914d8131-27d9-481c-b7e2-484f467526dc\") " pod="openshift-multus/multus-rc6td"
Jul 18 11:19:42.940484 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:42.938475    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/40e8e19c-87b3-4cd6-81c1-0f404971a282-host-slash\") pod \"ovnkube-node-58jnn\" (UID: \"40e8e19c-87b3-4cd6-81c1-0f404971a282\") " pod="openshift-ovn-kubernetes/ovnkube-node-58jnn"
Jul 18 11:19:42.940484 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:42.938491    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a80be958-508f-454a-b7ae-6db432c34ccf-etc-kubernetes\") pod \"tuned-kcmrw\" (UID: \"a80be958-508f-454a-b7ae-6db432c34ccf\") " pod="openshift-cluster-node-tuning-operator/tuned-kcmrw"
Jul 18 11:19:42.940484 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:42.938504    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/40e8e19c-87b3-4cd6-81c1-0f404971a282-node-log\") pod \"ovnkube-node-58jnn\" (UID: \"40e8e19c-87b3-4cd6-81c1-0f404971a282\") " pod="openshift-ovn-kubernetes/ovnkube-node-58jnn"
Jul 18 11:19:42.940484 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:42.938528    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/914d8131-27d9-481c-b7e2-484f467526dc-host-run-multus-certs\") pod \"multus-rc6td\" (UID: \"914d8131-27d9-481c-b7e2-484f467526dc\") " pod="openshift-multus/multus-rc6td"
Jul 18 11:19:42.940484 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:42.938537    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/e24556f0-f108-4c9d-a3b1-5d0548925197-serviceca\") pod \"node-ca-bz5mq\" (UID: \"e24556f0-f108-4c9d-a3b1-5d0548925197\") " pod="openshift-image-registry/node-ca-bz5mq"
Jul 18 11:19:42.940484 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:42.938546    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/49f40ae2-d33c-4284-a889-0d9b27421bf4-cni-binary-copy\") pod \"multus-additional-cni-plugins-lmf4l\" (UID: \"49f40ae2-d33c-4284-a889-0d9b27421bf4\") " pod="openshift-multus/multus-additional-cni-plugins-lmf4l"
Jul 18 11:19:42.940484 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:42.938572    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/914d8131-27d9-481c-b7e2-484f467526dc-host-run-netns\") pod \"multus-rc6td\" (UID: \"914d8131-27d9-481c-b7e2-484f467526dc\") " pod="openshift-multus/multus-rc6td"
Jul 18 11:19:42.940484 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:42.938588    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a80be958-508f-454a-b7ae-6db432c34ccf-etc-kubernetes\") pod \"tuned-kcmrw\" (UID: \"a80be958-508f-454a-b7ae-6db432c34ccf\") " pod="openshift-cluster-node-tuning-operator/tuned-kcmrw"
Jul 18 11:19:42.940484 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:42.938597    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/914d8131-27d9-481c-b7e2-484f467526dc-host-var-lib-cni-bin\") pod \"multus-rc6td\" (UID: \"914d8131-27d9-481c-b7e2-484f467526dc\") " pod="openshift-multus/multus-rc6td"
Jul 18 11:19:42.940484 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:42.938621    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/914d8131-27d9-481c-b7e2-484f467526dc-hostroot\") pod \"multus-rc6td\" (UID: \"914d8131-27d9-481c-b7e2-484f467526dc\") " pod="openshift-multus/multus-rc6td"
Jul 18 11:19:42.940484 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:42.938635    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/914d8131-27d9-481c-b7e2-484f467526dc-host-run-netns\") pod \"multus-rc6td\" (UID: \"914d8131-27d9-481c-b7e2-484f467526dc\") " pod="openshift-multus/multus-rc6td"
Jul 18 11:19:42.940484 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:42.938648    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d9kdd\" (UniqueName: \"kubernetes.io/projected/17f689f0-ceae-4eb8-acaa-922caaa8e3f8-kube-api-access-d9kdd\") pod \"network-check-target-cj4nh\" (UID: \"17f689f0-ceae-4eb8-acaa-922caaa8e3f8\") " pod="openshift-network-diagnostics/network-check-target-cj4nh"
Jul 18 11:19:42.941446 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:42.938675    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/914d8131-27d9-481c-b7e2-484f467526dc-host-var-lib-cni-bin\") pod \"multus-rc6td\" (UID: \"914d8131-27d9-481c-b7e2-484f467526dc\") " pod="openshift-multus/multus-rc6td"
Jul 18 11:19:42.941446 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:42.938677    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/40e8e19c-87b3-4cd6-81c1-0f404971a282-systemd-units\") pod \"ovnkube-node-58jnn\" (UID: \"40e8e19c-87b3-4cd6-81c1-0f404971a282\") " pod="openshift-ovn-kubernetes/ovnkube-node-58jnn"
Jul 18 11:19:42.941446 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:42.938695    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/914d8131-27d9-481c-b7e2-484f467526dc-hostroot\") pod \"multus-rc6td\" (UID: \"914d8131-27d9-481c-b7e2-484f467526dc\") " pod="openshift-multus/multus-rc6td"
Jul 18 11:19:42.941446 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:42.938699    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/49f40ae2-d33c-4284-a889-0d9b27421bf4-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-lmf4l\" (UID: \"49f40ae2-d33c-4284-a889-0d9b27421bf4\") " pod="openshift-multus/multus-additional-cni-plugins-lmf4l"
Jul 18 11:19:42.941446 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:42.938716    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/40e8e19c-87b3-4cd6-81c1-0f404971a282-systemd-units\") pod \"ovnkube-node-58jnn\" (UID: \"40e8e19c-87b3-4cd6-81c1-0f404971a282\") " pod="openshift-ovn-kubernetes/ovnkube-node-58jnn"
Jul 18 11:19:42.941446 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:42.938717    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/40e8e19c-87b3-4cd6-81c1-0f404971a282-var-lib-openvswitch\") pod \"ovnkube-node-58jnn\" (UID: \"40e8e19c-87b3-4cd6-81c1-0f404971a282\") " pod="openshift-ovn-kubernetes/ovnkube-node-58jnn"
Jul 18 11:19:42.941446 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:42.938749    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/40e8e19c-87b3-4cd6-81c1-0f404971a282-var-lib-openvswitch\") pod \"ovnkube-node-58jnn\" (UID: \"40e8e19c-87b3-4cd6-81c1-0f404971a282\") " pod="openshift-ovn-kubernetes/ovnkube-node-58jnn"
Jul 18 11:19:42.941446 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:42.938778    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/914d8131-27d9-481c-b7e2-484f467526dc-system-cni-dir\") pod \"multus-rc6td\" (UID: \"914d8131-27d9-481c-b7e2-484f467526dc\") " pod="openshift-multus/multus-rc6td"
Jul 18 11:19:42.941446 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:42.938805    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/914d8131-27d9-481c-b7e2-484f467526dc-cnibin\") pod \"multus-rc6td\" (UID: \"914d8131-27d9-481c-b7e2-484f467526dc\") " pod="openshift-multus/multus-rc6td"
Jul 18 11:19:42.941446 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:42.938837    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/aa392a6c-12d5-4e00-beda-a16aed7a5e09-device-dir\") pod \"aws-ebs-csi-driver-node-lvgzl\" (UID: \"aa392a6c-12d5-4e00-beda-a16aed7a5e09\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lvgzl"
Jul 18 11:19:42.941446 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:42.938866    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/49f40ae2-d33c-4284-a889-0d9b27421bf4-os-release\") pod \"multus-additional-cni-plugins-lmf4l\" (UID: \"49f40ae2-d33c-4284-a889-0d9b27421bf4\") " pod="openshift-multus/multus-additional-cni-plugins-lmf4l"
Jul 18 11:19:42.941446 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:42.938893    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/a80be958-508f-454a-b7ae-6db432c34ccf-etc-sysconfig\") pod \"tuned-kcmrw\" (UID: \"a80be958-508f-454a-b7ae-6db432c34ccf\") " pod="openshift-cluster-node-tuning-operator/tuned-kcmrw"
Jul 18 11:19:42.941446 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:42.938924    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/914d8131-27d9-481c-b7e2-484f467526dc-cnibin\") pod \"multus-rc6td\" (UID: \"914d8131-27d9-481c-b7e2-484f467526dc\") " pod="openshift-multus/multus-rc6td"
Jul 18 11:19:42.941446 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:42.938936    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/aa392a6c-12d5-4e00-beda-a16aed7a5e09-sys-fs\") pod \"aws-ebs-csi-driver-node-lvgzl\" (UID: \"aa392a6c-12d5-4e00-beda-a16aed7a5e09\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lvgzl"
Jul 18 11:19:42.941446 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:42.938911    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/914d8131-27d9-481c-b7e2-484f467526dc-system-cni-dir\") pod \"multus-rc6td\" (UID: \"914d8131-27d9-481c-b7e2-484f467526dc\") " pod="openshift-multus/multus-rc6td"
Jul 18 11:19:42.941446 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:42.938953    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/a80be958-508f-454a-b7ae-6db432c34ccf-etc-sysconfig\") pod \"tuned-kcmrw\" (UID: \"a80be958-508f-454a-b7ae-6db432c34ccf\") " pod="openshift-cluster-node-tuning-operator/tuned-kcmrw"
Jul 18 11:19:42.941446 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:42.938963    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/40e8e19c-87b3-4cd6-81c1-0f404971a282-etc-openvswitch\") pod \"ovnkube-node-58jnn\" (UID: \"40e8e19c-87b3-4cd6-81c1-0f404971a282\") " pod="openshift-ovn-kubernetes/ovnkube-node-58jnn"
Jul 18 11:19:42.941446 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:42.938955    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/49f40ae2-d33c-4284-a889-0d9b27421bf4-os-release\") pod \"multus-additional-cni-plugins-lmf4l\" (UID: \"49f40ae2-d33c-4284-a889-0d9b27421bf4\") " pod="openshift-multus/multus-additional-cni-plugins-lmf4l"
Jul 18 11:19:42.942292 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:42.938990    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/914d8131-27d9-481c-b7e2-484f467526dc-multus-socket-dir-parent\") pod \"multus-rc6td\" (UID: \"914d8131-27d9-481c-b7e2-484f467526dc\") " pod="openshift-multus/multus-rc6td"
Jul 18 11:19:42.942292 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:42.939014    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/914d8131-27d9-481c-b7e2-484f467526dc-multus-daemon-config\") pod \"multus-rc6td\" (UID: \"914d8131-27d9-481c-b7e2-484f467526dc\") " pod="openshift-multus/multus-rc6td"
Jul 18 11:19:42.942292 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:42.939015    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/40e8e19c-87b3-4cd6-81c1-0f404971a282-etc-openvswitch\") pod \"ovnkube-node-58jnn\" (UID: \"40e8e19c-87b3-4cd6-81c1-0f404971a282\") " pod="openshift-ovn-kubernetes/ovnkube-node-58jnn"
Jul 18 11:19:42.942292 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:42.939036    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/49f40ae2-d33c-4284-a889-0d9b27421bf4-cni-binary-copy\") pod \"multus-additional-cni-plugins-lmf4l\" (UID: \"49f40ae2-d33c-4284-a889-0d9b27421bf4\") " pod="openshift-multus/multus-additional-cni-plugins-lmf4l"
Jul 18 11:19:42.942292 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:42.939048    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/914d8131-27d9-481c-b7e2-484f467526dc-multus-socket-dir-parent\") pod \"multus-rc6td\" (UID: \"914d8131-27d9-481c-b7e2-484f467526dc\") " pod="openshift-multus/multus-rc6td"
Jul 18 11:19:42.942292 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:42.939069    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a80be958-508f-454a-b7ae-6db432c34ccf-host\") pod \"tuned-kcmrw\" (UID: \"a80be958-508f-454a-b7ae-6db432c34ccf\") " pod="openshift-cluster-node-tuning-operator/tuned-kcmrw"
Jul 18 11:19:42.942292 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:42.939088    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a80be958-508f-454a-b7ae-6db432c34ccf-tmp\") pod \"tuned-kcmrw\" (UID: \"a80be958-508f-454a-b7ae-6db432c34ccf\") " pod="openshift-cluster-node-tuning-operator/tuned-kcmrw"
Jul 18 11:19:42.942292 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:42.939104    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/b4c72690-9e6e-4826-8ff8-95eeea44b5d0-kubelet-config\") pod \"global-pull-secret-syncer-6j4vg\" (UID: \"b4c72690-9e6e-4826-8ff8-95eeea44b5d0\") " pod="kube-system/global-pull-secret-syncer-6j4vg"
Jul 18 11:19:42.942292 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:42.939132    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cmfnx\" (UniqueName: \"kubernetes.io/projected/aa392a6c-12d5-4e00-beda-a16aed7a5e09-kube-api-access-cmfnx\") pod \"aws-ebs-csi-driver-node-lvgzl\" (UID: \"aa392a6c-12d5-4e00-beda-a16aed7a5e09\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lvgzl"
Jul 18 11:19:42.942292 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:42.939140    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a80be958-508f-454a-b7ae-6db432c34ccf-host\") pod \"tuned-kcmrw\" (UID: \"a80be958-508f-454a-b7ae-6db432c34ccf\") " pod="openshift-cluster-node-tuning-operator/tuned-kcmrw"
Jul 18 11:19:42.942292 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:42.939164    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vhqln\" (UniqueName: \"kubernetes.io/projected/899ed5f2-c702-4904-82e7-0ab5570dd7d3-kube-api-access-vhqln\") pod \"node-resolver-4522z\" (UID: \"899ed5f2-c702-4904-82e7-0ab5570dd7d3\") " pod="openshift-dns/node-resolver-4522z"
Jul 18 11:19:42.942292 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:42.939189    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/b4c72690-9e6e-4826-8ff8-95eeea44b5d0-kubelet-config\") pod \"global-pull-secret-syncer-6j4vg\" (UID: \"b4c72690-9e6e-4826-8ff8-95eeea44b5d0\") " pod="kube-system/global-pull-secret-syncer-6j4vg"
Jul 18 11:19:42.942292 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:42.939193    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v2r7x\" (UniqueName: \"kubernetes.io/projected/49f40ae2-d33c-4284-a889-0d9b27421bf4-kube-api-access-v2r7x\") pod \"multus-additional-cni-plugins-lmf4l\" (UID: \"49f40ae2-d33c-4284-a889-0d9b27421bf4\") " pod="openshift-multus/multus-additional-cni-plugins-lmf4l"
Jul 18 11:19:42.942292 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:42.939254    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/40e8e19c-87b3-4cd6-81c1-0f404971a282-host-run-ovn-kubernetes\") pod \"ovnkube-node-58jnn\" (UID: \"40e8e19c-87b3-4cd6-81c1-0f404971a282\") " pod="openshift-ovn-kubernetes/ovnkube-node-58jnn"
Jul 18 11:19:42.942292 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:42.939282    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/914d8131-27d9-481c-b7e2-484f467526dc-multus-cni-dir\") pod \"multus-rc6td\" (UID: \"914d8131-27d9-481c-b7e2-484f467526dc\") " pod="openshift-multus/multus-rc6td"
Jul 18 11:19:42.942292 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:42.939307    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zpnqf\" (UniqueName: \"kubernetes.io/projected/a80be958-508f-454a-b7ae-6db432c34ccf-kube-api-access-zpnqf\") pod \"tuned-kcmrw\" (UID: \"a80be958-508f-454a-b7ae-6db432c34ccf\") " pod="openshift-cluster-node-tuning-operator/tuned-kcmrw"
Jul 18 11:19:42.942292 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:42.939336    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/40e8e19c-87b3-4cd6-81c1-0f404971a282-host-run-ovn-kubernetes\") pod \"ovnkube-node-58jnn\" (UID: \"40e8e19c-87b3-4cd6-81c1-0f404971a282\") " pod="openshift-ovn-kubernetes/ovnkube-node-58jnn"
Jul 18 11:19:42.942832 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:42.939340    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/49f40ae2-d33c-4284-a889-0d9b27421bf4-system-cni-dir\") pod \"multus-additional-cni-plugins-lmf4l\" (UID: \"49f40ae2-d33c-4284-a889-0d9b27421bf4\") " pod="openshift-multus/multus-additional-cni-plugins-lmf4l"
Jul 18 11:19:42.942832 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:42.939360    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/914d8131-27d9-481c-b7e2-484f467526dc-multus-cni-dir\") pod \"multus-rc6td\" (UID: \"914d8131-27d9-481c-b7e2-484f467526dc\") " pod="openshift-multus/multus-rc6td"
Jul 18 11:19:42.942832 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:42.939380    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/49f40ae2-d33c-4284-a889-0d9b27421bf4-system-cni-dir\") pod \"multus-additional-cni-plugins-lmf4l\" (UID: \"49f40ae2-d33c-4284-a889-0d9b27421bf4\") " pod="openshift-multus/multus-additional-cni-plugins-lmf4l"
Jul 18 11:19:42.942832 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:42.939382    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/40e8e19c-87b3-4cd6-81c1-0f404971a282-host-cni-netd\") pod \"ovnkube-node-58jnn\" (UID: \"40e8e19c-87b3-4cd6-81c1-0f404971a282\") " pod="openshift-ovn-kubernetes/ovnkube-node-58jnn"
Jul 18 11:19:42.942832 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:42.939417    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/40e8e19c-87b3-4cd6-81c1-0f404971a282-host-cni-netd\") pod \"ovnkube-node-58jnn\" (UID: \"40e8e19c-87b3-4cd6-81c1-0f404971a282\") " pod="openshift-ovn-kubernetes/ovnkube-node-58jnn"
Jul 18 11:19:42.942832 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:42.939418    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/40e8e19c-87b3-4cd6-81c1-0f404971a282-env-overrides\") pod \"ovnkube-node-58jnn\" (UID: \"40e8e19c-87b3-4cd6-81c1-0f404971a282\") " pod="openshift-ovn-kubernetes/ovnkube-node-58jnn"
Jul 18 11:19:42.942832 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:42.939448    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/914d8131-27d9-481c-b7e2-484f467526dc-multus-daemon-config\") pod \"multus-rc6td\" (UID: \"914d8131-27d9-481c-b7e2-484f467526dc\") " pod="openshift-multus/multus-rc6td"
Jul 18 11:19:42.942832 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:42.939445    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/40e8e19c-87b3-4cd6-81c1-0f404971a282-ovn-node-metrics-cert\") pod \"ovnkube-node-58jnn\" (UID: \"40e8e19c-87b3-4cd6-81c1-0f404971a282\") " pod="openshift-ovn-kubernetes/ovnkube-node-58jnn"
Jul 18 11:19:42.942832 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:42.939511    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/914d8131-27d9-481c-b7e2-484f467526dc-host-var-lib-cni-multus\") pod \"multus-rc6td\" (UID: \"914d8131-27d9-481c-b7e2-484f467526dc\") " pod="openshift-multus/multus-rc6td"
Jul 18 11:19:42.942832 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:42.939535    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/914d8131-27d9-481c-b7e2-484f467526dc-etc-kubernetes\") pod \"multus-rc6td\" (UID: \"914d8131-27d9-481c-b7e2-484f467526dc\") " pod="openshift-multus/multus-rc6td"
Jul 18 11:19:42.942832 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:42.939571    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/914d8131-27d9-481c-b7e2-484f467526dc-host-var-lib-cni-multus\") pod \"multus-rc6td\" (UID: \"914d8131-27d9-481c-b7e2-484f467526dc\") " pod="openshift-multus/multus-rc6td"
Jul 18 11:19:42.942832 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:42.939578    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b4c72690-9e6e-4826-8ff8-95eeea44b5d0-original-pull-secret\") pod \"global-pull-secret-syncer-6j4vg\" (UID: \"b4c72690-9e6e-4826-8ff8-95eeea44b5d0\") " pod="kube-system/global-pull-secret-syncer-6j4vg"
Jul 18 11:19:42.942832 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:42.939607    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/aa392a6c-12d5-4e00-beda-a16aed7a5e09-etc-selinux\") pod \"aws-ebs-csi-driver-node-lvgzl\" (UID: \"aa392a6c-12d5-4e00-beda-a16aed7a5e09\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lvgzl"
Jul 18 11:19:42.942832 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:42.939612    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/914d8131-27d9-481c-b7e2-484f467526dc-etc-kubernetes\") pod \"multus-rc6td\" (UID: \"914d8131-27d9-481c-b7e2-484f467526dc\") " pod="openshift-multus/multus-rc6td"
Jul 18 11:19:42.942832 ip-10-0-133-122 kubenswrapper[2579]: E0718 11:19:42.939675    2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 18 11:19:42.942832 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:42.939675    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jn8r5\" (UniqueName: \"kubernetes.io/projected/8c337674-d048-4107-ae53-0dfdbccf2176-kube-api-access-jn8r5\") pod \"iptables-alerter-mj8nl\" (UID: \"8c337674-d048-4107-ae53-0dfdbccf2176\") " pod="openshift-network-operator/iptables-alerter-mj8nl"
Jul 18 11:19:42.942832 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:42.939712    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/8c337674-d048-4107-ae53-0dfdbccf2176-iptables-alerter-script\") pod \"iptables-alerter-mj8nl\" (UID: \"8c337674-d048-4107-ae53-0dfdbccf2176\") " pod="openshift-network-operator/iptables-alerter-mj8nl"
Jul 18 11:19:42.943349 ip-10-0-133-122 kubenswrapper[2579]: E0718 11:19:42.939745    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b4c72690-9e6e-4826-8ff8-95eeea44b5d0-original-pull-secret podName:b4c72690-9e6e-4826-8ff8-95eeea44b5d0 nodeName:}" failed. No retries permitted until 2026-07-18 11:19:43.439722915 +0000 UTC m=+3.054759216 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b4c72690-9e6e-4826-8ff8-95eeea44b5d0-original-pull-secret") pod "global-pull-secret-syncer-6j4vg" (UID: "b4c72690-9e6e-4826-8ff8-95eeea44b5d0") : object "kube-system"/"original-pull-secret" not registered
Jul 18 11:19:42.943349 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:42.939763    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/a80be958-508f-454a-b7ae-6db432c34ccf-etc-systemd\") pod \"tuned-kcmrw\" (UID: \"a80be958-508f-454a-b7ae-6db432c34ccf\") " pod="openshift-cluster-node-tuning-operator/tuned-kcmrw"
Jul 18 11:19:42.943349 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:42.939790    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0e090c50-e996-4eda-b8c0-46d7f7d7dde3-metrics-certs\") pod \"network-metrics-daemon-ljhk6\" (UID: \"0e090c50-e996-4eda-b8c0-46d7f7d7dde3\") " pod="openshift-multus/network-metrics-daemon-ljhk6"
Jul 18 11:19:42.943349 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:42.939793    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/40e8e19c-87b3-4cd6-81c1-0f404971a282-env-overrides\") pod \"ovnkube-node-58jnn\" (UID: \"40e8e19c-87b3-4cd6-81c1-0f404971a282\") " pod="openshift-ovn-kubernetes/ovnkube-node-58jnn"
Jul 18 11:19:42.943349 ip-10-0-133-122 kubenswrapper[2579]: E0718 11:19:42.939883    2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 18 11:19:42.943349 ip-10-0-133-122 kubenswrapper[2579]: E0718 11:19:42.939954    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0e090c50-e996-4eda-b8c0-46d7f7d7dde3-metrics-certs podName:0e090c50-e996-4eda-b8c0-46d7f7d7dde3 nodeName:}" failed. No retries permitted until 2026-07-18 11:19:43.439932318 +0000 UTC m=+3.054968608 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0e090c50-e996-4eda-b8c0-46d7f7d7dde3-metrics-certs") pod "network-metrics-daemon-ljhk6" (UID: "0e090c50-e996-4eda-b8c0-46d7f7d7dde3") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 18 11:19:42.943349 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:42.939966    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/a80be958-508f-454a-b7ae-6db432c34ccf-etc-systemd\") pod \"tuned-kcmrw\" (UID: \"a80be958-508f-454a-b7ae-6db432c34ccf\") " pod="openshift-cluster-node-tuning-operator/tuned-kcmrw"
Jul 18 11:19:42.943349 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:42.940271    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/8c337674-d048-4107-ae53-0dfdbccf2176-iptables-alerter-script\") pod \"iptables-alerter-mj8nl\" (UID: \"8c337674-d048-4107-ae53-0dfdbccf2176\") " pod="openshift-network-operator/iptables-alerter-mj8nl"
Jul 18 11:19:42.943349 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:42.941843    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a80be958-508f-454a-b7ae-6db432c34ccf-tmp\") pod \"tuned-kcmrw\" (UID: \"a80be958-508f-454a-b7ae-6db432c34ccf\") " pod="openshift-cluster-node-tuning-operator/tuned-kcmrw"
Jul 18 11:19:42.943349 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:42.941896    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/a80be958-508f-454a-b7ae-6db432c34ccf-etc-tuned\") pod \"tuned-kcmrw\" (UID: \"a80be958-508f-454a-b7ae-6db432c34ccf\") " pod="openshift-cluster-node-tuning-operator/tuned-kcmrw"
Jul 18 11:19:42.943349 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:42.942083    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/40e8e19c-87b3-4cd6-81c1-0f404971a282-ovn-node-metrics-cert\") pod \"ovnkube-node-58jnn\" (UID: \"40e8e19c-87b3-4cd6-81c1-0f404971a282\") " pod="openshift-ovn-kubernetes/ovnkube-node-58jnn"
Jul 18 11:19:42.945775 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:42.945749    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t6f7x\" (UniqueName: \"kubernetes.io/projected/914d8131-27d9-481c-b7e2-484f467526dc-kube-api-access-t6f7x\") pod \"multus-rc6td\" (UID: \"914d8131-27d9-481c-b7e2-484f467526dc\") " pod="openshift-multus/multus-rc6td"
Jul 18 11:19:42.945867 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:42.945823    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6kxkb\" (UniqueName: \"kubernetes.io/projected/e24556f0-f108-4c9d-a3b1-5d0548925197-kube-api-access-6kxkb\") pod \"node-ca-bz5mq\" (UID: \"e24556f0-f108-4c9d-a3b1-5d0548925197\") " pod="openshift-image-registry/node-ca-bz5mq"
Jul 18 11:19:42.946196 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:42.946179    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fz4l9\" (UniqueName: \"kubernetes.io/projected/40e8e19c-87b3-4cd6-81c1-0f404971a282-kube-api-access-fz4l9\") pod \"ovnkube-node-58jnn\" (UID: \"40e8e19c-87b3-4cd6-81c1-0f404971a282\") " pod="openshift-ovn-kubernetes/ovnkube-node-58jnn"
Jul 18 11:19:42.946438 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:42.946422    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rcrx2\" (UniqueName: \"kubernetes.io/projected/0e090c50-e996-4eda-b8c0-46d7f7d7dde3-kube-api-access-rcrx2\") pod \"network-metrics-daemon-ljhk6\" (UID: \"0e090c50-e996-4eda-b8c0-46d7f7d7dde3\") " pod="openshift-multus/network-metrics-daemon-ljhk6"
Jul 18 11:19:42.950488 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:42.950458    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v2r7x\" (UniqueName: \"kubernetes.io/projected/49f40ae2-d33c-4284-a889-0d9b27421bf4-kube-api-access-v2r7x\") pod \"multus-additional-cni-plugins-lmf4l\" (UID: \"49f40ae2-d33c-4284-a889-0d9b27421bf4\") " pod="openshift-multus/multus-additional-cni-plugins-lmf4l"
Jul 18 11:19:42.951476 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:42.951448    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zpnqf\" (UniqueName: \"kubernetes.io/projected/a80be958-508f-454a-b7ae-6db432c34ccf-kube-api-access-zpnqf\") pod \"tuned-kcmrw\" (UID: \"a80be958-508f-454a-b7ae-6db432c34ccf\") " pod="openshift-cluster-node-tuning-operator/tuned-kcmrw"
Jul 18 11:19:42.951712 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:42.951694    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jn8r5\" (UniqueName: \"kubernetes.io/projected/8c337674-d048-4107-ae53-0dfdbccf2176-kube-api-access-jn8r5\") pod \"iptables-alerter-mj8nl\" (UID: \"8c337674-d048-4107-ae53-0dfdbccf2176\") " pod="openshift-network-operator/iptables-alerter-mj8nl"
Jul 18 11:19:42.987540 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:42.987508    2579 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 18 11:19:43.040334 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:43.040300    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/e0f67788-e972-49ff-b611-b9835f528d81-konnectivity-ca\") pod \"konnectivity-agent-hnt7j\" (UID: \"e0f67788-e972-49ff-b611-b9835f528d81\") " pod="kube-system/konnectivity-agent-hnt7j"
Jul 18 11:19:43.040334 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:43.040340    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/aa392a6c-12d5-4e00-beda-a16aed7a5e09-registration-dir\") pod \"aws-ebs-csi-driver-node-lvgzl\" (UID: \"aa392a6c-12d5-4e00-beda-a16aed7a5e09\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lvgzl"
Jul 18 11:19:43.040575 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:43.040361    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/899ed5f2-c702-4904-82e7-0ab5570dd7d3-hosts-file\") pod \"node-resolver-4522z\" (UID: \"899ed5f2-c702-4904-82e7-0ab5570dd7d3\") " pod="openshift-dns/node-resolver-4522z"
Jul 18 11:19:43.040575 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:43.040409    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/e0f67788-e972-49ff-b611-b9835f528d81-agent-certs\") pod \"konnectivity-agent-hnt7j\" (UID: \"e0f67788-e972-49ff-b611-b9835f528d81\") " pod="kube-system/konnectivity-agent-hnt7j"
Jul 18 11:19:43.040575 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:43.040428    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/aa392a6c-12d5-4e00-beda-a16aed7a5e09-socket-dir\") pod \"aws-ebs-csi-driver-node-lvgzl\" (UID: \"aa392a6c-12d5-4e00-beda-a16aed7a5e09\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lvgzl"
Jul 18 11:19:43.040575 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:43.040442    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/aa392a6c-12d5-4e00-beda-a16aed7a5e09-registration-dir\") pod \"aws-ebs-csi-driver-node-lvgzl\" (UID: \"aa392a6c-12d5-4e00-beda-a16aed7a5e09\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lvgzl"
Jul 18 11:19:43.040575 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:43.040447    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/899ed5f2-c702-4904-82e7-0ab5570dd7d3-tmp-dir\") pod \"node-resolver-4522z\" (UID: \"899ed5f2-c702-4904-82e7-0ab5570dd7d3\") " pod="openshift-dns/node-resolver-4522z"
Jul 18 11:19:43.040575 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:43.040504    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/aa392a6c-12d5-4e00-beda-a16aed7a5e09-kubelet-dir\") pod \"aws-ebs-csi-driver-node-lvgzl\" (UID: \"aa392a6c-12d5-4e00-beda-a16aed7a5e09\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lvgzl"
Jul 18 11:19:43.040899 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:43.040592    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/aa392a6c-12d5-4e00-beda-a16aed7a5e09-kubelet-dir\") pod \"aws-ebs-csi-driver-node-lvgzl\" (UID: \"aa392a6c-12d5-4e00-beda-a16aed7a5e09\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lvgzl"
Jul 18 11:19:43.040899 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:43.040549    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/899ed5f2-c702-4904-82e7-0ab5570dd7d3-hosts-file\") pod \"node-resolver-4522z\" (UID: \"899ed5f2-c702-4904-82e7-0ab5570dd7d3\") " pod="openshift-dns/node-resolver-4522z"
Jul 18 11:19:43.040899 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:43.040591    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d9kdd\" (UniqueName: \"kubernetes.io/projected/17f689f0-ceae-4eb8-acaa-922caaa8e3f8-kube-api-access-d9kdd\") pod \"network-check-target-cj4nh\" (UID: \"17f689f0-ceae-4eb8-acaa-922caaa8e3f8\") " pod="openshift-network-diagnostics/network-check-target-cj4nh"
Jul 18 11:19:43.040899 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:43.040659    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/aa392a6c-12d5-4e00-beda-a16aed7a5e09-socket-dir\") pod \"aws-ebs-csi-driver-node-lvgzl\" (UID: \"aa392a6c-12d5-4e00-beda-a16aed7a5e09\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lvgzl"
Jul 18 11:19:43.040899 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:43.040671    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/aa392a6c-12d5-4e00-beda-a16aed7a5e09-device-dir\") pod \"aws-ebs-csi-driver-node-lvgzl\" (UID: \"aa392a6c-12d5-4e00-beda-a16aed7a5e09\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lvgzl"
Jul 18 11:19:43.040899 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:43.040727    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/aa392a6c-12d5-4e00-beda-a16aed7a5e09-device-dir\") pod \"aws-ebs-csi-driver-node-lvgzl\" (UID: \"aa392a6c-12d5-4e00-beda-a16aed7a5e09\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lvgzl"
Jul 18 11:19:43.040899 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:43.040727    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/aa392a6c-12d5-4e00-beda-a16aed7a5e09-sys-fs\") pod \"aws-ebs-csi-driver-node-lvgzl\" (UID: \"aa392a6c-12d5-4e00-beda-a16aed7a5e09\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lvgzl"
Jul 18 11:19:43.040899 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:43.040769    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cmfnx\" (UniqueName: \"kubernetes.io/projected/aa392a6c-12d5-4e00-beda-a16aed7a5e09-kube-api-access-cmfnx\") pod \"aws-ebs-csi-driver-node-lvgzl\" (UID: \"aa392a6c-12d5-4e00-beda-a16aed7a5e09\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lvgzl"
Jul 18 11:19:43.040899 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:43.040795    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vhqln\" (UniqueName: \"kubernetes.io/projected/899ed5f2-c702-4904-82e7-0ab5570dd7d3-kube-api-access-vhqln\") pod \"node-resolver-4522z\" (UID: \"899ed5f2-c702-4904-82e7-0ab5570dd7d3\") " pod="openshift-dns/node-resolver-4522z"
Jul 18 11:19:43.040899 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:43.040817    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/899ed5f2-c702-4904-82e7-0ab5570dd7d3-tmp-dir\") pod \"node-resolver-4522z\" (UID: \"899ed5f2-c702-4904-82e7-0ab5570dd7d3\") " pod="openshift-dns/node-resolver-4522z"
Jul 18 11:19:43.040899 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:43.040841    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/aa392a6c-12d5-4e00-beda-a16aed7a5e09-sys-fs\") pod \"aws-ebs-csi-driver-node-lvgzl\" (UID: \"aa392a6c-12d5-4e00-beda-a16aed7a5e09\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lvgzl"
Jul 18 11:19:43.041295 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:43.040932    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/aa392a6c-12d5-4e00-beda-a16aed7a5e09-etc-selinux\") pod \"aws-ebs-csi-driver-node-lvgzl\" (UID: \"aa392a6c-12d5-4e00-beda-a16aed7a5e09\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lvgzl"
Jul 18 11:19:43.041295 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:43.040987    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/e0f67788-e972-49ff-b611-b9835f528d81-konnectivity-ca\") pod \"konnectivity-agent-hnt7j\" (UID: \"e0f67788-e972-49ff-b611-b9835f528d81\") " pod="kube-system/konnectivity-agent-hnt7j"
Jul 18 11:19:43.041295 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:43.041050    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/aa392a6c-12d5-4e00-beda-a16aed7a5e09-etc-selinux\") pod \"aws-ebs-csi-driver-node-lvgzl\" (UID: \"aa392a6c-12d5-4e00-beda-a16aed7a5e09\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lvgzl"
Jul 18 11:19:43.042999 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:43.042981    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/e0f67788-e972-49ff-b611-b9835f528d81-agent-certs\") pod \"konnectivity-agent-hnt7j\" (UID: \"e0f67788-e972-49ff-b611-b9835f528d81\") " pod="kube-system/konnectivity-agent-hnt7j"
Jul 18 11:19:43.046813 ip-10-0-133-122 kubenswrapper[2579]: E0718 11:19:43.046795    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 18 11:19:43.046870 ip-10-0-133-122 kubenswrapper[2579]: E0718 11:19:43.046817    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 18 11:19:43.046870 ip-10-0-133-122 kubenswrapper[2579]: E0718 11:19:43.046827    2579 projected.go:196] Error preparing data for projected volume kube-api-access-d9kdd for pod openshift-network-diagnostics/network-check-target-cj4nh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 18 11:19:43.046944 ip-10-0-133-122 kubenswrapper[2579]: E0718 11:19:43.046879    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/17f689f0-ceae-4eb8-acaa-922caaa8e3f8-kube-api-access-d9kdd podName:17f689f0-ceae-4eb8-acaa-922caaa8e3f8 nodeName:}" failed. No retries permitted until 2026-07-18 11:19:43.546866681 +0000 UTC m=+3.161902967 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-d9kdd" (UniqueName: "kubernetes.io/projected/17f689f0-ceae-4eb8-acaa-922caaa8e3f8-kube-api-access-d9kdd") pod "network-check-target-cj4nh" (UID: "17f689f0-ceae-4eb8-acaa-922caaa8e3f8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 18 11:19:43.050021 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:43.049984    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cmfnx\" (UniqueName: \"kubernetes.io/projected/aa392a6c-12d5-4e00-beda-a16aed7a5e09-kube-api-access-cmfnx\") pod \"aws-ebs-csi-driver-node-lvgzl\" (UID: \"aa392a6c-12d5-4e00-beda-a16aed7a5e09\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lvgzl"
Jul 18 11:19:43.050137 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:43.050035    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vhqln\" (UniqueName: \"kubernetes.io/projected/899ed5f2-c702-4904-82e7-0ab5570dd7d3-kube-api-access-vhqln\") pod \"node-resolver-4522z\" (UID: \"899ed5f2-c702-4904-82e7-0ab5570dd7d3\") " pod="openshift-dns/node-resolver-4522z"
Jul 18 11:19:43.132219 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:43.132188    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-rc6td"
Jul 18 11:19:43.139047 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:43.139024    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-kcmrw"
Jul 18 11:19:43.143193 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:43.143171    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod914d8131_27d9_481c_b7e2_484f467526dc.slice/crio-d74282eb4fc36c7d13df53c0962b7cf98f54f2271254ccfd49ad40349a091555 WatchSource:0}: Error finding container d74282eb4fc36c7d13df53c0962b7cf98f54f2271254ccfd49ad40349a091555: Status 404 returned error can't find the container with id d74282eb4fc36c7d13df53c0962b7cf98f54f2271254ccfd49ad40349a091555
Jul 18 11:19:43.147023 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:43.147000    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-bz5mq"
Jul 18 11:19:43.148688 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:43.148666    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda80be958_508f_454a_b7ae_6db432c34ccf.slice/crio-7296e8246f26a3c4097fc9a28e5307008bed83de3b4a99df3419597bec46c6d4 WatchSource:0}: Error finding container 7296e8246f26a3c4097fc9a28e5307008bed83de3b4a99df3419597bec46c6d4: Status 404 returned error can't find the container with id 7296e8246f26a3c4097fc9a28e5307008bed83de3b4a99df3419597bec46c6d4
Jul 18 11:19:43.150285 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:43.150263    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-lmf4l"
Jul 18 11:19:43.156684 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:43.156654    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-mj8nl"
Jul 18 11:19:43.158098 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:43.158070    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode24556f0_f108_4c9d_a3b1_5d0548925197.slice/crio-f1b83cbb5a688284ba70a53c1388640bc8712e2217dd74d4321251755465cae7 WatchSource:0}: Error finding container f1b83cbb5a688284ba70a53c1388640bc8712e2217dd74d4321251755465cae7: Status 404 returned error can't find the container with id f1b83cbb5a688284ba70a53c1388640bc8712e2217dd74d4321251755465cae7
Jul 18 11:19:43.160264 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:43.160220    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod49f40ae2_d33c_4284_a889_0d9b27421bf4.slice/crio-5fdc1874ed674b1cfd149204849e112df0a96fe57f7c1df6561d24260b3ec8cf WatchSource:0}: Error finding container 5fdc1874ed674b1cfd149204849e112df0a96fe57f7c1df6561d24260b3ec8cf: Status 404 returned error can't find the container with id 5fdc1874ed674b1cfd149204849e112df0a96fe57f7c1df6561d24260b3ec8cf
Jul 18 11:19:43.163672 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:43.163364    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-58jnn"
Jul 18 11:19:43.168479 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:43.168459    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-hnt7j"
Jul 18 11:19:43.170500 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:43.170474    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8c337674_d048_4107_ae53_0dfdbccf2176.slice/crio-81c740a2f9d5599b92eb125f4b59a423da7df60831bf7c7d961d925adaad2d04 WatchSource:0}: Error finding container 81c740a2f9d5599b92eb125f4b59a423da7df60831bf7c7d961d925adaad2d04: Status 404 returned error can't find the container with id 81c740a2f9d5599b92eb125f4b59a423da7df60831bf7c7d961d925adaad2d04
Jul 18 11:19:43.173525 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:43.173499    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod40e8e19c_87b3_4cd6_81c1_0f404971a282.slice/crio-dd03db3b38996388f3a1b67b776bc55f1826f8d363008a530eeb1b0d5fcefc5b WatchSource:0}: Error finding container dd03db3b38996388f3a1b67b776bc55f1826f8d363008a530eeb1b0d5fcefc5b: Status 404 returned error can't find the container with id dd03db3b38996388f3a1b67b776bc55f1826f8d363008a530eeb1b0d5fcefc5b
Jul 18 11:19:43.174221 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:43.174165    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lvgzl"
Jul 18 11:19:43.179203 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:43.179183    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode0f67788_e972_49ff_b611_b9835f528d81.slice/crio-2141ac36f5c7a729a01be1baf7631e28118bfcd5938cc25c383a63fdeef47c76 WatchSource:0}: Error finding container 2141ac36f5c7a729a01be1baf7631e28118bfcd5938cc25c383a63fdeef47c76: Status 404 returned error can't find the container with id 2141ac36f5c7a729a01be1baf7631e28118bfcd5938cc25c383a63fdeef47c76
Jul 18 11:19:43.179709 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:43.179690    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-4522z"
Jul 18 11:19:43.185266 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:43.185240    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaa392a6c_12d5_4e00_beda_a16aed7a5e09.slice/crio-8684c3490a517ab81d36a73b394acecb5381f874c4f1e94ec2bcf1d1035f9c0f WatchSource:0}: Error finding container 8684c3490a517ab81d36a73b394acecb5381f874c4f1e94ec2bcf1d1035f9c0f: Status 404 returned error can't find the container with id 8684c3490a517ab81d36a73b394acecb5381f874c4f1e94ec2bcf1d1035f9c0f
Jul 18 11:19:43.190406 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:19:43.190385    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod899ed5f2_c702_4904_82e7_0ab5570dd7d3.slice/crio-bf577ffeea7954328a218e504f022e0317d0847c10738cbedc6b847f9a4114cb WatchSource:0}: Error finding container bf577ffeea7954328a218e504f022e0317d0847c10738cbedc6b847f9a4114cb: Status 404 returned error can't find the container with id bf577ffeea7954328a218e504f022e0317d0847c10738cbedc6b847f9a4114cb
Jul 18 11:19:43.443059 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:43.442941    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b4c72690-9e6e-4826-8ff8-95eeea44b5d0-original-pull-secret\") pod \"global-pull-secret-syncer-6j4vg\" (UID: \"b4c72690-9e6e-4826-8ff8-95eeea44b5d0\") " pod="kube-system/global-pull-secret-syncer-6j4vg"
Jul 18 11:19:43.443059 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:43.443022    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0e090c50-e996-4eda-b8c0-46d7f7d7dde3-metrics-certs\") pod \"network-metrics-daemon-ljhk6\" (UID: \"0e090c50-e996-4eda-b8c0-46d7f7d7dde3\") " pod="openshift-multus/network-metrics-daemon-ljhk6"
Jul 18 11:19:43.443276 ip-10-0-133-122 kubenswrapper[2579]: E0718 11:19:43.443123    2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 18 11:19:43.443276 ip-10-0-133-122 kubenswrapper[2579]: E0718 11:19:43.443203    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b4c72690-9e6e-4826-8ff8-95eeea44b5d0-original-pull-secret podName:b4c72690-9e6e-4826-8ff8-95eeea44b5d0 nodeName:}" failed. No retries permitted until 2026-07-18 11:19:44.443181218 +0000 UTC m=+4.058217516 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b4c72690-9e6e-4826-8ff8-95eeea44b5d0-original-pull-secret") pod "global-pull-secret-syncer-6j4vg" (UID: "b4c72690-9e6e-4826-8ff8-95eeea44b5d0") : object "kube-system"/"original-pull-secret" not registered
Jul 18 11:19:43.443276 ip-10-0-133-122 kubenswrapper[2579]: E0718 11:19:43.443131    2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 18 11:19:43.443412 ip-10-0-133-122 kubenswrapper[2579]: E0718 11:19:43.443303    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0e090c50-e996-4eda-b8c0-46d7f7d7dde3-metrics-certs podName:0e090c50-e996-4eda-b8c0-46d7f7d7dde3 nodeName:}" failed. No retries permitted until 2026-07-18 11:19:44.44327916 +0000 UTC m=+4.058315451 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0e090c50-e996-4eda-b8c0-46d7f7d7dde3-metrics-certs") pod "network-metrics-daemon-ljhk6" (UID: "0e090c50-e996-4eda-b8c0-46d7f7d7dde3") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 18 11:19:43.645619 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:43.645577    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d9kdd\" (UniqueName: \"kubernetes.io/projected/17f689f0-ceae-4eb8-acaa-922caaa8e3f8-kube-api-access-d9kdd\") pod \"network-check-target-cj4nh\" (UID: \"17f689f0-ceae-4eb8-acaa-922caaa8e3f8\") " pod="openshift-network-diagnostics/network-check-target-cj4nh"
Jul 18 11:19:43.645826 ip-10-0-133-122 kubenswrapper[2579]: E0718 11:19:43.645804    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 18 11:19:43.645925 ip-10-0-133-122 kubenswrapper[2579]: E0718 11:19:43.645832    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 18 11:19:43.645925 ip-10-0-133-122 kubenswrapper[2579]: E0718 11:19:43.645845    2579 projected.go:196] Error preparing data for projected volume kube-api-access-d9kdd for pod openshift-network-diagnostics/network-check-target-cj4nh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 18 11:19:43.645925 ip-10-0-133-122 kubenswrapper[2579]: E0718 11:19:43.645908    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/17f689f0-ceae-4eb8-acaa-922caaa8e3f8-kube-api-access-d9kdd podName:17f689f0-ceae-4eb8-acaa-922caaa8e3f8 nodeName:}" failed. No retries permitted until 2026-07-18 11:19:44.645888795 +0000 UTC m=+4.260925081 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-d9kdd" (UniqueName: "kubernetes.io/projected/17f689f0-ceae-4eb8-acaa-922caaa8e3f8-kube-api-access-d9kdd") pod "network-check-target-cj4nh" (UID: "17f689f0-ceae-4eb8-acaa-922caaa8e3f8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 18 11:19:43.866102 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:43.866032    2579 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-17 11:14:43 +0000 UTC" deadline="2028-03-18 06:48:46.972130468 +0000 UTC"
Jul 18 11:19:43.866102 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:43.866101    2579 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14611h29m3.106033579s"
Jul 18 11:19:43.953230 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:43.953186    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lvgzl" event={"ID":"aa392a6c-12d5-4e00-beda-a16aed7a5e09","Type":"ContainerStarted","Data":"8684c3490a517ab81d36a73b394acecb5381f874c4f1e94ec2bcf1d1035f9c0f"}
Jul 18 11:19:43.959174 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:43.959094    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-hnt7j" event={"ID":"e0f67788-e972-49ff-b611-b9835f528d81","Type":"ContainerStarted","Data":"2141ac36f5c7a729a01be1baf7631e28118bfcd5938cc25c383a63fdeef47c76"}
Jul 18 11:19:43.975423 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:43.975387    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-58jnn" event={"ID":"40e8e19c-87b3-4cd6-81c1-0f404971a282","Type":"ContainerStarted","Data":"dd03db3b38996388f3a1b67b776bc55f1826f8d363008a530eeb1b0d5fcefc5b"}
Jul 18 11:19:43.977229 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:43.977199    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-mj8nl" event={"ID":"8c337674-d048-4107-ae53-0dfdbccf2176","Type":"ContainerStarted","Data":"81c740a2f9d5599b92eb125f4b59a423da7df60831bf7c7d961d925adaad2d04"}
Jul 18 11:19:43.979587 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:43.979560    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-kcmrw" event={"ID":"a80be958-508f-454a-b7ae-6db432c34ccf","Type":"ContainerStarted","Data":"7296e8246f26a3c4097fc9a28e5307008bed83de3b4a99df3419597bec46c6d4"}
Jul 18 11:19:43.986707 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:43.986682    2579 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 18 11:19:43.997222 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:43.997143    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-4522z" event={"ID":"899ed5f2-c702-4904-82e7-0ab5570dd7d3","Type":"ContainerStarted","Data":"bf577ffeea7954328a218e504f022e0317d0847c10738cbedc6b847f9a4114cb"}
Jul 18 11:19:44.006241 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:44.006152    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lmf4l" event={"ID":"49f40ae2-d33c-4284-a889-0d9b27421bf4","Type":"ContainerStarted","Data":"5fdc1874ed674b1cfd149204849e112df0a96fe57f7c1df6561d24260b3ec8cf"}
Jul 18 11:19:44.026366 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:44.026327    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-bz5mq" event={"ID":"e24556f0-f108-4c9d-a3b1-5d0548925197","Type":"ContainerStarted","Data":"f1b83cbb5a688284ba70a53c1388640bc8712e2217dd74d4321251755465cae7"}
Jul 18 11:19:44.039792 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:44.039686    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-rc6td" event={"ID":"914d8131-27d9-481c-b7e2-484f467526dc","Type":"ContainerStarted","Data":"d74282eb4fc36c7d13df53c0962b7cf98f54f2271254ccfd49ad40349a091555"}
Jul 18 11:19:44.454039 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:44.453999    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b4c72690-9e6e-4826-8ff8-95eeea44b5d0-original-pull-secret\") pod \"global-pull-secret-syncer-6j4vg\" (UID: \"b4c72690-9e6e-4826-8ff8-95eeea44b5d0\") " pod="kube-system/global-pull-secret-syncer-6j4vg"
Jul 18 11:19:44.454240 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:44.454056    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0e090c50-e996-4eda-b8c0-46d7f7d7dde3-metrics-certs\") pod \"network-metrics-daemon-ljhk6\" (UID: \"0e090c50-e996-4eda-b8c0-46d7f7d7dde3\") " pod="openshift-multus/network-metrics-daemon-ljhk6"
Jul 18 11:19:44.454240 ip-10-0-133-122 kubenswrapper[2579]: E0718 11:19:44.454195    2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 18 11:19:44.454383 ip-10-0-133-122 kubenswrapper[2579]: E0718 11:19:44.454259    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0e090c50-e996-4eda-b8c0-46d7f7d7dde3-metrics-certs podName:0e090c50-e996-4eda-b8c0-46d7f7d7dde3 nodeName:}" failed. No retries permitted until 2026-07-18 11:19:46.454238814 +0000 UTC m=+6.069275110 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0e090c50-e996-4eda-b8c0-46d7f7d7dde3-metrics-certs") pod "network-metrics-daemon-ljhk6" (UID: "0e090c50-e996-4eda-b8c0-46d7f7d7dde3") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 18 11:19:44.454700 ip-10-0-133-122 kubenswrapper[2579]: E0718 11:19:44.454682    2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 18 11:19:44.454760 ip-10-0-133-122 kubenswrapper[2579]: E0718 11:19:44.454737    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b4c72690-9e6e-4826-8ff8-95eeea44b5d0-original-pull-secret podName:b4c72690-9e6e-4826-8ff8-95eeea44b5d0 nodeName:}" failed. No retries permitted until 2026-07-18 11:19:46.454721801 +0000 UTC m=+6.069758088 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b4c72690-9e6e-4826-8ff8-95eeea44b5d0-original-pull-secret") pod "global-pull-secret-syncer-6j4vg" (UID: "b4c72690-9e6e-4826-8ff8-95eeea44b5d0") : object "kube-system"/"original-pull-secret" not registered
Jul 18 11:19:44.656350 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:44.656309    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d9kdd\" (UniqueName: \"kubernetes.io/projected/17f689f0-ceae-4eb8-acaa-922caaa8e3f8-kube-api-access-d9kdd\") pod \"network-check-target-cj4nh\" (UID: \"17f689f0-ceae-4eb8-acaa-922caaa8e3f8\") " pod="openshift-network-diagnostics/network-check-target-cj4nh"
Jul 18 11:19:44.656560 ip-10-0-133-122 kubenswrapper[2579]: E0718 11:19:44.656541    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 18 11:19:44.656645 ip-10-0-133-122 kubenswrapper[2579]: E0718 11:19:44.656570    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 18 11:19:44.656645 ip-10-0-133-122 kubenswrapper[2579]: E0718 11:19:44.656583    2579 projected.go:196] Error preparing data for projected volume kube-api-access-d9kdd for pod openshift-network-diagnostics/network-check-target-cj4nh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 18 11:19:44.656645 ip-10-0-133-122 kubenswrapper[2579]: E0718 11:19:44.656641    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/17f689f0-ceae-4eb8-acaa-922caaa8e3f8-kube-api-access-d9kdd podName:17f689f0-ceae-4eb8-acaa-922caaa8e3f8 nodeName:}" failed. No retries permitted until 2026-07-18 11:19:46.656622976 +0000 UTC m=+6.271659272 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-d9kdd" (UniqueName: "kubernetes.io/projected/17f689f0-ceae-4eb8-acaa-922caaa8e3f8-kube-api-access-d9kdd") pod "network-check-target-cj4nh" (UID: "17f689f0-ceae-4eb8-acaa-922caaa8e3f8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 18 11:19:44.866926 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:44.866290    2579 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-17 11:14:43 +0000 UTC" deadline="2028-04-16 02:51:09.348928978 +0000 UTC"
Jul 18 11:19:44.866926 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:44.866326    2579 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15303h31m24.482608543s"
Jul 18 11:19:44.891016 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:44.890988    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ljhk6"
Jul 18 11:19:44.891180 ip-10-0-133-122 kubenswrapper[2579]: E0718 11:19:44.891118    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ljhk6" podUID="0e090c50-e996-4eda-b8c0-46d7f7d7dde3"
Jul 18 11:19:44.891530 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:44.891508    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6j4vg"
Jul 18 11:19:44.891639 ip-10-0-133-122 kubenswrapper[2579]: E0718 11:19:44.891618    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6j4vg" podUID="b4c72690-9e6e-4826-8ff8-95eeea44b5d0"
Jul 18 11:19:44.891707 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:44.891694    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cj4nh"
Jul 18 11:19:44.891787 ip-10-0-133-122 kubenswrapper[2579]: E0718 11:19:44.891768    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cj4nh" podUID="17f689f0-ceae-4eb8-acaa-922caaa8e3f8"
Jul 18 11:19:46.472825 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:46.472787    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b4c72690-9e6e-4826-8ff8-95eeea44b5d0-original-pull-secret\") pod \"global-pull-secret-syncer-6j4vg\" (UID: \"b4c72690-9e6e-4826-8ff8-95eeea44b5d0\") " pod="kube-system/global-pull-secret-syncer-6j4vg"
Jul 18 11:19:46.473424 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:46.472850    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0e090c50-e996-4eda-b8c0-46d7f7d7dde3-metrics-certs\") pod \"network-metrics-daemon-ljhk6\" (UID: \"0e090c50-e996-4eda-b8c0-46d7f7d7dde3\") " pod="openshift-multus/network-metrics-daemon-ljhk6"
Jul 18 11:19:46.473424 ip-10-0-133-122 kubenswrapper[2579]: E0718 11:19:46.473033    2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 18 11:19:46.473424 ip-10-0-133-122 kubenswrapper[2579]: E0718 11:19:46.473093    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0e090c50-e996-4eda-b8c0-46d7f7d7dde3-metrics-certs podName:0e090c50-e996-4eda-b8c0-46d7f7d7dde3 nodeName:}" failed. No retries permitted until 2026-07-18 11:19:50.473075307 +0000 UTC m=+10.088111595 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0e090c50-e996-4eda-b8c0-46d7f7d7dde3-metrics-certs") pod "network-metrics-daemon-ljhk6" (UID: "0e090c50-e996-4eda-b8c0-46d7f7d7dde3") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 18 11:19:46.473424 ip-10-0-133-122 kubenswrapper[2579]: E0718 11:19:46.473250    2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 18 11:19:46.473424 ip-10-0-133-122 kubenswrapper[2579]: E0718 11:19:46.473296    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b4c72690-9e6e-4826-8ff8-95eeea44b5d0-original-pull-secret podName:b4c72690-9e6e-4826-8ff8-95eeea44b5d0 nodeName:}" failed. No retries permitted until 2026-07-18 11:19:50.473282204 +0000 UTC m=+10.088318492 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b4c72690-9e6e-4826-8ff8-95eeea44b5d0-original-pull-secret") pod "global-pull-secret-syncer-6j4vg" (UID: "b4c72690-9e6e-4826-8ff8-95eeea44b5d0") : object "kube-system"/"original-pull-secret" not registered
Jul 18 11:19:46.675450 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:46.675416    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d9kdd\" (UniqueName: \"kubernetes.io/projected/17f689f0-ceae-4eb8-acaa-922caaa8e3f8-kube-api-access-d9kdd\") pod \"network-check-target-cj4nh\" (UID: \"17f689f0-ceae-4eb8-acaa-922caaa8e3f8\") " pod="openshift-network-diagnostics/network-check-target-cj4nh"
Jul 18 11:19:46.675641 ip-10-0-133-122 kubenswrapper[2579]: E0718 11:19:46.675578    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 18 11:19:46.675641 ip-10-0-133-122 kubenswrapper[2579]: E0718 11:19:46.675597    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 18 11:19:46.675641 ip-10-0-133-122 kubenswrapper[2579]: E0718 11:19:46.675610    2579 projected.go:196] Error preparing data for projected volume kube-api-access-d9kdd for pod openshift-network-diagnostics/network-check-target-cj4nh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 18 11:19:46.675800 ip-10-0-133-122 kubenswrapper[2579]: E0718 11:19:46.675668    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/17f689f0-ceae-4eb8-acaa-922caaa8e3f8-kube-api-access-d9kdd podName:17f689f0-ceae-4eb8-acaa-922caaa8e3f8 nodeName:}" failed. No retries permitted until 2026-07-18 11:19:50.675647877 +0000 UTC m=+10.290684163 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-d9kdd" (UniqueName: "kubernetes.io/projected/17f689f0-ceae-4eb8-acaa-922caaa8e3f8-kube-api-access-d9kdd") pod "network-check-target-cj4nh" (UID: "17f689f0-ceae-4eb8-acaa-922caaa8e3f8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 18 11:19:46.888688 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:46.888657    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ljhk6"
Jul 18 11:19:46.888882 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:46.888656    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cj4nh"
Jul 18 11:19:46.888882 ip-10-0-133-122 kubenswrapper[2579]: E0718 11:19:46.888804    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ljhk6" podUID="0e090c50-e996-4eda-b8c0-46d7f7d7dde3"
Jul 18 11:19:46.889021 ip-10-0-133-122 kubenswrapper[2579]: E0718 11:19:46.888944    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cj4nh" podUID="17f689f0-ceae-4eb8-acaa-922caaa8e3f8"
Jul 18 11:19:46.889021 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:46.888659    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6j4vg"
Jul 18 11:19:46.889097 ip-10-0-133-122 kubenswrapper[2579]: E0718 11:19:46.889029    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6j4vg" podUID="b4c72690-9e6e-4826-8ff8-95eeea44b5d0"
Jul 18 11:19:48.888192 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:48.888157    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cj4nh"
Jul 18 11:19:48.888592 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:48.888169    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ljhk6"
Jul 18 11:19:48.888592 ip-10-0-133-122 kubenswrapper[2579]: E0718 11:19:48.888289    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cj4nh" podUID="17f689f0-ceae-4eb8-acaa-922caaa8e3f8"
Jul 18 11:19:48.888592 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:48.888170    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6j4vg"
Jul 18 11:19:48.888592 ip-10-0-133-122 kubenswrapper[2579]: E0718 11:19:48.888382    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ljhk6" podUID="0e090c50-e996-4eda-b8c0-46d7f7d7dde3"
Jul 18 11:19:48.888592 ip-10-0-133-122 kubenswrapper[2579]: E0718 11:19:48.888448    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6j4vg" podUID="b4c72690-9e6e-4826-8ff8-95eeea44b5d0"
Jul 18 11:19:50.508953 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:50.508914    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0e090c50-e996-4eda-b8c0-46d7f7d7dde3-metrics-certs\") pod \"network-metrics-daemon-ljhk6\" (UID: \"0e090c50-e996-4eda-b8c0-46d7f7d7dde3\") " pod="openshift-multus/network-metrics-daemon-ljhk6"
Jul 18 11:19:50.509424 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:50.509027    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b4c72690-9e6e-4826-8ff8-95eeea44b5d0-original-pull-secret\") pod \"global-pull-secret-syncer-6j4vg\" (UID: \"b4c72690-9e6e-4826-8ff8-95eeea44b5d0\") " pod="kube-system/global-pull-secret-syncer-6j4vg"
Jul 18 11:19:50.509424 ip-10-0-133-122 kubenswrapper[2579]: E0718 11:19:50.509155    2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 18 11:19:50.509424 ip-10-0-133-122 kubenswrapper[2579]: E0718 11:19:50.509217    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b4c72690-9e6e-4826-8ff8-95eeea44b5d0-original-pull-secret podName:b4c72690-9e6e-4826-8ff8-95eeea44b5d0 nodeName:}" failed. No retries permitted until 2026-07-18 11:19:58.509196213 +0000 UTC m=+18.124232518 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b4c72690-9e6e-4826-8ff8-95eeea44b5d0-original-pull-secret") pod "global-pull-secret-syncer-6j4vg" (UID: "b4c72690-9e6e-4826-8ff8-95eeea44b5d0") : object "kube-system"/"original-pull-secret" not registered
Jul 18 11:19:50.509424 ip-10-0-133-122 kubenswrapper[2579]: E0718 11:19:50.509281    2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 18 11:19:50.509424 ip-10-0-133-122 kubenswrapper[2579]: E0718 11:19:50.509313    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0e090c50-e996-4eda-b8c0-46d7f7d7dde3-metrics-certs podName:0e090c50-e996-4eda-b8c0-46d7f7d7dde3 nodeName:}" failed. No retries permitted until 2026-07-18 11:19:58.509301303 +0000 UTC m=+18.124337598 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0e090c50-e996-4eda-b8c0-46d7f7d7dde3-metrics-certs") pod "network-metrics-daemon-ljhk6" (UID: "0e090c50-e996-4eda-b8c0-46d7f7d7dde3") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 18 11:19:50.710732 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:50.710255    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d9kdd\" (UniqueName: \"kubernetes.io/projected/17f689f0-ceae-4eb8-acaa-922caaa8e3f8-kube-api-access-d9kdd\") pod \"network-check-target-cj4nh\" (UID: \"17f689f0-ceae-4eb8-acaa-922caaa8e3f8\") " pod="openshift-network-diagnostics/network-check-target-cj4nh"
Jul 18 11:19:50.710732 ip-10-0-133-122 kubenswrapper[2579]: E0718 11:19:50.710452    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 18 11:19:50.710732 ip-10-0-133-122 kubenswrapper[2579]: E0718 11:19:50.710473    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 18 11:19:50.710732 ip-10-0-133-122 kubenswrapper[2579]: E0718 11:19:50.710486    2579 projected.go:196] Error preparing data for projected volume kube-api-access-d9kdd for pod openshift-network-diagnostics/network-check-target-cj4nh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 18 11:19:50.710732 ip-10-0-133-122 kubenswrapper[2579]: E0718 11:19:50.710546    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/17f689f0-ceae-4eb8-acaa-922caaa8e3f8-kube-api-access-d9kdd podName:17f689f0-ceae-4eb8-acaa-922caaa8e3f8 nodeName:}" failed. No retries permitted until 2026-07-18 11:19:58.710528769 +0000 UTC m=+18.325565083 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-d9kdd" (UniqueName: "kubernetes.io/projected/17f689f0-ceae-4eb8-acaa-922caaa8e3f8-kube-api-access-d9kdd") pod "network-check-target-cj4nh" (UID: "17f689f0-ceae-4eb8-acaa-922caaa8e3f8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 18 11:19:50.889496 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:50.889135    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cj4nh"
Jul 18 11:19:50.889496 ip-10-0-133-122 kubenswrapper[2579]: E0718 11:19:50.889264    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cj4nh" podUID="17f689f0-ceae-4eb8-acaa-922caaa8e3f8"
Jul 18 11:19:50.889496 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:50.889347    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6j4vg"
Jul 18 11:19:50.889496 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:50.889395    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ljhk6"
Jul 18 11:19:50.889496 ip-10-0-133-122 kubenswrapper[2579]: E0718 11:19:50.889485    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ljhk6" podUID="0e090c50-e996-4eda-b8c0-46d7f7d7dde3"
Jul 18 11:19:50.889903 ip-10-0-133-122 kubenswrapper[2579]: E0718 11:19:50.889555    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6j4vg" podUID="b4c72690-9e6e-4826-8ff8-95eeea44b5d0"
Jul 18 11:19:52.889438 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:52.888951    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6j4vg"
Jul 18 11:19:52.889438 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:52.888950    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cj4nh"
Jul 18 11:19:52.889438 ip-10-0-133-122 kubenswrapper[2579]: E0718 11:19:52.889097    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6j4vg" podUID="b4c72690-9e6e-4826-8ff8-95eeea44b5d0"
Jul 18 11:19:52.889438 ip-10-0-133-122 kubenswrapper[2579]: E0718 11:19:52.889194    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cj4nh" podUID="17f689f0-ceae-4eb8-acaa-922caaa8e3f8"
Jul 18 11:19:52.889438 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:52.889226    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ljhk6"
Jul 18 11:19:52.889438 ip-10-0-133-122 kubenswrapper[2579]: E0718 11:19:52.889304    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ljhk6" podUID="0e090c50-e996-4eda-b8c0-46d7f7d7dde3"
Jul 18 11:19:54.888984 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:54.888944    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6j4vg"
Jul 18 11:19:54.888984 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:54.888976    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ljhk6"
Jul 18 11:19:54.889464 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:54.888944    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cj4nh"
Jul 18 11:19:54.889464 ip-10-0-133-122 kubenswrapper[2579]: E0718 11:19:54.889070    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6j4vg" podUID="b4c72690-9e6e-4826-8ff8-95eeea44b5d0"
Jul 18 11:19:54.889464 ip-10-0-133-122 kubenswrapper[2579]: E0718 11:19:54.889147    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cj4nh" podUID="17f689f0-ceae-4eb8-acaa-922caaa8e3f8"
Jul 18 11:19:54.889464 ip-10-0-133-122 kubenswrapper[2579]: E0718 11:19:54.889242    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ljhk6" podUID="0e090c50-e996-4eda-b8c0-46d7f7d7dde3"
Jul 18 11:19:56.888992 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:56.888954    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cj4nh"
Jul 18 11:19:56.889432 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:56.888957    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6j4vg"
Jul 18 11:19:56.889432 ip-10-0-133-122 kubenswrapper[2579]: E0718 11:19:56.889083    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cj4nh" podUID="17f689f0-ceae-4eb8-acaa-922caaa8e3f8"
Jul 18 11:19:56.889432 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:56.888957    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ljhk6"
Jul 18 11:19:56.889432 ip-10-0-133-122 kubenswrapper[2579]: E0718 11:19:56.889145    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6j4vg" podUID="b4c72690-9e6e-4826-8ff8-95eeea44b5d0"
Jul 18 11:19:56.889432 ip-10-0-133-122 kubenswrapper[2579]: E0718 11:19:56.889246    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ljhk6" podUID="0e090c50-e996-4eda-b8c0-46d7f7d7dde3"
Jul 18 11:19:58.564249 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:58.564155    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b4c72690-9e6e-4826-8ff8-95eeea44b5d0-original-pull-secret\") pod \"global-pull-secret-syncer-6j4vg\" (UID: \"b4c72690-9e6e-4826-8ff8-95eeea44b5d0\") " pod="kube-system/global-pull-secret-syncer-6j4vg"
Jul 18 11:19:58.564249 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:58.564216    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0e090c50-e996-4eda-b8c0-46d7f7d7dde3-metrics-certs\") pod \"network-metrics-daemon-ljhk6\" (UID: \"0e090c50-e996-4eda-b8c0-46d7f7d7dde3\") " pod="openshift-multus/network-metrics-daemon-ljhk6"
Jul 18 11:19:58.564672 ip-10-0-133-122 kubenswrapper[2579]: E0718 11:19:58.564338    2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 18 11:19:58.564672 ip-10-0-133-122 kubenswrapper[2579]: E0718 11:19:58.564355    2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 18 11:19:58.564672 ip-10-0-133-122 kubenswrapper[2579]: E0718 11:19:58.564421    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0e090c50-e996-4eda-b8c0-46d7f7d7dde3-metrics-certs podName:0e090c50-e996-4eda-b8c0-46d7f7d7dde3 nodeName:}" failed. No retries permitted until 2026-07-18 11:20:14.564400155 +0000 UTC m=+34.179436434 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0e090c50-e996-4eda-b8c0-46d7f7d7dde3-metrics-certs") pod "network-metrics-daemon-ljhk6" (UID: "0e090c50-e996-4eda-b8c0-46d7f7d7dde3") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 18 11:19:58.564672 ip-10-0-133-122 kubenswrapper[2579]: E0718 11:19:58.564444    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b4c72690-9e6e-4826-8ff8-95eeea44b5d0-original-pull-secret podName:b4c72690-9e6e-4826-8ff8-95eeea44b5d0 nodeName:}" failed. No retries permitted until 2026-07-18 11:20:14.564428752 +0000 UTC m=+34.179465033 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b4c72690-9e6e-4826-8ff8-95eeea44b5d0-original-pull-secret") pod "global-pull-secret-syncer-6j4vg" (UID: "b4c72690-9e6e-4826-8ff8-95eeea44b5d0") : object "kube-system"/"original-pull-secret" not registered
Jul 18 11:19:58.765902 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:58.765862    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d9kdd\" (UniqueName: \"kubernetes.io/projected/17f689f0-ceae-4eb8-acaa-922caaa8e3f8-kube-api-access-d9kdd\") pod \"network-check-target-cj4nh\" (UID: \"17f689f0-ceae-4eb8-acaa-922caaa8e3f8\") " pod="openshift-network-diagnostics/network-check-target-cj4nh"
Jul 18 11:19:58.766098 ip-10-0-133-122 kubenswrapper[2579]: E0718 11:19:58.766052    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 18 11:19:58.766098 ip-10-0-133-122 kubenswrapper[2579]: E0718 11:19:58.766086    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 18 11:19:58.766098 ip-10-0-133-122 kubenswrapper[2579]: E0718 11:19:58.766100    2579 projected.go:196] Error preparing data for projected volume kube-api-access-d9kdd for pod openshift-network-diagnostics/network-check-target-cj4nh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 18 11:19:58.766252 ip-10-0-133-122 kubenswrapper[2579]: E0718 11:19:58.766168    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/17f689f0-ceae-4eb8-acaa-922caaa8e3f8-kube-api-access-d9kdd podName:17f689f0-ceae-4eb8-acaa-922caaa8e3f8 nodeName:}" failed. No retries permitted until 2026-07-18 11:20:14.766153158 +0000 UTC m=+34.381189441 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-d9kdd" (UniqueName: "kubernetes.io/projected/17f689f0-ceae-4eb8-acaa-922caaa8e3f8-kube-api-access-d9kdd") pod "network-check-target-cj4nh" (UID: "17f689f0-ceae-4eb8-acaa-922caaa8e3f8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 18 11:19:58.888442 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:58.888405    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ljhk6"
Jul 18 11:19:58.888442 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:58.888427    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cj4nh"
Jul 18 11:19:58.888680 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:19:58.888405    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6j4vg"
Jul 18 11:19:58.888680 ip-10-0-133-122 kubenswrapper[2579]: E0718 11:19:58.888581    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ljhk6" podUID="0e090c50-e996-4eda-b8c0-46d7f7d7dde3"
Jul 18 11:19:58.888680 ip-10-0-133-122 kubenswrapper[2579]: E0718 11:19:58.888628    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cj4nh" podUID="17f689f0-ceae-4eb8-acaa-922caaa8e3f8"
Jul 18 11:19:58.888835 ip-10-0-133-122 kubenswrapper[2579]: E0718 11:19:58.888732    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6j4vg" podUID="b4c72690-9e6e-4826-8ff8-95eeea44b5d0"
Jul 18 11:20:00.889538 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:00.889499    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cj4nh"
Jul 18 11:20:00.890022 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:00.889550    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ljhk6"
Jul 18 11:20:00.890022 ip-10-0-133-122 kubenswrapper[2579]: E0718 11:20:00.889621    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cj4nh" podUID="17f689f0-ceae-4eb8-acaa-922caaa8e3f8"
Jul 18 11:20:00.890022 ip-10-0-133-122 kubenswrapper[2579]: E0718 11:20:00.889686    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ljhk6" podUID="0e090c50-e996-4eda-b8c0-46d7f7d7dde3"
Jul 18 11:20:00.890022 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:00.889750    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6j4vg"
Jul 18 11:20:00.890022 ip-10-0-133-122 kubenswrapper[2579]: E0718 11:20:00.889815    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6j4vg" podUID="b4c72690-9e6e-4826-8ff8-95eeea44b5d0"
Jul 18 11:20:02.888715 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:02.888674    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cj4nh"
Jul 18 11:20:02.889090 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:02.888679    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ljhk6"
Jul 18 11:20:02.889090 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:02.888792    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6j4vg"
Jul 18 11:20:02.889090 ip-10-0-133-122 kubenswrapper[2579]: E0718 11:20:02.888791    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cj4nh" podUID="17f689f0-ceae-4eb8-acaa-922caaa8e3f8"
Jul 18 11:20:02.889090 ip-10-0-133-122 kubenswrapper[2579]: E0718 11:20:02.888938    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ljhk6" podUID="0e090c50-e996-4eda-b8c0-46d7f7d7dde3"
Jul 18 11:20:02.889090 ip-10-0-133-122 kubenswrapper[2579]: E0718 11:20:02.888978    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6j4vg" podUID="b4c72690-9e6e-4826-8ff8-95eeea44b5d0"
Jul 18 11:20:03.083488 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:03.083459    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-122.ec2.internal" event={"ID":"2a172972fbb39a4c6031f848e0d266ff","Type":"ContainerStarted","Data":"4ab2aebfe2f1893bb0f5c4cad28b1f2c5dd3cc1e068015866bcf751970a6b660"}
Jul 18 11:20:03.097838 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:03.097785    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-122.ec2.internal" podStartSLOduration=21.097764148 podStartE2EDuration="21.097764148s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-18 11:19:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 11:20:03.097679861 +0000 UTC m=+22.712716164" watchObservedRunningTime="2026-07-18 11:20:03.097764148 +0000 UTC m=+22.712800453"
Jul 18 11:20:04.088085 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:04.087607    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-kcmrw" event={"ID":"a80be958-508f-454a-b7ae-6db432c34ccf","Type":"ContainerStarted","Data":"6fa528e77ae312f83c50397a0b9155654c02695cfb3c088a9bd93fce33b99003"}
Jul 18 11:20:04.092772 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:04.092740    2579 generic.go:356] "Generic (PLEG): container finished" podID="b7129788cc0ed725bc5853009237d25d" containerID="e4060410d0c0215bff09bb4517ccfe328f0537d3cfe49d6424f74c546ceb4d54" exitCode=0
Jul 18 11:20:04.092932 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:04.092830    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-122.ec2.internal" event={"ID":"b7129788cc0ed725bc5853009237d25d","Type":"ContainerDied","Data":"e4060410d0c0215bff09bb4517ccfe328f0537d3cfe49d6424f74c546ceb4d54"}
Jul 18 11:20:04.094647 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:04.094619    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-4522z" event={"ID":"899ed5f2-c702-4904-82e7-0ab5570dd7d3","Type":"ContainerStarted","Data":"8820b37f734112c0e4e6048c5b93d72159328157c505addaaa80b96cc2f95a50"}
Jul 18 11:20:04.096493 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:04.096472    2579 generic.go:356] "Generic (PLEG): container finished" podID="49f40ae2-d33c-4284-a889-0d9b27421bf4" containerID="4175982b6a26c556eca08ceab6eec26cf85708276fd5ba1b7d8dc3770d27b3b5" exitCode=0
Jul 18 11:20:04.096608 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:04.096561    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lmf4l" event={"ID":"49f40ae2-d33c-4284-a889-0d9b27421bf4","Type":"ContainerDied","Data":"4175982b6a26c556eca08ceab6eec26cf85708276fd5ba1b7d8dc3770d27b3b5"}
Jul 18 11:20:04.098522 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:04.098211    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-bz5mq" event={"ID":"e24556f0-f108-4c9d-a3b1-5d0548925197","Type":"ContainerStarted","Data":"eeb08fc7886070f2cfc71f07253ade1ec6f83833c6d3aee6ade31aaf7c304303"}
Jul 18 11:20:04.100091 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:04.100065    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-rc6td" event={"ID":"914d8131-27d9-481c-b7e2-484f467526dc","Type":"ContainerStarted","Data":"3448b9b09c924bfcff4e8f5a8c4d11b3ff10184c2ee6f4e661528eaa5c79051d"}
Jul 18 11:20:04.101724 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:04.101701    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lvgzl" event={"ID":"aa392a6c-12d5-4e00-beda-a16aed7a5e09","Type":"ContainerStarted","Data":"7a1ee947040e358ec32b7ab0ea7a9cfc25b656221190165cd76489628edcc086"}
Jul 18 11:20:04.103033 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:04.103009    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-hnt7j" event={"ID":"e0f67788-e972-49ff-b611-b9835f528d81","Type":"ContainerStarted","Data":"2c09624a3607f540bfe2867c41cdcc60b02c3dbca692af83b643f486af300141"}
Jul 18 11:20:04.105907 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:04.105875    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-58jnn_40e8e19c-87b3-4cd6-81c1-0f404971a282/ovn-acl-logging/0.log"
Jul 18 11:20:04.106234 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:04.106215    2579 generic.go:356] "Generic (PLEG): container finished" podID="40e8e19c-87b3-4cd6-81c1-0f404971a282" containerID="1f66703f9054518e5ca813e30e7d4bb9b0b7241cb7f73f442e051c8094456039" exitCode=1
Jul 18 11:20:04.106311 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:04.106288    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-58jnn" event={"ID":"40e8e19c-87b3-4cd6-81c1-0f404971a282","Type":"ContainerStarted","Data":"e2f57db42efedd10ddff4e07a299f0f359e9844ef225d4bfdae59a5159e9ab99"}
Jul 18 11:20:04.106374 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:04.106361    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-58jnn" event={"ID":"40e8e19c-87b3-4cd6-81c1-0f404971a282","Type":"ContainerStarted","Data":"ba55cef39d8759d87a98cc12ee2c5eaf28c077a9b601e64a56a95fbefc77763f"}
Jul 18 11:20:04.106429 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:04.106414    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-58jnn" event={"ID":"40e8e19c-87b3-4cd6-81c1-0f404971a282","Type":"ContainerStarted","Data":"7f70c5a3e4104cbf8012ec21b0c7cc0da9f53165520ac9c36f61da156af8a11c"}
Jul 18 11:20:04.106482 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:04.106462    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-58jnn" event={"ID":"40e8e19c-87b3-4cd6-81c1-0f404971a282","Type":"ContainerStarted","Data":"7e5a423aa1774b328c470228f7fdf997f21a08703ef08e6152fa403ca13722bf"}
Jul 18 11:20:04.106537 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:04.106511    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-58jnn" event={"ID":"40e8e19c-87b3-4cd6-81c1-0f404971a282","Type":"ContainerDied","Data":"1f66703f9054518e5ca813e30e7d4bb9b0b7241cb7f73f442e051c8094456039"}
Jul 18 11:20:04.106588 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:04.106562    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-58jnn" event={"ID":"40e8e19c-87b3-4cd6-81c1-0f404971a282","Type":"ContainerStarted","Data":"21f7217b9059228a949c5a19671485c39274771b5cdc7f8aa82efb0cecedd3fb"}
Jul 18 11:20:04.107625 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:04.107582    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-kcmrw" podStartSLOduration=3.512070236 podStartE2EDuration="23.107565778s" totalImagesPullingTime="19.595495542s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-18 11:19:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 11:20:04.106928511 +0000 UTC m=+23.721964813" watchObservedRunningTime="2026-07-18 11:20:04.107565778 +0000 UTC m=+23.722602081"
Jul 18 11:20:04.108710 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:04.108669    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-mj8nl" event={"ID":"8c337674-d048-4107-ae53-0dfdbccf2176","Type":"ContainerStarted","Data":"79ad5de14e3a4b8d66daac2d271ce39bf8e42b18f6cfcb9d1d698764bccea373"}
Jul 18 11:20:04.124304 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:04.124253    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-rc6td" podStartSLOduration=3.500153387 podStartE2EDuration="23.124238108s" totalImagesPullingTime="19.624084721s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-18 11:19:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 11:20:04.12326576 +0000 UTC m=+23.738302064" watchObservedRunningTime="2026-07-18 11:20:04.124238108 +0000 UTC m=+23.739274411"
Jul 18 11:20:04.164624 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:04.164570    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-bz5mq" podStartSLOduration=3.589096444 podStartE2EDuration="23.164553868s" totalImagesPullingTime="19.575457424s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-18 11:19:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 11:20:04.146062719 +0000 UTC m=+23.761099020" watchObservedRunningTime="2026-07-18 11:20:04.164553868 +0000 UTC m=+23.779590183"
Jul 18 11:20:04.202265 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:04.202226    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-4522z" podStartSLOduration=3.682333452 podStartE2EDuration="23.202210837s" totalImagesPullingTime="19.519877385s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-18 11:19:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 11:20:04.201958099 +0000 UTC m=+23.816994400" watchObservedRunningTime="2026-07-18 11:20:04.202210837 +0000 UTC m=+23.817247137"
Jul 18 11:20:04.220576 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:04.220526    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-hnt7j" podStartSLOduration=12.049554142 podStartE2EDuration="23.220503588s" totalImagesPullingTime="11.170949446s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 11:19:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 11:20:04.220337729 +0000 UTC m=+23.835374031" watchObservedRunningTime="2026-07-18 11:20:04.220503588 +0000 UTC m=+23.835539891"
Jul 18 11:20:04.239207 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:04.239146    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-mj8nl" podStartSLOduration=3.6996731880000002 podStartE2EDuration="23.239122714s" totalImagesPullingTime="19.539449526s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-18 11:19:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 11:20:04.23904447 +0000 UTC m=+23.854080771" watchObservedRunningTime="2026-07-18 11:20:04.239122714 +0000 UTC m=+23.854159021"
Jul 18 11:20:04.859993 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:04.859966    2579 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 18 11:20:04.892221 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:04.892195    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6j4vg"
Jul 18 11:20:04.892374 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:04.892237    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cj4nh"
Jul 18 11:20:04.892374 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:04.892303    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ljhk6"
Jul 18 11:20:04.892374 ip-10-0-133-122 kubenswrapper[2579]: E0718 11:20:04.892322    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6j4vg" podUID="b4c72690-9e6e-4826-8ff8-95eeea44b5d0"
Jul 18 11:20:04.892502 ip-10-0-133-122 kubenswrapper[2579]: E0718 11:20:04.892401    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ljhk6" podUID="0e090c50-e996-4eda-b8c0-46d7f7d7dde3"
Jul 18 11:20:04.892502 ip-10-0-133-122 kubenswrapper[2579]: E0718 11:20:04.892486    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cj4nh" podUID="17f689f0-ceae-4eb8-acaa-922caaa8e3f8"
Jul 18 11:20:04.901330 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:04.901265    2579 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-18T11:20:04.859986726Z","UUID":"ed662d57-5092-4942-87cc-af70fe995a94","Handler":null,"Name":"","Endpoint":""}
Jul 18 11:20:04.902565 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:04.902548    2579 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 18 11:20:04.902677 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:04.902581    2579 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 18 11:20:05.113261 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:05.113222    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lvgzl" event={"ID":"aa392a6c-12d5-4e00-beda-a16aed7a5e09","Type":"ContainerStarted","Data":"0d5d8f8f3d48182c16f4c325fa1e683abcdb96c31d428a524965587b69c68825"}
Jul 18 11:20:05.115266 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:05.115211    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-122.ec2.internal" event={"ID":"b7129788cc0ed725bc5853009237d25d","Type":"ContainerStarted","Data":"4c142ec789b7b82d4a86fb0cfc08076525360db3e51032dd31d4784a94d1d4aa"}
Jul 18 11:20:05.130051 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:05.129999    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-122.ec2.internal" podStartSLOduration=23.129980923 podStartE2EDuration="23.129980923s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-18 11:19:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 11:20:05.12995399 +0000 UTC m=+24.744990295" watchObservedRunningTime="2026-07-18 11:20:05.129980923 +0000 UTC m=+24.745017224"
Jul 18 11:20:06.338143 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:06.338072    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-hnt7j"
Jul 18 11:20:06.338821 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:06.338755    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-hnt7j"
Jul 18 11:20:06.888313 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:06.888089    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cj4nh"
Jul 18 11:20:06.888596 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:06.888111    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ljhk6"
Jul 18 11:20:06.888596 ip-10-0-133-122 kubenswrapper[2579]: E0718 11:20:06.888414    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cj4nh" podUID="17f689f0-ceae-4eb8-acaa-922caaa8e3f8"
Jul 18 11:20:06.888596 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:06.888183    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6j4vg"
Jul 18 11:20:06.888596 ip-10-0-133-122 kubenswrapper[2579]: E0718 11:20:06.888491    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ljhk6" podUID="0e090c50-e996-4eda-b8c0-46d7f7d7dde3"
Jul 18 11:20:06.888814 ip-10-0-133-122 kubenswrapper[2579]: E0718 11:20:06.888593    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6j4vg" podUID="b4c72690-9e6e-4826-8ff8-95eeea44b5d0"
Jul 18 11:20:07.122261 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:07.122225    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lvgzl" event={"ID":"aa392a6c-12d5-4e00-beda-a16aed7a5e09","Type":"ContainerStarted","Data":"5901db784bfa2360fb08f34011fdce34924f6fa1d17f8ad07001392efc787f9b"}
Jul 18 11:20:07.125685 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:07.125663    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-58jnn_40e8e19c-87b3-4cd6-81c1-0f404971a282/ovn-acl-logging/0.log"
Jul 18 11:20:07.126190 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:07.126161    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-58jnn" event={"ID":"40e8e19c-87b3-4cd6-81c1-0f404971a282","Type":"ContainerStarted","Data":"8bf9c9990faffa860d321019c3ba39a769871082b3120af266e4513eb2c6e2fa"}
Jul 18 11:20:07.140779 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:07.140679    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lvgzl" podStartSLOduration=4.027404863 podStartE2EDuration="26.140662037s" totalImagesPullingTime="22.113257174s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-18 11:19:41 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 11:20:07.140252225 +0000 UTC m=+26.755288526" watchObservedRunningTime="2026-07-18 11:20:07.140662037 +0000 UTC m=+26.755698342"
Jul 18 11:20:08.888721 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:08.888673    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ljhk6"
Jul 18 11:20:08.889690 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:08.888683    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6j4vg"
Jul 18 11:20:08.889690 ip-10-0-133-122 kubenswrapper[2579]: E0718 11:20:08.888800    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ljhk6" podUID="0e090c50-e996-4eda-b8c0-46d7f7d7dde3"
Jul 18 11:20:08.889690 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:08.888683    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cj4nh"
Jul 18 11:20:08.889690 ip-10-0-133-122 kubenswrapper[2579]: E0718 11:20:08.888880    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6j4vg" podUID="b4c72690-9e6e-4826-8ff8-95eeea44b5d0"
Jul 18 11:20:08.889690 ip-10-0-133-122 kubenswrapper[2579]: E0718 11:20:08.888946    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cj4nh" podUID="17f689f0-ceae-4eb8-acaa-922caaa8e3f8"
Jul 18 11:20:09.133147 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:09.132991    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-58jnn_40e8e19c-87b3-4cd6-81c1-0f404971a282/ovn-acl-logging/0.log"
Jul 18 11:20:09.133554 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:09.133527    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-58jnn" event={"ID":"40e8e19c-87b3-4cd6-81c1-0f404971a282","Type":"ContainerStarted","Data":"8a9758afbe81c07d2f28a94a936f2d73a6f00e31e2c247fd8dab084ce9ffb8b3"}
Jul 18 11:20:09.133884 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:09.133767    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-58jnn"
Jul 18 11:20:09.133884 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:09.133828    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-58jnn"
Jul 18 11:20:09.134240 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:09.134007    2579 scope.go:117] "RemoveContainer" containerID="1f66703f9054518e5ca813e30e7d4bb9b0b7241cb7f73f442e051c8094456039"
Jul 18 11:20:09.135552 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:09.135525    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lmf4l" event={"ID":"49f40ae2-d33c-4284-a889-0d9b27421bf4","Type":"ContainerStarted","Data":"0b2f94dd3f6c1ccd5548cd2c82c86ebf90f59b21ca8dc0ff70e6d3ef541cd870"}
Jul 18 11:20:09.149758 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:09.149727    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-58jnn"
Jul 18 11:20:09.149883 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:09.149871    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-58jnn"
Jul 18 11:20:10.139782 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:10.139747    2579 generic.go:356] "Generic (PLEG): container finished" podID="49f40ae2-d33c-4284-a889-0d9b27421bf4" containerID="0b2f94dd3f6c1ccd5548cd2c82c86ebf90f59b21ca8dc0ff70e6d3ef541cd870" exitCode=0
Jul 18 11:20:10.140294 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:10.139870    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lmf4l" event={"ID":"49f40ae2-d33c-4284-a889-0d9b27421bf4","Type":"ContainerDied","Data":"0b2f94dd3f6c1ccd5548cd2c82c86ebf90f59b21ca8dc0ff70e6d3ef541cd870"}
Jul 18 11:20:10.144059 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:10.144037    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-58jnn_40e8e19c-87b3-4cd6-81c1-0f404971a282/ovn-acl-logging/0.log"
Jul 18 11:20:10.144407 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:10.144386    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-58jnn" event={"ID":"40e8e19c-87b3-4cd6-81c1-0f404971a282","Type":"ContainerStarted","Data":"4e24c20b4bbf9f95047cdc937a92da9fe05beebc5812b864d9e5f367ab6595ba"}
Jul 18 11:20:10.144478 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:10.144464    2579 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jul 18 11:20:10.186425 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:10.186342    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-58jnn" podStartSLOduration=9.046691343 podStartE2EDuration="29.186326114s" totalImagesPullingTime="20.139634771s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-18 11:19:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 11:20:10.184915891 +0000 UTC m=+29.799952195" watchObservedRunningTime="2026-07-18 11:20:10.186326114 +0000 UTC m=+29.801362417"
Jul 18 11:20:10.889473 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:10.889442    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cj4nh"
Jul 18 11:20:10.889638 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:10.889503    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6j4vg"
Jul 18 11:20:10.889638 ip-10-0-133-122 kubenswrapper[2579]: E0718 11:20:10.889572    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6j4vg" podUID="b4c72690-9e6e-4826-8ff8-95eeea44b5d0"
Jul 18 11:20:10.889638 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:10.889592    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ljhk6"
Jul 18 11:20:10.889768 ip-10-0-133-122 kubenswrapper[2579]: E0718 11:20:10.889693    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ljhk6" podUID="0e090c50-e996-4eda-b8c0-46d7f7d7dde3"
Jul 18 11:20:10.889805 ip-10-0-133-122 kubenswrapper[2579]: E0718 11:20:10.889764    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cj4nh" podUID="17f689f0-ceae-4eb8-acaa-922caaa8e3f8"
Jul 18 11:20:10.943416 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:10.943386    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-6j4vg"]
Jul 18 11:20:10.947107 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:10.947079    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-ljhk6"]
Jul 18 11:20:10.947688 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:10.947667    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-cj4nh"]
Jul 18 11:20:11.146481 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:11.146399    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cj4nh"
Jul 18 11:20:11.146481 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:11.146417    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6j4vg"
Jul 18 11:20:11.146481 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:11.146418    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ljhk6"
Jul 18 11:20:11.146481 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:11.146483    2579 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jul 18 11:20:11.147102 ip-10-0-133-122 kubenswrapper[2579]: E0718 11:20:11.146515    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cj4nh" podUID="17f689f0-ceae-4eb8-acaa-922caaa8e3f8"
Jul 18 11:20:11.147102 ip-10-0-133-122 kubenswrapper[2579]: E0718 11:20:11.146884    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ljhk6" podUID="0e090c50-e996-4eda-b8c0-46d7f7d7dde3"
Jul 18 11:20:11.147102 ip-10-0-133-122 kubenswrapper[2579]: E0718 11:20:11.146991    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6j4vg" podUID="b4c72690-9e6e-4826-8ff8-95eeea44b5d0"
Jul 18 11:20:11.539193 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:11.539165    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-hnt7j"
Jul 18 11:20:11.539313 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:11.539302    2579 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jul 18 11:20:11.539803 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:11.539780    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-hnt7j"
Jul 18 11:20:12.151283 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:12.151250    2579 generic.go:356] "Generic (PLEG): container finished" podID="49f40ae2-d33c-4284-a889-0d9b27421bf4" containerID="d2d2ea8f051ac7b5a44c452ff2aabc5ab052bb31dc2332ad5d9df5e71aadcae0" exitCode=0
Jul 18 11:20:12.151642 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:12.151344    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lmf4l" event={"ID":"49f40ae2-d33c-4284-a889-0d9b27421bf4","Type":"ContainerDied","Data":"d2d2ea8f051ac7b5a44c452ff2aabc5ab052bb31dc2332ad5d9df5e71aadcae0"}
Jul 18 11:20:12.888613 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:12.888584    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ljhk6"
Jul 18 11:20:12.888795 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:12.888584    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cj4nh"
Jul 18 11:20:12.888795 ip-10-0-133-122 kubenswrapper[2579]: E0718 11:20:12.888698    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ljhk6" podUID="0e090c50-e996-4eda-b8c0-46d7f7d7dde3"
Jul 18 11:20:12.888795 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:12.888587    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6j4vg"
Jul 18 11:20:12.888795 ip-10-0-133-122 kubenswrapper[2579]: E0718 11:20:12.888780    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cj4nh" podUID="17f689f0-ceae-4eb8-acaa-922caaa8e3f8"
Jul 18 11:20:12.888976 ip-10-0-133-122 kubenswrapper[2579]: E0718 11:20:12.888907    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6j4vg" podUID="b4c72690-9e6e-4826-8ff8-95eeea44b5d0"
Jul 18 11:20:13.028352 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:13.028318    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-58jnn"
Jul 18 11:20:13.028573 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:13.028558    2579 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jul 18 11:20:13.040710 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:13.040542    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ovn-kubernetes/ovnkube-node-58jnn" podUID="40e8e19c-87b3-4cd6-81c1-0f404971a282" containerName="ovnkube-controller" probeResult="failure" output=""
Jul 18 11:20:13.049156 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:13.049116    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ovn-kubernetes/ovnkube-node-58jnn" podUID="40e8e19c-87b3-4cd6-81c1-0f404971a282" containerName="ovnkube-controller" probeResult="failure" output=""
Jul 18 11:20:14.157925 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:14.157875    2579 generic.go:356] "Generic (PLEG): container finished" podID="49f40ae2-d33c-4284-a889-0d9b27421bf4" containerID="22d082d053d5b63ca6d1fc4c31913ac3d8e615e5c035eccebb3eb8ed517ee181" exitCode=0
Jul 18 11:20:14.158307 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:14.157939    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lmf4l" event={"ID":"49f40ae2-d33c-4284-a889-0d9b27421bf4","Type":"ContainerDied","Data":"22d082d053d5b63ca6d1fc4c31913ac3d8e615e5c035eccebb3eb8ed517ee181"}
Jul 18 11:20:14.583593 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:14.583560    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b4c72690-9e6e-4826-8ff8-95eeea44b5d0-original-pull-secret\") pod \"global-pull-secret-syncer-6j4vg\" (UID: \"b4c72690-9e6e-4826-8ff8-95eeea44b5d0\") " pod="kube-system/global-pull-secret-syncer-6j4vg"
Jul 18 11:20:14.583754 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:14.583598    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0e090c50-e996-4eda-b8c0-46d7f7d7dde3-metrics-certs\") pod \"network-metrics-daemon-ljhk6\" (UID: \"0e090c50-e996-4eda-b8c0-46d7f7d7dde3\") " pod="openshift-multus/network-metrics-daemon-ljhk6"
Jul 18 11:20:14.583754 ip-10-0-133-122 kubenswrapper[2579]: E0718 11:20:14.583697    2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 18 11:20:14.583754 ip-10-0-133-122 kubenswrapper[2579]: E0718 11:20:14.583707    2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 18 11:20:14.583754 ip-10-0-133-122 kubenswrapper[2579]: E0718 11:20:14.583748    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0e090c50-e996-4eda-b8c0-46d7f7d7dde3-metrics-certs podName:0e090c50-e996-4eda-b8c0-46d7f7d7dde3 nodeName:}" failed. No retries permitted until 2026-07-18 11:20:46.583734644 +0000 UTC m=+66.198770924 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0e090c50-e996-4eda-b8c0-46d7f7d7dde3-metrics-certs") pod "network-metrics-daemon-ljhk6" (UID: "0e090c50-e996-4eda-b8c0-46d7f7d7dde3") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 18 11:20:14.583999 ip-10-0-133-122 kubenswrapper[2579]: E0718 11:20:14.583766    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b4c72690-9e6e-4826-8ff8-95eeea44b5d0-original-pull-secret podName:b4c72690-9e6e-4826-8ff8-95eeea44b5d0 nodeName:}" failed. No retries permitted until 2026-07-18 11:20:46.58375338 +0000 UTC m=+66.198789661 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b4c72690-9e6e-4826-8ff8-95eeea44b5d0-original-pull-secret") pod "global-pull-secret-syncer-6j4vg" (UID: "b4c72690-9e6e-4826-8ff8-95eeea44b5d0") : object "kube-system"/"original-pull-secret" not registered
Jul 18 11:20:14.786203 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:14.786161    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d9kdd\" (UniqueName: \"kubernetes.io/projected/17f689f0-ceae-4eb8-acaa-922caaa8e3f8-kube-api-access-d9kdd\") pod \"network-check-target-cj4nh\" (UID: \"17f689f0-ceae-4eb8-acaa-922caaa8e3f8\") " pod="openshift-network-diagnostics/network-check-target-cj4nh"
Jul 18 11:20:14.786395 ip-10-0-133-122 kubenswrapper[2579]: E0718 11:20:14.786305    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 18 11:20:14.786395 ip-10-0-133-122 kubenswrapper[2579]: E0718 11:20:14.786327    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 18 11:20:14.786395 ip-10-0-133-122 kubenswrapper[2579]: E0718 11:20:14.786337    2579 projected.go:196] Error preparing data for projected volume kube-api-access-d9kdd for pod openshift-network-diagnostics/network-check-target-cj4nh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 18 11:20:14.786395 ip-10-0-133-122 kubenswrapper[2579]: E0718 11:20:14.786390    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/17f689f0-ceae-4eb8-acaa-922caaa8e3f8-kube-api-access-d9kdd podName:17f689f0-ceae-4eb8-acaa-922caaa8e3f8 nodeName:}" failed. No retries permitted until 2026-07-18 11:20:46.786374494 +0000 UTC m=+66.401410775 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-d9kdd" (UniqueName: "kubernetes.io/projected/17f689f0-ceae-4eb8-acaa-922caaa8e3f8-kube-api-access-d9kdd") pod "network-check-target-cj4nh" (UID: "17f689f0-ceae-4eb8-acaa-922caaa8e3f8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 18 11:20:14.888105 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:14.888067    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6j4vg"
Jul 18 11:20:14.888293 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:14.888069    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cj4nh"
Jul 18 11:20:14.888293 ip-10-0-133-122 kubenswrapper[2579]: E0718 11:20:14.888204    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6j4vg" podUID="b4c72690-9e6e-4826-8ff8-95eeea44b5d0"
Jul 18 11:20:14.888293 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:14.888069    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ljhk6"
Jul 18 11:20:14.888293 ip-10-0-133-122 kubenswrapper[2579]: E0718 11:20:14.888271    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cj4nh" podUID="17f689f0-ceae-4eb8-acaa-922caaa8e3f8"
Jul 18 11:20:14.888511 ip-10-0-133-122 kubenswrapper[2579]: E0718 11:20:14.888352    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ljhk6" podUID="0e090c50-e996-4eda-b8c0-46d7f7d7dde3"
Jul 18 11:20:16.888245 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:16.888168    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6j4vg"
Jul 18 11:20:16.888718 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:16.888174    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cj4nh"
Jul 18 11:20:16.888718 ip-10-0-133-122 kubenswrapper[2579]: E0718 11:20:16.888304    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6j4vg" podUID="b4c72690-9e6e-4826-8ff8-95eeea44b5d0"
Jul 18 11:20:16.888718 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:16.888184    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ljhk6"
Jul 18 11:20:16.888718 ip-10-0-133-122 kubenswrapper[2579]: E0718 11:20:16.888350    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cj4nh" podUID="17f689f0-ceae-4eb8-acaa-922caaa8e3f8"
Jul 18 11:20:16.888718 ip-10-0-133-122 kubenswrapper[2579]: E0718 11:20:16.888441    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ljhk6" podUID="0e090c50-e996-4eda-b8c0-46d7f7d7dde3"
Jul 18 11:20:17.152353 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:17.152278    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-122.ec2.internal" event="NodeReady"
Jul 18 11:20:17.152499 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:17.152408    2579 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 18 11:20:17.186048 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:17.186017    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-rtpfm"]
Jul 18 11:20:17.191087 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:17.191030    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-565b7b569d-jfpn7"]
Jul 18 11:20:17.191237 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:17.191183    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-rtpfm"
Jul 18 11:20:17.193852 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:17.193748    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
Jul 18 11:20:17.193852 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:17.193753    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-xczns\""
Jul 18 11:20:17.194139 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:17.193837    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
Jul 18 11:20:17.194474 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:17.194453    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-76cf8966f8-fzxs7"]
Jul 18 11:20:17.194561 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:17.194541    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-565b7b569d-jfpn7"
Jul 18 11:20:17.197416 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:17.197399    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
Jul 18 11:20:17.197416 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:17.197408    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
Jul 18 11:20:17.197567 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:17.197424    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
Jul 18 11:20:17.197628 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:17.197578    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-mprtw\""
Jul 18 11:20:17.197684 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:17.197627    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-p7shj"]
Jul 18 11:20:17.197847 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:17.197833    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
Jul 18 11:20:17.198405 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:17.198076    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-fzxs7"
Jul 18 11:20:17.205951 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:17.203021    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-594b7ddb68-98wbn"]
Jul 18 11:20:17.205951 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:17.204153    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-p7shj"
Jul 18 11:20:17.205951 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:17.204571    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 18 11:20:17.205951 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:17.204749    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
Jul 18 11:20:17.205951 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:17.204840    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-7bhxp\""
Jul 18 11:20:17.205951 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:17.205685    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 18 11:20:17.207427 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:17.207396    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5bcbc94c78-g8g4r"]
Jul 18 11:20:17.208182 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:17.208161    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
Jul 18 11:20:17.212296 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:17.211160    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-594b7ddb68-98wbn"
Jul 18 11:20:17.212296 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:17.211432    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-rtpfm"]
Jul 18 11:20:17.212296 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:17.211469    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-kv2jv"]
Jul 18 11:20:17.212296 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:17.211755    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
Jul 18 11:20:17.212296 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:17.211815    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
Jul 18 11:20:17.212296 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:17.211845    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
Jul 18 11:20:17.212296 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:17.211952    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
Jul 18 11:20:17.212296 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:17.212127    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
Jul 18 11:20:17.212296 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:17.212181    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-lgq2l\""
Jul 18 11:20:17.212296 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:17.212251    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-g8g4r"
Jul 18 11:20:17.214094 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:17.214076    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-hnxrg\""
Jul 18 11:20:17.214809 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:17.214786    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Jul 18 11:20:17.214809 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:17.214840    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Jul 18 11:20:17.214809 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:17.214875    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 18 11:20:17.214809 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:17.215046    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-p7shj"]
Jul 18 11:20:17.214809 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:17.215077    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-2ls6p"]
Jul 18 11:20:17.214809 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:17.215136    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Jul 18 11:20:17.214809 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:17.215177    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 18 11:20:17.214809 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:17.215434    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Jul 18 11:20:17.214809 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:17.215487    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 18 11:20:17.214809 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:17.215517    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-kv2jv"
Jul 18 11:20:17.214809 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:17.215719    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-x8crh\""
Jul 18 11:20:17.217631 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:17.217614    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-72crb\""
Jul 18 11:20:17.217790 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:17.217736    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 18 11:20:17.217965 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:17.217799    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 18 11:20:17.218346 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:17.218324    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-7bc5b6bf85-jz6m4"]
Jul 18 11:20:17.218597 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:17.218579    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-2ls6p"
Jul 18 11:20:17.220042 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:17.219907    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 18 11:20:17.220916 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:17.220857    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
Jul 18 11:20:17.220916 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:17.220882    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
Jul 18 11:20:17.221114 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:17.221098    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-rn2n2\""
Jul 18 11:20:17.221278 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:17.221196    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
Jul 18 11:20:17.221566 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:17.221536    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-64cdb59cb-q4c6l"]
Jul 18 11:20:17.222497 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:17.222477    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-jz6m4"
Jul 18 11:20:17.227352 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:17.225949    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-76cf8966f8-fzxs7"]
Jul 18 11:20:17.227352 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:17.225987    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-ljssw"]
Jul 18 11:20:17.227352 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:17.226222    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 18 11:20:17.227352 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:17.226527    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-tf9km\""
Jul 18 11:20:17.230794 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:17.230772    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-7bc7489cb5-v6n2x"]
Jul 18 11:20:17.231126 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:17.231107    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-ljssw"
Jul 18 11:20:17.231368 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:17.231347    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-64cdb59cb-q4c6l"
Jul 18 11:20:17.233431 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:17.233413    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 18 11:20:17.234284 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:17.234264    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 18 11:20:17.234410 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:17.234393    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 18 11:20:17.234546 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:17.234524    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Jul 18 11:20:17.234795 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:17.234775    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Jul 18 11:20:17.234942 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:17.234923    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Jul 18 11:20:17.235035 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:17.235019    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-dgc9c\""
Jul 18 11:20:17.235223 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:17.235203    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Jul 18 11:20:17.235363 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:17.235346    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 18 11:20:17.235472 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:17.234361    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 18 11:20:17.235739 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:17.235724    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-ldvvj\""
Jul 18 11:20:17.236092 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:17.236076    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 18 11:20:17.239513 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:17.239491    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-v6n2x"
Jul 18 11:20:17.239916 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:17.239807    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-555d9d7885-qs8cs"]
Jul 18 11:20:17.242971 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:17.242916    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
Jul 18 11:20:17.243206 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:17.243187    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
Jul 18 11:20:17.243400 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:17.243360    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-565b7b569d-jfpn7"]
Jul 18 11:20:17.243400 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:17.243398    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-594b7ddb68-98wbn"]
Jul 18 11:20:17.243592 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:17.243418    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7bc5b6bf85-jz6m4"]
Jul 18 11:20:17.243592 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:17.243438    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-2ls6p"]
Jul 18 11:20:17.243592 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:17.243464    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5bcbc94c78-g8g4r"]
Jul 18 11:20:17.243592 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:17.243483    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-ljssw"]
Jul 18 11:20:17.243592 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:17.243502    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-kv2jv"]
Jul 18 11:20:17.243592 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:17.243524    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-64cdb59cb-q4c6l"]
Jul 18 11:20:17.243592 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:17.243544    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-555d9d7885-qs8cs"]
Jul 18 11:20:17.243592 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:17.243546    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-qfzzr\""
Jul 18 11:20:17.243592 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:17.243579    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-555d9d7885-qs8cs"
Jul 18 11:20:17.244440 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:17.244019    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-7bc7489cb5-v6n2x"]
Jul 18 11:20:17.245790 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:17.245711    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 18 11:20:17.246057 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:17.246037    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
Jul 18 11:20:17.246429 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:17.246411    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
Jul 18 11:20:17.246834 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:17.246818    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-hhzh5\""
Jul 18 11:20:17.247104 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:17.246901    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 18 11:20:17.252077 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:17.252057    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
Jul 18 11:20:17.304881 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:17.304849    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pxmng\" (UniqueName: \"kubernetes.io/projected/f4e046d0-f0d1-453c-8729-b2191f050b73-kube-api-access-pxmng\") pod \"cluster-monitoring-operator-76cf8966f8-fzxs7\" (UID: \"f4e046d0-f0d1-453c-8729-b2191f050b73\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-fzxs7"
Jul 18 11:20:17.305764 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:17.305740    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/067c96d7-6025-43a0-872a-9134f16c8221-service-ca-bundle\") pod \"router-default-64cdb59cb-q4c6l\" (UID: \"067c96d7-6025-43a0-872a-9134f16c8221\") " pod="openshift-ingress/router-default-64cdb59cb-q4c6l"
Jul 18 11:20:17.305860 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:17.305791    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/57dfdac3-878d-43df-84ab-0996f5fba323-metrics-tls\") pod \"dns-default-kv2jv\" (UID: \"57dfdac3-878d-43df-84ab-0996f5fba323\") " pod="openshift-dns/dns-default-kv2jv"
Jul 18 11:20:17.305860 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:17.305817    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/57dfdac3-878d-43df-84ab-0996f5fba323-tmp-dir\") pod \"dns-default-kv2jv\" (UID: \"57dfdac3-878d-43df-84ab-0996f5fba323\") " pod="openshift-dns/dns-default-kv2jv"
Jul 18 11:20:17.305999 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:17.305906    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/099bdb04-cb99-4be4-8f98-76ed8839204e-ca-trust-extracted\") pod \"image-registry-594b7ddb68-98wbn\" (UID: \"099bdb04-cb99-4be4-8f98-76ed8839204e\") " pod="openshift-image-registry/image-registry-594b7ddb68-98wbn"
Jul 18 11:20:17.305999 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:17.305945    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/85567bae-b6fc-4bdd-8973-0bd705dc22f8-serving-cert\") pod \"service-ca-operator-5bcbc94c78-g8g4r\" (UID: \"85567bae-b6fc-4bdd-8973-0bd705dc22f8\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-g8g4r"
Jul 18 11:20:17.305999 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:17.305987    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/099bdb04-cb99-4be4-8f98-76ed8839204e-image-registry-private-configuration\") pod \"image-registry-594b7ddb68-98wbn\" (UID: \"099bdb04-cb99-4be4-8f98-76ed8839204e\") " pod="openshift-image-registry/image-registry-594b7ddb68-98wbn"
Jul 18 11:20:17.306150 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:17.306013    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/099bdb04-cb99-4be4-8f98-76ed8839204e-trusted-ca\") pod \"image-registry-594b7ddb68-98wbn\" (UID: \"099bdb04-cb99-4be4-8f98-76ed8839204e\") " pod="openshift-image-registry/image-registry-594b7ddb68-98wbn"
Jul 18 11:20:17.306150 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:17.306042    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e6cc6097-8792-4b98-ab5f-085dac6a9dc7-config\") pod \"kube-storage-version-migrator-operator-7658d9b749-p7shj\" (UID: \"e6cc6097-8792-4b98-ab5f-085dac6a9dc7\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-p7shj"
Jul 18 11:20:17.306150 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:17.306071    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/067c96d7-6025-43a0-872a-9134f16c8221-metrics-certs\") pod \"router-default-64cdb59cb-q4c6l\" (UID: \"067c96d7-6025-43a0-872a-9134f16c8221\") " pod="openshift-ingress/router-default-64cdb59cb-q4c6l"
Jul 18 11:20:17.306150 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:17.306098    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/759a894c-1828-4ac9-a7c3-77354a104247-serving-cert\") pod \"console-operator-565b7b569d-jfpn7\" (UID: \"759a894c-1828-4ac9-a7c3-77354a104247\") " pod="openshift-console-operator/console-operator-565b7b569d-jfpn7"
Jul 18 11:20:17.306150 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:17.306128    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zqvc6\" (UniqueName: \"kubernetes.io/projected/099bdb04-cb99-4be4-8f98-76ed8839204e-kube-api-access-zqvc6\") pod \"image-registry-594b7ddb68-98wbn\" (UID: \"099bdb04-cb99-4be4-8f98-76ed8839204e\") " pod="openshift-image-registry/image-registry-594b7ddb68-98wbn"
Jul 18 11:20:17.306368 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:17.306172    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h5czc\" (UniqueName: \"kubernetes.io/projected/067c96d7-6025-43a0-872a-9134f16c8221-kube-api-access-h5czc\") pod \"router-default-64cdb59cb-q4c6l\" (UID: \"067c96d7-6025-43a0-872a-9134f16c8221\") " pod="openshift-ingress/router-default-64cdb59cb-q4c6l"
Jul 18 11:20:17.306368 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:17.306214    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5h6q7\" (UniqueName: \"kubernetes.io/projected/e6cc6097-8792-4b98-ab5f-085dac6a9dc7-kube-api-access-5h6q7\") pod \"kube-storage-version-migrator-operator-7658d9b749-p7shj\" (UID: \"e6cc6097-8792-4b98-ab5f-085dac6a9dc7\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-p7shj"
Jul 18 11:20:17.306368 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:17.306258    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/37a0a359-1903-477c-8f8a-80712275ad64-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-2ls6p\" (UID: \"37a0a359-1903-477c-8f8a-80712275ad64\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-2ls6p"
Jul 18 11:20:17.306368 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:17.306284    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/f4e046d0-f0d1-453c-8729-b2191f050b73-telemetry-config\") pod \"cluster-monitoring-operator-76cf8966f8-fzxs7\" (UID: \"f4e046d0-f0d1-453c-8729-b2191f050b73\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-fzxs7"
Jul 18 11:20:17.306368 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:17.306320    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k9tsd\" (UniqueName: \"kubernetes.io/projected/759a894c-1828-4ac9-a7c3-77354a104247-kube-api-access-k9tsd\") pod \"console-operator-565b7b569d-jfpn7\" (UID: \"759a894c-1828-4ac9-a7c3-77354a104247\") " pod="openshift-console-operator/console-operator-565b7b569d-jfpn7"
Jul 18 11:20:17.306584 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:17.306368    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/759a894c-1828-4ac9-a7c3-77354a104247-trusted-ca\") pod \"console-operator-565b7b569d-jfpn7\" (UID: \"759a894c-1828-4ac9-a7c3-77354a104247\") " pod="openshift-console-operator/console-operator-565b7b569d-jfpn7"
Jul 18 11:20:17.306584 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:17.306414    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/099bdb04-cb99-4be4-8f98-76ed8839204e-registry-certificates\") pod \"image-registry-594b7ddb68-98wbn\" (UID: \"099bdb04-cb99-4be4-8f98-76ed8839204e\") " pod="openshift-image-registry/image-registry-594b7ddb68-98wbn"
Jul 18 11:20:17.306584 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:17.306441    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pxxb2\" (UniqueName: \"kubernetes.io/projected/37a0a359-1903-477c-8f8a-80712275ad64-kube-api-access-pxxb2\") pod \"cluster-samples-operator-79b7c55f87-2ls6p\" (UID: \"37a0a359-1903-477c-8f8a-80712275ad64\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-2ls6p"
Jul 18 11:20:17.306584 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:17.306468    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/099bdb04-cb99-4be4-8f98-76ed8839204e-registry-tls\") pod \"image-registry-594b7ddb68-98wbn\" (UID: \"099bdb04-cb99-4be4-8f98-76ed8839204e\") " pod="openshift-image-registry/image-registry-594b7ddb68-98wbn"
Jul 18 11:20:17.306584 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:17.306520    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/067c96d7-6025-43a0-872a-9134f16c8221-default-certificate\") pod \"router-default-64cdb59cb-q4c6l\" (UID: \"067c96d7-6025-43a0-872a-9134f16c8221\") " pod="openshift-ingress/router-default-64cdb59cb-q4c6l"
Jul 18 11:20:17.306584 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:17.306565    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/f4e046d0-f0d1-453c-8729-b2191f050b73-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-fzxs7\" (UID: \"f4e046d0-f0d1-453c-8729-b2191f050b73\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-fzxs7"
Jul 18 11:20:17.306848 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:17.306616    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rl9bw\" (UniqueName: \"kubernetes.io/projected/1deb912b-fac4-4121-a030-3a5ae9700aa0-kube-api-access-rl9bw\") pod \"volume-data-source-validator-78cf4c6f6-rtpfm\" (UID: \"1deb912b-fac4-4121-a030-3a5ae9700aa0\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-rtpfm"
Jul 18 11:20:17.306848 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:17.306645    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/57dfdac3-878d-43df-84ab-0996f5fba323-config-volume\") pod \"dns-default-kv2jv\" (UID: \"57dfdac3-878d-43df-84ab-0996f5fba323\") " pod="openshift-dns/dns-default-kv2jv"
Jul 18 11:20:17.306848 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:17.306670    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mpfjn\" (UniqueName: \"kubernetes.io/projected/57dfdac3-878d-43df-84ab-0996f5fba323-kube-api-access-mpfjn\") pod \"dns-default-kv2jv\" (UID: \"57dfdac3-878d-43df-84ab-0996f5fba323\") " pod="openshift-dns/dns-default-kv2jv"
Jul 18 11:20:17.306848 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:17.306697    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/099bdb04-cb99-4be4-8f98-76ed8839204e-installation-pull-secrets\") pod \"image-registry-594b7ddb68-98wbn\" (UID: \"099bdb04-cb99-4be4-8f98-76ed8839204e\") " pod="openshift-image-registry/image-registry-594b7ddb68-98wbn"
Jul 18 11:20:17.306848 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:17.306734    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/067c96d7-6025-43a0-872a-9134f16c8221-stats-auth\") pod \"router-default-64cdb59cb-q4c6l\" (UID: \"067c96d7-6025-43a0-872a-9134f16c8221\") " pod="openshift-ingress/router-default-64cdb59cb-q4c6l"
Jul 18 11:20:17.307042 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:17.306843    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nnqmw\" (UniqueName: \"kubernetes.io/projected/85567bae-b6fc-4bdd-8973-0bd705dc22f8-kube-api-access-nnqmw\") pod \"service-ca-operator-5bcbc94c78-g8g4r\" (UID: \"85567bae-b6fc-4bdd-8973-0bd705dc22f8\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-g8g4r"
Jul 18 11:20:17.307042 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:17.306987    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/099bdb04-cb99-4be4-8f98-76ed8839204e-bound-sa-token\") pod \"image-registry-594b7ddb68-98wbn\" (UID: \"099bdb04-cb99-4be4-8f98-76ed8839204e\") " pod="openshift-image-registry/image-registry-594b7ddb68-98wbn"
Jul 18 11:20:17.307042 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:17.307026    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e6cc6097-8792-4b98-ab5f-085dac6a9dc7-serving-cert\") pod \"kube-storage-version-migrator-operator-7658d9b749-p7shj\" (UID: \"e6cc6097-8792-4b98-ab5f-085dac6a9dc7\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-p7shj"
Jul 18 11:20:17.307163 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:17.307084    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l565z\" (UniqueName: \"kubernetes.io/projected/1319723f-4179-4040-b746-8fde76308444-kube-api-access-l565z\") pod \"network-check-source-7bc5b6bf85-jz6m4\" (UID: \"1319723f-4179-4040-b746-8fde76308444\") " pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-jz6m4"
Jul 18 11:20:17.307163 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:17.307135    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/85567bae-b6fc-4bdd-8973-0bd705dc22f8-config\") pod \"service-ca-operator-5bcbc94c78-g8g4r\" (UID: \"85567bae-b6fc-4bdd-8973-0bd705dc22f8\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-g8g4r"
Jul 18 11:20:17.307234 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:17.307195    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/759a894c-1828-4ac9-a7c3-77354a104247-config\") pod \"console-operator-565b7b569d-jfpn7\" (UID: \"759a894c-1828-4ac9-a7c3-77354a104247\") " pod="openshift-console-operator/console-operator-565b7b569d-jfpn7"
Jul 18 11:20:17.351497 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:17.351458    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnt7j_e0f67788-e972-49ff-b611-b9835f528d81/konnectivity-agent/0.log" limit=1024
Jul 18 11:20:17.408247 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:17.408151    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5h6q7\" (UniqueName: \"kubernetes.io/projected/e6cc6097-8792-4b98-ab5f-085dac6a9dc7-kube-api-access-5h6q7\") pod \"kube-storage-version-migrator-operator-7658d9b749-p7shj\" (UID: \"e6cc6097-8792-4b98-ab5f-085dac6a9dc7\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-p7shj"
Jul 18 11:20:17.408247 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:17.408201    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/37a0a359-1903-477c-8f8a-80712275ad64-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-2ls6p\" (UID: \"37a0a359-1903-477c-8f8a-80712275ad64\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-2ls6p"
Jul 18 11:20:17.408247 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:17.408224    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/f4e046d0-f0d1-453c-8729-b2191f050b73-telemetry-config\") pod \"cluster-monitoring-operator-76cf8966f8-fzxs7\" (UID: \"f4e046d0-f0d1-453c-8729-b2191f050b73\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-fzxs7"
Jul 18 11:20:17.408247 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:17.408243    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k9tsd\" (UniqueName: \"kubernetes.io/projected/759a894c-1828-4ac9-a7c3-77354a104247-kube-api-access-k9tsd\") pod \"console-operator-565b7b569d-jfpn7\" (UID: \"759a894c-1828-4ac9-a7c3-77354a104247\") " pod="openshift-console-operator/console-operator-565b7b569d-jfpn7"
Jul 18 11:20:17.408554 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:17.408267    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e0a05104-9f66-40b5-8d49-2bf876d64b5c-serving-cert\") pod \"insights-operator-555d9d7885-qs8cs\" (UID: \"e0a05104-9f66-40b5-8d49-2bf876d64b5c\") " pod="openshift-insights/insights-operator-555d9d7885-qs8cs"
Jul 18 11:20:17.408554 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:17.408292    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/63d7c8c7-1716-489e-8698-e49c93a85050-nginx-conf\") pod \"networking-console-plugin-7bc7489cb5-v6n2x\" (UID: \"63d7c8c7-1716-489e-8698-e49c93a85050\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-v6n2x"
Jul 18 11:20:17.408554 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:17.408318    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/759a894c-1828-4ac9-a7c3-77354a104247-trusted-ca\") pod \"console-operator-565b7b569d-jfpn7\" (UID: \"759a894c-1828-4ac9-a7c3-77354a104247\") " pod="openshift-console-operator/console-operator-565b7b569d-jfpn7"
Jul 18 11:20:17.408554 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:17.408341    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/63d7c8c7-1716-489e-8698-e49c93a85050-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-v6n2x\" (UID: \"63d7c8c7-1716-489e-8698-e49c93a85050\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-v6n2x"
Jul 18 11:20:17.408554 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:17.408363    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/099bdb04-cb99-4be4-8f98-76ed8839204e-registry-certificates\") pod \"image-registry-594b7ddb68-98wbn\" (UID: \"099bdb04-cb99-4be4-8f98-76ed8839204e\") " pod="openshift-image-registry/image-registry-594b7ddb68-98wbn"
Jul 18 11:20:17.408554 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:17.408388    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pxxb2\" (UniqueName: \"kubernetes.io/projected/37a0a359-1903-477c-8f8a-80712275ad64-kube-api-access-pxxb2\") pod \"cluster-samples-operator-79b7c55f87-2ls6p\" (UID: \"37a0a359-1903-477c-8f8a-80712275ad64\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-2ls6p"
Jul 18 11:20:17.408554 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:17.408411    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e0a05104-9f66-40b5-8d49-2bf876d64b5c-trusted-ca-bundle\") pod \"insights-operator-555d9d7885-qs8cs\" (UID: \"e0a05104-9f66-40b5-8d49-2bf876d64b5c\") " pod="openshift-insights/insights-operator-555d9d7885-qs8cs"
Jul 18 11:20:17.408908 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:17.408562    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/099bdb04-cb99-4be4-8f98-76ed8839204e-registry-tls\") pod \"image-registry-594b7ddb68-98wbn\" (UID: \"099bdb04-cb99-4be4-8f98-76ed8839204e\") " pod="openshift-image-registry/image-registry-594b7ddb68-98wbn"
Jul 18 11:20:17.408908 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:17.408588    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/067c96d7-6025-43a0-872a-9134f16c8221-default-certificate\") pod \"router-default-64cdb59cb-q4c6l\" (UID: \"067c96d7-6025-43a0-872a-9134f16c8221\") " pod="openshift-ingress/router-default-64cdb59cb-q4c6l"
Jul 18 11:20:17.408908 ip-10-0-133-122 kubenswrapper[2579]: E0718 11:20:17.408657    2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 18 11:20:17.408908 ip-10-0-133-122 kubenswrapper[2579]: E0718 11:20:17.408677    2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-594b7ddb68-98wbn: secret "image-registry-tls" not found
Jul 18 11:20:17.408908 ip-10-0-133-122 kubenswrapper[2579]: E0718 11:20:17.408741    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/099bdb04-cb99-4be4-8f98-76ed8839204e-registry-tls podName:099bdb04-cb99-4be4-8f98-76ed8839204e nodeName:}" failed. No retries permitted until 2026-07-18 11:20:17.9087219 +0000 UTC m=+37.523758180 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/099bdb04-cb99-4be4-8f98-76ed8839204e-registry-tls") pod "image-registry-594b7ddb68-98wbn" (UID: "099bdb04-cb99-4be4-8f98-76ed8839204e") : secret "image-registry-tls" not found
Jul 18 11:20:17.408908 ip-10-0-133-122 kubenswrapper[2579]: E0718 11:20:17.408868    2579 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 18 11:20:17.409204 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:17.408905    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/f4e046d0-f0d1-453c-8729-b2191f050b73-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-fzxs7\" (UID: \"f4e046d0-f0d1-453c-8729-b2191f050b73\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-fzxs7"
Jul 18 11:20:17.409204 ip-10-0-133-122 kubenswrapper[2579]: E0718 11:20:17.408960    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/37a0a359-1903-477c-8f8a-80712275ad64-samples-operator-tls podName:37a0a359-1903-477c-8f8a-80712275ad64 nodeName:}" failed. No retries permitted until 2026-07-18 11:20:17.908941063 +0000 UTC m=+37.523977367 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/37a0a359-1903-477c-8f8a-80712275ad64-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-2ls6p" (UID: "37a0a359-1903-477c-8f8a-80712275ad64") : secret "samples-operator-tls" not found
Jul 18 11:20:17.409204 ip-10-0-133-122 kubenswrapper[2579]: E0718 11:20:17.408983    2579 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 18 11:20:17.409204 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:17.408984    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rl9bw\" (UniqueName: \"kubernetes.io/projected/1deb912b-fac4-4121-a030-3a5ae9700aa0-kube-api-access-rl9bw\") pod \"volume-data-source-validator-78cf4c6f6-rtpfm\" (UID: \"1deb912b-fac4-4121-a030-3a5ae9700aa0\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-rtpfm"
Jul 18 11:20:17.409204 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:17.409022    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/57dfdac3-878d-43df-84ab-0996f5fba323-config-volume\") pod \"dns-default-kv2jv\" (UID: \"57dfdac3-878d-43df-84ab-0996f5fba323\") " pod="openshift-dns/dns-default-kv2jv"
Jul 18 11:20:17.409204 ip-10-0-133-122 kubenswrapper[2579]: E0718 11:20:17.409035    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f4e046d0-f0d1-453c-8729-b2191f050b73-cluster-monitoring-operator-tls podName:f4e046d0-f0d1-453c-8729-b2191f050b73 nodeName:}" failed. No retries permitted until 2026-07-18 11:20:17.909019515 +0000 UTC m=+37.524055807 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/f4e046d0-f0d1-453c-8729-b2191f050b73-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-fzxs7" (UID: "f4e046d0-f0d1-453c-8729-b2191f050b73") : secret "cluster-monitoring-operator-tls" not found
Jul 18 11:20:17.409204 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:17.409066    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mpfjn\" (UniqueName: \"kubernetes.io/projected/57dfdac3-878d-43df-84ab-0996f5fba323-kube-api-access-mpfjn\") pod \"dns-default-kv2jv\" (UID: \"57dfdac3-878d-43df-84ab-0996f5fba323\") " pod="openshift-dns/dns-default-kv2jv"
Jul 18 11:20:17.409204 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:17.409070    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/f4e046d0-f0d1-453c-8729-b2191f050b73-telemetry-config\") pod \"cluster-monitoring-operator-76cf8966f8-fzxs7\" (UID: \"f4e046d0-f0d1-453c-8729-b2191f050b73\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-fzxs7"
Jul 18 11:20:17.409204 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:17.409096    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/099bdb04-cb99-4be4-8f98-76ed8839204e-installation-pull-secrets\") pod \"image-registry-594b7ddb68-98wbn\" (UID: \"099bdb04-cb99-4be4-8f98-76ed8839204e\") " pod="openshift-image-registry/image-registry-594b7ddb68-98wbn"
Jul 18 11:20:17.409204 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:17.409101    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/099bdb04-cb99-4be4-8f98-76ed8839204e-registry-certificates\") pod \"image-registry-594b7ddb68-98wbn\" (UID: \"099bdb04-cb99-4be4-8f98-76ed8839204e\") " pod="openshift-image-registry/image-registry-594b7ddb68-98wbn"
Jul 18 11:20:17.409204 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:17.409123    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/067c96d7-6025-43a0-872a-9134f16c8221-stats-auth\") pod \"router-default-64cdb59cb-q4c6l\" (UID: \"067c96d7-6025-43a0-872a-9134f16c8221\") " pod="openshift-ingress/router-default-64cdb59cb-q4c6l"
Jul 18 11:20:17.409204 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:17.409153    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sm7mm\" (UniqueName: \"kubernetes.io/projected/446260ea-ffd2-4b81-8455-4d2052b97c2a-kube-api-access-sm7mm\") pod \"ingress-canary-ljssw\" (UID: \"446260ea-ffd2-4b81-8455-4d2052b97c2a\") " pod="openshift-ingress-canary/ingress-canary-ljssw"
Jul 18 11:20:17.409204 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:17.409180    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nnqmw\" (UniqueName: \"kubernetes.io/projected/85567bae-b6fc-4bdd-8973-0bd705dc22f8-kube-api-access-nnqmw\") pod \"service-ca-operator-5bcbc94c78-g8g4r\" (UID: \"85567bae-b6fc-4bdd-8973-0bd705dc22f8\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-g8g4r"
Jul 18 11:20:17.409204 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:17.409208    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/099bdb04-cb99-4be4-8f98-76ed8839204e-bound-sa-token\") pod \"image-registry-594b7ddb68-98wbn\" (UID: \"099bdb04-cb99-4be4-8f98-76ed8839204e\") " pod="openshift-image-registry/image-registry-594b7ddb68-98wbn"
Jul 18 11:20:17.409867 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:17.409236    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e6cc6097-8792-4b98-ab5f-085dac6a9dc7-serving-cert\") pod \"kube-storage-version-migrator-operator-7658d9b749-p7shj\" (UID: \"e6cc6097-8792-4b98-ab5f-085dac6a9dc7\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-p7shj"
Jul 18 11:20:17.409867 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:17.409264    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l565z\" (UniqueName: \"kubernetes.io/projected/1319723f-4179-4040-b746-8fde76308444-kube-api-access-l565z\") pod \"network-check-source-7bc5b6bf85-jz6m4\" (UID: \"1319723f-4179-4040-b746-8fde76308444\") " pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-jz6m4"
Jul 18 11:20:17.409867 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:17.409288    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/e0a05104-9f66-40b5-8d49-2bf876d64b5c-snapshots\") pod \"insights-operator-555d9d7885-qs8cs\" (UID: \"e0a05104-9f66-40b5-8d49-2bf876d64b5c\") " pod="openshift-insights/insights-operator-555d9d7885-qs8cs"
Jul 18 11:20:17.409867 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:17.409324    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/85567bae-b6fc-4bdd-8973-0bd705dc22f8-config\") pod \"service-ca-operator-5bcbc94c78-g8g4r\" (UID: \"85567bae-b6fc-4bdd-8973-0bd705dc22f8\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-g8g4r"
Jul 18 11:20:17.409867 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:17.409349    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/759a894c-1828-4ac9-a7c3-77354a104247-config\") pod \"console-operator-565b7b569d-jfpn7\" (UID: \"759a894c-1828-4ac9-a7c3-77354a104247\") " pod="openshift-console-operator/console-operator-565b7b569d-jfpn7"
Jul 18 11:20:17.409867 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:17.409377    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e0a05104-9f66-40b5-8d49-2bf876d64b5c-service-ca-bundle\") pod \"insights-operator-555d9d7885-qs8cs\" (UID: \"e0a05104-9f66-40b5-8d49-2bf876d64b5c\") " pod="openshift-insights/insights-operator-555d9d7885-qs8cs"
Jul 18 11:20:17.409867 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:17.409424    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pxmng\" (UniqueName: \"kubernetes.io/projected/f4e046d0-f0d1-453c-8729-b2191f050b73-kube-api-access-pxmng\") pod \"cluster-monitoring-operator-76cf8966f8-fzxs7\" (UID: \"f4e046d0-f0d1-453c-8729-b2191f050b73\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-fzxs7"
Jul 18 11:20:17.409867 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:17.409452    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/067c96d7-6025-43a0-872a-9134f16c8221-service-ca-bundle\") pod \"router-default-64cdb59cb-q4c6l\" (UID: \"067c96d7-6025-43a0-872a-9134f16c8221\") " pod="openshift-ingress/router-default-64cdb59cb-q4c6l"
Jul 18 11:20:17.409867 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:17.409493    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/57dfdac3-878d-43df-84ab-0996f5fba323-metrics-tls\") pod \"dns-default-kv2jv\" (UID: \"57dfdac3-878d-43df-84ab-0996f5fba323\") " pod="openshift-dns/dns-default-kv2jv"
Jul 18 11:20:17.409867 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:17.409518    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/57dfdac3-878d-43df-84ab-0996f5fba323-tmp-dir\") pod \"dns-default-kv2jv\" (UID: \"57dfdac3-878d-43df-84ab-0996f5fba323\") " pod="openshift-dns/dns-default-kv2jv"
Jul 18 11:20:17.409867 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:17.409540    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e0a05104-9f66-40b5-8d49-2bf876d64b5c-tmp\") pod \"insights-operator-555d9d7885-qs8cs\" (UID: \"e0a05104-9f66-40b5-8d49-2bf876d64b5c\") " pod="openshift-insights/insights-operator-555d9d7885-qs8cs"
Jul 18 11:20:17.409867 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:17.409539    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/57dfdac3-878d-43df-84ab-0996f5fba323-config-volume\") pod \"dns-default-kv2jv\" (UID: \"57dfdac3-878d-43df-84ab-0996f5fba323\") " pod="openshift-dns/dns-default-kv2jv"
Jul 18 11:20:17.409867 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:17.409563    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nvnlg\" (UniqueName: \"kubernetes.io/projected/e0a05104-9f66-40b5-8d49-2bf876d64b5c-kube-api-access-nvnlg\") pod \"insights-operator-555d9d7885-qs8cs\" (UID: \"e0a05104-9f66-40b5-8d49-2bf876d64b5c\") " pod="openshift-insights/insights-operator-555d9d7885-qs8cs"
Jul 18 11:20:17.409867 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:17.409589    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/759a894c-1828-4ac9-a7c3-77354a104247-trusted-ca\") pod \"console-operator-565b7b569d-jfpn7\" (UID: \"759a894c-1828-4ac9-a7c3-77354a104247\") " pod="openshift-console-operator/console-operator-565b7b569d-jfpn7"
Jul 18 11:20:17.409867 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:17.409607    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/099bdb04-cb99-4be4-8f98-76ed8839204e-ca-trust-extracted\") pod \"image-registry-594b7ddb68-98wbn\" (UID: \"099bdb04-cb99-4be4-8f98-76ed8839204e\") " pod="openshift-image-registry/image-registry-594b7ddb68-98wbn"
Jul 18 11:20:17.409867 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:17.409649    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/85567bae-b6fc-4bdd-8973-0bd705dc22f8-serving-cert\") pod \"service-ca-operator-5bcbc94c78-g8g4r\" (UID: \"85567bae-b6fc-4bdd-8973-0bd705dc22f8\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-g8g4r"
Jul 18 11:20:17.410628 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:17.409677    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/099bdb04-cb99-4be4-8f98-76ed8839204e-image-registry-private-configuration\") pod \"image-registry-594b7ddb68-98wbn\" (UID: \"099bdb04-cb99-4be4-8f98-76ed8839204e\") " pod="openshift-image-registry/image-registry-594b7ddb68-98wbn"
Jul 18 11:20:17.410628 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:17.409705    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/099bdb04-cb99-4be4-8f98-76ed8839204e-trusted-ca\") pod \"image-registry-594b7ddb68-98wbn\" (UID: \"099bdb04-cb99-4be4-8f98-76ed8839204e\") " pod="openshift-image-registry/image-registry-594b7ddb68-98wbn"
Jul 18 11:20:17.410628 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:17.409729    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/446260ea-ffd2-4b81-8455-4d2052b97c2a-cert\") pod \"ingress-canary-ljssw\" (UID: \"446260ea-ffd2-4b81-8455-4d2052b97c2a\") " pod="openshift-ingress-canary/ingress-canary-ljssw"
Jul 18 11:20:17.410628 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:17.409759    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e6cc6097-8792-4b98-ab5f-085dac6a9dc7-config\") pod \"kube-storage-version-migrator-operator-7658d9b749-p7shj\" (UID: \"e6cc6097-8792-4b98-ab5f-085dac6a9dc7\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-p7shj"
Jul 18 11:20:17.410628 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:17.409792    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/067c96d7-6025-43a0-872a-9134f16c8221-metrics-certs\") pod \"router-default-64cdb59cb-q4c6l\" (UID: \"067c96d7-6025-43a0-872a-9134f16c8221\") " pod="openshift-ingress/router-default-64cdb59cb-q4c6l"
Jul 18 11:20:17.410628 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:17.409819    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/759a894c-1828-4ac9-a7c3-77354a104247-serving-cert\") pod \"console-operator-565b7b569d-jfpn7\" (UID: \"759a894c-1828-4ac9-a7c3-77354a104247\") " pod="openshift-console-operator/console-operator-565b7b569d-jfpn7"
Jul 18 11:20:17.410628 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:17.409852    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zqvc6\" (UniqueName: \"kubernetes.io/projected/099bdb04-cb99-4be4-8f98-76ed8839204e-kube-api-access-zqvc6\") pod \"image-registry-594b7ddb68-98wbn\" (UID: \"099bdb04-cb99-4be4-8f98-76ed8839204e\") " pod="openshift-image-registry/image-registry-594b7ddb68-98wbn"
Jul 18 11:20:17.410628 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:17.409853    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/57dfdac3-878d-43df-84ab-0996f5fba323-tmp-dir\") pod \"dns-default-kv2jv\" (UID: \"57dfdac3-878d-43df-84ab-0996f5fba323\") " pod="openshift-dns/dns-default-kv2jv"
Jul 18 11:20:17.410628 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:17.409878    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h5czc\" (UniqueName: \"kubernetes.io/projected/067c96d7-6025-43a0-872a-9134f16c8221-kube-api-access-h5czc\") pod \"router-default-64cdb59cb-q4c6l\" (UID: \"067c96d7-6025-43a0-872a-9134f16c8221\") " pod="openshift-ingress/router-default-64cdb59cb-q4c6l"
Jul 18 11:20:17.410628 ip-10-0-133-122 kubenswrapper[2579]: E0718 11:20:17.409987    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/067c96d7-6025-43a0-872a-9134f16c8221-service-ca-bundle podName:067c96d7-6025-43a0-872a-9134f16c8221 nodeName:}" failed. No retries permitted until 2026-07-18 11:20:17.909970262 +0000 UTC m=+37.525006546 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/067c96d7-6025-43a0-872a-9134f16c8221-service-ca-bundle") pod "router-default-64cdb59cb-q4c6l" (UID: "067c96d7-6025-43a0-872a-9134f16c8221") : configmap references non-existent config key: service-ca.crt
Jul 18 11:20:17.410628 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:17.409992    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/85567bae-b6fc-4bdd-8973-0bd705dc22f8-config\") pod \"service-ca-operator-5bcbc94c78-g8g4r\" (UID: \"85567bae-b6fc-4bdd-8973-0bd705dc22f8\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-g8g4r"
Jul 18 11:20:17.410628 ip-10-0-133-122 kubenswrapper[2579]: E0718 11:20:17.410059    2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 18 11:20:17.410628 ip-10-0-133-122 kubenswrapper[2579]: E0718 11:20:17.410095    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/57dfdac3-878d-43df-84ab-0996f5fba323-metrics-tls podName:57dfdac3-878d-43df-84ab-0996f5fba323 nodeName:}" failed. No retries permitted until 2026-07-18 11:20:17.910083193 +0000 UTC m=+37.525119476 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/57dfdac3-878d-43df-84ab-0996f5fba323-metrics-tls") pod "dns-default-kv2jv" (UID: "57dfdac3-878d-43df-84ab-0996f5fba323") : secret "dns-default-metrics-tls" not found
Jul 18 11:20:17.410628 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:17.410103    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/099bdb04-cb99-4be4-8f98-76ed8839204e-ca-trust-extracted\") pod \"image-registry-594b7ddb68-98wbn\" (UID: \"099bdb04-cb99-4be4-8f98-76ed8839204e\") " pod="openshift-image-registry/image-registry-594b7ddb68-98wbn"
Jul 18 11:20:17.410628 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:17.410137    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/759a894c-1828-4ac9-a7c3-77354a104247-config\") pod \"console-operator-565b7b569d-jfpn7\" (UID: \"759a894c-1828-4ac9-a7c3-77354a104247\") " pod="openshift-console-operator/console-operator-565b7b569d-jfpn7"
Jul 18 11:20:17.410628 ip-10-0-133-122 kubenswrapper[2579]: E0718 11:20:17.410446    2579 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 18 11:20:17.411364 ip-10-0-133-122 kubenswrapper[2579]: E0718 11:20:17.410484    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/067c96d7-6025-43a0-872a-9134f16c8221-metrics-certs podName:067c96d7-6025-43a0-872a-9134f16c8221 nodeName:}" failed. No retries permitted until 2026-07-18 11:20:17.910472273 +0000 UTC m=+37.525508565 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/067c96d7-6025-43a0-872a-9134f16c8221-metrics-certs") pod "router-default-64cdb59cb-q4c6l" (UID: "067c96d7-6025-43a0-872a-9134f16c8221") : secret "router-metrics-certs-default" not found
Jul 18 11:20:17.411364 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:17.410729    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e6cc6097-8792-4b98-ab5f-085dac6a9dc7-config\") pod \"kube-storage-version-migrator-operator-7658d9b749-p7shj\" (UID: \"e6cc6097-8792-4b98-ab5f-085dac6a9dc7\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-p7shj"
Jul 18 11:20:17.411588 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:17.411542    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/099bdb04-cb99-4be4-8f98-76ed8839204e-trusted-ca\") pod \"image-registry-594b7ddb68-98wbn\" (UID: \"099bdb04-cb99-4be4-8f98-76ed8839204e\") " pod="openshift-image-registry/image-registry-594b7ddb68-98wbn"
Jul 18 11:20:17.414338 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:17.414313    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e6cc6097-8792-4b98-ab5f-085dac6a9dc7-serving-cert\") pod \"kube-storage-version-migrator-operator-7658d9b749-p7shj\" (UID: \"e6cc6097-8792-4b98-ab5f-085dac6a9dc7\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-p7shj"
Jul 18 11:20:17.414439 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:17.414341    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/759a894c-1828-4ac9-a7c3-77354a104247-serving-cert\") pod \"console-operator-565b7b569d-jfpn7\" (UID: \"759a894c-1828-4ac9-a7c3-77354a104247\") " pod="openshift-console-operator/console-operator-565b7b569d-jfpn7"
Jul 18 11:20:17.414498 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:17.414468    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/099bdb04-cb99-4be4-8f98-76ed8839204e-installation-pull-secrets\") pod \"image-registry-594b7ddb68-98wbn\" (UID: \"099bdb04-cb99-4be4-8f98-76ed8839204e\") " pod="openshift-image-registry/image-registry-594b7ddb68-98wbn"
Jul 18 11:20:17.414561 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:17.414505    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/067c96d7-6025-43a0-872a-9134f16c8221-stats-auth\") pod \"router-default-64cdb59cb-q4c6l\" (UID: \"067c96d7-6025-43a0-872a-9134f16c8221\") " pod="openshift-ingress/router-default-64cdb59cb-q4c6l"
Jul 18 11:20:17.414959 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:17.414935    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/067c96d7-6025-43a0-872a-9134f16c8221-default-certificate\") pod \"router-default-64cdb59cb-q4c6l\" (UID: \"067c96d7-6025-43a0-872a-9134f16c8221\") " pod="openshift-ingress/router-default-64cdb59cb-q4c6l"
Jul 18 11:20:17.415855 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:17.415828    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/85567bae-b6fc-4bdd-8973-0bd705dc22f8-serving-cert\") pod \"service-ca-operator-5bcbc94c78-g8g4r\" (UID: \"85567bae-b6fc-4bdd-8973-0bd705dc22f8\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-g8g4r"
Jul 18 11:20:17.416100 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:17.416077    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/099bdb04-cb99-4be4-8f98-76ed8839204e-image-registry-private-configuration\") pod \"image-registry-594b7ddb68-98wbn\" (UID: \"099bdb04-cb99-4be4-8f98-76ed8839204e\") " pod="openshift-image-registry/image-registry-594b7ddb68-98wbn"
Jul 18 11:20:17.418350 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:17.418325    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pxxb2\" (UniqueName: \"kubernetes.io/projected/37a0a359-1903-477c-8f8a-80712275ad64-kube-api-access-pxxb2\") pod \"cluster-samples-operator-79b7c55f87-2ls6p\" (UID: \"37a0a359-1903-477c-8f8a-80712275ad64\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-2ls6p"
Jul 18 11:20:17.419485 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:17.419460    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mpfjn\" (UniqueName: \"kubernetes.io/projected/57dfdac3-878d-43df-84ab-0996f5fba323-kube-api-access-mpfjn\") pod \"dns-default-kv2jv\" (UID: \"57dfdac3-878d-43df-84ab-0996f5fba323\") " pod="openshift-dns/dns-default-kv2jv"
Jul 18 11:20:17.419589 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:17.419526    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5h6q7\" (UniqueName: \"kubernetes.io/projected/e6cc6097-8792-4b98-ab5f-085dac6a9dc7-kube-api-access-5h6q7\") pod \"kube-storage-version-migrator-operator-7658d9b749-p7shj\" (UID: \"e6cc6097-8792-4b98-ab5f-085dac6a9dc7\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-p7shj"
Jul 18 11:20:17.419738 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:17.419716    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rl9bw\" (UniqueName: \"kubernetes.io/projected/1deb912b-fac4-4121-a030-3a5ae9700aa0-kube-api-access-rl9bw\") pod \"volume-data-source-validator-78cf4c6f6-rtpfm\" (UID: \"1deb912b-fac4-4121-a030-3a5ae9700aa0\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-rtpfm"
Jul 18 11:20:17.421350 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:17.421154    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h5czc\" (UniqueName: \"kubernetes.io/projected/067c96d7-6025-43a0-872a-9134f16c8221-kube-api-access-h5czc\") pod \"router-default-64cdb59cb-q4c6l\" (UID: \"067c96d7-6025-43a0-872a-9134f16c8221\") " pod="openshift-ingress/router-default-64cdb59cb-q4c6l"
Jul 18 11:20:17.421452 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:17.421396    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pxmng\" (UniqueName: \"kubernetes.io/projected/f4e046d0-f0d1-453c-8729-b2191f050b73-kube-api-access-pxmng\") pod \"cluster-monitoring-operator-76cf8966f8-fzxs7\" (UID: \"f4e046d0-f0d1-453c-8729-b2191f050b73\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-fzxs7"
Jul 18 11:20:17.422080 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:17.422040    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zqvc6\" (UniqueName: \"kubernetes.io/projected/099bdb04-cb99-4be4-8f98-76ed8839204e-kube-api-access-zqvc6\") pod \"image-registry-594b7ddb68-98wbn\" (UID: \"099bdb04-cb99-4be4-8f98-76ed8839204e\") " pod="openshift-image-registry/image-registry-594b7ddb68-98wbn"
Jul 18 11:20:17.422080 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:17.422052    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l565z\" (UniqueName: \"kubernetes.io/projected/1319723f-4179-4040-b746-8fde76308444-kube-api-access-l565z\") pod \"network-check-source-7bc5b6bf85-jz6m4\" (UID: \"1319723f-4179-4040-b746-8fde76308444\") " pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-jz6m4"
Jul 18 11:20:17.422393 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:17.422374    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/099bdb04-cb99-4be4-8f98-76ed8839204e-bound-sa-token\") pod \"image-registry-594b7ddb68-98wbn\" (UID: \"099bdb04-cb99-4be4-8f98-76ed8839204e\") " pod="openshift-image-registry/image-registry-594b7ddb68-98wbn"
Jul 18 11:20:17.422464 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:17.422441    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nnqmw\" (UniqueName: \"kubernetes.io/projected/85567bae-b6fc-4bdd-8973-0bd705dc22f8-kube-api-access-nnqmw\") pod \"service-ca-operator-5bcbc94c78-g8g4r\" (UID: \"85567bae-b6fc-4bdd-8973-0bd705dc22f8\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-g8g4r"
Jul 18 11:20:17.423140 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:17.423121    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k9tsd\" (UniqueName: \"kubernetes.io/projected/759a894c-1828-4ac9-a7c3-77354a104247-kube-api-access-k9tsd\") pod \"console-operator-565b7b569d-jfpn7\" (UID: \"759a894c-1828-4ac9-a7c3-77354a104247\") " pod="openshift-console-operator/console-operator-565b7b569d-jfpn7"
Jul 18 11:20:17.438544 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:17.438436    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnt7j_e0f67788-e972-49ff-b611-b9835f528d81/konnectivity-agent/0.log" limit=1024
Jul 18 11:20:17.510664 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:17.510631    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e0a05104-9f66-40b5-8d49-2bf876d64b5c-serving-cert\") pod \"insights-operator-555d9d7885-qs8cs\" (UID: \"e0a05104-9f66-40b5-8d49-2bf876d64b5c\") " pod="openshift-insights/insights-operator-555d9d7885-qs8cs"
Jul 18 11:20:17.510835 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:17.510672    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/63d7c8c7-1716-489e-8698-e49c93a85050-nginx-conf\") pod \"networking-console-plugin-7bc7489cb5-v6n2x\" (UID: \"63d7c8c7-1716-489e-8698-e49c93a85050\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-v6n2x"
Jul 18 11:20:17.510835 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:17.510703    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/63d7c8c7-1716-489e-8698-e49c93a85050-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-v6n2x\" (UID: \"63d7c8c7-1716-489e-8698-e49c93a85050\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-v6n2x"
Jul 18 11:20:17.510835 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:17.510735    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e0a05104-9f66-40b5-8d49-2bf876d64b5c-trusted-ca-bundle\") pod \"insights-operator-555d9d7885-qs8cs\" (UID: \"e0a05104-9f66-40b5-8d49-2bf876d64b5c\") " pod="openshift-insights/insights-operator-555d9d7885-qs8cs"
Jul 18 11:20:17.511027 ip-10-0-133-122 kubenswrapper[2579]: E0718 11:20:17.510836    2579 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 18 11:20:17.511027 ip-10-0-133-122 kubenswrapper[2579]: E0718 11:20:17.510921    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/63d7c8c7-1716-489e-8698-e49c93a85050-networking-console-plugin-cert podName:63d7c8c7-1716-489e-8698-e49c93a85050 nodeName:}" failed. No retries permitted until 2026-07-18 11:20:18.010875869 +0000 UTC m=+37.625912150 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/63d7c8c7-1716-489e-8698-e49c93a85050-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-v6n2x" (UID: "63d7c8c7-1716-489e-8698-e49c93a85050") : secret "networking-console-plugin-cert" not found
Jul 18 11:20:17.511799 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:17.511197    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sm7mm\" (UniqueName: \"kubernetes.io/projected/446260ea-ffd2-4b81-8455-4d2052b97c2a-kube-api-access-sm7mm\") pod \"ingress-canary-ljssw\" (UID: \"446260ea-ffd2-4b81-8455-4d2052b97c2a\") " pod="openshift-ingress-canary/ingress-canary-ljssw"
Jul 18 11:20:17.511799 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:17.511266    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/e0a05104-9f66-40b5-8d49-2bf876d64b5c-snapshots\") pod \"insights-operator-555d9d7885-qs8cs\" (UID: \"e0a05104-9f66-40b5-8d49-2bf876d64b5c\") " pod="openshift-insights/insights-operator-555d9d7885-qs8cs"
Jul 18 11:20:17.511799 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:17.511319    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e0a05104-9f66-40b5-8d49-2bf876d64b5c-service-ca-bundle\") pod \"insights-operator-555d9d7885-qs8cs\" (UID: \"e0a05104-9f66-40b5-8d49-2bf876d64b5c\") " pod="openshift-insights/insights-operator-555d9d7885-qs8cs"
Jul 18 11:20:17.511799 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:17.511393    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e0a05104-9f66-40b5-8d49-2bf876d64b5c-tmp\") pod \"insights-operator-555d9d7885-qs8cs\" (UID: \"e0a05104-9f66-40b5-8d49-2bf876d64b5c\") " pod="openshift-insights/insights-operator-555d9d7885-qs8cs"
Jul 18 11:20:17.511799 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:17.511419    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nvnlg\" (UniqueName: \"kubernetes.io/projected/e0a05104-9f66-40b5-8d49-2bf876d64b5c-kube-api-access-nvnlg\") pod \"insights-operator-555d9d7885-qs8cs\" (UID: \"e0a05104-9f66-40b5-8d49-2bf876d64b5c\") " pod="openshift-insights/insights-operator-555d9d7885-qs8cs"
Jul 18 11:20:17.511799 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:17.511472    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/446260ea-ffd2-4b81-8455-4d2052b97c2a-cert\") pod \"ingress-canary-ljssw\" (UID: \"446260ea-ffd2-4b81-8455-4d2052b97c2a\") " pod="openshift-ingress-canary/ingress-canary-ljssw"
Jul 18 11:20:17.511799 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:17.511500    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/63d7c8c7-1716-489e-8698-e49c93a85050-nginx-conf\") pod \"networking-console-plugin-7bc7489cb5-v6n2x\" (UID: \"63d7c8c7-1716-489e-8698-e49c93a85050\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-v6n2x"
Jul 18 11:20:17.511799 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:17.511733    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-rtpfm"
Jul 18 11:20:17.511799 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:17.511796    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e0a05104-9f66-40b5-8d49-2bf876d64b5c-tmp\") pod \"insights-operator-555d9d7885-qs8cs\" (UID: \"e0a05104-9f66-40b5-8d49-2bf876d64b5c\") " pod="openshift-insights/insights-operator-555d9d7885-qs8cs"
Jul 18 11:20:17.512409 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:17.511840    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/e0a05104-9f66-40b5-8d49-2bf876d64b5c-snapshots\") pod \"insights-operator-555d9d7885-qs8cs\" (UID: \"e0a05104-9f66-40b5-8d49-2bf876d64b5c\") " pod="openshift-insights/insights-operator-555d9d7885-qs8cs"
Jul 18 11:20:17.512409 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:17.512052    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e0a05104-9f66-40b5-8d49-2bf876d64b5c-service-ca-bundle\") pod \"insights-operator-555d9d7885-qs8cs\" (UID: \"e0a05104-9f66-40b5-8d49-2bf876d64b5c\") " pod="openshift-insights/insights-operator-555d9d7885-qs8cs"
Jul 18 11:20:17.512409 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:17.512133    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e0a05104-9f66-40b5-8d49-2bf876d64b5c-trusted-ca-bundle\") pod \"insights-operator-555d9d7885-qs8cs\" (UID: \"e0a05104-9f66-40b5-8d49-2bf876d64b5c\") " pod="openshift-insights/insights-operator-555d9d7885-qs8cs"
Jul 18 11:20:17.513587 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:17.513557    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e0a05104-9f66-40b5-8d49-2bf876d64b5c-serving-cert\") pod \"insights-operator-555d9d7885-qs8cs\" (UID: \"e0a05104-9f66-40b5-8d49-2bf876d64b5c\") " pod="openshift-insights/insights-operator-555d9d7885-qs8cs"
Jul 18 11:20:17.514288 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:17.514265    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/446260ea-ffd2-4b81-8455-4d2052b97c2a-cert\") pod \"ingress-canary-ljssw\" (UID: \"446260ea-ffd2-4b81-8455-4d2052b97c2a\") " pod="openshift-ingress-canary/ingress-canary-ljssw"
Jul 18 11:20:17.517873 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:17.517851    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-565b7b569d-jfpn7"
Jul 18 11:20:17.526384 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:17.526363    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nvnlg\" (UniqueName: \"kubernetes.io/projected/e0a05104-9f66-40b5-8d49-2bf876d64b5c-kube-api-access-nvnlg\") pod \"insights-operator-555d9d7885-qs8cs\" (UID: \"e0a05104-9f66-40b5-8d49-2bf876d64b5c\") " pod="openshift-insights/insights-operator-555d9d7885-qs8cs"
Jul 18 11:20:17.526477 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:17.526423    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sm7mm\" (UniqueName: \"kubernetes.io/projected/446260ea-ffd2-4b81-8455-4d2052b97c2a-kube-api-access-sm7mm\") pod \"ingress-canary-ljssw\" (UID: \"446260ea-ffd2-4b81-8455-4d2052b97c2a\") " pod="openshift-ingress-canary/ingress-canary-ljssw"
Jul 18 11:20:17.544494 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:17.544459    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-p7shj"
Jul 18 11:20:17.558701 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:17.558680    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-g8g4r"
Jul 18 11:20:17.580877 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:17.580846    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-jz6m4"
Jul 18 11:20:17.587765 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:17.587744    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-ljssw"
Jul 18 11:20:17.608860 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:17.608822    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-555d9d7885-qs8cs"
Jul 18 11:20:17.916177 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:17.916140    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/067c96d7-6025-43a0-872a-9134f16c8221-metrics-certs\") pod \"router-default-64cdb59cb-q4c6l\" (UID: \"067c96d7-6025-43a0-872a-9134f16c8221\") " pod="openshift-ingress/router-default-64cdb59cb-q4c6l"
Jul 18 11:20:17.916177 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:17.916184    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/37a0a359-1903-477c-8f8a-80712275ad64-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-2ls6p\" (UID: \"37a0a359-1903-477c-8f8a-80712275ad64\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-2ls6p"
Jul 18 11:20:17.916924 ip-10-0-133-122 kubenswrapper[2579]: E0718 11:20:17.916289    2579 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 18 11:20:17.916924 ip-10-0-133-122 kubenswrapper[2579]: E0718 11:20:17.916305    2579 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 18 11:20:17.916924 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:17.916329    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/099bdb04-cb99-4be4-8f98-76ed8839204e-registry-tls\") pod \"image-registry-594b7ddb68-98wbn\" (UID: \"099bdb04-cb99-4be4-8f98-76ed8839204e\") " pod="openshift-image-registry/image-registry-594b7ddb68-98wbn"
Jul 18 11:20:17.916924 ip-10-0-133-122 kubenswrapper[2579]: E0718 11:20:17.916343    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/37a0a359-1903-477c-8f8a-80712275ad64-samples-operator-tls podName:37a0a359-1903-477c-8f8a-80712275ad64 nodeName:}" failed. No retries permitted until 2026-07-18 11:20:18.916329902 +0000 UTC m=+38.531366181 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/37a0a359-1903-477c-8f8a-80712275ad64-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-2ls6p" (UID: "37a0a359-1903-477c-8f8a-80712275ad64") : secret "samples-operator-tls" not found
Jul 18 11:20:17.916924 ip-10-0-133-122 kubenswrapper[2579]: E0718 11:20:17.916379    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/067c96d7-6025-43a0-872a-9134f16c8221-metrics-certs podName:067c96d7-6025-43a0-872a-9134f16c8221 nodeName:}" failed. No retries permitted until 2026-07-18 11:20:18.916360428 +0000 UTC m=+38.531396715 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/067c96d7-6025-43a0-872a-9134f16c8221-metrics-certs") pod "router-default-64cdb59cb-q4c6l" (UID: "067c96d7-6025-43a0-872a-9134f16c8221") : secret "router-metrics-certs-default" not found
Jul 18 11:20:17.916924 ip-10-0-133-122 kubenswrapper[2579]: E0718 11:20:17.916413    2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 18 11:20:17.916924 ip-10-0-133-122 kubenswrapper[2579]: E0718 11:20:17.916425    2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-594b7ddb68-98wbn: secret "image-registry-tls" not found
Jul 18 11:20:17.916924 ip-10-0-133-122 kubenswrapper[2579]: E0718 11:20:17.916461    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/099bdb04-cb99-4be4-8f98-76ed8839204e-registry-tls podName:099bdb04-cb99-4be4-8f98-76ed8839204e nodeName:}" failed. No retries permitted until 2026-07-18 11:20:18.916446266 +0000 UTC m=+38.531482551 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/099bdb04-cb99-4be4-8f98-76ed8839204e-registry-tls") pod "image-registry-594b7ddb68-98wbn" (UID: "099bdb04-cb99-4be4-8f98-76ed8839204e") : secret "image-registry-tls" not found
Jul 18 11:20:17.916924 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:17.916409    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/f4e046d0-f0d1-453c-8729-b2191f050b73-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-fzxs7\" (UID: \"f4e046d0-f0d1-453c-8729-b2191f050b73\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-fzxs7"
Jul 18 11:20:17.916924 ip-10-0-133-122 kubenswrapper[2579]: E0718 11:20:17.916471    2579 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 18 11:20:17.916924 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:17.916584    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/067c96d7-6025-43a0-872a-9134f16c8221-service-ca-bundle\") pod \"router-default-64cdb59cb-q4c6l\" (UID: \"067c96d7-6025-43a0-872a-9134f16c8221\") " pod="openshift-ingress/router-default-64cdb59cb-q4c6l"
Jul 18 11:20:17.916924 ip-10-0-133-122 kubenswrapper[2579]: E0718 11:20:17.916605    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f4e046d0-f0d1-453c-8729-b2191f050b73-cluster-monitoring-operator-tls podName:f4e046d0-f0d1-453c-8729-b2191f050b73 nodeName:}" failed. No retries permitted until 2026-07-18 11:20:18.916591863 +0000 UTC m=+38.531628148 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/f4e046d0-f0d1-453c-8729-b2191f050b73-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-fzxs7" (UID: "f4e046d0-f0d1-453c-8729-b2191f050b73") : secret "cluster-monitoring-operator-tls" not found
Jul 18 11:20:17.916924 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:17.916639    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/57dfdac3-878d-43df-84ab-0996f5fba323-metrics-tls\") pod \"dns-default-kv2jv\" (UID: \"57dfdac3-878d-43df-84ab-0996f5fba323\") " pod="openshift-dns/dns-default-kv2jv"
Jul 18 11:20:17.916924 ip-10-0-133-122 kubenswrapper[2579]: E0718 11:20:17.916664    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/067c96d7-6025-43a0-872a-9134f16c8221-service-ca-bundle podName:067c96d7-6025-43a0-872a-9134f16c8221 nodeName:}" failed. No retries permitted until 2026-07-18 11:20:18.916651833 +0000 UTC m=+38.531688114 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/067c96d7-6025-43a0-872a-9134f16c8221-service-ca-bundle") pod "router-default-64cdb59cb-q4c6l" (UID: "067c96d7-6025-43a0-872a-9134f16c8221") : configmap references non-existent config key: service-ca.crt
Jul 18 11:20:17.916924 ip-10-0-133-122 kubenswrapper[2579]: E0718 11:20:17.916711    2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 18 11:20:17.917413 ip-10-0-133-122 kubenswrapper[2579]: E0718 11:20:17.916745    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/57dfdac3-878d-43df-84ab-0996f5fba323-metrics-tls podName:57dfdac3-878d-43df-84ab-0996f5fba323 nodeName:}" failed. No retries permitted until 2026-07-18 11:20:18.916737417 +0000 UTC m=+38.531773700 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/57dfdac3-878d-43df-84ab-0996f5fba323-metrics-tls") pod "dns-default-kv2jv" (UID: "57dfdac3-878d-43df-84ab-0996f5fba323") : secret "dns-default-metrics-tls" not found
Jul 18 11:20:18.018153 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:18.018121    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/63d7c8c7-1716-489e-8698-e49c93a85050-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-v6n2x\" (UID: \"63d7c8c7-1716-489e-8698-e49c93a85050\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-v6n2x"
Jul 18 11:20:18.018327 ip-10-0-133-122 kubenswrapper[2579]: E0718 11:20:18.018277    2579 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 18 11:20:18.018375 ip-10-0-133-122 kubenswrapper[2579]: E0718 11:20:18.018352    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/63d7c8c7-1716-489e-8698-e49c93a85050-networking-console-plugin-cert podName:63d7c8c7-1716-489e-8698-e49c93a85050 nodeName:}" failed. No retries permitted until 2026-07-18 11:20:19.018336204 +0000 UTC m=+38.633372484 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/63d7c8c7-1716-489e-8698-e49c93a85050-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-v6n2x" (UID: "63d7c8c7-1716-489e-8698-e49c93a85050") : secret "networking-console-plugin-cert" not found
Jul 18 11:20:18.892146 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:18.889726    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cj4nh"
Jul 18 11:20:18.892146 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:18.890193    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ljhk6"
Jul 18 11:20:18.900155 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:18.898048    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-s78sq\""
Jul 18 11:20:18.900155 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:18.898333    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 18 11:20:18.900155 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:18.898540    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-b49zp\""
Jul 18 11:20:18.904566 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:18.903507    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6j4vg"
Jul 18 11:20:18.906651 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:18.906631    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 18 11:20:18.933320 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:18.932166    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/57dfdac3-878d-43df-84ab-0996f5fba323-metrics-tls\") pod \"dns-default-kv2jv\" (UID: \"57dfdac3-878d-43df-84ab-0996f5fba323\") " pod="openshift-dns/dns-default-kv2jv"
Jul 18 11:20:18.933320 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:18.932247    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/067c96d7-6025-43a0-872a-9134f16c8221-metrics-certs\") pod \"router-default-64cdb59cb-q4c6l\" (UID: \"067c96d7-6025-43a0-872a-9134f16c8221\") " pod="openshift-ingress/router-default-64cdb59cb-q4c6l"
Jul 18 11:20:18.933320 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:18.932288    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/37a0a359-1903-477c-8f8a-80712275ad64-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-2ls6p\" (UID: \"37a0a359-1903-477c-8f8a-80712275ad64\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-2ls6p"
Jul 18 11:20:18.933320 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:18.932335    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/099bdb04-cb99-4be4-8f98-76ed8839204e-registry-tls\") pod \"image-registry-594b7ddb68-98wbn\" (UID: \"099bdb04-cb99-4be4-8f98-76ed8839204e\") " pod="openshift-image-registry/image-registry-594b7ddb68-98wbn"
Jul 18 11:20:18.933320 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:18.932362    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/f4e046d0-f0d1-453c-8729-b2191f050b73-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-fzxs7\" (UID: \"f4e046d0-f0d1-453c-8729-b2191f050b73\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-fzxs7"
Jul 18 11:20:18.933320 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:18.932442    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/067c96d7-6025-43a0-872a-9134f16c8221-service-ca-bundle\") pod \"router-default-64cdb59cb-q4c6l\" (UID: \"067c96d7-6025-43a0-872a-9134f16c8221\") " pod="openshift-ingress/router-default-64cdb59cb-q4c6l"
Jul 18 11:20:18.933320 ip-10-0-133-122 kubenswrapper[2579]: E0718 11:20:18.932570    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/067c96d7-6025-43a0-872a-9134f16c8221-service-ca-bundle podName:067c96d7-6025-43a0-872a-9134f16c8221 nodeName:}" failed. No retries permitted until 2026-07-18 11:20:20.932552169 +0000 UTC m=+40.547588450 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/067c96d7-6025-43a0-872a-9134f16c8221-service-ca-bundle") pod "router-default-64cdb59cb-q4c6l" (UID: "067c96d7-6025-43a0-872a-9134f16c8221") : configmap references non-existent config key: service-ca.crt
Jul 18 11:20:18.933320 ip-10-0-133-122 kubenswrapper[2579]: E0718 11:20:18.932804    2579 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 18 11:20:18.933320 ip-10-0-133-122 kubenswrapper[2579]: E0718 11:20:18.932863    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/37a0a359-1903-477c-8f8a-80712275ad64-samples-operator-tls podName:37a0a359-1903-477c-8f8a-80712275ad64 nodeName:}" failed. No retries permitted until 2026-07-18 11:20:20.932845963 +0000 UTC m=+40.547882257 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/37a0a359-1903-477c-8f8a-80712275ad64-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-2ls6p" (UID: "37a0a359-1903-477c-8f8a-80712275ad64") : secret "samples-operator-tls" not found
Jul 18 11:20:18.933320 ip-10-0-133-122 kubenswrapper[2579]: E0718 11:20:18.932945    2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 18 11:20:18.933320 ip-10-0-133-122 kubenswrapper[2579]: E0718 11:20:18.932979    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/57dfdac3-878d-43df-84ab-0996f5fba323-metrics-tls podName:57dfdac3-878d-43df-84ab-0996f5fba323 nodeName:}" failed. No retries permitted until 2026-07-18 11:20:20.932967939 +0000 UTC m=+40.548004222 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/57dfdac3-878d-43df-84ab-0996f5fba323-metrics-tls") pod "dns-default-kv2jv" (UID: "57dfdac3-878d-43df-84ab-0996f5fba323") : secret "dns-default-metrics-tls" not found
Jul 18 11:20:18.933320 ip-10-0-133-122 kubenswrapper[2579]: E0718 11:20:18.933006    2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 18 11:20:18.933320 ip-10-0-133-122 kubenswrapper[2579]: E0718 11:20:18.933022    2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-594b7ddb68-98wbn: secret "image-registry-tls" not found
Jul 18 11:20:18.933320 ip-10-0-133-122 kubenswrapper[2579]: E0718 11:20:18.933033    2579 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 18 11:20:18.933320 ip-10-0-133-122 kubenswrapper[2579]: E0718 11:20:18.933068    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/099bdb04-cb99-4be4-8f98-76ed8839204e-registry-tls podName:099bdb04-cb99-4be4-8f98-76ed8839204e nodeName:}" failed. No retries permitted until 2026-07-18 11:20:20.933052814 +0000 UTC m=+40.548089112 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/099bdb04-cb99-4be4-8f98-76ed8839204e-registry-tls") pod "image-registry-594b7ddb68-98wbn" (UID: "099bdb04-cb99-4be4-8f98-76ed8839204e") : secret "image-registry-tls" not found
Jul 18 11:20:18.934975 ip-10-0-133-122 kubenswrapper[2579]: E0718 11:20:18.933084    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/067c96d7-6025-43a0-872a-9134f16c8221-metrics-certs podName:067c96d7-6025-43a0-872a-9134f16c8221 nodeName:}" failed. No retries permitted until 2026-07-18 11:20:20.933075713 +0000 UTC m=+40.548111993 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/067c96d7-6025-43a0-872a-9134f16c8221-metrics-certs") pod "router-default-64cdb59cb-q4c6l" (UID: "067c96d7-6025-43a0-872a-9134f16c8221") : secret "router-metrics-certs-default" not found
Jul 18 11:20:18.934975 ip-10-0-133-122 kubenswrapper[2579]: E0718 11:20:18.933110    2579 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 18 11:20:18.934975 ip-10-0-133-122 kubenswrapper[2579]: E0718 11:20:18.933143    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f4e046d0-f0d1-453c-8729-b2191f050b73-cluster-monitoring-operator-tls podName:f4e046d0-f0d1-453c-8729-b2191f050b73 nodeName:}" failed. No retries permitted until 2026-07-18 11:20:20.933131972 +0000 UTC m=+40.548168255 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/f4e046d0-f0d1-453c-8729-b2191f050b73-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-fzxs7" (UID: "f4e046d0-f0d1-453c-8729-b2191f050b73") : secret "cluster-monitoring-operator-tls" not found
Jul 18 11:20:18.962766 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:18.962735    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-565b7b569d-jfpn7"]
Jul 18 11:20:18.975245 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:18.975043    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7bc5b6bf85-jz6m4"]
Jul 18 11:20:18.984082 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:18.981133    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-ljssw"]
Jul 18 11:20:18.984082 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:18.982039    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-p7shj"]
Jul 18 11:20:18.984810 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:20:18.984509    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod446260ea_ffd2_4b81_8455_4d2052b97c2a.slice/crio-944059012fc53fc5b3f755045bc5f3c3567a6d76dfc6244bbc11855f0dda4417 WatchSource:0}: Error finding container 944059012fc53fc5b3f755045bc5f3c3567a6d76dfc6244bbc11855f0dda4417: Status 404 returned error can't find the container with id 944059012fc53fc5b3f755045bc5f3c3567a6d76dfc6244bbc11855f0dda4417
Jul 18 11:20:18.989983 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:18.989962    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-rtpfm"]
Jul 18 11:20:18.994354 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:20:18.994319    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1deb912b_fac4_4121_a030_3a5ae9700aa0.slice/crio-9f80e59278a34a048780e266582a665cb5df30bf44b93f644dda69f856ed73bd WatchSource:0}: Error finding container 9f80e59278a34a048780e266582a665cb5df30bf44b93f644dda69f856ed73bd: Status 404 returned error can't find the container with id 9f80e59278a34a048780e266582a665cb5df30bf44b93f644dda69f856ed73bd
Jul 18 11:20:19.001153 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:19.001128    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-555d9d7885-qs8cs"]
Jul 18 11:20:19.002716 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:19.002663    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5bcbc94c78-g8g4r"]
Jul 18 11:20:19.005457 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:20:19.005431    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode0a05104_9f66_40b5_8d49_2bf876d64b5c.slice/crio-665d242719b05d9c1e600cbe0aa61b79d88fe08742668e2932a5695c7dfc2455 WatchSource:0}: Error finding container 665d242719b05d9c1e600cbe0aa61b79d88fe08742668e2932a5695c7dfc2455: Status 404 returned error can't find the container with id 665d242719b05d9c1e600cbe0aa61b79d88fe08742668e2932a5695c7dfc2455
Jul 18 11:20:19.006694 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:20:19.006669    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod85567bae_b6fc_4bdd_8973_0bd705dc22f8.slice/crio-e4826ced6d876cd925e2c1163b42bf3e771e8bfbb54f7cf65fff7c24afc33713 WatchSource:0}: Error finding container e4826ced6d876cd925e2c1163b42bf3e771e8bfbb54f7cf65fff7c24afc33713: Status 404 returned error can't find the container with id e4826ced6d876cd925e2c1163b42bf3e771e8bfbb54f7cf65fff7c24afc33713
Jul 18 11:20:19.033578 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:19.033543    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/63d7c8c7-1716-489e-8698-e49c93a85050-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-v6n2x\" (UID: \"63d7c8c7-1716-489e-8698-e49c93a85050\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-v6n2x"
Jul 18 11:20:19.033752 ip-10-0-133-122 kubenswrapper[2579]: E0718 11:20:19.033728    2579 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 18 11:20:19.033826 ip-10-0-133-122 kubenswrapper[2579]: E0718 11:20:19.033817    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/63d7c8c7-1716-489e-8698-e49c93a85050-networking-console-plugin-cert podName:63d7c8c7-1716-489e-8698-e49c93a85050 nodeName:}" failed. No retries permitted until 2026-07-18 11:20:21.033793809 +0000 UTC m=+40.648830110 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/63d7c8c7-1716-489e-8698-e49c93a85050-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-v6n2x" (UID: "63d7c8c7-1716-489e-8698-e49c93a85050") : secret "networking-console-plugin-cert" not found
Jul 18 11:20:19.172933 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:19.172876    2579 generic.go:356] "Generic (PLEG): container finished" podID="49f40ae2-d33c-4284-a889-0d9b27421bf4" containerID="27df60899a26a149c5f06b3983f121eef86de1384abe17da9bfda271a53134b8" exitCode=0
Jul 18 11:20:19.173086 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:19.172928    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lmf4l" event={"ID":"49f40ae2-d33c-4284-a889-0d9b27421bf4","Type":"ContainerDied","Data":"27df60899a26a149c5f06b3983f121eef86de1384abe17da9bfda271a53134b8"}
Jul 18 11:20:19.174276 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:19.174252    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-ljssw" event={"ID":"446260ea-ffd2-4b81-8455-4d2052b97c2a","Type":"ContainerStarted","Data":"944059012fc53fc5b3f755045bc5f3c3567a6d76dfc6244bbc11855f0dda4417"}
Jul 18 11:20:19.175512 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:19.175485    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-rtpfm" event={"ID":"1deb912b-fac4-4121-a030-3a5ae9700aa0","Type":"ContainerStarted","Data":"9f80e59278a34a048780e266582a665cb5df30bf44b93f644dda69f856ed73bd"}
Jul 18 11:20:19.176847 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:19.176821    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-jz6m4" event={"ID":"1319723f-4179-4040-b746-8fde76308444","Type":"ContainerStarted","Data":"d6238a16d2fdaef81c4ac3efe31683df74f7b54229a09eb885d345ced4f69ea0"}
Jul 18 11:20:19.178118 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:19.178092    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-g8g4r" event={"ID":"85567bae-b6fc-4bdd-8973-0bd705dc22f8","Type":"ContainerStarted","Data":"e4826ced6d876cd925e2c1163b42bf3e771e8bfbb54f7cf65fff7c24afc33713"}
Jul 18 11:20:19.179223 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:19.179203    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-p7shj" event={"ID":"e6cc6097-8792-4b98-ab5f-085dac6a9dc7","Type":"ContainerStarted","Data":"9d2b2ed39334bb147b7d8a7f1912daf6c652d74cb4f4d591b01d2d6467e080a3"}
Jul 18 11:20:19.180366 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:19.180339    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-jfpn7" event={"ID":"759a894c-1828-4ac9-a7c3-77354a104247","Type":"ContainerStarted","Data":"b440b2315cc1a517a1856613611c63927f1d464e1552c4e3563f8b51098c09ea"}
Jul 18 11:20:19.181527 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:19.181505    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-555d9d7885-qs8cs" event={"ID":"e0a05104-9f66-40b5-8d49-2bf876d64b5c","Type":"ContainerStarted","Data":"665d242719b05d9c1e600cbe0aa61b79d88fe08742668e2932a5695c7dfc2455"}
Jul 18 11:20:20.194692 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:20.194444    2579 generic.go:356] "Generic (PLEG): container finished" podID="49f40ae2-d33c-4284-a889-0d9b27421bf4" containerID="5fc237c7fbc248e32d666ee75d6c248d6a0a38a96dfe93ff5080e972cab358ff" exitCode=0
Jul 18 11:20:20.195158 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:20.194748    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lmf4l" event={"ID":"49f40ae2-d33c-4284-a889-0d9b27421bf4","Type":"ContainerDied","Data":"5fc237c7fbc248e32d666ee75d6c248d6a0a38a96dfe93ff5080e972cab358ff"}
Jul 18 11:20:20.450466 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:20.450342    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnt7j_e0f67788-e972-49ff-b611-b9835f528d81/konnectivity-agent/0.log" limit=1024
Jul 18 11:20:20.505640 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:20.505456    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnt7j_e0f67788-e972-49ff-b611-b9835f528d81/konnectivity-agent/0.log" limit=1024
Jul 18 11:20:20.957765 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:20.957731    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/067c96d7-6025-43a0-872a-9134f16c8221-service-ca-bundle\") pod \"router-default-64cdb59cb-q4c6l\" (UID: \"067c96d7-6025-43a0-872a-9134f16c8221\") " pod="openshift-ingress/router-default-64cdb59cb-q4c6l"
Jul 18 11:20:20.958170 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:20.958147    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/57dfdac3-878d-43df-84ab-0996f5fba323-metrics-tls\") pod \"dns-default-kv2jv\" (UID: \"57dfdac3-878d-43df-84ab-0996f5fba323\") " pod="openshift-dns/dns-default-kv2jv"
Jul 18 11:20:20.958385 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:20.958367    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/067c96d7-6025-43a0-872a-9134f16c8221-metrics-certs\") pod \"router-default-64cdb59cb-q4c6l\" (UID: \"067c96d7-6025-43a0-872a-9134f16c8221\") " pod="openshift-ingress/router-default-64cdb59cb-q4c6l"
Jul 18 11:20:20.958545 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:20.958528    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/37a0a359-1903-477c-8f8a-80712275ad64-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-2ls6p\" (UID: \"37a0a359-1903-477c-8f8a-80712275ad64\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-2ls6p"
Jul 18 11:20:20.958975 ip-10-0-133-122 kubenswrapper[2579]: E0718 11:20:20.958792    2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 18 11:20:20.959175 ip-10-0-133-122 kubenswrapper[2579]: E0718 11:20:20.959137    2579 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 18 11:20:20.959287 ip-10-0-133-122 kubenswrapper[2579]: E0718 11:20:20.959271    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/37a0a359-1903-477c-8f8a-80712275ad64-samples-operator-tls podName:37a0a359-1903-477c-8f8a-80712275ad64 nodeName:}" failed. No retries permitted until 2026-07-18 11:20:24.959229061 +0000 UTC m=+44.574265348 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/37a0a359-1903-477c-8f8a-80712275ad64-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-2ls6p" (UID: "37a0a359-1903-477c-8f8a-80712275ad64") : secret "samples-operator-tls" not found
Jul 18 11:20:20.959464 ip-10-0-133-122 kubenswrapper[2579]: E0718 11:20:20.959448    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/57dfdac3-878d-43df-84ab-0996f5fba323-metrics-tls podName:57dfdac3-878d-43df-84ab-0996f5fba323 nodeName:}" failed. No retries permitted until 2026-07-18 11:20:24.9594018 +0000 UTC m=+44.574438087 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/57dfdac3-878d-43df-84ab-0996f5fba323-metrics-tls") pod "dns-default-kv2jv" (UID: "57dfdac3-878d-43df-84ab-0996f5fba323") : secret "dns-default-metrics-tls" not found
Jul 18 11:20:20.960257 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:20.960237    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/099bdb04-cb99-4be4-8f98-76ed8839204e-registry-tls\") pod \"image-registry-594b7ddb68-98wbn\" (UID: \"099bdb04-cb99-4be4-8f98-76ed8839204e\") " pod="openshift-image-registry/image-registry-594b7ddb68-98wbn"
Jul 18 11:20:20.960424 ip-10-0-133-122 kubenswrapper[2579]: E0718 11:20:20.960192    2579 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 18 11:20:20.960610 ip-10-0-133-122 kubenswrapper[2579]: E0718 11:20:20.960597    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/067c96d7-6025-43a0-872a-9134f16c8221-metrics-certs podName:067c96d7-6025-43a0-872a-9134f16c8221 nodeName:}" failed. No retries permitted until 2026-07-18 11:20:24.960549699 +0000 UTC m=+44.575585982 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/067c96d7-6025-43a0-872a-9134f16c8221-metrics-certs") pod "router-default-64cdb59cb-q4c6l" (UID: "067c96d7-6025-43a0-872a-9134f16c8221") : secret "router-metrics-certs-default" not found
Jul 18 11:20:20.960836 ip-10-0-133-122 kubenswrapper[2579]: E0718 11:20:20.960791    2579 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 18 11:20:20.961016 ip-10-0-133-122 kubenswrapper[2579]: E0718 11:20:20.961003    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f4e046d0-f0d1-453c-8729-b2191f050b73-cluster-monitoring-operator-tls podName:f4e046d0-f0d1-453c-8729-b2191f050b73 nodeName:}" failed. No retries permitted until 2026-07-18 11:20:24.960980271 +0000 UTC m=+44.576016550 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/f4e046d0-f0d1-453c-8729-b2191f050b73-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-fzxs7" (UID: "f4e046d0-f0d1-453c-8729-b2191f050b73") : secret "cluster-monitoring-operator-tls" not found
Jul 18 11:20:20.961257 ip-10-0-133-122 kubenswrapper[2579]: E0718 11:20:20.960390    2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 18 11:20:20.961257 ip-10-0-133-122 kubenswrapper[2579]: E0718 11:20:20.961174    2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-594b7ddb68-98wbn: secret "image-registry-tls" not found
Jul 18 11:20:20.961257 ip-10-0-133-122 kubenswrapper[2579]: E0718 11:20:20.961225    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/099bdb04-cb99-4be4-8f98-76ed8839204e-registry-tls podName:099bdb04-cb99-4be4-8f98-76ed8839204e nodeName:}" failed. No retries permitted until 2026-07-18 11:20:24.961202994 +0000 UTC m=+44.576239290 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/099bdb04-cb99-4be4-8f98-76ed8839204e-registry-tls") pod "image-registry-594b7ddb68-98wbn" (UID: "099bdb04-cb99-4be4-8f98-76ed8839204e") : secret "image-registry-tls" not found
Jul 18 11:20:20.961511 ip-10-0-133-122 kubenswrapper[2579]: E0718 11:20:20.961493    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/067c96d7-6025-43a0-872a-9134f16c8221-service-ca-bundle podName:067c96d7-6025-43a0-872a-9134f16c8221 nodeName:}" failed. No retries permitted until 2026-07-18 11:20:24.961473618 +0000 UTC m=+44.576509920 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/067c96d7-6025-43a0-872a-9134f16c8221-service-ca-bundle") pod "router-default-64cdb59cb-q4c6l" (UID: "067c96d7-6025-43a0-872a-9134f16c8221") : configmap references non-existent config key: service-ca.crt
Jul 18 11:20:20.961633 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:20.960442    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/f4e046d0-f0d1-453c-8729-b2191f050b73-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-fzxs7\" (UID: \"f4e046d0-f0d1-453c-8729-b2191f050b73\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-fzxs7"
Jul 18 11:20:21.062959 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:21.062916    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/63d7c8c7-1716-489e-8698-e49c93a85050-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-v6n2x\" (UID: \"63d7c8c7-1716-489e-8698-e49c93a85050\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-v6n2x"
Jul 18 11:20:21.063227 ip-10-0-133-122 kubenswrapper[2579]: E0718 11:20:21.063207    2579 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 18 11:20:21.063396 ip-10-0-133-122 kubenswrapper[2579]: E0718 11:20:21.063381    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/63d7c8c7-1716-489e-8698-e49c93a85050-networking-console-plugin-cert podName:63d7c8c7-1716-489e-8698-e49c93a85050 nodeName:}" failed. No retries permitted until 2026-07-18 11:20:25.063343757 +0000 UTC m=+44.678380039 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/63d7c8c7-1716-489e-8698-e49c93a85050-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-v6n2x" (UID: "63d7c8c7-1716-489e-8698-e49c93a85050") : secret "networking-console-plugin-cert" not found
Jul 18 11:20:21.203860 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:21.202978    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lmf4l" event={"ID":"49f40ae2-d33c-4284-a889-0d9b27421bf4","Type":"ContainerStarted","Data":"22e2b5843bd21ce6e7402e42b38dd12e9cd532b531d901375c3d283e1dbf55ef"}
Jul 18 11:20:21.233313 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:21.233228    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnt7j_e0f67788-e972-49ff-b611-b9835f528d81/konnectivity-agent/0.log" limit=1024
Jul 18 11:20:21.286742 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:21.286683    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnt7j_e0f67788-e972-49ff-b611-b9835f528d81/konnectivity-agent/0.log" limit=1024
Jul 18 11:20:21.387906 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:21.387840    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnt7j_e0f67788-e972-49ff-b611-b9835f528d81/konnectivity-agent/0.log" limit=1024
Jul 18 11:20:21.442946 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:21.442915    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnt7j_e0f67788-e972-49ff-b611-b9835f528d81/konnectivity-agent/0.log" limit=1024
Jul 18 11:20:22.229664 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:22.229629    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnt7j_e0f67788-e972-49ff-b611-b9835f528d81/konnectivity-agent/0.log" limit=1024
Jul 18 11:20:22.596131 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:22.596096    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnt7j_e0f67788-e972-49ff-b611-b9835f528d81/konnectivity-agent/0.log" limit=1024
Jul 18 11:20:22.648144 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:22.648110    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnt7j_e0f67788-e972-49ff-b611-b9835f528d81/konnectivity-agent/0.log" limit=1024
Jul 18 11:20:23.174426 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:23.174392    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnt7j_e0f67788-e972-49ff-b611-b9835f528d81/konnectivity-agent/0.log" limit=1024
Jul 18 11:20:23.383757 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:23.383722    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnt7j_e0f67788-e972-49ff-b611-b9835f528d81/konnectivity-agent/0.log" limit=1024
Jul 18 11:20:23.441288 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:23.441208    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnt7j_e0f67788-e972-49ff-b611-b9835f528d81/konnectivity-agent/0.log" limit=1024
Jul 18 11:20:24.996155 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:24.996114    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/067c96d7-6025-43a0-872a-9134f16c8221-service-ca-bundle\") pod \"router-default-64cdb59cb-q4c6l\" (UID: \"067c96d7-6025-43a0-872a-9134f16c8221\") " pod="openshift-ingress/router-default-64cdb59cb-q4c6l"
Jul 18 11:20:24.996155 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:24.996163    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/57dfdac3-878d-43df-84ab-0996f5fba323-metrics-tls\") pod \"dns-default-kv2jv\" (UID: \"57dfdac3-878d-43df-84ab-0996f5fba323\") " pod="openshift-dns/dns-default-kv2jv"
Jul 18 11:20:24.996698 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:24.996225    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/067c96d7-6025-43a0-872a-9134f16c8221-metrics-certs\") pod \"router-default-64cdb59cb-q4c6l\" (UID: \"067c96d7-6025-43a0-872a-9134f16c8221\") " pod="openshift-ingress/router-default-64cdb59cb-q4c6l"
Jul 18 11:20:24.996698 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:24.996265    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/37a0a359-1903-477c-8f8a-80712275ad64-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-2ls6p\" (UID: \"37a0a359-1903-477c-8f8a-80712275ad64\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-2ls6p"
Jul 18 11:20:24.996698 ip-10-0-133-122 kubenswrapper[2579]: E0718 11:20:24.996325    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/067c96d7-6025-43a0-872a-9134f16c8221-service-ca-bundle podName:067c96d7-6025-43a0-872a-9134f16c8221 nodeName:}" failed. No retries permitted until 2026-07-18 11:20:32.996304275 +0000 UTC m=+52.611340555 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/067c96d7-6025-43a0-872a-9134f16c8221-service-ca-bundle") pod "router-default-64cdb59cb-q4c6l" (UID: "067c96d7-6025-43a0-872a-9134f16c8221") : configmap references non-existent config key: service-ca.crt
Jul 18 11:20:24.996698 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:24.996357    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/099bdb04-cb99-4be4-8f98-76ed8839204e-registry-tls\") pod \"image-registry-594b7ddb68-98wbn\" (UID: \"099bdb04-cb99-4be4-8f98-76ed8839204e\") " pod="openshift-image-registry/image-registry-594b7ddb68-98wbn"
Jul 18 11:20:24.996698 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:24.996394    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/f4e046d0-f0d1-453c-8729-b2191f050b73-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-fzxs7\" (UID: \"f4e046d0-f0d1-453c-8729-b2191f050b73\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-fzxs7"
Jul 18 11:20:24.996698 ip-10-0-133-122 kubenswrapper[2579]: E0718 11:20:24.996360    2579 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 18 11:20:24.996698 ip-10-0-133-122 kubenswrapper[2579]: E0718 11:20:24.996484    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/37a0a359-1903-477c-8f8a-80712275ad64-samples-operator-tls podName:37a0a359-1903-477c-8f8a-80712275ad64 nodeName:}" failed. No retries permitted until 2026-07-18 11:20:32.996467533 +0000 UTC m=+52.611503818 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/37a0a359-1903-477c-8f8a-80712275ad64-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-2ls6p" (UID: "37a0a359-1903-477c-8f8a-80712275ad64") : secret "samples-operator-tls" not found
Jul 18 11:20:24.996698 ip-10-0-133-122 kubenswrapper[2579]: E0718 11:20:24.996360    2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 18 11:20:24.996698 ip-10-0-133-122 kubenswrapper[2579]: E0718 11:20:24.996532    2579 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 18 11:20:24.996698 ip-10-0-133-122 kubenswrapper[2579]: E0718 11:20:24.996370    2579 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 18 11:20:24.996698 ip-10-0-133-122 kubenswrapper[2579]: E0718 11:20:24.996406    2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 18 11:20:24.996698 ip-10-0-133-122 kubenswrapper[2579]: E0718 11:20:24.996572    2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-594b7ddb68-98wbn: secret "image-registry-tls" not found
Jul 18 11:20:24.996698 ip-10-0-133-122 kubenswrapper[2579]: E0718 11:20:24.996537    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/57dfdac3-878d-43df-84ab-0996f5fba323-metrics-tls podName:57dfdac3-878d-43df-84ab-0996f5fba323 nodeName:}" failed. No retries permitted until 2026-07-18 11:20:32.996528654 +0000 UTC m=+52.611564934 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/57dfdac3-878d-43df-84ab-0996f5fba323-metrics-tls") pod "dns-default-kv2jv" (UID: "57dfdac3-878d-43df-84ab-0996f5fba323") : secret "dns-default-metrics-tls" not found
Jul 18 11:20:24.996698 ip-10-0-133-122 kubenswrapper[2579]: E0718 11:20:24.996612    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f4e046d0-f0d1-453c-8729-b2191f050b73-cluster-monitoring-operator-tls podName:f4e046d0-f0d1-453c-8729-b2191f050b73 nodeName:}" failed. No retries permitted until 2026-07-18 11:20:32.996602161 +0000 UTC m=+52.611638444 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/f4e046d0-f0d1-453c-8729-b2191f050b73-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-fzxs7" (UID: "f4e046d0-f0d1-453c-8729-b2191f050b73") : secret "cluster-monitoring-operator-tls" not found
Jul 18 11:20:24.996698 ip-10-0-133-122 kubenswrapper[2579]: E0718 11:20:24.996624    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/067c96d7-6025-43a0-872a-9134f16c8221-metrics-certs podName:067c96d7-6025-43a0-872a-9134f16c8221 nodeName:}" failed. No retries permitted until 2026-07-18 11:20:32.996617654 +0000 UTC m=+52.611653933 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/067c96d7-6025-43a0-872a-9134f16c8221-metrics-certs") pod "router-default-64cdb59cb-q4c6l" (UID: "067c96d7-6025-43a0-872a-9134f16c8221") : secret "router-metrics-certs-default" not found
Jul 18 11:20:24.997283 ip-10-0-133-122 kubenswrapper[2579]: E0718 11:20:24.996636    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/099bdb04-cb99-4be4-8f98-76ed8839204e-registry-tls podName:099bdb04-cb99-4be4-8f98-76ed8839204e nodeName:}" failed. No retries permitted until 2026-07-18 11:20:32.996629463 +0000 UTC m=+52.611665743 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/099bdb04-cb99-4be4-8f98-76ed8839204e-registry-tls") pod "image-registry-594b7ddb68-98wbn" (UID: "099bdb04-cb99-4be4-8f98-76ed8839204e") : secret "image-registry-tls" not found
Jul 18 11:20:25.097583 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:25.097548    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/63d7c8c7-1716-489e-8698-e49c93a85050-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-v6n2x\" (UID: \"63d7c8c7-1716-489e-8698-e49c93a85050\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-v6n2x"
Jul 18 11:20:25.097744 ip-10-0-133-122 kubenswrapper[2579]: E0718 11:20:25.097708    2579 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 18 11:20:25.097802 ip-10-0-133-122 kubenswrapper[2579]: E0718 11:20:25.097791    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/63d7c8c7-1716-489e-8698-e49c93a85050-networking-console-plugin-cert podName:63d7c8c7-1716-489e-8698-e49c93a85050 nodeName:}" failed. No retries permitted until 2026-07-18 11:20:33.097773841 +0000 UTC m=+52.712810120 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/63d7c8c7-1716-489e-8698-e49c93a85050-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-v6n2x" (UID: "63d7c8c7-1716-489e-8698-e49c93a85050") : secret "networking-console-plugin-cert" not found
Jul 18 11:20:26.602989 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:26.602956    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnt7j_e0f67788-e972-49ff-b611-b9835f528d81/konnectivity-agent/0.log" limit=1024
Jul 18 11:20:26.707805 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:26.707771    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnt7j_e0f67788-e972-49ff-b611-b9835f528d81/konnectivity-agent/0.log" limit=1024
Jul 18 11:20:27.055333 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:27.055273    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-lmf4l" podStartSLOduration=14.724416402 podStartE2EDuration="46.055250121s" totalImagesPullingTime="31.330833719s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-18 11:19:41 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 11:20:21.22997318 +0000 UTC m=+40.845009490" watchObservedRunningTime="2026-07-18 11:20:27.055250121 +0000 UTC m=+46.670286423"
Jul 18 11:20:27.056492 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:27.056468    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-5769ff544c-wmjqn"]
Jul 18 11:20:27.086450 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:27.086355    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6948895d4d-htfwq"]
Jul 18 11:20:27.086575 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:27.086503    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5769ff544c-wmjqn"
Jul 18 11:20:27.089298 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:27.089262    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\""
Jul 18 11:20:27.089416 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:27.089326    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 18 11:20:27.089482 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:27.089262    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 18 11:20:27.090337 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:27.090152    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 18 11:20:27.105585 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:27.105542    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-5769ff544c-wmjqn"]
Jul 18 11:20:27.105705 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:27.105621    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6948895d4d-htfwq"]
Jul 18 11:20:27.105705 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:27.105642    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-69d69956f7-lpbnb"]
Jul 18 11:20:27.107863 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:27.107826    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6948895d4d-htfwq"
Jul 18 11:20:27.112279 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:27.112253    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-7smrh\""
Jul 18 11:20:27.112573 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:27.112556    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\""
Jul 18 11:20:27.119723 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:27.118999    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/a252d7fc-6695-42c5-b9c3-a02dc7104cfd-klusterlet-config\") pod \"klusterlet-addon-workmgr-5769ff544c-wmjqn\" (UID: \"a252d7fc-6695-42c5-b9c3-a02dc7104cfd\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5769ff544c-wmjqn"
Jul 18 11:20:27.119723 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:27.119075    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2xp5k\" (UniqueName: \"kubernetes.io/projected/a252d7fc-6695-42c5-b9c3-a02dc7104cfd-kube-api-access-2xp5k\") pod \"klusterlet-addon-workmgr-5769ff544c-wmjqn\" (UID: \"a252d7fc-6695-42c5-b9c3-a02dc7104cfd\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5769ff544c-wmjqn"
Jul 18 11:20:27.119723 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:27.119122    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a252d7fc-6695-42c5-b9c3-a02dc7104cfd-tmp\") pod \"klusterlet-addon-workmgr-5769ff544c-wmjqn\" (UID: \"a252d7fc-6695-42c5-b9c3-a02dc7104cfd\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5769ff544c-wmjqn"
Jul 18 11:20:27.119723 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:27.119186    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l48bb\" (UniqueName: \"kubernetes.io/projected/2d5ed932-8778-4ad2-875d-df39f5c18884-kube-api-access-l48bb\") pod \"managed-serviceaccount-addon-agent-6948895d4d-htfwq\" (UID: \"2d5ed932-8778-4ad2-875d-df39f5c18884\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6948895d4d-htfwq"
Jul 18 11:20:27.119723 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:27.119232    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/2d5ed932-8778-4ad2-875d-df39f5c18884-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-6948895d4d-htfwq\" (UID: \"2d5ed932-8778-4ad2-875d-df39f5c18884\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6948895d4d-htfwq"
Jul 18 11:20:27.126842 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:27.126000    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-69d69956f7-lpbnb"]
Jul 18 11:20:27.126842 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:27.126112    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-69d69956f7-lpbnb"
Jul 18 11:20:27.131500 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:27.131022    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\""
Jul 18 11:20:27.131500 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:27.131465    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\""
Jul 18 11:20:27.131500 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:27.131490    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\""
Jul 18 11:20:27.131695 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:27.131599    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\""
Jul 18 11:20:27.219873 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:27.219843    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/2ee04fb4-5905-4a32-9f9b-cccd53f60f5a-hub\") pod \"cluster-proxy-proxy-agent-69d69956f7-lpbnb\" (UID: \"2ee04fb4-5905-4a32-9f9b-cccd53f60f5a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-69d69956f7-lpbnb"
Jul 18 11:20:27.220080 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:27.219916    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/2d5ed932-8778-4ad2-875d-df39f5c18884-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-6948895d4d-htfwq\" (UID: \"2d5ed932-8778-4ad2-875d-df39f5c18884\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6948895d4d-htfwq"
Jul 18 11:20:27.220145 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:27.220070    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/2ee04fb4-5905-4a32-9f9b-cccd53f60f5a-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-69d69956f7-lpbnb\" (UID: \"2ee04fb4-5905-4a32-9f9b-cccd53f60f5a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-69d69956f7-lpbnb"
Jul 18 11:20:27.220145 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:27.220135    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/2ee04fb4-5905-4a32-9f9b-cccd53f60f5a-additional-service-ca\") pod \"cluster-proxy-proxy-agent-69d69956f7-lpbnb\" (UID: \"2ee04fb4-5905-4a32-9f9b-cccd53f60f5a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-69d69956f7-lpbnb"
Jul 18 11:20:27.220256 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:27.220201    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/a252d7fc-6695-42c5-b9c3-a02dc7104cfd-klusterlet-config\") pod \"klusterlet-addon-workmgr-5769ff544c-wmjqn\" (UID: \"a252d7fc-6695-42c5-b9c3-a02dc7104cfd\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5769ff544c-wmjqn"
Jul 18 11:20:27.220303 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:27.220245    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/2ee04fb4-5905-4a32-9f9b-cccd53f60f5a-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-69d69956f7-lpbnb\" (UID: \"2ee04fb4-5905-4a32-9f9b-cccd53f60f5a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-69d69956f7-lpbnb"
Jul 18 11:20:27.220303 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:27.220295    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/2ee04fb4-5905-4a32-9f9b-cccd53f60f5a-ca\") pod \"cluster-proxy-proxy-agent-69d69956f7-lpbnb\" (UID: \"2ee04fb4-5905-4a32-9f9b-cccd53f60f5a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-69d69956f7-lpbnb"
Jul 18 11:20:27.220384 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:27.220348    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2xp5k\" (UniqueName: \"kubernetes.io/projected/a252d7fc-6695-42c5-b9c3-a02dc7104cfd-kube-api-access-2xp5k\") pod \"klusterlet-addon-workmgr-5769ff544c-wmjqn\" (UID: \"a252d7fc-6695-42c5-b9c3-a02dc7104cfd\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5769ff544c-wmjqn"
Jul 18 11:20:27.220423 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:27.220395    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a252d7fc-6695-42c5-b9c3-a02dc7104cfd-tmp\") pod \"klusterlet-addon-workmgr-5769ff544c-wmjqn\" (UID: \"a252d7fc-6695-42c5-b9c3-a02dc7104cfd\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5769ff544c-wmjqn"
Jul 18 11:20:27.220505 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:27.220475    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l48bb\" (UniqueName: \"kubernetes.io/projected/2d5ed932-8778-4ad2-875d-df39f5c18884-kube-api-access-l48bb\") pod \"managed-serviceaccount-addon-agent-6948895d4d-htfwq\" (UID: \"2d5ed932-8778-4ad2-875d-df39f5c18884\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6948895d4d-htfwq"
Jul 18 11:20:27.222986 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:27.222960    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-trjdb\" (UniqueName: \"kubernetes.io/projected/2ee04fb4-5905-4a32-9f9b-cccd53f60f5a-kube-api-access-trjdb\") pod \"cluster-proxy-proxy-agent-69d69956f7-lpbnb\" (UID: \"2ee04fb4-5905-4a32-9f9b-cccd53f60f5a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-69d69956f7-lpbnb"
Jul 18 11:20:27.223305 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:27.223262    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-rtpfm" event={"ID":"1deb912b-fac4-4121-a030-3a5ae9700aa0","Type":"ContainerStarted","Data":"d214b8a5ae33586eb9d029117debbc979b70317aeb65fce007f8fffe0f30c41e"}
Jul 18 11:20:27.224416 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:27.224172    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a252d7fc-6695-42c5-b9c3-a02dc7104cfd-tmp\") pod \"klusterlet-addon-workmgr-5769ff544c-wmjqn\" (UID: \"a252d7fc-6695-42c5-b9c3-a02dc7104cfd\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5769ff544c-wmjqn"
Jul 18 11:20:27.226681 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:27.226571    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/2d5ed932-8778-4ad2-875d-df39f5c18884-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-6948895d4d-htfwq\" (UID: \"2d5ed932-8778-4ad2-875d-df39f5c18884\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6948895d4d-htfwq"
Jul 18 11:20:27.226681 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:27.226574    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-jz6m4" event={"ID":"1319723f-4179-4040-b746-8fde76308444","Type":"ContainerStarted","Data":"a30c67fbb9524f4a4a47ae75dbdf123458a626e13f04a7dd1de7f5312a42b2fe"}
Jul 18 11:20:27.226681 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:27.226570    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/a252d7fc-6695-42c5-b9c3-a02dc7104cfd-klusterlet-config\") pod \"klusterlet-addon-workmgr-5769ff544c-wmjqn\" (UID: \"a252d7fc-6695-42c5-b9c3-a02dc7104cfd\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5769ff544c-wmjqn"
Jul 18 11:20:27.229980 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:27.229715    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-g8g4r" event={"ID":"85567bae-b6fc-4bdd-8973-0bd705dc22f8","Type":"ContainerStarted","Data":"5437904864c06f9a41963908f3b1c82ab1fbed956031927ad32801cd81e385ec"}
Jul 18 11:20:27.231871 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:27.231849    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-p7shj" event={"ID":"e6cc6097-8792-4b98-ab5f-085dac6a9dc7","Type":"ContainerStarted","Data":"b0dd240b9eb418888c8cc104bb0e30906d1ad91de039f518f5c921b8a808611b"}
Jul 18 11:20:27.233412 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:27.233357    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l48bb\" (UniqueName: \"kubernetes.io/projected/2d5ed932-8778-4ad2-875d-df39f5c18884-kube-api-access-l48bb\") pod \"managed-serviceaccount-addon-agent-6948895d4d-htfwq\" (UID: \"2d5ed932-8778-4ad2-875d-df39f5c18884\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6948895d4d-htfwq"
Jul 18 11:20:27.234919 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:27.234515    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-jfpn7_759a894c-1828-4ac9-a7c3-77354a104247/console-operator/0.log"
Jul 18 11:20:27.234919 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:27.234551    2579 generic.go:356] "Generic (PLEG): container finished" podID="759a894c-1828-4ac9-a7c3-77354a104247" containerID="ecf0ee9a5190d58db774676850ec6f1744747d3ca8d0c14c3f98577cf40b793b" exitCode=255
Jul 18 11:20:27.234919 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:27.234626    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-jfpn7" event={"ID":"759a894c-1828-4ac9-a7c3-77354a104247","Type":"ContainerDied","Data":"ecf0ee9a5190d58db774676850ec6f1744747d3ca8d0c14c3f98577cf40b793b"}
Jul 18 11:20:27.235446 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:27.235140    2579 scope.go:117] "RemoveContainer" containerID="ecf0ee9a5190d58db774676850ec6f1744747d3ca8d0c14c3f98577cf40b793b"
Jul 18 11:20:27.235446 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:27.235302    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2xp5k\" (UniqueName: \"kubernetes.io/projected/a252d7fc-6695-42c5-b9c3-a02dc7104cfd-kube-api-access-2xp5k\") pod \"klusterlet-addon-workmgr-5769ff544c-wmjqn\" (UID: \"a252d7fc-6695-42c5-b9c3-a02dc7104cfd\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5769ff544c-wmjqn"
Jul 18 11:20:27.238509 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:27.237677    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-555d9d7885-qs8cs" event={"ID":"e0a05104-9f66-40b5-8d49-2bf876d64b5c","Type":"ContainerStarted","Data":"190f6d523972f716c322d2ec57db515f8f48f762059aaa60622ec4f484f2cc91"}
Jul 18 11:20:27.238509 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:27.238374    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-rtpfm" podStartSLOduration=37.53530764 podStartE2EDuration="45.238357383s" totalImagesPullingTime="7.703049743s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 11:19:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 11:20:27.238341266 +0000 UTC m=+46.853377569" watchObservedRunningTime="2026-07-18 11:20:27.238357383 +0000 UTC m=+46.853393685"
Jul 18 11:20:27.242022 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:27.241979    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-ljssw" event={"ID":"446260ea-ffd2-4b81-8455-4d2052b97c2a","Type":"ContainerStarted","Data":"9961ecbbad1bc03836412cf514fb61f481071870d84df58cb4b13baea643161a"}
Jul 18 11:20:27.272834 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:27.272771    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-g8g4r" podStartSLOduration=37.479743894 podStartE2EDuration="45.272692743s" totalImagesPullingTime="7.792948849s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 11:19:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 11:20:27.271962067 +0000 UTC m=+46.886998371" watchObservedRunningTime="2026-07-18 11:20:27.272692743 +0000 UTC m=+46.887729045"
Jul 18 11:20:27.291774 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:27.291706    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-jz6m4" podStartSLOduration=33.46445183 podStartE2EDuration="41.291683278s" totalImagesPullingTime="7.827231448s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 11:19:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 11:20:27.290181211 +0000 UTC m=+46.905217513" watchObservedRunningTime="2026-07-18 11:20:27.291683278 +0000 UTC m=+46.906719581"
Jul 18 11:20:27.314539 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:27.312078    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-p7shj" podStartSLOduration=38.499837866 podStartE2EDuration="46.312054414s" totalImagesPullingTime="7.812216548s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 11:19:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 11:20:27.309112606 +0000 UTC m=+46.924148909" watchObservedRunningTime="2026-07-18 11:20:27.312054414 +0000 UTC m=+46.927090721"
Jul 18 11:20:27.321341 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:27.321217    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnt7j_e0f67788-e972-49ff-b611-b9835f528d81/konnectivity-agent/0.log" limit=1024
Jul 18 11:20:27.326973 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:27.324044    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/2ee04fb4-5905-4a32-9f9b-cccd53f60f5a-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-69d69956f7-lpbnb\" (UID: \"2ee04fb4-5905-4a32-9f9b-cccd53f60f5a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-69d69956f7-lpbnb"
Jul 18 11:20:27.326973 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:27.324120    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/2ee04fb4-5905-4a32-9f9b-cccd53f60f5a-ca\") pod \"cluster-proxy-proxy-agent-69d69956f7-lpbnb\" (UID: \"2ee04fb4-5905-4a32-9f9b-cccd53f60f5a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-69d69956f7-lpbnb"
Jul 18 11:20:27.326973 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:27.324788    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-trjdb\" (UniqueName: \"kubernetes.io/projected/2ee04fb4-5905-4a32-9f9b-cccd53f60f5a-kube-api-access-trjdb\") pod \"cluster-proxy-proxy-agent-69d69956f7-lpbnb\" (UID: \"2ee04fb4-5905-4a32-9f9b-cccd53f60f5a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-69d69956f7-lpbnb"
Jul 18 11:20:27.326973 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:27.324868    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/2ee04fb4-5905-4a32-9f9b-cccd53f60f5a-hub\") pod \"cluster-proxy-proxy-agent-69d69956f7-lpbnb\" (UID: \"2ee04fb4-5905-4a32-9f9b-cccd53f60f5a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-69d69956f7-lpbnb"
Jul 18 11:20:27.326973 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:27.325045    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/2ee04fb4-5905-4a32-9f9b-cccd53f60f5a-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-69d69956f7-lpbnb\" (UID: \"2ee04fb4-5905-4a32-9f9b-cccd53f60f5a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-69d69956f7-lpbnb"
Jul 18 11:20:27.326973 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:27.325087    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/2ee04fb4-5905-4a32-9f9b-cccd53f60f5a-additional-service-ca\") pod \"cluster-proxy-proxy-agent-69d69956f7-lpbnb\" (UID: \"2ee04fb4-5905-4a32-9f9b-cccd53f60f5a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-69d69956f7-lpbnb"
Jul 18 11:20:27.329404 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:27.329130    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/2ee04fb4-5905-4a32-9f9b-cccd53f60f5a-additional-service-ca\") pod \"cluster-proxy-proxy-agent-69d69956f7-lpbnb\" (UID: \"2ee04fb4-5905-4a32-9f9b-cccd53f60f5a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-69d69956f7-lpbnb"
Jul 18 11:20:27.333623 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:27.332954    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/2ee04fb4-5905-4a32-9f9b-cccd53f60f5a-ca\") pod \"cluster-proxy-proxy-agent-69d69956f7-lpbnb\" (UID: \"2ee04fb4-5905-4a32-9f9b-cccd53f60f5a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-69d69956f7-lpbnb"
Jul 18 11:20:27.333623 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:27.333341    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-555d9d7885-qs8cs" podStartSLOduration=37.540954642 podStartE2EDuration="45.333325231s" totalImagesPullingTime="7.792370589s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 11:19:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 11:20:27.331468979 +0000 UTC m=+46.946505298" watchObservedRunningTime="2026-07-18 11:20:27.333325231 +0000 UTC m=+46.948361534"
Jul 18 11:20:27.334336 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:27.334309    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/2ee04fb4-5905-4a32-9f9b-cccd53f60f5a-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-69d69956f7-lpbnb\" (UID: \"2ee04fb4-5905-4a32-9f9b-cccd53f60f5a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-69d69956f7-lpbnb"
Jul 18 11:20:27.335172 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:27.335118    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/2ee04fb4-5905-4a32-9f9b-cccd53f60f5a-hub\") pod \"cluster-proxy-proxy-agent-69d69956f7-lpbnb\" (UID: \"2ee04fb4-5905-4a32-9f9b-cccd53f60f5a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-69d69956f7-lpbnb"
Jul 18 11:20:27.336487 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:27.336408    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/2ee04fb4-5905-4a32-9f9b-cccd53f60f5a-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-69d69956f7-lpbnb\" (UID: \"2ee04fb4-5905-4a32-9f9b-cccd53f60f5a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-69d69956f7-lpbnb"
Jul 18 11:20:27.338334 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:27.338303    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-trjdb\" (UniqueName: \"kubernetes.io/projected/2ee04fb4-5905-4a32-9f9b-cccd53f60f5a-kube-api-access-trjdb\") pod \"cluster-proxy-proxy-agent-69d69956f7-lpbnb\" (UID: \"2ee04fb4-5905-4a32-9f9b-cccd53f60f5a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-69d69956f7-lpbnb"
Jul 18 11:20:27.348275 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:27.346668    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-ljssw" podStartSLOduration=2.534298555 podStartE2EDuration="10.346650349s" totalImagesPullingTime="7.812351794s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 11:20:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 11:20:27.345568966 +0000 UTC m=+46.960605268" watchObservedRunningTime="2026-07-18 11:20:27.346650349 +0000 UTC m=+46.961686652"
Jul 18 11:20:27.380130 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:27.380051    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnt7j_e0f67788-e972-49ff-b611-b9835f528d81/konnectivity-agent/0.log" limit=1024
Jul 18 11:20:27.402936 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:27.402869    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5769ff544c-wmjqn"
Jul 18 11:20:27.468668 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:27.468541    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6948895d4d-htfwq"
Jul 18 11:20:27.484180 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:27.482534    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-69d69956f7-lpbnb"
Jul 18 11:20:27.518825 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:27.518747    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-565b7b569d-jfpn7"
Jul 18 11:20:27.520614 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:27.520466    2579 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-565b7b569d-jfpn7"
Jul 18 11:20:27.594052 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:27.588871    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-5769ff544c-wmjqn"]
Jul 18 11:20:27.595307 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:20:27.595251    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda252d7fc_6695_42c5_b9c3_a02dc7104cfd.slice/crio-6cd1d35e8707fa55c68febc91bd6ca53512bcb87d8f483fc1647f7afbe9ee576 WatchSource:0}: Error finding container 6cd1d35e8707fa55c68febc91bd6ca53512bcb87d8f483fc1647f7afbe9ee576: Status 404 returned error can't find the container with id 6cd1d35e8707fa55c68febc91bd6ca53512bcb87d8f483fc1647f7afbe9ee576
Jul 18 11:20:27.686778 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:27.686725    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6948895d4d-htfwq"]
Jul 18 11:20:27.691718 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:20:27.691652    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2d5ed932_8778_4ad2_875d_df39f5c18884.slice/crio-679d1a7620b20087b4add23f4bc43839b5a476a02532e17f9066e6654624ad03 WatchSource:0}: Error finding container 679d1a7620b20087b4add23f4bc43839b5a476a02532e17f9066e6654624ad03: Status 404 returned error can't find the container with id 679d1a7620b20087b4add23f4bc43839b5a476a02532e17f9066e6654624ad03
Jul 18 11:20:27.705157 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:27.705126    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-69d69956f7-lpbnb"]
Jul 18 11:20:27.708428 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:20:27.708396    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2ee04fb4_5905_4a32_9f9b_cccd53f60f5a.slice/crio-9b323b8dff8bf5ef1df52c4a960ac5318b2ef20e5cc2aa62a568db53d18d68b1 WatchSource:0}: Error finding container 9b323b8dff8bf5ef1df52c4a960ac5318b2ef20e5cc2aa62a568db53d18d68b1: Status 404 returned error can't find the container with id 9b323b8dff8bf5ef1df52c4a960ac5318b2ef20e5cc2aa62a568db53d18d68b1
Jul 18 11:20:28.246978 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:28.246827    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-jfpn7_759a894c-1828-4ac9-a7c3-77354a104247/console-operator/1.log"
Jul 18 11:20:28.248546 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:28.247358    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-jfpn7_759a894c-1828-4ac9-a7c3-77354a104247/console-operator/0.log"
Jul 18 11:20:28.248546 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:28.247396    2579 generic.go:356] "Generic (PLEG): container finished" podID="759a894c-1828-4ac9-a7c3-77354a104247" containerID="d03aa069d805d56554d37e2777d7bdeee3e607495a7479d493f3f303f8868fc2" exitCode=255
Jul 18 11:20:28.248546 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:28.247481    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-jfpn7" event={"ID":"759a894c-1828-4ac9-a7c3-77354a104247","Type":"ContainerDied","Data":"d03aa069d805d56554d37e2777d7bdeee3e607495a7479d493f3f303f8868fc2"}
Jul 18 11:20:28.248546 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:28.247564    2579 scope.go:117] "RemoveContainer" containerID="ecf0ee9a5190d58db774676850ec6f1744747d3ca8d0c14c3f98577cf40b793b"
Jul 18 11:20:28.248546 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:28.247994    2579 scope.go:117] "RemoveContainer" containerID="d03aa069d805d56554d37e2777d7bdeee3e607495a7479d493f3f303f8868fc2"
Jul 18 11:20:28.248546 ip-10-0-133-122 kubenswrapper[2579]: E0718 11:20:28.248169    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-565b7b569d-jfpn7_openshift-console-operator(759a894c-1828-4ac9-a7c3-77354a104247)\"" pod="openshift-console-operator/console-operator-565b7b569d-jfpn7" podUID="759a894c-1828-4ac9-a7c3-77354a104247"
Jul 18 11:20:28.250613 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:28.250583    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-69d69956f7-lpbnb" event={"ID":"2ee04fb4-5905-4a32-9f9b-cccd53f60f5a","Type":"ContainerStarted","Data":"9b323b8dff8bf5ef1df52c4a960ac5318b2ef20e5cc2aa62a568db53d18d68b1"}
Jul 18 11:20:28.252211 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:28.252180    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6948895d4d-htfwq" event={"ID":"2d5ed932-8778-4ad2-875d-df39f5c18884","Type":"ContainerStarted","Data":"679d1a7620b20087b4add23f4bc43839b5a476a02532e17f9066e6654624ad03"}
Jul 18 11:20:28.254143 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:28.254116    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5769ff544c-wmjqn" event={"ID":"a252d7fc-6695-42c5-b9c3-a02dc7104cfd","Type":"ContainerStarted","Data":"6cd1d35e8707fa55c68febc91bd6ca53512bcb87d8f483fc1647f7afbe9ee576"}
Jul 18 11:20:28.287644 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:28.285942    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-2l7gv"]
Jul 18 11:20:28.308332 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:28.308188    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-2l7gv"]
Jul 18 11:20:28.308332 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:28.308333    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-2l7gv"
Jul 18 11:20:28.312442 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:28.311809    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 18 11:20:28.312442 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:28.312076    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 18 11:20:28.312442 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:28.312299    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-nhs4n\""
Jul 18 11:20:28.340330 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:28.340274    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/33c02514-4254-498e-86eb-8d7d858bc338-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2l7gv\" (UID: \"33c02514-4254-498e-86eb-8d7d858bc338\") " pod="openshift-insights/insights-runtime-extractor-2l7gv"
Jul 18 11:20:28.340530 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:28.340358    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/33c02514-4254-498e-86eb-8d7d858bc338-crio-socket\") pod \"insights-runtime-extractor-2l7gv\" (UID: \"33c02514-4254-498e-86eb-8d7d858bc338\") " pod="openshift-insights/insights-runtime-extractor-2l7gv"
Jul 18 11:20:28.341707 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:28.340994    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/33c02514-4254-498e-86eb-8d7d858bc338-data-volume\") pod \"insights-runtime-extractor-2l7gv\" (UID: \"33c02514-4254-498e-86eb-8d7d858bc338\") " pod="openshift-insights/insights-runtime-extractor-2l7gv"
Jul 18 11:20:28.341707 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:28.341105    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bd5gs\" (UniqueName: \"kubernetes.io/projected/33c02514-4254-498e-86eb-8d7d858bc338-kube-api-access-bd5gs\") pod \"insights-runtime-extractor-2l7gv\" (UID: \"33c02514-4254-498e-86eb-8d7d858bc338\") " pod="openshift-insights/insights-runtime-extractor-2l7gv"
Jul 18 11:20:28.341707 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:28.341223    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/33c02514-4254-498e-86eb-8d7d858bc338-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2l7gv\" (UID: \"33c02514-4254-498e-86eb-8d7d858bc338\") " pod="openshift-insights/insights-runtime-extractor-2l7gv"
Jul 18 11:20:28.343020 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:28.342981    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnt7j_e0f67788-e972-49ff-b611-b9835f528d81/konnectivity-agent/0.log" limit=1024
Jul 18 11:20:28.386830 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:28.386797    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-m68sg"]
Jul 18 11:20:28.404048 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:28.403839    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-m68sg"]
Jul 18 11:20:28.404048 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:28.404004    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-m68sg"
Jul 18 11:20:28.408008 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:28.407939    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-n9vl6\""
Jul 18 11:20:28.408588 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:28.408565    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Jul 18 11:20:28.409326 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:28.409298    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Jul 18 11:20:28.433405 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:28.433381    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnt7j_e0f67788-e972-49ff-b611-b9835f528d81/konnectivity-agent/0.log" limit=1024
Jul 18 11:20:28.443306 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:28.443261    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/33c02514-4254-498e-86eb-8d7d858bc338-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2l7gv\" (UID: \"33c02514-4254-498e-86eb-8d7d858bc338\") " pod="openshift-insights/insights-runtime-extractor-2l7gv"
Jul 18 11:20:28.443503 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:28.443312    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8cq8z\" (UniqueName: \"kubernetes.io/projected/cea912a4-ac4a-4b4d-979e-812f1ac845ed-kube-api-access-8cq8z\") pod \"migrator-7cc9c7ffd7-m68sg\" (UID: \"cea912a4-ac4a-4b4d-979e-812f1ac845ed\") " pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-m68sg"
Jul 18 11:20:28.443503 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:28.443348    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/33c02514-4254-498e-86eb-8d7d858bc338-crio-socket\") pod \"insights-runtime-extractor-2l7gv\" (UID: \"33c02514-4254-498e-86eb-8d7d858bc338\") " pod="openshift-insights/insights-runtime-extractor-2l7gv"
Jul 18 11:20:28.443503 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:28.443457    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/33c02514-4254-498e-86eb-8d7d858bc338-data-volume\") pod \"insights-runtime-extractor-2l7gv\" (UID: \"33c02514-4254-498e-86eb-8d7d858bc338\") " pod="openshift-insights/insights-runtime-extractor-2l7gv"
Jul 18 11:20:28.443797 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:28.443505    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bd5gs\" (UniqueName: \"kubernetes.io/projected/33c02514-4254-498e-86eb-8d7d858bc338-kube-api-access-bd5gs\") pod \"insights-runtime-extractor-2l7gv\" (UID: \"33c02514-4254-498e-86eb-8d7d858bc338\") " pod="openshift-insights/insights-runtime-extractor-2l7gv"
Jul 18 11:20:28.443797 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:28.443568    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/33c02514-4254-498e-86eb-8d7d858bc338-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2l7gv\" (UID: \"33c02514-4254-498e-86eb-8d7d858bc338\") " pod="openshift-insights/insights-runtime-extractor-2l7gv"
Jul 18 11:20:28.443797 ip-10-0-133-122 kubenswrapper[2579]: E0718 11:20:28.443641    2579 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 18 11:20:28.443797 ip-10-0-133-122 kubenswrapper[2579]: E0718 11:20:28.443701    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/33c02514-4254-498e-86eb-8d7d858bc338-kube-rbac-proxy-cm podName:33c02514-4254-498e-86eb-8d7d858bc338 nodeName:}" failed. No retries permitted until 2026-07-18 11:20:28.943683111 +0000 UTC m=+48.558719390 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/33c02514-4254-498e-86eb-8d7d858bc338-kube-rbac-proxy-cm") pod "insights-runtime-extractor-2l7gv" (UID: "33c02514-4254-498e-86eb-8d7d858bc338") : configmap "kube-rbac-proxy" not found
Jul 18 11:20:28.444144 ip-10-0-133-122 kubenswrapper[2579]: E0718 11:20:28.443783    2579 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 18 11:20:28.444144 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:28.443844    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/33c02514-4254-498e-86eb-8d7d858bc338-crio-socket\") pod \"insights-runtime-extractor-2l7gv\" (UID: \"33c02514-4254-498e-86eb-8d7d858bc338\") " pod="openshift-insights/insights-runtime-extractor-2l7gv"
Jul 18 11:20:28.444144 ip-10-0-133-122 kubenswrapper[2579]: E0718 11:20:28.443861    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/33c02514-4254-498e-86eb-8d7d858bc338-insights-runtime-extractor-tls podName:33c02514-4254-498e-86eb-8d7d858bc338 nodeName:}" failed. No retries permitted until 2026-07-18 11:20:28.943841428 +0000 UTC m=+48.558877712 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/33c02514-4254-498e-86eb-8d7d858bc338-insights-runtime-extractor-tls") pod "insights-runtime-extractor-2l7gv" (UID: "33c02514-4254-498e-86eb-8d7d858bc338") : secret "insights-runtime-extractor-tls" not found
Jul 18 11:20:28.444623 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:28.444597    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/33c02514-4254-498e-86eb-8d7d858bc338-data-volume\") pod \"insights-runtime-extractor-2l7gv\" (UID: \"33c02514-4254-498e-86eb-8d7d858bc338\") " pod="openshift-insights/insights-runtime-extractor-2l7gv"
Jul 18 11:20:28.454213 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:28.454184    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bd5gs\" (UniqueName: \"kubernetes.io/projected/33c02514-4254-498e-86eb-8d7d858bc338-kube-api-access-bd5gs\") pod \"insights-runtime-extractor-2l7gv\" (UID: \"33c02514-4254-498e-86eb-8d7d858bc338\") " pod="openshift-insights/insights-runtime-extractor-2l7gv"
Jul 18 11:20:28.492825 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:28.492673    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnt7j_e0f67788-e972-49ff-b611-b9835f528d81/konnectivity-agent/0.log" limit=1024
Jul 18 11:20:28.544594 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:28.544501    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8cq8z\" (UniqueName: \"kubernetes.io/projected/cea912a4-ac4a-4b4d-979e-812f1ac845ed-kube-api-access-8cq8z\") pod \"migrator-7cc9c7ffd7-m68sg\" (UID: \"cea912a4-ac4a-4b4d-979e-812f1ac845ed\") " pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-m68sg"
Jul 18 11:20:28.555740 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:28.555661    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8cq8z\" (UniqueName: \"kubernetes.io/projected/cea912a4-ac4a-4b4d-979e-812f1ac845ed-kube-api-access-8cq8z\") pod \"migrator-7cc9c7ffd7-m68sg\" (UID: \"cea912a4-ac4a-4b4d-979e-812f1ac845ed\") " pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-m68sg"
Jul 18 11:20:28.718854 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:28.718572    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-m68sg"
Jul 18 11:20:28.949065 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:28.948974    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/33c02514-4254-498e-86eb-8d7d858bc338-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2l7gv\" (UID: \"33c02514-4254-498e-86eb-8d7d858bc338\") " pod="openshift-insights/insights-runtime-extractor-2l7gv"
Jul 18 11:20:28.949245 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:28.949085    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/33c02514-4254-498e-86eb-8d7d858bc338-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2l7gv\" (UID: \"33c02514-4254-498e-86eb-8d7d858bc338\") " pod="openshift-insights/insights-runtime-extractor-2l7gv"
Jul 18 11:20:28.949400 ip-10-0-133-122 kubenswrapper[2579]: E0718 11:20:28.949357    2579 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 18 11:20:28.949468 ip-10-0-133-122 kubenswrapper[2579]: E0718 11:20:28.949399    2579 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 18 11:20:28.949468 ip-10-0-133-122 kubenswrapper[2579]: E0718 11:20:28.949451    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/33c02514-4254-498e-86eb-8d7d858bc338-kube-rbac-proxy-cm podName:33c02514-4254-498e-86eb-8d7d858bc338 nodeName:}" failed. No retries permitted until 2026-07-18 11:20:29.949434069 +0000 UTC m=+49.564470353 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/33c02514-4254-498e-86eb-8d7d858bc338-kube-rbac-proxy-cm") pod "insights-runtime-extractor-2l7gv" (UID: "33c02514-4254-498e-86eb-8d7d858bc338") : configmap "kube-rbac-proxy" not found
Jul 18 11:20:28.949577 ip-10-0-133-122 kubenswrapper[2579]: E0718 11:20:28.949467    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/33c02514-4254-498e-86eb-8d7d858bc338-insights-runtime-extractor-tls podName:33c02514-4254-498e-86eb-8d7d858bc338 nodeName:}" failed. No retries permitted until 2026-07-18 11:20:29.949459431 +0000 UTC m=+49.564495724 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/33c02514-4254-498e-86eb-8d7d858bc338-insights-runtime-extractor-tls") pod "insights-runtime-extractor-2l7gv" (UID: "33c02514-4254-498e-86eb-8d7d858bc338") : secret "insights-runtime-extractor-tls" not found
Jul 18 11:20:28.951808 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:28.951780    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-m68sg"]
Jul 18 11:20:28.959249 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:20:28.959209    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcea912a4_ac4a_4b4d_979e_812f1ac845ed.slice/crio-6a042695ee9ef2fc0de22cd6227f80ad2e86680b7c0348cef16954104b96e359 WatchSource:0}: Error finding container 6a042695ee9ef2fc0de22cd6227f80ad2e86680b7c0348cef16954104b96e359: Status 404 returned error can't find the container with id 6a042695ee9ef2fc0de22cd6227f80ad2e86680b7c0348cef16954104b96e359
Jul 18 11:20:29.267385 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:29.266132    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-jfpn7_759a894c-1828-4ac9-a7c3-77354a104247/console-operator/1.log"
Jul 18 11:20:29.267385 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:29.266611    2579 scope.go:117] "RemoveContainer" containerID="d03aa069d805d56554d37e2777d7bdeee3e607495a7479d493f3f303f8868fc2"
Jul 18 11:20:29.267385 ip-10-0-133-122 kubenswrapper[2579]: E0718 11:20:29.266817    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-565b7b569d-jfpn7_openshift-console-operator(759a894c-1828-4ac9-a7c3-77354a104247)\"" pod="openshift-console-operator/console-operator-565b7b569d-jfpn7" podUID="759a894c-1828-4ac9-a7c3-77354a104247"
Jul 18 11:20:29.272844 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:29.272761    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-m68sg" event={"ID":"cea912a4-ac4a-4b4d-979e-812f1ac845ed","Type":"ContainerStarted","Data":"6a042695ee9ef2fc0de22cd6227f80ad2e86680b7c0348cef16954104b96e359"}
Jul 18 11:20:29.276080 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:29.276056    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-4522z_899ed5f2-c702-4904-82e7-0ab5570dd7d3/dns-node-resolver/0.log"
Jul 18 11:20:29.961744 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:29.961703    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/33c02514-4254-498e-86eb-8d7d858bc338-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2l7gv\" (UID: \"33c02514-4254-498e-86eb-8d7d858bc338\") " pod="openshift-insights/insights-runtime-extractor-2l7gv"
Jul 18 11:20:29.962236 ip-10-0-133-122 kubenswrapper[2579]: E0718 11:20:29.961816    2579 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 18 11:20:29.962236 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:29.961843    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/33c02514-4254-498e-86eb-8d7d858bc338-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2l7gv\" (UID: \"33c02514-4254-498e-86eb-8d7d858bc338\") " pod="openshift-insights/insights-runtime-extractor-2l7gv"
Jul 18 11:20:29.962236 ip-10-0-133-122 kubenswrapper[2579]: E0718 11:20:29.961901    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/33c02514-4254-498e-86eb-8d7d858bc338-kube-rbac-proxy-cm podName:33c02514-4254-498e-86eb-8d7d858bc338 nodeName:}" failed. No retries permitted until 2026-07-18 11:20:31.961866875 +0000 UTC m=+51.576903172 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/33c02514-4254-498e-86eb-8d7d858bc338-kube-rbac-proxy-cm") pod "insights-runtime-extractor-2l7gv" (UID: "33c02514-4254-498e-86eb-8d7d858bc338") : configmap "kube-rbac-proxy" not found
Jul 18 11:20:29.962236 ip-10-0-133-122 kubenswrapper[2579]: E0718 11:20:29.961958    2579 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 18 11:20:29.962236 ip-10-0-133-122 kubenswrapper[2579]: E0718 11:20:29.961998    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/33c02514-4254-498e-86eb-8d7d858bc338-insights-runtime-extractor-tls podName:33c02514-4254-498e-86eb-8d7d858bc338 nodeName:}" failed. No retries permitted until 2026-07-18 11:20:31.961985973 +0000 UTC m=+51.577022267 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/33c02514-4254-498e-86eb-8d7d858bc338-insights-runtime-extractor-tls") pod "insights-runtime-extractor-2l7gv" (UID: "33c02514-4254-498e-86eb-8d7d858bc338") : secret "insights-runtime-extractor-tls" not found
Jul 18 11:20:30.476564 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:30.476510    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-bz5mq_e24556f0-f108-4c9d-a3b1-5d0548925197/node-ca/0.log"
Jul 18 11:20:31.077263 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:31.077116    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-ljssw_446260ea-ffd2-4b81-8455-4d2052b97c2a/serve-healthcheck-canary/0.log"
Jul 18 11:20:31.351670 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:31.351639    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-58598695f7-v5x6q"]
Jul 18 11:20:31.359970 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:31.359939    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-58598695f7-v5x6q"
Jul 18 11:20:31.362535 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:31.362508    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
Jul 18 11:20:31.363165 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:31.363070    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
Jul 18 11:20:31.363290 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:31.363259    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
Jul 18 11:20:31.363590 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:31.363565    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
Jul 18 11:20:31.363699 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:31.363569    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-zcn6v\""
Jul 18 11:20:31.363828 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:31.363747    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-58598695f7-v5x6q"]
Jul 18 11:20:31.479318 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:31.479268    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/94e6396e-ad77-4b9e-a77f-105d18ba2741-signing-key\") pod \"service-ca-58598695f7-v5x6q\" (UID: \"94e6396e-ad77-4b9e-a77f-105d18ba2741\") " pod="openshift-service-ca/service-ca-58598695f7-v5x6q"
Jul 18 11:20:31.479318 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:31.479320    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-szr6t\" (UniqueName: \"kubernetes.io/projected/94e6396e-ad77-4b9e-a77f-105d18ba2741-kube-api-access-szr6t\") pod \"service-ca-58598695f7-v5x6q\" (UID: \"94e6396e-ad77-4b9e-a77f-105d18ba2741\") " pod="openshift-service-ca/service-ca-58598695f7-v5x6q"
Jul 18 11:20:31.479552 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:31.479478    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/94e6396e-ad77-4b9e-a77f-105d18ba2741-signing-cabundle\") pod \"service-ca-58598695f7-v5x6q\" (UID: \"94e6396e-ad77-4b9e-a77f-105d18ba2741\") " pod="openshift-service-ca/service-ca-58598695f7-v5x6q"
Jul 18 11:20:31.581061 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:31.581027    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/94e6396e-ad77-4b9e-a77f-105d18ba2741-signing-cabundle\") pod \"service-ca-58598695f7-v5x6q\" (UID: \"94e6396e-ad77-4b9e-a77f-105d18ba2741\") " pod="openshift-service-ca/service-ca-58598695f7-v5x6q"
Jul 18 11:20:31.581214 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:31.581180    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/94e6396e-ad77-4b9e-a77f-105d18ba2741-signing-key\") pod \"service-ca-58598695f7-v5x6q\" (UID: \"94e6396e-ad77-4b9e-a77f-105d18ba2741\") " pod="openshift-service-ca/service-ca-58598695f7-v5x6q"
Jul 18 11:20:31.581327 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:31.581220    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-szr6t\" (UniqueName: \"kubernetes.io/projected/94e6396e-ad77-4b9e-a77f-105d18ba2741-kube-api-access-szr6t\") pod \"service-ca-58598695f7-v5x6q\" (UID: \"94e6396e-ad77-4b9e-a77f-105d18ba2741\") " pod="openshift-service-ca/service-ca-58598695f7-v5x6q"
Jul 18 11:20:31.581768 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:31.581746    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/94e6396e-ad77-4b9e-a77f-105d18ba2741-signing-cabundle\") pod \"service-ca-58598695f7-v5x6q\" (UID: \"94e6396e-ad77-4b9e-a77f-105d18ba2741\") " pod="openshift-service-ca/service-ca-58598695f7-v5x6q"
Jul 18 11:20:31.585589 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:31.585560    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/94e6396e-ad77-4b9e-a77f-105d18ba2741-signing-key\") pod \"service-ca-58598695f7-v5x6q\" (UID: \"94e6396e-ad77-4b9e-a77f-105d18ba2741\") " pod="openshift-service-ca/service-ca-58598695f7-v5x6q"
Jul 18 11:20:31.591688 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:31.591661    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-szr6t\" (UniqueName: \"kubernetes.io/projected/94e6396e-ad77-4b9e-a77f-105d18ba2741-kube-api-access-szr6t\") pod \"service-ca-58598695f7-v5x6q\" (UID: \"94e6396e-ad77-4b9e-a77f-105d18ba2741\") " pod="openshift-service-ca/service-ca-58598695f7-v5x6q"
Jul 18 11:20:31.674163 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:31.674083    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-58598695f7-v5x6q"
Jul 18 11:20:31.986572 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:31.986495    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/33c02514-4254-498e-86eb-8d7d858bc338-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2l7gv\" (UID: \"33c02514-4254-498e-86eb-8d7d858bc338\") " pod="openshift-insights/insights-runtime-extractor-2l7gv"
Jul 18 11:20:31.986572 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:31.986567    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/33c02514-4254-498e-86eb-8d7d858bc338-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2l7gv\" (UID: \"33c02514-4254-498e-86eb-8d7d858bc338\") " pod="openshift-insights/insights-runtime-extractor-2l7gv"
Jul 18 11:20:31.986752 ip-10-0-133-122 kubenswrapper[2579]: E0718 11:20:31.986638    2579 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 18 11:20:31.986752 ip-10-0-133-122 kubenswrapper[2579]: E0718 11:20:31.986665    2579 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 18 11:20:31.986752 ip-10-0-133-122 kubenswrapper[2579]: E0718 11:20:31.986718    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/33c02514-4254-498e-86eb-8d7d858bc338-kube-rbac-proxy-cm podName:33c02514-4254-498e-86eb-8d7d858bc338 nodeName:}" failed. No retries permitted until 2026-07-18 11:20:35.986702282 +0000 UTC m=+55.601738561 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/33c02514-4254-498e-86eb-8d7d858bc338-kube-rbac-proxy-cm") pod "insights-runtime-extractor-2l7gv" (UID: "33c02514-4254-498e-86eb-8d7d858bc338") : configmap "kube-rbac-proxy" not found
Jul 18 11:20:31.986752 ip-10-0-133-122 kubenswrapper[2579]: E0718 11:20:31.986732    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/33c02514-4254-498e-86eb-8d7d858bc338-insights-runtime-extractor-tls podName:33c02514-4254-498e-86eb-8d7d858bc338 nodeName:}" failed. No retries permitted until 2026-07-18 11:20:35.98672618 +0000 UTC m=+55.601762460 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/33c02514-4254-498e-86eb-8d7d858bc338-insights-runtime-extractor-tls") pod "insights-runtime-extractor-2l7gv" (UID: "33c02514-4254-498e-86eb-8d7d858bc338") : secret "insights-runtime-extractor-tls" not found
Jul 18 11:20:32.997749 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:32.997703    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/099bdb04-cb99-4be4-8f98-76ed8839204e-registry-tls\") pod \"image-registry-594b7ddb68-98wbn\" (UID: \"099bdb04-cb99-4be4-8f98-76ed8839204e\") " pod="openshift-image-registry/image-registry-594b7ddb68-98wbn"
Jul 18 11:20:32.998258 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:32.997768    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/f4e046d0-f0d1-453c-8729-b2191f050b73-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-fzxs7\" (UID: \"f4e046d0-f0d1-453c-8729-b2191f050b73\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-fzxs7"
Jul 18 11:20:32.998258 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:32.997870    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/067c96d7-6025-43a0-872a-9134f16c8221-service-ca-bundle\") pod \"router-default-64cdb59cb-q4c6l\" (UID: \"067c96d7-6025-43a0-872a-9134f16c8221\") " pod="openshift-ingress/router-default-64cdb59cb-q4c6l"
Jul 18 11:20:32.998258 ip-10-0-133-122 kubenswrapper[2579]: E0718 11:20:32.997901    2579 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 18 11:20:32.998258 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:32.997920    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/57dfdac3-878d-43df-84ab-0996f5fba323-metrics-tls\") pod \"dns-default-kv2jv\" (UID: \"57dfdac3-878d-43df-84ab-0996f5fba323\") " pod="openshift-dns/dns-default-kv2jv"
Jul 18 11:20:32.998258 ip-10-0-133-122 kubenswrapper[2579]: E0718 11:20:32.997905    2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 18 11:20:32.998258 ip-10-0-133-122 kubenswrapper[2579]: E0718 11:20:32.997982    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f4e046d0-f0d1-453c-8729-b2191f050b73-cluster-monitoring-operator-tls podName:f4e046d0-f0d1-453c-8729-b2191f050b73 nodeName:}" failed. No retries permitted until 2026-07-18 11:20:48.997960173 +0000 UTC m=+68.612996476 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/f4e046d0-f0d1-453c-8729-b2191f050b73-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-fzxs7" (UID: "f4e046d0-f0d1-453c-8729-b2191f050b73") : secret "cluster-monitoring-operator-tls" not found
Jul 18 11:20:32.998258 ip-10-0-133-122 kubenswrapper[2579]: E0718 11:20:32.997991    2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-594b7ddb68-98wbn: secret "image-registry-tls" not found
Jul 18 11:20:32.998258 ip-10-0-133-122 kubenswrapper[2579]: E0718 11:20:32.998032    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/099bdb04-cb99-4be4-8f98-76ed8839204e-registry-tls podName:099bdb04-cb99-4be4-8f98-76ed8839204e nodeName:}" failed. No retries permitted until 2026-07-18 11:20:48.998020401 +0000 UTC m=+68.613056693 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/099bdb04-cb99-4be4-8f98-76ed8839204e-registry-tls") pod "image-registry-594b7ddb68-98wbn" (UID: "099bdb04-cb99-4be4-8f98-76ed8839204e") : secret "image-registry-tls" not found
Jul 18 11:20:32.998258 ip-10-0-133-122 kubenswrapper[2579]: E0718 11:20:32.998036    2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 18 11:20:32.998258 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:32.998052    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/067c96d7-6025-43a0-872a-9134f16c8221-metrics-certs\") pod \"router-default-64cdb59cb-q4c6l\" (UID: \"067c96d7-6025-43a0-872a-9134f16c8221\") " pod="openshift-ingress/router-default-64cdb59cb-q4c6l"
Jul 18 11:20:32.998258 ip-10-0-133-122 kubenswrapper[2579]: E0718 11:20:32.998065    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/067c96d7-6025-43a0-872a-9134f16c8221-service-ca-bundle podName:067c96d7-6025-43a0-872a-9134f16c8221 nodeName:}" failed. No retries permitted until 2026-07-18 11:20:48.998044363 +0000 UTC m=+68.613080648 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/067c96d7-6025-43a0-872a-9134f16c8221-service-ca-bundle") pod "router-default-64cdb59cb-q4c6l" (UID: "067c96d7-6025-43a0-872a-9134f16c8221") : configmap references non-existent config key: service-ca.crt
Jul 18 11:20:32.998258 ip-10-0-133-122 kubenswrapper[2579]: E0718 11:20:32.998099    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/57dfdac3-878d-43df-84ab-0996f5fba323-metrics-tls podName:57dfdac3-878d-43df-84ab-0996f5fba323 nodeName:}" failed. No retries permitted until 2026-07-18 11:20:48.998087841 +0000 UTC m=+68.613124126 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/57dfdac3-878d-43df-84ab-0996f5fba323-metrics-tls") pod "dns-default-kv2jv" (UID: "57dfdac3-878d-43df-84ab-0996f5fba323") : secret "dns-default-metrics-tls" not found
Jul 18 11:20:32.998258 ip-10-0-133-122 kubenswrapper[2579]: E0718 11:20:32.998111    2579 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 18 11:20:32.998258 ip-10-0-133-122 kubenswrapper[2579]: E0718 11:20:32.998142    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/067c96d7-6025-43a0-872a-9134f16c8221-metrics-certs podName:067c96d7-6025-43a0-872a-9134f16c8221 nodeName:}" failed. No retries permitted until 2026-07-18 11:20:48.998132345 +0000 UTC m=+68.613168641 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/067c96d7-6025-43a0-872a-9134f16c8221-metrics-certs") pod "router-default-64cdb59cb-q4c6l" (UID: "067c96d7-6025-43a0-872a-9134f16c8221") : secret "router-metrics-certs-default" not found
Jul 18 11:20:32.998258 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:32.998161    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/37a0a359-1903-477c-8f8a-80712275ad64-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-2ls6p\" (UID: \"37a0a359-1903-477c-8f8a-80712275ad64\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-2ls6p"
Jul 18 11:20:32.998979 ip-10-0-133-122 kubenswrapper[2579]: E0718 11:20:32.998302    2579 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 18 11:20:32.998979 ip-10-0-133-122 kubenswrapper[2579]: E0718 11:20:32.998356    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/37a0a359-1903-477c-8f8a-80712275ad64-samples-operator-tls podName:37a0a359-1903-477c-8f8a-80712275ad64 nodeName:}" failed. No retries permitted until 2026-07-18 11:20:48.998339918 +0000 UTC m=+68.613376200 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/37a0a359-1903-477c-8f8a-80712275ad64-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-2ls6p" (UID: "37a0a359-1903-477c-8f8a-80712275ad64") : secret "samples-operator-tls" not found
Jul 18 11:20:33.099480 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:33.099441    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/63d7c8c7-1716-489e-8698-e49c93a85050-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-v6n2x\" (UID: \"63d7c8c7-1716-489e-8698-e49c93a85050\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-v6n2x"
Jul 18 11:20:33.099677 ip-10-0-133-122 kubenswrapper[2579]: E0718 11:20:33.099615    2579 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 18 11:20:33.099737 ip-10-0-133-122 kubenswrapper[2579]: E0718 11:20:33.099695    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/63d7c8c7-1716-489e-8698-e49c93a85050-networking-console-plugin-cert podName:63d7c8c7-1716-489e-8698-e49c93a85050 nodeName:}" failed. No retries permitted until 2026-07-18 11:20:49.099674499 +0000 UTC m=+68.714710781 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/63d7c8c7-1716-489e-8698-e49c93a85050-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-v6n2x" (UID: "63d7c8c7-1716-489e-8698-e49c93a85050") : secret "networking-console-plugin-cert" not found
Jul 18 11:20:35.391740 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:35.391709    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-58598695f7-v5x6q"]
Jul 18 11:20:35.395992 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:20:35.395963    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod94e6396e_ad77_4b9e_a77f_105d18ba2741.slice/crio-6641fe521cae4f06bcd48b53d222de9e53ddaae111f447d4afbbae7cd9c178ff WatchSource:0}: Error finding container 6641fe521cae4f06bcd48b53d222de9e53ddaae111f447d4afbbae7cd9c178ff: Status 404 returned error can't find the container with id 6641fe521cae4f06bcd48b53d222de9e53ddaae111f447d4afbbae7cd9c178ff
Jul 18 11:20:36.029195 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:36.029159    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/33c02514-4254-498e-86eb-8d7d858bc338-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2l7gv\" (UID: \"33c02514-4254-498e-86eb-8d7d858bc338\") " pod="openshift-insights/insights-runtime-extractor-2l7gv"
Jul 18 11:20:36.029394 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:36.029300    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/33c02514-4254-498e-86eb-8d7d858bc338-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2l7gv\" (UID: \"33c02514-4254-498e-86eb-8d7d858bc338\") " pod="openshift-insights/insights-runtime-extractor-2l7gv"
Jul 18 11:20:36.029394 ip-10-0-133-122 kubenswrapper[2579]: E0718 11:20:36.029335    2579 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 18 11:20:36.029467 ip-10-0-133-122 kubenswrapper[2579]: E0718 11:20:36.029401    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/33c02514-4254-498e-86eb-8d7d858bc338-insights-runtime-extractor-tls podName:33c02514-4254-498e-86eb-8d7d858bc338 nodeName:}" failed. No retries permitted until 2026-07-18 11:20:44.029385346 +0000 UTC m=+63.644421626 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/33c02514-4254-498e-86eb-8d7d858bc338-insights-runtime-extractor-tls") pod "insights-runtime-extractor-2l7gv" (UID: "33c02514-4254-498e-86eb-8d7d858bc338") : secret "insights-runtime-extractor-tls" not found
Jul 18 11:20:36.029804 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:36.029788    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/33c02514-4254-498e-86eb-8d7d858bc338-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2l7gv\" (UID: \"33c02514-4254-498e-86eb-8d7d858bc338\") " pod="openshift-insights/insights-runtime-extractor-2l7gv"
Jul 18 11:20:36.305699 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:36.305583    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-69d69956f7-lpbnb" event={"ID":"2ee04fb4-5905-4a32-9f9b-cccd53f60f5a","Type":"ContainerStarted","Data":"97fe9e9f8afa4cb0e8518a438beab0baf02df6315dc8d8ec408a2eb3584797c3"}
Jul 18 11:20:36.305699 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:36.305648    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-69d69956f7-lpbnb" event={"ID":"2ee04fb4-5905-4a32-9f9b-cccd53f60f5a","Type":"ContainerStarted","Data":"c277223137d013f63e987b69cc24fd1640e386462a0e2ab12c2da328af1eff04"}
Jul 18 11:20:36.305699 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:36.305666    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-69d69956f7-lpbnb" event={"ID":"2ee04fb4-5905-4a32-9f9b-cccd53f60f5a","Type":"ContainerStarted","Data":"6f1e1acac59df44b9f080a2572899871ae5263bbad824691450576c28e1928af"}
Jul 18 11:20:36.307154 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:36.307128    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6948895d4d-htfwq" event={"ID":"2d5ed932-8778-4ad2-875d-df39f5c18884","Type":"ContainerStarted","Data":"c4c5d889bdae46847de1326e74e1c58e41e463459a7b58e2d7ffb29a47619ee5"}
Jul 18 11:20:36.308665 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:36.308640    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5769ff544c-wmjqn" event={"ID":"a252d7fc-6695-42c5-b9c3-a02dc7104cfd","Type":"ContainerStarted","Data":"49ec7815a4572df03d60b58992ac7a79469c51e5b4e262901283958477c42d8b"}
Jul 18 11:20:36.308758 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:36.308722    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5769ff544c-wmjqn"
Jul 18 11:20:36.310721 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:36.310695    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-m68sg" event={"ID":"cea912a4-ac4a-4b4d-979e-812f1ac845ed","Type":"ContainerStarted","Data":"4c5138db1eb5cb77fcbe545dbeca7a1a6ab8c8ff6a68233621527b3ab58fa462"}
Jul 18 11:20:36.310821 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:36.310768    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5769ff544c-wmjqn"
Jul 18 11:20:36.310821 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:36.310800    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-m68sg" event={"ID":"cea912a4-ac4a-4b4d-979e-812f1ac845ed","Type":"ContainerStarted","Data":"2731472b6188a9cd363e91ecae942bd653bc337cb81b97176eac612e8516faf1"}
Jul 18 11:20:36.312037 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:36.312018    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-58598695f7-v5x6q" event={"ID":"94e6396e-ad77-4b9e-a77f-105d18ba2741","Type":"ContainerStarted","Data":"0c78785602937c920103b56901b814dea3f09b08c012b6428e0da24f7afbf77e"}
Jul 18 11:20:36.312112 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:36.312051    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-58598695f7-v5x6q" event={"ID":"94e6396e-ad77-4b9e-a77f-105d18ba2741","Type":"ContainerStarted","Data":"6641fe521cae4f06bcd48b53d222de9e53ddaae111f447d4afbbae7cd9c178ff"}
Jul 18 11:20:36.323836 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:36.323785    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-69d69956f7-lpbnb" podStartSLOduration=1.782795956 podStartE2EDuration="9.323772707s" totalImagesPullingTime="7.540976751s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 11:20:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 11:20:36.32185665 +0000 UTC m=+55.936892952" watchObservedRunningTime="2026-07-18 11:20:36.323772707 +0000 UTC m=+55.938809048"
Jul 18 11:20:36.336049 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:36.336005    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5769ff544c-wmjqn" podStartSLOduration=1.666910473 podStartE2EDuration="9.335990081s" totalImagesPullingTime="7.669079608s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 11:20:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 11:20:36.335477249 +0000 UTC m=+55.950513552" watchObservedRunningTime="2026-07-18 11:20:36.335990081 +0000 UTC m=+55.951026377"
Jul 18 11:20:36.349403 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:36.349354    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-58598695f7-v5x6q" podStartSLOduration=5.349339457 podStartE2EDuration="5.349339457s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 11:20:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 11:20:36.34891269 +0000 UTC m=+55.963948990" watchObservedRunningTime="2026-07-18 11:20:36.349339457 +0000 UTC m=+55.964375750"
Jul 18 11:20:36.363617 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:36.363571    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6948895d4d-htfwq" podStartSLOduration=1.8058584610000001 podStartE2EDuration="9.363555263s" totalImagesPullingTime="7.557696802s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 11:20:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 11:20:36.363279364 +0000 UTC m=+55.978315676" watchObservedRunningTime="2026-07-18 11:20:36.363555263 +0000 UTC m=+55.978591565"
Jul 18 11:20:36.382212 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:36.382159    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-m68sg" podStartSLOduration=2.094576698 podStartE2EDuration="8.382142765s" totalImagesPullingTime="6.287566067s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 11:20:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 11:20:36.381165933 +0000 UTC m=+55.996202235" watchObservedRunningTime="2026-07-18 11:20:36.382142765 +0000 UTC m=+55.997179122"
Jul 18 11:20:37.484491 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:37.484443    2579 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-69d69956f7-lpbnb" podUID="2ee04fb4-5905-4a32-9f9b-cccd53f60f5a" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
Jul 18 11:20:37.518361 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:37.518321    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-565b7b569d-jfpn7"
Jul 18 11:20:37.518558 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:37.518388    2579 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-565b7b569d-jfpn7"
Jul 18 11:20:37.518765 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:37.518751    2579 scope.go:117] "RemoveContainer" containerID="d03aa069d805d56554d37e2777d7bdeee3e607495a7479d493f3f303f8868fc2"
Jul 18 11:20:38.322166 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:38.322137    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-jfpn7_759a894c-1828-4ac9-a7c3-77354a104247/console-operator/2.log"
Jul 18 11:20:38.322558 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:38.322541    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-jfpn7_759a894c-1828-4ac9-a7c3-77354a104247/console-operator/1.log"
Jul 18 11:20:38.322658 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:38.322581    2579 generic.go:356] "Generic (PLEG): container finished" podID="759a894c-1828-4ac9-a7c3-77354a104247" containerID="18506a8f6ffedd34727ba2ae13d6668b606759a71b152185962637deb27212a9" exitCode=255
Jul 18 11:20:38.322716 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:38.322663    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-jfpn7" event={"ID":"759a894c-1828-4ac9-a7c3-77354a104247","Type":"ContainerDied","Data":"18506a8f6ffedd34727ba2ae13d6668b606759a71b152185962637deb27212a9"}
Jul 18 11:20:38.322770 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:38.322737    2579 scope.go:117] "RemoveContainer" containerID="d03aa069d805d56554d37e2777d7bdeee3e607495a7479d493f3f303f8868fc2"
Jul 18 11:20:38.323195 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:38.323174    2579 scope.go:117] "RemoveContainer" containerID="18506a8f6ffedd34727ba2ae13d6668b606759a71b152185962637deb27212a9"
Jul 18 11:20:38.323360 ip-10-0-133-122 kubenswrapper[2579]: E0718 11:20:38.323326    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-565b7b569d-jfpn7_openshift-console-operator(759a894c-1828-4ac9-a7c3-77354a104247)\"" pod="openshift-console-operator/console-operator-565b7b569d-jfpn7" podUID="759a894c-1828-4ac9-a7c3-77354a104247"
Jul 18 11:20:39.327085 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:39.327055    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-jfpn7_759a894c-1828-4ac9-a7c3-77354a104247/console-operator/2.log"
Jul 18 11:20:43.050751 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:43.050718    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-58jnn"
Jul 18 11:20:44.108527 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:44.108479    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/33c02514-4254-498e-86eb-8d7d858bc338-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2l7gv\" (UID: \"33c02514-4254-498e-86eb-8d7d858bc338\") " pod="openshift-insights/insights-runtime-extractor-2l7gv"
Jul 18 11:20:44.110763 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:44.110742    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/33c02514-4254-498e-86eb-8d7d858bc338-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2l7gv\" (UID: \"33c02514-4254-498e-86eb-8d7d858bc338\") " pod="openshift-insights/insights-runtime-extractor-2l7gv"
Jul 18 11:20:44.225878 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:44.225847    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-nhs4n\""
Jul 18 11:20:44.233988 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:44.233962    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-2l7gv"
Jul 18 11:20:44.363616 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:44.363398    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-2l7gv"]
Jul 18 11:20:44.366031 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:20:44.366004    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod33c02514_4254_498e_86eb_8d7d858bc338.slice/crio-0bb6a060b79e4fc368d8819e3d790c2f4aba1aa3628d1fa44e9394f7797c1b8c WatchSource:0}: Error finding container 0bb6a060b79e4fc368d8819e3d790c2f4aba1aa3628d1fa44e9394f7797c1b8c: Status 404 returned error can't find the container with id 0bb6a060b79e4fc368d8819e3d790c2f4aba1aa3628d1fa44e9394f7797c1b8c
Jul 18 11:20:45.348945 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:45.348905    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-2l7gv" event={"ID":"33c02514-4254-498e-86eb-8d7d858bc338","Type":"ContainerStarted","Data":"0bb6a060b79e4fc368d8819e3d790c2f4aba1aa3628d1fa44e9394f7797c1b8c"}
Jul 18 11:20:46.634519 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:46.634471    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b4c72690-9e6e-4826-8ff8-95eeea44b5d0-original-pull-secret\") pod \"global-pull-secret-syncer-6j4vg\" (UID: \"b4c72690-9e6e-4826-8ff8-95eeea44b5d0\") " pod="kube-system/global-pull-secret-syncer-6j4vg"
Jul 18 11:20:46.634519 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:46.634527    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0e090c50-e996-4eda-b8c0-46d7f7d7dde3-metrics-certs\") pod \"network-metrics-daemon-ljhk6\" (UID: \"0e090c50-e996-4eda-b8c0-46d7f7d7dde3\") " pod="openshift-multus/network-metrics-daemon-ljhk6"
Jul 18 11:20:46.637125 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:46.637092    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 18 11:20:46.637125 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:46.637123    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 18 11:20:46.647848 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:46.647819    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b4c72690-9e6e-4826-8ff8-95eeea44b5d0-original-pull-secret\") pod \"global-pull-secret-syncer-6j4vg\" (UID: \"b4c72690-9e6e-4826-8ff8-95eeea44b5d0\") " pod="kube-system/global-pull-secret-syncer-6j4vg"
Jul 18 11:20:46.648015 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:46.647830    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0e090c50-e996-4eda-b8c0-46d7f7d7dde3-metrics-certs\") pod \"network-metrics-daemon-ljhk6\" (UID: \"0e090c50-e996-4eda-b8c0-46d7f7d7dde3\") " pod="openshift-multus/network-metrics-daemon-ljhk6"
Jul 18 11:20:46.837360 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:46.837323    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d9kdd\" (UniqueName: \"kubernetes.io/projected/17f689f0-ceae-4eb8-acaa-922caaa8e3f8-kube-api-access-d9kdd\") pod \"network-check-target-cj4nh\" (UID: \"17f689f0-ceae-4eb8-acaa-922caaa8e3f8\") " pod="openshift-network-diagnostics/network-check-target-cj4nh"
Jul 18 11:20:46.840107 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:46.840078    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d9kdd\" (UniqueName: \"kubernetes.io/projected/17f689f0-ceae-4eb8-acaa-922caaa8e3f8-kube-api-access-d9kdd\") pod \"network-check-target-cj4nh\" (UID: \"17f689f0-ceae-4eb8-acaa-922caaa8e3f8\") " pod="openshift-network-diagnostics/network-check-target-cj4nh"
Jul 18 11:20:46.842828 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:46.842800    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-s78sq\""
Jul 18 11:20:46.851253 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:46.851217    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cj4nh"
Jul 18 11:20:46.866394 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:46.866372    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-b49zp\""
Jul 18 11:20:46.874419 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:46.874395    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ljhk6"
Jul 18 11:20:46.881452 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:46.881431    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6j4vg"
Jul 18 11:20:47.484590 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:47.484537    2579 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-69d69956f7-lpbnb" podUID="2ee04fb4-5905-4a32-9f9b-cccd53f60f5a" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
Jul 18 11:20:47.518942 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:47.518900    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-565b7b569d-jfpn7"
Jul 18 11:20:47.519114 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:47.518992    2579 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-565b7b569d-jfpn7"
Jul 18 11:20:47.519383 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:47.519364    2579 scope.go:117] "RemoveContainer" containerID="18506a8f6ffedd34727ba2ae13d6668b606759a71b152185962637deb27212a9"
Jul 18 11:20:47.519568 ip-10-0-133-122 kubenswrapper[2579]: E0718 11:20:47.519544    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-565b7b569d-jfpn7_openshift-console-operator(759a894c-1828-4ac9-a7c3-77354a104247)\"" pod="openshift-console-operator/console-operator-565b7b569d-jfpn7" podUID="759a894c-1828-4ac9-a7c3-77354a104247"
Jul 18 11:20:49.060589 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:49.060552    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/099bdb04-cb99-4be4-8f98-76ed8839204e-registry-tls\") pod \"image-registry-594b7ddb68-98wbn\" (UID: \"099bdb04-cb99-4be4-8f98-76ed8839204e\") " pod="openshift-image-registry/image-registry-594b7ddb68-98wbn"
Jul 18 11:20:49.060589 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:49.060592    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/f4e046d0-f0d1-453c-8729-b2191f050b73-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-fzxs7\" (UID: \"f4e046d0-f0d1-453c-8729-b2191f050b73\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-fzxs7"
Jul 18 11:20:49.061066 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:49.060643    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/067c96d7-6025-43a0-872a-9134f16c8221-service-ca-bundle\") pod \"router-default-64cdb59cb-q4c6l\" (UID: \"067c96d7-6025-43a0-872a-9134f16c8221\") " pod="openshift-ingress/router-default-64cdb59cb-q4c6l"
Jul 18 11:20:49.061066 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:49.060662    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/57dfdac3-878d-43df-84ab-0996f5fba323-metrics-tls\") pod \"dns-default-kv2jv\" (UID: \"57dfdac3-878d-43df-84ab-0996f5fba323\") " pod="openshift-dns/dns-default-kv2jv"
Jul 18 11:20:49.061066 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:49.060693    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/067c96d7-6025-43a0-872a-9134f16c8221-metrics-certs\") pod \"router-default-64cdb59cb-q4c6l\" (UID: \"067c96d7-6025-43a0-872a-9134f16c8221\") " pod="openshift-ingress/router-default-64cdb59cb-q4c6l"
Jul 18 11:20:49.061066 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:49.060727    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/37a0a359-1903-477c-8f8a-80712275ad64-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-2ls6p\" (UID: \"37a0a359-1903-477c-8f8a-80712275ad64\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-2ls6p"
Jul 18 11:20:49.061401 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:49.061362    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/067c96d7-6025-43a0-872a-9134f16c8221-service-ca-bundle\") pod \"router-default-64cdb59cb-q4c6l\" (UID: \"067c96d7-6025-43a0-872a-9134f16c8221\") " pod="openshift-ingress/router-default-64cdb59cb-q4c6l"
Jul 18 11:20:49.063144 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:49.063116    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/099bdb04-cb99-4be4-8f98-76ed8839204e-registry-tls\") pod \"image-registry-594b7ddb68-98wbn\" (UID: \"099bdb04-cb99-4be4-8f98-76ed8839204e\") " pod="openshift-image-registry/image-registry-594b7ddb68-98wbn"
Jul 18 11:20:49.063638 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:49.063327    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/067c96d7-6025-43a0-872a-9134f16c8221-metrics-certs\") pod \"router-default-64cdb59cb-q4c6l\" (UID: \"067c96d7-6025-43a0-872a-9134f16c8221\") " pod="openshift-ingress/router-default-64cdb59cb-q4c6l"
Jul 18 11:20:49.063638 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:49.063582    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/57dfdac3-878d-43df-84ab-0996f5fba323-metrics-tls\") pod \"dns-default-kv2jv\" (UID: \"57dfdac3-878d-43df-84ab-0996f5fba323\") " pod="openshift-dns/dns-default-kv2jv"
Jul 18 11:20:49.063638 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:49.063586    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/37a0a359-1903-477c-8f8a-80712275ad64-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-2ls6p\" (UID: \"37a0a359-1903-477c-8f8a-80712275ad64\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-2ls6p"
Jul 18 11:20:49.064002 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:49.063668    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/f4e046d0-f0d1-453c-8729-b2191f050b73-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-fzxs7\" (UID: \"f4e046d0-f0d1-453c-8729-b2191f050b73\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-fzxs7"
Jul 18 11:20:49.068832 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:49.068814    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-72crb\""
Jul 18 11:20:49.075851 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:49.075835    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-rn2n2\""
Jul 18 11:20:49.076860 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:49.076839    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-kv2jv"
Jul 18 11:20:49.084077 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:49.084055    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-2ls6p"
Jul 18 11:20:49.096710 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:49.096603    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-ldvvj\""
Jul 18 11:20:49.104763 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:49.104737    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-64cdb59cb-q4c6l"
Jul 18 11:20:49.161231 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:49.161201    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/63d7c8c7-1716-489e-8698-e49c93a85050-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-v6n2x\" (UID: \"63d7c8c7-1716-489e-8698-e49c93a85050\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-v6n2x"
Jul 18 11:20:49.163608 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:49.163577    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/63d7c8c7-1716-489e-8698-e49c93a85050-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-v6n2x\" (UID: \"63d7c8c7-1716-489e-8698-e49c93a85050\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-v6n2x"
Jul 18 11:20:49.341949 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:49.341863    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-7bhxp\""
Jul 18 11:20:49.349961 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:49.349932    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-fzxs7"
Jul 18 11:20:49.354494 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:49.354471    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-hnxrg\""
Jul 18 11:20:49.362400 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:49.362379    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-594b7ddb68-98wbn"
Jul 18 11:20:49.404549 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:49.404470    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-qfzzr\""
Jul 18 11:20:49.412442 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:49.412418    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-v6n2x"
Jul 18 11:20:50.068788 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:50.068706    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-cj4nh"]
Jul 18 11:20:50.208360 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:50.208196    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-ljhk6"]
Jul 18 11:20:50.215015 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:20:50.214977    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0e090c50_e996_4eda_b8c0_46d7f7d7dde3.slice/crio-f784d1fa21de8bdfecc46b82930d233ada23afe896a82294a98e7a1a23931aea WatchSource:0}: Error finding container f784d1fa21de8bdfecc46b82930d233ada23afe896a82294a98e7a1a23931aea: Status 404 returned error can't find the container with id f784d1fa21de8bdfecc46b82930d233ada23afe896a82294a98e7a1a23931aea
Jul 18 11:20:50.231234 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:50.231132    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-6j4vg"]
Jul 18 11:20:50.233860 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:20:50.233822    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb4c72690_9e6e_4826_8ff8_95eeea44b5d0.slice/crio-0c59b2ef5fafe3a7cc2afd162a0d89ce10fc5fa6d85b2a4b4dc194e9018bb0a9 WatchSource:0}: Error finding container 0c59b2ef5fafe3a7cc2afd162a0d89ce10fc5fa6d85b2a4b4dc194e9018bb0a9: Status 404 returned error can't find the container with id 0c59b2ef5fafe3a7cc2afd162a0d89ce10fc5fa6d85b2a4b4dc194e9018bb0a9
Jul 18 11:20:50.367487 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:50.367450    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-6j4vg" event={"ID":"b4c72690-9e6e-4826-8ff8-95eeea44b5d0","Type":"ContainerStarted","Data":"0c59b2ef5fafe3a7cc2afd162a0d89ce10fc5fa6d85b2a4b4dc194e9018bb0a9"}
Jul 18 11:20:50.368534 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:50.368511    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-ljhk6" event={"ID":"0e090c50-e996-4eda-b8c0-46d7f7d7dde3","Type":"ContainerStarted","Data":"f784d1fa21de8bdfecc46b82930d233ada23afe896a82294a98e7a1a23931aea"}
Jul 18 11:20:50.369868 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:50.369848    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-2l7gv" event={"ID":"33c02514-4254-498e-86eb-8d7d858bc338","Type":"ContainerStarted","Data":"e6b1b51a20dd3465e11d0f9b4f8f0c547e94c51ba82cc8f4f0cfb16986b21381"}
Jul 18 11:20:50.371257 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:50.371237    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-cj4nh" event={"ID":"17f689f0-ceae-4eb8-acaa-922caaa8e3f8","Type":"ContainerStarted","Data":"2854dd24ed825d0e451206cc733e454c62e04f3e3306203d39b2f01061c9f81c"}
Jul 18 11:20:50.371338 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:50.371271    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-cj4nh" event={"ID":"17f689f0-ceae-4eb8-acaa-922caaa8e3f8","Type":"ContainerStarted","Data":"991ccd85c7763363edc4b8a4dca33703cbb9d476ac5cb181d4f24e09e59e2c45"}
Jul 18 11:20:50.371377 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:50.371342    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-cj4nh"
Jul 18 11:20:50.386220 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:50.386131    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-cj4nh" podStartSLOduration=69.386112926 podStartE2EDuration="1m9.386112926s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 11:19:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 11:20:50.385694486 +0000 UTC m=+70.000730790" watchObservedRunningTime="2026-07-18 11:20:50.386112926 +0000 UTC m=+70.001149243"
Jul 18 11:20:50.429903 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:50.429855    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-76cf8966f8-fzxs7"]
Jul 18 11:20:50.431041 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:50.431017    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-7bc7489cb5-v6n2x"]
Jul 18 11:20:50.432311 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:20:50.432276    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod63d7c8c7_1716_489e_8698_e49c93a85050.slice/crio-16c135ee7735c1a3d60a4477f8471f25ffb0ebcdbadb40db5101ea08116b6b91 WatchSource:0}: Error finding container 16c135ee7735c1a3d60a4477f8471f25ffb0ebcdbadb40db5101ea08116b6b91: Status 404 returned error can't find the container with id 16c135ee7735c1a3d60a4477f8471f25ffb0ebcdbadb40db5101ea08116b6b91
Jul 18 11:20:50.433034 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:20:50.433014    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf4e046d0_f0d1_453c_8729_b2191f050b73.slice/crio-58d3e2948ef7a637119aa3147987a36d8142b6cf21d920c98ddc89262d094c21 WatchSource:0}: Error finding container 58d3e2948ef7a637119aa3147987a36d8142b6cf21d920c98ddc89262d094c21: Status 404 returned error can't find the container with id 58d3e2948ef7a637119aa3147987a36d8142b6cf21d920c98ddc89262d094c21
Jul 18 11:20:50.479530 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:50.479492    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-2ls6p"]
Jul 18 11:20:50.482950 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:50.482920    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-594b7ddb68-98wbn"]
Jul 18 11:20:50.484908 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:50.484846    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-kv2jv"]
Jul 18 11:20:50.486171 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:50.486151    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-64cdb59cb-q4c6l"]
Jul 18 11:20:50.486464 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:20:50.486431    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod57dfdac3_878d_43df_84ab_0996f5fba323.slice/crio-f3d6fed72250648748efb448bb38dd47c9cc6225007865896cedc6cf77e5b19d WatchSource:0}: Error finding container f3d6fed72250648748efb448bb38dd47c9cc6225007865896cedc6cf77e5b19d: Status 404 returned error can't find the container with id f3d6fed72250648748efb448bb38dd47c9cc6225007865896cedc6cf77e5b19d
Jul 18 11:20:50.487741 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:20:50.487716    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod099bdb04_cb99_4be4_8f98_76ed8839204e.slice/crio-9dd9a6e585cd32c520eb3235572fe0ad240bbf13c3e9666bb5230e6543bebd73 WatchSource:0}: Error finding container 9dd9a6e585cd32c520eb3235572fe0ad240bbf13c3e9666bb5230e6543bebd73: Status 404 returned error can't find the container with id 9dd9a6e585cd32c520eb3235572fe0ad240bbf13c3e9666bb5230e6543bebd73
Jul 18 11:20:50.496090 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:20:50.496061    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod067c96d7_6025_43a0_872a_9134f16c8221.slice/crio-1952c3155d566ded94737e24203cc3bbb850a9dde5b1cb194a61a5187355e473 WatchSource:0}: Error finding container 1952c3155d566ded94737e24203cc3bbb850a9dde5b1cb194a61a5187355e473: Status 404 returned error can't find the container with id 1952c3155d566ded94737e24203cc3bbb850a9dde5b1cb194a61a5187355e473
Jul 18 11:20:51.385050 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:51.384949    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-fzxs7" event={"ID":"f4e046d0-f0d1-453c-8729-b2191f050b73","Type":"ContainerStarted","Data":"58d3e2948ef7a637119aa3147987a36d8142b6cf21d920c98ddc89262d094c21"}
Jul 18 11:20:51.387479 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:51.387380    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-2ls6p" event={"ID":"37a0a359-1903-477c-8f8a-80712275ad64","Type":"ContainerStarted","Data":"0a2feea042f78073d684765950c3696eb0587b3f3d575749b5e9fd7edeb822a8"}
Jul 18 11:20:51.396614 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:51.396462    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-594b7ddb68-98wbn" event={"ID":"099bdb04-cb99-4be4-8f98-76ed8839204e","Type":"ContainerStarted","Data":"83558e74aa2357a88410475abba40818004f7c588a54988391b585cd68b785f4"}
Jul 18 11:20:51.396614 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:51.396525    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-594b7ddb68-98wbn" event={"ID":"099bdb04-cb99-4be4-8f98-76ed8839204e","Type":"ContainerStarted","Data":"9dd9a6e585cd32c520eb3235572fe0ad240bbf13c3e9666bb5230e6543bebd73"}
Jul 18 11:20:51.396614 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:51.396580    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-594b7ddb68-98wbn"
Jul 18 11:20:51.407588 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:51.407552    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-kv2jv" event={"ID":"57dfdac3-878d-43df-84ab-0996f5fba323","Type":"ContainerStarted","Data":"f3d6fed72250648748efb448bb38dd47c9cc6225007865896cedc6cf77e5b19d"}
Jul 18 11:20:51.413863 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:51.413234    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-64cdb59cb-q4c6l" event={"ID":"067c96d7-6025-43a0-872a-9134f16c8221","Type":"ContainerStarted","Data":"9809f2ef38cb048f3a5786079c501a57c6c5bad104cd51c7847b80b72b63991b"}
Jul 18 11:20:51.413863 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:51.413287    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-64cdb59cb-q4c6l" event={"ID":"067c96d7-6025-43a0-872a-9134f16c8221","Type":"ContainerStarted","Data":"1952c3155d566ded94737e24203cc3bbb850a9dde5b1cb194a61a5187355e473"}
Jul 18 11:20:51.420192 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:51.420125    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-v6n2x" event={"ID":"63d7c8c7-1716-489e-8698-e49c93a85050","Type":"ContainerStarted","Data":"16c135ee7735c1a3d60a4477f8471f25ffb0ebcdbadb40db5101ea08116b6b91"}
Jul 18 11:20:51.420192 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:51.420121    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-594b7ddb68-98wbn" podStartSLOduration=70.420099582 podStartE2EDuration="1m10.420099582s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 11:19:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 11:20:51.418815381 +0000 UTC m=+71.033851681" watchObservedRunningTime="2026-07-18 11:20:51.420099582 +0000 UTC m=+71.035135885"
Jul 18 11:20:51.442915 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:51.441013    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-64cdb59cb-q4c6l" podStartSLOduration=69.440995405 podStartE2EDuration="1m9.440995405s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 11:19:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 11:20:51.440238673 +0000 UTC m=+71.055274976" watchObservedRunningTime="2026-07-18 11:20:51.440995405 +0000 UTC m=+71.056031699"
Jul 18 11:20:52.105343 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:52.105306    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-64cdb59cb-q4c6l"
Jul 18 11:20:52.108613 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:52.108585    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-64cdb59cb-q4c6l"
Jul 18 11:20:52.431077 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:52.430971    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-64cdb59cb-q4c6l"
Jul 18 11:20:52.433017 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:52.432782    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-64cdb59cb-q4c6l"
Jul 18 11:20:52.628674 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:52.628645    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-594b7ddb68-98wbn"]
Jul 18 11:20:52.692695 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:52.692610    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-649ff8c9d5-svm5g"]
Jul 18 11:20:52.698620 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:52.698580    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-649ff8c9d5-svm5g"
Jul 18 11:20:52.710146 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:52.710120    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-649ff8c9d5-svm5g"]
Jul 18 11:20:52.795954 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:52.795912    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7620d14f-9a52-46b0-9bfd-15432e78b658-trusted-ca\") pod \"image-registry-649ff8c9d5-svm5g\" (UID: \"7620d14f-9a52-46b0-9bfd-15432e78b658\") " pod="openshift-image-registry/image-registry-649ff8c9d5-svm5g"
Jul 18 11:20:52.796126 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:52.795980    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/7620d14f-9a52-46b0-9bfd-15432e78b658-registry-certificates\") pod \"image-registry-649ff8c9d5-svm5g\" (UID: \"7620d14f-9a52-46b0-9bfd-15432e78b658\") " pod="openshift-image-registry/image-registry-649ff8c9d5-svm5g"
Jul 18 11:20:52.796126 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:52.796007    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7620d14f-9a52-46b0-9bfd-15432e78b658-registry-tls\") pod \"image-registry-649ff8c9d5-svm5g\" (UID: \"7620d14f-9a52-46b0-9bfd-15432e78b658\") " pod="openshift-image-registry/image-registry-649ff8c9d5-svm5g"
Jul 18 11:20:52.796126 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:52.796032    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/7620d14f-9a52-46b0-9bfd-15432e78b658-ca-trust-extracted\") pod \"image-registry-649ff8c9d5-svm5g\" (UID: \"7620d14f-9a52-46b0-9bfd-15432e78b658\") " pod="openshift-image-registry/image-registry-649ff8c9d5-svm5g"
Jul 18 11:20:52.796126 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:52.796053    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/7620d14f-9a52-46b0-9bfd-15432e78b658-installation-pull-secrets\") pod \"image-registry-649ff8c9d5-svm5g\" (UID: \"7620d14f-9a52-46b0-9bfd-15432e78b658\") " pod="openshift-image-registry/image-registry-649ff8c9d5-svm5g"
Jul 18 11:20:52.796352 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:52.796148    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7620d14f-9a52-46b0-9bfd-15432e78b658-bound-sa-token\") pod \"image-registry-649ff8c9d5-svm5g\" (UID: \"7620d14f-9a52-46b0-9bfd-15432e78b658\") " pod="openshift-image-registry/image-registry-649ff8c9d5-svm5g"
Jul 18 11:20:52.796352 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:52.796186    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/7620d14f-9a52-46b0-9bfd-15432e78b658-image-registry-private-configuration\") pod \"image-registry-649ff8c9d5-svm5g\" (UID: \"7620d14f-9a52-46b0-9bfd-15432e78b658\") " pod="openshift-image-registry/image-registry-649ff8c9d5-svm5g"
Jul 18 11:20:52.796352 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:52.796223    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2k7lv\" (UniqueName: \"kubernetes.io/projected/7620d14f-9a52-46b0-9bfd-15432e78b658-kube-api-access-2k7lv\") pod \"image-registry-649ff8c9d5-svm5g\" (UID: \"7620d14f-9a52-46b0-9bfd-15432e78b658\") " pod="openshift-image-registry/image-registry-649ff8c9d5-svm5g"
Jul 18 11:20:52.899564 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:52.898350    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/7620d14f-9a52-46b0-9bfd-15432e78b658-registry-certificates\") pod \"image-registry-649ff8c9d5-svm5g\" (UID: \"7620d14f-9a52-46b0-9bfd-15432e78b658\") " pod="openshift-image-registry/image-registry-649ff8c9d5-svm5g"
Jul 18 11:20:52.899564 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:52.898424    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7620d14f-9a52-46b0-9bfd-15432e78b658-registry-tls\") pod \"image-registry-649ff8c9d5-svm5g\" (UID: \"7620d14f-9a52-46b0-9bfd-15432e78b658\") " pod="openshift-image-registry/image-registry-649ff8c9d5-svm5g"
Jul 18 11:20:52.899564 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:52.898459    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/7620d14f-9a52-46b0-9bfd-15432e78b658-ca-trust-extracted\") pod \"image-registry-649ff8c9d5-svm5g\" (UID: \"7620d14f-9a52-46b0-9bfd-15432e78b658\") " pod="openshift-image-registry/image-registry-649ff8c9d5-svm5g"
Jul 18 11:20:52.899564 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:52.898491    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/7620d14f-9a52-46b0-9bfd-15432e78b658-installation-pull-secrets\") pod \"image-registry-649ff8c9d5-svm5g\" (UID: \"7620d14f-9a52-46b0-9bfd-15432e78b658\") " pod="openshift-image-registry/image-registry-649ff8c9d5-svm5g"
Jul 18 11:20:52.899564 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:52.898529    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7620d14f-9a52-46b0-9bfd-15432e78b658-bound-sa-token\") pod \"image-registry-649ff8c9d5-svm5g\" (UID: \"7620d14f-9a52-46b0-9bfd-15432e78b658\") " pod="openshift-image-registry/image-registry-649ff8c9d5-svm5g"
Jul 18 11:20:52.899564 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:52.898564    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/7620d14f-9a52-46b0-9bfd-15432e78b658-image-registry-private-configuration\") pod \"image-registry-649ff8c9d5-svm5g\" (UID: \"7620d14f-9a52-46b0-9bfd-15432e78b658\") " pod="openshift-image-registry/image-registry-649ff8c9d5-svm5g"
Jul 18 11:20:52.899564 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:52.898603    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2k7lv\" (UniqueName: \"kubernetes.io/projected/7620d14f-9a52-46b0-9bfd-15432e78b658-kube-api-access-2k7lv\") pod \"image-registry-649ff8c9d5-svm5g\" (UID: \"7620d14f-9a52-46b0-9bfd-15432e78b658\") " pod="openshift-image-registry/image-registry-649ff8c9d5-svm5g"
Jul 18 11:20:52.899564 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:52.898712    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7620d14f-9a52-46b0-9bfd-15432e78b658-trusted-ca\") pod \"image-registry-649ff8c9d5-svm5g\" (UID: \"7620d14f-9a52-46b0-9bfd-15432e78b658\") " pod="openshift-image-registry/image-registry-649ff8c9d5-svm5g"
Jul 18 11:20:52.900658 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:52.900591    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/7620d14f-9a52-46b0-9bfd-15432e78b658-registry-certificates\") pod \"image-registry-649ff8c9d5-svm5g\" (UID: \"7620d14f-9a52-46b0-9bfd-15432e78b658\") " pod="openshift-image-registry/image-registry-649ff8c9d5-svm5g"
Jul 18 11:20:52.901113 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:52.901011    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/7620d14f-9a52-46b0-9bfd-15432e78b658-ca-trust-extracted\") pod \"image-registry-649ff8c9d5-svm5g\" (UID: \"7620d14f-9a52-46b0-9bfd-15432e78b658\") " pod="openshift-image-registry/image-registry-649ff8c9d5-svm5g"
Jul 18 11:20:52.901113 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:52.901055    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7620d14f-9a52-46b0-9bfd-15432e78b658-trusted-ca\") pod \"image-registry-649ff8c9d5-svm5g\" (UID: \"7620d14f-9a52-46b0-9bfd-15432e78b658\") " pod="openshift-image-registry/image-registry-649ff8c9d5-svm5g"
Jul 18 11:20:52.902833 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:52.902780    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7620d14f-9a52-46b0-9bfd-15432e78b658-registry-tls\") pod \"image-registry-649ff8c9d5-svm5g\" (UID: \"7620d14f-9a52-46b0-9bfd-15432e78b658\") " pod="openshift-image-registry/image-registry-649ff8c9d5-svm5g"
Jul 18 11:20:52.903206 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:52.903185    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/7620d14f-9a52-46b0-9bfd-15432e78b658-image-registry-private-configuration\") pod \"image-registry-649ff8c9d5-svm5g\" (UID: \"7620d14f-9a52-46b0-9bfd-15432e78b658\") " pod="openshift-image-registry/image-registry-649ff8c9d5-svm5g"
Jul 18 11:20:52.903402 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:52.903317    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/7620d14f-9a52-46b0-9bfd-15432e78b658-installation-pull-secrets\") pod \"image-registry-649ff8c9d5-svm5g\" (UID: \"7620d14f-9a52-46b0-9bfd-15432e78b658\") " pod="openshift-image-registry/image-registry-649ff8c9d5-svm5g"
Jul 18 11:20:52.909837 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:52.909811    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7620d14f-9a52-46b0-9bfd-15432e78b658-bound-sa-token\") pod \"image-registry-649ff8c9d5-svm5g\" (UID: \"7620d14f-9a52-46b0-9bfd-15432e78b658\") " pod="openshift-image-registry/image-registry-649ff8c9d5-svm5g"
Jul 18 11:20:52.910114 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:52.910088    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2k7lv\" (UniqueName: \"kubernetes.io/projected/7620d14f-9a52-46b0-9bfd-15432e78b658-kube-api-access-2k7lv\") pod \"image-registry-649ff8c9d5-svm5g\" (UID: \"7620d14f-9a52-46b0-9bfd-15432e78b658\") " pod="openshift-image-registry/image-registry-649ff8c9d5-svm5g"
Jul 18 11:20:53.014049 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:53.013924    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-649ff8c9d5-svm5g"
Jul 18 11:20:57.484057 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:57.484007    2579 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-69d69956f7-lpbnb" podUID="2ee04fb4-5905-4a32-9f9b-cccd53f60f5a" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
Jul 18 11:20:57.484573 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:57.484100    2579 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-69d69956f7-lpbnb"
Jul 18 11:20:57.484804 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:57.484749    2579 kuberuntime_manager.go:1192] "Message for Container of pod" containerName="service-proxy" containerStatusID={"Type":"cri-o","ID":"97fe9e9f8afa4cb0e8518a438beab0baf02df6315dc8d8ec408a2eb3584797c3"} pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-69d69956f7-lpbnb" containerMessage="Container service-proxy failed liveness probe, will be restarted"
Jul 18 11:20:57.484975 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:57.484822    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-69d69956f7-lpbnb" podUID="2ee04fb4-5905-4a32-9f9b-cccd53f60f5a" containerName="service-proxy" containerID="cri-o://97fe9e9f8afa4cb0e8518a438beab0baf02df6315dc8d8ec408a2eb3584797c3" gracePeriod=30
Jul 18 11:20:58.450655 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:58.450630    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-649ff8c9d5-svm5g"]
Jul 18 11:20:58.454712 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:58.454682    2579 generic.go:356] "Generic (PLEG): container finished" podID="2ee04fb4-5905-4a32-9f9b-cccd53f60f5a" containerID="97fe9e9f8afa4cb0e8518a438beab0baf02df6315dc8d8ec408a2eb3584797c3" exitCode=2
Jul 18 11:20:58.454829 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:58.454747    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-69d69956f7-lpbnb" event={"ID":"2ee04fb4-5905-4a32-9f9b-cccd53f60f5a","Type":"ContainerDied","Data":"97fe9e9f8afa4cb0e8518a438beab0baf02df6315dc8d8ec408a2eb3584797c3"}
Jul 18 11:20:58.491566 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:20:58.491537    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7620d14f_9a52_46b0_9bfd_15432e78b658.slice/crio-a83c85a49c309b7127b2cacd8b6f629ee4890154b7f5810061e54a02ec1ae8e6 WatchSource:0}: Error finding container a83c85a49c309b7127b2cacd8b6f629ee4890154b7f5810061e54a02ec1ae8e6: Status 404 returned error can't find the container with id a83c85a49c309b7127b2cacd8b6f629ee4890154b7f5810061e54a02ec1ae8e6
Jul 18 11:20:59.460350 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:59.460305    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-v6n2x" event={"ID":"63d7c8c7-1716-489e-8698-e49c93a85050","Type":"ContainerStarted","Data":"2076d392f20b921db6db4e77890f1b3085fca5b3b4f13cb643508a5197a15d5d"}
Jul 18 11:20:59.461942 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:59.461914    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-fzxs7" event={"ID":"f4e046d0-f0d1-453c-8729-b2191f050b73","Type":"ContainerStarted","Data":"666a8c36e4c43538ef49c05d8cc4d084153b46edf0febaf840f2751c7064afb6"}
Jul 18 11:20:59.463554 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:59.463530    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-2ls6p" event={"ID":"37a0a359-1903-477c-8f8a-80712275ad64","Type":"ContainerStarted","Data":"77b0cca958a27005395e1209c1593ba947ee6e803cd60d7ea6d27c0bd9f1abc6"}
Jul 18 11:20:59.463680 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:59.463577    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-2ls6p" event={"ID":"37a0a359-1903-477c-8f8a-80712275ad64","Type":"ContainerStarted","Data":"2bcad332e76ada81fee93915e7985b686893f5ab84ed351f6c1bd67703ddd945"}
Jul 18 11:20:59.465074 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:59.465048    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-6j4vg" event={"ID":"b4c72690-9e6e-4826-8ff8-95eeea44b5d0","Type":"ContainerStarted","Data":"570d6dab94bf5904310818e13e163a77d93ba9f87b2100751a331d365a9224d1"}
Jul 18 11:20:59.466693 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:59.466669    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-ljhk6" event={"ID":"0e090c50-e996-4eda-b8c0-46d7f7d7dde3","Type":"ContainerStarted","Data":"2edabdf2c779f4e10d4692cd249e3cdf17af334fcd59c6f085720911e4febecc"}
Jul 18 11:20:59.466824 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:59.466720    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-ljhk6" event={"ID":"0e090c50-e996-4eda-b8c0-46d7f7d7dde3","Type":"ContainerStarted","Data":"71c9b3a98f15318837b9d84401c0a0c933c422585583ada1fa7d26cfcd1adabe"}
Jul 18 11:20:59.468504 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:59.468482    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-kv2jv" event={"ID":"57dfdac3-878d-43df-84ab-0996f5fba323","Type":"ContainerStarted","Data":"50448a5c476c9f4cbde8350c2b735ca35af60a94393f4c8cf8790fd89c090f97"}
Jul 18 11:20:59.468631 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:59.468526    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-kv2jv" event={"ID":"57dfdac3-878d-43df-84ab-0996f5fba323","Type":"ContainerStarted","Data":"78ca09eccd5e08e483f9e92f5cf9ffbd06be91a4db8d3324ce4303e9ad2b6349"}
Jul 18 11:20:59.468631 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:59.468556    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-kv2jv"
Jul 18 11:20:59.471039 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:59.471013    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-69d69956f7-lpbnb" event={"ID":"2ee04fb4-5905-4a32-9f9b-cccd53f60f5a","Type":"ContainerStarted","Data":"c35e6a158da164b624ac7f426f7f6b9678de163ee2470c3a7148e5b1f6be8b8e"}
Jul 18 11:20:59.473015 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:59.472992    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-2l7gv" event={"ID":"33c02514-4254-498e-86eb-8d7d858bc338","Type":"ContainerStarted","Data":"ec0e908618630a3d1bb1099d47d3136b1d97a2bd96d4b636ab44691ca8dcbdd2"}
Jul 18 11:20:59.474353 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:59.474326    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-649ff8c9d5-svm5g" event={"ID":"7620d14f-9a52-46b0-9bfd-15432e78b658","Type":"ContainerStarted","Data":"0510b1e35b9a06b627da88e3cb4fe1f170808abdbaa16ff4d67bd270f869cb80"}
Jul 18 11:20:59.474469 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:59.474363    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-649ff8c9d5-svm5g" event={"ID":"7620d14f-9a52-46b0-9bfd-15432e78b658","Type":"ContainerStarted","Data":"a83c85a49c309b7127b2cacd8b6f629ee4890154b7f5810061e54a02ec1ae8e6"}
Jul 18 11:20:59.474469 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:59.474400    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-649ff8c9d5-svm5g"
Jul 18 11:20:59.477341 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:59.477300    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-v6n2x" podStartSLOduration=42.419574103 podStartE2EDuration="44.477287166s" totalImagesPullingTime="2.057713063s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 11:20:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 11:20:59.476911171 +0000 UTC m=+79.091947473" watchObservedRunningTime="2026-07-18 11:20:59.477287166 +0000 UTC m=+79.092323467"
Jul 18 11:20:59.504832 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:59.503534    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-2ls6p" podStartSLOduration=69.545539174 podStartE2EDuration="1m17.50351029s" totalImagesPullingTime="7.957971116s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 11:19:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 11:20:59.502700879 +0000 UTC m=+79.117737183" watchObservedRunningTime="2026-07-18 11:20:59.50351029 +0000 UTC m=+79.118546593"
Jul 18 11:20:59.523100 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:59.523046    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-649ff8c9d5-svm5g" podStartSLOduration=7.5230252459999996 podStartE2EDuration="7.523025246s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 11:20:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 11:20:59.521933472 +0000 UTC m=+79.136969775" watchObservedRunningTime="2026-07-18 11:20:59.523025246 +0000 UTC m=+79.138061627"
Jul 18 11:20:59.537599 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:59.537547    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-6j4vg" podStartSLOduration=70.225469801 podStartE2EDuration="1m18.537531149s" totalImagesPullingTime="8.312061348s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-18 11:19:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 11:20:59.535706 +0000 UTC m=+79.150742302" watchObservedRunningTime="2026-07-18 11:20:59.537531149 +0000 UTC m=+79.152567453"
Jul 18 11:20:59.550668 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:59.550599    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-fzxs7" podStartSLOduration=70.574773668 podStartE2EDuration="1m17.550563999s" totalImagesPullingTime="6.975790331s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 11:19:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 11:20:59.550161899 +0000 UTC m=+79.165198196" watchObservedRunningTime="2026-07-18 11:20:59.550563999 +0000 UTC m=+79.165600298"
Jul 18 11:20:59.616592 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:59.616514    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-kv2jv" podStartSLOduration=34.616109072 podStartE2EDuration="42.616489907s" totalImagesPullingTime="8.000380835s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 11:20:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 11:20:59.614796136 +0000 UTC m=+79.229832440" watchObservedRunningTime="2026-07-18 11:20:59.616489907 +0000 UTC m=+79.231526209"
Jul 18 11:20:59.635458 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:20:59.635401    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-ljhk6" podStartSLOduration=76.361854951 podStartE2EDuration="1m18.635380033s" totalImagesPullingTime="2.273525082s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 11:19:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 11:20:59.634951513 +0000 UTC m=+79.249987817" watchObservedRunningTime="2026-07-18 11:20:59.635380033 +0000 UTC m=+79.250416334"
Jul 18 11:21:01.889034 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:21:01.888986    2579 scope.go:117] "RemoveContainer" containerID="18506a8f6ffedd34727ba2ae13d6668b606759a71b152185962637deb27212a9"
Jul 18 11:21:03.495876 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:21:03.495797    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-jfpn7_759a894c-1828-4ac9-a7c3-77354a104247/console-operator/2.log"
Jul 18 11:21:03.496367 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:21:03.495930    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-jfpn7" event={"ID":"759a894c-1828-4ac9-a7c3-77354a104247","Type":"ContainerStarted","Data":"dd23a913192fc5b212e4ae61f1692fbe9bc073090b98db9e663a1c0b35046cc5"}
Jul 18 11:21:03.496367 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:21:03.496360    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-565b7b569d-jfpn7"
Jul 18 11:21:03.498708 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:21:03.498682    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-2l7gv" event={"ID":"33c02514-4254-498e-86eb-8d7d858bc338","Type":"ContainerStarted","Data":"4a56f47fe45b5105baa41600ec904f57029ea6abe6f129fc6cbcc8690c76eddd"}
Jul 18 11:21:03.501441 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:21:03.501417    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-565b7b569d-jfpn7"
Jul 18 11:21:03.519730 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:21:03.519675    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-565b7b569d-jfpn7" podStartSLOduration=74.699636899 podStartE2EDuration="1m22.519657981s" totalImagesPullingTime="7.820021082s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 11:19:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 11:21:03.518692013 +0000 UTC m=+83.133728315" watchObservedRunningTime="2026-07-18 11:21:03.519657981 +0000 UTC m=+83.134694316"
Jul 18 11:21:03.537126 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:21:03.537070    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-2l7gv" podStartSLOduration=17.066468802 podStartE2EDuration="35.53705287s" totalImagesPullingTime="18.470584068s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-18 11:20:28 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 11:21:03.535462527 +0000 UTC m=+83.150498829" watchObservedRunningTime="2026-07-18 11:21:03.53705287 +0000 UTC m=+83.152089172"
Jul 18 11:21:09.481928 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:21:09.481873    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-kv2jv"
Jul 18 11:21:09.606080 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:21:09.606039    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-hlhp7"]
Jul 18 11:21:09.610747 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:21:09.610725    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-hlhp7"
Jul 18 11:21:09.613181 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:21:09.613155    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 18 11:21:09.613376 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:21:09.613184    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 18 11:21:09.613448 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:21:09.613402    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-kw9x4\""
Jul 18 11:21:09.613448 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:21:09.613192    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 18 11:21:09.613553 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:21:09.613316    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 18 11:21:09.756225 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:21:09.756121    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wfv52\" (UniqueName: \"kubernetes.io/projected/41df8388-1932-4d01-b750-9d1648196b4c-kube-api-access-wfv52\") pod \"node-exporter-hlhp7\" (UID: \"41df8388-1932-4d01-b750-9d1648196b4c\") " pod="openshift-monitoring/node-exporter-hlhp7"
Jul 18 11:21:09.756225 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:21:09.756171    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/41df8388-1932-4d01-b750-9d1648196b4c-node-exporter-wtmp\") pod \"node-exporter-hlhp7\" (UID: \"41df8388-1932-4d01-b750-9d1648196b4c\") " pod="openshift-monitoring/node-exporter-hlhp7"
Jul 18 11:21:09.756225 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:21:09.756209    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/41df8388-1932-4d01-b750-9d1648196b4c-sys\") pod \"node-exporter-hlhp7\" (UID: \"41df8388-1932-4d01-b750-9d1648196b4c\") " pod="openshift-monitoring/node-exporter-hlhp7"
Jul 18 11:21:09.756515 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:21:09.756231    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/41df8388-1932-4d01-b750-9d1648196b4c-root\") pod \"node-exporter-hlhp7\" (UID: \"41df8388-1932-4d01-b750-9d1648196b4c\") " pod="openshift-monitoring/node-exporter-hlhp7"
Jul 18 11:21:09.756515 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:21:09.756261    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/41df8388-1932-4d01-b750-9d1648196b4c-node-exporter-tls\") pod \"node-exporter-hlhp7\" (UID: \"41df8388-1932-4d01-b750-9d1648196b4c\") " pod="openshift-monitoring/node-exporter-hlhp7"
Jul 18 11:21:09.756515 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:21:09.756293    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/41df8388-1932-4d01-b750-9d1648196b4c-node-exporter-accelerators-collector-config\") pod \"node-exporter-hlhp7\" (UID: \"41df8388-1932-4d01-b750-9d1648196b4c\") " pod="openshift-monitoring/node-exporter-hlhp7"
Jul 18 11:21:09.756515 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:21:09.756321    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/41df8388-1932-4d01-b750-9d1648196b4c-node-exporter-textfile\") pod \"node-exporter-hlhp7\" (UID: \"41df8388-1932-4d01-b750-9d1648196b4c\") " pod="openshift-monitoring/node-exporter-hlhp7"
Jul 18 11:21:09.756515 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:21:09.756352    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/41df8388-1932-4d01-b750-9d1648196b4c-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-hlhp7\" (UID: \"41df8388-1932-4d01-b750-9d1648196b4c\") " pod="openshift-monitoring/node-exporter-hlhp7"
Jul 18 11:21:09.756515 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:21:09.756380    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/41df8388-1932-4d01-b750-9d1648196b4c-metrics-client-ca\") pod \"node-exporter-hlhp7\" (UID: \"41df8388-1932-4d01-b750-9d1648196b4c\") " pod="openshift-monitoring/node-exporter-hlhp7"
Jul 18 11:21:09.857637 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:21:09.857598    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wfv52\" (UniqueName: \"kubernetes.io/projected/41df8388-1932-4d01-b750-9d1648196b4c-kube-api-access-wfv52\") pod \"node-exporter-hlhp7\" (UID: \"41df8388-1932-4d01-b750-9d1648196b4c\") " pod="openshift-monitoring/node-exporter-hlhp7"
Jul 18 11:21:09.857637 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:21:09.857635    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/41df8388-1932-4d01-b750-9d1648196b4c-node-exporter-wtmp\") pod \"node-exporter-hlhp7\" (UID: \"41df8388-1932-4d01-b750-9d1648196b4c\") " pod="openshift-monitoring/node-exporter-hlhp7"
Jul 18 11:21:09.857859 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:21:09.857662    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/41df8388-1932-4d01-b750-9d1648196b4c-sys\") pod \"node-exporter-hlhp7\" (UID: \"41df8388-1932-4d01-b750-9d1648196b4c\") " pod="openshift-monitoring/node-exporter-hlhp7"
Jul 18 11:21:09.857859 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:21:09.857683    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/41df8388-1932-4d01-b750-9d1648196b4c-root\") pod \"node-exporter-hlhp7\" (UID: \"41df8388-1932-4d01-b750-9d1648196b4c\") " pod="openshift-monitoring/node-exporter-hlhp7"
Jul 18 11:21:09.857859 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:21:09.857722    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/41df8388-1932-4d01-b750-9d1648196b4c-node-exporter-tls\") pod \"node-exporter-hlhp7\" (UID: \"41df8388-1932-4d01-b750-9d1648196b4c\") " pod="openshift-monitoring/node-exporter-hlhp7"
Jul 18 11:21:09.857859 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:21:09.857759    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/41df8388-1932-4d01-b750-9d1648196b4c-node-exporter-accelerators-collector-config\") pod \"node-exporter-hlhp7\" (UID: \"41df8388-1932-4d01-b750-9d1648196b4c\") " pod="openshift-monitoring/node-exporter-hlhp7"
Jul 18 11:21:09.857859 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:21:09.857779    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/41df8388-1932-4d01-b750-9d1648196b4c-node-exporter-textfile\") pod \"node-exporter-hlhp7\" (UID: \"41df8388-1932-4d01-b750-9d1648196b4c\") " pod="openshift-monitoring/node-exporter-hlhp7"
Jul 18 11:21:09.857859 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:21:09.857781    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/41df8388-1932-4d01-b750-9d1648196b4c-node-exporter-wtmp\") pod \"node-exporter-hlhp7\" (UID: \"41df8388-1932-4d01-b750-9d1648196b4c\") " pod="openshift-monitoring/node-exporter-hlhp7"
Jul 18 11:21:09.858192 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:21:09.857910    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/41df8388-1932-4d01-b750-9d1648196b4c-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-hlhp7\" (UID: \"41df8388-1932-4d01-b750-9d1648196b4c\") " pod="openshift-monitoring/node-exporter-hlhp7"
Jul 18 11:21:09.858192 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:21:09.857951    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/41df8388-1932-4d01-b750-9d1648196b4c-metrics-client-ca\") pod \"node-exporter-hlhp7\" (UID: \"41df8388-1932-4d01-b750-9d1648196b4c\") " pod="openshift-monitoring/node-exporter-hlhp7"
Jul 18 11:21:09.858192 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:21:09.857975    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/41df8388-1932-4d01-b750-9d1648196b4c-sys\") pod \"node-exporter-hlhp7\" (UID: \"41df8388-1932-4d01-b750-9d1648196b4c\") " pod="openshift-monitoring/node-exporter-hlhp7"
Jul 18 11:21:09.858192 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:21:09.858153    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/41df8388-1932-4d01-b750-9d1648196b4c-node-exporter-textfile\") pod \"node-exporter-hlhp7\" (UID: \"41df8388-1932-4d01-b750-9d1648196b4c\") " pod="openshift-monitoring/node-exporter-hlhp7"
Jul 18 11:21:09.858414 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:21:09.858386    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/41df8388-1932-4d01-b750-9d1648196b4c-root\") pod \"node-exporter-hlhp7\" (UID: \"41df8388-1932-4d01-b750-9d1648196b4c\") " pod="openshift-monitoring/node-exporter-hlhp7"
Jul 18 11:21:09.858487 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:21:09.858457    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/41df8388-1932-4d01-b750-9d1648196b4c-node-exporter-accelerators-collector-config\") pod \"node-exporter-hlhp7\" (UID: \"41df8388-1932-4d01-b750-9d1648196b4c\") " pod="openshift-monitoring/node-exporter-hlhp7"
Jul 18 11:21:09.858552 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:21:09.858527    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/41df8388-1932-4d01-b750-9d1648196b4c-metrics-client-ca\") pod \"node-exporter-hlhp7\" (UID: \"41df8388-1932-4d01-b750-9d1648196b4c\") " pod="openshift-monitoring/node-exporter-hlhp7"
Jul 18 11:21:09.860247 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:21:09.860229    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/41df8388-1932-4d01-b750-9d1648196b4c-node-exporter-tls\") pod \"node-exporter-hlhp7\" (UID: \"41df8388-1932-4d01-b750-9d1648196b4c\") " pod="openshift-monitoring/node-exporter-hlhp7"
Jul 18 11:21:09.860247 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:21:09.860234    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/41df8388-1932-4d01-b750-9d1648196b4c-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-hlhp7\" (UID: \"41df8388-1932-4d01-b750-9d1648196b4c\") " pod="openshift-monitoring/node-exporter-hlhp7"
Jul 18 11:21:09.865452 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:21:09.865428    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wfv52\" (UniqueName: \"kubernetes.io/projected/41df8388-1932-4d01-b750-9d1648196b4c-kube-api-access-wfv52\") pod \"node-exporter-hlhp7\" (UID: \"41df8388-1932-4d01-b750-9d1648196b4c\") " pod="openshift-monitoring/node-exporter-hlhp7"
Jul 18 11:21:09.923218 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:21:09.923175    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-hlhp7"
Jul 18 11:21:09.936629 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:21:09.936602    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod41df8388_1932_4d01_b750_9d1648196b4c.slice/crio-d9e03190293798aeb9cda740c41921147ba22c8f092e8502350dbba73afeb8e4 WatchSource:0}: Error finding container d9e03190293798aeb9cda740c41921147ba22c8f092e8502350dbba73afeb8e4: Status 404 returned error can't find the container with id d9e03190293798aeb9cda740c41921147ba22c8f092e8502350dbba73afeb8e4
Jul 18 11:21:10.531181 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:21:10.531136    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-hlhp7" event={"ID":"41df8388-1932-4d01-b750-9d1648196b4c","Type":"ContainerStarted","Data":"d9e03190293798aeb9cda740c41921147ba22c8f092e8502350dbba73afeb8e4"}
Jul 18 11:21:11.536793 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:21:11.536757    2579 generic.go:356] "Generic (PLEG): container finished" podID="41df8388-1932-4d01-b750-9d1648196b4c" containerID="43e7af9c60aeb9898466b8c1d2d6bcacfeba5577783610bf8514d394d7bd2cea" exitCode=0
Jul 18 11:21:11.537208 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:21:11.536843    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-hlhp7" event={"ID":"41df8388-1932-4d01-b750-9d1648196b4c","Type":"ContainerDied","Data":"43e7af9c60aeb9898466b8c1d2d6bcacfeba5577783610bf8514d394d7bd2cea"}
Jul 18 11:21:12.543736 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:21:12.543700    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-hlhp7" event={"ID":"41df8388-1932-4d01-b750-9d1648196b4c","Type":"ContainerStarted","Data":"471d4998b6f7a9f44bd3186b084f2090a59886773d4875a7c6b093a48e30273b"}
Jul 18 11:21:12.544249 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:21:12.543761    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-hlhp7" event={"ID":"41df8388-1932-4d01-b750-9d1648196b4c","Type":"ContainerStarted","Data":"05702455b6754334fbe3bf2ac5b4291498c5a2b73f06d022d00e5cd8cf8c3db5"}
Jul 18 11:21:12.561840 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:21:12.561780    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-hlhp7" podStartSLOduration=2.5271794610000002 podStartE2EDuration="3.561764337s" totalImagesPullingTime="970.140293ms" totalInitContainerRuntime="64.444583ms" isStatefulPod=true podCreationTimestamp="2026-07-18 11:21:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 11:21:12.560570713 +0000 UTC m=+92.175607016" watchObservedRunningTime="2026-07-18 11:21:12.561764337 +0000 UTC m=+92.176800638"
Jul 18 11:21:13.442049 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:21:13.442020    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-594b7ddb68-98wbn"
Jul 18 11:21:18.460470 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:21:18.460427    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-594b7ddb68-98wbn" podUID="099bdb04-cb99-4be4-8f98-76ed8839204e" containerName="registry" containerID="cri-o://83558e74aa2357a88410475abba40818004f7c588a54988391b585cd68b785f4" gracePeriod=30
Jul 18 11:21:18.733901 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:21:18.733811    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-594b7ddb68-98wbn"
Jul 18 11:21:18.837205 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:21:18.837172    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/099bdb04-cb99-4be4-8f98-76ed8839204e-installation-pull-secrets\") pod \"099bdb04-cb99-4be4-8f98-76ed8839204e\" (UID: \"099bdb04-cb99-4be4-8f98-76ed8839204e\") "
Jul 18 11:21:18.837205 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:21:18.837214    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/099bdb04-cb99-4be4-8f98-76ed8839204e-image-registry-private-configuration\") pod \"099bdb04-cb99-4be4-8f98-76ed8839204e\" (UID: \"099bdb04-cb99-4be4-8f98-76ed8839204e\") "
Jul 18 11:21:18.837464 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:21:18.837277    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/099bdb04-cb99-4be4-8f98-76ed8839204e-registry-tls\") pod \"099bdb04-cb99-4be4-8f98-76ed8839204e\" (UID: \"099bdb04-cb99-4be4-8f98-76ed8839204e\") "
Jul 18 11:21:18.837464 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:21:18.837367    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/099bdb04-cb99-4be4-8f98-76ed8839204e-bound-sa-token\") pod \"099bdb04-cb99-4be4-8f98-76ed8839204e\" (UID: \"099bdb04-cb99-4be4-8f98-76ed8839204e\") "
Jul 18 11:21:18.837464 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:21:18.837442    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/099bdb04-cb99-4be4-8f98-76ed8839204e-registry-certificates\") pod \"099bdb04-cb99-4be4-8f98-76ed8839204e\" (UID: \"099bdb04-cb99-4be4-8f98-76ed8839204e\") "
Jul 18 11:21:18.837632 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:21:18.837499    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/099bdb04-cb99-4be4-8f98-76ed8839204e-trusted-ca\") pod \"099bdb04-cb99-4be4-8f98-76ed8839204e\" (UID: \"099bdb04-cb99-4be4-8f98-76ed8839204e\") "
Jul 18 11:21:18.837632 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:21:18.837526    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zqvc6\" (UniqueName: \"kubernetes.io/projected/099bdb04-cb99-4be4-8f98-76ed8839204e-kube-api-access-zqvc6\") pod \"099bdb04-cb99-4be4-8f98-76ed8839204e\" (UID: \"099bdb04-cb99-4be4-8f98-76ed8839204e\") "
Jul 18 11:21:18.837632 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:21:18.837559    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/099bdb04-cb99-4be4-8f98-76ed8839204e-ca-trust-extracted\") pod \"099bdb04-cb99-4be4-8f98-76ed8839204e\" (UID: \"099bdb04-cb99-4be4-8f98-76ed8839204e\") "
Jul 18 11:21:18.837870 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:21:18.837831    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/099bdb04-cb99-4be4-8f98-76ed8839204e-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "099bdb04-cb99-4be4-8f98-76ed8839204e" (UID: "099bdb04-cb99-4be4-8f98-76ed8839204e"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 18 11:21:18.838331 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:21:18.838278    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/099bdb04-cb99-4be4-8f98-76ed8839204e-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "099bdb04-cb99-4be4-8f98-76ed8839204e" (UID: "099bdb04-cb99-4be4-8f98-76ed8839204e"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 18 11:21:18.839827 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:21:18.839791    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/099bdb04-cb99-4be4-8f98-76ed8839204e-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "099bdb04-cb99-4be4-8f98-76ed8839204e" (UID: "099bdb04-cb99-4be4-8f98-76ed8839204e"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 18 11:21:18.840112 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:21:18.840076    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/099bdb04-cb99-4be4-8f98-76ed8839204e-kube-api-access-zqvc6" (OuterVolumeSpecName: "kube-api-access-zqvc6") pod "099bdb04-cb99-4be4-8f98-76ed8839204e" (UID: "099bdb04-cb99-4be4-8f98-76ed8839204e"). InnerVolumeSpecName "kube-api-access-zqvc6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 18 11:21:18.840209 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:21:18.840108    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/099bdb04-cb99-4be4-8f98-76ed8839204e-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "099bdb04-cb99-4be4-8f98-76ed8839204e" (UID: "099bdb04-cb99-4be4-8f98-76ed8839204e"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 18 11:21:18.840209 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:21:18.840145    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/099bdb04-cb99-4be4-8f98-76ed8839204e-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "099bdb04-cb99-4be4-8f98-76ed8839204e" (UID: "099bdb04-cb99-4be4-8f98-76ed8839204e"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 18 11:21:18.840371 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:21:18.840355    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/099bdb04-cb99-4be4-8f98-76ed8839204e-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "099bdb04-cb99-4be4-8f98-76ed8839204e" (UID: "099bdb04-cb99-4be4-8f98-76ed8839204e"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 18 11:21:18.846644 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:21:18.846622    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/099bdb04-cb99-4be4-8f98-76ed8839204e-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "099bdb04-cb99-4be4-8f98-76ed8839204e" (UID: "099bdb04-cb99-4be4-8f98-76ed8839204e"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 11:21:18.939135 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:21:18.939097    2579 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/099bdb04-cb99-4be4-8f98-76ed8839204e-registry-tls\") on node \"ip-10-0-133-122.ec2.internal\" DevicePath \"\""
Jul 18 11:21:18.939135 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:21:18.939127    2579 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/099bdb04-cb99-4be4-8f98-76ed8839204e-bound-sa-token\") on node \"ip-10-0-133-122.ec2.internal\" DevicePath \"\""
Jul 18 11:21:18.939135 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:21:18.939137    2579 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/099bdb04-cb99-4be4-8f98-76ed8839204e-registry-certificates\") on node \"ip-10-0-133-122.ec2.internal\" DevicePath \"\""
Jul 18 11:21:18.939135 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:21:18.939146    2579 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/099bdb04-cb99-4be4-8f98-76ed8839204e-trusted-ca\") on node \"ip-10-0-133-122.ec2.internal\" DevicePath \"\""
Jul 18 11:21:18.939387 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:21:18.939155    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zqvc6\" (UniqueName: \"kubernetes.io/projected/099bdb04-cb99-4be4-8f98-76ed8839204e-kube-api-access-zqvc6\") on node \"ip-10-0-133-122.ec2.internal\" DevicePath \"\""
Jul 18 11:21:18.939387 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:21:18.939163    2579 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/099bdb04-cb99-4be4-8f98-76ed8839204e-ca-trust-extracted\") on node \"ip-10-0-133-122.ec2.internal\" DevicePath \"\""
Jul 18 11:21:18.939387 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:21:18.939171    2579 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/099bdb04-cb99-4be4-8f98-76ed8839204e-installation-pull-secrets\") on node \"ip-10-0-133-122.ec2.internal\" DevicePath \"\""
Jul 18 11:21:18.939387 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:21:18.939180    2579 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/099bdb04-cb99-4be4-8f98-76ed8839204e-image-registry-private-configuration\") on node \"ip-10-0-133-122.ec2.internal\" DevicePath \"\""
Jul 18 11:21:19.574980 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:21:19.574945    2579 generic.go:356] "Generic (PLEG): container finished" podID="099bdb04-cb99-4be4-8f98-76ed8839204e" containerID="83558e74aa2357a88410475abba40818004f7c588a54988391b585cd68b785f4" exitCode=0
Jul 18 11:21:19.575493 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:21:19.574993    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-594b7ddb68-98wbn" event={"ID":"099bdb04-cb99-4be4-8f98-76ed8839204e","Type":"ContainerDied","Data":"83558e74aa2357a88410475abba40818004f7c588a54988391b585cd68b785f4"}
Jul 18 11:21:19.575493 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:21:19.575000    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-594b7ddb68-98wbn"
Jul 18 11:21:19.575493 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:21:19.575032    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-594b7ddb68-98wbn" event={"ID":"099bdb04-cb99-4be4-8f98-76ed8839204e","Type":"ContainerDied","Data":"9dd9a6e585cd32c520eb3235572fe0ad240bbf13c3e9666bb5230e6543bebd73"}
Jul 18 11:21:19.575493 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:21:19.575052    2579 scope.go:117] "RemoveContainer" containerID="83558e74aa2357a88410475abba40818004f7c588a54988391b585cd68b785f4"
Jul 18 11:21:19.583335 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:21:19.583318    2579 scope.go:117] "RemoveContainer" containerID="83558e74aa2357a88410475abba40818004f7c588a54988391b585cd68b785f4"
Jul 18 11:21:19.583590 ip-10-0-133-122 kubenswrapper[2579]: E0718 11:21:19.583572    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"83558e74aa2357a88410475abba40818004f7c588a54988391b585cd68b785f4\": container with ID starting with 83558e74aa2357a88410475abba40818004f7c588a54988391b585cd68b785f4 not found: ID does not exist" containerID="83558e74aa2357a88410475abba40818004f7c588a54988391b585cd68b785f4"
Jul 18 11:21:19.583641 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:21:19.583598    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"83558e74aa2357a88410475abba40818004f7c588a54988391b585cd68b785f4"} err="failed to get container status \"83558e74aa2357a88410475abba40818004f7c588a54988391b585cd68b785f4\": rpc error: code = NotFound desc = could not find container \"83558e74aa2357a88410475abba40818004f7c588a54988391b585cd68b785f4\": container with ID starting with 83558e74aa2357a88410475abba40818004f7c588a54988391b585cd68b785f4 not found: ID does not exist"
Jul 18 11:21:19.591579 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:21:19.591554    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-594b7ddb68-98wbn"]
Jul 18 11:21:19.595035 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:21:19.595012    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-594b7ddb68-98wbn"]
Jul 18 11:21:20.484200 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:21:20.484174    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-649ff8c9d5-svm5g"
Jul 18 11:21:20.893245 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:21:20.893215    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="099bdb04-cb99-4be4-8f98-76ed8839204e" path="/var/lib/kubelet/pods/099bdb04-cb99-4be4-8f98-76ed8839204e/volumes"
Jul 18 11:21:21.423024 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:21:21.422997    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-cj4nh"
Jul 18 11:21:32.637481 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:21:32.637442    2579 generic.go:356] "Generic (PLEG): container finished" podID="e0a05104-9f66-40b5-8d49-2bf876d64b5c" containerID="190f6d523972f716c322d2ec57db515f8f48f762059aaa60622ec4f484f2cc91" exitCode=0
Jul 18 11:21:32.637986 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:21:32.637519    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-555d9d7885-qs8cs" event={"ID":"e0a05104-9f66-40b5-8d49-2bf876d64b5c","Type":"ContainerDied","Data":"190f6d523972f716c322d2ec57db515f8f48f762059aaa60622ec4f484f2cc91"}
Jul 18 11:21:32.638079 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:21:32.637995    2579 scope.go:117] "RemoveContainer" containerID="190f6d523972f716c322d2ec57db515f8f48f762059aaa60622ec4f484f2cc91"
Jul 18 11:21:33.643491 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:21:33.643451    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-555d9d7885-qs8cs" event={"ID":"e0a05104-9f66-40b5-8d49-2bf876d64b5c","Type":"ContainerStarted","Data":"233d03be9587d6c57363fc6092eb1b7fcad0f25f4673fb032ae00eacba882f26"}
Jul 18 11:21:58.748494 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:21:58.748454    2579 generic.go:356] "Generic (PLEG): container finished" podID="e6cc6097-8792-4b98-ab5f-085dac6a9dc7" containerID="b0dd240b9eb418888c8cc104bb0e30906d1ad91de039f518f5c921b8a808611b" exitCode=0
Jul 18 11:21:58.749015 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:21:58.748527    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-p7shj" event={"ID":"e6cc6097-8792-4b98-ab5f-085dac6a9dc7","Type":"ContainerDied","Data":"b0dd240b9eb418888c8cc104bb0e30906d1ad91de039f518f5c921b8a808611b"}
Jul 18 11:21:58.749015 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:21:58.748966    2579 scope.go:117] "RemoveContainer" containerID="b0dd240b9eb418888c8cc104bb0e30906d1ad91de039f518f5c921b8a808611b"
Jul 18 11:21:58.750208 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:21:58.750188    2579 generic.go:356] "Generic (PLEG): container finished" podID="85567bae-b6fc-4bdd-8973-0bd705dc22f8" containerID="5437904864c06f9a41963908f3b1c82ab1fbed956031927ad32801cd81e385ec" exitCode=0
Jul 18 11:21:58.750331 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:21:58.750236    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-g8g4r" event={"ID":"85567bae-b6fc-4bdd-8973-0bd705dc22f8","Type":"ContainerDied","Data":"5437904864c06f9a41963908f3b1c82ab1fbed956031927ad32801cd81e385ec"}
Jul 18 11:21:58.750550 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:21:58.750534    2579 scope.go:117] "RemoveContainer" containerID="5437904864c06f9a41963908f3b1c82ab1fbed956031927ad32801cd81e385ec"
Jul 18 11:21:59.755793 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:21:59.755751    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-p7shj" event={"ID":"e6cc6097-8792-4b98-ab5f-085dac6a9dc7","Type":"ContainerStarted","Data":"5b7e1198a9753e343aa602df8008ac40867f746e67c56e7f5979c13da61f1c05"}
Jul 18 11:21:59.757606 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:21:59.757578    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-g8g4r" event={"ID":"85567bae-b6fc-4bdd-8973-0bd705dc22f8","Type":"ContainerStarted","Data":"1014a7a3f6cf4dca45f6552ab2632246887e53576d2e6f1b5373049592094ff9"}
Jul 18 11:24:40.830502 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:24:40.830474    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-jfpn7_759a894c-1828-4ac9-a7c3-77354a104247/console-operator/2.log"
Jul 18 11:24:40.834192 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:24:40.834170    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-58jnn_40e8e19c-87b3-4cd6-81c1-0f404971a282/ovn-acl-logging/0.log"
Jul 18 11:24:40.838056 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:24:40.838032    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-jfpn7_759a894c-1828-4ac9-a7c3-77354a104247/console-operator/2.log"
Jul 18 11:24:40.839851 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:24:40.839832    2579 kubelet.go:1648] "Image garbage collection succeeded"
Jul 18 11:24:40.842180 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:24:40.842161    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-58jnn_40e8e19c-87b3-4cd6-81c1-0f404971a282/ovn-acl-logging/0.log"
Jul 18 11:26:22.708905 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:26:22.708859    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-78b8cdd6f7-m4f5l"]
Jul 18 11:26:22.709378 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:26:22.709178    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="099bdb04-cb99-4be4-8f98-76ed8839204e" containerName="registry"
Jul 18 11:26:22.709378 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:26:22.709191    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="099bdb04-cb99-4be4-8f98-76ed8839204e" containerName="registry"
Jul 18 11:26:22.709378 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:26:22.709248    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="099bdb04-cb99-4be4-8f98-76ed8839204e" containerName="registry"
Jul 18 11:26:22.712207 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:26:22.712187    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-78b8cdd6f7-m4f5l"
Jul 18 11:26:22.714447 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:26:22.714425    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 18 11:26:22.714564 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:26:22.714427    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 18 11:26:22.714627 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:26:22.714611    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 18 11:26:22.714678 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:26:22.714663    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 18 11:26:22.714752 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:26:22.714732    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-58g65\""
Jul 18 11:26:22.728988 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:26:22.728962    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-78b8cdd6f7-m4f5l"]
Jul 18 11:26:22.766688 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:26:22.766613    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2d639e51-1a11-4bd6-84aa-c98a1478b0d1-webhook-cert\") pod \"opendatahub-operator-controller-manager-78b8cdd6f7-m4f5l\" (UID: \"2d639e51-1a11-4bd6-84aa-c98a1478b0d1\") " pod="opendatahub/opendatahub-operator-controller-manager-78b8cdd6f7-m4f5l"
Jul 18 11:26:22.766688 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:26:22.766651    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jgnkm\" (UniqueName: \"kubernetes.io/projected/2d639e51-1a11-4bd6-84aa-c98a1478b0d1-kube-api-access-jgnkm\") pod \"opendatahub-operator-controller-manager-78b8cdd6f7-m4f5l\" (UID: \"2d639e51-1a11-4bd6-84aa-c98a1478b0d1\") " pod="opendatahub/opendatahub-operator-controller-manager-78b8cdd6f7-m4f5l"
Jul 18 11:26:22.767083 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:26:22.766745    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/2d639e51-1a11-4bd6-84aa-c98a1478b0d1-apiservice-cert\") pod \"opendatahub-operator-controller-manager-78b8cdd6f7-m4f5l\" (UID: \"2d639e51-1a11-4bd6-84aa-c98a1478b0d1\") " pod="opendatahub/opendatahub-operator-controller-manager-78b8cdd6f7-m4f5l"
Jul 18 11:26:22.767083 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:26:22.766788    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/2d639e51-1a11-4bd6-84aa-c98a1478b0d1-manifests\") pod \"opendatahub-operator-controller-manager-78b8cdd6f7-m4f5l\" (UID: \"2d639e51-1a11-4bd6-84aa-c98a1478b0d1\") " pod="opendatahub/opendatahub-operator-controller-manager-78b8cdd6f7-m4f5l"
Jul 18 11:26:22.767083 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:26:22.766816    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2d639e51-1a11-4bd6-84aa-c98a1478b0d1-tmp\") pod \"opendatahub-operator-controller-manager-78b8cdd6f7-m4f5l\" (UID: \"2d639e51-1a11-4bd6-84aa-c98a1478b0d1\") " pod="opendatahub/opendatahub-operator-controller-manager-78b8cdd6f7-m4f5l"
Jul 18 11:26:22.867472 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:26:22.867435    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2d639e51-1a11-4bd6-84aa-c98a1478b0d1-webhook-cert\") pod \"opendatahub-operator-controller-manager-78b8cdd6f7-m4f5l\" (UID: \"2d639e51-1a11-4bd6-84aa-c98a1478b0d1\") " pod="opendatahub/opendatahub-operator-controller-manager-78b8cdd6f7-m4f5l"
Jul 18 11:26:22.867659 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:26:22.867482    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jgnkm\" (UniqueName: \"kubernetes.io/projected/2d639e51-1a11-4bd6-84aa-c98a1478b0d1-kube-api-access-jgnkm\") pod \"opendatahub-operator-controller-manager-78b8cdd6f7-m4f5l\" (UID: \"2d639e51-1a11-4bd6-84aa-c98a1478b0d1\") " pod="opendatahub/opendatahub-operator-controller-manager-78b8cdd6f7-m4f5l"
Jul 18 11:26:22.867659 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:26:22.867523    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/2d639e51-1a11-4bd6-84aa-c98a1478b0d1-apiservice-cert\") pod \"opendatahub-operator-controller-manager-78b8cdd6f7-m4f5l\" (UID: \"2d639e51-1a11-4bd6-84aa-c98a1478b0d1\") " pod="opendatahub/opendatahub-operator-controller-manager-78b8cdd6f7-m4f5l"
Jul 18 11:26:22.867659 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:26:22.867544    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/2d639e51-1a11-4bd6-84aa-c98a1478b0d1-manifests\") pod \"opendatahub-operator-controller-manager-78b8cdd6f7-m4f5l\" (UID: \"2d639e51-1a11-4bd6-84aa-c98a1478b0d1\") " pod="opendatahub/opendatahub-operator-controller-manager-78b8cdd6f7-m4f5l"
Jul 18 11:26:22.867659 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:26:22.867562    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2d639e51-1a11-4bd6-84aa-c98a1478b0d1-tmp\") pod \"opendatahub-operator-controller-manager-78b8cdd6f7-m4f5l\" (UID: \"2d639e51-1a11-4bd6-84aa-c98a1478b0d1\") " pod="opendatahub/opendatahub-operator-controller-manager-78b8cdd6f7-m4f5l"
Jul 18 11:26:22.868027 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:26:22.868004    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/2d639e51-1a11-4bd6-84aa-c98a1478b0d1-manifests\") pod \"opendatahub-operator-controller-manager-78b8cdd6f7-m4f5l\" (UID: \"2d639e51-1a11-4bd6-84aa-c98a1478b0d1\") " pod="opendatahub/opendatahub-operator-controller-manager-78b8cdd6f7-m4f5l"
Jul 18 11:26:22.869998 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:26:22.869971    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2d639e51-1a11-4bd6-84aa-c98a1478b0d1-tmp\") pod \"opendatahub-operator-controller-manager-78b8cdd6f7-m4f5l\" (UID: \"2d639e51-1a11-4bd6-84aa-c98a1478b0d1\") " pod="opendatahub/opendatahub-operator-controller-manager-78b8cdd6f7-m4f5l"
Jul 18 11:26:22.870116 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:26:22.870095    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/2d639e51-1a11-4bd6-84aa-c98a1478b0d1-apiservice-cert\") pod \"opendatahub-operator-controller-manager-78b8cdd6f7-m4f5l\" (UID: \"2d639e51-1a11-4bd6-84aa-c98a1478b0d1\") " pod="opendatahub/opendatahub-operator-controller-manager-78b8cdd6f7-m4f5l"
Jul 18 11:26:22.870169 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:26:22.870145    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2d639e51-1a11-4bd6-84aa-c98a1478b0d1-webhook-cert\") pod \"opendatahub-operator-controller-manager-78b8cdd6f7-m4f5l\" (UID: \"2d639e51-1a11-4bd6-84aa-c98a1478b0d1\") " pod="opendatahub/opendatahub-operator-controller-manager-78b8cdd6f7-m4f5l"
Jul 18 11:26:22.876117 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:26:22.876097    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jgnkm\" (UniqueName: \"kubernetes.io/projected/2d639e51-1a11-4bd6-84aa-c98a1478b0d1-kube-api-access-jgnkm\") pod \"opendatahub-operator-controller-manager-78b8cdd6f7-m4f5l\" (UID: \"2d639e51-1a11-4bd6-84aa-c98a1478b0d1\") " pod="opendatahub/opendatahub-operator-controller-manager-78b8cdd6f7-m4f5l"
Jul 18 11:26:23.022672 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:26:23.022593    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-78b8cdd6f7-m4f5l"
Jul 18 11:26:23.161175 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:26:23.161143    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-78b8cdd6f7-m4f5l"]
Jul 18 11:26:23.164699 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:26:23.164659    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2d639e51_1a11_4bd6_84aa_c98a1478b0d1.slice/crio-746c330cca592d6d4b50f48739bb0d7455420ea969bee72c163b8bff2652ff66 WatchSource:0}: Error finding container 746c330cca592d6d4b50f48739bb0d7455420ea969bee72c163b8bff2652ff66: Status 404 returned error can't find the container with id 746c330cca592d6d4b50f48739bb0d7455420ea969bee72c163b8bff2652ff66
Jul 18 11:26:23.166710 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:26:23.166687    2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 18 11:26:23.772096 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:26:23.772049    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-78b8cdd6f7-m4f5l" event={"ID":"2d639e51-1a11-4bd6-84aa-c98a1478b0d1","Type":"ContainerStarted","Data":"746c330cca592d6d4b50f48739bb0d7455420ea969bee72c163b8bff2652ff66"}
Jul 18 11:26:26.793668 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:26:26.793623    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-78b8cdd6f7-m4f5l" event={"ID":"2d639e51-1a11-4bd6-84aa-c98a1478b0d1","Type":"ContainerStarted","Data":"4828b26c9f2d395dbb79e33d676e451ad9d07faa9d98698eac955529852ba508"}
Jul 18 11:26:27.799419 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:26:27.799383    2579 generic.go:356] "Generic (PLEG): container finished" podID="2d639e51-1a11-4bd6-84aa-c98a1478b0d1" containerID="4828b26c9f2d395dbb79e33d676e451ad9d07faa9d98698eac955529852ba508" exitCode=0
Jul 18 11:26:27.799927 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:26:27.799427    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-78b8cdd6f7-m4f5l" event={"ID":"2d639e51-1a11-4bd6-84aa-c98a1478b0d1","Type":"ContainerDied","Data":"4828b26c9f2d395dbb79e33d676e451ad9d07faa9d98698eac955529852ba508"}
Jul 18 11:26:28.805661 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:26:28.805627    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-78b8cdd6f7-m4f5l" event={"ID":"2d639e51-1a11-4bd6-84aa-c98a1478b0d1","Type":"ContainerStarted","Data":"c2e0719af2481496903414608d78138a0d8058ee45817488b179a6dd11e2b3ea"}
Jul 18 11:26:28.806089 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:26:28.805765    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-78b8cdd6f7-m4f5l"
Jul 18 11:26:28.828899 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:26:28.828832    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-78b8cdd6f7-m4f5l" podStartSLOduration=2.647130203 podStartE2EDuration="6.828816386s" totalImagesPullingTime="3.16879724s" totalInitContainerRuntime="1.012888943s" isStatefulPod=false podCreationTimestamp="2026-07-18 11:26:22 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 11:26:28.827234921 +0000 UTC m=+408.442271222" watchObservedRunningTime="2026-07-18 11:26:28.828816386 +0000 UTC m=+408.443852689"
Jul 18 11:26:39.811953 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:26:39.811918    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-78b8cdd6f7-m4f5l"
Jul 18 11:26:42.767237 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:26:42.767197    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-6df8599d98-ln7qm"]
Jul 18 11:26:42.775718 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:26:42.775690    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-6df8599d98-ln7qm"
Jul 18 11:26:42.781793 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:26:42.781770    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 18 11:26:42.782638 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:26:42.782615    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 18 11:26:42.794305 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:26:42.794278    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-6df8599d98-ln7qm"]
Jul 18 11:26:42.829615 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:26:42.829581    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/640816cf-eb9e-415c-a697-251d12cdc225-tmp\") pod \"kube-auth-proxy-6df8599d98-ln7qm\" (UID: \"640816cf-eb9e-415c-a697-251d12cdc225\") " pod="openshift-ingress/kube-auth-proxy-6df8599d98-ln7qm"
Jul 18 11:26:42.829753 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:26:42.829639    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/640816cf-eb9e-415c-a697-251d12cdc225-tls-certs\") pod \"kube-auth-proxy-6df8599d98-ln7qm\" (UID: \"640816cf-eb9e-415c-a697-251d12cdc225\") " pod="openshift-ingress/kube-auth-proxy-6df8599d98-ln7qm"
Jul 18 11:26:42.829753 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:26:42.829709    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mdb5j\" (UniqueName: \"kubernetes.io/projected/640816cf-eb9e-415c-a697-251d12cdc225-kube-api-access-mdb5j\") pod \"kube-auth-proxy-6df8599d98-ln7qm\" (UID: \"640816cf-eb9e-415c-a697-251d12cdc225\") " pod="openshift-ingress/kube-auth-proxy-6df8599d98-ln7qm"
Jul 18 11:26:42.893494 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:26:42.893465    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-zr4nk"]
Jul 18 11:26:42.896559 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:26:42.896536    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-zr4nk"
Jul 18 11:26:42.899139 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:26:42.899114    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
Jul 18 11:26:42.899139 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:26:42.899136    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-5shhv\""
Jul 18 11:26:42.905039 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:26:42.905017    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-zr4nk"]
Jul 18 11:26:42.930644 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:26:42.930612    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mdb5j\" (UniqueName: \"kubernetes.io/projected/640816cf-eb9e-415c-a697-251d12cdc225-kube-api-access-mdb5j\") pod \"kube-auth-proxy-6df8599d98-ln7qm\" (UID: \"640816cf-eb9e-415c-a697-251d12cdc225\") " pod="openshift-ingress/kube-auth-proxy-6df8599d98-ln7qm"
Jul 18 11:26:42.930812 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:26:42.930664    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/94c96214-64fb-45bd-839d-363d257601b1-cert\") pod \"odh-model-controller-7998c67dc4-zr4nk\" (UID: \"94c96214-64fb-45bd-839d-363d257601b1\") " pod="opendatahub/odh-model-controller-7998c67dc4-zr4nk"
Jul 18 11:26:42.930812 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:26:42.930681    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g2dvv\" (UniqueName: \"kubernetes.io/projected/94c96214-64fb-45bd-839d-363d257601b1-kube-api-access-g2dvv\") pod \"odh-model-controller-7998c67dc4-zr4nk\" (UID: \"94c96214-64fb-45bd-839d-363d257601b1\") " pod="opendatahub/odh-model-controller-7998c67dc4-zr4nk"
Jul 18 11:26:42.930812 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:26:42.930701    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/640816cf-eb9e-415c-a697-251d12cdc225-tmp\") pod \"kube-auth-proxy-6df8599d98-ln7qm\" (UID: \"640816cf-eb9e-415c-a697-251d12cdc225\") " pod="openshift-ingress/kube-auth-proxy-6df8599d98-ln7qm"
Jul 18 11:26:42.931021 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:26:42.930824    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/640816cf-eb9e-415c-a697-251d12cdc225-tls-certs\") pod \"kube-auth-proxy-6df8599d98-ln7qm\" (UID: \"640816cf-eb9e-415c-a697-251d12cdc225\") " pod="openshift-ingress/kube-auth-proxy-6df8599d98-ln7qm"
Jul 18 11:26:42.932938 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:26:42.932912    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/640816cf-eb9e-415c-a697-251d12cdc225-tmp\") pod \"kube-auth-proxy-6df8599d98-ln7qm\" (UID: \"640816cf-eb9e-415c-a697-251d12cdc225\") " pod="openshift-ingress/kube-auth-proxy-6df8599d98-ln7qm"
Jul 18 11:26:42.933201 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:26:42.933184    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/640816cf-eb9e-415c-a697-251d12cdc225-tls-certs\") pod \"kube-auth-proxy-6df8599d98-ln7qm\" (UID: \"640816cf-eb9e-415c-a697-251d12cdc225\") " pod="openshift-ingress/kube-auth-proxy-6df8599d98-ln7qm"
Jul 18 11:26:42.938498 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:26:42.938475    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mdb5j\" (UniqueName: \"kubernetes.io/projected/640816cf-eb9e-415c-a697-251d12cdc225-kube-api-access-mdb5j\") pod \"kube-auth-proxy-6df8599d98-ln7qm\" (UID: \"640816cf-eb9e-415c-a697-251d12cdc225\") " pod="openshift-ingress/kube-auth-proxy-6df8599d98-ln7qm"
Jul 18 11:26:43.031409 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:26:43.031322    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/94c96214-64fb-45bd-839d-363d257601b1-cert\") pod \"odh-model-controller-7998c67dc4-zr4nk\" (UID: \"94c96214-64fb-45bd-839d-363d257601b1\") " pod="opendatahub/odh-model-controller-7998c67dc4-zr4nk"
Jul 18 11:26:43.031409 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:26:43.031363    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g2dvv\" (UniqueName: \"kubernetes.io/projected/94c96214-64fb-45bd-839d-363d257601b1-kube-api-access-g2dvv\") pod \"odh-model-controller-7998c67dc4-zr4nk\" (UID: \"94c96214-64fb-45bd-839d-363d257601b1\") " pod="opendatahub/odh-model-controller-7998c67dc4-zr4nk"
Jul 18 11:26:43.031593 ip-10-0-133-122 kubenswrapper[2579]: E0718 11:26:43.031472    2579 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found
Jul 18 11:26:43.031593 ip-10-0-133-122 kubenswrapper[2579]: E0718 11:26:43.031547    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/94c96214-64fb-45bd-839d-363d257601b1-cert podName:94c96214-64fb-45bd-839d-363d257601b1 nodeName:}" failed. No retries permitted until 2026-07-18 11:26:43.531531123 +0000 UTC m=+423.146567403 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/94c96214-64fb-45bd-839d-363d257601b1-cert") pod "odh-model-controller-7998c67dc4-zr4nk" (UID: "94c96214-64fb-45bd-839d-363d257601b1") : secret "odh-model-controller-webhook-cert" not found
Jul 18 11:26:43.042705 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:26:43.042673    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g2dvv\" (UniqueName: \"kubernetes.io/projected/94c96214-64fb-45bd-839d-363d257601b1-kube-api-access-g2dvv\") pod \"odh-model-controller-7998c67dc4-zr4nk\" (UID: \"94c96214-64fb-45bd-839d-363d257601b1\") " pod="opendatahub/odh-model-controller-7998c67dc4-zr4nk"
Jul 18 11:26:43.087257 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:26:43.087225    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-6df8599d98-ln7qm"
Jul 18 11:26:43.221669 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:26:43.221645    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-6df8599d98-ln7qm"]
Jul 18 11:26:43.223931 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:26:43.223902    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod640816cf_eb9e_415c_a697_251d12cdc225.slice/crio-240739048e1c10c07f53651d68c60d63fbccdfb23f33edef009983326918ec46 WatchSource:0}: Error finding container 240739048e1c10c07f53651d68c60d63fbccdfb23f33edef009983326918ec46: Status 404 returned error can't find the container with id 240739048e1c10c07f53651d68c60d63fbccdfb23f33edef009983326918ec46
Jul 18 11:26:43.536757 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:26:43.536723    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/94c96214-64fb-45bd-839d-363d257601b1-cert\") pod \"odh-model-controller-7998c67dc4-zr4nk\" (UID: \"94c96214-64fb-45bd-839d-363d257601b1\") " pod="opendatahub/odh-model-controller-7998c67dc4-zr4nk"
Jul 18 11:26:43.539226 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:26:43.539198    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/94c96214-64fb-45bd-839d-363d257601b1-cert\") pod \"odh-model-controller-7998c67dc4-zr4nk\" (UID: \"94c96214-64fb-45bd-839d-363d257601b1\") " pod="opendatahub/odh-model-controller-7998c67dc4-zr4nk"
Jul 18 11:26:43.732721 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:26:43.732687    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-gt9q8"]
Jul 18 11:26:43.737084 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:26:43.737068    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-gt9q8"
Jul 18 11:26:43.741116 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:26:43.741096    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-dockercfg-sfwqb\""
Jul 18 11:26:43.741280 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:26:43.741096    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\""
Jul 18 11:26:43.749623 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:26:43.749603    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-gt9q8"]
Jul 18 11:26:43.808286 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:26:43.808192    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-zr4nk"
Jul 18 11:26:43.840447 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:26:43.840415    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-spw4s\" (UniqueName: \"kubernetes.io/projected/457d77bd-9dba-45f9-b058-e7e858552e30-kube-api-access-spw4s\") pod \"model-serving-api-54d89bd5fc-gt9q8\" (UID: \"457d77bd-9dba-45f9-b058-e7e858552e30\") " pod="opendatahub/model-serving-api-54d89bd5fc-gt9q8"
Jul 18 11:26:43.840622 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:26:43.840519    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/457d77bd-9dba-45f9-b058-e7e858552e30-tls-certs\") pod \"model-serving-api-54d89bd5fc-gt9q8\" (UID: \"457d77bd-9dba-45f9-b058-e7e858552e30\") " pod="opendatahub/model-serving-api-54d89bd5fc-gt9q8"
Jul 18 11:26:43.878525 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:26:43.878436    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-6df8599d98-ln7qm" event={"ID":"640816cf-eb9e-415c-a697-251d12cdc225","Type":"ContainerStarted","Data":"240739048e1c10c07f53651d68c60d63fbccdfb23f33edef009983326918ec46"}
Jul 18 11:26:43.941555 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:26:43.941464    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/457d77bd-9dba-45f9-b058-e7e858552e30-tls-certs\") pod \"model-serving-api-54d89bd5fc-gt9q8\" (UID: \"457d77bd-9dba-45f9-b058-e7e858552e30\") " pod="opendatahub/model-serving-api-54d89bd5fc-gt9q8"
Jul 18 11:26:43.941555 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:26:43.941546    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-spw4s\" (UniqueName: \"kubernetes.io/projected/457d77bd-9dba-45f9-b058-e7e858552e30-kube-api-access-spw4s\") pod \"model-serving-api-54d89bd5fc-gt9q8\" (UID: \"457d77bd-9dba-45f9-b058-e7e858552e30\") " pod="opendatahub/model-serving-api-54d89bd5fc-gt9q8"
Jul 18 11:26:43.946607 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:26:43.946576    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/457d77bd-9dba-45f9-b058-e7e858552e30-tls-certs\") pod \"model-serving-api-54d89bd5fc-gt9q8\" (UID: \"457d77bd-9dba-45f9-b058-e7e858552e30\") " pod="opendatahub/model-serving-api-54d89bd5fc-gt9q8"
Jul 18 11:26:43.952329 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:26:43.952302    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-spw4s\" (UniqueName: \"kubernetes.io/projected/457d77bd-9dba-45f9-b058-e7e858552e30-kube-api-access-spw4s\") pod \"model-serving-api-54d89bd5fc-gt9q8\" (UID: \"457d77bd-9dba-45f9-b058-e7e858552e30\") " pod="opendatahub/model-serving-api-54d89bd5fc-gt9q8"
Jul 18 11:26:43.979229 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:26:43.979202    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-zr4nk"]
Jul 18 11:26:43.982120 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:26:43.982080    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod94c96214_64fb_45bd_839d_363d257601b1.slice/crio-fb4775a50bc6d2eabf2b63abeb934f8e002ca2091f08383a7c9558f71a7cb102 WatchSource:0}: Error finding container fb4775a50bc6d2eabf2b63abeb934f8e002ca2091f08383a7c9558f71a7cb102: Status 404 returned error can't find the container with id fb4775a50bc6d2eabf2b63abeb934f8e002ca2091f08383a7c9558f71a7cb102
Jul 18 11:26:44.049786 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:26:44.049747    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-gt9q8"
Jul 18 11:26:44.213315 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:26:44.213048    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-gt9q8"]
Jul 18 11:26:44.216390 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:26:44.216359    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod457d77bd_9dba_45f9_b058_e7e858552e30.slice/crio-206f0b83a0748205439f6c22e28db1b680b113cb2b5ed348adfe090fdfc39e27 WatchSource:0}: Error finding container 206f0b83a0748205439f6c22e28db1b680b113cb2b5ed348adfe090fdfc39e27: Status 404 returned error can't find the container with id 206f0b83a0748205439f6c22e28db1b680b113cb2b5ed348adfe090fdfc39e27
Jul 18 11:26:44.277213 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:26:44.277184    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-xqrjw"]
Jul 18 11:26:44.281435 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:26:44.281415    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-xqrjw"
Jul 18 11:26:44.283877 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:26:44.283837    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 18 11:26:44.283877 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:26:44.283850    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Jul 18 11:26:44.284067 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:26:44.284051    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Jul 18 11:26:44.284266 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:26:44.284247    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-2q4cv\""
Jul 18 11:26:44.284362 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:26:44.284347    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Jul 18 11:26:44.292474 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:26:44.292451    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-xqrjw"]
Jul 18 11:26:44.345781 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:26:44.345746    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/89990a09-ed06-4a79-87d2-6ff28475af9e-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-xqrjw\" (UID: \"89990a09-ed06-4a79-87d2-6ff28475af9e\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-xqrjw"
Jul 18 11:26:44.345989 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:26:44.345818    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pmjch\" (UniqueName: \"kubernetes.io/projected/89990a09-ed06-4a79-87d2-6ff28475af9e-kube-api-access-pmjch\") pod \"istiod-openshift-gateway-7574459656-xqrjw\" (UID: \"89990a09-ed06-4a79-87d2-6ff28475af9e\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-xqrjw"
Jul 18 11:26:44.345989 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:26:44.345842    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/89990a09-ed06-4a79-87d2-6ff28475af9e-istio-token\") pod \"istiod-openshift-gateway-7574459656-xqrjw\" (UID: \"89990a09-ed06-4a79-87d2-6ff28475af9e\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-xqrjw"
Jul 18 11:26:44.345989 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:26:44.345872    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/89990a09-ed06-4a79-87d2-6ff28475af9e-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-xqrjw\" (UID: \"89990a09-ed06-4a79-87d2-6ff28475af9e\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-xqrjw"
Jul 18 11:26:44.345989 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:26:44.345970    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/89990a09-ed06-4a79-87d2-6ff28475af9e-cacerts\") pod \"istiod-openshift-gateway-7574459656-xqrjw\" (UID: \"89990a09-ed06-4a79-87d2-6ff28475af9e\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-xqrjw"
Jul 18 11:26:44.346159 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:26:44.346015    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/89990a09-ed06-4a79-87d2-6ff28475af9e-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-xqrjw\" (UID: \"89990a09-ed06-4a79-87d2-6ff28475af9e\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-xqrjw"
Jul 18 11:26:44.346159 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:26:44.346043    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/89990a09-ed06-4a79-87d2-6ff28475af9e-local-certs\") pod \"istiod-openshift-gateway-7574459656-xqrjw\" (UID: \"89990a09-ed06-4a79-87d2-6ff28475af9e\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-xqrjw"
Jul 18 11:26:44.447512 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:26:44.447473    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/89990a09-ed06-4a79-87d2-6ff28475af9e-cacerts\") pod \"istiod-openshift-gateway-7574459656-xqrjw\" (UID: \"89990a09-ed06-4a79-87d2-6ff28475af9e\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-xqrjw"
Jul 18 11:26:44.447678 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:26:44.447535    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/89990a09-ed06-4a79-87d2-6ff28475af9e-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-xqrjw\" (UID: \"89990a09-ed06-4a79-87d2-6ff28475af9e\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-xqrjw"
Jul 18 11:26:44.447678 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:26:44.447589    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/89990a09-ed06-4a79-87d2-6ff28475af9e-local-certs\") pod \"istiod-openshift-gateway-7574459656-xqrjw\" (UID: \"89990a09-ed06-4a79-87d2-6ff28475af9e\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-xqrjw"
Jul 18 11:26:44.447678 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:26:44.447649    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/89990a09-ed06-4a79-87d2-6ff28475af9e-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-xqrjw\" (UID: \"89990a09-ed06-4a79-87d2-6ff28475af9e\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-xqrjw"
Jul 18 11:26:44.447856 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:26:44.447703    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pmjch\" (UniqueName: \"kubernetes.io/projected/89990a09-ed06-4a79-87d2-6ff28475af9e-kube-api-access-pmjch\") pod \"istiod-openshift-gateway-7574459656-xqrjw\" (UID: \"89990a09-ed06-4a79-87d2-6ff28475af9e\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-xqrjw"
Jul 18 11:26:44.447856 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:26:44.447721    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/89990a09-ed06-4a79-87d2-6ff28475af9e-istio-token\") pod \"istiod-openshift-gateway-7574459656-xqrjw\" (UID: \"89990a09-ed06-4a79-87d2-6ff28475af9e\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-xqrjw"
Jul 18 11:26:44.447856 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:26:44.447751    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/89990a09-ed06-4a79-87d2-6ff28475af9e-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-xqrjw\" (UID: \"89990a09-ed06-4a79-87d2-6ff28475af9e\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-xqrjw"
Jul 18 11:26:44.448437 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:26:44.448404    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/89990a09-ed06-4a79-87d2-6ff28475af9e-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-xqrjw\" (UID: \"89990a09-ed06-4a79-87d2-6ff28475af9e\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-xqrjw"
Jul 18 11:26:44.450127 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:26:44.450096    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/89990a09-ed06-4a79-87d2-6ff28475af9e-local-certs\") pod \"istiod-openshift-gateway-7574459656-xqrjw\" (UID: \"89990a09-ed06-4a79-87d2-6ff28475af9e\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-xqrjw"
Jul 18 11:26:44.450232 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:26:44.450195    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/89990a09-ed06-4a79-87d2-6ff28475af9e-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-xqrjw\" (UID: \"89990a09-ed06-4a79-87d2-6ff28475af9e\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-xqrjw"
Jul 18 11:26:44.450356 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:26:44.450337    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/89990a09-ed06-4a79-87d2-6ff28475af9e-cacerts\") pod \"istiod-openshift-gateway-7574459656-xqrjw\" (UID: \"89990a09-ed06-4a79-87d2-6ff28475af9e\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-xqrjw"
Jul 18 11:26:44.450558 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:26:44.450537    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/89990a09-ed06-4a79-87d2-6ff28475af9e-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-xqrjw\" (UID: \"89990a09-ed06-4a79-87d2-6ff28475af9e\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-xqrjw"
Jul 18 11:26:44.458794 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:26:44.458769    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pmjch\" (UniqueName: \"kubernetes.io/projected/89990a09-ed06-4a79-87d2-6ff28475af9e-kube-api-access-pmjch\") pod \"istiod-openshift-gateway-7574459656-xqrjw\" (UID: \"89990a09-ed06-4a79-87d2-6ff28475af9e\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-xqrjw"
Jul 18 11:26:44.462219 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:26:44.462196    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/89990a09-ed06-4a79-87d2-6ff28475af9e-istio-token\") pod \"istiod-openshift-gateway-7574459656-xqrjw\" (UID: \"89990a09-ed06-4a79-87d2-6ff28475af9e\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-xqrjw"
Jul 18 11:26:44.590622 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:26:44.590586    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-xqrjw"
Jul 18 11:26:44.771431 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:26:44.771181    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-xqrjw"]
Jul 18 11:26:44.774058 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:26:44.774021    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod89990a09_ed06_4a79_87d2_6ff28475af9e.slice/crio-7b2a5f6ca5a81d0f5607bd599e6b7903e766edbb4486b895c6ad0d9676b889b2 WatchSource:0}: Error finding container 7b2a5f6ca5a81d0f5607bd599e6b7903e766edbb4486b895c6ad0d9676b889b2: Status 404 returned error can't find the container with id 7b2a5f6ca5a81d0f5607bd599e6b7903e766edbb4486b895c6ad0d9676b889b2
Jul 18 11:26:44.895963 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:26:44.895827    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-xqrjw" event={"ID":"89990a09-ed06-4a79-87d2-6ff28475af9e","Type":"ContainerStarted","Data":"7b2a5f6ca5a81d0f5607bd599e6b7903e766edbb4486b895c6ad0d9676b889b2"}
Jul 18 11:26:44.896517 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:26:44.895883    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-zr4nk" event={"ID":"94c96214-64fb-45bd-839d-363d257601b1","Type":"ContainerStarted","Data":"fb4775a50bc6d2eabf2b63abeb934f8e002ca2091f08383a7c9558f71a7cb102"}
Jul 18 11:26:44.896517 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:26:44.896479    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-gt9q8" event={"ID":"457d77bd-9dba-45f9-b058-e7e858552e30","Type":"ContainerStarted","Data":"206f0b83a0748205439f6c22e28db1b680b113cb2b5ed348adfe090fdfc39e27"}
Jul 18 11:26:48.620512 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:26:48.620466    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 18 11:26:48.620776 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:26:48.620560    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 18 11:26:48.914397 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:26:48.914347    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-6df8599d98-ln7qm" event={"ID":"640816cf-eb9e-415c-a697-251d12cdc225","Type":"ContainerStarted","Data":"909fd4e4b4457918866e245b01e49538e256b46a4e1feb3de14711c0928d1302"}
Jul 18 11:26:48.915868 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:26:48.915843    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-gt9q8" event={"ID":"457d77bd-9dba-45f9-b058-e7e858552e30","Type":"ContainerStarted","Data":"694572d986013b48edf3cde5226b003ed90144f296c931bfa38cdd46751ddd41"}
Jul 18 11:26:48.916018 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:26:48.915927    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-gt9q8"
Jul 18 11:26:48.917427 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:26:48.917407    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-xqrjw" event={"ID":"89990a09-ed06-4a79-87d2-6ff28475af9e","Type":"ContainerStarted","Data":"ae6b1af68d39763acbecedbdc9e00b9d4c348a7633459c8dacfd038428c2e6e1"}
Jul 18 11:26:48.917584 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:26:48.917521    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-xqrjw"
Jul 18 11:26:48.919031 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:26:48.919005    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-zr4nk" event={"ID":"94c96214-64fb-45bd-839d-363d257601b1","Type":"ContainerStarted","Data":"f742c66af38605f9bceb4630d9c1f460b12b74691ec786d48d5789926075dd76"}
Jul 18 11:26:48.919114 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:26:48.919058    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-zr4nk"
Jul 18 11:26:48.933347 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:26:48.933299    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-6df8599d98-ln7qm" podStartSLOduration=2.476818724 podStartE2EDuration="6.933280718s" totalImagesPullingTime="4.456461994s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 11:26:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 11:26:48.931664291 +0000 UTC m=+428.546700594" watchObservedRunningTime="2026-07-18 11:26:48.933280718 +0000 UTC m=+428.548317019"
Jul 18 11:26:48.949160 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:26:48.949102    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-gt9q8" podStartSLOduration=1.613469603 podStartE2EDuration="5.94908184s" totalImagesPullingTime="4.335612237s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 11:26:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 11:26:48.947607998 +0000 UTC m=+428.562644302" watchObservedRunningTime="2026-07-18 11:26:48.94908184 +0000 UTC m=+428.564118143"
Jul 18 11:26:48.969744 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:26:48.969694    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7574459656-xqrjw" podStartSLOduration=1.12644428 podStartE2EDuration="4.969677978s" totalImagesPullingTime="3.843233698s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 11:26:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 11:26:48.96857735 +0000 UTC m=+428.583613653" watchObservedRunningTime="2026-07-18 11:26:48.969677978 +0000 UTC m=+428.584714272"
Jul 18 11:26:48.984232 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:26:48.984179    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-zr4nk" podStartSLOduration=2.403755385 podStartE2EDuration="6.98415796s" totalImagesPullingTime="4.580402575s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 11:26:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 11:26:48.983117725 +0000 UTC m=+428.598154039" watchObservedRunningTime="2026-07-18 11:26:48.98415796 +0000 UTC m=+428.599194264"
Jul 18 11:26:49.928248 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:26:49.928209    2579 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7574459656-xqrjw container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 18 11:26:49.928732 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:26:49.928285    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7574459656-xqrjw" podUID="89990a09-ed06-4a79-87d2-6ff28475af9e" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 18 11:26:52.927214 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:26:52.927178    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-xqrjw"
Jul 18 11:26:54.752388 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:26:54.752351    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-xqrjw"]
Jul 18 11:26:54.752962 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:26:54.752531    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7574459656-xqrjw" podUID="89990a09-ed06-4a79-87d2-6ff28475af9e" containerName="discovery" containerID="cri-o://ae6b1af68d39763acbecedbdc9e00b9d4c348a7633459c8dacfd038428c2e6e1" gracePeriod=30
Jul 18 11:26:54.950464 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:26:54.950434    2579 generic.go:356] "Generic (PLEG): container finished" podID="89990a09-ed06-4a79-87d2-6ff28475af9e" containerID="ae6b1af68d39763acbecedbdc9e00b9d4c348a7633459c8dacfd038428c2e6e1" exitCode=0
Jul 18 11:26:54.950645 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:26:54.950482    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-xqrjw" event={"ID":"89990a09-ed06-4a79-87d2-6ff28475af9e","Type":"ContainerDied","Data":"ae6b1af68d39763acbecedbdc9e00b9d4c348a7633459c8dacfd038428c2e6e1"}
Jul 18 11:26:55.021497 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:26:55.021407    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-xqrjw"
Jul 18 11:26:55.146876 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:26:55.146840    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/89990a09-ed06-4a79-87d2-6ff28475af9e-istio-token\") pod \"89990a09-ed06-4a79-87d2-6ff28475af9e\" (UID: \"89990a09-ed06-4a79-87d2-6ff28475af9e\") "
Jul 18 11:26:55.146876 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:26:55.146878    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/89990a09-ed06-4a79-87d2-6ff28475af9e-cacerts\") pod \"89990a09-ed06-4a79-87d2-6ff28475af9e\" (UID: \"89990a09-ed06-4a79-87d2-6ff28475af9e\") "
Jul 18 11:26:55.147113 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:26:55.146950    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pmjch\" (UniqueName: \"kubernetes.io/projected/89990a09-ed06-4a79-87d2-6ff28475af9e-kube-api-access-pmjch\") pod \"89990a09-ed06-4a79-87d2-6ff28475af9e\" (UID: \"89990a09-ed06-4a79-87d2-6ff28475af9e\") "
Jul 18 11:26:55.147113 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:26:55.147010    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/89990a09-ed06-4a79-87d2-6ff28475af9e-istio-csr-ca-configmap\") pod \"89990a09-ed06-4a79-87d2-6ff28475af9e\" (UID: \"89990a09-ed06-4a79-87d2-6ff28475af9e\") "
Jul 18 11:26:55.147113 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:26:55.147059    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/89990a09-ed06-4a79-87d2-6ff28475af9e-istio-csr-dns-cert\") pod \"89990a09-ed06-4a79-87d2-6ff28475af9e\" (UID: \"89990a09-ed06-4a79-87d2-6ff28475af9e\") "
Jul 18 11:26:55.147113 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:26:55.147103    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/89990a09-ed06-4a79-87d2-6ff28475af9e-istio-kubeconfig\") pod \"89990a09-ed06-4a79-87d2-6ff28475af9e\" (UID: \"89990a09-ed06-4a79-87d2-6ff28475af9e\") "
Jul 18 11:26:55.147356 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:26:55.147127    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/89990a09-ed06-4a79-87d2-6ff28475af9e-local-certs\") pod \"89990a09-ed06-4a79-87d2-6ff28475af9e\" (UID: \"89990a09-ed06-4a79-87d2-6ff28475af9e\") "
Jul 18 11:26:55.147424 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:26:55.147372    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/89990a09-ed06-4a79-87d2-6ff28475af9e-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "89990a09-ed06-4a79-87d2-6ff28475af9e" (UID: "89990a09-ed06-4a79-87d2-6ff28475af9e"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 18 11:26:55.149356 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:26:55.149327    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/89990a09-ed06-4a79-87d2-6ff28475af9e-istio-token" (OuterVolumeSpecName: "istio-token") pod "89990a09-ed06-4a79-87d2-6ff28475af9e" (UID: "89990a09-ed06-4a79-87d2-6ff28475af9e"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 18 11:26:55.149487 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:26:55.149407    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/89990a09-ed06-4a79-87d2-6ff28475af9e-kube-api-access-pmjch" (OuterVolumeSpecName: "kube-api-access-pmjch") pod "89990a09-ed06-4a79-87d2-6ff28475af9e" (UID: "89990a09-ed06-4a79-87d2-6ff28475af9e"). InnerVolumeSpecName "kube-api-access-pmjch". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 18 11:26:55.149572 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:26:55.149550    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/89990a09-ed06-4a79-87d2-6ff28475af9e-cacerts" (OuterVolumeSpecName: "cacerts") pod "89990a09-ed06-4a79-87d2-6ff28475af9e" (UID: "89990a09-ed06-4a79-87d2-6ff28475af9e"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 18 11:26:55.149627 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:26:55.149571    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/89990a09-ed06-4a79-87d2-6ff28475af9e-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "89990a09-ed06-4a79-87d2-6ff28475af9e" (UID: "89990a09-ed06-4a79-87d2-6ff28475af9e"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 18 11:26:55.149627 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:26:55.149595    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/89990a09-ed06-4a79-87d2-6ff28475af9e-local-certs" (OuterVolumeSpecName: "local-certs") pod "89990a09-ed06-4a79-87d2-6ff28475af9e" (UID: "89990a09-ed06-4a79-87d2-6ff28475af9e"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 11:26:55.149627 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:26:55.149604    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/89990a09-ed06-4a79-87d2-6ff28475af9e-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "89990a09-ed06-4a79-87d2-6ff28475af9e" (UID: "89990a09-ed06-4a79-87d2-6ff28475af9e"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 18 11:26:55.248580 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:26:55.248535    2579 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/89990a09-ed06-4a79-87d2-6ff28475af9e-istio-kubeconfig\") on node \"ip-10-0-133-122.ec2.internal\" DevicePath \"\""
Jul 18 11:26:55.248580 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:26:55.248576    2579 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/89990a09-ed06-4a79-87d2-6ff28475af9e-local-certs\") on node \"ip-10-0-133-122.ec2.internal\" DevicePath \"\""
Jul 18 11:26:55.248580 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:26:55.248588    2579 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/89990a09-ed06-4a79-87d2-6ff28475af9e-istio-token\") on node \"ip-10-0-133-122.ec2.internal\" DevicePath \"\""
Jul 18 11:26:55.248580 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:26:55.248596    2579 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/89990a09-ed06-4a79-87d2-6ff28475af9e-cacerts\") on node \"ip-10-0-133-122.ec2.internal\" DevicePath \"\""
Jul 18 11:26:55.248861 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:26:55.248604    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pmjch\" (UniqueName: \"kubernetes.io/projected/89990a09-ed06-4a79-87d2-6ff28475af9e-kube-api-access-pmjch\") on node \"ip-10-0-133-122.ec2.internal\" DevicePath \"\""
Jul 18 11:26:55.248861 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:26:55.248614    2579 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/89990a09-ed06-4a79-87d2-6ff28475af9e-istio-csr-ca-configmap\") on node \"ip-10-0-133-122.ec2.internal\" DevicePath \"\""
Jul 18 11:26:55.248861 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:26:55.248623    2579 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/89990a09-ed06-4a79-87d2-6ff28475af9e-istio-csr-dns-cert\") on node \"ip-10-0-133-122.ec2.internal\" DevicePath \"\""
Jul 18 11:26:55.956623 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:26:55.956581    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-xqrjw" event={"ID":"89990a09-ed06-4a79-87d2-6ff28475af9e","Type":"ContainerDied","Data":"7b2a5f6ca5a81d0f5607bd599e6b7903e766edbb4486b895c6ad0d9676b889b2"}
Jul 18 11:26:55.957103 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:26:55.956642    2579 scope.go:117] "RemoveContainer" containerID="ae6b1af68d39763acbecedbdc9e00b9d4c348a7633459c8dacfd038428c2e6e1"
Jul 18 11:26:55.957103 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:26:55.956596    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-xqrjw"
Jul 18 11:26:55.989998 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:26:55.989960    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-xqrjw"]
Jul 18 11:26:55.998652 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:26:55.998617    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-xqrjw"]
Jul 18 11:26:56.893792 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:26:56.893754    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="89990a09-ed06-4a79-87d2-6ff28475af9e" path="/var/lib/kubelet/pods/89990a09-ed06-4a79-87d2-6ff28475af9e/volumes"
Jul 18 11:26:59.928751 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:26:59.928722    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-zr4nk"
Jul 18 11:26:59.930692 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:26:59.930671    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-gt9q8"
Jul 18 11:27:43.612487 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:27:43.612453    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-pc5qh"]
Jul 18 11:27:43.612925 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:27:43.612774    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="89990a09-ed06-4a79-87d2-6ff28475af9e" containerName="discovery"
Jul 18 11:27:43.612925 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:27:43.612784    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="89990a09-ed06-4a79-87d2-6ff28475af9e" containerName="discovery"
Jul 18 11:27:43.612925 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:27:43.612836    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="89990a09-ed06-4a79-87d2-6ff28475af9e" containerName="discovery"
Jul 18 11:27:43.617053 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:27:43.617025    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-pc5qh"
Jul 18 11:27:43.619595 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:27:43.619571    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 18 11:27:43.619727 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:27:43.619573    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-4jtnv\""
Jul 18 11:27:43.620641 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:27:43.620622    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 18 11:27:43.625420 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:27:43.625395    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-pc5qh"]
Jul 18 11:27:43.760070 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:27:43.760030    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8nqhb\" (UniqueName: \"kubernetes.io/projected/dc2a9d82-4707-4048-8ee2-11681dc66aee-kube-api-access-8nqhb\") pod \"kuadrant-operator-catalog-pc5qh\" (UID: \"dc2a9d82-4707-4048-8ee2-11681dc66aee\") " pod="kuadrant-system/kuadrant-operator-catalog-pc5qh"
Jul 18 11:27:43.860550 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:27:43.860513    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8nqhb\" (UniqueName: \"kubernetes.io/projected/dc2a9d82-4707-4048-8ee2-11681dc66aee-kube-api-access-8nqhb\") pod \"kuadrant-operator-catalog-pc5qh\" (UID: \"dc2a9d82-4707-4048-8ee2-11681dc66aee\") " pod="kuadrant-system/kuadrant-operator-catalog-pc5qh"
Jul 18 11:27:43.868436 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:27:43.868373    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8nqhb\" (UniqueName: \"kubernetes.io/projected/dc2a9d82-4707-4048-8ee2-11681dc66aee-kube-api-access-8nqhb\") pod \"kuadrant-operator-catalog-pc5qh\" (UID: \"dc2a9d82-4707-4048-8ee2-11681dc66aee\") " pod="kuadrant-system/kuadrant-operator-catalog-pc5qh"
Jul 18 11:27:43.927635 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:27:43.927598    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-pc5qh"
Jul 18 11:27:43.979503 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:27:43.979472    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-pc5qh"]
Jul 18 11:27:44.065986 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:27:44.065960    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-pc5qh"]
Jul 18 11:27:44.067731 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:27:44.067705    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddc2a9d82_4707_4048_8ee2_11681dc66aee.slice/crio-052b65198a6407a7845f14d464c9265912305e171aca1abb606e06faf446fc2a WatchSource:0}: Error finding container 052b65198a6407a7845f14d464c9265912305e171aca1abb606e06faf446fc2a: Status 404 returned error can't find the container with id 052b65198a6407a7845f14d464c9265912305e171aca1abb606e06faf446fc2a
Jul 18 11:27:44.168563 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:27:44.168474    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-pc5qh" event={"ID":"dc2a9d82-4707-4048-8ee2-11681dc66aee","Type":"ContainerStarted","Data":"052b65198a6407a7845f14d464c9265912305e171aca1abb606e06faf446fc2a"}
Jul 18 11:27:44.187656 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:27:44.187626    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-s65nm"]
Jul 18 11:27:44.191880 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:27:44.191864    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-s65nm"
Jul 18 11:27:44.199766 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:27:44.199743    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-s65nm"]
Jul 18 11:27:44.263755 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:27:44.263727    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b9v7w\" (UniqueName: \"kubernetes.io/projected/8c6394f8-d608-425a-bec8-b33c5fe82ef8-kube-api-access-b9v7w\") pod \"kuadrant-operator-catalog-s65nm\" (UID: \"8c6394f8-d608-425a-bec8-b33c5fe82ef8\") " pod="kuadrant-system/kuadrant-operator-catalog-s65nm"
Jul 18 11:27:44.364752 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:27:44.364710    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b9v7w\" (UniqueName: \"kubernetes.io/projected/8c6394f8-d608-425a-bec8-b33c5fe82ef8-kube-api-access-b9v7w\") pod \"kuadrant-operator-catalog-s65nm\" (UID: \"8c6394f8-d608-425a-bec8-b33c5fe82ef8\") " pod="kuadrant-system/kuadrant-operator-catalog-s65nm"
Jul 18 11:27:44.374325 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:27:44.374272    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b9v7w\" (UniqueName: \"kubernetes.io/projected/8c6394f8-d608-425a-bec8-b33c5fe82ef8-kube-api-access-b9v7w\") pod \"kuadrant-operator-catalog-s65nm\" (UID: \"8c6394f8-d608-425a-bec8-b33c5fe82ef8\") " pod="kuadrant-system/kuadrant-operator-catalog-s65nm"
Jul 18 11:27:44.502672 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:27:44.502580    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-s65nm"
Jul 18 11:27:44.642374 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:27:44.642302    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-s65nm"]
Jul 18 11:27:44.644846 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:27:44.644817    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8c6394f8_d608_425a_bec8_b33c5fe82ef8.slice/crio-b863f0d63ab0eaf397578b0474201b195eb25289ef6c784d897cea595bfcc4f7 WatchSource:0}: Error finding container b863f0d63ab0eaf397578b0474201b195eb25289ef6c784d897cea595bfcc4f7: Status 404 returned error can't find the container with id b863f0d63ab0eaf397578b0474201b195eb25289ef6c784d897cea595bfcc4f7
Jul 18 11:27:45.177332 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:27:45.177257    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-s65nm" event={"ID":"8c6394f8-d608-425a-bec8-b33c5fe82ef8","Type":"ContainerStarted","Data":"b863f0d63ab0eaf397578b0474201b195eb25289ef6c784d897cea595bfcc4f7"}
Jul 18 11:27:46.184070 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:27:46.184023    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-pc5qh" event={"ID":"dc2a9d82-4707-4048-8ee2-11681dc66aee","Type":"ContainerStarted","Data":"4ab352767ef413c8fef12a374b356e0952ebc6c4391e8861c015c23bcd197195"}
Jul 18 11:27:46.184647 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:27:46.184091    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-pc5qh" podUID="dc2a9d82-4707-4048-8ee2-11681dc66aee" containerName="registry-server" containerID="cri-o://4ab352767ef413c8fef12a374b356e0952ebc6c4391e8861c015c23bcd197195" gracePeriod=2
Jul 18 11:27:46.186442 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:27:46.186415    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-s65nm" event={"ID":"8c6394f8-d608-425a-bec8-b33c5fe82ef8","Type":"ContainerStarted","Data":"88811929db4c447243e5893a23a81745cf6acde126b51e4e322f16db22eb999b"}
Jul 18 11:27:46.200537 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:27:46.200479    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-pc5qh" podStartSLOduration=1.222255276 podStartE2EDuration="3.200464675s" totalImagesPullingTime="1.978209399s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 11:27:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 11:27:46.198712471 +0000 UTC m=+485.813748778" watchObservedRunningTime="2026-07-18 11:27:46.200464675 +0000 UTC m=+485.815500977"
Jul 18 11:27:46.213883 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:27:46.213478    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-s65nm" podStartSLOduration=0.811640875 podStartE2EDuration="2.213457934s" totalImagesPullingTime="1.401817059s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 11:27:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 11:27:46.212272802 +0000 UTC m=+485.827309106" watchObservedRunningTime="2026-07-18 11:27:46.213457934 +0000 UTC m=+485.828494237"
Jul 18 11:27:46.533773 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:27:46.533748    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-pc5qh"
Jul 18 11:27:46.685507 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:27:46.685468    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8nqhb\" (UniqueName: \"kubernetes.io/projected/dc2a9d82-4707-4048-8ee2-11681dc66aee-kube-api-access-8nqhb\") pod \"dc2a9d82-4707-4048-8ee2-11681dc66aee\" (UID: \"dc2a9d82-4707-4048-8ee2-11681dc66aee\") "
Jul 18 11:27:46.687610 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:27:46.687586    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dc2a9d82-4707-4048-8ee2-11681dc66aee-kube-api-access-8nqhb" (OuterVolumeSpecName: "kube-api-access-8nqhb") pod "dc2a9d82-4707-4048-8ee2-11681dc66aee" (UID: "dc2a9d82-4707-4048-8ee2-11681dc66aee"). InnerVolumeSpecName "kube-api-access-8nqhb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 18 11:27:46.786350 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:27:46.786304    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8nqhb\" (UniqueName: \"kubernetes.io/projected/dc2a9d82-4707-4048-8ee2-11681dc66aee-kube-api-access-8nqhb\") on node \"ip-10-0-133-122.ec2.internal\" DevicePath \"\""
Jul 18 11:27:47.191711 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:27:47.191678    2579 generic.go:356] "Generic (PLEG): container finished" podID="dc2a9d82-4707-4048-8ee2-11681dc66aee" containerID="4ab352767ef413c8fef12a374b356e0952ebc6c4391e8861c015c23bcd197195" exitCode=0
Jul 18 11:27:47.192132 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:27:47.191720    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-pc5qh"
Jul 18 11:27:47.192132 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:27:47.191768    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-pc5qh" event={"ID":"dc2a9d82-4707-4048-8ee2-11681dc66aee","Type":"ContainerDied","Data":"4ab352767ef413c8fef12a374b356e0952ebc6c4391e8861c015c23bcd197195"}
Jul 18 11:27:47.192132 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:27:47.191812    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-pc5qh" event={"ID":"dc2a9d82-4707-4048-8ee2-11681dc66aee","Type":"ContainerDied","Data":"052b65198a6407a7845f14d464c9265912305e171aca1abb606e06faf446fc2a"}
Jul 18 11:27:47.192132 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:27:47.191835    2579 scope.go:117] "RemoveContainer" containerID="4ab352767ef413c8fef12a374b356e0952ebc6c4391e8861c015c23bcd197195"
Jul 18 11:27:47.200582 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:27:47.200563    2579 scope.go:117] "RemoveContainer" containerID="4ab352767ef413c8fef12a374b356e0952ebc6c4391e8861c015c23bcd197195"
Jul 18 11:27:47.200816 ip-10-0-133-122 kubenswrapper[2579]: E0718 11:27:47.200798    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4ab352767ef413c8fef12a374b356e0952ebc6c4391e8861c015c23bcd197195\": container with ID starting with 4ab352767ef413c8fef12a374b356e0952ebc6c4391e8861c015c23bcd197195 not found: ID does not exist" containerID="4ab352767ef413c8fef12a374b356e0952ebc6c4391e8861c015c23bcd197195"
Jul 18 11:27:47.200882 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:27:47.200824    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4ab352767ef413c8fef12a374b356e0952ebc6c4391e8861c015c23bcd197195"} err="failed to get container status \"4ab352767ef413c8fef12a374b356e0952ebc6c4391e8861c015c23bcd197195\": rpc error: code = NotFound desc = could not find container \"4ab352767ef413c8fef12a374b356e0952ebc6c4391e8861c015c23bcd197195\": container with ID starting with 4ab352767ef413c8fef12a374b356e0952ebc6c4391e8861c015c23bcd197195 not found: ID does not exist"
Jul 18 11:27:47.210391 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:27:47.210353    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-pc5qh"]
Jul 18 11:27:47.212198 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:27:47.212180    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-pc5qh"]
Jul 18 11:27:48.894228 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:27:48.894192    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dc2a9d82-4707-4048-8ee2-11681dc66aee" path="/var/lib/kubelet/pods/dc2a9d82-4707-4048-8ee2-11681dc66aee/volumes"
Jul 18 11:27:54.503329 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:27:54.503295    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-s65nm"
Jul 18 11:27:54.503766 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:27:54.503351    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-s65nm"
Jul 18 11:27:54.525491 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:27:54.525465    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-s65nm"
Jul 18 11:27:55.249764 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:27:55.249738    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-s65nm"
Jul 18 11:28:17.671835 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:28:17.671797    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-shm4n"]
Jul 18 11:28:17.672316 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:28:17.672171    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dc2a9d82-4707-4048-8ee2-11681dc66aee" containerName="registry-server"
Jul 18 11:28:17.672316 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:28:17.672184    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="dc2a9d82-4707-4048-8ee2-11681dc66aee" containerName="registry-server"
Jul 18 11:28:17.672316 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:28:17.672237    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="dc2a9d82-4707-4048-8ee2-11681dc66aee" containerName="registry-server"
Jul 18 11:28:17.679473 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:28:17.679448    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-shm4n"
Jul 18 11:28:17.682339 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:28:17.682319    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-5j5p6\""
Jul 18 11:28:17.687153 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:28:17.687129    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-shm4n"]
Jul 18 11:28:17.749781 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:28:17.749741    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p4gzz\" (UniqueName: \"kubernetes.io/projected/ad8005db-d17d-4b41-9c21-d591ebbaa531-kube-api-access-p4gzz\") pod \"authorino-operator-75cc8d5cb7-shm4n\" (UID: \"ad8005db-d17d-4b41-9c21-d591ebbaa531\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-shm4n"
Jul 18 11:28:17.850668 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:28:17.850627    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p4gzz\" (UniqueName: \"kubernetes.io/projected/ad8005db-d17d-4b41-9c21-d591ebbaa531-kube-api-access-p4gzz\") pod \"authorino-operator-75cc8d5cb7-shm4n\" (UID: \"ad8005db-d17d-4b41-9c21-d591ebbaa531\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-shm4n"
Jul 18 11:28:17.858614 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:28:17.858585    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p4gzz\" (UniqueName: \"kubernetes.io/projected/ad8005db-d17d-4b41-9c21-d591ebbaa531-kube-api-access-p4gzz\") pod \"authorino-operator-75cc8d5cb7-shm4n\" (UID: \"ad8005db-d17d-4b41-9c21-d591ebbaa531\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-shm4n"
Jul 18 11:28:17.990344 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:28:17.990257    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-shm4n"
Jul 18 11:28:18.125993 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:28:18.125969    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-shm4n"]
Jul 18 11:28:18.128586 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:28:18.128560    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podad8005db_d17d_4b41_9c21_d591ebbaa531.slice/crio-da62fadcad205d72c57397457ec61e70057b0ca2302fcff57f06a1f55e9d7fe5 WatchSource:0}: Error finding container da62fadcad205d72c57397457ec61e70057b0ca2302fcff57f06a1f55e9d7fe5: Status 404 returned error can't find the container with id da62fadcad205d72c57397457ec61e70057b0ca2302fcff57f06a1f55e9d7fe5
Jul 18 11:28:18.330482 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:28:18.330399    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-shm4n" event={"ID":"ad8005db-d17d-4b41-9c21-d591ebbaa531","Type":"ContainerStarted","Data":"da62fadcad205d72c57397457ec61e70057b0ca2302fcff57f06a1f55e9d7fe5"}
Jul 18 11:28:20.341028 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:28:20.341003    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-shm4n" event={"ID":"ad8005db-d17d-4b41-9c21-d591ebbaa531","Type":"ContainerStarted","Data":"6f7e73af964f08ca03a9eefdfdf9ff3e48076b01ff40ed7b6006a3f8f2075d77"}
Jul 18 11:28:20.341374 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:28:20.341099    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-shm4n"
Jul 18 11:28:20.357569 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:28:20.357521    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-shm4n" podStartSLOduration=1.208241372 podStartE2EDuration="3.357505043s" totalImagesPullingTime="2.149263671s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 11:28:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 11:28:20.356401278 +0000 UTC m=+519.971437590" watchObservedRunningTime="2026-07-18 11:28:20.357505043 +0000 UTC m=+519.972541345"
Jul 18 11:28:20.911524 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:28:20.911493    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-kftrx"]
Jul 18 11:28:20.914773 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:28:20.914756    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-kftrx"
Jul 18 11:28:20.917010 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:28:20.916989    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-m5lq2\""
Jul 18 11:28:20.924213 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:28:20.924183    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-kftrx"]
Jul 18 11:28:20.986688 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:28:20.986643    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2d98w\" (UniqueName: \"kubernetes.io/projected/15f7c79b-1517-47ff-8856-b8088e3e7b41-kube-api-access-2d98w\") pod \"limitador-operator-controller-manager-859d7b78bd-kftrx\" (UID: \"15f7c79b-1517-47ff-8856-b8088e3e7b41\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-kftrx"
Jul 18 11:28:21.088000 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:28:21.087964    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2d98w\" (UniqueName: \"kubernetes.io/projected/15f7c79b-1517-47ff-8856-b8088e3e7b41-kube-api-access-2d98w\") pod \"limitador-operator-controller-manager-859d7b78bd-kftrx\" (UID: \"15f7c79b-1517-47ff-8856-b8088e3e7b41\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-kftrx"
Jul 18 11:28:21.097309 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:28:21.097275    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2d98w\" (UniqueName: \"kubernetes.io/projected/15f7c79b-1517-47ff-8856-b8088e3e7b41-kube-api-access-2d98w\") pod \"limitador-operator-controller-manager-859d7b78bd-kftrx\" (UID: \"15f7c79b-1517-47ff-8856-b8088e3e7b41\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-kftrx"
Jul 18 11:28:21.225705 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:28:21.225609    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-kftrx"
Jul 18 11:28:21.365938 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:28:21.365882    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-kftrx"]
Jul 18 11:28:21.370149 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:28:21.370116    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod15f7c79b_1517_47ff_8856_b8088e3e7b41.slice/crio-49c65e3597f0e65c2b4c6bd49d71771e95d21117de4884e8d6038cb072379033 WatchSource:0}: Error finding container 49c65e3597f0e65c2b4c6bd49d71771e95d21117de4884e8d6038cb072379033: Status 404 returned error can't find the container with id 49c65e3597f0e65c2b4c6bd49d71771e95d21117de4884e8d6038cb072379033
Jul 18 11:28:22.351998 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:28:22.351953    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-kftrx" event={"ID":"15f7c79b-1517-47ff-8856-b8088e3e7b41","Type":"ContainerStarted","Data":"49c65e3597f0e65c2b4c6bd49d71771e95d21117de4884e8d6038cb072379033"}
Jul 18 11:28:23.358121 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:28:23.358086    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-kftrx" event={"ID":"15f7c79b-1517-47ff-8856-b8088e3e7b41","Type":"ContainerStarted","Data":"deed39efcb28f7de461e06333ada6e6bc41cc434a3cba3fd122540c807d33c6c"}
Jul 18 11:28:23.358488 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:28:23.358156    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-kftrx"
Jul 18 11:28:23.383161 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:28:23.383106    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-kftrx" podStartSLOduration=1.974115557 podStartE2EDuration="3.38308819s" totalImagesPullingTime="1.408972633s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 11:28:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 11:28:23.381540707 +0000 UTC m=+522.996577008" watchObservedRunningTime="2026-07-18 11:28:23.38308819 +0000 UTC m=+522.998124557"
Jul 18 11:28:24.458504 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:28:24.458472    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-9wcs7"]
Jul 18 11:28:24.461865 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:28:24.461848    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-9wcs7"
Jul 18 11:28:24.465034 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:28:24.465000    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
Jul 18 11:28:24.465469 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:28:24.465452    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-5mn5z\""
Jul 18 11:28:24.477235 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:28:24.477206    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-9wcs7"]
Jul 18 11:28:24.521704 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:28:24.521663    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-668q4\" (UniqueName: \"kubernetes.io/projected/3e20b43a-6546-4d4f-a035-4a2f1a2e2b29-kube-api-access-668q4\") pod \"dns-operator-controller-manager-864dd78c4c-9wcs7\" (UID: \"3e20b43a-6546-4d4f-a035-4a2f1a2e2b29\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-9wcs7"
Jul 18 11:28:24.622376 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:28:24.622335    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-668q4\" (UniqueName: \"kubernetes.io/projected/3e20b43a-6546-4d4f-a035-4a2f1a2e2b29-kube-api-access-668q4\") pod \"dns-operator-controller-manager-864dd78c4c-9wcs7\" (UID: \"3e20b43a-6546-4d4f-a035-4a2f1a2e2b29\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-9wcs7"
Jul 18 11:28:24.635590 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:28:24.635556    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-668q4\" (UniqueName: \"kubernetes.io/projected/3e20b43a-6546-4d4f-a035-4a2f1a2e2b29-kube-api-access-668q4\") pod \"dns-operator-controller-manager-864dd78c4c-9wcs7\" (UID: \"3e20b43a-6546-4d4f-a035-4a2f1a2e2b29\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-9wcs7"
Jul 18 11:28:24.771830 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:28:24.771739    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-9wcs7"
Jul 18 11:28:24.919431 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:28:24.919405    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-9wcs7"]
Jul 18 11:28:24.922067 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:28:24.922037    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3e20b43a_6546_4d4f_a035_4a2f1a2e2b29.slice/crio-1dbf7c5957d7ab1ea3b12ecb59a55b4485605f84fa5eab545e9d97c39770617f WatchSource:0}: Error finding container 1dbf7c5957d7ab1ea3b12ecb59a55b4485605f84fa5eab545e9d97c39770617f: Status 404 returned error can't find the container with id 1dbf7c5957d7ab1ea3b12ecb59a55b4485605f84fa5eab545e9d97c39770617f
Jul 18 11:28:25.368819 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:28:25.368786    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-9wcs7" event={"ID":"3e20b43a-6546-4d4f-a035-4a2f1a2e2b29","Type":"ContainerStarted","Data":"1dbf7c5957d7ab1ea3b12ecb59a55b4485605f84fa5eab545e9d97c39770617f"}
Jul 18 11:28:27.380367 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:28:27.380329    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-9wcs7" event={"ID":"3e20b43a-6546-4d4f-a035-4a2f1a2e2b29","Type":"ContainerStarted","Data":"e3be0fc45a0d525d60148d3285f7dc374c40b270296809238f3196e1ab9049da"}
Jul 18 11:28:27.380795 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:28:27.380459    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-9wcs7"
Jul 18 11:28:27.409424 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:28:27.409363    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-9wcs7" podStartSLOduration=1.4555953609999999 podStartE2EDuration="3.409346547s" totalImagesPullingTime="1.953751186s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 11:28:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 11:28:27.406855192 +0000 UTC m=+527.021891497" watchObservedRunningTime="2026-07-18 11:28:27.409346547 +0000 UTC m=+527.024382849"
Jul 18 11:28:29.474397 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:28:29.474360    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tgggb"]
Jul 18 11:28:29.477806 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:28:29.477788    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tgggb"
Jul 18 11:28:29.480674 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:28:29.480654    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-6g7qj\""
Jul 18 11:28:29.500464 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:28:29.500437    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tgggb"]
Jul 18 11:28:29.572699 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:28:29.572659    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/cd565107-730f-4150-a623-894681655251-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-tgggb\" (UID: \"cd565107-730f-4150-a623-894681655251\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tgggb"
Jul 18 11:28:29.572699 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:28:29.572706    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ht5f7\" (UniqueName: \"kubernetes.io/projected/cd565107-730f-4150-a623-894681655251-kube-api-access-ht5f7\") pod \"kuadrant-operator-controller-manager-8684c9ff49-tgggb\" (UID: \"cd565107-730f-4150-a623-894681655251\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tgggb"
Jul 18 11:28:29.673504 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:28:29.673452    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/cd565107-730f-4150-a623-894681655251-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-tgggb\" (UID: \"cd565107-730f-4150-a623-894681655251\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tgggb"
Jul 18 11:28:29.673504 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:28:29.673506    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ht5f7\" (UniqueName: \"kubernetes.io/projected/cd565107-730f-4150-a623-894681655251-kube-api-access-ht5f7\") pod \"kuadrant-operator-controller-manager-8684c9ff49-tgggb\" (UID: \"cd565107-730f-4150-a623-894681655251\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tgggb"
Jul 18 11:28:29.673857 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:28:29.673836    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/cd565107-730f-4150-a623-894681655251-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-tgggb\" (UID: \"cd565107-730f-4150-a623-894681655251\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tgggb"
Jul 18 11:28:29.683005 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:28:29.682985    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ht5f7\" (UniqueName: \"kubernetes.io/projected/cd565107-730f-4150-a623-894681655251-kube-api-access-ht5f7\") pod \"kuadrant-operator-controller-manager-8684c9ff49-tgggb\" (UID: \"cd565107-730f-4150-a623-894681655251\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tgggb"
Jul 18 11:28:29.788289 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:28:29.788196    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tgggb"
Jul 18 11:28:29.924442 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:28:29.924325    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tgggb"]
Jul 18 11:28:29.926948 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:28:29.926919    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcd565107_730f_4150_a623_894681655251.slice/crio-921521d5849bae6a62c20871d240f8f4f75d44b977681f924b022f4ea4be1c9a WatchSource:0}: Error finding container 921521d5849bae6a62c20871d240f8f4f75d44b977681f924b022f4ea4be1c9a: Status 404 returned error can't find the container with id 921521d5849bae6a62c20871d240f8f4f75d44b977681f924b022f4ea4be1c9a
Jul 18 11:28:30.395636 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:28:30.395601    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tgggb" event={"ID":"cd565107-730f-4150-a623-894681655251","Type":"ContainerStarted","Data":"921521d5849bae6a62c20871d240f8f4f75d44b977681f924b022f4ea4be1c9a"}
Jul 18 11:28:31.348631 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:28:31.348597    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-shm4n"
Jul 18 11:28:34.364845 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:28:34.364816    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-kftrx"
Jul 18 11:28:35.427521 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:28:35.427478    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tgggb" event={"ID":"cd565107-730f-4150-a623-894681655251","Type":"ContainerStarted","Data":"3e1cc037643f6bca1a0c1acac93d7fc3043a76b94462e30b7b196d74bd66577f"}
Jul 18 11:28:35.427929 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:28:35.427648    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tgggb"
Jul 18 11:28:35.446876 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:28:35.446823    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tgggb" podStartSLOduration=2.02311575 podStartE2EDuration="6.44680712s" totalImagesPullingTime="4.42369137s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 11:28:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 11:28:35.445353993 +0000 UTC m=+535.060390296" watchObservedRunningTime="2026-07-18 11:28:35.44680712 +0000 UTC m=+535.061843422"
Jul 18 11:28:38.387737 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:28:38.387706    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-9wcs7"
Jul 18 11:28:46.435216 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:28:46.435186    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tgggb"
Jul 18 11:28:47.487815 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:28:47.487782    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-mtdcj"]
Jul 18 11:28:47.492410 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:28:47.492385    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-mtdcj"
Jul 18 11:28:47.505223 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:28:47.505195    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-mtdcj"]
Jul 18 11:28:47.526522 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:28:47.526489    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/053a5c1f-a173-42ac-94f7-4d19afb31e49-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-mtdcj\" (UID: \"053a5c1f-a173-42ac-94f7-4d19afb31e49\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-mtdcj"
Jul 18 11:28:47.526522 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:28:47.526523    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zv4pq\" (UniqueName: \"kubernetes.io/projected/053a5c1f-a173-42ac-94f7-4d19afb31e49-kube-api-access-zv4pq\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-mtdcj\" (UID: \"053a5c1f-a173-42ac-94f7-4d19afb31e49\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-mtdcj"
Jul 18 11:28:47.627564 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:28:47.627519    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/053a5c1f-a173-42ac-94f7-4d19afb31e49-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-mtdcj\" (UID: \"053a5c1f-a173-42ac-94f7-4d19afb31e49\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-mtdcj"
Jul 18 11:28:47.627564 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:28:47.627561    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zv4pq\" (UniqueName: \"kubernetes.io/projected/053a5c1f-a173-42ac-94f7-4d19afb31e49-kube-api-access-zv4pq\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-mtdcj\" (UID: \"053a5c1f-a173-42ac-94f7-4d19afb31e49\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-mtdcj"
Jul 18 11:28:47.627951 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:28:47.627931    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/053a5c1f-a173-42ac-94f7-4d19afb31e49-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-mtdcj\" (UID: \"053a5c1f-a173-42ac-94f7-4d19afb31e49\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-mtdcj"
Jul 18 11:28:47.636005 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:28:47.635978    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zv4pq\" (UniqueName: \"kubernetes.io/projected/053a5c1f-a173-42ac-94f7-4d19afb31e49-kube-api-access-zv4pq\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-mtdcj\" (UID: \"053a5c1f-a173-42ac-94f7-4d19afb31e49\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-mtdcj"
Jul 18 11:28:47.802611 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:28:47.802506    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-mtdcj"
Jul 18 11:28:47.945465 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:28:47.945441    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-mtdcj"]
Jul 18 11:28:47.949125 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:28:47.949099    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod053a5c1f_a173_42ac_94f7_4d19afb31e49.slice/crio-97548ccbbdcbd239f6e5df9ad64b969ba7ecb1baf537ba7b044cf113444f895e WatchSource:0}: Error finding container 97548ccbbdcbd239f6e5df9ad64b969ba7ecb1baf537ba7b044cf113444f895e: Status 404 returned error can't find the container with id 97548ccbbdcbd239f6e5df9ad64b969ba7ecb1baf537ba7b044cf113444f895e
Jul 18 11:28:48.188015 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:28:48.187954    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-mtdcj"]
Jul 18 11:28:48.192030 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:28:48.191999    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-mtdcj"]
Jul 18 11:28:48.204662 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:28:48.204627    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tgggb"]
Jul 18 11:28:48.204829 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:28:48.204807    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tgggb" podUID="cd565107-730f-4150-a623-894681655251" containerName="manager" containerID="cri-o://3e1cc037643f6bca1a0c1acac93d7fc3043a76b94462e30b7b196d74bd66577f" gracePeriod=2
Jul 18 11:28:48.215747 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:28:48.215714    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-zrjqh"]
Jul 18 11:28:48.216150 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:28:48.216126    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="053a5c1f-a173-42ac-94f7-4d19afb31e49" containerName="manager"
Jul 18 11:28:48.216150 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:28:48.216150    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="053a5c1f-a173-42ac-94f7-4d19afb31e49" containerName="manager"
Jul 18 11:28:48.216341 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:28:48.216224    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="053a5c1f-a173-42ac-94f7-4d19afb31e49" containerName="manager"
Jul 18 11:28:48.219145 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:28:48.219122    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-zrjqh"
Jul 18 11:28:48.224451 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:28:48.224422    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tgggb"]
Jul 18 11:28:48.242854 ip-10-0-133-122 kubenswrapper[2579]: E0718 11:28:48.242812    2579 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"cd565107-730f-4150-a623-894681655251\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"kuadrant-operator-controller-manager-8684c9ff49-tgggb\": pods \"kuadrant-operator-controller-manager-8684c9ff49-tgggb\" not found" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tgggb"
Jul 18 11:28:48.245655 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:28:48.245629    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zcrsb\" (UniqueName: \"kubernetes.io/projected/6b7ae6d4-6be2-441f-9841-a000e780f6cf-kube-api-access-zcrsb\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-zrjqh\" (UID: \"6b7ae6d4-6be2-441f-9841-a000e780f6cf\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-zrjqh"
Jul 18 11:28:48.246245 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:28:48.246131    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6b7ae6d4-6be2-441f-9841-a000e780f6cf-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-zrjqh\" (UID: \"6b7ae6d4-6be2-441f-9841-a000e780f6cf\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-zrjqh"
Jul 18 11:28:48.246519 ip-10-0-133-122 kubenswrapper[2579]: E0718 11:28:48.246047    2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-tgggb\" is forbidden: User \"system:node:ip-10-0-133-122.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-122.ec2.internal' and this object" podUID="cd565107-730f-4150-a623-894681655251" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tgggb"
Jul 18 11:28:48.248471 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:28:48.248451    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-zrjqh"]
Jul 18 11:28:48.261881 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:28:48.261851    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-kftrx"]
Jul 18 11:28:48.262328 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:28:48.262296    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-kftrx" podUID="15f7c79b-1517-47ff-8856-b8088e3e7b41" containerName="manager" containerID="cri-o://deed39efcb28f7de461e06333ada6e6bc41cc434a3cba3fd122540c807d33c6c" gracePeriod=2
Jul 18 11:28:48.263479 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:28:48.263441    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-kftrx"]
Jul 18 11:28:48.265229 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:28:48.265206    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-psgjq"]
Jul 18 11:28:48.265722 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:28:48.265698    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cd565107-730f-4150-a623-894681655251" containerName="manager"
Jul 18 11:28:48.265722 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:28:48.265723    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="cd565107-730f-4150-a623-894681655251" containerName="manager"
Jul 18 11:28:48.265864 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:28:48.265777    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="15f7c79b-1517-47ff-8856-b8088e3e7b41" containerName="manager"
Jul 18 11:28:48.265864 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:28:48.265788    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="15f7c79b-1517-47ff-8856-b8088e3e7b41" containerName="manager"
Jul 18 11:28:48.266108 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:28:48.265872    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="15f7c79b-1517-47ff-8856-b8088e3e7b41" containerName="manager"
Jul 18 11:28:48.266108 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:28:48.265906    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="cd565107-730f-4150-a623-894681655251" containerName="manager"
Jul 18 11:28:48.269211 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:28:48.269180    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-psgjq"
Jul 18 11:28:48.270720 ip-10-0-133-122 kubenswrapper[2579]: E0718 11:28:48.270687    2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-tgggb\" is forbidden: User \"system:node:ip-10-0-133-122.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-122.ec2.internal' and this object" podUID="cd565107-730f-4150-a623-894681655251" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tgggb"
Jul 18 11:28:48.272692 ip-10-0-133-122 kubenswrapper[2579]: E0718 11:28:48.272664    2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-kftrx\" is forbidden: User \"system:node:ip-10-0-133-122.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-122.ec2.internal' and this object" podUID="15f7c79b-1517-47ff-8856-b8088e3e7b41" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-kftrx"
Jul 18 11:28:48.274872 ip-10-0-133-122 kubenswrapper[2579]: E0718 11:28:48.274836    2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-tgggb\" is forbidden: User \"system:node:ip-10-0-133-122.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-122.ec2.internal' and this object" podUID="cd565107-730f-4150-a623-894681655251" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tgggb"
Jul 18 11:28:48.280343 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:28:48.280319    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-psgjq"]
Jul 18 11:28:48.293557 ip-10-0-133-122 kubenswrapper[2579]: E0718 11:28:48.293512    2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-kftrx\" is forbidden: User \"system:node:ip-10-0-133-122.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-122.ec2.internal' and this object" podUID="15f7c79b-1517-47ff-8856-b8088e3e7b41" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-kftrx"
Jul 18 11:28:48.347480 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:28:48.347440    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c7hrg\" (UniqueName: \"kubernetes.io/projected/1b58326c-69ea-4a70-822c-ae0c7f6e9bfe-kube-api-access-c7hrg\") pod \"limitador-operator-controller-manager-859d7b78bd-psgjq\" (UID: \"1b58326c-69ea-4a70-822c-ae0c7f6e9bfe\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-psgjq"
Jul 18 11:28:48.347681 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:28:48.347493    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6b7ae6d4-6be2-441f-9841-a000e780f6cf-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-zrjqh\" (UID: \"6b7ae6d4-6be2-441f-9841-a000e780f6cf\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-zrjqh"
Jul 18 11:28:48.347681 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:28:48.347624    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zcrsb\" (UniqueName: \"kubernetes.io/projected/6b7ae6d4-6be2-441f-9841-a000e780f6cf-kube-api-access-zcrsb\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-zrjqh\" (UID: \"6b7ae6d4-6be2-441f-9841-a000e780f6cf\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-zrjqh"
Jul 18 11:28:48.347946 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:28:48.347926    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6b7ae6d4-6be2-441f-9841-a000e780f6cf-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-zrjqh\" (UID: \"6b7ae6d4-6be2-441f-9841-a000e780f6cf\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-zrjqh"
Jul 18 11:28:48.356220 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:28:48.356197    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zcrsb\" (UniqueName: \"kubernetes.io/projected/6b7ae6d4-6be2-441f-9841-a000e780f6cf-kube-api-access-zcrsb\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-zrjqh\" (UID: \"6b7ae6d4-6be2-441f-9841-a000e780f6cf\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-zrjqh"
Jul 18 11:28:48.448715 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:28:48.448626    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c7hrg\" (UniqueName: \"kubernetes.io/projected/1b58326c-69ea-4a70-822c-ae0c7f6e9bfe-kube-api-access-c7hrg\") pod \"limitador-operator-controller-manager-859d7b78bd-psgjq\" (UID: \"1b58326c-69ea-4a70-822c-ae0c7f6e9bfe\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-psgjq"
Jul 18 11:28:48.459952 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:28:48.459921    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c7hrg\" (UniqueName: \"kubernetes.io/projected/1b58326c-69ea-4a70-822c-ae0c7f6e9bfe-kube-api-access-c7hrg\") pod \"limitador-operator-controller-manager-859d7b78bd-psgjq\" (UID: \"1b58326c-69ea-4a70-822c-ae0c7f6e9bfe\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-psgjq"
Jul 18 11:28:48.492570 ip-10-0-133-122 kubenswrapper[2579]: E0718 11:28:48.492540    2579 kuberuntime_manager.go:649] "Missing actuated resource record" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-mtdcj" container="manager"
Jul 18 11:28:48.494348 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:28:48.494319    2579 generic.go:356] "Generic (PLEG): container finished" podID="cd565107-730f-4150-a623-894681655251" containerID="3e1cc037643f6bca1a0c1acac93d7fc3043a76b94462e30b7b196d74bd66577f" exitCode=0
Jul 18 11:28:48.494931 ip-10-0-133-122 kubenswrapper[2579]: E0718 11:28:48.494867    2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-mtdcj\" is forbidden: User \"system:node:ip-10-0-133-122.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-122.ec2.internal' and this object" podUID="053a5c1f-a173-42ac-94f7-4d19afb31e49" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-mtdcj"
Jul 18 11:28:48.496159 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:28:48.496137    2579 generic.go:356] "Generic (PLEG): container finished" podID="15f7c79b-1517-47ff-8856-b8088e3e7b41" containerID="deed39efcb28f7de461e06333ada6e6bc41cc434a3cba3fd122540c807d33c6c" exitCode=0
Jul 18 11:28:48.496860 ip-10-0-133-122 kubenswrapper[2579]: E0718 11:28:48.496837    2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-tgggb\" is forbidden: User \"system:node:ip-10-0-133-122.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-122.ec2.internal' and this object" podUID="cd565107-730f-4150-a623-894681655251" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tgggb"
Jul 18 11:28:48.498656 ip-10-0-133-122 kubenswrapper[2579]: E0718 11:28:48.498629    2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-kftrx\" is forbidden: User \"system:node:ip-10-0-133-122.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-122.ec2.internal' and this object" podUID="15f7c79b-1517-47ff-8856-b8088e3e7b41" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-kftrx"
Jul 18 11:28:48.502279 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:28:48.502260    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tgggb"
Jul 18 11:28:48.504195 ip-10-0-133-122 kubenswrapper[2579]: E0718 11:28:48.504169    2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-tgggb\" is forbidden: User \"system:node:ip-10-0-133-122.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-122.ec2.internal' and this object" podUID="cd565107-730f-4150-a623-894681655251" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tgggb"
Jul 18 11:28:48.506044 ip-10-0-133-122 kubenswrapper[2579]: E0718 11:28:48.506010    2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-kftrx\" is forbidden: User \"system:node:ip-10-0-133-122.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-122.ec2.internal' and this object" podUID="15f7c79b-1517-47ff-8856-b8088e3e7b41" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-kftrx"
Jul 18 11:28:48.507811 ip-10-0-133-122 kubenswrapper[2579]: E0718 11:28:48.507785    2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-mtdcj\" is forbidden: User \"system:node:ip-10-0-133-122.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-122.ec2.internal' and this object" podUID="053a5c1f-a173-42ac-94f7-4d19afb31e49" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-mtdcj"
Jul 18 11:28:48.513197 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:28:48.513180    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-kftrx"
Jul 18 11:28:48.515241 ip-10-0-133-122 kubenswrapper[2579]: E0718 11:28:48.515221    2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-tgggb\" is forbidden: User \"system:node:ip-10-0-133-122.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-122.ec2.internal' and this object" podUID="cd565107-730f-4150-a623-894681655251" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tgggb"
Jul 18 11:28:48.516960 ip-10-0-133-122 kubenswrapper[2579]: E0718 11:28:48.516938    2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-kftrx\" is forbidden: User \"system:node:ip-10-0-133-122.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-122.ec2.internal' and this object" podUID="15f7c79b-1517-47ff-8856-b8088e3e7b41" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-kftrx"
Jul 18 11:28:48.518840 ip-10-0-133-122 kubenswrapper[2579]: E0718 11:28:48.518821    2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-mtdcj\" is forbidden: User \"system:node:ip-10-0-133-122.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-122.ec2.internal' and this object" podUID="053a5c1f-a173-42ac-94f7-4d19afb31e49" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-mtdcj"
Jul 18 11:28:48.549052 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:28:48.549018    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/cd565107-730f-4150-a623-894681655251-extensions-socket-volume\") pod \"cd565107-730f-4150-a623-894681655251\" (UID: \"cd565107-730f-4150-a623-894681655251\") "
Jul 18 11:28:48.549212 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:28:48.549072    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2d98w\" (UniqueName: \"kubernetes.io/projected/15f7c79b-1517-47ff-8856-b8088e3e7b41-kube-api-access-2d98w\") pod \"15f7c79b-1517-47ff-8856-b8088e3e7b41\" (UID: \"15f7c79b-1517-47ff-8856-b8088e3e7b41\") "
Jul 18 11:28:48.549212 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:28:48.549142    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ht5f7\" (UniqueName: \"kubernetes.io/projected/cd565107-730f-4150-a623-894681655251-kube-api-access-ht5f7\") pod \"cd565107-730f-4150-a623-894681655251\" (UID: \"cd565107-730f-4150-a623-894681655251\") "
Jul 18 11:28:48.549409 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:28:48.549381    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cd565107-730f-4150-a623-894681655251-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "cd565107-730f-4150-a623-894681655251" (UID: "cd565107-730f-4150-a623-894681655251"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 11:28:48.551296 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:28:48.551270    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cd565107-730f-4150-a623-894681655251-kube-api-access-ht5f7" (OuterVolumeSpecName: "kube-api-access-ht5f7") pod "cd565107-730f-4150-a623-894681655251" (UID: "cd565107-730f-4150-a623-894681655251"). InnerVolumeSpecName "kube-api-access-ht5f7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 18 11:28:48.551390 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:28:48.551328    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/15f7c79b-1517-47ff-8856-b8088e3e7b41-kube-api-access-2d98w" (OuterVolumeSpecName: "kube-api-access-2d98w") pod "15f7c79b-1517-47ff-8856-b8088e3e7b41" (UID: "15f7c79b-1517-47ff-8856-b8088e3e7b41"). InnerVolumeSpecName "kube-api-access-2d98w". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 18 11:28:48.571554 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:28:48.571517    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-zrjqh"
Jul 18 11:28:48.611561 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:28:48.611521    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-psgjq"
Jul 18 11:28:48.650969 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:28:48.650871    2579 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/cd565107-730f-4150-a623-894681655251-extensions-socket-volume\") on node \"ip-10-0-133-122.ec2.internal\" DevicePath \"\""
Jul 18 11:28:48.650969 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:28:48.650926    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2d98w\" (UniqueName: \"kubernetes.io/projected/15f7c79b-1517-47ff-8856-b8088e3e7b41-kube-api-access-2d98w\") on node \"ip-10-0-133-122.ec2.internal\" DevicePath \"\""
Jul 18 11:28:48.650969 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:28:48.650938    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ht5f7\" (UniqueName: \"kubernetes.io/projected/cd565107-730f-4150-a623-894681655251-kube-api-access-ht5f7\") on node \"ip-10-0-133-122.ec2.internal\" DevicePath \"\""
Jul 18 11:28:48.737786 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:28:48.737753    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-zrjqh"]
Jul 18 11:28:48.739900 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:28:48.739855    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6b7ae6d4_6be2_441f_9841_a000e780f6cf.slice/crio-e21c0d6cff8d80e714a4ceb0c7cc197448e73cdcd50c7e493902ce51217c47d6 WatchSource:0}: Error finding container e21c0d6cff8d80e714a4ceb0c7cc197448e73cdcd50c7e493902ce51217c47d6: Status 404 returned error can't find the container with id e21c0d6cff8d80e714a4ceb0c7cc197448e73cdcd50c7e493902ce51217c47d6
Jul 18 11:28:48.799533 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:28:48.799511    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-psgjq"]
Jul 18 11:28:48.801990 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:28:48.801955    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1b58326c_69ea_4a70_822c_ae0c7f6e9bfe.slice/crio-91f3c3ce3e0ddb41575506702319da75fde7ee8c89780a8d3f8de50f72b88bdb WatchSource:0}: Error finding container 91f3c3ce3e0ddb41575506702319da75fde7ee8c89780a8d3f8de50f72b88bdb: Status 404 returned error can't find the container with id 91f3c3ce3e0ddb41575506702319da75fde7ee8c89780a8d3f8de50f72b88bdb
Jul 18 11:28:48.894670 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:28:48.894639    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="15f7c79b-1517-47ff-8856-b8088e3e7b41" path="/var/lib/kubelet/pods/15f7c79b-1517-47ff-8856-b8088e3e7b41/volumes"
Jul 18 11:28:48.895025 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:28:48.895012    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cd565107-730f-4150-a623-894681655251" path="/var/lib/kubelet/pods/cd565107-730f-4150-a623-894681655251/volumes"
Jul 18 11:28:49.502244 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:28:49.502209    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-mtdcj" podUID="053a5c1f-a173-42ac-94f7-4d19afb31e49" containerName="manager" containerID="cri-o://2ffaf534baf50d11fda744c62664c2a8e2d8adf466d1e63731bd6455c0047c47" gracePeriod=2
Jul 18 11:28:49.503634 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:28:49.503610    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tgggb"
Jul 18 11:28:49.503762 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:28:49.503663    2579 scope.go:117] "RemoveContainer" containerID="3e1cc037643f6bca1a0c1acac93d7fc3043a76b94462e30b7b196d74bd66577f"
Jul 18 11:28:49.505091 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:28:49.505067    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-kftrx"
Jul 18 11:28:49.507156 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:28:49.506977    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-psgjq" event={"ID":"1b58326c-69ea-4a70-822c-ae0c7f6e9bfe","Type":"ContainerStarted","Data":"6966c94df66b57d93b4d77d87aba1a9c6fb3a85bc74bb7596a8773999c3643a4"}
Jul 18 11:28:49.507156 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:28:49.507031    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-psgjq" event={"ID":"1b58326c-69ea-4a70-822c-ae0c7f6e9bfe","Type":"ContainerStarted","Data":"91f3c3ce3e0ddb41575506702319da75fde7ee8c89780a8d3f8de50f72b88bdb"}
Jul 18 11:28:49.507275 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:28:49.507156    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-psgjq"
Jul 18 11:28:49.509014 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:28:49.508988    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-zrjqh" event={"ID":"6b7ae6d4-6be2-441f-9841-a000e780f6cf","Type":"ContainerStarted","Data":"4e47de6e2b29af7b97fbcc21beffb17f56c3f6d95c06a379cdea6f21dfe8b7db"}
Jul 18 11:28:49.509187 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:28:49.509169    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-zrjqh" event={"ID":"6b7ae6d4-6be2-441f-9841-a000e780f6cf","Type":"ContainerStarted","Data":"e21c0d6cff8d80e714a4ceb0c7cc197448e73cdcd50c7e493902ce51217c47d6"}
Jul 18 11:28:49.509953 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:28:49.509935    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-zrjqh"
Jul 18 11:28:49.513492 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:28:49.513468    2579 scope.go:117] "RemoveContainer" containerID="deed39efcb28f7de461e06333ada6e6bc41cc434a3cba3fd122540c807d33c6c"
Jul 18 11:28:49.527828 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:28:49.527781    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-psgjq" podStartSLOduration=1.527766272 podStartE2EDuration="1.527766272s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 11:28:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 11:28:49.527204488 +0000 UTC m=+549.142240803" watchObservedRunningTime="2026-07-18 11:28:49.527766272 +0000 UTC m=+549.142802574"
Jul 18 11:28:49.545159 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:28:49.545108    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-zrjqh" podStartSLOduration=1.54508993 podStartE2EDuration="1.54508993s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 11:28:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 11:28:49.543220501 +0000 UTC m=+549.158256804" watchObservedRunningTime="2026-07-18 11:28:49.54508993 +0000 UTC m=+549.160126231"
Jul 18 11:28:49.754417 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:28:49.754353    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-mtdcj"
Jul 18 11:28:49.756381 ip-10-0-133-122 kubenswrapper[2579]: E0718 11:28:49.756354    2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-mtdcj\" is forbidden: User \"system:node:ip-10-0-133-122.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-122.ec2.internal' and this object" podUID="053a5c1f-a173-42ac-94f7-4d19afb31e49" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-mtdcj"
Jul 18 11:28:49.759612 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:28:49.759589    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zv4pq\" (UniqueName: \"kubernetes.io/projected/053a5c1f-a173-42ac-94f7-4d19afb31e49-kube-api-access-zv4pq\") pod \"053a5c1f-a173-42ac-94f7-4d19afb31e49\" (UID: \"053a5c1f-a173-42ac-94f7-4d19afb31e49\") "
Jul 18 11:28:49.759696 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:28:49.759685    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/053a5c1f-a173-42ac-94f7-4d19afb31e49-extensions-socket-volume\") pod \"053a5c1f-a173-42ac-94f7-4d19afb31e49\" (UID: \"053a5c1f-a173-42ac-94f7-4d19afb31e49\") "
Jul 18 11:28:49.759945 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:28:49.759924    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/053a5c1f-a173-42ac-94f7-4d19afb31e49-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "053a5c1f-a173-42ac-94f7-4d19afb31e49" (UID: "053a5c1f-a173-42ac-94f7-4d19afb31e49"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 11:28:49.761586 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:28:49.761551    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/053a5c1f-a173-42ac-94f7-4d19afb31e49-kube-api-access-zv4pq" (OuterVolumeSpecName: "kube-api-access-zv4pq") pod "053a5c1f-a173-42ac-94f7-4d19afb31e49" (UID: "053a5c1f-a173-42ac-94f7-4d19afb31e49"). InnerVolumeSpecName "kube-api-access-zv4pq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 18 11:28:49.860872 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:28:49.860834    2579 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/053a5c1f-a173-42ac-94f7-4d19afb31e49-extensions-socket-volume\") on node \"ip-10-0-133-122.ec2.internal\" DevicePath \"\""
Jul 18 11:28:49.860872 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:28:49.860865    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zv4pq\" (UniqueName: \"kubernetes.io/projected/053a5c1f-a173-42ac-94f7-4d19afb31e49-kube-api-access-zv4pq\") on node \"ip-10-0-133-122.ec2.internal\" DevicePath \"\""
Jul 18 11:28:50.515254 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:28:50.515215    2579 generic.go:356] "Generic (PLEG): container finished" podID="053a5c1f-a173-42ac-94f7-4d19afb31e49" containerID="2ffaf534baf50d11fda744c62664c2a8e2d8adf466d1e63731bd6455c0047c47" exitCode=2
Jul 18 11:28:50.515710 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:28:50.515263    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-mtdcj"
Jul 18 11:28:50.515710 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:28:50.515269    2579 scope.go:117] "RemoveContainer" containerID="2ffaf534baf50d11fda744c62664c2a8e2d8adf466d1e63731bd6455c0047c47"
Jul 18 11:28:50.517754 ip-10-0-133-122 kubenswrapper[2579]: E0718 11:28:50.517724    2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-mtdcj\" is forbidden: User \"system:node:ip-10-0-133-122.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-122.ec2.internal' and this object" podUID="053a5c1f-a173-42ac-94f7-4d19afb31e49" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-mtdcj"
Jul 18 11:28:50.524781 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:28:50.524748    2579 scope.go:117] "RemoveContainer" containerID="2ffaf534baf50d11fda744c62664c2a8e2d8adf466d1e63731bd6455c0047c47"
Jul 18 11:28:50.525050 ip-10-0-133-122 kubenswrapper[2579]: E0718 11:28:50.525033    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2ffaf534baf50d11fda744c62664c2a8e2d8adf466d1e63731bd6455c0047c47\": container with ID starting with 2ffaf534baf50d11fda744c62664c2a8e2d8adf466d1e63731bd6455c0047c47 not found: ID does not exist" containerID="2ffaf534baf50d11fda744c62664c2a8e2d8adf466d1e63731bd6455c0047c47"
Jul 18 11:28:50.525127 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:28:50.525060    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2ffaf534baf50d11fda744c62664c2a8e2d8adf466d1e63731bd6455c0047c47"} err="failed to get container status \"2ffaf534baf50d11fda744c62664c2a8e2d8adf466d1e63731bd6455c0047c47\": rpc error: code = NotFound desc = could not find container \"2ffaf534baf50d11fda744c62664c2a8e2d8adf466d1e63731bd6455c0047c47\": container with ID starting with 2ffaf534baf50d11fda744c62664c2a8e2d8adf466d1e63731bd6455c0047c47 not found: ID does not exist"
Jul 18 11:28:50.525863 ip-10-0-133-122 kubenswrapper[2579]: E0718 11:28:50.525841    2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-mtdcj\" is forbidden: User \"system:node:ip-10-0-133-122.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-122.ec2.internal' and this object" podUID="053a5c1f-a173-42ac-94f7-4d19afb31e49" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-mtdcj"
Jul 18 11:28:50.892028 ip-10-0-133-122 kubenswrapper[2579]: E0718 11:28:50.891987    2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-mtdcj\" is forbidden: User \"system:node:ip-10-0-133-122.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-122.ec2.internal' and this object" podUID="053a5c1f-a173-42ac-94f7-4d19afb31e49" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-mtdcj"
Jul 18 11:28:50.897783 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:28:50.897754    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="053a5c1f-a173-42ac-94f7-4d19afb31e49" path="/var/lib/kubelet/pods/053a5c1f-a173-42ac-94f7-4d19afb31e49/volumes"
Jul 18 11:29:00.520176 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:29:00.520144    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-psgjq"
Jul 18 11:29:01.525802 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:29:01.525771    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-zrjqh"
Jul 18 11:29:01.835187 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:29:01.835148    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-q8ks6"]
Jul 18 11:29:01.845552 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:29:01.845526    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-q8ks6"
Jul 18 11:29:01.857523 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:29:01.857490    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-q8ks6"]
Jul 18 11:29:01.965766 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:29:01.965728    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7vbxc\" (UniqueName: \"kubernetes.io/projected/fc79b155-d739-4736-805f-9498bab0cda5-kube-api-access-7vbxc\") pod \"kuadrant-operator-controller-manager-86878c769f-q8ks6\" (UID: \"fc79b155-d739-4736-805f-9498bab0cda5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-q8ks6"
Jul 18 11:29:01.965980 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:29:01.965776    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/fc79b155-d739-4736-805f-9498bab0cda5-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-q8ks6\" (UID: \"fc79b155-d739-4736-805f-9498bab0cda5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-q8ks6"
Jul 18 11:29:02.066814 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:29:02.066710    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7vbxc\" (UniqueName: \"kubernetes.io/projected/fc79b155-d739-4736-805f-9498bab0cda5-kube-api-access-7vbxc\") pod \"kuadrant-operator-controller-manager-86878c769f-q8ks6\" (UID: \"fc79b155-d739-4736-805f-9498bab0cda5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-q8ks6"
Jul 18 11:29:02.066814 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:29:02.066760    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/fc79b155-d739-4736-805f-9498bab0cda5-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-q8ks6\" (UID: \"fc79b155-d739-4736-805f-9498bab0cda5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-q8ks6"
Jul 18 11:29:02.067185 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:29:02.067165    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/fc79b155-d739-4736-805f-9498bab0cda5-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-q8ks6\" (UID: \"fc79b155-d739-4736-805f-9498bab0cda5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-q8ks6"
Jul 18 11:29:02.074705 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:29:02.074681    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7vbxc\" (UniqueName: \"kubernetes.io/projected/fc79b155-d739-4736-805f-9498bab0cda5-kube-api-access-7vbxc\") pod \"kuadrant-operator-controller-manager-86878c769f-q8ks6\" (UID: \"fc79b155-d739-4736-805f-9498bab0cda5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-q8ks6"
Jul 18 11:29:02.156884 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:29:02.156850    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-q8ks6"
Jul 18 11:29:02.300203 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:29:02.300174    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-q8ks6"]
Jul 18 11:29:02.303219 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:29:02.303191    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfc79b155_d739_4736_805f_9498bab0cda5.slice/crio-00db9a4dacbc84cb2575c9ca3b4b7130ff2cb78e2ee2d181b49d99787381aa1e WatchSource:0}: Error finding container 00db9a4dacbc84cb2575c9ca3b4b7130ff2cb78e2ee2d181b49d99787381aa1e: Status 404 returned error can't find the container with id 00db9a4dacbc84cb2575c9ca3b4b7130ff2cb78e2ee2d181b49d99787381aa1e
Jul 18 11:29:02.578943 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:29:02.578831    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-q8ks6" event={"ID":"fc79b155-d739-4736-805f-9498bab0cda5","Type":"ContainerStarted","Data":"1c935ec9955389b332704b536eb469f0c4cd5387f68bb1af7d4913422a6fe171"}
Jul 18 11:29:02.578943 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:29:02.578898    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-q8ks6" event={"ID":"fc79b155-d739-4736-805f-9498bab0cda5","Type":"ContainerStarted","Data":"00db9a4dacbc84cb2575c9ca3b4b7130ff2cb78e2ee2d181b49d99787381aa1e"}
Jul 18 11:29:02.579331 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:29:02.579035    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-q8ks6"
Jul 18 11:29:02.602502 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:29:02.602444    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-q8ks6" podStartSLOduration=1.602422664 podStartE2EDuration="1.602422664s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 11:29:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 11:29:02.601720551 +0000 UTC m=+562.216756852" watchObservedRunningTime="2026-07-18 11:29:02.602422664 +0000 UTC m=+562.217458968"
Jul 18 11:29:13.586259 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:29:13.586229    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-q8ks6"
Jul 18 11:29:13.632976 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:29:13.632940    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-zrjqh"]
Jul 18 11:29:13.633183 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:29:13.633157    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-zrjqh" podUID="6b7ae6d4-6be2-441f-9841-a000e780f6cf" containerName="manager" containerID="cri-o://4e47de6e2b29af7b97fbcc21beffb17f56c3f6d95c06a379cdea6f21dfe8b7db" gracePeriod=10
Jul 18 11:29:13.895216 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:29:13.895190    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-zrjqh"
Jul 18 11:29:13.965240 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:29:13.965206    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6b7ae6d4-6be2-441f-9841-a000e780f6cf-extensions-socket-volume\") pod \"6b7ae6d4-6be2-441f-9841-a000e780f6cf\" (UID: \"6b7ae6d4-6be2-441f-9841-a000e780f6cf\") "
Jul 18 11:29:13.965437 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:29:13.965303    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zcrsb\" (UniqueName: \"kubernetes.io/projected/6b7ae6d4-6be2-441f-9841-a000e780f6cf-kube-api-access-zcrsb\") pod \"6b7ae6d4-6be2-441f-9841-a000e780f6cf\" (UID: \"6b7ae6d4-6be2-441f-9841-a000e780f6cf\") "
Jul 18 11:29:13.965649 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:29:13.965621    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6b7ae6d4-6be2-441f-9841-a000e780f6cf-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "6b7ae6d4-6be2-441f-9841-a000e780f6cf" (UID: "6b7ae6d4-6be2-441f-9841-a000e780f6cf"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 11:29:13.967376 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:29:13.967347    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6b7ae6d4-6be2-441f-9841-a000e780f6cf-kube-api-access-zcrsb" (OuterVolumeSpecName: "kube-api-access-zcrsb") pod "6b7ae6d4-6be2-441f-9841-a000e780f6cf" (UID: "6b7ae6d4-6be2-441f-9841-a000e780f6cf"). InnerVolumeSpecName "kube-api-access-zcrsb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 18 11:29:14.066637 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:29:14.066607    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zcrsb\" (UniqueName: \"kubernetes.io/projected/6b7ae6d4-6be2-441f-9841-a000e780f6cf-kube-api-access-zcrsb\") on node \"ip-10-0-133-122.ec2.internal\" DevicePath \"\""
Jul 18 11:29:14.066637 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:29:14.066633    2579 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6b7ae6d4-6be2-441f-9841-a000e780f6cf-extensions-socket-volume\") on node \"ip-10-0-133-122.ec2.internal\" DevicePath \"\""
Jul 18 11:29:14.638048 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:29:14.638016    2579 generic.go:356] "Generic (PLEG): container finished" podID="6b7ae6d4-6be2-441f-9841-a000e780f6cf" containerID="4e47de6e2b29af7b97fbcc21beffb17f56c3f6d95c06a379cdea6f21dfe8b7db" exitCode=0
Jul 18 11:29:14.638048 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:29:14.638053    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-zrjqh"
Jul 18 11:29:14.638570 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:29:14.638089    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-zrjqh" event={"ID":"6b7ae6d4-6be2-441f-9841-a000e780f6cf","Type":"ContainerDied","Data":"4e47de6e2b29af7b97fbcc21beffb17f56c3f6d95c06a379cdea6f21dfe8b7db"}
Jul 18 11:29:14.638570 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:29:14.638143    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-zrjqh" event={"ID":"6b7ae6d4-6be2-441f-9841-a000e780f6cf","Type":"ContainerDied","Data":"e21c0d6cff8d80e714a4ceb0c7cc197448e73cdcd50c7e493902ce51217c47d6"}
Jul 18 11:29:14.638570 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:29:14.638170    2579 scope.go:117] "RemoveContainer" containerID="4e47de6e2b29af7b97fbcc21beffb17f56c3f6d95c06a379cdea6f21dfe8b7db"
Jul 18 11:29:14.647202 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:29:14.647185    2579 scope.go:117] "RemoveContainer" containerID="4e47de6e2b29af7b97fbcc21beffb17f56c3f6d95c06a379cdea6f21dfe8b7db"
Jul 18 11:29:14.647463 ip-10-0-133-122 kubenswrapper[2579]: E0718 11:29:14.647447    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4e47de6e2b29af7b97fbcc21beffb17f56c3f6d95c06a379cdea6f21dfe8b7db\": container with ID starting with 4e47de6e2b29af7b97fbcc21beffb17f56c3f6d95c06a379cdea6f21dfe8b7db not found: ID does not exist" containerID="4e47de6e2b29af7b97fbcc21beffb17f56c3f6d95c06a379cdea6f21dfe8b7db"
Jul 18 11:29:14.647513 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:29:14.647472    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4e47de6e2b29af7b97fbcc21beffb17f56c3f6d95c06a379cdea6f21dfe8b7db"} err="failed to get container status \"4e47de6e2b29af7b97fbcc21beffb17f56c3f6d95c06a379cdea6f21dfe8b7db\": rpc error: code = NotFound desc = could not find container \"4e47de6e2b29af7b97fbcc21beffb17f56c3f6d95c06a379cdea6f21dfe8b7db\": container with ID starting with 4e47de6e2b29af7b97fbcc21beffb17f56c3f6d95c06a379cdea6f21dfe8b7db not found: ID does not exist"
Jul 18 11:29:14.659949 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:29:14.659877    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-zrjqh"]
Jul 18 11:29:14.672298 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:29:14.672271    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-zrjqh"]
Jul 18 11:29:14.894251 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:29:14.894169    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6b7ae6d4-6be2-441f-9841-a000e780f6cf" path="/var/lib/kubelet/pods/6b7ae6d4-6be2-441f-9841-a000e780f6cf/volumes"
Jul 18 11:29:29.943848 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:29:29.943809    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-8j9zf"]
Jul 18 11:29:29.944430 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:29:29.944366    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6b7ae6d4-6be2-441f-9841-a000e780f6cf" containerName="manager"
Jul 18 11:29:29.944430 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:29:29.944388    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="6b7ae6d4-6be2-441f-9841-a000e780f6cf" containerName="manager"
Jul 18 11:29:29.944544 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:29:29.944502    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="6b7ae6d4-6be2-441f-9841-a000e780f6cf" containerName="manager"
Jul 18 11:29:29.949027 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:29:29.948995    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-8j9zf"
Jul 18 11:29:29.951421 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:29:29.951393    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 18 11:29:29.951561 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:29:29.951444    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-799hc\""
Jul 18 11:29:29.956155 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:29:29.956128    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-8j9zf"]
Jul 18 11:29:30.050754 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:29:30.050720    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-8j9zf"]
Jul 18 11:29:30.108043 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:29:30.108003    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/a75bccb2-72dc-4e0e-895c-bded9dd84d3e-config-file\") pod \"limitador-limitador-64c94fd64f-8j9zf\" (UID: \"a75bccb2-72dc-4e0e-895c-bded9dd84d3e\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-8j9zf"
Jul 18 11:29:30.108219 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:29:30.108052    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t64sf\" (UniqueName: \"kubernetes.io/projected/a75bccb2-72dc-4e0e-895c-bded9dd84d3e-kube-api-access-t64sf\") pod \"limitador-limitador-64c94fd64f-8j9zf\" (UID: \"a75bccb2-72dc-4e0e-895c-bded9dd84d3e\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-8j9zf"
Jul 18 11:29:30.209275 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:29:30.209187    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/a75bccb2-72dc-4e0e-895c-bded9dd84d3e-config-file\") pod \"limitador-limitador-64c94fd64f-8j9zf\" (UID: \"a75bccb2-72dc-4e0e-895c-bded9dd84d3e\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-8j9zf"
Jul 18 11:29:30.209275 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:29:30.209226    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t64sf\" (UniqueName: \"kubernetes.io/projected/a75bccb2-72dc-4e0e-895c-bded9dd84d3e-kube-api-access-t64sf\") pod \"limitador-limitador-64c94fd64f-8j9zf\" (UID: \"a75bccb2-72dc-4e0e-895c-bded9dd84d3e\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-8j9zf"
Jul 18 11:29:30.209789 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:29:30.209768    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/a75bccb2-72dc-4e0e-895c-bded9dd84d3e-config-file\") pod \"limitador-limitador-64c94fd64f-8j9zf\" (UID: \"a75bccb2-72dc-4e0e-895c-bded9dd84d3e\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-8j9zf"
Jul 18 11:29:30.217088 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:29:30.217065    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t64sf\" (UniqueName: \"kubernetes.io/projected/a75bccb2-72dc-4e0e-895c-bded9dd84d3e-kube-api-access-t64sf\") pod \"limitador-limitador-64c94fd64f-8j9zf\" (UID: \"a75bccb2-72dc-4e0e-895c-bded9dd84d3e\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-8j9zf"
Jul 18 11:29:30.261393 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:29:30.261353    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-8j9zf"
Jul 18 11:29:30.405090 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:29:30.405044    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-8j9zf"]
Jul 18 11:29:30.408086 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:29:30.408054    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda75bccb2_72dc_4e0e_895c_bded9dd84d3e.slice/crio-a4cc42a9d4dcae8dc4bc24ad8479495c814ad3aafe5fb7af89b12cc58fde8ca5 WatchSource:0}: Error finding container a4cc42a9d4dcae8dc4bc24ad8479495c814ad3aafe5fb7af89b12cc58fde8ca5: Status 404 returned error can't find the container with id a4cc42a9d4dcae8dc4bc24ad8479495c814ad3aafe5fb7af89b12cc58fde8ca5
Jul 18 11:29:30.717852 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:29:30.717816    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-8j9zf" event={"ID":"a75bccb2-72dc-4e0e-895c-bded9dd84d3e","Type":"ContainerStarted","Data":"a4cc42a9d4dcae8dc4bc24ad8479495c814ad3aafe5fb7af89b12cc58fde8ca5"}
Jul 18 11:29:30.894920 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:29:30.894878    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-gv7sp"]
Jul 18 11:29:30.899677 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:29:30.899651    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-gv7sp"
Jul 18 11:29:30.901157 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:29:30.901132    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-gv7sp"]
Jul 18 11:29:30.902279 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:29:30.902259    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-2qz95\""
Jul 18 11:29:31.016193 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:29:31.016108    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hrnq9\" (UniqueName: \"kubernetes.io/projected/e17a4ed3-6a94-41db-aaa7-ddd547ab7a1c-kube-api-access-hrnq9\") pod \"authorino-75d556bd77-gv7sp\" (UID: \"e17a4ed3-6a94-41db-aaa7-ddd547ab7a1c\") " pod="kuadrant-system/authorino-75d556bd77-gv7sp"
Jul 18 11:29:31.117513 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:29:31.117472    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hrnq9\" (UniqueName: \"kubernetes.io/projected/e17a4ed3-6a94-41db-aaa7-ddd547ab7a1c-kube-api-access-hrnq9\") pod \"authorino-75d556bd77-gv7sp\" (UID: \"e17a4ed3-6a94-41db-aaa7-ddd547ab7a1c\") " pod="kuadrant-system/authorino-75d556bd77-gv7sp"
Jul 18 11:29:31.133919 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:29:31.133855    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hrnq9\" (UniqueName: \"kubernetes.io/projected/e17a4ed3-6a94-41db-aaa7-ddd547ab7a1c-kube-api-access-hrnq9\") pod \"authorino-75d556bd77-gv7sp\" (UID: \"e17a4ed3-6a94-41db-aaa7-ddd547ab7a1c\") " pod="kuadrant-system/authorino-75d556bd77-gv7sp"
Jul 18 11:29:31.210011 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:29:31.209971    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-gv7sp"
Jul 18 11:29:31.401685 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:29:31.401649    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-gv7sp"]
Jul 18 11:29:31.725113 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:29:31.725077    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-gv7sp" event={"ID":"e17a4ed3-6a94-41db-aaa7-ddd547ab7a1c","Type":"ContainerStarted","Data":"381ee6ba8f97e660d000fb8931897c2213ffd25012487d204b66aaa279dc3aca"}
Jul 18 11:29:35.749653 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:29:35.749611    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-8j9zf" event={"ID":"a75bccb2-72dc-4e0e-895c-bded9dd84d3e","Type":"ContainerStarted","Data":"3d9414da428c4d3e7d777710b33a748667dae89ce4240352ec88c03d5c80caf9"}
Jul 18 11:29:35.750102 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:29:35.749795    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-8j9zf"
Jul 18 11:29:35.751069 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:29:35.751048    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-gv7sp" event={"ID":"e17a4ed3-6a94-41db-aaa7-ddd547ab7a1c","Type":"ContainerStarted","Data":"69caf74195aa1cf661fd25546809c39107847b91d5fab71ef7cc71fdb3efa869"}
Jul 18 11:29:35.766185 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:29:35.766136    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-8j9zf" podStartSLOduration=2.107349428 podStartE2EDuration="6.766122322s" totalImagesPullingTime="4.658772894s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 11:29:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 11:29:35.764186667 +0000 UTC m=+595.379222984" watchObservedRunningTime="2026-07-18 11:29:35.766122322 +0000 UTC m=+595.381158628"
Jul 18 11:29:35.777810 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:29:35.777761    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-gv7sp" podStartSLOduration=2.116735843 podStartE2EDuration="5.777745639s" totalImagesPullingTime="3.661009796s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 11:29:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 11:29:35.77717952 +0000 UTC m=+595.392215845" watchObservedRunningTime="2026-07-18 11:29:35.777745639 +0000 UTC m=+595.392781941"
Jul 18 11:29:40.863989 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:29:40.863960    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-jfpn7_759a894c-1828-4ac9-a7c3-77354a104247/console-operator/2.log"
Jul 18 11:29:40.872960 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:29:40.872930    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-jfpn7_759a894c-1828-4ac9-a7c3-77354a104247/console-operator/2.log"
Jul 18 11:29:40.873947 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:29:40.873924    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-58jnn_40e8e19c-87b3-4cd6-81c1-0f404971a282/ovn-acl-logging/0.log"
Jul 18 11:29:40.876922 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:29:40.876880    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-58jnn_40e8e19c-87b3-4cd6-81c1-0f404971a282/ovn-acl-logging/0.log"
Jul 18 11:29:44.569281 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:29:44.569242    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-8j9zf"]
Jul 18 11:29:44.569731 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:29:44.569459    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-8j9zf" podUID="a75bccb2-72dc-4e0e-895c-bded9dd84d3e" containerName="limitador" containerID="cri-o://3d9414da428c4d3e7d777710b33a748667dae89ce4240352ec88c03d5c80caf9" gracePeriod=30
Jul 18 11:29:44.570252 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:29:44.570157    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-8j9zf"
Jul 18 11:29:45.131091 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:29:45.131027    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-8j9zf"
Jul 18 11:29:45.240933 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:29:45.240878    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t64sf\" (UniqueName: \"kubernetes.io/projected/a75bccb2-72dc-4e0e-895c-bded9dd84d3e-kube-api-access-t64sf\") pod \"a75bccb2-72dc-4e0e-895c-bded9dd84d3e\" (UID: \"a75bccb2-72dc-4e0e-895c-bded9dd84d3e\") "
Jul 18 11:29:45.241115 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:29:45.240979    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/a75bccb2-72dc-4e0e-895c-bded9dd84d3e-config-file\") pod \"a75bccb2-72dc-4e0e-895c-bded9dd84d3e\" (UID: \"a75bccb2-72dc-4e0e-895c-bded9dd84d3e\") "
Jul 18 11:29:45.241344 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:29:45.241321    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a75bccb2-72dc-4e0e-895c-bded9dd84d3e-config-file" (OuterVolumeSpecName: "config-file") pod "a75bccb2-72dc-4e0e-895c-bded9dd84d3e" (UID: "a75bccb2-72dc-4e0e-895c-bded9dd84d3e"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 18 11:29:45.242933 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:29:45.242907    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a75bccb2-72dc-4e0e-895c-bded9dd84d3e-kube-api-access-t64sf" (OuterVolumeSpecName: "kube-api-access-t64sf") pod "a75bccb2-72dc-4e0e-895c-bded9dd84d3e" (UID: "a75bccb2-72dc-4e0e-895c-bded9dd84d3e"). InnerVolumeSpecName "kube-api-access-t64sf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 18 11:29:45.341711 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:29:45.341675    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t64sf\" (UniqueName: \"kubernetes.io/projected/a75bccb2-72dc-4e0e-895c-bded9dd84d3e-kube-api-access-t64sf\") on node \"ip-10-0-133-122.ec2.internal\" DevicePath \"\""
Jul 18 11:29:45.341711 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:29:45.341706    2579 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/a75bccb2-72dc-4e0e-895c-bded9dd84d3e-config-file\") on node \"ip-10-0-133-122.ec2.internal\" DevicePath \"\""
Jul 18 11:29:45.803143 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:29:45.803108    2579 generic.go:356] "Generic (PLEG): container finished" podID="a75bccb2-72dc-4e0e-895c-bded9dd84d3e" containerID="3d9414da428c4d3e7d777710b33a748667dae89ce4240352ec88c03d5c80caf9" exitCode=0
Jul 18 11:29:45.803576 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:29:45.803163    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-8j9zf"
Jul 18 11:29:45.803576 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:29:45.803184    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-8j9zf" event={"ID":"a75bccb2-72dc-4e0e-895c-bded9dd84d3e","Type":"ContainerDied","Data":"3d9414da428c4d3e7d777710b33a748667dae89ce4240352ec88c03d5c80caf9"}
Jul 18 11:29:45.803576 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:29:45.803265    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-8j9zf" event={"ID":"a75bccb2-72dc-4e0e-895c-bded9dd84d3e","Type":"ContainerDied","Data":"a4cc42a9d4dcae8dc4bc24ad8479495c814ad3aafe5fb7af89b12cc58fde8ca5"}
Jul 18 11:29:45.803576 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:29:45.803289    2579 scope.go:117] "RemoveContainer" containerID="3d9414da428c4d3e7d777710b33a748667dae89ce4240352ec88c03d5c80caf9"
Jul 18 11:29:45.812723 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:29:45.812700    2579 scope.go:117] "RemoveContainer" containerID="3d9414da428c4d3e7d777710b33a748667dae89ce4240352ec88c03d5c80caf9"
Jul 18 11:29:45.813023 ip-10-0-133-122 kubenswrapper[2579]: E0718 11:29:45.813004    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3d9414da428c4d3e7d777710b33a748667dae89ce4240352ec88c03d5c80caf9\": container with ID starting with 3d9414da428c4d3e7d777710b33a748667dae89ce4240352ec88c03d5c80caf9 not found: ID does not exist" containerID="3d9414da428c4d3e7d777710b33a748667dae89ce4240352ec88c03d5c80caf9"
Jul 18 11:29:45.813099 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:29:45.813036    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3d9414da428c4d3e7d777710b33a748667dae89ce4240352ec88c03d5c80caf9"} err="failed to get container status \"3d9414da428c4d3e7d777710b33a748667dae89ce4240352ec88c03d5c80caf9\": rpc error: code = NotFound desc = could not find container \"3d9414da428c4d3e7d777710b33a748667dae89ce4240352ec88c03d5c80caf9\": container with ID starting with 3d9414da428c4d3e7d777710b33a748667dae89ce4240352ec88c03d5c80caf9 not found: ID does not exist"
Jul 18 11:29:45.824336 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:29:45.824304    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-8j9zf"]
Jul 18 11:29:45.828105 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:29:45.828078    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-8j9zf"]
Jul 18 11:29:46.895745 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:29:46.895710    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a75bccb2-72dc-4e0e-895c-bded9dd84d3e" path="/var/lib/kubelet/pods/a75bccb2-72dc-4e0e-895c-bded9dd84d3e/volumes"
Jul 18 11:29:47.122596 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:29:47.122562    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-jvdfg"]
Jul 18 11:29:47.123019 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:29:47.123002    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a75bccb2-72dc-4e0e-895c-bded9dd84d3e" containerName="limitador"
Jul 18 11:29:47.123061 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:29:47.123021    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="a75bccb2-72dc-4e0e-895c-bded9dd84d3e" containerName="limitador"
Jul 18 11:29:47.123101 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:29:47.123091    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="a75bccb2-72dc-4e0e-895c-bded9dd84d3e" containerName="limitador"
Jul 18 11:29:47.127472 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:29:47.127450    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-jvdfg"
Jul 18 11:29:47.130062 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:29:47.130030    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\""
Jul 18 11:29:47.130186 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:29:47.130094    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 18 11:29:47.130186 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:29:47.130103    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 18 11:29:47.130961 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:29:47.130941    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-v7cjt\""
Jul 18 11:29:47.135875 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:29:47.135855    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-jvdfg"]
Jul 18 11:29:47.154331 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:29:47.154240    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ll6ht\" (UniqueName: \"kubernetes.io/projected/6a1d8986-a31b-4af0-ab23-836e6bd9cf88-kube-api-access-ll6ht\") pod \"postgres-69fb4594cf-jvdfg\" (UID: \"6a1d8986-a31b-4af0-ab23-836e6bd9cf88\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-jvdfg"
Jul 18 11:29:47.154483 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:29:47.154349    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/6a1d8986-a31b-4af0-ab23-836e6bd9cf88-data\") pod \"postgres-69fb4594cf-jvdfg\" (UID: \"6a1d8986-a31b-4af0-ab23-836e6bd9cf88\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-jvdfg"
Jul 18 11:29:47.255225 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:29:47.255187    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ll6ht\" (UniqueName: \"kubernetes.io/projected/6a1d8986-a31b-4af0-ab23-836e6bd9cf88-kube-api-access-ll6ht\") pod \"postgres-69fb4594cf-jvdfg\" (UID: \"6a1d8986-a31b-4af0-ab23-836e6bd9cf88\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-jvdfg"
Jul 18 11:29:47.255407 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:29:47.255327    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/6a1d8986-a31b-4af0-ab23-836e6bd9cf88-data\") pod \"postgres-69fb4594cf-jvdfg\" (UID: \"6a1d8986-a31b-4af0-ab23-836e6bd9cf88\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-jvdfg"
Jul 18 11:29:47.255630 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:29:47.255616    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/6a1d8986-a31b-4af0-ab23-836e6bd9cf88-data\") pod \"postgres-69fb4594cf-jvdfg\" (UID: \"6a1d8986-a31b-4af0-ab23-836e6bd9cf88\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-jvdfg"
Jul 18 11:29:47.262921 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:29:47.262875    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ll6ht\" (UniqueName: \"kubernetes.io/projected/6a1d8986-a31b-4af0-ab23-836e6bd9cf88-kube-api-access-ll6ht\") pod \"postgres-69fb4594cf-jvdfg\" (UID: \"6a1d8986-a31b-4af0-ab23-836e6bd9cf88\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-jvdfg"
Jul 18 11:29:47.439489 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:29:47.439390    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-jvdfg"
Jul 18 11:29:47.579055 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:29:47.579020    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-jvdfg"]
Jul 18 11:29:47.582647 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:29:47.582614    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6a1d8986_a31b_4af0_ab23_836e6bd9cf88.slice/crio-4df6dcc6bbf843de69717192a9d15c5306b8bb91504578627ec7efc8ea13cfd8 WatchSource:0}: Error finding container 4df6dcc6bbf843de69717192a9d15c5306b8bb91504578627ec7efc8ea13cfd8: Status 404 returned error can't find the container with id 4df6dcc6bbf843de69717192a9d15c5306b8bb91504578627ec7efc8ea13cfd8
Jul 18 11:29:47.816606 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:29:47.816518    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-jvdfg" event={"ID":"6a1d8986-a31b-4af0-ab23-836e6bd9cf88","Type":"ContainerStarted","Data":"4df6dcc6bbf843de69717192a9d15c5306b8bb91504578627ec7efc8ea13cfd8"}
Jul 18 11:29:52.858145 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:29:52.858109    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-jvdfg" event={"ID":"6a1d8986-a31b-4af0-ab23-836e6bd9cf88","Type":"ContainerStarted","Data":"26cc35cba00e46f40c581397d909d9ca4663602e244201aa684c3417ffdd5a9c"}
Jul 18 11:29:52.858547 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:29:52.858176    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-jvdfg"
Jul 18 11:29:52.873780 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:29:52.873726    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-jvdfg" podStartSLOduration=1.016786959 podStartE2EDuration="5.873706995s" totalImagesPullingTime="4.856920036s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 11:29:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 11:29:52.872279652 +0000 UTC m=+612.487315954" watchObservedRunningTime="2026-07-18 11:29:52.873706995 +0000 UTC m=+612.488743296"
Jul 18 11:29:58.894604 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:29:58.894574    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-jvdfg"
Jul 18 11:29:59.439816 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:29:59.439782    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-ktmtj"]
Jul 18 11:29:59.446655 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:29:59.446630    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-ktmtj"
Jul 18 11:29:59.452608 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:29:59.452582    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-ktmtj"]
Jul 18 11:29:59.563983 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:29:59.563934    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r44lq\" (UniqueName: \"kubernetes.io/projected/b046cac5-f003-4601-a5a7-72155477fc9e-kube-api-access-r44lq\") pod \"authorino-5d4b67c446-ktmtj\" (UID: \"b046cac5-f003-4601-a5a7-72155477fc9e\") " pod="kuadrant-system/authorino-5d4b67c446-ktmtj"
Jul 18 11:29:59.665215 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:29:59.665179    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r44lq\" (UniqueName: \"kubernetes.io/projected/b046cac5-f003-4601-a5a7-72155477fc9e-kube-api-access-r44lq\") pod \"authorino-5d4b67c446-ktmtj\" (UID: \"b046cac5-f003-4601-a5a7-72155477fc9e\") " pod="kuadrant-system/authorino-5d4b67c446-ktmtj"
Jul 18 11:29:59.677109 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:29:59.677079    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r44lq\" (UniqueName: \"kubernetes.io/projected/b046cac5-f003-4601-a5a7-72155477fc9e-kube-api-access-r44lq\") pod \"authorino-5d4b67c446-ktmtj\" (UID: \"b046cac5-f003-4601-a5a7-72155477fc9e\") " pod="kuadrant-system/authorino-5d4b67c446-ktmtj"
Jul 18 11:29:59.688378 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:29:59.688349    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-ktmtj"]
Jul 18 11:29:59.688618 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:29:59.688604    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-ktmtj"
Jul 18 11:29:59.710532 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:29:59.710503    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-6d47b5f49b-4rl8q"]
Jul 18 11:29:59.717232 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:29:59.717205    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6d47b5f49b-4rl8q"
Jul 18 11:29:59.717738 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:29:59.717713    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6d47b5f49b-4rl8q"]
Jul 18 11:29:59.766600 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:29:59.766565    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p8kff\" (UniqueName: \"kubernetes.io/projected/ce059683-c5db-46e7-a717-6c15ea4c762d-kube-api-access-p8kff\") pod \"authorino-6d47b5f49b-4rl8q\" (UID: \"ce059683-c5db-46e7-a717-6c15ea4c762d\") " pod="kuadrant-system/authorino-6d47b5f49b-4rl8q"
Jul 18 11:29:59.837516 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:29:59.837490    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-ktmtj"]
Jul 18 11:29:59.841052 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:29:59.841023    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb046cac5_f003_4601_a5a7_72155477fc9e.slice/crio-2d841b31eeac05bab39b25213f1ae1e7e8f7d572fee2e67bd5a85aeebea4b794 WatchSource:0}: Error finding container 2d841b31eeac05bab39b25213f1ae1e7e8f7d572fee2e67bd5a85aeebea4b794: Status 404 returned error can't find the container with id 2d841b31eeac05bab39b25213f1ae1e7e8f7d572fee2e67bd5a85aeebea4b794
Jul 18 11:29:59.867662 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:29:59.867631    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p8kff\" (UniqueName: \"kubernetes.io/projected/ce059683-c5db-46e7-a717-6c15ea4c762d-kube-api-access-p8kff\") pod \"authorino-6d47b5f49b-4rl8q\" (UID: \"ce059683-c5db-46e7-a717-6c15ea4c762d\") " pod="kuadrant-system/authorino-6d47b5f49b-4rl8q"
Jul 18 11:29:59.875764 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:29:59.875727    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p8kff\" (UniqueName: \"kubernetes.io/projected/ce059683-c5db-46e7-a717-6c15ea4c762d-kube-api-access-p8kff\") pod \"authorino-6d47b5f49b-4rl8q\" (UID: \"ce059683-c5db-46e7-a717-6c15ea4c762d\") " pod="kuadrant-system/authorino-6d47b5f49b-4rl8q"
Jul 18 11:29:59.890879 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:29:59.890838    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-ktmtj" event={"ID":"b046cac5-f003-4601-a5a7-72155477fc9e","Type":"ContainerStarted","Data":"2d841b31eeac05bab39b25213f1ae1e7e8f7d572fee2e67bd5a85aeebea4b794"}
Jul 18 11:30:00.028084 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:30:00.027990    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6d47b5f49b-4rl8q"
Jul 18 11:30:00.165606 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:30:00.165584    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6d47b5f49b-4rl8q"]
Jul 18 11:30:00.167722 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:30:00.167688    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podce059683_c5db_46e7_a717_6c15ea4c762d.slice/crio-49e4a1c02dcf0c9bff8e3579282ddc2b176be9e2c64ce5b06de4ac611aed6792 WatchSource:0}: Error finding container 49e4a1c02dcf0c9bff8e3579282ddc2b176be9e2c64ce5b06de4ac611aed6792: Status 404 returned error can't find the container with id 49e4a1c02dcf0c9bff8e3579282ddc2b176be9e2c64ce5b06de4ac611aed6792
Jul 18 11:30:00.896766 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:30:00.896730    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-ktmtj" event={"ID":"b046cac5-f003-4601-a5a7-72155477fc9e","Type":"ContainerStarted","Data":"0d194d84507a21dadde29f649174b5fdd366c356fdd3eb41fe87435aa2912dbb"}
Jul 18 11:30:00.897002 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:30:00.896779    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-5d4b67c446-ktmtj" podUID="b046cac5-f003-4601-a5a7-72155477fc9e" containerName="authorino" containerID="cri-o://0d194d84507a21dadde29f649174b5fdd366c356fdd3eb41fe87435aa2912dbb" gracePeriod=30
Jul 18 11:30:00.898221 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:30:00.898199    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6d47b5f49b-4rl8q" event={"ID":"ce059683-c5db-46e7-a717-6c15ea4c762d","Type":"ContainerStarted","Data":"ea351d73c300261e6dbfa45754485ea8b55e28281f814a23d036b3277a3989cb"}
Jul 18 11:30:00.898368 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:30:00.898227    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6d47b5f49b-4rl8q" event={"ID":"ce059683-c5db-46e7-a717-6c15ea4c762d","Type":"ContainerStarted","Data":"49e4a1c02dcf0c9bff8e3579282ddc2b176be9e2c64ce5b06de4ac611aed6792"}
Jul 18 11:30:00.913922 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:30:00.913852    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5d4b67c446-ktmtj" podStartSLOduration=1.5933697279999999 podStartE2EDuration="1.913836937s" totalImagesPullingTime="320.467209ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 11:29:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 11:30:00.912749366 +0000 UTC m=+620.527785667" watchObservedRunningTime="2026-07-18 11:30:00.913836937 +0000 UTC m=+620.528873241"
Jul 18 11:30:00.926673 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:30:00.926625    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-6d47b5f49b-4rl8q" podStartSLOduration=1.613457914 podStartE2EDuration="1.926609044s" totalImagesPullingTime="313.15113ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 11:29:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 11:30:00.925515707 +0000 UTC m=+620.540552010" watchObservedRunningTime="2026-07-18 11:30:00.926609044 +0000 UTC m=+620.541645340"
Jul 18 11:30:00.952167 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:30:00.952134    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-gv7sp"]
Jul 18 11:30:00.952375 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:30:00.952350    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-gv7sp" podUID="e17a4ed3-6a94-41db-aaa7-ddd547ab7a1c" containerName="authorino" containerID="cri-o://69caf74195aa1cf661fd25546809c39107847b91d5fab71ef7cc71fdb3efa869" gracePeriod=30
Jul 18 11:30:01.166960 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:30:01.166927    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5f684d9d5b-mtt84"]
Jul 18 11:30:01.171021 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:30:01.170993    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5f684d9d5b-mtt84"
Jul 18 11:30:01.173359 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:30:01.173320    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Jul 18 11:30:01.177610 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:30:01.177330    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5f684d9d5b-mtt84"]
Jul 18 11:30:01.245243 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:30:01.245211    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-gv7sp"
Jul 18 11:30:01.253031 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:30:01.253003    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-ktmtj"
Jul 18 11:30:01.284365 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:30:01.284335    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hrnq9\" (UniqueName: \"kubernetes.io/projected/e17a4ed3-6a94-41db-aaa7-ddd547ab7a1c-kube-api-access-hrnq9\") pod \"e17a4ed3-6a94-41db-aaa7-ddd547ab7a1c\" (UID: \"e17a4ed3-6a94-41db-aaa7-ddd547ab7a1c\") "
Jul 18 11:30:01.284591 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:30:01.284573    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/c73d64d6-ae99-4782-94ed-54fb6aa76e81-tls-cert\") pod \"authorino-5f684d9d5b-mtt84\" (UID: \"c73d64d6-ae99-4782-94ed-54fb6aa76e81\") " pod="kuadrant-system/authorino-5f684d9d5b-mtt84"
Jul 18 11:30:01.284706 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:30:01.284678    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gxlqv\" (UniqueName: \"kubernetes.io/projected/c73d64d6-ae99-4782-94ed-54fb6aa76e81-kube-api-access-gxlqv\") pod \"authorino-5f684d9d5b-mtt84\" (UID: \"c73d64d6-ae99-4782-94ed-54fb6aa76e81\") " pod="kuadrant-system/authorino-5f684d9d5b-mtt84"
Jul 18 11:30:01.286461 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:30:01.286434    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e17a4ed3-6a94-41db-aaa7-ddd547ab7a1c-kube-api-access-hrnq9" (OuterVolumeSpecName: "kube-api-access-hrnq9") pod "e17a4ed3-6a94-41db-aaa7-ddd547ab7a1c" (UID: "e17a4ed3-6a94-41db-aaa7-ddd547ab7a1c"). InnerVolumeSpecName "kube-api-access-hrnq9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 18 11:30:01.386090 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:30:01.386046    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r44lq\" (UniqueName: \"kubernetes.io/projected/b046cac5-f003-4601-a5a7-72155477fc9e-kube-api-access-r44lq\") pod \"b046cac5-f003-4601-a5a7-72155477fc9e\" (UID: \"b046cac5-f003-4601-a5a7-72155477fc9e\") "
Jul 18 11:30:01.386260 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:30:01.386214    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gxlqv\" (UniqueName: \"kubernetes.io/projected/c73d64d6-ae99-4782-94ed-54fb6aa76e81-kube-api-access-gxlqv\") pod \"authorino-5f684d9d5b-mtt84\" (UID: \"c73d64d6-ae99-4782-94ed-54fb6aa76e81\") " pod="kuadrant-system/authorino-5f684d9d5b-mtt84"
Jul 18 11:30:01.386316 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:30:01.386299    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/c73d64d6-ae99-4782-94ed-54fb6aa76e81-tls-cert\") pod \"authorino-5f684d9d5b-mtt84\" (UID: \"c73d64d6-ae99-4782-94ed-54fb6aa76e81\") " pod="kuadrant-system/authorino-5f684d9d5b-mtt84"
Jul 18 11:30:01.386372 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:30:01.386354    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hrnq9\" (UniqueName: \"kubernetes.io/projected/e17a4ed3-6a94-41db-aaa7-ddd547ab7a1c-kube-api-access-hrnq9\") on node \"ip-10-0-133-122.ec2.internal\" DevicePath \"\""
Jul 18 11:30:01.388204 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:30:01.388176    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b046cac5-f003-4601-a5a7-72155477fc9e-kube-api-access-r44lq" (OuterVolumeSpecName: "kube-api-access-r44lq") pod "b046cac5-f003-4601-a5a7-72155477fc9e" (UID: "b046cac5-f003-4601-a5a7-72155477fc9e"). InnerVolumeSpecName "kube-api-access-r44lq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 18 11:30:01.388671 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:30:01.388651    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/c73d64d6-ae99-4782-94ed-54fb6aa76e81-tls-cert\") pod \"authorino-5f684d9d5b-mtt84\" (UID: \"c73d64d6-ae99-4782-94ed-54fb6aa76e81\") " pod="kuadrant-system/authorino-5f684d9d5b-mtt84"
Jul 18 11:30:01.393405 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:30:01.393382    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gxlqv\" (UniqueName: \"kubernetes.io/projected/c73d64d6-ae99-4782-94ed-54fb6aa76e81-kube-api-access-gxlqv\") pod \"authorino-5f684d9d5b-mtt84\" (UID: \"c73d64d6-ae99-4782-94ed-54fb6aa76e81\") " pod="kuadrant-system/authorino-5f684d9d5b-mtt84"
Jul 18 11:30:01.484682 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:30:01.484598    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5f684d9d5b-mtt84"
Jul 18 11:30:01.487110 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:30:01.487083    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r44lq\" (UniqueName: \"kubernetes.io/projected/b046cac5-f003-4601-a5a7-72155477fc9e-kube-api-access-r44lq\") on node \"ip-10-0-133-122.ec2.internal\" DevicePath \"\""
Jul 18 11:30:01.620185 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:30:01.620156    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5f684d9d5b-mtt84"]
Jul 18 11:30:01.622037 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:30:01.622006    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc73d64d6_ae99_4782_94ed_54fb6aa76e81.slice/crio-975548ed72076c66b2f3a4a277752ccf18e1c342747ba6a9439e5c8ec88aed90 WatchSource:0}: Error finding container 975548ed72076c66b2f3a4a277752ccf18e1c342747ba6a9439e5c8ec88aed90: Status 404 returned error can't find the container with id 975548ed72076c66b2f3a4a277752ccf18e1c342747ba6a9439e5c8ec88aed90
Jul 18 11:30:01.904665 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:30:01.904625    2579 generic.go:356] "Generic (PLEG): container finished" podID="e17a4ed3-6a94-41db-aaa7-ddd547ab7a1c" containerID="69caf74195aa1cf661fd25546809c39107847b91d5fab71ef7cc71fdb3efa869" exitCode=0
Jul 18 11:30:01.904665 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:30:01.904666    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-gv7sp"
Jul 18 11:30:01.904943 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:30:01.904714    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-gv7sp" event={"ID":"e17a4ed3-6a94-41db-aaa7-ddd547ab7a1c","Type":"ContainerDied","Data":"69caf74195aa1cf661fd25546809c39107847b91d5fab71ef7cc71fdb3efa869"}
Jul 18 11:30:01.904943 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:30:01.904752    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-gv7sp" event={"ID":"e17a4ed3-6a94-41db-aaa7-ddd547ab7a1c","Type":"ContainerDied","Data":"381ee6ba8f97e660d000fb8931897c2213ffd25012487d204b66aaa279dc3aca"}
Jul 18 11:30:01.904943 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:30:01.904775    2579 scope.go:117] "RemoveContainer" containerID="69caf74195aa1cf661fd25546809c39107847b91d5fab71ef7cc71fdb3efa869"
Jul 18 11:30:01.906221 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:30:01.906200    2579 generic.go:356] "Generic (PLEG): container finished" podID="b046cac5-f003-4601-a5a7-72155477fc9e" containerID="0d194d84507a21dadde29f649174b5fdd366c356fdd3eb41fe87435aa2912dbb" exitCode=0
Jul 18 11:30:01.906314 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:30:01.906250    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-ktmtj"
Jul 18 11:30:01.906314 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:30:01.906274    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-ktmtj" event={"ID":"b046cac5-f003-4601-a5a7-72155477fc9e","Type":"ContainerDied","Data":"0d194d84507a21dadde29f649174b5fdd366c356fdd3eb41fe87435aa2912dbb"}
Jul 18 11:30:01.906314 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:30:01.906310    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-ktmtj" event={"ID":"b046cac5-f003-4601-a5a7-72155477fc9e","Type":"ContainerDied","Data":"2d841b31eeac05bab39b25213f1ae1e7e8f7d572fee2e67bd5a85aeebea4b794"}
Jul 18 11:30:01.907508 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:30:01.907480    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5f684d9d5b-mtt84" event={"ID":"c73d64d6-ae99-4782-94ed-54fb6aa76e81","Type":"ContainerStarted","Data":"975548ed72076c66b2f3a4a277752ccf18e1c342747ba6a9439e5c8ec88aed90"}
Jul 18 11:30:01.916335 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:30:01.916317    2579 scope.go:117] "RemoveContainer" containerID="69caf74195aa1cf661fd25546809c39107847b91d5fab71ef7cc71fdb3efa869"
Jul 18 11:30:01.916617 ip-10-0-133-122 kubenswrapper[2579]: E0718 11:30:01.916601    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"69caf74195aa1cf661fd25546809c39107847b91d5fab71ef7cc71fdb3efa869\": container with ID starting with 69caf74195aa1cf661fd25546809c39107847b91d5fab71ef7cc71fdb3efa869 not found: ID does not exist" containerID="69caf74195aa1cf661fd25546809c39107847b91d5fab71ef7cc71fdb3efa869"
Jul 18 11:30:01.916676 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:30:01.916626    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"69caf74195aa1cf661fd25546809c39107847b91d5fab71ef7cc71fdb3efa869"} err="failed to get container status \"69caf74195aa1cf661fd25546809c39107847b91d5fab71ef7cc71fdb3efa869\": rpc error: code = NotFound desc = could not find container \"69caf74195aa1cf661fd25546809c39107847b91d5fab71ef7cc71fdb3efa869\": container with ID starting with 69caf74195aa1cf661fd25546809c39107847b91d5fab71ef7cc71fdb3efa869 not found: ID does not exist"
Jul 18 11:30:01.916676 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:30:01.916643    2579 scope.go:117] "RemoveContainer" containerID="0d194d84507a21dadde29f649174b5fdd366c356fdd3eb41fe87435aa2912dbb"
Jul 18 11:30:01.925151 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:30:01.925123    2579 scope.go:117] "RemoveContainer" containerID="0d194d84507a21dadde29f649174b5fdd366c356fdd3eb41fe87435aa2912dbb"
Jul 18 11:30:01.925451 ip-10-0-133-122 kubenswrapper[2579]: E0718 11:30:01.925427    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0d194d84507a21dadde29f649174b5fdd366c356fdd3eb41fe87435aa2912dbb\": container with ID starting with 0d194d84507a21dadde29f649174b5fdd366c356fdd3eb41fe87435aa2912dbb not found: ID does not exist" containerID="0d194d84507a21dadde29f649174b5fdd366c356fdd3eb41fe87435aa2912dbb"
Jul 18 11:30:01.925496 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:30:01.925459    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0d194d84507a21dadde29f649174b5fdd366c356fdd3eb41fe87435aa2912dbb"} err="failed to get container status \"0d194d84507a21dadde29f649174b5fdd366c356fdd3eb41fe87435aa2912dbb\": rpc error: code = NotFound desc = could not find container \"0d194d84507a21dadde29f649174b5fdd366c356fdd3eb41fe87435aa2912dbb\": container with ID starting with 0d194d84507a21dadde29f649174b5fdd366c356fdd3eb41fe87435aa2912dbb not found: ID does not exist"
Jul 18 11:30:01.927040 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:30:01.927010    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-gv7sp"]
Jul 18 11:30:01.928719 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:30:01.928699    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-gv7sp"]
Jul 18 11:30:01.937595 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:30:01.937565    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-ktmtj"]
Jul 18 11:30:01.941041 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:30:01.941018    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-ktmtj"]
Jul 18 11:30:02.894836 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:30:02.894804    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b046cac5-f003-4601-a5a7-72155477fc9e" path="/var/lib/kubelet/pods/b046cac5-f003-4601-a5a7-72155477fc9e/volumes"
Jul 18 11:30:02.895232 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:30:02.895153    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e17a4ed3-6a94-41db-aaa7-ddd547ab7a1c" path="/var/lib/kubelet/pods/e17a4ed3-6a94-41db-aaa7-ddd547ab7a1c/volumes"
Jul 18 11:30:02.914992 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:30:02.914961    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5f684d9d5b-mtt84" event={"ID":"c73d64d6-ae99-4782-94ed-54fb6aa76e81","Type":"ContainerStarted","Data":"6d4aa1b96d28856f74daf55df14cd6a6065b8e4d905a2e3b21dc10f517ca12cf"}
Jul 18 11:30:02.931474 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:30:02.931417    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5f684d9d5b-mtt84" podStartSLOduration=1.381979292 podStartE2EDuration="1.931398382s" totalImagesPullingTime="549.41909ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 11:30:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 11:30:02.928779357 +0000 UTC m=+622.543815659" watchObservedRunningTime="2026-07-18 11:30:02.931398382 +0000 UTC m=+622.546434684"
Jul 18 11:30:02.956215 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:30:02.956183    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6d47b5f49b-4rl8q"]
Jul 18 11:30:02.956395 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:30:02.956349    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-6d47b5f49b-4rl8q" podUID="ce059683-c5db-46e7-a717-6c15ea4c762d" containerName="authorino" containerID="cri-o://ea351d73c300261e6dbfa45754485ea8b55e28281f814a23d036b3277a3989cb" gracePeriod=30
Jul 18 11:30:03.217412 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:30:03.217372    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6d47b5f49b-4rl8q"
Jul 18 11:30:03.304242 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:30:03.304200    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p8kff\" (UniqueName: \"kubernetes.io/projected/ce059683-c5db-46e7-a717-6c15ea4c762d-kube-api-access-p8kff\") pod \"ce059683-c5db-46e7-a717-6c15ea4c762d\" (UID: \"ce059683-c5db-46e7-a717-6c15ea4c762d\") "
Jul 18 11:30:03.306432 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:30:03.306396    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ce059683-c5db-46e7-a717-6c15ea4c762d-kube-api-access-p8kff" (OuterVolumeSpecName: "kube-api-access-p8kff") pod "ce059683-c5db-46e7-a717-6c15ea4c762d" (UID: "ce059683-c5db-46e7-a717-6c15ea4c762d"). InnerVolumeSpecName "kube-api-access-p8kff". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 18 11:30:03.405120 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:30:03.405080    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p8kff\" (UniqueName: \"kubernetes.io/projected/ce059683-c5db-46e7-a717-6c15ea4c762d-kube-api-access-p8kff\") on node \"ip-10-0-133-122.ec2.internal\" DevicePath \"\""
Jul 18 11:30:03.923679 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:30:03.923642    2579 generic.go:356] "Generic (PLEG): container finished" podID="ce059683-c5db-46e7-a717-6c15ea4c762d" containerID="ea351d73c300261e6dbfa45754485ea8b55e28281f814a23d036b3277a3989cb" exitCode=0
Jul 18 11:30:03.924103 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:30:03.923691    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6d47b5f49b-4rl8q"
Jul 18 11:30:03.924103 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:30:03.923727    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6d47b5f49b-4rl8q" event={"ID":"ce059683-c5db-46e7-a717-6c15ea4c762d","Type":"ContainerDied","Data":"ea351d73c300261e6dbfa45754485ea8b55e28281f814a23d036b3277a3989cb"}
Jul 18 11:30:03.924103 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:30:03.923768    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6d47b5f49b-4rl8q" event={"ID":"ce059683-c5db-46e7-a717-6c15ea4c762d","Type":"ContainerDied","Data":"49e4a1c02dcf0c9bff8e3579282ddc2b176be9e2c64ce5b06de4ac611aed6792"}
Jul 18 11:30:03.924103 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:30:03.923784    2579 scope.go:117] "RemoveContainer" containerID="ea351d73c300261e6dbfa45754485ea8b55e28281f814a23d036b3277a3989cb"
Jul 18 11:30:03.932644 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:30:03.932624    2579 scope.go:117] "RemoveContainer" containerID="ea351d73c300261e6dbfa45754485ea8b55e28281f814a23d036b3277a3989cb"
Jul 18 11:30:03.932924 ip-10-0-133-122 kubenswrapper[2579]: E0718 11:30:03.932896    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ea351d73c300261e6dbfa45754485ea8b55e28281f814a23d036b3277a3989cb\": container with ID starting with ea351d73c300261e6dbfa45754485ea8b55e28281f814a23d036b3277a3989cb not found: ID does not exist" containerID="ea351d73c300261e6dbfa45754485ea8b55e28281f814a23d036b3277a3989cb"
Jul 18 11:30:03.933012 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:30:03.932928    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ea351d73c300261e6dbfa45754485ea8b55e28281f814a23d036b3277a3989cb"} err="failed to get container status \"ea351d73c300261e6dbfa45754485ea8b55e28281f814a23d036b3277a3989cb\": rpc error: code = NotFound desc = could not find container \"ea351d73c300261e6dbfa45754485ea8b55e28281f814a23d036b3277a3989cb\": container with ID starting with ea351d73c300261e6dbfa45754485ea8b55e28281f814a23d036b3277a3989cb not found: ID does not exist"
Jul 18 11:30:03.944472 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:30:03.944441    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6d47b5f49b-4rl8q"]
Jul 18 11:30:03.946045 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:30:03.946024    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-6d47b5f49b-4rl8q"]
Jul 18 11:30:04.893928 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:30:04.893872    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ce059683-c5db-46e7-a717-6c15ea4c762d" path="/var/lib/kubelet/pods/ce059683-c5db-46e7-a717-6c15ea4c762d/volumes"
Jul 18 11:30:05.674140 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:30:05.674100    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-85c589fb66-29bwk"]
Jul 18 11:30:05.674548 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:30:05.674459    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b046cac5-f003-4601-a5a7-72155477fc9e" containerName="authorino"
Jul 18 11:30:05.674548 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:30:05.674470    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="b046cac5-f003-4601-a5a7-72155477fc9e" containerName="authorino"
Jul 18 11:30:05.674548 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:30:05.674489    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ce059683-c5db-46e7-a717-6c15ea4c762d" containerName="authorino"
Jul 18 11:30:05.674548 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:30:05.674495    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="ce059683-c5db-46e7-a717-6c15ea4c762d" containerName="authorino"
Jul 18 11:30:05.674548 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:30:05.674502    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e17a4ed3-6a94-41db-aaa7-ddd547ab7a1c" containerName="authorino"
Jul 18 11:30:05.674548 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:30:05.674507    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="e17a4ed3-6a94-41db-aaa7-ddd547ab7a1c" containerName="authorino"
Jul 18 11:30:05.674739 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:30:05.674560    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="b046cac5-f003-4601-a5a7-72155477fc9e" containerName="authorino"
Jul 18 11:30:05.674739 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:30:05.674567    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="e17a4ed3-6a94-41db-aaa7-ddd547ab7a1c" containerName="authorino"
Jul 18 11:30:05.674739 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:30:05.674574    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="ce059683-c5db-46e7-a717-6c15ea4c762d" containerName="authorino"
Jul 18 11:30:05.686219 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:30:05.686190    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-85c589fb66-29bwk"
Jul 18 11:30:05.689501 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:30:05.689472    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 18 11:30:05.689768 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:30:05.689747    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 18 11:30:05.690373 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:30:05.690208    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-f2fjs\""
Jul 18 11:30:05.691657 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:30:05.691629    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-85c589fb66-29bwk"]
Jul 18 11:30:05.830077 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:30:05.830041    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4d7zf\" (UniqueName: \"kubernetes.io/projected/bc64546d-b866-4827-84df-9c707306af40-kube-api-access-4d7zf\") pod \"maas-controller-85c589fb66-29bwk\" (UID: \"bc64546d-b866-4827-84df-9c707306af40\") " pod="opendatahub/maas-controller-85c589fb66-29bwk"
Jul 18 11:30:05.830251 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:30:05.830087    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/bc64546d-b866-4827-84df-9c707306af40-webhook-cert\") pod \"maas-controller-85c589fb66-29bwk\" (UID: \"bc64546d-b866-4827-84df-9c707306af40\") " pod="opendatahub/maas-controller-85c589fb66-29bwk"
Jul 18 11:30:05.861744 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:30:05.861708    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-b98bf4979-vxqlr"]
Jul 18 11:30:05.914129 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:30:05.914090    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-b98bf4979-vxqlr"]
Jul 18 11:30:05.914296 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:30:05.914219    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-b98bf4979-vxqlr"
Jul 18 11:30:05.931237 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:30:05.931156    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4d7zf\" (UniqueName: \"kubernetes.io/projected/bc64546d-b866-4827-84df-9c707306af40-kube-api-access-4d7zf\") pod \"maas-controller-85c589fb66-29bwk\" (UID: \"bc64546d-b866-4827-84df-9c707306af40\") " pod="opendatahub/maas-controller-85c589fb66-29bwk"
Jul 18 11:30:05.931237 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:30:05.931207    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/bc64546d-b866-4827-84df-9c707306af40-webhook-cert\") pod \"maas-controller-85c589fb66-29bwk\" (UID: \"bc64546d-b866-4827-84df-9c707306af40\") " pod="opendatahub/maas-controller-85c589fb66-29bwk"
Jul 18 11:30:05.931465 ip-10-0-133-122 kubenswrapper[2579]: E0718 11:30:05.931366    2579 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found
Jul 18 11:30:05.931465 ip-10-0-133-122 kubenswrapper[2579]: E0718 11:30:05.931452    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bc64546d-b866-4827-84df-9c707306af40-webhook-cert podName:bc64546d-b866-4827-84df-9c707306af40 nodeName:}" failed. No retries permitted until 2026-07-18 11:30:06.431422891 +0000 UTC m=+626.046459178 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/bc64546d-b866-4827-84df-9c707306af40-webhook-cert") pod "maas-controller-85c589fb66-29bwk" (UID: "bc64546d-b866-4827-84df-9c707306af40") : secret "maas-controller-webhook-cert" not found
Jul 18 11:30:05.943587 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:30:05.943553    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4d7zf\" (UniqueName: \"kubernetes.io/projected/bc64546d-b866-4827-84df-9c707306af40-kube-api-access-4d7zf\") pod \"maas-controller-85c589fb66-29bwk\" (UID: \"bc64546d-b866-4827-84df-9c707306af40\") " pod="opendatahub/maas-controller-85c589fb66-29bwk"
Jul 18 11:30:06.032327 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:30:06.032288    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/74fb912a-3946-4fca-ae6b-be2264132ca8-webhook-cert\") pod \"maas-controller-b98bf4979-vxqlr\" (UID: \"74fb912a-3946-4fca-ae6b-be2264132ca8\") " pod="opendatahub/maas-controller-b98bf4979-vxqlr"
Jul 18 11:30:06.032516 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:30:06.032423    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lrlkh\" (UniqueName: \"kubernetes.io/projected/74fb912a-3946-4fca-ae6b-be2264132ca8-kube-api-access-lrlkh\") pod \"maas-controller-b98bf4979-vxqlr\" (UID: \"74fb912a-3946-4fca-ae6b-be2264132ca8\") " pod="opendatahub/maas-controller-b98bf4979-vxqlr"
Jul 18 11:30:06.133701 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:30:06.133656    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lrlkh\" (UniqueName: \"kubernetes.io/projected/74fb912a-3946-4fca-ae6b-be2264132ca8-kube-api-access-lrlkh\") pod \"maas-controller-b98bf4979-vxqlr\" (UID: \"74fb912a-3946-4fca-ae6b-be2264132ca8\") " pod="opendatahub/maas-controller-b98bf4979-vxqlr"
Jul 18 11:30:06.133939 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:30:06.133727    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/74fb912a-3946-4fca-ae6b-be2264132ca8-webhook-cert\") pod \"maas-controller-b98bf4979-vxqlr\" (UID: \"74fb912a-3946-4fca-ae6b-be2264132ca8\") " pod="opendatahub/maas-controller-b98bf4979-vxqlr"
Jul 18 11:30:06.133939 ip-10-0-133-122 kubenswrapper[2579]: E0718 11:30:06.133833    2579 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found
Jul 18 11:30:06.133939 ip-10-0-133-122 kubenswrapper[2579]: E0718 11:30:06.133934    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/74fb912a-3946-4fca-ae6b-be2264132ca8-webhook-cert podName:74fb912a-3946-4fca-ae6b-be2264132ca8 nodeName:}" failed. No retries permitted until 2026-07-18 11:30:06.633880473 +0000 UTC m=+626.248916752 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/74fb912a-3946-4fca-ae6b-be2264132ca8-webhook-cert") pod "maas-controller-b98bf4979-vxqlr" (UID: "74fb912a-3946-4fca-ae6b-be2264132ca8") : secret "maas-controller-webhook-cert" not found
Jul 18 11:30:06.142616 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:30:06.142582    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lrlkh\" (UniqueName: \"kubernetes.io/projected/74fb912a-3946-4fca-ae6b-be2264132ca8-kube-api-access-lrlkh\") pod \"maas-controller-b98bf4979-vxqlr\" (UID: \"74fb912a-3946-4fca-ae6b-be2264132ca8\") " pod="opendatahub/maas-controller-b98bf4979-vxqlr"
Jul 18 11:30:06.435347 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:30:06.435308    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/bc64546d-b866-4827-84df-9c707306af40-webhook-cert\") pod \"maas-controller-85c589fb66-29bwk\" (UID: \"bc64546d-b866-4827-84df-9c707306af40\") " pod="opendatahub/maas-controller-85c589fb66-29bwk"
Jul 18 11:30:06.437875 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:30:06.437849    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/bc64546d-b866-4827-84df-9c707306af40-webhook-cert\") pod \"maas-controller-85c589fb66-29bwk\" (UID: \"bc64546d-b866-4827-84df-9c707306af40\") " pod="opendatahub/maas-controller-85c589fb66-29bwk"
Jul 18 11:30:06.599422 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:30:06.599385    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-85c589fb66-29bwk"
Jul 18 11:30:06.637475 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:30:06.637435    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/74fb912a-3946-4fca-ae6b-be2264132ca8-webhook-cert\") pod \"maas-controller-b98bf4979-vxqlr\" (UID: \"74fb912a-3946-4fca-ae6b-be2264132ca8\") " pod="opendatahub/maas-controller-b98bf4979-vxqlr"
Jul 18 11:30:06.639985 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:30:06.639959    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/74fb912a-3946-4fca-ae6b-be2264132ca8-webhook-cert\") pod \"maas-controller-b98bf4979-vxqlr\" (UID: \"74fb912a-3946-4fca-ae6b-be2264132ca8\") " pod="opendatahub/maas-controller-b98bf4979-vxqlr"
Jul 18 11:30:06.785187 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:30:06.785158    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-85c589fb66-29bwk"]
Jul 18 11:30:06.787020 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:30:06.786990    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbc64546d_b866_4827_84df_9c707306af40.slice/crio-9daf64163ce9420d01385966142df3a776a1195f4a1689287a84d0d6944d98d6 WatchSource:0}: Error finding container 9daf64163ce9420d01385966142df3a776a1195f4a1689287a84d0d6944d98d6: Status 404 returned error can't find the container with id 9daf64163ce9420d01385966142df3a776a1195f4a1689287a84d0d6944d98d6
Jul 18 11:30:06.824944 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:30:06.824882    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-b98bf4979-vxqlr"
Jul 18 11:30:06.943205 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:30:06.943161    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-85c589fb66-29bwk" event={"ID":"bc64546d-b866-4827-84df-9c707306af40","Type":"ContainerStarted","Data":"9daf64163ce9420d01385966142df3a776a1195f4a1689287a84d0d6944d98d6"}
Jul 18 11:30:06.988660 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:30:06.988635    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-b98bf4979-vxqlr"]
Jul 18 11:30:06.990349 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:30:06.990319    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod74fb912a_3946_4fca_ae6b_be2264132ca8.slice/crio-81293bd75d6b64cb7ff334ea8f102f00926f3e122b70a14659c9ecac4e971407 WatchSource:0}: Error finding container 81293bd75d6b64cb7ff334ea8f102f00926f3e122b70a14659c9ecac4e971407: Status 404 returned error can't find the container with id 81293bd75d6b64cb7ff334ea8f102f00926f3e122b70a14659c9ecac4e971407
Jul 18 11:30:07.954383 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:30:07.954342    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-b98bf4979-vxqlr" event={"ID":"74fb912a-3946-4fca-ae6b-be2264132ca8","Type":"ContainerStarted","Data":"81293bd75d6b64cb7ff334ea8f102f00926f3e122b70a14659c9ecac4e971407"}
Jul 18 11:30:09.966182 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:30:09.966148    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-85c589fb66-29bwk" event={"ID":"bc64546d-b866-4827-84df-9c707306af40","Type":"ContainerStarted","Data":"d004cab1611d7e628527dac4f01830b4cd7ce00a378a4c4799fa9ee0351c9b4b"}
Jul 18 11:30:09.966646 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:30:09.966211    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-85c589fb66-29bwk"
Jul 18 11:30:09.967735 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:30:09.967709    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-b98bf4979-vxqlr" event={"ID":"74fb912a-3946-4fca-ae6b-be2264132ca8","Type":"ContainerStarted","Data":"2621d0b4cdfc7ab9eac86fa2fef87a8e7e9a75c529e54bb026f1b032f3362cbc"}
Jul 18 11:30:09.967853 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:30:09.967756    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-b98bf4979-vxqlr"
Jul 18 11:30:09.984339 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:30:09.984281    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-85c589fb66-29bwk" podStartSLOduration=2.242281825 podStartE2EDuration="4.984261112s" totalImagesPullingTime="2.741979287s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 11:30:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 11:30:09.983907676 +0000 UTC m=+629.598943982" watchObservedRunningTime="2026-07-18 11:30:09.984261112 +0000 UTC m=+629.599297418"
Jul 18 11:30:09.999220 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:30:09.999168    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-b98bf4979-vxqlr" podStartSLOduration=2.466677051 podStartE2EDuration="4.99914942s" totalImagesPullingTime="2.532472369s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 11:30:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 11:30:09.998392685 +0000 UTC m=+629.613428987" watchObservedRunningTime="2026-07-18 11:30:09.99914942 +0000 UTC m=+629.614185722"
Jul 18 11:30:20.975324 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:30:20.975294    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-85c589fb66-29bwk"
Jul 18 11:30:20.975711 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:30:20.975363    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-b98bf4979-vxqlr"
Jul 18 11:30:21.035206 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:30:21.035171    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-85c589fb66-29bwk"]
Jul 18 11:30:21.035439 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:30:21.035410    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-85c589fb66-29bwk" podUID="bc64546d-b866-4827-84df-9c707306af40" containerName="manager" containerID="cri-o://d004cab1611d7e628527dac4f01830b4cd7ce00a378a4c4799fa9ee0351c9b4b" gracePeriod=30
Jul 18 11:30:21.289352 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:30:21.289324    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-85c589fb66-29bwk"
Jul 18 11:30:21.474426 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:30:21.474391    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4d7zf\" (UniqueName: \"kubernetes.io/projected/bc64546d-b866-4827-84df-9c707306af40-kube-api-access-4d7zf\") pod \"bc64546d-b866-4827-84df-9c707306af40\" (UID: \"bc64546d-b866-4827-84df-9c707306af40\") "
Jul 18 11:30:21.474605 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:30:21.474474    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/bc64546d-b866-4827-84df-9c707306af40-webhook-cert\") pod \"bc64546d-b866-4827-84df-9c707306af40\" (UID: \"bc64546d-b866-4827-84df-9c707306af40\") "
Jul 18 11:30:21.476787 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:30:21.476755    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bc64546d-b866-4827-84df-9c707306af40-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "bc64546d-b866-4827-84df-9c707306af40" (UID: "bc64546d-b866-4827-84df-9c707306af40"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 18 11:30:21.476931 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:30:21.476765    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bc64546d-b866-4827-84df-9c707306af40-kube-api-access-4d7zf" (OuterVolumeSpecName: "kube-api-access-4d7zf") pod "bc64546d-b866-4827-84df-9c707306af40" (UID: "bc64546d-b866-4827-84df-9c707306af40"). InnerVolumeSpecName "kube-api-access-4d7zf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 18 11:30:21.576107 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:30:21.576008    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4d7zf\" (UniqueName: \"kubernetes.io/projected/bc64546d-b866-4827-84df-9c707306af40-kube-api-access-4d7zf\") on node \"ip-10-0-133-122.ec2.internal\" DevicePath \"\""
Jul 18 11:30:21.576107 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:30:21.576045    2579 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/bc64546d-b866-4827-84df-9c707306af40-webhook-cert\") on node \"ip-10-0-133-122.ec2.internal\" DevicePath \"\""
Jul 18 11:30:22.029940 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:30:22.029880    2579 generic.go:356] "Generic (PLEG): container finished" podID="bc64546d-b866-4827-84df-9c707306af40" containerID="d004cab1611d7e628527dac4f01830b4cd7ce00a378a4c4799fa9ee0351c9b4b" exitCode=0
Jul 18 11:30:22.030318 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:30:22.029956    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-85c589fb66-29bwk"
Jul 18 11:30:22.030318 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:30:22.029982    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-85c589fb66-29bwk" event={"ID":"bc64546d-b866-4827-84df-9c707306af40","Type":"ContainerDied","Data":"d004cab1611d7e628527dac4f01830b4cd7ce00a378a4c4799fa9ee0351c9b4b"}
Jul 18 11:30:22.030318 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:30:22.030047    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-85c589fb66-29bwk" event={"ID":"bc64546d-b866-4827-84df-9c707306af40","Type":"ContainerDied","Data":"9daf64163ce9420d01385966142df3a776a1195f4a1689287a84d0d6944d98d6"}
Jul 18 11:30:22.030318 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:30:22.030079    2579 scope.go:117] "RemoveContainer" containerID="d004cab1611d7e628527dac4f01830b4cd7ce00a378a4c4799fa9ee0351c9b4b"
Jul 18 11:30:22.039463 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:30:22.039285    2579 scope.go:117] "RemoveContainer" containerID="d004cab1611d7e628527dac4f01830b4cd7ce00a378a4c4799fa9ee0351c9b4b"
Jul 18 11:30:22.039592 ip-10-0-133-122 kubenswrapper[2579]: E0718 11:30:22.039570    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d004cab1611d7e628527dac4f01830b4cd7ce00a378a4c4799fa9ee0351c9b4b\": container with ID starting with d004cab1611d7e628527dac4f01830b4cd7ce00a378a4c4799fa9ee0351c9b4b not found: ID does not exist" containerID="d004cab1611d7e628527dac4f01830b4cd7ce00a378a4c4799fa9ee0351c9b4b"
Jul 18 11:30:22.039650 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:30:22.039606    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d004cab1611d7e628527dac4f01830b4cd7ce00a378a4c4799fa9ee0351c9b4b"} err="failed to get container status \"d004cab1611d7e628527dac4f01830b4cd7ce00a378a4c4799fa9ee0351c9b4b\": rpc error: code = NotFound desc = could not find container \"d004cab1611d7e628527dac4f01830b4cd7ce00a378a4c4799fa9ee0351c9b4b\": container with ID starting with d004cab1611d7e628527dac4f01830b4cd7ce00a378a4c4799fa9ee0351c9b4b not found: ID does not exist"
Jul 18 11:30:22.050366 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:30:22.050332    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-85c589fb66-29bwk"]
Jul 18 11:30:22.054317 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:30:22.054291    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-85c589fb66-29bwk"]
Jul 18 11:30:22.894937 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:30:22.894904    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bc64546d-b866-4827-84df-9c707306af40" path="/var/lib/kubelet/pods/bc64546d-b866-4827-84df-9c707306af40/volumes"
Jul 18 11:30:44.066336 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:30:44.066301    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-c9b7d9585-dfsk8"]
Jul 18 11:30:44.066727 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:30:44.066680    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bc64546d-b866-4827-84df-9c707306af40" containerName="manager"
Jul 18 11:30:44.066727 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:30:44.066692    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="bc64546d-b866-4827-84df-9c707306af40" containerName="manager"
Jul 18 11:30:44.066806 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:30:44.066754    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="bc64546d-b866-4827-84df-9c707306af40" containerName="manager"
Jul 18 11:30:44.072103 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:30:44.072087    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-c9b7d9585-dfsk8"
Jul 18 11:30:44.075290 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:30:44.075259    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-qwdvw\""
Jul 18 11:30:44.075549 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:30:44.075530    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Jul 18 11:30:44.085918 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:30:44.085865    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-c9b7d9585-dfsk8"]
Jul 18 11:30:44.172044 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:30:44.172009    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/dac0d1f3-4b8f-440c-aca3-6f9cc02fd1b8-openshift-service-ca\") pod \"maas-api-c9b7d9585-dfsk8\" (UID: \"dac0d1f3-4b8f-440c-aca3-6f9cc02fd1b8\") " pod="odh-ai-gateway-infra/maas-api-c9b7d9585-dfsk8"
Jul 18 11:30:44.172224 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:30:44.172065    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/dac0d1f3-4b8f-440c-aca3-6f9cc02fd1b8-maas-api-tls\") pod \"maas-api-c9b7d9585-dfsk8\" (UID: \"dac0d1f3-4b8f-440c-aca3-6f9cc02fd1b8\") " pod="odh-ai-gateway-infra/maas-api-c9b7d9585-dfsk8"
Jul 18 11:30:44.172224 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:30:44.172096    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fskcp\" (UniqueName: \"kubernetes.io/projected/dac0d1f3-4b8f-440c-aca3-6f9cc02fd1b8-kube-api-access-fskcp\") pod \"maas-api-c9b7d9585-dfsk8\" (UID: \"dac0d1f3-4b8f-440c-aca3-6f9cc02fd1b8\") " pod="odh-ai-gateway-infra/maas-api-c9b7d9585-dfsk8"
Jul 18 11:30:44.273401 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:30:44.273372    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/dac0d1f3-4b8f-440c-aca3-6f9cc02fd1b8-openshift-service-ca\") pod \"maas-api-c9b7d9585-dfsk8\" (UID: \"dac0d1f3-4b8f-440c-aca3-6f9cc02fd1b8\") " pod="odh-ai-gateway-infra/maas-api-c9b7d9585-dfsk8"
Jul 18 11:30:44.273582 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:30:44.273422    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/dac0d1f3-4b8f-440c-aca3-6f9cc02fd1b8-maas-api-tls\") pod \"maas-api-c9b7d9585-dfsk8\" (UID: \"dac0d1f3-4b8f-440c-aca3-6f9cc02fd1b8\") " pod="odh-ai-gateway-infra/maas-api-c9b7d9585-dfsk8"
Jul 18 11:30:44.273582 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:30:44.273453    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fskcp\" (UniqueName: \"kubernetes.io/projected/dac0d1f3-4b8f-440c-aca3-6f9cc02fd1b8-kube-api-access-fskcp\") pod \"maas-api-c9b7d9585-dfsk8\" (UID: \"dac0d1f3-4b8f-440c-aca3-6f9cc02fd1b8\") " pod="odh-ai-gateway-infra/maas-api-c9b7d9585-dfsk8"
Jul 18 11:30:44.273661 ip-10-0-133-122 kubenswrapper[2579]: E0718 11:30:44.273581    2579 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-serving-cert: secret "maas-api-serving-cert" not found
Jul 18 11:30:44.273661 ip-10-0-133-122 kubenswrapper[2579]: E0718 11:30:44.273655    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dac0d1f3-4b8f-440c-aca3-6f9cc02fd1b8-maas-api-tls podName:dac0d1f3-4b8f-440c-aca3-6f9cc02fd1b8 nodeName:}" failed. No retries permitted until 2026-07-18 11:30:44.773637174 +0000 UTC m=+664.388673455 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/dac0d1f3-4b8f-440c-aca3-6f9cc02fd1b8-maas-api-tls") pod "maas-api-c9b7d9585-dfsk8" (UID: "dac0d1f3-4b8f-440c-aca3-6f9cc02fd1b8") : secret "maas-api-serving-cert" not found
Jul 18 11:30:44.274028 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:30:44.274008    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/dac0d1f3-4b8f-440c-aca3-6f9cc02fd1b8-openshift-service-ca\") pod \"maas-api-c9b7d9585-dfsk8\" (UID: \"dac0d1f3-4b8f-440c-aca3-6f9cc02fd1b8\") " pod="odh-ai-gateway-infra/maas-api-c9b7d9585-dfsk8"
Jul 18 11:30:44.285731 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:30:44.285705    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fskcp\" (UniqueName: \"kubernetes.io/projected/dac0d1f3-4b8f-440c-aca3-6f9cc02fd1b8-kube-api-access-fskcp\") pod \"maas-api-c9b7d9585-dfsk8\" (UID: \"dac0d1f3-4b8f-440c-aca3-6f9cc02fd1b8\") " pod="odh-ai-gateway-infra/maas-api-c9b7d9585-dfsk8"
Jul 18 11:30:44.777668 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:30:44.777636    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/dac0d1f3-4b8f-440c-aca3-6f9cc02fd1b8-maas-api-tls\") pod \"maas-api-c9b7d9585-dfsk8\" (UID: \"dac0d1f3-4b8f-440c-aca3-6f9cc02fd1b8\") " pod="odh-ai-gateway-infra/maas-api-c9b7d9585-dfsk8"
Jul 18 11:30:44.780143 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:30:44.780116    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/dac0d1f3-4b8f-440c-aca3-6f9cc02fd1b8-maas-api-tls\") pod \"maas-api-c9b7d9585-dfsk8\" (UID: \"dac0d1f3-4b8f-440c-aca3-6f9cc02fd1b8\") " pod="odh-ai-gateway-infra/maas-api-c9b7d9585-dfsk8"
Jul 18 11:30:44.983443 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:30:44.983403    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-c9b7d9585-dfsk8"
Jul 18 11:30:45.128166 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:30:45.128135    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-c9b7d9585-dfsk8"]
Jul 18 11:30:45.130191 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:30:45.130163    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddac0d1f3_4b8f_440c_aca3_6f9cc02fd1b8.slice/crio-f7da4ecbb50f0eac9878ea369514587110b3fe510c5b40b46061629f75db22c3 WatchSource:0}: Error finding container f7da4ecbb50f0eac9878ea369514587110b3fe510c5b40b46061629f75db22c3: Status 404 returned error can't find the container with id f7da4ecbb50f0eac9878ea369514587110b3fe510c5b40b46061629f75db22c3
Jul 18 11:30:45.152092 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:30:45.152063    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-c9b7d9585-dfsk8" event={"ID":"dac0d1f3-4b8f-440c-aca3-6f9cc02fd1b8","Type":"ContainerStarted","Data":"f7da4ecbb50f0eac9878ea369514587110b3fe510c5b40b46061629f75db22c3"}
Jul 18 11:30:47.163480 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:30:47.163444    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-c9b7d9585-dfsk8" event={"ID":"dac0d1f3-4b8f-440c-aca3-6f9cc02fd1b8","Type":"ContainerStarted","Data":"6b323d2dbab8b76204e3f0b62a67412916022ae79d5e984c9ec487876fe7b587"}
Jul 18 11:30:47.163866 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:30:47.163508    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-c9b7d9585-dfsk8"
Jul 18 11:30:47.179500 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:30:47.179449    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-c9b7d9585-dfsk8" podStartSLOduration=1.8871237870000002 podStartE2EDuration="3.179434416s" totalImagesPullingTime="1.292310629s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 11:30:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 11:30:47.178504073 +0000 UTC m=+666.793540375" watchObservedRunningTime="2026-07-18 11:30:47.179434416 +0000 UTC m=+666.794470717"
Jul 18 11:30:53.174368 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:30:53.174338    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-c9b7d9585-dfsk8"
Jul 18 11:31:07.425853 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:31:07.425818    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-wptft"]
Jul 18 11:31:07.429606 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:31:07.429582    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-wptft"
Jul 18 11:31:07.431915 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:31:07.431864    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 18 11:31:07.432038 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:31:07.431877    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-ft9rj\""
Jul 18 11:31:07.432935 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:31:07.432910    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\""
Jul 18 11:31:07.433032 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:31:07.432918    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 18 11:31:07.438688 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:31:07.438661    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-wptft"]
Jul 18 11:31:07.584324 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:31:07.584278    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/41f1408a-25d0-4d54-b07e-db50e046aba7-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-wptft\" (UID: \"41f1408a-25d0-4d54-b07e-db50e046aba7\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-wptft"
Jul 18 11:31:07.584324 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:31:07.584320    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/41f1408a-25d0-4d54-b07e-db50e046aba7-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-wptft\" (UID: \"41f1408a-25d0-4d54-b07e-db50e046aba7\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-wptft"
Jul 18 11:31:07.584532 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:31:07.584343    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/41f1408a-25d0-4d54-b07e-db50e046aba7-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-wptft\" (UID: \"41f1408a-25d0-4d54-b07e-db50e046aba7\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-wptft"
Jul 18 11:31:07.584532 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:31:07.584377    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/41f1408a-25d0-4d54-b07e-db50e046aba7-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-wptft\" (UID: \"41f1408a-25d0-4d54-b07e-db50e046aba7\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-wptft"
Jul 18 11:31:07.584532 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:31:07.584453    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8hhnc\" (UniqueName: \"kubernetes.io/projected/41f1408a-25d0-4d54-b07e-db50e046aba7-kube-api-access-8hhnc\") pod \"e2e-distinct-simulated-kserve-59975d69f9-wptft\" (UID: \"41f1408a-25d0-4d54-b07e-db50e046aba7\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-wptft"
Jul 18 11:31:07.584532 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:31:07.584474    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/41f1408a-25d0-4d54-b07e-db50e046aba7-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-wptft\" (UID: \"41f1408a-25d0-4d54-b07e-db50e046aba7\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-wptft"
Jul 18 11:31:07.686038 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:31:07.685944    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8hhnc\" (UniqueName: \"kubernetes.io/projected/41f1408a-25d0-4d54-b07e-db50e046aba7-kube-api-access-8hhnc\") pod \"e2e-distinct-simulated-kserve-59975d69f9-wptft\" (UID: \"41f1408a-25d0-4d54-b07e-db50e046aba7\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-wptft"
Jul 18 11:31:07.686038 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:31:07.685984    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/41f1408a-25d0-4d54-b07e-db50e046aba7-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-wptft\" (UID: \"41f1408a-25d0-4d54-b07e-db50e046aba7\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-wptft"
Jul 18 11:31:07.686279 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:31:07.686053    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/41f1408a-25d0-4d54-b07e-db50e046aba7-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-wptft\" (UID: \"41f1408a-25d0-4d54-b07e-db50e046aba7\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-wptft"
Jul 18 11:31:07.686279 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:31:07.686073    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/41f1408a-25d0-4d54-b07e-db50e046aba7-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-wptft\" (UID: \"41f1408a-25d0-4d54-b07e-db50e046aba7\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-wptft"
Jul 18 11:31:07.686279 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:31:07.686097    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/41f1408a-25d0-4d54-b07e-db50e046aba7-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-wptft\" (UID: \"41f1408a-25d0-4d54-b07e-db50e046aba7\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-wptft"
Jul 18 11:31:07.686279 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:31:07.686174    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/41f1408a-25d0-4d54-b07e-db50e046aba7-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-wptft\" (UID: \"41f1408a-25d0-4d54-b07e-db50e046aba7\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-wptft"
Jul 18 11:31:07.686483 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:31:07.686468    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/41f1408a-25d0-4d54-b07e-db50e046aba7-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-wptft\" (UID: \"41f1408a-25d0-4d54-b07e-db50e046aba7\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-wptft"
Jul 18 11:31:07.686543 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:31:07.686526    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/41f1408a-25d0-4d54-b07e-db50e046aba7-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-wptft\" (UID: \"41f1408a-25d0-4d54-b07e-db50e046aba7\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-wptft"
Jul 18 11:31:07.686627 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:31:07.686609    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/41f1408a-25d0-4d54-b07e-db50e046aba7-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-wptft\" (UID: \"41f1408a-25d0-4d54-b07e-db50e046aba7\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-wptft"
Jul 18 11:31:07.688434 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:31:07.688413    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/41f1408a-25d0-4d54-b07e-db50e046aba7-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-wptft\" (UID: \"41f1408a-25d0-4d54-b07e-db50e046aba7\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-wptft"
Jul 18 11:31:07.688690 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:31:07.688674    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/41f1408a-25d0-4d54-b07e-db50e046aba7-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-wptft\" (UID: \"41f1408a-25d0-4d54-b07e-db50e046aba7\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-wptft"
Jul 18 11:31:07.693843 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:31:07.693818    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8hhnc\" (UniqueName: \"kubernetes.io/projected/41f1408a-25d0-4d54-b07e-db50e046aba7-kube-api-access-8hhnc\") pod \"e2e-distinct-simulated-kserve-59975d69f9-wptft\" (UID: \"41f1408a-25d0-4d54-b07e-db50e046aba7\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-wptft"
Jul 18 11:31:07.740610 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:31:07.740568    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-wptft"
Jul 18 11:31:07.883522 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:31:07.883494    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-wptft"]
Jul 18 11:31:07.885376 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:31:07.885349    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod41f1408a_25d0_4d54_b07e_db50e046aba7.slice/crio-1c2496851f4366a4dba93d5cd0351a2350b8bc82122d30c9e32cacf1d921a70c WatchSource:0}: Error finding container 1c2496851f4366a4dba93d5cd0351a2350b8bc82122d30c9e32cacf1d921a70c: Status 404 returned error can't find the container with id 1c2496851f4366a4dba93d5cd0351a2350b8bc82122d30c9e32cacf1d921a70c
Jul 18 11:31:08.268342 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:31:08.268296    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-wptft" event={"ID":"41f1408a-25d0-4d54-b07e-db50e046aba7","Type":"ContainerStarted","Data":"1c2496851f4366a4dba93d5cd0351a2350b8bc82122d30c9e32cacf1d921a70c"}
Jul 18 11:31:09.275476 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:31:09.275367    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-wptft" event={"ID":"41f1408a-25d0-4d54-b07e-db50e046aba7","Type":"ContainerStarted","Data":"5709823722d2ff66e58226e5b7abd20366a988c62f400a4a2f29de62eec455cb"}
Jul 18 11:31:09.299430 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:31:09.299362    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-wptft" podStartSLOduration=1.223986933 podStartE2EDuration="2.299342705s" totalImagesPullingTime="1.075355772s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 11:31:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 11:31:09.297380238 +0000 UTC m=+688.912416553" watchObservedRunningTime="2026-07-18 11:31:09.299342705 +0000 UTC m=+688.914379008"
Jul 18 11:31:17.741036 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:31:17.740991    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-wptft"
Jul 18 11:31:17.741508 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:31:17.741056    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-wptft"
Jul 18 11:31:17.753535 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:31:17.753505    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-wptft"
Jul 18 11:31:18.333299 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:31:18.333269    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-wptft"
Jul 18 11:31:21.727336 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:31:21.727301    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f5rj8f"]
Jul 18 11:31:21.732763 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:31:21.732736    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f5rj8f"
Jul 18 11:31:21.734955 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:31:21.734932    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\""
Jul 18 11:31:21.738169 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:31:21.738146    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f5rj8f"]
Jul 18 11:31:21.811525 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:31:21.811496    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bd776893-4c58-4515-aa7b-f0210d9dfe35-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f5rj8f\" (UID: \"bd776893-4c58-4515-aa7b-f0210d9dfe35\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f5rj8f"
Jul 18 11:31:21.811697 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:31:21.811548    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-655bw\" (UniqueName: \"kubernetes.io/projected/bd776893-4c58-4515-aa7b-f0210d9dfe35-kube-api-access-655bw\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f5rj8f\" (UID: \"bd776893-4c58-4515-aa7b-f0210d9dfe35\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f5rj8f"
Jul 18 11:31:21.811697 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:31:21.811608    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bd776893-4c58-4515-aa7b-f0210d9dfe35-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f5rj8f\" (UID: \"bd776893-4c58-4515-aa7b-f0210d9dfe35\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f5rj8f"
Jul 18 11:31:21.811697 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:31:21.811684    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bd776893-4c58-4515-aa7b-f0210d9dfe35-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f5rj8f\" (UID: \"bd776893-4c58-4515-aa7b-f0210d9dfe35\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f5rj8f"
Jul 18 11:31:21.811858 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:31:21.811753    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bd776893-4c58-4515-aa7b-f0210d9dfe35-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f5rj8f\" (UID: \"bd776893-4c58-4515-aa7b-f0210d9dfe35\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f5rj8f"
Jul 18 11:31:21.811858 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:31:21.811789    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bd776893-4c58-4515-aa7b-f0210d9dfe35-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f5rj8f\" (UID: \"bd776893-4c58-4515-aa7b-f0210d9dfe35\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f5rj8f"
Jul 18 11:31:21.913262 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:31:21.913228    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-655bw\" (UniqueName: \"kubernetes.io/projected/bd776893-4c58-4515-aa7b-f0210d9dfe35-kube-api-access-655bw\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f5rj8f\" (UID: \"bd776893-4c58-4515-aa7b-f0210d9dfe35\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f5rj8f"
Jul 18 11:31:21.913262 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:31:21.913264    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bd776893-4c58-4515-aa7b-f0210d9dfe35-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f5rj8f\" (UID: \"bd776893-4c58-4515-aa7b-f0210d9dfe35\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f5rj8f"
Jul 18 11:31:21.913508 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:31:21.913302    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bd776893-4c58-4515-aa7b-f0210d9dfe35-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f5rj8f\" (UID: \"bd776893-4c58-4515-aa7b-f0210d9dfe35\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f5rj8f"
Jul 18 11:31:21.913508 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:31:21.913336    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bd776893-4c58-4515-aa7b-f0210d9dfe35-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f5rj8f\" (UID: \"bd776893-4c58-4515-aa7b-f0210d9dfe35\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f5rj8f"
Jul 18 11:31:21.913508 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:31:21.913364    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bd776893-4c58-4515-aa7b-f0210d9dfe35-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f5rj8f\" (UID: \"bd776893-4c58-4515-aa7b-f0210d9dfe35\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f5rj8f"
Jul 18 11:31:21.913508 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:31:21.913459    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bd776893-4c58-4515-aa7b-f0210d9dfe35-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f5rj8f\" (UID: \"bd776893-4c58-4515-aa7b-f0210d9dfe35\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f5rj8f"
Jul 18 11:31:21.913744 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:31:21.913721    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bd776893-4c58-4515-aa7b-f0210d9dfe35-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f5rj8f\" (UID: \"bd776893-4c58-4515-aa7b-f0210d9dfe35\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f5rj8f"
Jul 18 11:31:21.913797 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:31:21.913748    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bd776893-4c58-4515-aa7b-f0210d9dfe35-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f5rj8f\" (UID: \"bd776893-4c58-4515-aa7b-f0210d9dfe35\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f5rj8f"
Jul 18 11:31:21.913797 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:31:21.913772    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bd776893-4c58-4515-aa7b-f0210d9dfe35-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f5rj8f\" (UID: \"bd776893-4c58-4515-aa7b-f0210d9dfe35\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f5rj8f"
Jul 18 11:31:21.915654 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:31:21.915636    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bd776893-4c58-4515-aa7b-f0210d9dfe35-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f5rj8f\" (UID: \"bd776893-4c58-4515-aa7b-f0210d9dfe35\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f5rj8f"
Jul 18 11:31:21.915765 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:31:21.915745    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bd776893-4c58-4515-aa7b-f0210d9dfe35-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f5rj8f\" (UID: \"bd776893-4c58-4515-aa7b-f0210d9dfe35\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f5rj8f"
Jul 18 11:31:21.920378 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:31:21.920356    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-655bw\" (UniqueName: \"kubernetes.io/projected/bd776893-4c58-4515-aa7b-f0210d9dfe35-kube-api-access-655bw\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f5rj8f\" (UID: \"bd776893-4c58-4515-aa7b-f0210d9dfe35\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f5rj8f"
Jul 18 11:31:22.043420 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:31:22.043332    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f5rj8f"
Jul 18 11:31:22.175838 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:31:22.175812    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f5rj8f"]
Jul 18 11:31:22.177768 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:31:22.177739    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbd776893_4c58_4515_aa7b_f0210d9dfe35.slice/crio-e391b597379b3ad8be9ffb7d0fb536b850def9a7e1438b18e65e1b5eca4e2c0d WatchSource:0}: Error finding container e391b597379b3ad8be9ffb7d0fb536b850def9a7e1438b18e65e1b5eca4e2c0d: Status 404 returned error can't find the container with id e391b597379b3ad8be9ffb7d0fb536b850def9a7e1438b18e65e1b5eca4e2c0d
Jul 18 11:31:22.343937 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:31:22.343813    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f5rj8f" event={"ID":"bd776893-4c58-4515-aa7b-f0210d9dfe35","Type":"ContainerStarted","Data":"e391b597379b3ad8be9ffb7d0fb536b850def9a7e1438b18e65e1b5eca4e2c0d"}
Jul 18 11:31:23.352695 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:31:23.352655    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f5rj8f" event={"ID":"bd776893-4c58-4515-aa7b-f0210d9dfe35","Type":"ContainerStarted","Data":"24c242050dcaad8988a64523e9306820945806bd2a490edecc0e39170fef8913"}
Jul 18 11:31:23.371854 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:31:23.371799    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f5rj8f" podStartSLOduration=2.20198479 podStartE2EDuration="2.371784178s" totalImagesPullingTime="169.799388ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 11:31:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 11:31:23.370492121 +0000 UTC m=+702.985528424" watchObservedRunningTime="2026-07-18 11:31:23.371784178 +0000 UTC m=+702.986820510"
Jul 18 11:31:32.043937 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:31:32.043876    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f5rj8f"
Jul 18 11:31:32.044322 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:31:32.043987    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f5rj8f"
Jul 18 11:31:32.057128 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:31:32.057091    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f5rj8f"
Jul 18 11:31:32.410049 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:31:32.410021    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f5rj8f"
Jul 18 11:32:53.135814 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:32:53.135774    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5f684d9d5b-mtt84"]
Jul 18 11:32:53.136562 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:32:53.136051    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-5f684d9d5b-mtt84" podUID="c73d64d6-ae99-4782-94ed-54fb6aa76e81" containerName="authorino" containerID="cri-o://6d4aa1b96d28856f74daf55df14cd6a6065b8e4d905a2e3b21dc10f517ca12cf" gracePeriod=30
Jul 18 11:32:53.394272 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:32:53.394216    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5f684d9d5b-mtt84"
Jul 18 11:32:53.440773 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:32:53.440737    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/c73d64d6-ae99-4782-94ed-54fb6aa76e81-tls-cert\") pod \"c73d64d6-ae99-4782-94ed-54fb6aa76e81\" (UID: \"c73d64d6-ae99-4782-94ed-54fb6aa76e81\") "
Jul 18 11:32:53.440773 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:32:53.440779    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gxlqv\" (UniqueName: \"kubernetes.io/projected/c73d64d6-ae99-4782-94ed-54fb6aa76e81-kube-api-access-gxlqv\") pod \"c73d64d6-ae99-4782-94ed-54fb6aa76e81\" (UID: \"c73d64d6-ae99-4782-94ed-54fb6aa76e81\") "
Jul 18 11:32:53.442920 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:32:53.442868    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c73d64d6-ae99-4782-94ed-54fb6aa76e81-kube-api-access-gxlqv" (OuterVolumeSpecName: "kube-api-access-gxlqv") pod "c73d64d6-ae99-4782-94ed-54fb6aa76e81" (UID: "c73d64d6-ae99-4782-94ed-54fb6aa76e81"). InnerVolumeSpecName "kube-api-access-gxlqv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 18 11:32:53.453441 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:32:53.453411    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c73d64d6-ae99-4782-94ed-54fb6aa76e81-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "c73d64d6-ae99-4782-94ed-54fb6aa76e81" (UID: "c73d64d6-ae99-4782-94ed-54fb6aa76e81"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 18 11:32:53.541826 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:32:53.541788    2579 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/c73d64d6-ae99-4782-94ed-54fb6aa76e81-tls-cert\") on node \"ip-10-0-133-122.ec2.internal\" DevicePath \"\""
Jul 18 11:32:53.541826 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:32:53.541819    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gxlqv\" (UniqueName: \"kubernetes.io/projected/c73d64d6-ae99-4782-94ed-54fb6aa76e81-kube-api-access-gxlqv\") on node \"ip-10-0-133-122.ec2.internal\" DevicePath \"\""
Jul 18 11:32:53.807979 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:32:53.807855    2579 generic.go:356] "Generic (PLEG): container finished" podID="c73d64d6-ae99-4782-94ed-54fb6aa76e81" containerID="6d4aa1b96d28856f74daf55df14cd6a6065b8e4d905a2e3b21dc10f517ca12cf" exitCode=0
Jul 18 11:32:53.807979 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:32:53.807904    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5f684d9d5b-mtt84"
Jul 18 11:32:53.807979 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:32:53.807949    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5f684d9d5b-mtt84" event={"ID":"c73d64d6-ae99-4782-94ed-54fb6aa76e81","Type":"ContainerDied","Data":"6d4aa1b96d28856f74daf55df14cd6a6065b8e4d905a2e3b21dc10f517ca12cf"}
Jul 18 11:32:53.808197 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:32:53.807994    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5f684d9d5b-mtt84" event={"ID":"c73d64d6-ae99-4782-94ed-54fb6aa76e81","Type":"ContainerDied","Data":"975548ed72076c66b2f3a4a277752ccf18e1c342747ba6a9439e5c8ec88aed90"}
Jul 18 11:32:53.808197 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:32:53.808015    2579 scope.go:117] "RemoveContainer" containerID="6d4aa1b96d28856f74daf55df14cd6a6065b8e4d905a2e3b21dc10f517ca12cf"
Jul 18 11:32:53.817924 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:32:53.817868    2579 scope.go:117] "RemoveContainer" containerID="6d4aa1b96d28856f74daf55df14cd6a6065b8e4d905a2e3b21dc10f517ca12cf"
Jul 18 11:32:53.818434 ip-10-0-133-122 kubenswrapper[2579]: E0718 11:32:53.818364    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6d4aa1b96d28856f74daf55df14cd6a6065b8e4d905a2e3b21dc10f517ca12cf\": container with ID starting with 6d4aa1b96d28856f74daf55df14cd6a6065b8e4d905a2e3b21dc10f517ca12cf not found: ID does not exist" containerID="6d4aa1b96d28856f74daf55df14cd6a6065b8e4d905a2e3b21dc10f517ca12cf"
Jul 18 11:32:53.818434 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:32:53.818400    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6d4aa1b96d28856f74daf55df14cd6a6065b8e4d905a2e3b21dc10f517ca12cf"} err="failed to get container status \"6d4aa1b96d28856f74daf55df14cd6a6065b8e4d905a2e3b21dc10f517ca12cf\": rpc error: code = NotFound desc = could not find container \"6d4aa1b96d28856f74daf55df14cd6a6065b8e4d905a2e3b21dc10f517ca12cf\": container with ID starting with 6d4aa1b96d28856f74daf55df14cd6a6065b8e4d905a2e3b21dc10f517ca12cf not found: ID does not exist"
Jul 18 11:32:53.828690 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:32:53.828666    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5f684d9d5b-mtt84"]
Jul 18 11:32:53.832419 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:32:53.832398    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5f684d9d5b-mtt84"]
Jul 18 11:32:54.893999 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:32:54.893963    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c73d64d6-ae99-4782-94ed-54fb6aa76e81" path="/var/lib/kubelet/pods/c73d64d6-ae99-4782-94ed-54fb6aa76e81/volumes"
Jul 18 11:33:38.953071 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:33:38.953040    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-b98bf4979-vxqlr"]
Jul 18 11:33:38.953593 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:33:38.953208    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-b98bf4979-vxqlr" podUID="74fb912a-3946-4fca-ae6b-be2264132ca8" containerName="manager" containerID="cri-o://2621d0b4cdfc7ab9eac86fa2fef87a8e7e9a75c529e54bb026f1b032f3362cbc" gracePeriod=30
Jul 18 11:33:39.210868 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:33:39.210802    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-b98bf4979-vxqlr"
Jul 18 11:33:39.252294 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:33:39.252265    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/74fb912a-3946-4fca-ae6b-be2264132ca8-webhook-cert\") pod \"74fb912a-3946-4fca-ae6b-be2264132ca8\" (UID: \"74fb912a-3946-4fca-ae6b-be2264132ca8\") "
Jul 18 11:33:39.252467 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:33:39.252355    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lrlkh\" (UniqueName: \"kubernetes.io/projected/74fb912a-3946-4fca-ae6b-be2264132ca8-kube-api-access-lrlkh\") pod \"74fb912a-3946-4fca-ae6b-be2264132ca8\" (UID: \"74fb912a-3946-4fca-ae6b-be2264132ca8\") "
Jul 18 11:33:39.254438 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:33:39.254404    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/74fb912a-3946-4fca-ae6b-be2264132ca8-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "74fb912a-3946-4fca-ae6b-be2264132ca8" (UID: "74fb912a-3946-4fca-ae6b-be2264132ca8"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 18 11:33:39.254647 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:33:39.254619    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/74fb912a-3946-4fca-ae6b-be2264132ca8-kube-api-access-lrlkh" (OuterVolumeSpecName: "kube-api-access-lrlkh") pod "74fb912a-3946-4fca-ae6b-be2264132ca8" (UID: "74fb912a-3946-4fca-ae6b-be2264132ca8"). InnerVolumeSpecName "kube-api-access-lrlkh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 18 11:33:39.353391 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:33:39.353357    2579 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/74fb912a-3946-4fca-ae6b-be2264132ca8-webhook-cert\") on node \"ip-10-0-133-122.ec2.internal\" DevicePath \"\""
Jul 18 11:33:39.353391 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:33:39.353387    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lrlkh\" (UniqueName: \"kubernetes.io/projected/74fb912a-3946-4fca-ae6b-be2264132ca8-kube-api-access-lrlkh\") on node \"ip-10-0-133-122.ec2.internal\" DevicePath \"\""
Jul 18 11:33:40.035679 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:33:40.035643    2579 generic.go:356] "Generic (PLEG): container finished" podID="74fb912a-3946-4fca-ae6b-be2264132ca8" containerID="2621d0b4cdfc7ab9eac86fa2fef87a8e7e9a75c529e54bb026f1b032f3362cbc" exitCode=0
Jul 18 11:33:40.036210 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:33:40.035696    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-b98bf4979-vxqlr"
Jul 18 11:33:40.036210 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:33:40.035725    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-b98bf4979-vxqlr" event={"ID":"74fb912a-3946-4fca-ae6b-be2264132ca8","Type":"ContainerDied","Data":"2621d0b4cdfc7ab9eac86fa2fef87a8e7e9a75c529e54bb026f1b032f3362cbc"}
Jul 18 11:33:40.036210 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:33:40.035774    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-b98bf4979-vxqlr" event={"ID":"74fb912a-3946-4fca-ae6b-be2264132ca8","Type":"ContainerDied","Data":"81293bd75d6b64cb7ff334ea8f102f00926f3e122b70a14659c9ecac4e971407"}
Jul 18 11:33:40.036210 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:33:40.035796    2579 scope.go:117] "RemoveContainer" containerID="2621d0b4cdfc7ab9eac86fa2fef87a8e7e9a75c529e54bb026f1b032f3362cbc"
Jul 18 11:33:40.045233 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:33:40.045217    2579 scope.go:117] "RemoveContainer" containerID="2621d0b4cdfc7ab9eac86fa2fef87a8e7e9a75c529e54bb026f1b032f3362cbc"
Jul 18 11:33:40.045481 ip-10-0-133-122 kubenswrapper[2579]: E0718 11:33:40.045461    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2621d0b4cdfc7ab9eac86fa2fef87a8e7e9a75c529e54bb026f1b032f3362cbc\": container with ID starting with 2621d0b4cdfc7ab9eac86fa2fef87a8e7e9a75c529e54bb026f1b032f3362cbc not found: ID does not exist" containerID="2621d0b4cdfc7ab9eac86fa2fef87a8e7e9a75c529e54bb026f1b032f3362cbc"
Jul 18 11:33:40.045519 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:33:40.045490    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2621d0b4cdfc7ab9eac86fa2fef87a8e7e9a75c529e54bb026f1b032f3362cbc"} err="failed to get container status \"2621d0b4cdfc7ab9eac86fa2fef87a8e7e9a75c529e54bb026f1b032f3362cbc\": rpc error: code = NotFound desc = could not find container \"2621d0b4cdfc7ab9eac86fa2fef87a8e7e9a75c529e54bb026f1b032f3362cbc\": container with ID starting with 2621d0b4cdfc7ab9eac86fa2fef87a8e7e9a75c529e54bb026f1b032f3362cbc not found: ID does not exist"
Jul 18 11:33:40.057881 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:33:40.057859    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-b98bf4979-vxqlr"]
Jul 18 11:33:40.063482 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:33:40.063459    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-b98bf4979-vxqlr"]
Jul 18 11:33:40.895793 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:33:40.895758    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="74fb912a-3946-4fca-ae6b-be2264132ca8" path="/var/lib/kubelet/pods/74fb912a-3946-4fca-ae6b-be2264132ca8/volumes"
Jul 18 11:34:40.897550 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:34:40.897481    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-b98bf4979-nqgrp"]
Jul 18 11:34:40.898099 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:34:40.898009    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c73d64d6-ae99-4782-94ed-54fb6aa76e81" containerName="authorino"
Jul 18 11:34:40.898099 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:34:40.898029    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="c73d64d6-ae99-4782-94ed-54fb6aa76e81" containerName="authorino"
Jul 18 11:34:40.898099 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:34:40.898048    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="74fb912a-3946-4fca-ae6b-be2264132ca8" containerName="manager"
Jul 18 11:34:40.898099 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:34:40.898056    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="74fb912a-3946-4fca-ae6b-be2264132ca8" containerName="manager"
Jul 18 11:34:40.898380 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:34:40.898178    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="74fb912a-3946-4fca-ae6b-be2264132ca8" containerName="manager"
Jul 18 11:34:40.898380 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:34:40.898195    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="c73d64d6-ae99-4782-94ed-54fb6aa76e81" containerName="authorino"
Jul 18 11:34:40.901461 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:34:40.901444    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-b98bf4979-nqgrp"
Jul 18 11:34:40.903874 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:34:40.903854    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 18 11:34:40.904866 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:34:40.904843    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 18 11:34:40.904990 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:34:40.904903    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-f2fjs\""
Jul 18 11:34:40.905581 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:34:40.905563    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-jfpn7_759a894c-1828-4ac9-a7c3-77354a104247/console-operator/2.log"
Jul 18 11:34:40.905672 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:34:40.905602    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-jfpn7_759a894c-1828-4ac9-a7c3-77354a104247/console-operator/2.log"
Jul 18 11:34:40.912306 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:34:40.912286    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-b98bf4979-nqgrp"]
Jul 18 11:34:40.912523 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:34:40.912406    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-58jnn_40e8e19c-87b3-4cd6-81c1-0f404971a282/ovn-acl-logging/0.log"
Jul 18 11:34:40.913045 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:34:40.913028    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-58jnn_40e8e19c-87b3-4cd6-81c1-0f404971a282/ovn-acl-logging/0.log"
Jul 18 11:34:40.992396 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:34:40.992371    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/81221f87-ce60-4ffd-ba95-aead441483b3-webhook-cert\") pod \"maas-controller-b98bf4979-nqgrp\" (UID: \"81221f87-ce60-4ffd-ba95-aead441483b3\") " pod="opendatahub/maas-controller-b98bf4979-nqgrp"
Jul 18 11:34:40.992524 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:34:40.992412    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4hgct\" (UniqueName: \"kubernetes.io/projected/81221f87-ce60-4ffd-ba95-aead441483b3-kube-api-access-4hgct\") pod \"maas-controller-b98bf4979-nqgrp\" (UID: \"81221f87-ce60-4ffd-ba95-aead441483b3\") " pod="opendatahub/maas-controller-b98bf4979-nqgrp"
Jul 18 11:34:41.093069 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:34:41.093040    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4hgct\" (UniqueName: \"kubernetes.io/projected/81221f87-ce60-4ffd-ba95-aead441483b3-kube-api-access-4hgct\") pod \"maas-controller-b98bf4979-nqgrp\" (UID: \"81221f87-ce60-4ffd-ba95-aead441483b3\") " pod="opendatahub/maas-controller-b98bf4979-nqgrp"
Jul 18 11:34:41.093226 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:34:41.093127    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/81221f87-ce60-4ffd-ba95-aead441483b3-webhook-cert\") pod \"maas-controller-b98bf4979-nqgrp\" (UID: \"81221f87-ce60-4ffd-ba95-aead441483b3\") " pod="opendatahub/maas-controller-b98bf4979-nqgrp"
Jul 18 11:34:41.095450 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:34:41.095429    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/81221f87-ce60-4ffd-ba95-aead441483b3-webhook-cert\") pod \"maas-controller-b98bf4979-nqgrp\" (UID: \"81221f87-ce60-4ffd-ba95-aead441483b3\") " pod="opendatahub/maas-controller-b98bf4979-nqgrp"
Jul 18 11:34:41.100672 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:34:41.100648    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4hgct\" (UniqueName: \"kubernetes.io/projected/81221f87-ce60-4ffd-ba95-aead441483b3-kube-api-access-4hgct\") pod \"maas-controller-b98bf4979-nqgrp\" (UID: \"81221f87-ce60-4ffd-ba95-aead441483b3\") " pod="opendatahub/maas-controller-b98bf4979-nqgrp"
Jul 18 11:34:41.232131 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:34:41.232037    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-b98bf4979-nqgrp"
Jul 18 11:34:41.364712 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:34:41.364663    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-b98bf4979-nqgrp"]
Jul 18 11:34:41.366969 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:34:41.366945    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod81221f87_ce60_4ffd_ba95_aead441483b3.slice/crio-008e51016f560644f166ebff69b0308a73efa9f5b8bf2e783e5feef64a165b7a WatchSource:0}: Error finding container 008e51016f560644f166ebff69b0308a73efa9f5b8bf2e783e5feef64a165b7a: Status 404 returned error can't find the container with id 008e51016f560644f166ebff69b0308a73efa9f5b8bf2e783e5feef64a165b7a
Jul 18 11:34:41.368236 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:34:41.368220    2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 18 11:34:42.343926 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:34:42.343877    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-b98bf4979-nqgrp" event={"ID":"81221f87-ce60-4ffd-ba95-aead441483b3","Type":"ContainerStarted","Data":"dbc8d29e11e469cc810dc5adfb485c5ce04208c61349bad967462ee6fb7b2791"}
Jul 18 11:34:42.344345 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:34:42.343983    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-b98bf4979-nqgrp" event={"ID":"81221f87-ce60-4ffd-ba95-aead441483b3","Type":"ContainerStarted","Data":"008e51016f560644f166ebff69b0308a73efa9f5b8bf2e783e5feef64a165b7a"}
Jul 18 11:34:42.344345 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:34:42.344015    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-b98bf4979-nqgrp"
Jul 18 11:34:42.361271 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:34:42.361225    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-b98bf4979-nqgrp" podStartSLOduration=1.969118555 podStartE2EDuration="2.361209357s" totalImagesPullingTime="392.090802ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 11:34:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 11:34:42.359194248 +0000 UTC m=+901.974230552" watchObservedRunningTime="2026-07-18 11:34:42.361209357 +0000 UTC m=+901.976245658"
Jul 18 11:34:53.350649 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:34:53.350618    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-b98bf4979-nqgrp"
Jul 18 11:34:58.016536 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:34:58.016500    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-b98bf4979-nqgrp"]
Jul 18 11:34:58.017016 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:34:58.016686    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-b98bf4979-nqgrp" podUID="81221f87-ce60-4ffd-ba95-aead441483b3" containerName="manager" containerID="cri-o://dbc8d29e11e469cc810dc5adfb485c5ce04208c61349bad967462ee6fb7b2791" gracePeriod=30
Jul 18 11:34:58.273773 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:34:58.273707    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-b98bf4979-nqgrp"
Jul 18 11:34:58.355302 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:34:58.355267    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4hgct\" (UniqueName: \"kubernetes.io/projected/81221f87-ce60-4ffd-ba95-aead441483b3-kube-api-access-4hgct\") pod \"81221f87-ce60-4ffd-ba95-aead441483b3\" (UID: \"81221f87-ce60-4ffd-ba95-aead441483b3\") "
Jul 18 11:34:58.355478 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:34:58.355309    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/81221f87-ce60-4ffd-ba95-aead441483b3-webhook-cert\") pod \"81221f87-ce60-4ffd-ba95-aead441483b3\" (UID: \"81221f87-ce60-4ffd-ba95-aead441483b3\") "
Jul 18 11:34:58.357412 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:34:58.357376    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/81221f87-ce60-4ffd-ba95-aead441483b3-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "81221f87-ce60-4ffd-ba95-aead441483b3" (UID: "81221f87-ce60-4ffd-ba95-aead441483b3"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 18 11:34:58.357527 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:34:58.357447    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/81221f87-ce60-4ffd-ba95-aead441483b3-kube-api-access-4hgct" (OuterVolumeSpecName: "kube-api-access-4hgct") pod "81221f87-ce60-4ffd-ba95-aead441483b3" (UID: "81221f87-ce60-4ffd-ba95-aead441483b3"). InnerVolumeSpecName "kube-api-access-4hgct". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 18 11:34:58.422655 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:34:58.422616    2579 generic.go:356] "Generic (PLEG): container finished" podID="81221f87-ce60-4ffd-ba95-aead441483b3" containerID="dbc8d29e11e469cc810dc5adfb485c5ce04208c61349bad967462ee6fb7b2791" exitCode=0
Jul 18 11:34:58.422857 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:34:58.422673    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-b98bf4979-nqgrp"
Jul 18 11:34:58.422857 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:34:58.422702    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-b98bf4979-nqgrp" event={"ID":"81221f87-ce60-4ffd-ba95-aead441483b3","Type":"ContainerDied","Data":"dbc8d29e11e469cc810dc5adfb485c5ce04208c61349bad967462ee6fb7b2791"}
Jul 18 11:34:58.422857 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:34:58.422766    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-b98bf4979-nqgrp" event={"ID":"81221f87-ce60-4ffd-ba95-aead441483b3","Type":"ContainerDied","Data":"008e51016f560644f166ebff69b0308a73efa9f5b8bf2e783e5feef64a165b7a"}
Jul 18 11:34:58.422857 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:34:58.422804    2579 scope.go:117] "RemoveContainer" containerID="dbc8d29e11e469cc810dc5adfb485c5ce04208c61349bad967462ee6fb7b2791"
Jul 18 11:34:58.431849 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:34:58.431831    2579 scope.go:117] "RemoveContainer" containerID="dbc8d29e11e469cc810dc5adfb485c5ce04208c61349bad967462ee6fb7b2791"
Jul 18 11:34:58.432153 ip-10-0-133-122 kubenswrapper[2579]: E0718 11:34:58.432131    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dbc8d29e11e469cc810dc5adfb485c5ce04208c61349bad967462ee6fb7b2791\": container with ID starting with dbc8d29e11e469cc810dc5adfb485c5ce04208c61349bad967462ee6fb7b2791 not found: ID does not exist" containerID="dbc8d29e11e469cc810dc5adfb485c5ce04208c61349bad967462ee6fb7b2791"
Jul 18 11:34:58.432263 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:34:58.432160    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dbc8d29e11e469cc810dc5adfb485c5ce04208c61349bad967462ee6fb7b2791"} err="failed to get container status \"dbc8d29e11e469cc810dc5adfb485c5ce04208c61349bad967462ee6fb7b2791\": rpc error: code = NotFound desc = could not find container \"dbc8d29e11e469cc810dc5adfb485c5ce04208c61349bad967462ee6fb7b2791\": container with ID starting with dbc8d29e11e469cc810dc5adfb485c5ce04208c61349bad967462ee6fb7b2791 not found: ID does not exist"
Jul 18 11:34:58.446961 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:34:58.446943    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-b98bf4979-nqgrp"]
Jul 18 11:34:58.451386 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:34:58.451366    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-b98bf4979-nqgrp"]
Jul 18 11:34:58.456842 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:34:58.456824    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4hgct\" (UniqueName: \"kubernetes.io/projected/81221f87-ce60-4ffd-ba95-aead441483b3-kube-api-access-4hgct\") on node \"ip-10-0-133-122.ec2.internal\" DevicePath \"\""
Jul 18 11:34:58.456914 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:34:58.456846    2579 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/81221f87-ce60-4ffd-ba95-aead441483b3-webhook-cert\") on node \"ip-10-0-133-122.ec2.internal\" DevicePath \"\""
Jul 18 11:34:58.894160 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:34:58.894128    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="81221f87-ce60-4ffd-ba95-aead441483b3" path="/var/lib/kubelet/pods/81221f87-ce60-4ffd-ba95-aead441483b3/volumes"
Jul 18 11:34:59.286585 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:34:59.286498    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-b98bf4979-vp7dc"]
Jul 18 11:34:59.286984 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:34:59.286963    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="81221f87-ce60-4ffd-ba95-aead441483b3" containerName="manager"
Jul 18 11:34:59.286984 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:34:59.286978    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="81221f87-ce60-4ffd-ba95-aead441483b3" containerName="manager"
Jul 18 11:34:59.287104 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:34:59.287042    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="81221f87-ce60-4ffd-ba95-aead441483b3" containerName="manager"
Jul 18 11:34:59.293338 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:34:59.293305    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-b98bf4979-vp7dc"
Jul 18 11:34:59.297584 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:34:59.297555    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 18 11:34:59.297742 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:34:59.297633    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-f2fjs\""
Jul 18 11:34:59.297742 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:34:59.297555    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 18 11:34:59.300311 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:34:59.300285    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-b98bf4979-vp7dc"]
Jul 18 11:34:59.365408 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:34:59.365374    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8edc7039-0a69-4921-a1a1-a3d67a9df116-webhook-cert\") pod \"maas-controller-b98bf4979-vp7dc\" (UID: \"8edc7039-0a69-4921-a1a1-a3d67a9df116\") " pod="opendatahub/maas-controller-b98bf4979-vp7dc"
Jul 18 11:34:59.365581 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:34:59.365437    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bpw5q\" (UniqueName: \"kubernetes.io/projected/8edc7039-0a69-4921-a1a1-a3d67a9df116-kube-api-access-bpw5q\") pod \"maas-controller-b98bf4979-vp7dc\" (UID: \"8edc7039-0a69-4921-a1a1-a3d67a9df116\") " pod="opendatahub/maas-controller-b98bf4979-vp7dc"
Jul 18 11:34:59.465909 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:34:59.465847    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8edc7039-0a69-4921-a1a1-a3d67a9df116-webhook-cert\") pod \"maas-controller-b98bf4979-vp7dc\" (UID: \"8edc7039-0a69-4921-a1a1-a3d67a9df116\") " pod="opendatahub/maas-controller-b98bf4979-vp7dc"
Jul 18 11:34:59.466086 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:34:59.465984    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bpw5q\" (UniqueName: \"kubernetes.io/projected/8edc7039-0a69-4921-a1a1-a3d67a9df116-kube-api-access-bpw5q\") pod \"maas-controller-b98bf4979-vp7dc\" (UID: \"8edc7039-0a69-4921-a1a1-a3d67a9df116\") " pod="opendatahub/maas-controller-b98bf4979-vp7dc"
Jul 18 11:34:59.468311 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:34:59.468282    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8edc7039-0a69-4921-a1a1-a3d67a9df116-webhook-cert\") pod \"maas-controller-b98bf4979-vp7dc\" (UID: \"8edc7039-0a69-4921-a1a1-a3d67a9df116\") " pod="opendatahub/maas-controller-b98bf4979-vp7dc"
Jul 18 11:34:59.473678 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:34:59.473656    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bpw5q\" (UniqueName: \"kubernetes.io/projected/8edc7039-0a69-4921-a1a1-a3d67a9df116-kube-api-access-bpw5q\") pod \"maas-controller-b98bf4979-vp7dc\" (UID: \"8edc7039-0a69-4921-a1a1-a3d67a9df116\") " pod="opendatahub/maas-controller-b98bf4979-vp7dc"
Jul 18 11:34:59.606396 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:34:59.606369    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-b98bf4979-vp7dc"
Jul 18 11:34:59.744595 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:34:59.744562    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-b98bf4979-vp7dc"]
Jul 18 11:34:59.748037 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:34:59.748007    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8edc7039_0a69_4921_a1a1_a3d67a9df116.slice/crio-eb9304d323dc3a8095765af92e3a5ea33cc247d9d7347559d99eb2f7f2ed17b9 WatchSource:0}: Error finding container eb9304d323dc3a8095765af92e3a5ea33cc247d9d7347559d99eb2f7f2ed17b9: Status 404 returned error can't find the container with id eb9304d323dc3a8095765af92e3a5ea33cc247d9d7347559d99eb2f7f2ed17b9
Jul 18 11:35:00.434839 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:35:00.434804    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-b98bf4979-vp7dc" event={"ID":"8edc7039-0a69-4921-a1a1-a3d67a9df116","Type":"ContainerStarted","Data":"dd6079a0a71315af92cb6858e80891818b391e2ae60fea5b6f69eb37519efb7a"}
Jul 18 11:35:00.435261 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:35:00.434855    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-b98bf4979-vp7dc" event={"ID":"8edc7039-0a69-4921-a1a1-a3d67a9df116","Type":"ContainerStarted","Data":"eb9304d323dc3a8095765af92e3a5ea33cc247d9d7347559d99eb2f7f2ed17b9"}
Jul 18 11:35:00.435261 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:35:00.434930    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-b98bf4979-vp7dc"
Jul 18 11:35:00.451763 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:35:00.451699    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-b98bf4979-vp7dc" podStartSLOduration=1.126359893 podStartE2EDuration="1.451682878s" totalImagesPullingTime="325.322985ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 11:34:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 11:35:00.449374635 +0000 UTC m=+920.064410936" watchObservedRunningTime="2026-07-18 11:35:00.451682878 +0000 UTC m=+920.066719180"
Jul 18 11:35:11.442502 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:35:11.442474    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-b98bf4979-vp7dc"
Jul 18 11:39:40.943222 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:39:40.943147    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-jfpn7_759a894c-1828-4ac9-a7c3-77354a104247/console-operator/2.log"
Jul 18 11:39:40.945170 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:39:40.945146    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-jfpn7_759a894c-1828-4ac9-a7c3-77354a104247/console-operator/2.log"
Jul 18 11:39:40.949382 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:39:40.949226    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-58jnn_40e8e19c-87b3-4cd6-81c1-0f404971a282/ovn-acl-logging/0.log"
Jul 18 11:39:40.951170 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:39:40.951149    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-58jnn_40e8e19c-87b3-4cd6-81c1-0f404971a282/ovn-acl-logging/0.log"
Jul 18 11:39:47.884868 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:39:47.884826    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-q8ks6"]
Jul 18 11:39:47.885373 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:39:47.885110    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-q8ks6" podUID="fc79b155-d739-4736-805f-9498bab0cda5" containerName="manager" containerID="cri-o://1c935ec9955389b332704b536eb469f0c4cd5387f68bb1af7d4913422a6fe171" gracePeriod=10
Jul 18 11:39:50.885100 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:39:50.885064    2579 generic.go:356] "Generic (PLEG): container finished" podID="fc79b155-d739-4736-805f-9498bab0cda5" containerID="1c935ec9955389b332704b536eb469f0c4cd5387f68bb1af7d4913422a6fe171" exitCode=0
Jul 18 11:39:50.885501 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:39:50.885141    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-q8ks6" event={"ID":"fc79b155-d739-4736-805f-9498bab0cda5","Type":"ContainerDied","Data":"1c935ec9955389b332704b536eb469f0c4cd5387f68bb1af7d4913422a6fe171"}
Jul 18 11:39:51.140051 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:39:51.139981    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-q8ks6"
Jul 18 11:39:51.328063 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:39:51.328026    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7vbxc\" (UniqueName: \"kubernetes.io/projected/fc79b155-d739-4736-805f-9498bab0cda5-kube-api-access-7vbxc\") pod \"fc79b155-d739-4736-805f-9498bab0cda5\" (UID: \"fc79b155-d739-4736-805f-9498bab0cda5\") "
Jul 18 11:39:51.328233 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:39:51.328079    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/fc79b155-d739-4736-805f-9498bab0cda5-extensions-socket-volume\") pod \"fc79b155-d739-4736-805f-9498bab0cda5\" (UID: \"fc79b155-d739-4736-805f-9498bab0cda5\") "
Jul 18 11:39:51.328560 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:39:51.328530    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fc79b155-d739-4736-805f-9498bab0cda5-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "fc79b155-d739-4736-805f-9498bab0cda5" (UID: "fc79b155-d739-4736-805f-9498bab0cda5"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 11:39:51.330262 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:39:51.330241    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fc79b155-d739-4736-805f-9498bab0cda5-kube-api-access-7vbxc" (OuterVolumeSpecName: "kube-api-access-7vbxc") pod "fc79b155-d739-4736-805f-9498bab0cda5" (UID: "fc79b155-d739-4736-805f-9498bab0cda5"). InnerVolumeSpecName "kube-api-access-7vbxc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 18 11:39:51.429589 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:39:51.429502    2579 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/fc79b155-d739-4736-805f-9498bab0cda5-extensions-socket-volume\") on node \"ip-10-0-133-122.ec2.internal\" DevicePath \"\""
Jul 18 11:39:51.429589 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:39:51.429532    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7vbxc\" (UniqueName: \"kubernetes.io/projected/fc79b155-d739-4736-805f-9498bab0cda5-kube-api-access-7vbxc\") on node \"ip-10-0-133-122.ec2.internal\" DevicePath \"\""
Jul 18 11:39:51.891065 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:39:51.891035    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-q8ks6"
Jul 18 11:39:51.891065 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:39:51.891058    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-q8ks6" event={"ID":"fc79b155-d739-4736-805f-9498bab0cda5","Type":"ContainerDied","Data":"00db9a4dacbc84cb2575c9ca3b4b7130ff2cb78e2ee2d181b49d99787381aa1e"}
Jul 18 11:39:51.891552 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:39:51.891114    2579 scope.go:117] "RemoveContainer" containerID="1c935ec9955389b332704b536eb469f0c4cd5387f68bb1af7d4913422a6fe171"
Jul 18 11:39:51.913085 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:39:51.913045    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-q8ks6"]
Jul 18 11:39:51.916156 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:39:51.916130    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-q8ks6"]
Jul 18 11:39:52.894482 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:39:52.894437    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fc79b155-d739-4736-805f-9498bab0cda5" path="/var/lib/kubelet/pods/fc79b155-d739-4736-805f-9498bab0cda5/volumes"
Jul 18 11:40:49.087194 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:40:49.087156    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xxwh9"]
Jul 18 11:40:49.087602 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:40:49.087549    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fc79b155-d739-4736-805f-9498bab0cda5" containerName="manager"
Jul 18 11:40:49.087602 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:40:49.087560    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="fc79b155-d739-4736-805f-9498bab0cda5" containerName="manager"
Jul 18 11:40:49.087673 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:40:49.087626    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="fc79b155-d739-4736-805f-9498bab0cda5" containerName="manager"
Jul 18 11:40:49.091078 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:40:49.091057    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xxwh9"
Jul 18 11:40:49.093419 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:40:49.093395    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-6g7qj\""
Jul 18 11:40:49.104415 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:40:49.104388    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xxwh9"]
Jul 18 11:40:49.141671 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:40:49.141628    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mhn62\" (UniqueName: \"kubernetes.io/projected/135abbdc-a94a-45c3-a6ac-fe5fd28156be-kube-api-access-mhn62\") pod \"kuadrant-operator-controller-manager-86878c769f-xxwh9\" (UID: \"135abbdc-a94a-45c3-a6ac-fe5fd28156be\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xxwh9"
Jul 18 11:40:49.141832 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:40:49.141684    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/135abbdc-a94a-45c3-a6ac-fe5fd28156be-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-xxwh9\" (UID: \"135abbdc-a94a-45c3-a6ac-fe5fd28156be\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xxwh9"
Jul 18 11:40:49.243167 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:40:49.243121    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mhn62\" (UniqueName: \"kubernetes.io/projected/135abbdc-a94a-45c3-a6ac-fe5fd28156be-kube-api-access-mhn62\") pod \"kuadrant-operator-controller-manager-86878c769f-xxwh9\" (UID: \"135abbdc-a94a-45c3-a6ac-fe5fd28156be\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xxwh9"
Jul 18 11:40:49.243167 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:40:49.243173    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/135abbdc-a94a-45c3-a6ac-fe5fd28156be-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-xxwh9\" (UID: \"135abbdc-a94a-45c3-a6ac-fe5fd28156be\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xxwh9"
Jul 18 11:40:49.243604 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:40:49.243582    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/135abbdc-a94a-45c3-a6ac-fe5fd28156be-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-xxwh9\" (UID: \"135abbdc-a94a-45c3-a6ac-fe5fd28156be\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xxwh9"
Jul 18 11:40:49.252156 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:40:49.252118    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mhn62\" (UniqueName: \"kubernetes.io/projected/135abbdc-a94a-45c3-a6ac-fe5fd28156be-kube-api-access-mhn62\") pod \"kuadrant-operator-controller-manager-86878c769f-xxwh9\" (UID: \"135abbdc-a94a-45c3-a6ac-fe5fd28156be\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xxwh9"
Jul 18 11:40:49.401080 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:40:49.401042    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xxwh9"
Jul 18 11:40:49.539116 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:40:49.539090    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xxwh9"]
Jul 18 11:40:49.541395 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:40:49.541369    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod135abbdc_a94a_45c3_a6ac_fe5fd28156be.slice/crio-0fd4ac1f10b597a1015cd1f8ebe675f6a7da43072f09b03fc452a59a45c58fad WatchSource:0}: Error finding container 0fd4ac1f10b597a1015cd1f8ebe675f6a7da43072f09b03fc452a59a45c58fad: Status 404 returned error can't find the container with id 0fd4ac1f10b597a1015cd1f8ebe675f6a7da43072f09b03fc452a59a45c58fad
Jul 18 11:40:50.184252 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:40:50.184213    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xxwh9" event={"ID":"135abbdc-a94a-45c3-a6ac-fe5fd28156be","Type":"ContainerStarted","Data":"81f3f7f27e4b0efc1f8fee77424f5ac4a614bb56dc210b4a043d1c9301036fd1"}
Jul 18 11:40:50.184683 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:40:50.184272    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xxwh9" event={"ID":"135abbdc-a94a-45c3-a6ac-fe5fd28156be","Type":"ContainerStarted","Data":"0fd4ac1f10b597a1015cd1f8ebe675f6a7da43072f09b03fc452a59a45c58fad"}
Jul 18 11:40:50.184683 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:40:50.184315    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xxwh9"
Jul 18 11:40:50.205963 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:40:50.205908    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xxwh9" podStartSLOduration=1.2058714799999999 podStartE2EDuration="1.20587148s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 11:40:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 11:40:50.202680349 +0000 UTC m=+1269.817716652" watchObservedRunningTime="2026-07-18 11:40:50.20587148 +0000 UTC m=+1269.820907846"
Jul 18 11:41:01.191157 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:41:01.191127    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xxwh9"
Jul 18 11:43:24.150332 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:43:24.150292    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-same-id-a-5626ee40-kserve-54b64d5fc5-pkqsh"]
Jul 18 11:43:24.154326 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:43:24.154304    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-5626ee40-kserve-54b64d5fc5-pkqsh"
Jul 18 11:43:24.157642 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:43:24.157620    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-same-id-a-5626ee40-kserve-self-signed-certs\""
Jul 18 11:43:24.171005 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:43:24.170980    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-a-5626ee40-kserve-54b64d5fc5-pkqsh"]
Jul 18 11:43:24.244652 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:43:24.244623    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bdfaff1b-c351-49ed-8994-eb68fb6cb105-tls-certs\") pod \"e2e-same-id-a-5626ee40-kserve-54b64d5fc5-pkqsh\" (UID: \"bdfaff1b-c351-49ed-8994-eb68fb6cb105\") " pod="llm/e2e-same-id-a-5626ee40-kserve-54b64d5fc5-pkqsh"
Jul 18 11:43:24.244652 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:43:24.244657    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bdfaff1b-c351-49ed-8994-eb68fb6cb105-dshm\") pod \"e2e-same-id-a-5626ee40-kserve-54b64d5fc5-pkqsh\" (UID: \"bdfaff1b-c351-49ed-8994-eb68fb6cb105\") " pod="llm/e2e-same-id-a-5626ee40-kserve-54b64d5fc5-pkqsh"
Jul 18 11:43:24.244926 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:43:24.244678    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bdfaff1b-c351-49ed-8994-eb68fb6cb105-tmp-dir\") pod \"e2e-same-id-a-5626ee40-kserve-54b64d5fc5-pkqsh\" (UID: \"bdfaff1b-c351-49ed-8994-eb68fb6cb105\") " pod="llm/e2e-same-id-a-5626ee40-kserve-54b64d5fc5-pkqsh"
Jul 18 11:43:24.244926 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:43:24.244694    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bdfaff1b-c351-49ed-8994-eb68fb6cb105-home\") pod \"e2e-same-id-a-5626ee40-kserve-54b64d5fc5-pkqsh\" (UID: \"bdfaff1b-c351-49ed-8994-eb68fb6cb105\") " pod="llm/e2e-same-id-a-5626ee40-kserve-54b64d5fc5-pkqsh"
Jul 18 11:43:24.244926 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:43:24.244711    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gl9f6\" (UniqueName: \"kubernetes.io/projected/bdfaff1b-c351-49ed-8994-eb68fb6cb105-kube-api-access-gl9f6\") pod \"e2e-same-id-a-5626ee40-kserve-54b64d5fc5-pkqsh\" (UID: \"bdfaff1b-c351-49ed-8994-eb68fb6cb105\") " pod="llm/e2e-same-id-a-5626ee40-kserve-54b64d5fc5-pkqsh"
Jul 18 11:43:24.244926 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:43:24.244834    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bdfaff1b-c351-49ed-8994-eb68fb6cb105-model-cache\") pod \"e2e-same-id-a-5626ee40-kserve-54b64d5fc5-pkqsh\" (UID: \"bdfaff1b-c351-49ed-8994-eb68fb6cb105\") " pod="llm/e2e-same-id-a-5626ee40-kserve-54b64d5fc5-pkqsh"
Jul 18 11:43:24.345690 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:43:24.345647    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bdfaff1b-c351-49ed-8994-eb68fb6cb105-model-cache\") pod \"e2e-same-id-a-5626ee40-kserve-54b64d5fc5-pkqsh\" (UID: \"bdfaff1b-c351-49ed-8994-eb68fb6cb105\") " pod="llm/e2e-same-id-a-5626ee40-kserve-54b64d5fc5-pkqsh"
Jul 18 11:43:24.345918 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:43:24.345749    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bdfaff1b-c351-49ed-8994-eb68fb6cb105-tls-certs\") pod \"e2e-same-id-a-5626ee40-kserve-54b64d5fc5-pkqsh\" (UID: \"bdfaff1b-c351-49ed-8994-eb68fb6cb105\") " pod="llm/e2e-same-id-a-5626ee40-kserve-54b64d5fc5-pkqsh"
Jul 18 11:43:24.345918 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:43:24.345777    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bdfaff1b-c351-49ed-8994-eb68fb6cb105-dshm\") pod \"e2e-same-id-a-5626ee40-kserve-54b64d5fc5-pkqsh\" (UID: \"bdfaff1b-c351-49ed-8994-eb68fb6cb105\") " pod="llm/e2e-same-id-a-5626ee40-kserve-54b64d5fc5-pkqsh"
Jul 18 11:43:24.345918 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:43:24.345808    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bdfaff1b-c351-49ed-8994-eb68fb6cb105-tmp-dir\") pod \"e2e-same-id-a-5626ee40-kserve-54b64d5fc5-pkqsh\" (UID: \"bdfaff1b-c351-49ed-8994-eb68fb6cb105\") " pod="llm/e2e-same-id-a-5626ee40-kserve-54b64d5fc5-pkqsh"
Jul 18 11:43:24.345918 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:43:24.345831    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bdfaff1b-c351-49ed-8994-eb68fb6cb105-home\") pod \"e2e-same-id-a-5626ee40-kserve-54b64d5fc5-pkqsh\" (UID: \"bdfaff1b-c351-49ed-8994-eb68fb6cb105\") " pod="llm/e2e-same-id-a-5626ee40-kserve-54b64d5fc5-pkqsh"
Jul 18 11:43:24.345918 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:43:24.345852    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gl9f6\" (UniqueName: \"kubernetes.io/projected/bdfaff1b-c351-49ed-8994-eb68fb6cb105-kube-api-access-gl9f6\") pod \"e2e-same-id-a-5626ee40-kserve-54b64d5fc5-pkqsh\" (UID: \"bdfaff1b-c351-49ed-8994-eb68fb6cb105\") " pod="llm/e2e-same-id-a-5626ee40-kserve-54b64d5fc5-pkqsh"
Jul 18 11:43:24.346148 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:43:24.346114    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bdfaff1b-c351-49ed-8994-eb68fb6cb105-model-cache\") pod \"e2e-same-id-a-5626ee40-kserve-54b64d5fc5-pkqsh\" (UID: \"bdfaff1b-c351-49ed-8994-eb68fb6cb105\") " pod="llm/e2e-same-id-a-5626ee40-kserve-54b64d5fc5-pkqsh"
Jul 18 11:43:24.346193 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:43:24.346172    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bdfaff1b-c351-49ed-8994-eb68fb6cb105-tmp-dir\") pod \"e2e-same-id-a-5626ee40-kserve-54b64d5fc5-pkqsh\" (UID: \"bdfaff1b-c351-49ed-8994-eb68fb6cb105\") " pod="llm/e2e-same-id-a-5626ee40-kserve-54b64d5fc5-pkqsh"
Jul 18 11:43:24.346256 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:43:24.346223    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bdfaff1b-c351-49ed-8994-eb68fb6cb105-home\") pod \"e2e-same-id-a-5626ee40-kserve-54b64d5fc5-pkqsh\" (UID: \"bdfaff1b-c351-49ed-8994-eb68fb6cb105\") " pod="llm/e2e-same-id-a-5626ee40-kserve-54b64d5fc5-pkqsh"
Jul 18 11:43:24.347982 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:43:24.347957    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bdfaff1b-c351-49ed-8994-eb68fb6cb105-dshm\") pod \"e2e-same-id-a-5626ee40-kserve-54b64d5fc5-pkqsh\" (UID: \"bdfaff1b-c351-49ed-8994-eb68fb6cb105\") " pod="llm/e2e-same-id-a-5626ee40-kserve-54b64d5fc5-pkqsh"
Jul 18 11:43:24.348237 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:43:24.348221    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bdfaff1b-c351-49ed-8994-eb68fb6cb105-tls-certs\") pod \"e2e-same-id-a-5626ee40-kserve-54b64d5fc5-pkqsh\" (UID: \"bdfaff1b-c351-49ed-8994-eb68fb6cb105\") " pod="llm/e2e-same-id-a-5626ee40-kserve-54b64d5fc5-pkqsh"
Jul 18 11:43:24.354019 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:43:24.353998    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gl9f6\" (UniqueName: \"kubernetes.io/projected/bdfaff1b-c351-49ed-8994-eb68fb6cb105-kube-api-access-gl9f6\") pod \"e2e-same-id-a-5626ee40-kserve-54b64d5fc5-pkqsh\" (UID: \"bdfaff1b-c351-49ed-8994-eb68fb6cb105\") " pod="llm/e2e-same-id-a-5626ee40-kserve-54b64d5fc5-pkqsh"
Jul 18 11:43:24.464022 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:43:24.463939    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-5626ee40-kserve-54b64d5fc5-pkqsh"
Jul 18 11:43:24.606488 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:43:24.606447    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-a-5626ee40-kserve-54b64d5fc5-pkqsh"]
Jul 18 11:43:24.608973 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:43:24.608949    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbdfaff1b_c351_49ed_8994_eb68fb6cb105.slice/crio-44bbb37a0cce22df400ab4949a2a610084edd4a2794ec3fda8c9e37e619d92c4 WatchSource:0}: Error finding container 44bbb37a0cce22df400ab4949a2a610084edd4a2794ec3fda8c9e37e619d92c4: Status 404 returned error can't find the container with id 44bbb37a0cce22df400ab4949a2a610084edd4a2794ec3fda8c9e37e619d92c4
Jul 18 11:43:24.939553 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:43:24.939509    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-5626ee40-kserve-54b64d5fc5-pkqsh" event={"ID":"bdfaff1b-c351-49ed-8994-eb68fb6cb105","Type":"ContainerStarted","Data":"6ad59bcf562202812c55b5d60ef8ed754d7c0f39a81e25fc02cb6090d2036182"}
Jul 18 11:43:24.939771 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:43:24.939563    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-5626ee40-kserve-54b64d5fc5-pkqsh" event={"ID":"bdfaff1b-c351-49ed-8994-eb68fb6cb105","Type":"ContainerStarted","Data":"44bbb37a0cce22df400ab4949a2a610084edd4a2794ec3fda8c9e37e619d92c4"}
Jul 18 11:43:24.959035 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:43:24.958983    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-same-id-a-5626ee40-kserve-54b64d5fc5-pkqsh" podStartSLOduration=0.958966938 podStartE2EDuration="958.966938ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 11:43:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 11:43:24.956614394 +0000 UTC m=+1424.571650698" watchObservedRunningTime="2026-07-18 11:43:24.958966938 +0000 UTC m=+1424.574003249"
Jul 18 11:43:34.464943 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:43:34.464819    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-same-id-a-5626ee40-kserve-54b64d5fc5-pkqsh"
Jul 18 11:43:34.464943 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:43:34.464880    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-same-id-a-5626ee40-kserve-54b64d5fc5-pkqsh"
Jul 18 11:43:34.477478 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:43:34.477454    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-same-id-a-5626ee40-kserve-54b64d5fc5-pkqsh"
Jul 18 11:43:35.006414 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:43:35.006380    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-same-id-a-5626ee40-kserve-54b64d5fc5-pkqsh"
Jul 18 11:44:40.979197 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:44:40.979170    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-jfpn7_759a894c-1828-4ac9-a7c3-77354a104247/console-operator/2.log"
Jul 18 11:44:40.980586 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:44:40.980566    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-jfpn7_759a894c-1828-4ac9-a7c3-77354a104247/console-operator/2.log"
Jul 18 11:44:40.983326 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:44:40.983307    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-58jnn_40e8e19c-87b3-4cd6-81c1-0f404971a282/ovn-acl-logging/0.log"
Jul 18 11:44:40.984338 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:44:40.984322    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-58jnn_40e8e19c-87b3-4cd6-81c1-0f404971a282/ovn-acl-logging/0.log"
Jul 18 11:45:00.137738 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:45:00.137704    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29739585-n8bv4"]
Jul 18 11:45:00.141105 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:45:00.141086    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29739585-n8bv4"
Jul 18 11:45:00.143485 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:45:00.143465    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-99w6p\""
Jul 18 11:45:00.148196 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:45:00.148173    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29739585-n8bv4"]
Jul 18 11:45:00.152288 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:45:00.152268    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29739585-n8bv4"
Jul 18 11:45:00.294948 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:45:00.293801    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podab9d055e_1bb5_4a55_96a6_3597995699c8.slice/crio-6d37d9d58b4d354b9b98c3b3c5c2f11ea92e6bdf3aec9e001eb30e63168e1a7f WatchSource:0}: Error finding container 6d37d9d58b4d354b9b98c3b3c5c2f11ea92e6bdf3aec9e001eb30e63168e1a7f: Status 404 returned error can't find the container with id 6d37d9d58b4d354b9b98c3b3c5c2f11ea92e6bdf3aec9e001eb30e63168e1a7f
Jul 18 11:45:00.298686 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:45:00.298470    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29739585-n8bv4"]
Jul 18 11:45:00.299063 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:45:00.299040    2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 18 11:45:00.416112 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:45:00.416031    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29739585-n8bv4" event={"ID":"ab9d055e-1bb5-4a55-96a6-3597995699c8","Type":"ContainerStarted","Data":"6d37d9d58b4d354b9b98c3b3c5c2f11ea92e6bdf3aec9e001eb30e63168e1a7f"}
Jul 18 11:45:03.432681 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:45:03.432594    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29739585-n8bv4" event={"ID":"ab9d055e-1bb5-4a55-96a6-3597995699c8","Type":"ContainerStarted","Data":"f60431889d9f6fcff645df14c9bc6be68f87fc003950d6ef6f1bbe7ecc968c7b"}
Jul 18 11:45:03.446044 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:45:03.446000    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29739585-n8bv4" podStartSLOduration=0.995914887 podStartE2EDuration="3.445987198s" totalImagesPullingTime="2.450072311s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 11:45:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 11:45:03.445758371 +0000 UTC m=+1523.060794672" watchObservedRunningTime="2026-07-18 11:45:03.445987198 +0000 UTC m=+1523.061023500"
Jul 18 11:45:04.438973 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:45:04.438935    2579 generic.go:356] "Generic (PLEG): container finished" podID="ab9d055e-1bb5-4a55-96a6-3597995699c8" containerID="f60431889d9f6fcff645df14c9bc6be68f87fc003950d6ef6f1bbe7ecc968c7b" exitCode=0
Jul 18 11:45:04.439392 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:45:04.438976    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29739585-n8bv4" event={"ID":"ab9d055e-1bb5-4a55-96a6-3597995699c8","Type":"ContainerDied","Data":"f60431889d9f6fcff645df14c9bc6be68f87fc003950d6ef6f1bbe7ecc968c7b"}
Jul 18 11:45:05.581067 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:45:05.581042    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29739585-n8bv4"
Jul 18 11:45:06.450194 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:45:06.450162    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29739585-n8bv4"
Jul 18 11:45:06.450377 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:45:06.450205    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29739585-n8bv4" event={"ID":"ab9d055e-1bb5-4a55-96a6-3597995699c8","Type":"ContainerDied","Data":"6d37d9d58b4d354b9b98c3b3c5c2f11ea92e6bdf3aec9e001eb30e63168e1a7f"}
Jul 18 11:45:06.450377 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:45:06.450250    2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6d37d9d58b4d354b9b98c3b3c5c2f11ea92e6bdf3aec9e001eb30e63168e1a7f"
Jul 18 11:46:03.430170 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:46:03.430138    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-a-5626ee40-kserve-54b64d5fc5-pkqsh"]
Jul 18 11:46:18.762028 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:46:18.761972    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="llm/e2e-same-id-a-5626ee40-kserve-54b64d5fc5-pkqsh" podUID="bdfaff1b-c351-49ed-8994-eb68fb6cb105" containerName="main" containerID="cri-o://6ad59bcf562202812c55b5d60ef8ed754d7c0f39a81e25fc02cb6090d2036182" gracePeriod=45
Jul 18 11:46:19.017346 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:46:19.017286    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-5626ee40-kserve-54b64d5fc5-pkqsh"
Jul 18 11:46:19.120571 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:46:19.120522    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bdfaff1b-c351-49ed-8994-eb68fb6cb105-tmp-dir\") pod \"bdfaff1b-c351-49ed-8994-eb68fb6cb105\" (UID: \"bdfaff1b-c351-49ed-8994-eb68fb6cb105\") "
Jul 18 11:46:19.120766 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:46:19.120591    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bdfaff1b-c351-49ed-8994-eb68fb6cb105-dshm\") pod \"bdfaff1b-c351-49ed-8994-eb68fb6cb105\" (UID: \"bdfaff1b-c351-49ed-8994-eb68fb6cb105\") "
Jul 18 11:46:19.120766 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:46:19.120633    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bdfaff1b-c351-49ed-8994-eb68fb6cb105-home\") pod \"bdfaff1b-c351-49ed-8994-eb68fb6cb105\" (UID: \"bdfaff1b-c351-49ed-8994-eb68fb6cb105\") "
Jul 18 11:46:19.120766 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:46:19.120673    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gl9f6\" (UniqueName: \"kubernetes.io/projected/bdfaff1b-c351-49ed-8994-eb68fb6cb105-kube-api-access-gl9f6\") pod \"bdfaff1b-c351-49ed-8994-eb68fb6cb105\" (UID: \"bdfaff1b-c351-49ed-8994-eb68fb6cb105\") "
Jul 18 11:46:19.120766 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:46:19.120717    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bdfaff1b-c351-49ed-8994-eb68fb6cb105-tls-certs\") pod \"bdfaff1b-c351-49ed-8994-eb68fb6cb105\" (UID: \"bdfaff1b-c351-49ed-8994-eb68fb6cb105\") "
Jul 18 11:46:19.120766 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:46:19.120757    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bdfaff1b-c351-49ed-8994-eb68fb6cb105-model-cache\") pod \"bdfaff1b-c351-49ed-8994-eb68fb6cb105\" (UID: \"bdfaff1b-c351-49ed-8994-eb68fb6cb105\") "
Jul 18 11:46:19.121089 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:46:19.120819    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bdfaff1b-c351-49ed-8994-eb68fb6cb105-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "bdfaff1b-c351-49ed-8994-eb68fb6cb105" (UID: "bdfaff1b-c351-49ed-8994-eb68fb6cb105"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 11:46:19.121089 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:46:19.120869    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bdfaff1b-c351-49ed-8994-eb68fb6cb105-home" (OuterVolumeSpecName: "home") pod "bdfaff1b-c351-49ed-8994-eb68fb6cb105" (UID: "bdfaff1b-c351-49ed-8994-eb68fb6cb105"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 11:46:19.121089 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:46:19.121080    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bdfaff1b-c351-49ed-8994-eb68fb6cb105-model-cache" (OuterVolumeSpecName: "model-cache") pod "bdfaff1b-c351-49ed-8994-eb68fb6cb105" (UID: "bdfaff1b-c351-49ed-8994-eb68fb6cb105"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 11:46:19.121240 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:46:19.121109    2579 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bdfaff1b-c351-49ed-8994-eb68fb6cb105-tmp-dir\") on node \"ip-10-0-133-122.ec2.internal\" DevicePath \"\""
Jul 18 11:46:19.121240 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:46:19.121134    2579 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bdfaff1b-c351-49ed-8994-eb68fb6cb105-home\") on node \"ip-10-0-133-122.ec2.internal\" DevicePath \"\""
Jul 18 11:46:19.122966 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:46:19.122937    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bdfaff1b-c351-49ed-8994-eb68fb6cb105-dshm" (OuterVolumeSpecName: "dshm") pod "bdfaff1b-c351-49ed-8994-eb68fb6cb105" (UID: "bdfaff1b-c351-49ed-8994-eb68fb6cb105"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 11:46:19.123084 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:46:19.122991    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bdfaff1b-c351-49ed-8994-eb68fb6cb105-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "bdfaff1b-c351-49ed-8994-eb68fb6cb105" (UID: "bdfaff1b-c351-49ed-8994-eb68fb6cb105"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 18 11:46:19.123151 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:46:19.123127    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bdfaff1b-c351-49ed-8994-eb68fb6cb105-kube-api-access-gl9f6" (OuterVolumeSpecName: "kube-api-access-gl9f6") pod "bdfaff1b-c351-49ed-8994-eb68fb6cb105" (UID: "bdfaff1b-c351-49ed-8994-eb68fb6cb105"). InnerVolumeSpecName "kube-api-access-gl9f6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 18 11:46:19.221605 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:46:19.221569    2579 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bdfaff1b-c351-49ed-8994-eb68fb6cb105-tls-certs\") on node \"ip-10-0-133-122.ec2.internal\" DevicePath \"\""
Jul 18 11:46:19.221605 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:46:19.221598    2579 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bdfaff1b-c351-49ed-8994-eb68fb6cb105-model-cache\") on node \"ip-10-0-133-122.ec2.internal\" DevicePath \"\""
Jul 18 11:46:19.221605 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:46:19.221606    2579 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bdfaff1b-c351-49ed-8994-eb68fb6cb105-dshm\") on node \"ip-10-0-133-122.ec2.internal\" DevicePath \"\""
Jul 18 11:46:19.221605 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:46:19.221614    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gl9f6\" (UniqueName: \"kubernetes.io/projected/bdfaff1b-c351-49ed-8994-eb68fb6cb105-kube-api-access-gl9f6\") on node \"ip-10-0-133-122.ec2.internal\" DevicePath \"\""
Jul 18 11:46:19.824672 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:46:19.824629    2579 generic.go:356] "Generic (PLEG): container finished" podID="bdfaff1b-c351-49ed-8994-eb68fb6cb105" containerID="6ad59bcf562202812c55b5d60ef8ed754d7c0f39a81e25fc02cb6090d2036182" exitCode=0
Jul 18 11:46:19.824672 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:46:19.824672    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-5626ee40-kserve-54b64d5fc5-pkqsh"
Jul 18 11:46:19.825252 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:46:19.824718    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-5626ee40-kserve-54b64d5fc5-pkqsh" event={"ID":"bdfaff1b-c351-49ed-8994-eb68fb6cb105","Type":"ContainerDied","Data":"6ad59bcf562202812c55b5d60ef8ed754d7c0f39a81e25fc02cb6090d2036182"}
Jul 18 11:46:19.825252 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:46:19.824771    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-5626ee40-kserve-54b64d5fc5-pkqsh" event={"ID":"bdfaff1b-c351-49ed-8994-eb68fb6cb105","Type":"ContainerDied","Data":"44bbb37a0cce22df400ab4949a2a610084edd4a2794ec3fda8c9e37e619d92c4"}
Jul 18 11:46:19.825252 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:46:19.824798    2579 scope.go:117] "RemoveContainer" containerID="6ad59bcf562202812c55b5d60ef8ed754d7c0f39a81e25fc02cb6090d2036182"
Jul 18 11:46:19.834973 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:46:19.834948    2579 scope.go:117] "RemoveContainer" containerID="6ad59bcf562202812c55b5d60ef8ed754d7c0f39a81e25fc02cb6090d2036182"
Jul 18 11:46:19.835246 ip-10-0-133-122 kubenswrapper[2579]: E0718 11:46:19.835226    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6ad59bcf562202812c55b5d60ef8ed754d7c0f39a81e25fc02cb6090d2036182\": container with ID starting with 6ad59bcf562202812c55b5d60ef8ed754d7c0f39a81e25fc02cb6090d2036182 not found: ID does not exist" containerID="6ad59bcf562202812c55b5d60ef8ed754d7c0f39a81e25fc02cb6090d2036182"
Jul 18 11:46:19.835316 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:46:19.835251    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6ad59bcf562202812c55b5d60ef8ed754d7c0f39a81e25fc02cb6090d2036182"} err="failed to get container status \"6ad59bcf562202812c55b5d60ef8ed754d7c0f39a81e25fc02cb6090d2036182\": rpc error: code = NotFound desc = could not find container \"6ad59bcf562202812c55b5d60ef8ed754d7c0f39a81e25fc02cb6090d2036182\": container with ID starting with 6ad59bcf562202812c55b5d60ef8ed754d7c0f39a81e25fc02cb6090d2036182 not found: ID does not exist"
Jul 18 11:46:19.845701 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:46:19.845665    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-a-5626ee40-kserve-54b64d5fc5-pkqsh"]
Jul 18 11:46:19.849373 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:46:19.849340    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["llm/e2e-same-id-a-5626ee40-kserve-54b64d5fc5-pkqsh"]
Jul 18 11:46:20.895717 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:46:20.895680    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bdfaff1b-c351-49ed-8994-eb68fb6cb105" path="/var/lib/kubelet/pods/bdfaff1b-c351-49ed-8994-eb68fb6cb105/volumes"
Jul 18 11:49:26.969881 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:49:26.969831    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-97de021e-86cbffc457-fbzsv"]
Jul 18 11:49:26.970518 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:49:26.970321    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bdfaff1b-c351-49ed-8994-eb68fb6cb105" containerName="main"
Jul 18 11:49:26.970518 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:49:26.970336    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="bdfaff1b-c351-49ed-8994-eb68fb6cb105" containerName="main"
Jul 18 11:49:26.970518 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:49:26.970349    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ab9d055e-1bb5-4a55-96a6-3597995699c8" containerName="cleanup"
Jul 18 11:49:26.970518 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:49:26.970355    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="ab9d055e-1bb5-4a55-96a6-3597995699c8" containerName="cleanup"
Jul 18 11:49:26.970518 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:49:26.970430    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="ab9d055e-1bb5-4a55-96a6-3597995699c8" containerName="cleanup"
Jul 18 11:49:26.970518 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:49:26.970439    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="bdfaff1b-c351-49ed-8994-eb68fb6cb105" containerName="main"
Jul 18 11:49:26.973732 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:49:26.973709    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-97de021e-86cbffc457-fbzsv"
Jul 18 11:49:26.977017 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:49:26.976989    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-97de021e-serving-cert\""
Jul 18 11:49:26.986322 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:49:26.986292    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-97de021e-86cbffc457-fbzsv"]
Jul 18 11:49:26.995286 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:49:26.995257    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d67ffa1e-4c3c-479f-a8f2-894f33353834-maas-api-tls\") pod \"maas-api-e2e-ait-97de021e-86cbffc457-fbzsv\" (UID: \"d67ffa1e-4c3c-479f-a8f2-894f33353834\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-97de021e-86cbffc457-fbzsv"
Jul 18 11:49:26.995436 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:49:26.995360    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d67ffa1e-4c3c-479f-a8f2-894f33353834-openshift-service-ca\") pod \"maas-api-e2e-ait-97de021e-86cbffc457-fbzsv\" (UID: \"d67ffa1e-4c3c-479f-a8f2-894f33353834\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-97de021e-86cbffc457-fbzsv"
Jul 18 11:49:26.995516 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:49:26.995433    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2cc86\" (UniqueName: \"kubernetes.io/projected/d67ffa1e-4c3c-479f-a8f2-894f33353834-kube-api-access-2cc86\") pod \"maas-api-e2e-ait-97de021e-86cbffc457-fbzsv\" (UID: \"d67ffa1e-4c3c-479f-a8f2-894f33353834\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-97de021e-86cbffc457-fbzsv"
Jul 18 11:49:27.096853 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:49:27.096818    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d67ffa1e-4c3c-479f-a8f2-894f33353834-openshift-service-ca\") pod \"maas-api-e2e-ait-97de021e-86cbffc457-fbzsv\" (UID: \"d67ffa1e-4c3c-479f-a8f2-894f33353834\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-97de021e-86cbffc457-fbzsv"
Jul 18 11:49:27.097040 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:49:27.096870    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2cc86\" (UniqueName: \"kubernetes.io/projected/d67ffa1e-4c3c-479f-a8f2-894f33353834-kube-api-access-2cc86\") pod \"maas-api-e2e-ait-97de021e-86cbffc457-fbzsv\" (UID: \"d67ffa1e-4c3c-479f-a8f2-894f33353834\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-97de021e-86cbffc457-fbzsv"
Jul 18 11:49:27.097040 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:49:27.096962    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d67ffa1e-4c3c-479f-a8f2-894f33353834-maas-api-tls\") pod \"maas-api-e2e-ait-97de021e-86cbffc457-fbzsv\" (UID: \"d67ffa1e-4c3c-479f-a8f2-894f33353834\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-97de021e-86cbffc457-fbzsv"
Jul 18 11:49:27.097499 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:49:27.097467    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d67ffa1e-4c3c-479f-a8f2-894f33353834-openshift-service-ca\") pod \"maas-api-e2e-ait-97de021e-86cbffc457-fbzsv\" (UID: \"d67ffa1e-4c3c-479f-a8f2-894f33353834\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-97de021e-86cbffc457-fbzsv"
Jul 18 11:49:27.099394 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:49:27.099376    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d67ffa1e-4c3c-479f-a8f2-894f33353834-maas-api-tls\") pod \"maas-api-e2e-ait-97de021e-86cbffc457-fbzsv\" (UID: \"d67ffa1e-4c3c-479f-a8f2-894f33353834\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-97de021e-86cbffc457-fbzsv"
Jul 18 11:49:27.117625 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:49:27.117595    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2cc86\" (UniqueName: \"kubernetes.io/projected/d67ffa1e-4c3c-479f-a8f2-894f33353834-kube-api-access-2cc86\") pod \"maas-api-e2e-ait-97de021e-86cbffc457-fbzsv\" (UID: \"d67ffa1e-4c3c-479f-a8f2-894f33353834\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-97de021e-86cbffc457-fbzsv"
Jul 18 11:49:27.285843 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:49:27.285747    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-97de021e-86cbffc457-fbzsv"
Jul 18 11:49:27.424831 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:49:27.424798    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-97de021e-86cbffc457-fbzsv"]
Jul 18 11:49:27.425932 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:49:27.425883    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd67ffa1e_4c3c_479f_a8f2_894f33353834.slice/crio-c0f7f7e47c97d2b55f68bd0cd5d17e2f58f1deddd8d1a051a238ff45781a2896 WatchSource:0}: Error finding container c0f7f7e47c97d2b55f68bd0cd5d17e2f58f1deddd8d1a051a238ff45781a2896: Status 404 returned error can't find the container with id c0f7f7e47c97d2b55f68bd0cd5d17e2f58f1deddd8d1a051a238ff45781a2896
Jul 18 11:49:27.772040 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:49:27.772009    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-97de021e-86cbffc457-fbzsv" event={"ID":"d67ffa1e-4c3c-479f-a8f2-894f33353834","Type":"ContainerStarted","Data":"c0f7f7e47c97d2b55f68bd0cd5d17e2f58f1deddd8d1a051a238ff45781a2896"}
Jul 18 11:49:28.778493 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:49:28.778453    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-97de021e-86cbffc457-fbzsv" event={"ID":"d67ffa1e-4c3c-479f-a8f2-894f33353834","Type":"ContainerStarted","Data":"91622446f139b00ba2f52c7fea63fb041c18b3c694ba2b33513721eb182b1af1"}
Jul 18 11:49:28.779013 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:49:28.778512    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-97de021e-86cbffc457-fbzsv"
Jul 18 11:49:28.797172 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:49:28.797118    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-97de021e-86cbffc457-fbzsv" podStartSLOduration=2.331826676 podStartE2EDuration="2.797101667s" totalImagesPullingTime="465.274991ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 11:49:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 11:49:28.795804787 +0000 UTC m=+1788.410841088" watchObservedRunningTime="2026-07-18 11:49:28.797101667 +0000 UTC m=+1788.412137996"
Jul 18 11:49:34.789008 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:49:34.788980    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-97de021e-86cbffc457-fbzsv"
Jul 18 11:49:41.008812 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:49:41.008781    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-jfpn7_759a894c-1828-4ac9-a7c3-77354a104247/console-operator/2.log"
Jul 18 11:49:41.012942 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:49:41.012916    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-58jnn_40e8e19c-87b3-4cd6-81c1-0f404971a282/ovn-acl-logging/0.log"
Jul 18 11:49:41.017943 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:49:41.017924    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-jfpn7_759a894c-1828-4ac9-a7c3-77354a104247/console-operator/2.log"
Jul 18 11:49:41.021707 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:49:41.021689    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-58jnn_40e8e19c-87b3-4cd6-81c1-0f404971a282/ovn-acl-logging/0.log"
Jul 18 11:49:52.531138 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:49:52.531099    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-97de021e-jt28g"]
Jul 18 11:49:52.534663 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:49:52.534645    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-97de021e-jt28g"
Jul 18 11:49:52.537413 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:49:52.537386    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-99w6p\""
Jul 18 11:49:52.542644 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:49:52.542549    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-97de021e-jt28g"]
Jul 18 11:49:52.644396 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:49:52.644361    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ec688748-e547-4161-8fc9-34816b1d3764-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-97de021e-jt28g\" (UID: \"ec688748-e547-4161-8fc9-34816b1d3764\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-97de021e-jt28g"
Jul 18 11:49:52.745580 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:49:52.745541    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ec688748-e547-4161-8fc9-34816b1d3764-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-97de021e-jt28g\" (UID: \"ec688748-e547-4161-8fc9-34816b1d3764\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-97de021e-jt28g"
Jul 18 11:49:52.746204 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:49:52.746184    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ec688748-e547-4161-8fc9-34816b1d3764-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-97de021e-jt28g\" (UID: \"ec688748-e547-4161-8fc9-34816b1d3764\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-97de021e-jt28g"
Jul 18 11:49:52.847985 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:49:52.847950    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-97de021e-jt28g"
Jul 18 11:49:52.987117 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:49:52.987095    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-97de021e-jt28g"]
Jul 18 11:49:52.989272 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:49:52.989241    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podec688748_e547_4161_8fc9_34816b1d3764.slice/crio-7c1895c913b0cfc755bc8781ee8ff7a6e07be7d2cf0e8da6be1ba221a26939fe WatchSource:0}: Error finding container 7c1895c913b0cfc755bc8781ee8ff7a6e07be7d2cf0e8da6be1ba221a26939fe: Status 404 returned error can't find the container with id 7c1895c913b0cfc755bc8781ee8ff7a6e07be7d2cf0e8da6be1ba221a26939fe
Jul 18 11:49:53.918282 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:49:53.918249    2579 generic.go:356] "Generic (PLEG): container finished" podID="ec688748-e547-4161-8fc9-34816b1d3764" containerID="9e1748bd5e4b46311b843b1a2c1b660fa3e249466df45c85a57b48d20e3549c9" exitCode=0
Jul 18 11:49:53.918655 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:49:53.918339    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-97de021e-jt28g" event={"ID":"ec688748-e547-4161-8fc9-34816b1d3764","Type":"ContainerDied","Data":"9e1748bd5e4b46311b843b1a2c1b660fa3e249466df45c85a57b48d20e3549c9"}
Jul 18 11:49:53.918655 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:49:53.918426    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-97de021e-jt28g" event={"ID":"ec688748-e547-4161-8fc9-34816b1d3764","Type":"ContainerStarted","Data":"7c1895c913b0cfc755bc8781ee8ff7a6e07be7d2cf0e8da6be1ba221a26939fe"}
Jul 18 11:49:55.059401 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:49:55.059377    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-97de021e-jt28g"
Jul 18 11:49:55.061422 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:49:55.061404    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ec688748-e547-4161-8fc9-34816b1d3764-maas-api-service-ca\") pod \"ec688748-e547-4161-8fc9-34816b1d3764\" (UID: \"ec688748-e547-4161-8fc9-34816b1d3764\") "
Jul 18 11:49:55.061701 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:49:55.061679    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ec688748-e547-4161-8fc9-34816b1d3764-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "ec688748-e547-4161-8fc9-34816b1d3764" (UID: "ec688748-e547-4161-8fc9-34816b1d3764"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 18 11:49:55.162593 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:49:55.162556    2579 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ec688748-e547-4161-8fc9-34816b1d3764-maas-api-service-ca\") on node \"ip-10-0-133-122.ec2.internal\" DevicePath \"\""
Jul 18 11:49:55.928846 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:49:55.928814    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-97de021e-jt28g"
Jul 18 11:49:55.929037 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:49:55.928851    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-97de021e-jt28g" event={"ID":"ec688748-e547-4161-8fc9-34816b1d3764","Type":"ContainerDied","Data":"7c1895c913b0cfc755bc8781ee8ff7a6e07be7d2cf0e8da6be1ba221a26939fe"}
Jul 18 11:49:55.929037 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:49:55.928920    2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7c1895c913b0cfc755bc8781ee8ff7a6e07be7d2cf0e8da6be1ba221a26939fe"
Jul 18 11:50:03.163757 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:50:03.163711    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-97de021e-86cbffc457-fbzsv"]
Jul 18 11:50:03.164390 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:50:03.163947    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-97de021e-86cbffc457-fbzsv" podUID="d67ffa1e-4c3c-479f-a8f2-894f33353834" containerName="maas-api" containerID="cri-o://91622446f139b00ba2f52c7fea63fb041c18b3c694ba2b33513721eb182b1af1" gracePeriod=30
Jul 18 11:50:03.422615 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:50:03.422538    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-97de021e-86cbffc457-fbzsv"
Jul 18 11:50:03.538479 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:50:03.538436    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2cc86\" (UniqueName: \"kubernetes.io/projected/d67ffa1e-4c3c-479f-a8f2-894f33353834-kube-api-access-2cc86\") pod \"d67ffa1e-4c3c-479f-a8f2-894f33353834\" (UID: \"d67ffa1e-4c3c-479f-a8f2-894f33353834\") "
Jul 18 11:50:03.538690 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:50:03.538505    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d67ffa1e-4c3c-479f-a8f2-894f33353834-maas-api-tls\") pod \"d67ffa1e-4c3c-479f-a8f2-894f33353834\" (UID: \"d67ffa1e-4c3c-479f-a8f2-894f33353834\") "
Jul 18 11:50:03.538690 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:50:03.538557    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d67ffa1e-4c3c-479f-a8f2-894f33353834-openshift-service-ca\") pod \"d67ffa1e-4c3c-479f-a8f2-894f33353834\" (UID: \"d67ffa1e-4c3c-479f-a8f2-894f33353834\") "
Jul 18 11:50:03.538981 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:50:03.538953    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d67ffa1e-4c3c-479f-a8f2-894f33353834-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "d67ffa1e-4c3c-479f-a8f2-894f33353834" (UID: "d67ffa1e-4c3c-479f-a8f2-894f33353834"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 18 11:50:03.540727 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:50:03.540698    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d67ffa1e-4c3c-479f-a8f2-894f33353834-kube-api-access-2cc86" (OuterVolumeSpecName: "kube-api-access-2cc86") pod "d67ffa1e-4c3c-479f-a8f2-894f33353834" (UID: "d67ffa1e-4c3c-479f-a8f2-894f33353834"). InnerVolumeSpecName "kube-api-access-2cc86". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 18 11:50:03.540839 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:50:03.540778    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d67ffa1e-4c3c-479f-a8f2-894f33353834-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "d67ffa1e-4c3c-479f-a8f2-894f33353834" (UID: "d67ffa1e-4c3c-479f-a8f2-894f33353834"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 18 11:50:03.639238 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:50:03.639205    2579 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d67ffa1e-4c3c-479f-a8f2-894f33353834-openshift-service-ca\") on node \"ip-10-0-133-122.ec2.internal\" DevicePath \"\""
Jul 18 11:50:03.639238 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:50:03.639234    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2cc86\" (UniqueName: \"kubernetes.io/projected/d67ffa1e-4c3c-479f-a8f2-894f33353834-kube-api-access-2cc86\") on node \"ip-10-0-133-122.ec2.internal\" DevicePath \"\""
Jul 18 11:50:03.639238 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:50:03.639243    2579 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d67ffa1e-4c3c-479f-a8f2-894f33353834-maas-api-tls\") on node \"ip-10-0-133-122.ec2.internal\" DevicePath \"\""
Jul 18 11:50:03.969377 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:50:03.969343    2579 generic.go:356] "Generic (PLEG): container finished" podID="d67ffa1e-4c3c-479f-a8f2-894f33353834" containerID="91622446f139b00ba2f52c7fea63fb041c18b3c694ba2b33513721eb182b1af1" exitCode=0
Jul 18 11:50:03.969555 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:50:03.969393    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-97de021e-86cbffc457-fbzsv"
Jul 18 11:50:03.969555 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:50:03.969420    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-97de021e-86cbffc457-fbzsv" event={"ID":"d67ffa1e-4c3c-479f-a8f2-894f33353834","Type":"ContainerDied","Data":"91622446f139b00ba2f52c7fea63fb041c18b3c694ba2b33513721eb182b1af1"}
Jul 18 11:50:03.969555 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:50:03.969475    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-97de021e-86cbffc457-fbzsv" event={"ID":"d67ffa1e-4c3c-479f-a8f2-894f33353834","Type":"ContainerDied","Data":"c0f7f7e47c97d2b55f68bd0cd5d17e2f58f1deddd8d1a051a238ff45781a2896"}
Jul 18 11:50:03.969555 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:50:03.969498    2579 scope.go:117] "RemoveContainer" containerID="91622446f139b00ba2f52c7fea63fb041c18b3c694ba2b33513721eb182b1af1"
Jul 18 11:50:03.979759 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:50:03.979741    2579 scope.go:117] "RemoveContainer" containerID="91622446f139b00ba2f52c7fea63fb041c18b3c694ba2b33513721eb182b1af1"
Jul 18 11:50:03.980060 ip-10-0-133-122 kubenswrapper[2579]: E0718 11:50:03.980037    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"91622446f139b00ba2f52c7fea63fb041c18b3c694ba2b33513721eb182b1af1\": container with ID starting with 91622446f139b00ba2f52c7fea63fb041c18b3c694ba2b33513721eb182b1af1 not found: ID does not exist" containerID="91622446f139b00ba2f52c7fea63fb041c18b3c694ba2b33513721eb182b1af1"
Jul 18 11:50:03.980112 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:50:03.980070    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"91622446f139b00ba2f52c7fea63fb041c18b3c694ba2b33513721eb182b1af1"} err="failed to get container status \"91622446f139b00ba2f52c7fea63fb041c18b3c694ba2b33513721eb182b1af1\": rpc error: code = NotFound desc = could not find container \"91622446f139b00ba2f52c7fea63fb041c18b3c694ba2b33513721eb182b1af1\": container with ID starting with 91622446f139b00ba2f52c7fea63fb041c18b3c694ba2b33513721eb182b1af1 not found: ID does not exist"
Jul 18 11:50:03.992057 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:50:03.992029    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-97de021e-86cbffc457-fbzsv"]
Jul 18 11:50:03.997937 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:50:03.997915    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-97de021e-86cbffc457-fbzsv"]
Jul 18 11:50:04.894403 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:50:04.894368    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d67ffa1e-4c3c-479f-a8f2-894f33353834" path="/var/lib/kubelet/pods/d67ffa1e-4c3c-479f-a8f2-894f33353834/volumes"
Jul 18 11:50:07.603799 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:50:07.603764    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-97de021e-jt28g"]
Jul 18 11:50:07.606269 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:50:07.606240    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-97de021e-jt28g"]
Jul 18 11:50:08.801568 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:50:08.801534    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-migrate-5c267dde-gw-openshift-default-98bb96d7-hqt52"]
Jul 18 11:50:08.802147 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:50:08.802131    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d67ffa1e-4c3c-479f-a8f2-894f33353834" containerName="maas-api"
Jul 18 11:50:08.802211 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:50:08.802150    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="d67ffa1e-4c3c-479f-a8f2-894f33353834" containerName="maas-api"
Jul 18 11:50:08.802211 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:50:08.802184    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ec688748-e547-4161-8fc9-34816b1d3764" containerName="revoke-keys"
Jul 18 11:50:08.802211 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:50:08.802192    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="ec688748-e547-4161-8fc9-34816b1d3764" containerName="revoke-keys"
Jul 18 11:50:08.802313 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:50:08.802291    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="d67ffa1e-4c3c-479f-a8f2-894f33353834" containerName="maas-api"
Jul 18 11:50:08.802313 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:50:08.802306    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="ec688748-e547-4161-8fc9-34816b1d3764" containerName="revoke-keys"
Jul 18 11:50:08.807304 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:50:08.807278    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-5c267dde-gw-openshift-default-98bb96d7-hqt52"
Jul 18 11:50:08.809681 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:50:08.809653    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 18 11:50:08.809783 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:50:08.809673    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-migrate-5c267dde-gw-openshift-default-dockercfg-vd5f5\""
Jul 18 11:50:08.815821 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:50:08.815788    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-5c267dde-gw-openshift-default-98bb96d7-hqt52"]
Jul 18 11:50:08.889361 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:50:08.889179    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6b86f3bc-2d0d-4795-959a-d0ef466f1889-istio-token\") pod \"e2e-migrate-5c267dde-gw-openshift-default-98bb96d7-hqt52\" (UID: \"6b86f3bc-2d0d-4795-959a-d0ef466f1889\") " pod="openshift-ingress/e2e-migrate-5c267dde-gw-openshift-default-98bb96d7-hqt52"
Jul 18 11:50:08.889361 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:50:08.889246    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6b86f3bc-2d0d-4795-959a-d0ef466f1889-istio-data\") pod \"e2e-migrate-5c267dde-gw-openshift-default-98bb96d7-hqt52\" (UID: \"6b86f3bc-2d0d-4795-959a-d0ef466f1889\") " pod="openshift-ingress/e2e-migrate-5c267dde-gw-openshift-default-98bb96d7-hqt52"
Jul 18 11:50:08.889361 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:50:08.889303    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6b86f3bc-2d0d-4795-959a-d0ef466f1889-istio-envoy\") pod \"e2e-migrate-5c267dde-gw-openshift-default-98bb96d7-hqt52\" (UID: \"6b86f3bc-2d0d-4795-959a-d0ef466f1889\") " pod="openshift-ingress/e2e-migrate-5c267dde-gw-openshift-default-98bb96d7-hqt52"
Jul 18 11:50:08.889361 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:50:08.889359    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6b86f3bc-2d0d-4795-959a-d0ef466f1889-workload-socket\") pod \"e2e-migrate-5c267dde-gw-openshift-default-98bb96d7-hqt52\" (UID: \"6b86f3bc-2d0d-4795-959a-d0ef466f1889\") " pod="openshift-ingress/e2e-migrate-5c267dde-gw-openshift-default-98bb96d7-hqt52"
Jul 18 11:50:08.889731 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:50:08.889407    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6b86f3bc-2d0d-4795-959a-d0ef466f1889-credential-socket\") pod \"e2e-migrate-5c267dde-gw-openshift-default-98bb96d7-hqt52\" (UID: \"6b86f3bc-2d0d-4795-959a-d0ef466f1889\") " pod="openshift-ingress/e2e-migrate-5c267dde-gw-openshift-default-98bb96d7-hqt52"
Jul 18 11:50:08.889731 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:50:08.889484    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wkdwx\" (UniqueName: \"kubernetes.io/projected/6b86f3bc-2d0d-4795-959a-d0ef466f1889-kube-api-access-wkdwx\") pod \"e2e-migrate-5c267dde-gw-openshift-default-98bb96d7-hqt52\" (UID: \"6b86f3bc-2d0d-4795-959a-d0ef466f1889\") " pod="openshift-ingress/e2e-migrate-5c267dde-gw-openshift-default-98bb96d7-hqt52"
Jul 18 11:50:08.889731 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:50:08.889517    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6b86f3bc-2d0d-4795-959a-d0ef466f1889-istiod-ca-cert\") pod \"e2e-migrate-5c267dde-gw-openshift-default-98bb96d7-hqt52\" (UID: \"6b86f3bc-2d0d-4795-959a-d0ef466f1889\") " pod="openshift-ingress/e2e-migrate-5c267dde-gw-openshift-default-98bb96d7-hqt52"
Jul 18 11:50:08.889731 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:50:08.889543    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6b86f3bc-2d0d-4795-959a-d0ef466f1889-workload-certs\") pod \"e2e-migrate-5c267dde-gw-openshift-default-98bb96d7-hqt52\" (UID: \"6b86f3bc-2d0d-4795-959a-d0ef466f1889\") " pod="openshift-ingress/e2e-migrate-5c267dde-gw-openshift-default-98bb96d7-hqt52"
Jul 18 11:50:08.889731 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:50:08.889590    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6b86f3bc-2d0d-4795-959a-d0ef466f1889-istio-podinfo\") pod \"e2e-migrate-5c267dde-gw-openshift-default-98bb96d7-hqt52\" (UID: \"6b86f3bc-2d0d-4795-959a-d0ef466f1889\") " pod="openshift-ingress/e2e-migrate-5c267dde-gw-openshift-default-98bb96d7-hqt52"
Jul 18 11:50:08.896009 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:50:08.895978    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ec688748-e547-4161-8fc9-34816b1d3764" path="/var/lib/kubelet/pods/ec688748-e547-4161-8fc9-34816b1d3764/volumes"
Jul 18 11:50:08.990719 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:50:08.990669    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6b86f3bc-2d0d-4795-959a-d0ef466f1889-istio-token\") pod \"e2e-migrate-5c267dde-gw-openshift-default-98bb96d7-hqt52\" (UID: \"6b86f3bc-2d0d-4795-959a-d0ef466f1889\") " pod="openshift-ingress/e2e-migrate-5c267dde-gw-openshift-default-98bb96d7-hqt52"
Jul 18 11:50:08.990939 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:50:08.990834    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6b86f3bc-2d0d-4795-959a-d0ef466f1889-istio-data\") pod \"e2e-migrate-5c267dde-gw-openshift-default-98bb96d7-hqt52\" (UID: \"6b86f3bc-2d0d-4795-959a-d0ef466f1889\") " pod="openshift-ingress/e2e-migrate-5c267dde-gw-openshift-default-98bb96d7-hqt52"
Jul 18 11:50:08.991009 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:50:08.990940    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6b86f3bc-2d0d-4795-959a-d0ef466f1889-istio-envoy\") pod \"e2e-migrate-5c267dde-gw-openshift-default-98bb96d7-hqt52\" (UID: \"6b86f3bc-2d0d-4795-959a-d0ef466f1889\") " pod="openshift-ingress/e2e-migrate-5c267dde-gw-openshift-default-98bb96d7-hqt52"
Jul 18 11:50:08.991009 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:50:08.990965    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6b86f3bc-2d0d-4795-959a-d0ef466f1889-workload-socket\") pod \"e2e-migrate-5c267dde-gw-openshift-default-98bb96d7-hqt52\" (UID: \"6b86f3bc-2d0d-4795-959a-d0ef466f1889\") " pod="openshift-ingress/e2e-migrate-5c267dde-gw-openshift-default-98bb96d7-hqt52"
Jul 18 11:50:08.991009 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:50:08.991001    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6b86f3bc-2d0d-4795-959a-d0ef466f1889-credential-socket\") pod \"e2e-migrate-5c267dde-gw-openshift-default-98bb96d7-hqt52\" (UID: \"6b86f3bc-2d0d-4795-959a-d0ef466f1889\") " pod="openshift-ingress/e2e-migrate-5c267dde-gw-openshift-default-98bb96d7-hqt52"
Jul 18 11:50:08.991166 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:50:08.991031    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wkdwx\" (UniqueName: \"kubernetes.io/projected/6b86f3bc-2d0d-4795-959a-d0ef466f1889-kube-api-access-wkdwx\") pod \"e2e-migrate-5c267dde-gw-openshift-default-98bb96d7-hqt52\" (UID: \"6b86f3bc-2d0d-4795-959a-d0ef466f1889\") " pod="openshift-ingress/e2e-migrate-5c267dde-gw-openshift-default-98bb96d7-hqt52"
Jul 18 11:50:08.991166 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:50:08.991058    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6b86f3bc-2d0d-4795-959a-d0ef466f1889-istiod-ca-cert\") pod \"e2e-migrate-5c267dde-gw-openshift-default-98bb96d7-hqt52\" (UID: \"6b86f3bc-2d0d-4795-959a-d0ef466f1889\") " pod="openshift-ingress/e2e-migrate-5c267dde-gw-openshift-default-98bb96d7-hqt52"
Jul 18 11:50:08.991166 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:50:08.991123    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6b86f3bc-2d0d-4795-959a-d0ef466f1889-workload-certs\") pod \"e2e-migrate-5c267dde-gw-openshift-default-98bb96d7-hqt52\" (UID: \"6b86f3bc-2d0d-4795-959a-d0ef466f1889\") " pod="openshift-ingress/e2e-migrate-5c267dde-gw-openshift-default-98bb96d7-hqt52"
Jul 18 11:50:08.991326 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:50:08.991235    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6b86f3bc-2d0d-4795-959a-d0ef466f1889-istio-data\") pod \"e2e-migrate-5c267dde-gw-openshift-default-98bb96d7-hqt52\" (UID: \"6b86f3bc-2d0d-4795-959a-d0ef466f1889\") " pod="openshift-ingress/e2e-migrate-5c267dde-gw-openshift-default-98bb96d7-hqt52"
Jul 18 11:50:08.991390 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:50:08.991327    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6b86f3bc-2d0d-4795-959a-d0ef466f1889-istio-podinfo\") pod \"e2e-migrate-5c267dde-gw-openshift-default-98bb96d7-hqt52\" (UID: \"6b86f3bc-2d0d-4795-959a-d0ef466f1889\") " pod="openshift-ingress/e2e-migrate-5c267dde-gw-openshift-default-98bb96d7-hqt52"
Jul 18 11:50:08.991390 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:50:08.991334    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6b86f3bc-2d0d-4795-959a-d0ef466f1889-workload-socket\") pod \"e2e-migrate-5c267dde-gw-openshift-default-98bb96d7-hqt52\" (UID: \"6b86f3bc-2d0d-4795-959a-d0ef466f1889\") " pod="openshift-ingress/e2e-migrate-5c267dde-gw-openshift-default-98bb96d7-hqt52"
Jul 18 11:50:08.991560 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:50:08.991512    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6b86f3bc-2d0d-4795-959a-d0ef466f1889-credential-socket\") pod \"e2e-migrate-5c267dde-gw-openshift-default-98bb96d7-hqt52\" (UID: \"6b86f3bc-2d0d-4795-959a-d0ef466f1889\") " pod="openshift-ingress/e2e-migrate-5c267dde-gw-openshift-default-98bb96d7-hqt52"
Jul 18 11:50:08.991619 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:50:08.991587    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6b86f3bc-2d0d-4795-959a-d0ef466f1889-workload-certs\") pod \"e2e-migrate-5c267dde-gw-openshift-default-98bb96d7-hqt52\" (UID: \"6b86f3bc-2d0d-4795-959a-d0ef466f1889\") " pod="openshift-ingress/e2e-migrate-5c267dde-gw-openshift-default-98bb96d7-hqt52"
Jul 18 11:50:08.991904 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:50:08.991860    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6b86f3bc-2d0d-4795-959a-d0ef466f1889-istiod-ca-cert\") pod \"e2e-migrate-5c267dde-gw-openshift-default-98bb96d7-hqt52\" (UID: \"6b86f3bc-2d0d-4795-959a-d0ef466f1889\") " pod="openshift-ingress/e2e-migrate-5c267dde-gw-openshift-default-98bb96d7-hqt52"
Jul 18 11:50:08.993713 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:50:08.993688    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6b86f3bc-2d0d-4795-959a-d0ef466f1889-istio-envoy\") pod \"e2e-migrate-5c267dde-gw-openshift-default-98bb96d7-hqt52\" (UID: \"6b86f3bc-2d0d-4795-959a-d0ef466f1889\") " pod="openshift-ingress/e2e-migrate-5c267dde-gw-openshift-default-98bb96d7-hqt52"
Jul 18 11:50:08.993820 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:50:08.993763    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6b86f3bc-2d0d-4795-959a-d0ef466f1889-istio-podinfo\") pod \"e2e-migrate-5c267dde-gw-openshift-default-98bb96d7-hqt52\" (UID: \"6b86f3bc-2d0d-4795-959a-d0ef466f1889\") " pod="openshift-ingress/e2e-migrate-5c267dde-gw-openshift-default-98bb96d7-hqt52"
Jul 18 11:50:08.999807 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:50:08.999780    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6b86f3bc-2d0d-4795-959a-d0ef466f1889-istio-token\") pod \"e2e-migrate-5c267dde-gw-openshift-default-98bb96d7-hqt52\" (UID: \"6b86f3bc-2d0d-4795-959a-d0ef466f1889\") " pod="openshift-ingress/e2e-migrate-5c267dde-gw-openshift-default-98bb96d7-hqt52"
Jul 18 11:50:09.000141 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:50:09.000120    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wkdwx\" (UniqueName: \"kubernetes.io/projected/6b86f3bc-2d0d-4795-959a-d0ef466f1889-kube-api-access-wkdwx\") pod \"e2e-migrate-5c267dde-gw-openshift-default-98bb96d7-hqt52\" (UID: \"6b86f3bc-2d0d-4795-959a-d0ef466f1889\") " pod="openshift-ingress/e2e-migrate-5c267dde-gw-openshift-default-98bb96d7-hqt52"
Jul 18 11:50:09.121277 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:50:09.121235    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-5c267dde-gw-openshift-default-98bb96d7-hqt52"
Jul 18 11:50:09.285243 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:50:09.285213    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-5c267dde-gw-openshift-default-98bb96d7-hqt52"]
Jul 18 11:50:09.287443 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:50:09.287420    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6b86f3bc_2d0d_4795_959a_d0ef466f1889.slice/crio-c0ed0cf13409ae36711be51b1a666334562545ed4dfb9927dafbec149355cdc7 WatchSource:0}: Error finding container c0ed0cf13409ae36711be51b1a666334562545ed4dfb9927dafbec149355cdc7: Status 404 returned error can't find the container with id c0ed0cf13409ae36711be51b1a666334562545ed4dfb9927dafbec149355cdc7
Jul 18 11:50:09.289767 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:50:09.289746    2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 18 11:50:10.008754 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:50:10.008709    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-5c267dde-gw-openshift-default-98bb96d7-hqt52" event={"ID":"6b86f3bc-2d0d-4795-959a-d0ef466f1889","Type":"ContainerStarted","Data":"c0ed0cf13409ae36711be51b1a666334562545ed4dfb9927dafbec149355cdc7"}
Jul 18 11:50:12.117792 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:50:12.117750    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 18 11:50:12.118221 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:50:12.117840    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 18 11:50:12.118221 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:50:12.117882    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 18 11:50:13.030470 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:50:13.030433    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-5c267dde-gw-openshift-default-98bb96d7-hqt52" event={"ID":"6b86f3bc-2d0d-4795-959a-d0ef466f1889","Type":"ContainerStarted","Data":"18a0d57fc269781e52b63f1aaf8c5df578eb795d8abb898ae67e45eb6e4b1d77"}
Jul 18 11:50:13.052614 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:50:13.052551    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-migrate-5c267dde-gw-openshift-default-98bb96d7-hqt52" podStartSLOduration=2.225012945 podStartE2EDuration="5.052528321s" totalImagesPullingTime="2.827515376s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 11:50:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 11:50:13.048869243 +0000 UTC m=+1832.663905546" watchObservedRunningTime="2026-07-18 11:50:13.052528321 +0000 UTC m=+1832.667564624"
Jul 18 11:50:13.121974 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:50:13.121932    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-5c267dde-gw-openshift-default-98bb96d7-hqt52"
Jul 18 11:50:13.127382 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:50:13.127354    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-5c267dde-gw-openshift-default-98bb96d7-hqt52"
Jul 18 11:50:14.035660 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:50:14.035629    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-5c267dde-gw-openshift-default-98bb96d7-hqt52"
Jul 18 11:50:14.036721 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:50:14.036700    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-5c267dde-gw-openshift-default-98bb96d7-hqt52"
Jul 18 11:50:14.600127 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:50:14.600083    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-5c267dde-5ddb5f46f-rqwtl"]
Jul 18 11:50:14.604064 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:50:14.604035    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-5c267dde-5ddb5f46f-rqwtl"
Jul 18 11:50:14.606750 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:50:14.606727    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-migrate-5c267dde-serving-cert\""
Jul 18 11:50:14.614763 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:50:14.614695    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-5c267dde-5ddb5f46f-rqwtl"]
Jul 18 11:50:14.748694 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:50:14.748650    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2hfwp\" (UniqueName: \"kubernetes.io/projected/3f4774c1-289c-43c2-a142-53fecaec75bf-kube-api-access-2hfwp\") pod \"maas-api-e2e-migrate-5c267dde-5ddb5f46f-rqwtl\" (UID: \"3f4774c1-289c-43c2-a142-53fecaec75bf\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-5c267dde-5ddb5f46f-rqwtl"
Jul 18 11:50:14.748939 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:50:14.748760    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3f4774c1-289c-43c2-a142-53fecaec75bf-maas-api-tls\") pod \"maas-api-e2e-migrate-5c267dde-5ddb5f46f-rqwtl\" (UID: \"3f4774c1-289c-43c2-a142-53fecaec75bf\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-5c267dde-5ddb5f46f-rqwtl"
Jul 18 11:50:14.748939 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:50:14.748787    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3f4774c1-289c-43c2-a142-53fecaec75bf-openshift-service-ca\") pod \"maas-api-e2e-migrate-5c267dde-5ddb5f46f-rqwtl\" (UID: \"3f4774c1-289c-43c2-a142-53fecaec75bf\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-5c267dde-5ddb5f46f-rqwtl"
Jul 18 11:50:14.849780 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:50:14.849742    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2hfwp\" (UniqueName: \"kubernetes.io/projected/3f4774c1-289c-43c2-a142-53fecaec75bf-kube-api-access-2hfwp\") pod \"maas-api-e2e-migrate-5c267dde-5ddb5f46f-rqwtl\" (UID: \"3f4774c1-289c-43c2-a142-53fecaec75bf\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-5c267dde-5ddb5f46f-rqwtl"
Jul 18 11:50:14.850029 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:50:14.849835    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3f4774c1-289c-43c2-a142-53fecaec75bf-maas-api-tls\") pod \"maas-api-e2e-migrate-5c267dde-5ddb5f46f-rqwtl\" (UID: \"3f4774c1-289c-43c2-a142-53fecaec75bf\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-5c267dde-5ddb5f46f-rqwtl"
Jul 18 11:50:14.850029 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:50:14.849863    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3f4774c1-289c-43c2-a142-53fecaec75bf-openshift-service-ca\") pod \"maas-api-e2e-migrate-5c267dde-5ddb5f46f-rqwtl\" (UID: \"3f4774c1-289c-43c2-a142-53fecaec75bf\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-5c267dde-5ddb5f46f-rqwtl"
Jul 18 11:50:14.850621 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:50:14.850575    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3f4774c1-289c-43c2-a142-53fecaec75bf-openshift-service-ca\") pod \"maas-api-e2e-migrate-5c267dde-5ddb5f46f-rqwtl\" (UID: \"3f4774c1-289c-43c2-a142-53fecaec75bf\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-5c267dde-5ddb5f46f-rqwtl"
Jul 18 11:50:14.852309 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:50:14.852286    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3f4774c1-289c-43c2-a142-53fecaec75bf-maas-api-tls\") pod \"maas-api-e2e-migrate-5c267dde-5ddb5f46f-rqwtl\" (UID: \"3f4774c1-289c-43c2-a142-53fecaec75bf\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-5c267dde-5ddb5f46f-rqwtl"
Jul 18 11:50:14.858608 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:50:14.858587    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2hfwp\" (UniqueName: \"kubernetes.io/projected/3f4774c1-289c-43c2-a142-53fecaec75bf-kube-api-access-2hfwp\") pod \"maas-api-e2e-migrate-5c267dde-5ddb5f46f-rqwtl\" (UID: \"3f4774c1-289c-43c2-a142-53fecaec75bf\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-5c267dde-5ddb5f46f-rqwtl"
Jul 18 11:50:14.918246 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:50:14.918210    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-5c267dde-5ddb5f46f-rqwtl"
Jul 18 11:50:15.066063 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:50:15.066036    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-5c267dde-5ddb5f46f-rqwtl"]
Jul 18 11:50:15.068205 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:50:15.068179    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3f4774c1_289c_43c2_a142_53fecaec75bf.slice/crio-5d4213311c7395ac82fa09378eaf0010ddf7fa154c57122cc9447b4b6ea99067 WatchSource:0}: Error finding container 5d4213311c7395ac82fa09378eaf0010ddf7fa154c57122cc9447b4b6ea99067: Status 404 returned error can't find the container with id 5d4213311c7395ac82fa09378eaf0010ddf7fa154c57122cc9447b4b6ea99067
Jul 18 11:50:16.047784 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:50:16.047743    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-5c267dde-5ddb5f46f-rqwtl" event={"ID":"3f4774c1-289c-43c2-a142-53fecaec75bf","Type":"ContainerStarted","Data":"ca69bf8a45bd9ac696358b4e9eeab5a9ee657780efed6e30556ed8feea952a84"}
Jul 18 11:50:16.048246 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:50:16.047810    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-5c267dde-5ddb5f46f-rqwtl" event={"ID":"3f4774c1-289c-43c2-a142-53fecaec75bf","Type":"ContainerStarted","Data":"5d4213311c7395ac82fa09378eaf0010ddf7fa154c57122cc9447b4b6ea99067"}
Jul 18 11:50:16.048246 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:50:16.048032    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-5c267dde-5ddb5f46f-rqwtl"
Jul 18 11:50:16.068702 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:50:16.068654    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-5c267dde-5ddb5f46f-rqwtl" podStartSLOduration=1.710055044 podStartE2EDuration="2.068638032s" totalImagesPullingTime="358.582988ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 11:50:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 11:50:16.067216624 +0000 UTC m=+1835.682252927" watchObservedRunningTime="2026-07-18 11:50:16.068638032 +0000 UTC m=+1835.683674333"
Jul 18 11:50:22.058973 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:50:22.058943    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-5c267dde-5ddb5f46f-rqwtl"
Jul 18 11:50:27.106965 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:50:27.106927    2579 generic.go:356] "Generic (PLEG): container finished" podID="6b86f3bc-2d0d-4795-959a-d0ef466f1889" containerID="18a0d57fc269781e52b63f1aaf8c5df578eb795d8abb898ae67e45eb6e4b1d77" exitCode=0
Jul 18 11:50:27.107523 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:50:27.107010    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-5c267dde-gw-openshift-default-98bb96d7-hqt52" event={"ID":"6b86f3bc-2d0d-4795-959a-d0ef466f1889","Type":"ContainerDied","Data":"18a0d57fc269781e52b63f1aaf8c5df578eb795d8abb898ae67e45eb6e4b1d77"}
Jul 18 11:50:27.107596 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:50:27.107549    2579 scope.go:117] "RemoveContainer" containerID="18a0d57fc269781e52b63f1aaf8c5df578eb795d8abb898ae67e45eb6e4b1d77"
Jul 18 11:50:27.109571 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:50:27.109541    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 18 11:50:27.109670 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:50:27.109612    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 18 11:50:27.109670 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:50:27.109644    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 18 11:50:28.114569 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:50:28.114530    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-5c267dde-gw-openshift-default-98bb96d7-hqt52" event={"ID":"6b86f3bc-2d0d-4795-959a-d0ef466f1889","Type":"ContainerStarted","Data":"8e23d8181e89c7d1f40aa492b314ddef94b50f5937f1efbd127fc481871f2cd4"}
Jul 18 11:50:28.122666 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:50:28.122631    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-5c267dde-gw-openshift-default-98bb96d7-hqt52"
Jul 18 11:50:28.124093 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:50:28.124060    2579 patch_prober.go:28] interesting pod/e2e-migrate-5c267dde-gw-openshift-default-98bb96d7-hqt52 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" start-of-body=
Jul 18 11:50:28.124219 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:50:28.124134    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-5c267dde-gw-openshift-default-98bb96d7-hqt52" podUID="6b86f3bc-2d0d-4795-959a-d0ef466f1889" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused"
Jul 18 11:50:29.036453 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:50:29.036414    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-5c267dde-gw-openshift-default-98bb96d7-hqt52"
Jul 18 11:50:29.122218 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:50:29.122184    2579 patch_prober.go:28] interesting pod/e2e-migrate-5c267dde-gw-openshift-default-98bb96d7-hqt52 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" start-of-body=
Jul 18 11:50:29.122806 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:50:29.122773    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-5c267dde-gw-openshift-default-98bb96d7-hqt52" podUID="6b86f3bc-2d0d-4795-959a-d0ef466f1889" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused"
Jul 18 11:50:30.125796 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:50:30.125753    2579 patch_prober.go:28] interesting pod/e2e-migrate-5c267dde-gw-openshift-default-98bb96d7-hqt52 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" start-of-body=
Jul 18 11:50:30.126459 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:50:30.126421    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-5c267dde-gw-openshift-default-98bb96d7-hqt52" podUID="6b86f3bc-2d0d-4795-959a-d0ef466f1889" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused"
Jul 18 11:50:31.122185 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:50:31.122144    2579 patch_prober.go:28] interesting pod/e2e-migrate-5c267dde-gw-openshift-default-98bb96d7-hqt52 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" start-of-body=
Jul 18 11:50:31.122409 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:50:31.122229    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-5c267dde-gw-openshift-default-98bb96d7-hqt52" podUID="6b86f3bc-2d0d-4795-959a-d0ef466f1889" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused"
Jul 18 11:50:32.126397 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:50:32.126365    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-5c267dde-gw-openshift-default-98bb96d7-hqt52"
Jul 18 11:50:32.127406 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:50:32.127383    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-5c267dde-gw-openshift-default-98bb96d7-hqt52"
Jul 18 11:50:50.109346 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:50:50.109305    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-5c267dde-5ddb5f46f-rqwtl"]
Jul 18 11:50:50.109938 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:50:50.109626    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-5c267dde-5ddb5f46f-rqwtl" podUID="3f4774c1-289c-43c2-a142-53fecaec75bf" containerName="maas-api" containerID="cri-o://ca69bf8a45bd9ac696358b4e9eeab5a9ee657780efed6e30556ed8feea952a84" gracePeriod=30
Jul 18 11:50:50.246520 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:50:50.246478    2579 generic.go:356] "Generic (PLEG): container finished" podID="3f4774c1-289c-43c2-a142-53fecaec75bf" containerID="ca69bf8a45bd9ac696358b4e9eeab5a9ee657780efed6e30556ed8feea952a84" exitCode=0
Jul 18 11:50:50.246687 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:50:50.246547    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-5c267dde-5ddb5f46f-rqwtl" event={"ID":"3f4774c1-289c-43c2-a142-53fecaec75bf","Type":"ContainerDied","Data":"ca69bf8a45bd9ac696358b4e9eeab5a9ee657780efed6e30556ed8feea952a84"}
Jul 18 11:50:50.375400 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:50:50.375334    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-5c267dde-5ddb5f46f-rqwtl"
Jul 18 11:50:50.501835 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:50:50.501804    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3f4774c1-289c-43c2-a142-53fecaec75bf-openshift-service-ca\") pod \"3f4774c1-289c-43c2-a142-53fecaec75bf\" (UID: \"3f4774c1-289c-43c2-a142-53fecaec75bf\") "
Jul 18 11:50:50.502060 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:50:50.501939    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3f4774c1-289c-43c2-a142-53fecaec75bf-maas-api-tls\") pod \"3f4774c1-289c-43c2-a142-53fecaec75bf\" (UID: \"3f4774c1-289c-43c2-a142-53fecaec75bf\") "
Jul 18 11:50:50.502060 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:50:50.502015    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2hfwp\" (UniqueName: \"kubernetes.io/projected/3f4774c1-289c-43c2-a142-53fecaec75bf-kube-api-access-2hfwp\") pod \"3f4774c1-289c-43c2-a142-53fecaec75bf\" (UID: \"3f4774c1-289c-43c2-a142-53fecaec75bf\") "
Jul 18 11:50:50.502233 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:50:50.502205    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3f4774c1-289c-43c2-a142-53fecaec75bf-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "3f4774c1-289c-43c2-a142-53fecaec75bf" (UID: "3f4774c1-289c-43c2-a142-53fecaec75bf"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 18 11:50:50.504087 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:50:50.504062    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3f4774c1-289c-43c2-a142-53fecaec75bf-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "3f4774c1-289c-43c2-a142-53fecaec75bf" (UID: "3f4774c1-289c-43c2-a142-53fecaec75bf"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 18 11:50:50.504305 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:50:50.504284    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3f4774c1-289c-43c2-a142-53fecaec75bf-kube-api-access-2hfwp" (OuterVolumeSpecName: "kube-api-access-2hfwp") pod "3f4774c1-289c-43c2-a142-53fecaec75bf" (UID: "3f4774c1-289c-43c2-a142-53fecaec75bf"). InnerVolumeSpecName "kube-api-access-2hfwp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 18 11:50:50.602947 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:50:50.602877    2579 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3f4774c1-289c-43c2-a142-53fecaec75bf-maas-api-tls\") on node \"ip-10-0-133-122.ec2.internal\" DevicePath \"\""
Jul 18 11:50:50.602947 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:50:50.602940    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2hfwp\" (UniqueName: \"kubernetes.io/projected/3f4774c1-289c-43c2-a142-53fecaec75bf-kube-api-access-2hfwp\") on node \"ip-10-0-133-122.ec2.internal\" DevicePath \"\""
Jul 18 11:50:50.602947 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:50:50.602952    2579 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3f4774c1-289c-43c2-a142-53fecaec75bf-openshift-service-ca\") on node \"ip-10-0-133-122.ec2.internal\" DevicePath \"\""
Jul 18 11:50:51.252748 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:50:51.252667    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-5c267dde-5ddb5f46f-rqwtl"
Jul 18 11:50:51.253210 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:50:51.252666    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-5c267dde-5ddb5f46f-rqwtl" event={"ID":"3f4774c1-289c-43c2-a142-53fecaec75bf","Type":"ContainerDied","Data":"5d4213311c7395ac82fa09378eaf0010ddf7fa154c57122cc9447b4b6ea99067"}
Jul 18 11:50:51.253210 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:50:51.252807    2579 scope.go:117] "RemoveContainer" containerID="ca69bf8a45bd9ac696358b4e9eeab5a9ee657780efed6e30556ed8feea952a84"
Jul 18 11:50:51.267747 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:50:51.267388    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-5c267dde-5ddb5f46f-rqwtl"]
Jul 18 11:50:51.269577 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:50:51.269557    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-5c267dde-5ddb5f46f-rqwtl"]
Jul 18 11:50:52.894687 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:50:52.894654    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3f4774c1-289c-43c2-a142-53fecaec75bf" path="/var/lib/kubelet/pods/3f4774c1-289c-43c2-a142-53fecaec75bf/volumes"
Jul 18 11:50:54.770110 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:50:54.770073    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-5c267dde-gw-openshift-default-98bb96d7-hqt52"]
Jul 18 11:50:54.770531 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:50:54.770351    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-migrate-5c267dde-gw-openshift-default-98bb96d7-hqt52" podUID="6b86f3bc-2d0d-4795-959a-d0ef466f1889" containerName="istio-proxy" containerID="cri-o://8e23d8181e89c7d1f40aa492b314ddef94b50f5937f1efbd127fc481871f2cd4" gracePeriod=30
Jul 18 11:51:00.036356 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:51:00.036277    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-5c267dde-gw-openshift-default-98bb96d7-hqt52"
Jul 18 11:51:00.206458 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:51:00.206420    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wkdwx\" (UniqueName: \"kubernetes.io/projected/6b86f3bc-2d0d-4795-959a-d0ef466f1889-kube-api-access-wkdwx\") pod \"6b86f3bc-2d0d-4795-959a-d0ef466f1889\" (UID: \"6b86f3bc-2d0d-4795-959a-d0ef466f1889\") "
Jul 18 11:51:00.206658 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:51:00.206514    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6b86f3bc-2d0d-4795-959a-d0ef466f1889-workload-socket\") pod \"6b86f3bc-2d0d-4795-959a-d0ef466f1889\" (UID: \"6b86f3bc-2d0d-4795-959a-d0ef466f1889\") "
Jul 18 11:51:00.206658 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:51:00.206538    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6b86f3bc-2d0d-4795-959a-d0ef466f1889-istio-envoy\") pod \"6b86f3bc-2d0d-4795-959a-d0ef466f1889\" (UID: \"6b86f3bc-2d0d-4795-959a-d0ef466f1889\") "
Jul 18 11:51:00.206658 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:51:00.206565    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6b86f3bc-2d0d-4795-959a-d0ef466f1889-istio-data\") pod \"6b86f3bc-2d0d-4795-959a-d0ef466f1889\" (UID: \"6b86f3bc-2d0d-4795-959a-d0ef466f1889\") "
Jul 18 11:51:00.206658 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:51:00.206582    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6b86f3bc-2d0d-4795-959a-d0ef466f1889-workload-certs\") pod \"6b86f3bc-2d0d-4795-959a-d0ef466f1889\" (UID: \"6b86f3bc-2d0d-4795-959a-d0ef466f1889\") "
Jul 18 11:51:00.206658 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:51:00.206614    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6b86f3bc-2d0d-4795-959a-d0ef466f1889-istio-token\") pod \"6b86f3bc-2d0d-4795-959a-d0ef466f1889\" (UID: \"6b86f3bc-2d0d-4795-959a-d0ef466f1889\") "
Jul 18 11:51:00.206658 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:51:00.206648    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6b86f3bc-2d0d-4795-959a-d0ef466f1889-credential-socket\") pod \"6b86f3bc-2d0d-4795-959a-d0ef466f1889\" (UID: \"6b86f3bc-2d0d-4795-959a-d0ef466f1889\") "
Jul 18 11:51:00.207050 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:51:00.206695    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6b86f3bc-2d0d-4795-959a-d0ef466f1889-istiod-ca-cert\") pod \"6b86f3bc-2d0d-4795-959a-d0ef466f1889\" (UID: \"6b86f3bc-2d0d-4795-959a-d0ef466f1889\") "
Jul 18 11:51:00.207050 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:51:00.206724    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6b86f3bc-2d0d-4795-959a-d0ef466f1889-istio-podinfo\") pod \"6b86f3bc-2d0d-4795-959a-d0ef466f1889\" (UID: \"6b86f3bc-2d0d-4795-959a-d0ef466f1889\") "
Jul 18 11:51:00.207050 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:51:00.206941    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6b86f3bc-2d0d-4795-959a-d0ef466f1889-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "6b86f3bc-2d0d-4795-959a-d0ef466f1889" (UID: "6b86f3bc-2d0d-4795-959a-d0ef466f1889"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 11:51:00.207215 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:51:00.207076    2579 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6b86f3bc-2d0d-4795-959a-d0ef466f1889-workload-certs\") on node \"ip-10-0-133-122.ec2.internal\" DevicePath \"\""
Jul 18 11:51:00.207215 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:51:00.207088    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6b86f3bc-2d0d-4795-959a-d0ef466f1889-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "6b86f3bc-2d0d-4795-959a-d0ef466f1889" (UID: "6b86f3bc-2d0d-4795-959a-d0ef466f1889"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 11:51:00.207215 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:51:00.207186    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6b86f3bc-2d0d-4795-959a-d0ef466f1889-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "6b86f3bc-2d0d-4795-959a-d0ef466f1889" (UID: "6b86f3bc-2d0d-4795-959a-d0ef466f1889"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 11:51:00.207371 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:51:00.207264    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6b86f3bc-2d0d-4795-959a-d0ef466f1889-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "6b86f3bc-2d0d-4795-959a-d0ef466f1889" (UID: "6b86f3bc-2d0d-4795-959a-d0ef466f1889"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 18 11:51:00.207664 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:51:00.207634    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6b86f3bc-2d0d-4795-959a-d0ef466f1889-istio-data" (OuterVolumeSpecName: "istio-data") pod "6b86f3bc-2d0d-4795-959a-d0ef466f1889" (UID: "6b86f3bc-2d0d-4795-959a-d0ef466f1889"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 11:51:00.208952 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:51:00.208925    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6b86f3bc-2d0d-4795-959a-d0ef466f1889-kube-api-access-wkdwx" (OuterVolumeSpecName: "kube-api-access-wkdwx") pod "6b86f3bc-2d0d-4795-959a-d0ef466f1889" (UID: "6b86f3bc-2d0d-4795-959a-d0ef466f1889"). InnerVolumeSpecName "kube-api-access-wkdwx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 18 11:51:00.209080 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:51:00.209060    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/6b86f3bc-2d0d-4795-959a-d0ef466f1889-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "6b86f3bc-2d0d-4795-959a-d0ef466f1889" (UID: "6b86f3bc-2d0d-4795-959a-d0ef466f1889"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 18 11:51:00.209236 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:51:00.209218    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6b86f3bc-2d0d-4795-959a-d0ef466f1889-istio-token" (OuterVolumeSpecName: "istio-token") pod "6b86f3bc-2d0d-4795-959a-d0ef466f1889" (UID: "6b86f3bc-2d0d-4795-959a-d0ef466f1889"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 18 11:51:00.209297 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:51:00.209272    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6b86f3bc-2d0d-4795-959a-d0ef466f1889-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "6b86f3bc-2d0d-4795-959a-d0ef466f1889" (UID: "6b86f3bc-2d0d-4795-959a-d0ef466f1889"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 11:51:00.301695 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:51:00.301594    2579 generic.go:356] "Generic (PLEG): container finished" podID="6b86f3bc-2d0d-4795-959a-d0ef466f1889" containerID="8e23d8181e89c7d1f40aa492b314ddef94b50f5937f1efbd127fc481871f2cd4" exitCode=0
Jul 18 11:51:00.301695 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:51:00.301645    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-5c267dde-gw-openshift-default-98bb96d7-hqt52"
Jul 18 11:51:00.301695 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:51:00.301677    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-5c267dde-gw-openshift-default-98bb96d7-hqt52" event={"ID":"6b86f3bc-2d0d-4795-959a-d0ef466f1889","Type":"ContainerDied","Data":"8e23d8181e89c7d1f40aa492b314ddef94b50f5937f1efbd127fc481871f2cd4"}
Jul 18 11:51:00.301956 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:51:00.301732    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-5c267dde-gw-openshift-default-98bb96d7-hqt52" event={"ID":"6b86f3bc-2d0d-4795-959a-d0ef466f1889","Type":"ContainerDied","Data":"c0ed0cf13409ae36711be51b1a666334562545ed4dfb9927dafbec149355cdc7"}
Jul 18 11:51:00.301956 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:51:00.301759    2579 scope.go:117] "RemoveContainer" containerID="8e23d8181e89c7d1f40aa492b314ddef94b50f5937f1efbd127fc481871f2cd4"
Jul 18 11:51:00.307765 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:51:00.307742    2579 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6b86f3bc-2d0d-4795-959a-d0ef466f1889-istio-token\") on node \"ip-10-0-133-122.ec2.internal\" DevicePath \"\""
Jul 18 11:51:00.307765 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:51:00.307765    2579 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6b86f3bc-2d0d-4795-959a-d0ef466f1889-credential-socket\") on node \"ip-10-0-133-122.ec2.internal\" DevicePath \"\""
Jul 18 11:51:00.307957 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:51:00.307775    2579 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6b86f3bc-2d0d-4795-959a-d0ef466f1889-istiod-ca-cert\") on node \"ip-10-0-133-122.ec2.internal\" DevicePath \"\""
Jul 18 11:51:00.307957 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:51:00.307785    2579 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6b86f3bc-2d0d-4795-959a-d0ef466f1889-istio-podinfo\") on node \"ip-10-0-133-122.ec2.internal\" DevicePath \"\""
Jul 18 11:51:00.307957 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:51:00.307793    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wkdwx\" (UniqueName: \"kubernetes.io/projected/6b86f3bc-2d0d-4795-959a-d0ef466f1889-kube-api-access-wkdwx\") on node \"ip-10-0-133-122.ec2.internal\" DevicePath \"\""
Jul 18 11:51:00.307957 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:51:00.307802    2579 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6b86f3bc-2d0d-4795-959a-d0ef466f1889-workload-socket\") on node \"ip-10-0-133-122.ec2.internal\" DevicePath \"\""
Jul 18 11:51:00.307957 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:51:00.307811    2579 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6b86f3bc-2d0d-4795-959a-d0ef466f1889-istio-envoy\") on node \"ip-10-0-133-122.ec2.internal\" DevicePath \"\""
Jul 18 11:51:00.307957 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:51:00.307819    2579 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6b86f3bc-2d0d-4795-959a-d0ef466f1889-istio-data\") on node \"ip-10-0-133-122.ec2.internal\" DevicePath \"\""
Jul 18 11:51:00.311694 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:51:00.311650    2579 scope.go:117] "RemoveContainer" containerID="18a0d57fc269781e52b63f1aaf8c5df578eb795d8abb898ae67e45eb6e4b1d77"
Jul 18 11:51:00.322878 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:51:00.322852    2579 scope.go:117] "RemoveContainer" containerID="8e23d8181e89c7d1f40aa492b314ddef94b50f5937f1efbd127fc481871f2cd4"
Jul 18 11:51:00.325010 ip-10-0-133-122 kubenswrapper[2579]: E0718 11:51:00.324975    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8e23d8181e89c7d1f40aa492b314ddef94b50f5937f1efbd127fc481871f2cd4\": container with ID starting with 8e23d8181e89c7d1f40aa492b314ddef94b50f5937f1efbd127fc481871f2cd4 not found: ID does not exist" containerID="8e23d8181e89c7d1f40aa492b314ddef94b50f5937f1efbd127fc481871f2cd4"
Jul 18 11:51:00.325133 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:51:00.325018    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8e23d8181e89c7d1f40aa492b314ddef94b50f5937f1efbd127fc481871f2cd4"} err="failed to get container status \"8e23d8181e89c7d1f40aa492b314ddef94b50f5937f1efbd127fc481871f2cd4\": rpc error: code = NotFound desc = could not find container \"8e23d8181e89c7d1f40aa492b314ddef94b50f5937f1efbd127fc481871f2cd4\": container with ID starting with 8e23d8181e89c7d1f40aa492b314ddef94b50f5937f1efbd127fc481871f2cd4 not found: ID does not exist"
Jul 18 11:51:00.325133 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:51:00.325042    2579 scope.go:117] "RemoveContainer" containerID="18a0d57fc269781e52b63f1aaf8c5df578eb795d8abb898ae67e45eb6e4b1d77"
Jul 18 11:51:00.325366 ip-10-0-133-122 kubenswrapper[2579]: E0718 11:51:00.325346    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"18a0d57fc269781e52b63f1aaf8c5df578eb795d8abb898ae67e45eb6e4b1d77\": container with ID starting with 18a0d57fc269781e52b63f1aaf8c5df578eb795d8abb898ae67e45eb6e4b1d77 not found: ID does not exist" containerID="18a0d57fc269781e52b63f1aaf8c5df578eb795d8abb898ae67e45eb6e4b1d77"
Jul 18 11:51:00.325445 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:51:00.325371    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"18a0d57fc269781e52b63f1aaf8c5df578eb795d8abb898ae67e45eb6e4b1d77"} err="failed to get container status \"18a0d57fc269781e52b63f1aaf8c5df578eb795d8abb898ae67e45eb6e4b1d77\": rpc error: code = NotFound desc = could not find container \"18a0d57fc269781e52b63f1aaf8c5df578eb795d8abb898ae67e45eb6e4b1d77\": container with ID starting with 18a0d57fc269781e52b63f1aaf8c5df578eb795d8abb898ae67e45eb6e4b1d77 not found: ID does not exist"
Jul 18 11:51:00.325771 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:51:00.325750    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-5c267dde-gw-openshift-default-98bb96d7-hqt52"]
Jul 18 11:51:00.333539 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:51:00.332222    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-migrate-5c267dde-gw-openshift-default-98bb96d7-hqt52"]
Jul 18 11:51:00.894510 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:51:00.894472    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6b86f3bc-2d0d-4795-959a-d0ef466f1889" path="/var/lib/kubelet/pods/6b86f3bc-2d0d-4795-959a-d0ef466f1889/volumes"
Jul 18 11:51:24.117817 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:51:24.117718    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-da009c57-ls69r"]
Jul 18 11:51:24.118465 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:51:24.118176    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3f4774c1-289c-43c2-a142-53fecaec75bf" containerName="maas-api"
Jul 18 11:51:24.118465 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:51:24.118191    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="3f4774c1-289c-43c2-a142-53fecaec75bf" containerName="maas-api"
Jul 18 11:51:24.118465 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:51:24.118199    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6b86f3bc-2d0d-4795-959a-d0ef466f1889" containerName="istio-proxy"
Jul 18 11:51:24.118465 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:51:24.118205    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="6b86f3bc-2d0d-4795-959a-d0ef466f1889" containerName="istio-proxy"
Jul 18 11:51:24.118465 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:51:24.118221    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6b86f3bc-2d0d-4795-959a-d0ef466f1889" containerName="istio-proxy"
Jul 18 11:51:24.118465 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:51:24.118226    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="6b86f3bc-2d0d-4795-959a-d0ef466f1889" containerName="istio-proxy"
Jul 18 11:51:24.118465 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:51:24.118303    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="6b86f3bc-2d0d-4795-959a-d0ef466f1889" containerName="istio-proxy"
Jul 18 11:51:24.118465 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:51:24.118312    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="3f4774c1-289c-43c2-a142-53fecaec75bf" containerName="maas-api"
Jul 18 11:51:24.121531 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:51:24.121510    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-da009c57-ls69r"
Jul 18 11:51:24.124213 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:51:24.124189    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-99w6p\""
Jul 18 11:51:24.130575 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:51:24.130548    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-da009c57-ls69r"]
Jul 18 11:51:24.229976 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:51:24.229931    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/37cc2bc7-35ea-4078-bb31-ce0c9995b4d1-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-da009c57-ls69r\" (UID: \"37cc2bc7-35ea-4078-bb31-ce0c9995b4d1\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-da009c57-ls69r"
Jul 18 11:51:24.331294 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:51:24.331255    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/37cc2bc7-35ea-4078-bb31-ce0c9995b4d1-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-da009c57-ls69r\" (UID: \"37cc2bc7-35ea-4078-bb31-ce0c9995b4d1\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-da009c57-ls69r"
Jul 18 11:51:24.331883 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:51:24.331865    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/37cc2bc7-35ea-4078-bb31-ce0c9995b4d1-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-da009c57-ls69r\" (UID: \"37cc2bc7-35ea-4078-bb31-ce0c9995b4d1\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-da009c57-ls69r"
Jul 18 11:51:24.432863 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:51:24.432777    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-da009c57-ls69r"
Jul 18 11:51:24.575539 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:51:24.575504    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-da009c57-ls69r"]
Jul 18 11:51:24.578931 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:51:24.578898    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod37cc2bc7_35ea_4078_bb31_ce0c9995b4d1.slice/crio-8f35e1b79018722d569916cd1981ed9c2d2f1efa93662d43428f47479c1ed111 WatchSource:0}: Error finding container 8f35e1b79018722d569916cd1981ed9c2d2f1efa93662d43428f47479c1ed111: Status 404 returned error can't find the container with id 8f35e1b79018722d569916cd1981ed9c2d2f1efa93662d43428f47479c1ed111
Jul 18 11:51:25.439188 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:51:25.439148    2579 generic.go:356] "Generic (PLEG): container finished" podID="37cc2bc7-35ea-4078-bb31-ce0c9995b4d1" containerID="87a2257aff1359739261f2f7fd17f8ee147486d3d6d2df212c690a4954ac0b93" exitCode=0
Jul 18 11:51:25.439590 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:51:25.439206    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-da009c57-ls69r" event={"ID":"37cc2bc7-35ea-4078-bb31-ce0c9995b4d1","Type":"ContainerDied","Data":"87a2257aff1359739261f2f7fd17f8ee147486d3d6d2df212c690a4954ac0b93"}
Jul 18 11:51:25.439590 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:51:25.439256    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-da009c57-ls69r" event={"ID":"37cc2bc7-35ea-4078-bb31-ce0c9995b4d1","Type":"ContainerStarted","Data":"8f35e1b79018722d569916cd1981ed9c2d2f1efa93662d43428f47479c1ed111"}
Jul 18 11:51:26.595376 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:51:26.595347    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-da009c57-ls69r"
Jul 18 11:51:26.652191 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:51:26.652154    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/37cc2bc7-35ea-4078-bb31-ce0c9995b4d1-maas-api-service-ca\") pod \"37cc2bc7-35ea-4078-bb31-ce0c9995b4d1\" (UID: \"37cc2bc7-35ea-4078-bb31-ce0c9995b4d1\") "
Jul 18 11:51:26.652533 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:51:26.652507    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/37cc2bc7-35ea-4078-bb31-ce0c9995b4d1-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "37cc2bc7-35ea-4078-bb31-ce0c9995b4d1" (UID: "37cc2bc7-35ea-4078-bb31-ce0c9995b4d1"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 18 11:51:26.753788 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:51:26.753679    2579 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/37cc2bc7-35ea-4078-bb31-ce0c9995b4d1-maas-api-service-ca\") on node \"ip-10-0-133-122.ec2.internal\" DevicePath \"\""
Jul 18 11:51:27.451265 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:51:27.451234    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-da009c57-ls69r"
Jul 18 11:51:27.451265 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:51:27.451256    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-da009c57-ls69r" event={"ID":"37cc2bc7-35ea-4078-bb31-ce0c9995b4d1","Type":"ContainerDied","Data":"8f35e1b79018722d569916cd1981ed9c2d2f1efa93662d43428f47479c1ed111"}
Jul 18 11:51:27.451493 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:51:27.451308    2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8f35e1b79018722d569916cd1981ed9c2d2f1efa93662d43428f47479c1ed111"
Jul 18 11:51:39.199252 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:51:39.199219    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-da009c57-ls69r"]
Jul 18 11:51:39.202325 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:51:39.202301    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-da009c57-ls69r"]
Jul 18 11:51:40.894846 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:51:40.894805    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="37cc2bc7-35ea-4078-bb31-ce0c9995b4d1" path="/var/lib/kubelet/pods/37cc2bc7-35ea-4078-bb31-ce0c9995b4d1/volumes"
Jul 18 11:51:41.196149 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:51:41.196076    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-9573ed82-openshift-default-7dbd66994c-z86fq"]
Jul 18 11:51:41.196506 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:51:41.196494    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="37cc2bc7-35ea-4078-bb31-ce0c9995b4d1" containerName="revoke-keys"
Jul 18 11:51:41.196549 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:51:41.196508    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="37cc2bc7-35ea-4078-bb31-ce0c9995b4d1" containerName="revoke-keys"
Jul 18 11:51:41.196610 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:51:41.196601    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="37cc2bc7-35ea-4078-bb31-ce0c9995b4d1" containerName="revoke-keys"
Jul 18 11:51:41.196648 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:51:41.196611    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="6b86f3bc-2d0d-4795-959a-d0ef466f1889" containerName="istio-proxy"
Jul 18 11:51:41.201062 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:51:41.201033    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-9573ed82-openshift-default-7dbd66994c-z86fq"
Jul 18 11:51:41.203518 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:51:41.203495    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 18 11:51:41.203642 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:51:41.203497    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-9573ed82-openshift-default-dockercfg-6plnl\""
Jul 18 11:51:41.212592 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:51:41.212565    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-9573ed82-openshift-default-7dbd66994c-z86fq"]
Jul 18 11:51:41.294802 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:51:41.294760    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/70e9424f-0380-4a1e-b0b9-74e4f3776f2a-istio-data\") pod \"e2e-derive-9573ed82-openshift-default-7dbd66994c-z86fq\" (UID: \"70e9424f-0380-4a1e-b0b9-74e4f3776f2a\") " pod="openshift-ingress/e2e-derive-9573ed82-openshift-default-7dbd66994c-z86fq"
Jul 18 11:51:41.295034 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:51:41.294812    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/70e9424f-0380-4a1e-b0b9-74e4f3776f2a-istio-podinfo\") pod \"e2e-derive-9573ed82-openshift-default-7dbd66994c-z86fq\" (UID: \"70e9424f-0380-4a1e-b0b9-74e4f3776f2a\") " pod="openshift-ingress/e2e-derive-9573ed82-openshift-default-7dbd66994c-z86fq"
Jul 18 11:51:41.295034 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:51:41.294935    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-msc6g\" (UniqueName: \"kubernetes.io/projected/70e9424f-0380-4a1e-b0b9-74e4f3776f2a-kube-api-access-msc6g\") pod \"e2e-derive-9573ed82-openshift-default-7dbd66994c-z86fq\" (UID: \"70e9424f-0380-4a1e-b0b9-74e4f3776f2a\") " pod="openshift-ingress/e2e-derive-9573ed82-openshift-default-7dbd66994c-z86fq"
Jul 18 11:51:41.295034 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:51:41.294997    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/70e9424f-0380-4a1e-b0b9-74e4f3776f2a-workload-certs\") pod \"e2e-derive-9573ed82-openshift-default-7dbd66994c-z86fq\" (UID: \"70e9424f-0380-4a1e-b0b9-74e4f3776f2a\") " pod="openshift-ingress/e2e-derive-9573ed82-openshift-default-7dbd66994c-z86fq"
Jul 18 11:51:41.295034 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:51:41.295024    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/70e9424f-0380-4a1e-b0b9-74e4f3776f2a-workload-socket\") pod \"e2e-derive-9573ed82-openshift-default-7dbd66994c-z86fq\" (UID: \"70e9424f-0380-4a1e-b0b9-74e4f3776f2a\") " pod="openshift-ingress/e2e-derive-9573ed82-openshift-default-7dbd66994c-z86fq"
Jul 18 11:51:41.295195 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:51:41.295043    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/70e9424f-0380-4a1e-b0b9-74e4f3776f2a-istiod-ca-cert\") pod \"e2e-derive-9573ed82-openshift-default-7dbd66994c-z86fq\" (UID: \"70e9424f-0380-4a1e-b0b9-74e4f3776f2a\") " pod="openshift-ingress/e2e-derive-9573ed82-openshift-default-7dbd66994c-z86fq"
Jul 18 11:51:41.295195 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:51:41.295078    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/70e9424f-0380-4a1e-b0b9-74e4f3776f2a-istio-envoy\") pod \"e2e-derive-9573ed82-openshift-default-7dbd66994c-z86fq\" (UID: \"70e9424f-0380-4a1e-b0b9-74e4f3776f2a\") " pod="openshift-ingress/e2e-derive-9573ed82-openshift-default-7dbd66994c-z86fq"
Jul 18 11:51:41.295195 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:51:41.295107    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/70e9424f-0380-4a1e-b0b9-74e4f3776f2a-credential-socket\") pod \"e2e-derive-9573ed82-openshift-default-7dbd66994c-z86fq\" (UID: \"70e9424f-0380-4a1e-b0b9-74e4f3776f2a\") " pod="openshift-ingress/e2e-derive-9573ed82-openshift-default-7dbd66994c-z86fq"
Jul 18 11:51:41.295195 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:51:41.295127    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/70e9424f-0380-4a1e-b0b9-74e4f3776f2a-istio-token\") pod \"e2e-derive-9573ed82-openshift-default-7dbd66994c-z86fq\" (UID: \"70e9424f-0380-4a1e-b0b9-74e4f3776f2a\") " pod="openshift-ingress/e2e-derive-9573ed82-openshift-default-7dbd66994c-z86fq"
Jul 18 11:51:41.396585 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:51:41.396551    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/70e9424f-0380-4a1e-b0b9-74e4f3776f2a-workload-certs\") pod \"e2e-derive-9573ed82-openshift-default-7dbd66994c-z86fq\" (UID: \"70e9424f-0380-4a1e-b0b9-74e4f3776f2a\") " pod="openshift-ingress/e2e-derive-9573ed82-openshift-default-7dbd66994c-z86fq"
Jul 18 11:51:41.396802 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:51:41.396596    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/70e9424f-0380-4a1e-b0b9-74e4f3776f2a-workload-socket\") pod \"e2e-derive-9573ed82-openshift-default-7dbd66994c-z86fq\" (UID: \"70e9424f-0380-4a1e-b0b9-74e4f3776f2a\") " pod="openshift-ingress/e2e-derive-9573ed82-openshift-default-7dbd66994c-z86fq"
Jul 18 11:51:41.396802 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:51:41.396629    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/70e9424f-0380-4a1e-b0b9-74e4f3776f2a-istiod-ca-cert\") pod \"e2e-derive-9573ed82-openshift-default-7dbd66994c-z86fq\" (UID: \"70e9424f-0380-4a1e-b0b9-74e4f3776f2a\") " pod="openshift-ingress/e2e-derive-9573ed82-openshift-default-7dbd66994c-z86fq"
Jul 18 11:51:41.396802 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:51:41.396659    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/70e9424f-0380-4a1e-b0b9-74e4f3776f2a-istio-envoy\") pod \"e2e-derive-9573ed82-openshift-default-7dbd66994c-z86fq\" (UID: \"70e9424f-0380-4a1e-b0b9-74e4f3776f2a\") " pod="openshift-ingress/e2e-derive-9573ed82-openshift-default-7dbd66994c-z86fq"
Jul 18 11:51:41.396802 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:51:41.396689    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/70e9424f-0380-4a1e-b0b9-74e4f3776f2a-credential-socket\") pod \"e2e-derive-9573ed82-openshift-default-7dbd66994c-z86fq\" (UID: \"70e9424f-0380-4a1e-b0b9-74e4f3776f2a\") " pod="openshift-ingress/e2e-derive-9573ed82-openshift-default-7dbd66994c-z86fq"
Jul 18 11:51:41.396802 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:51:41.396711    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/70e9424f-0380-4a1e-b0b9-74e4f3776f2a-istio-token\") pod \"e2e-derive-9573ed82-openshift-default-7dbd66994c-z86fq\" (UID: \"70e9424f-0380-4a1e-b0b9-74e4f3776f2a\") " pod="openshift-ingress/e2e-derive-9573ed82-openshift-default-7dbd66994c-z86fq"
Jul 18 11:51:41.397181 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:51:41.396831    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/70e9424f-0380-4a1e-b0b9-74e4f3776f2a-istio-data\") pod \"e2e-derive-9573ed82-openshift-default-7dbd66994c-z86fq\" (UID: \"70e9424f-0380-4a1e-b0b9-74e4f3776f2a\") " pod="openshift-ingress/e2e-derive-9573ed82-openshift-default-7dbd66994c-z86fq"
Jul 18 11:51:41.397181 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:51:41.396917    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/70e9424f-0380-4a1e-b0b9-74e4f3776f2a-istio-podinfo\") pod \"e2e-derive-9573ed82-openshift-default-7dbd66994c-z86fq\" (UID: \"70e9424f-0380-4a1e-b0b9-74e4f3776f2a\") " pod="openshift-ingress/e2e-derive-9573ed82-openshift-default-7dbd66994c-z86fq"
Jul 18 11:51:41.397181 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:51:41.396979    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-msc6g\" (UniqueName: \"kubernetes.io/projected/70e9424f-0380-4a1e-b0b9-74e4f3776f2a-kube-api-access-msc6g\") pod \"e2e-derive-9573ed82-openshift-default-7dbd66994c-z86fq\" (UID: \"70e9424f-0380-4a1e-b0b9-74e4f3776f2a\") " pod="openshift-ingress/e2e-derive-9573ed82-openshift-default-7dbd66994c-z86fq"
Jul 18 11:51:41.397181 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:51:41.397110    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/70e9424f-0380-4a1e-b0b9-74e4f3776f2a-workload-certs\") pod \"e2e-derive-9573ed82-openshift-default-7dbd66994c-z86fq\" (UID: \"70e9424f-0380-4a1e-b0b9-74e4f3776f2a\") " pod="openshift-ingress/e2e-derive-9573ed82-openshift-default-7dbd66994c-z86fq"
Jul 18 11:51:41.397181 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:51:41.397132    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/70e9424f-0380-4a1e-b0b9-74e4f3776f2a-workload-socket\") pod \"e2e-derive-9573ed82-openshift-default-7dbd66994c-z86fq\" (UID: \"70e9424f-0380-4a1e-b0b9-74e4f3776f2a\") " pod="openshift-ingress/e2e-derive-9573ed82-openshift-default-7dbd66994c-z86fq"
Jul 18 11:51:41.397456 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:51:41.397358    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/70e9424f-0380-4a1e-b0b9-74e4f3776f2a-istio-data\") pod \"e2e-derive-9573ed82-openshift-default-7dbd66994c-z86fq\" (UID: \"70e9424f-0380-4a1e-b0b9-74e4f3776f2a\") " pod="openshift-ingress/e2e-derive-9573ed82-openshift-default-7dbd66994c-z86fq"
Jul 18 11:51:41.397517 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:51:41.397489    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/70e9424f-0380-4a1e-b0b9-74e4f3776f2a-credential-socket\") pod \"e2e-derive-9573ed82-openshift-default-7dbd66994c-z86fq\" (UID: \"70e9424f-0380-4a1e-b0b9-74e4f3776f2a\") " pod="openshift-ingress/e2e-derive-9573ed82-openshift-default-7dbd66994c-z86fq"
Jul 18 11:51:41.397564 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:51:41.397543    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/70e9424f-0380-4a1e-b0b9-74e4f3776f2a-istiod-ca-cert\") pod \"e2e-derive-9573ed82-openshift-default-7dbd66994c-z86fq\" (UID: \"70e9424f-0380-4a1e-b0b9-74e4f3776f2a\") " pod="openshift-ingress/e2e-derive-9573ed82-openshift-default-7dbd66994c-z86fq"
Jul 18 11:51:41.399317 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:51:41.399287    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/70e9424f-0380-4a1e-b0b9-74e4f3776f2a-istio-envoy\") pod \"e2e-derive-9573ed82-openshift-default-7dbd66994c-z86fq\" (UID: \"70e9424f-0380-4a1e-b0b9-74e4f3776f2a\") " pod="openshift-ingress/e2e-derive-9573ed82-openshift-default-7dbd66994c-z86fq"
Jul 18 11:51:41.399581 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:51:41.399563    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/70e9424f-0380-4a1e-b0b9-74e4f3776f2a-istio-podinfo\") pod \"e2e-derive-9573ed82-openshift-default-7dbd66994c-z86fq\" (UID: \"70e9424f-0380-4a1e-b0b9-74e4f3776f2a\") " pod="openshift-ingress/e2e-derive-9573ed82-openshift-default-7dbd66994c-z86fq"
Jul 18 11:51:41.406259 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:51:41.406235    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/70e9424f-0380-4a1e-b0b9-74e4f3776f2a-istio-token\") pod \"e2e-derive-9573ed82-openshift-default-7dbd66994c-z86fq\" (UID: \"70e9424f-0380-4a1e-b0b9-74e4f3776f2a\") " pod="openshift-ingress/e2e-derive-9573ed82-openshift-default-7dbd66994c-z86fq"
Jul 18 11:51:41.406427 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:51:41.406406    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-msc6g\" (UniqueName: \"kubernetes.io/projected/70e9424f-0380-4a1e-b0b9-74e4f3776f2a-kube-api-access-msc6g\") pod \"e2e-derive-9573ed82-openshift-default-7dbd66994c-z86fq\" (UID: \"70e9424f-0380-4a1e-b0b9-74e4f3776f2a\") " pod="openshift-ingress/e2e-derive-9573ed82-openshift-default-7dbd66994c-z86fq"
Jul 18 11:51:41.513005 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:51:41.512856    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-9573ed82-openshift-default-7dbd66994c-z86fq"
Jul 18 11:51:41.656474 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:51:41.656443    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-9573ed82-openshift-default-7dbd66994c-z86fq"]
Jul 18 11:51:41.657936 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:51:41.657908    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod70e9424f_0380_4a1e_b0b9_74e4f3776f2a.slice/crio-855c0d414ec451a84daf55f8520da2a46e6c7bdabe768327b5fd3c8f8b35eafb WatchSource:0}: Error finding container 855c0d414ec451a84daf55f8520da2a46e6c7bdabe768327b5fd3c8f8b35eafb: Status 404 returned error can't find the container with id 855c0d414ec451a84daf55f8520da2a46e6c7bdabe768327b5fd3c8f8b35eafb
Jul 18 11:51:41.660207 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:51:41.660165    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 18 11:51:41.660279 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:51:41.660258    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 18 11:51:41.660329 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:51:41.660301    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 18 11:51:42.533266 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:51:42.533227    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-9573ed82-openshift-default-7dbd66994c-z86fq" event={"ID":"70e9424f-0380-4a1e-b0b9-74e4f3776f2a","Type":"ContainerStarted","Data":"79636625d2b6a118a0498815532bae48d3ae21433ff23ab25a9c352d442ab942"}
Jul 18 11:51:42.533679 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:51:42.533288    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-9573ed82-openshift-default-7dbd66994c-z86fq" event={"ID":"70e9424f-0380-4a1e-b0b9-74e4f3776f2a","Type":"ContainerStarted","Data":"855c0d414ec451a84daf55f8520da2a46e6c7bdabe768327b5fd3c8f8b35eafb"}
Jul 18 11:51:42.553490 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:51:42.553441    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-9573ed82-openshift-default-7dbd66994c-z86fq" podStartSLOduration=1.553424999 podStartE2EDuration="1.553424999s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 11:51:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 11:51:42.552331812 +0000 UTC m=+1922.167368152" watchObservedRunningTime="2026-07-18 11:51:42.553424999 +0000 UTC m=+1922.168461343"
Jul 18 11:51:43.513286 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:51:43.513253    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-9573ed82-openshift-default-7dbd66994c-z86fq"
Jul 18 11:51:43.518308 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:51:43.518285    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-9573ed82-openshift-default-7dbd66994c-z86fq"
Jul 18 11:51:43.538373 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:51:43.538339    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-9573ed82-openshift-default-7dbd66994c-z86fq"
Jul 18 11:51:43.539488 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:51:43.539466    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-9573ed82-openshift-default-7dbd66994c-z86fq"
Jul 18 11:51:56.606144 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:51:56.606108    2579 generic.go:356] "Generic (PLEG): container finished" podID="70e9424f-0380-4a1e-b0b9-74e4f3776f2a" containerID="79636625d2b6a118a0498815532bae48d3ae21433ff23ab25a9c352d442ab942" exitCode=0
Jul 18 11:51:56.606613 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:51:56.606184    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-9573ed82-openshift-default-7dbd66994c-z86fq" event={"ID":"70e9424f-0380-4a1e-b0b9-74e4f3776f2a","Type":"ContainerDied","Data":"79636625d2b6a118a0498815532bae48d3ae21433ff23ab25a9c352d442ab942"}
Jul 18 11:51:56.606613 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:51:56.606566    2579 scope.go:117] "RemoveContainer" containerID="79636625d2b6a118a0498815532bae48d3ae21433ff23ab25a9c352d442ab942"
Jul 18 11:51:56.607571 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:51:56.607541    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 18 11:51:56.607644 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:51:56.607611    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 18 11:51:56.607681 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:51:56.607642    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 18 11:51:57.613038 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:51:57.613000    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-9573ed82-openshift-default-7dbd66994c-z86fq" event={"ID":"70e9424f-0380-4a1e-b0b9-74e4f3776f2a","Type":"ContainerStarted","Data":"9002e19967658f17e875696a2ff2a82345740975faca00dd3a21419f906154b9"}
Jul 18 11:51:58.513509 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:51:58.513478    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-9573ed82-openshift-default-7dbd66994c-z86fq"
Jul 18 11:51:58.514932 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:51:58.514878    2579 patch_prober.go:28] interesting pod/e2e-derive-9573ed82-openshift-default-7dbd66994c-z86fq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused" start-of-body=
Jul 18 11:51:58.515077 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:51:58.514947    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-9573ed82-openshift-default-7dbd66994c-z86fq" podUID="70e9424f-0380-4a1e-b0b9-74e4f3776f2a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused"
Jul 18 11:51:58.538856 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:51:58.538813    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-9573ed82-openshift-default-7dbd66994c-z86fq"
Jul 18 11:51:59.513240 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:51:59.513201    2579 patch_prober.go:28] interesting pod/e2e-derive-9573ed82-openshift-default-7dbd66994c-z86fq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused" start-of-body=
Jul 18 11:51:59.513649 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:51:59.513260    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-9573ed82-openshift-default-7dbd66994c-z86fq" podUID="70e9424f-0380-4a1e-b0b9-74e4f3776f2a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused"
Jul 18 11:52:00.513464 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:52:00.513425    2579 patch_prober.go:28] interesting pod/e2e-derive-9573ed82-openshift-default-7dbd66994c-z86fq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused" start-of-body=
Jul 18 11:52:00.513858 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:52:00.513490    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-9573ed82-openshift-default-7dbd66994c-z86fq" podUID="70e9424f-0380-4a1e-b0b9-74e4f3776f2a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused"
Jul 18 11:52:01.517488 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:52:01.517449    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-9573ed82-openshift-default-7dbd66994c-z86fq"
Jul 18 11:52:01.518424 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:52:01.518403    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-9573ed82-openshift-default-7dbd66994c-z86fq"
Jul 18 11:52:08.819321 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:52:08.819280    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-9573ed82-49qr6"]
Jul 18 11:52:08.823085 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:52:08.823065    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-9573ed82-49qr6"
Jul 18 11:52:08.825444 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:52:08.825422    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-99w6p\""
Jul 18 11:52:08.830044 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:52:08.830018    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-9573ed82-49qr6"]
Jul 18 11:52:08.946208 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:52:08.946173    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7ef64a86-57d2-40ee-a030-d42c961306ec-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-9573ed82-49qr6\" (UID: \"7ef64a86-57d2-40ee-a030-d42c961306ec\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-9573ed82-49qr6"
Jul 18 11:52:09.047431 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:52:09.047389    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7ef64a86-57d2-40ee-a030-d42c961306ec-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-9573ed82-49qr6\" (UID: \"7ef64a86-57d2-40ee-a030-d42c961306ec\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-9573ed82-49qr6"
Jul 18 11:52:09.048049 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:52:09.048031    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7ef64a86-57d2-40ee-a030-d42c961306ec-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-9573ed82-49qr6\" (UID: \"7ef64a86-57d2-40ee-a030-d42c961306ec\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-9573ed82-49qr6"
Jul 18 11:52:09.136165 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:52:09.136133    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-9573ed82-49qr6"
Jul 18 11:52:09.276415 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:52:09.276388    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-9573ed82-49qr6"]
Jul 18 11:52:09.278794 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:52:09.278765    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7ef64a86_57d2_40ee_a030_d42c961306ec.slice/crio-514dfbc7fdac36cae946f388a0a01d459d316a9114b0fe81c7fc4009b1e33400 WatchSource:0}: Error finding container 514dfbc7fdac36cae946f388a0a01d459d316a9114b0fe81c7fc4009b1e33400: Status 404 returned error can't find the container with id 514dfbc7fdac36cae946f388a0a01d459d316a9114b0fe81c7fc4009b1e33400
Jul 18 11:52:09.681361 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:52:09.681321    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-9573ed82-49qr6" event={"ID":"7ef64a86-57d2-40ee-a030-d42c961306ec","Type":"ContainerStarted","Data":"73b972125d38251729f0a058f0c03ea1087ba51dd615be770507b686d4c00271"}
Jul 18 11:52:09.681547 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:52:09.681380    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-9573ed82-49qr6" event={"ID":"7ef64a86-57d2-40ee-a030-d42c961306ec","Type":"ContainerStarted","Data":"514dfbc7fdac36cae946f388a0a01d459d316a9114b0fe81c7fc4009b1e33400"}
Jul 18 11:52:09.696194 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:52:09.696144    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-9573ed82-49qr6" podStartSLOduration=1.696128334 podStartE2EDuration="1.696128334s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 11:52:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 11:52:09.69529617 +0000 UTC m=+1949.310332471" watchObservedRunningTime="2026-07-18 11:52:09.696128334 +0000 UTC m=+1949.311164632"
Jul 18 11:52:10.688029 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:52:10.687998    2579 generic.go:356] "Generic (PLEG): container finished" podID="7ef64a86-57d2-40ee-a030-d42c961306ec" containerID="73b972125d38251729f0a058f0c03ea1087ba51dd615be770507b686d4c00271" exitCode=0
Jul 18 11:52:10.688415 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:52:10.688084    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-9573ed82-49qr6" event={"ID":"7ef64a86-57d2-40ee-a030-d42c961306ec","Type":"ContainerDied","Data":"73b972125d38251729f0a058f0c03ea1087ba51dd615be770507b686d4c00271"}
Jul 18 11:52:11.828337 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:52:11.828309    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-9573ed82-49qr6"
Jul 18 11:52:11.973303 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:52:11.973215    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7ef64a86-57d2-40ee-a030-d42c961306ec-maas-api-service-ca\") pod \"7ef64a86-57d2-40ee-a030-d42c961306ec\" (UID: \"7ef64a86-57d2-40ee-a030-d42c961306ec\") "
Jul 18 11:52:11.973557 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:52:11.973534    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7ef64a86-57d2-40ee-a030-d42c961306ec-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "7ef64a86-57d2-40ee-a030-d42c961306ec" (UID: "7ef64a86-57d2-40ee-a030-d42c961306ec"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 18 11:52:12.073983 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:52:12.073955    2579 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7ef64a86-57d2-40ee-a030-d42c961306ec-maas-api-service-ca\") on node \"ip-10-0-133-122.ec2.internal\" DevicePath \"\""
Jul 18 11:52:12.699439 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:52:12.699410    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-9573ed82-49qr6"
Jul 18 11:52:12.699439 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:52:12.699420    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-9573ed82-49qr6" event={"ID":"7ef64a86-57d2-40ee-a030-d42c961306ec","Type":"ContainerDied","Data":"514dfbc7fdac36cae946f388a0a01d459d316a9114b0fe81c7fc4009b1e33400"}
Jul 18 11:52:12.699653 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:52:12.699501    2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="514dfbc7fdac36cae946f388a0a01d459d316a9114b0fe81c7fc4009b1e33400"
Jul 18 11:52:23.897337 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:52:23.897307    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-9573ed82-49qr6"]
Jul 18 11:52:23.900545 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:52:23.900514    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-9573ed82-49qr6"]
Jul 18 11:52:24.044675 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:52:24.044636    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-9573ed82-openshift-default-7dbd66994c-z86fq"]
Jul 18 11:52:24.044921 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:52:24.044880    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-9573ed82-openshift-default-7dbd66994c-z86fq" podUID="70e9424f-0380-4a1e-b0b9-74e4f3776f2a" containerName="istio-proxy" containerID="cri-o://9002e19967658f17e875696a2ff2a82345740975faca00dd3a21419f906154b9" gracePeriod=30
Jul 18 11:52:24.895710 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:52:24.895677    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7ef64a86-57d2-40ee-a030-d42c961306ec" path="/var/lib/kubelet/pods/7ef64a86-57d2-40ee-a030-d42c961306ec/volumes"
Jul 18 11:52:29.303985 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:52:29.303959    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-9573ed82-openshift-default-7dbd66994c-z86fq"
Jul 18 11:52:29.436326 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:52:29.436292    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/70e9424f-0380-4a1e-b0b9-74e4f3776f2a-istio-envoy\") pod \"70e9424f-0380-4a1e-b0b9-74e4f3776f2a\" (UID: \"70e9424f-0380-4a1e-b0b9-74e4f3776f2a\") "
Jul 18 11:52:29.436495 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:52:29.436357    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-msc6g\" (UniqueName: \"kubernetes.io/projected/70e9424f-0380-4a1e-b0b9-74e4f3776f2a-kube-api-access-msc6g\") pod \"70e9424f-0380-4a1e-b0b9-74e4f3776f2a\" (UID: \"70e9424f-0380-4a1e-b0b9-74e4f3776f2a\") "
Jul 18 11:52:29.436495 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:52:29.436386    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/70e9424f-0380-4a1e-b0b9-74e4f3776f2a-istiod-ca-cert\") pod \"70e9424f-0380-4a1e-b0b9-74e4f3776f2a\" (UID: \"70e9424f-0380-4a1e-b0b9-74e4f3776f2a\") "
Jul 18 11:52:29.436495 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:52:29.436414    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/70e9424f-0380-4a1e-b0b9-74e4f3776f2a-credential-socket\") pod \"70e9424f-0380-4a1e-b0b9-74e4f3776f2a\" (UID: \"70e9424f-0380-4a1e-b0b9-74e4f3776f2a\") "
Jul 18 11:52:29.436495 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:52:29.436479    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/70e9424f-0380-4a1e-b0b9-74e4f3776f2a-istio-data\") pod \"70e9424f-0380-4a1e-b0b9-74e4f3776f2a\" (UID: \"70e9424f-0380-4a1e-b0b9-74e4f3776f2a\") "
Jul 18 11:52:29.436715 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:52:29.436509    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/70e9424f-0380-4a1e-b0b9-74e4f3776f2a-istio-podinfo\") pod \"70e9424f-0380-4a1e-b0b9-74e4f3776f2a\" (UID: \"70e9424f-0380-4a1e-b0b9-74e4f3776f2a\") "
Jul 18 11:52:29.436715 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:52:29.436556    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/70e9424f-0380-4a1e-b0b9-74e4f3776f2a-istio-token\") pod \"70e9424f-0380-4a1e-b0b9-74e4f3776f2a\" (UID: \"70e9424f-0380-4a1e-b0b9-74e4f3776f2a\") "
Jul 18 11:52:29.436715 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:52:29.436600    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/70e9424f-0380-4a1e-b0b9-74e4f3776f2a-workload-certs\") pod \"70e9424f-0380-4a1e-b0b9-74e4f3776f2a\" (UID: \"70e9424f-0380-4a1e-b0b9-74e4f3776f2a\") "
Jul 18 11:52:29.436715 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:52:29.436625    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/70e9424f-0380-4a1e-b0b9-74e4f3776f2a-workload-socket\") pod \"70e9424f-0380-4a1e-b0b9-74e4f3776f2a\" (UID: \"70e9424f-0380-4a1e-b0b9-74e4f3776f2a\") "
Jul 18 11:52:29.436949 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:52:29.436801    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/70e9424f-0380-4a1e-b0b9-74e4f3776f2a-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "70e9424f-0380-4a1e-b0b9-74e4f3776f2a" (UID: "70e9424f-0380-4a1e-b0b9-74e4f3776f2a"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 18 11:52:29.436949 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:52:29.436791    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/70e9424f-0380-4a1e-b0b9-74e4f3776f2a-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "70e9424f-0380-4a1e-b0b9-74e4f3776f2a" (UID: "70e9424f-0380-4a1e-b0b9-74e4f3776f2a"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 11:52:29.437066 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:52:29.437049    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/70e9424f-0380-4a1e-b0b9-74e4f3776f2a-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "70e9424f-0380-4a1e-b0b9-74e4f3776f2a" (UID: "70e9424f-0380-4a1e-b0b9-74e4f3776f2a"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 11:52:29.437066 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:52:29.437059    2579 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/70e9424f-0380-4a1e-b0b9-74e4f3776f2a-istiod-ca-cert\") on node \"ip-10-0-133-122.ec2.internal\" DevicePath \"\""
Jul 18 11:52:29.437180 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:52:29.437080    2579 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/70e9424f-0380-4a1e-b0b9-74e4f3776f2a-credential-socket\") on node \"ip-10-0-133-122.ec2.internal\" DevicePath \"\""
Jul 18 11:52:29.437373 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:52:29.437346    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/70e9424f-0380-4a1e-b0b9-74e4f3776f2a-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "70e9424f-0380-4a1e-b0b9-74e4f3776f2a" (UID: "70e9424f-0380-4a1e-b0b9-74e4f3776f2a"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 11:52:29.437581 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:52:29.437553    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/70e9424f-0380-4a1e-b0b9-74e4f3776f2a-istio-data" (OuterVolumeSpecName: "istio-data") pod "70e9424f-0380-4a1e-b0b9-74e4f3776f2a" (UID: "70e9424f-0380-4a1e-b0b9-74e4f3776f2a"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 11:52:29.438730 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:52:29.438704    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/70e9424f-0380-4a1e-b0b9-74e4f3776f2a-kube-api-access-msc6g" (OuterVolumeSpecName: "kube-api-access-msc6g") pod "70e9424f-0380-4a1e-b0b9-74e4f3776f2a" (UID: "70e9424f-0380-4a1e-b0b9-74e4f3776f2a"). InnerVolumeSpecName "kube-api-access-msc6g". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 18 11:52:29.439020 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:52:29.438998    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/70e9424f-0380-4a1e-b0b9-74e4f3776f2a-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "70e9424f-0380-4a1e-b0b9-74e4f3776f2a" (UID: "70e9424f-0380-4a1e-b0b9-74e4f3776f2a"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 11:52:29.439141 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:52:29.439125    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/70e9424f-0380-4a1e-b0b9-74e4f3776f2a-istio-token" (OuterVolumeSpecName: "istio-token") pod "70e9424f-0380-4a1e-b0b9-74e4f3776f2a" (UID: "70e9424f-0380-4a1e-b0b9-74e4f3776f2a"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 18 11:52:29.439188 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:52:29.439139    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/70e9424f-0380-4a1e-b0b9-74e4f3776f2a-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "70e9424f-0380-4a1e-b0b9-74e4f3776f2a" (UID: "70e9424f-0380-4a1e-b0b9-74e4f3776f2a"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 18 11:52:29.538178 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:52:29.538143    2579 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/70e9424f-0380-4a1e-b0b9-74e4f3776f2a-istio-envoy\") on node \"ip-10-0-133-122.ec2.internal\" DevicePath \"\""
Jul 18 11:52:29.538178 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:52:29.538175    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-msc6g\" (UniqueName: \"kubernetes.io/projected/70e9424f-0380-4a1e-b0b9-74e4f3776f2a-kube-api-access-msc6g\") on node \"ip-10-0-133-122.ec2.internal\" DevicePath \"\""
Jul 18 11:52:29.538178 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:52:29.538185    2579 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/70e9424f-0380-4a1e-b0b9-74e4f3776f2a-istio-data\") on node \"ip-10-0-133-122.ec2.internal\" DevicePath \"\""
Jul 18 11:52:29.538405 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:52:29.538194    2579 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/70e9424f-0380-4a1e-b0b9-74e4f3776f2a-istio-podinfo\") on node \"ip-10-0-133-122.ec2.internal\" DevicePath \"\""
Jul 18 11:52:29.538405 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:52:29.538202    2579 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/70e9424f-0380-4a1e-b0b9-74e4f3776f2a-istio-token\") on node \"ip-10-0-133-122.ec2.internal\" DevicePath \"\""
Jul 18 11:52:29.538405 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:52:29.538210    2579 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/70e9424f-0380-4a1e-b0b9-74e4f3776f2a-workload-certs\") on node \"ip-10-0-133-122.ec2.internal\" DevicePath \"\""
Jul 18 11:52:29.538405 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:52:29.538218    2579 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/70e9424f-0380-4a1e-b0b9-74e4f3776f2a-workload-socket\") on node \"ip-10-0-133-122.ec2.internal\" DevicePath \"\""
Jul 18 11:52:29.788743 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:52:29.788648    2579 generic.go:356] "Generic (PLEG): container finished" podID="70e9424f-0380-4a1e-b0b9-74e4f3776f2a" containerID="9002e19967658f17e875696a2ff2a82345740975faca00dd3a21419f906154b9" exitCode=0
Jul 18 11:52:29.788743 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:52:29.788696    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-9573ed82-openshift-default-7dbd66994c-z86fq"
Jul 18 11:52:29.788979 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:52:29.788738    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-9573ed82-openshift-default-7dbd66994c-z86fq" event={"ID":"70e9424f-0380-4a1e-b0b9-74e4f3776f2a","Type":"ContainerDied","Data":"9002e19967658f17e875696a2ff2a82345740975faca00dd3a21419f906154b9"}
Jul 18 11:52:29.788979 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:52:29.788797    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-9573ed82-openshift-default-7dbd66994c-z86fq" event={"ID":"70e9424f-0380-4a1e-b0b9-74e4f3776f2a","Type":"ContainerDied","Data":"855c0d414ec451a84daf55f8520da2a46e6c7bdabe768327b5fd3c8f8b35eafb"}
Jul 18 11:52:29.788979 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:52:29.788820    2579 scope.go:117] "RemoveContainer" containerID="9002e19967658f17e875696a2ff2a82345740975faca00dd3a21419f906154b9"
Jul 18 11:52:29.799507 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:52:29.799488    2579 scope.go:117] "RemoveContainer" containerID="79636625d2b6a118a0498815532bae48d3ae21433ff23ab25a9c352d442ab942"
Jul 18 11:52:29.807718 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:52:29.807698    2579 scope.go:117] "RemoveContainer" containerID="9002e19967658f17e875696a2ff2a82345740975faca00dd3a21419f906154b9"
Jul 18 11:52:29.807972 ip-10-0-133-122 kubenswrapper[2579]: E0718 11:52:29.807953    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9002e19967658f17e875696a2ff2a82345740975faca00dd3a21419f906154b9\": container with ID starting with 9002e19967658f17e875696a2ff2a82345740975faca00dd3a21419f906154b9 not found: ID does not exist" containerID="9002e19967658f17e875696a2ff2a82345740975faca00dd3a21419f906154b9"
Jul 18 11:52:29.808043 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:52:29.807981    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9002e19967658f17e875696a2ff2a82345740975faca00dd3a21419f906154b9"} err="failed to get container status \"9002e19967658f17e875696a2ff2a82345740975faca00dd3a21419f906154b9\": rpc error: code = NotFound desc = could not find container \"9002e19967658f17e875696a2ff2a82345740975faca00dd3a21419f906154b9\": container with ID starting with 9002e19967658f17e875696a2ff2a82345740975faca00dd3a21419f906154b9 not found: ID does not exist"
Jul 18 11:52:29.808043 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:52:29.807999    2579 scope.go:117] "RemoveContainer" containerID="79636625d2b6a118a0498815532bae48d3ae21433ff23ab25a9c352d442ab942"
Jul 18 11:52:29.808230 ip-10-0-133-122 kubenswrapper[2579]: E0718 11:52:29.808212    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"79636625d2b6a118a0498815532bae48d3ae21433ff23ab25a9c352d442ab942\": container with ID starting with 79636625d2b6a118a0498815532bae48d3ae21433ff23ab25a9c352d442ab942 not found: ID does not exist" containerID="79636625d2b6a118a0498815532bae48d3ae21433ff23ab25a9c352d442ab942"
Jul 18 11:52:29.808290 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:52:29.808236    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"79636625d2b6a118a0498815532bae48d3ae21433ff23ab25a9c352d442ab942"} err="failed to get container status \"79636625d2b6a118a0498815532bae48d3ae21433ff23ab25a9c352d442ab942\": rpc error: code = NotFound desc = could not find container \"79636625d2b6a118a0498815532bae48d3ae21433ff23ab25a9c352d442ab942\": container with ID starting with 79636625d2b6a118a0498815532bae48d3ae21433ff23ab25a9c352d442ab942 not found: ID does not exist"
Jul 18 11:52:29.811998 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:52:29.811976    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-9573ed82-openshift-default-7dbd66994c-z86fq"]
Jul 18 11:52:29.815689 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:52:29.815668    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-9573ed82-openshift-default-7dbd66994c-z86fq"]
Jul 18 11:52:30.894926 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:52:30.894872    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="70e9424f-0380-4a1e-b0b9-74e4f3776f2a" path="/var/lib/kubelet/pods/70e9424f-0380-4a1e-b0b9-74e4f3776f2a/volumes"
Jul 18 11:54:00.816846 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:54:00.816807    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-a8e6b1ef-openshift-default-86d8cf8c99-k9zfs"]
Jul 18 11:54:00.817402 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:54:00.817386    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7ef64a86-57d2-40ee-a030-d42c961306ec" containerName="revoke-keys"
Jul 18 11:54:00.817452 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:54:00.817406    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="7ef64a86-57d2-40ee-a030-d42c961306ec" containerName="revoke-keys"
Jul 18 11:54:00.817452 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:54:00.817421    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="70e9424f-0380-4a1e-b0b9-74e4f3776f2a" containerName="istio-proxy"
Jul 18 11:54:00.817452 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:54:00.817429    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="70e9424f-0380-4a1e-b0b9-74e4f3776f2a" containerName="istio-proxy"
Jul 18 11:54:00.817547 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:54:00.817535    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="7ef64a86-57d2-40ee-a030-d42c961306ec" containerName="revoke-keys"
Jul 18 11:54:00.817584 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:54:00.817546    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="70e9424f-0380-4a1e-b0b9-74e4f3776f2a" containerName="istio-proxy"
Jul 18 11:54:00.821046 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:54:00.821022    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-a8e6b1ef-openshift-default-86d8cf8c99-k9zfs"
Jul 18 11:54:00.823880 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:54:00.823849    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-a8e6b1ef-openshift-default-dockercfg-nxjj9\""
Jul 18 11:54:00.824237 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:54:00.823992    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 18 11:54:00.838360 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:54:00.838337    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-a8e6b1ef-openshift-default-86d8cf8c99-k9zfs"]
Jul 18 11:54:00.937668 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:54:00.937631    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-94s74\" (UniqueName: \"kubernetes.io/projected/be445a3f-848a-47d2-a111-2795fef74366-kube-api-access-94s74\") pod \"e2e-mt-a8e6b1ef-openshift-default-86d8cf8c99-k9zfs\" (UID: \"be445a3f-848a-47d2-a111-2795fef74366\") " pod="openshift-ingress/e2e-mt-a8e6b1ef-openshift-default-86d8cf8c99-k9zfs"
Jul 18 11:54:00.937868 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:54:00.937794    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/be445a3f-848a-47d2-a111-2795fef74366-workload-certs\") pod \"e2e-mt-a8e6b1ef-openshift-default-86d8cf8c99-k9zfs\" (UID: \"be445a3f-848a-47d2-a111-2795fef74366\") " pod="openshift-ingress/e2e-mt-a8e6b1ef-openshift-default-86d8cf8c99-k9zfs"
Jul 18 11:54:00.937868 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:54:00.937835    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/be445a3f-848a-47d2-a111-2795fef74366-credential-socket\") pod \"e2e-mt-a8e6b1ef-openshift-default-86d8cf8c99-k9zfs\" (UID: \"be445a3f-848a-47d2-a111-2795fef74366\") " pod="openshift-ingress/e2e-mt-a8e6b1ef-openshift-default-86d8cf8c99-k9zfs"
Jul 18 11:54:00.938048 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:54:00.937874    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/be445a3f-848a-47d2-a111-2795fef74366-istiod-ca-cert\") pod \"e2e-mt-a8e6b1ef-openshift-default-86d8cf8c99-k9zfs\" (UID: \"be445a3f-848a-47d2-a111-2795fef74366\") " pod="openshift-ingress/e2e-mt-a8e6b1ef-openshift-default-86d8cf8c99-k9zfs"
Jul 18 11:54:00.938048 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:54:00.938018    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/be445a3f-848a-47d2-a111-2795fef74366-workload-socket\") pod \"e2e-mt-a8e6b1ef-openshift-default-86d8cf8c99-k9zfs\" (UID: \"be445a3f-848a-47d2-a111-2795fef74366\") " pod="openshift-ingress/e2e-mt-a8e6b1ef-openshift-default-86d8cf8c99-k9zfs"
Jul 18 11:54:00.938128 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:54:00.938079    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/be445a3f-848a-47d2-a111-2795fef74366-istio-podinfo\") pod \"e2e-mt-a8e6b1ef-openshift-default-86d8cf8c99-k9zfs\" (UID: \"be445a3f-848a-47d2-a111-2795fef74366\") " pod="openshift-ingress/e2e-mt-a8e6b1ef-openshift-default-86d8cf8c99-k9zfs"
Jul 18 11:54:00.938128 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:54:00.938107    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/be445a3f-848a-47d2-a111-2795fef74366-istio-envoy\") pod \"e2e-mt-a8e6b1ef-openshift-default-86d8cf8c99-k9zfs\" (UID: \"be445a3f-848a-47d2-a111-2795fef74366\") " pod="openshift-ingress/e2e-mt-a8e6b1ef-openshift-default-86d8cf8c99-k9zfs"
Jul 18 11:54:00.938204 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:54:00.938129    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/be445a3f-848a-47d2-a111-2795fef74366-istio-data\") pod \"e2e-mt-a8e6b1ef-openshift-default-86d8cf8c99-k9zfs\" (UID: \"be445a3f-848a-47d2-a111-2795fef74366\") " pod="openshift-ingress/e2e-mt-a8e6b1ef-openshift-default-86d8cf8c99-k9zfs"
Jul 18 11:54:00.938204 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:54:00.938158    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/be445a3f-848a-47d2-a111-2795fef74366-istio-token\") pod \"e2e-mt-a8e6b1ef-openshift-default-86d8cf8c99-k9zfs\" (UID: \"be445a3f-848a-47d2-a111-2795fef74366\") " pod="openshift-ingress/e2e-mt-a8e6b1ef-openshift-default-86d8cf8c99-k9zfs"
Jul 18 11:54:01.039271 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:54:01.039236    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/be445a3f-848a-47d2-a111-2795fef74366-istiod-ca-cert\") pod \"e2e-mt-a8e6b1ef-openshift-default-86d8cf8c99-k9zfs\" (UID: \"be445a3f-848a-47d2-a111-2795fef74366\") " pod="openshift-ingress/e2e-mt-a8e6b1ef-openshift-default-86d8cf8c99-k9zfs"
Jul 18 11:54:01.039271 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:54:01.039275    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/be445a3f-848a-47d2-a111-2795fef74366-workload-socket\") pod \"e2e-mt-a8e6b1ef-openshift-default-86d8cf8c99-k9zfs\" (UID: \"be445a3f-848a-47d2-a111-2795fef74366\") " pod="openshift-ingress/e2e-mt-a8e6b1ef-openshift-default-86d8cf8c99-k9zfs"
Jul 18 11:54:01.039487 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:54:01.039299    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/be445a3f-848a-47d2-a111-2795fef74366-istio-podinfo\") pod \"e2e-mt-a8e6b1ef-openshift-default-86d8cf8c99-k9zfs\" (UID: \"be445a3f-848a-47d2-a111-2795fef74366\") " pod="openshift-ingress/e2e-mt-a8e6b1ef-openshift-default-86d8cf8c99-k9zfs"
Jul 18 11:54:01.039487 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:54:01.039432    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/be445a3f-848a-47d2-a111-2795fef74366-istio-envoy\") pod \"e2e-mt-a8e6b1ef-openshift-default-86d8cf8c99-k9zfs\" (UID: \"be445a3f-848a-47d2-a111-2795fef74366\") " pod="openshift-ingress/e2e-mt-a8e6b1ef-openshift-default-86d8cf8c99-k9zfs"
Jul 18 11:54:01.039487 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:54:01.039472    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/be445a3f-848a-47d2-a111-2795fef74366-istio-data\") pod \"e2e-mt-a8e6b1ef-openshift-default-86d8cf8c99-k9zfs\" (UID: \"be445a3f-848a-47d2-a111-2795fef74366\") " pod="openshift-ingress/e2e-mt-a8e6b1ef-openshift-default-86d8cf8c99-k9zfs"
Jul 18 11:54:01.039616 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:54:01.039519    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/be445a3f-848a-47d2-a111-2795fef74366-istio-token\") pod \"e2e-mt-a8e6b1ef-openshift-default-86d8cf8c99-k9zfs\" (UID: \"be445a3f-848a-47d2-a111-2795fef74366\") " pod="openshift-ingress/e2e-mt-a8e6b1ef-openshift-default-86d8cf8c99-k9zfs"
Jul 18 11:54:01.039616 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:54:01.039557    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-94s74\" (UniqueName: \"kubernetes.io/projected/be445a3f-848a-47d2-a111-2795fef74366-kube-api-access-94s74\") pod \"e2e-mt-a8e6b1ef-openshift-default-86d8cf8c99-k9zfs\" (UID: \"be445a3f-848a-47d2-a111-2795fef74366\") " pod="openshift-ingress/e2e-mt-a8e6b1ef-openshift-default-86d8cf8c99-k9zfs"
Jul 18 11:54:01.039731 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:54:01.039662    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/be445a3f-848a-47d2-a111-2795fef74366-workload-certs\") pod \"e2e-mt-a8e6b1ef-openshift-default-86d8cf8c99-k9zfs\" (UID: \"be445a3f-848a-47d2-a111-2795fef74366\") " pod="openshift-ingress/e2e-mt-a8e6b1ef-openshift-default-86d8cf8c99-k9zfs"
Jul 18 11:54:01.039731 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:54:01.039689    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/be445a3f-848a-47d2-a111-2795fef74366-workload-socket\") pod \"e2e-mt-a8e6b1ef-openshift-default-86d8cf8c99-k9zfs\" (UID: \"be445a3f-848a-47d2-a111-2795fef74366\") " pod="openshift-ingress/e2e-mt-a8e6b1ef-openshift-default-86d8cf8c99-k9zfs"
Jul 18 11:54:01.039731 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:54:01.039698    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/be445a3f-848a-47d2-a111-2795fef74366-credential-socket\") pod \"e2e-mt-a8e6b1ef-openshift-default-86d8cf8c99-k9zfs\" (UID: \"be445a3f-848a-47d2-a111-2795fef74366\") " pod="openshift-ingress/e2e-mt-a8e6b1ef-openshift-default-86d8cf8c99-k9zfs"
Jul 18 11:54:01.039929 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:54:01.039883    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/be445a3f-848a-47d2-a111-2795fef74366-istio-data\") pod \"e2e-mt-a8e6b1ef-openshift-default-86d8cf8c99-k9zfs\" (UID: \"be445a3f-848a-47d2-a111-2795fef74366\") " pod="openshift-ingress/e2e-mt-a8e6b1ef-openshift-default-86d8cf8c99-k9zfs"
Jul 18 11:54:01.040036 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:54:01.040016    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/be445a3f-848a-47d2-a111-2795fef74366-credential-socket\") pod \"e2e-mt-a8e6b1ef-openshift-default-86d8cf8c99-k9zfs\" (UID: \"be445a3f-848a-47d2-a111-2795fef74366\") " pod="openshift-ingress/e2e-mt-a8e6b1ef-openshift-default-86d8cf8c99-k9zfs"
Jul 18 11:54:01.040095 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:54:01.040073    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/be445a3f-848a-47d2-a111-2795fef74366-workload-certs\") pod \"e2e-mt-a8e6b1ef-openshift-default-86d8cf8c99-k9zfs\" (UID: \"be445a3f-848a-47d2-a111-2795fef74366\") " pod="openshift-ingress/e2e-mt-a8e6b1ef-openshift-default-86d8cf8c99-k9zfs"
Jul 18 11:54:01.040135 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:54:01.040097    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/be445a3f-848a-47d2-a111-2795fef74366-istiod-ca-cert\") pod \"e2e-mt-a8e6b1ef-openshift-default-86d8cf8c99-k9zfs\" (UID: \"be445a3f-848a-47d2-a111-2795fef74366\") " pod="openshift-ingress/e2e-mt-a8e6b1ef-openshift-default-86d8cf8c99-k9zfs"
Jul 18 11:54:01.041673 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:54:01.041654    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/be445a3f-848a-47d2-a111-2795fef74366-istio-envoy\") pod \"e2e-mt-a8e6b1ef-openshift-default-86d8cf8c99-k9zfs\" (UID: \"be445a3f-848a-47d2-a111-2795fef74366\") " pod="openshift-ingress/e2e-mt-a8e6b1ef-openshift-default-86d8cf8c99-k9zfs"
Jul 18 11:54:01.042008 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:54:01.041988    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/be445a3f-848a-47d2-a111-2795fef74366-istio-podinfo\") pod \"e2e-mt-a8e6b1ef-openshift-default-86d8cf8c99-k9zfs\" (UID: \"be445a3f-848a-47d2-a111-2795fef74366\") " pod="openshift-ingress/e2e-mt-a8e6b1ef-openshift-default-86d8cf8c99-k9zfs"
Jul 18 11:54:01.050286 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:54:01.050259    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/be445a3f-848a-47d2-a111-2795fef74366-istio-token\") pod \"e2e-mt-a8e6b1ef-openshift-default-86d8cf8c99-k9zfs\" (UID: \"be445a3f-848a-47d2-a111-2795fef74366\") " pod="openshift-ingress/e2e-mt-a8e6b1ef-openshift-default-86d8cf8c99-k9zfs"
Jul 18 11:54:01.050557 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:54:01.050541    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-94s74\" (UniqueName: \"kubernetes.io/projected/be445a3f-848a-47d2-a111-2795fef74366-kube-api-access-94s74\") pod \"e2e-mt-a8e6b1ef-openshift-default-86d8cf8c99-k9zfs\" (UID: \"be445a3f-848a-47d2-a111-2795fef74366\") " pod="openshift-ingress/e2e-mt-a8e6b1ef-openshift-default-86d8cf8c99-k9zfs"
Jul 18 11:54:01.135439 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:54:01.135407    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-a8e6b1ef-openshift-default-86d8cf8c99-k9zfs"
Jul 18 11:54:01.271418 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:54:01.271393    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-a8e6b1ef-openshift-default-86d8cf8c99-k9zfs"]
Jul 18 11:54:01.273724 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:54:01.273698    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbe445a3f_848a_47d2_a111_2795fef74366.slice/crio-140fa1573b246c943f0fe2c724b1f53235cd963fbd96ce31ea7b5e0e6de853d2 WatchSource:0}: Error finding container 140fa1573b246c943f0fe2c724b1f53235cd963fbd96ce31ea7b5e0e6de853d2: Status 404 returned error can't find the container with id 140fa1573b246c943f0fe2c724b1f53235cd963fbd96ce31ea7b5e0e6de853d2
Jul 18 11:54:01.275749 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:54:01.275716    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 18 11:54:01.275825 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:54:01.275780    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 18 11:54:01.275825 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:54:01.275809    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 18 11:54:02.276114 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:54:02.276079    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-a8e6b1ef-openshift-default-86d8cf8c99-k9zfs" event={"ID":"be445a3f-848a-47d2-a111-2795fef74366","Type":"ContainerStarted","Data":"c4ddb566511f02f00770168e0187f9ddb459faf64462bd431c9931fd63b3d251"}
Jul 18 11:54:02.276516 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:54:02.276134    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-a8e6b1ef-openshift-default-86d8cf8c99-k9zfs" event={"ID":"be445a3f-848a-47d2-a111-2795fef74366","Type":"ContainerStarted","Data":"140fa1573b246c943f0fe2c724b1f53235cd963fbd96ce31ea7b5e0e6de853d2"}
Jul 18 11:54:02.303187 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:54:02.303130    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-a8e6b1ef-openshift-default-86d8cf8c99-k9zfs" podStartSLOduration=2.30311142 podStartE2EDuration="2.30311142s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 11:54:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 11:54:02.301851759 +0000 UTC m=+2061.916888070" watchObservedRunningTime="2026-07-18 11:54:02.30311142 +0000 UTC m=+2061.918147721"
Jul 18 11:54:03.136125 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:54:03.136036    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-a8e6b1ef-openshift-default-86d8cf8c99-k9zfs"
Jul 18 11:54:03.141739 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:54:03.141710    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-a8e6b1ef-openshift-default-86d8cf8c99-k9zfs"
Jul 18 11:54:03.281974 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:54:03.281941    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-a8e6b1ef-openshift-default-86d8cf8c99-k9zfs"
Jul 18 11:54:03.282908 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:54:03.282873    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-a8e6b1ef-openshift-default-86d8cf8c99-k9zfs"
Jul 18 11:54:15.349096 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:54:15.349059    2579 generic.go:356] "Generic (PLEG): container finished" podID="be445a3f-848a-47d2-a111-2795fef74366" containerID="c4ddb566511f02f00770168e0187f9ddb459faf64462bd431c9931fd63b3d251" exitCode=0
Jul 18 11:54:15.349638 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:54:15.349136    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-a8e6b1ef-openshift-default-86d8cf8c99-k9zfs" event={"ID":"be445a3f-848a-47d2-a111-2795fef74366","Type":"ContainerDied","Data":"c4ddb566511f02f00770168e0187f9ddb459faf64462bd431c9931fd63b3d251"}
Jul 18 11:54:15.349720 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:54:15.349636    2579 scope.go:117] "RemoveContainer" containerID="c4ddb566511f02f00770168e0187f9ddb459faf64462bd431c9931fd63b3d251"
Jul 18 11:54:15.350667 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:54:15.350640    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 18 11:54:15.350720 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:54:15.350703    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 18 11:54:15.350755 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:54:15.350732    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 18 11:54:15.994933 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:54:15.994870    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-a8e6b1ef-sz9f4"]
Jul 18 11:54:15.995318 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:54:15.995305    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="70e9424f-0380-4a1e-b0b9-74e4f3776f2a" containerName="istio-proxy"
Jul 18 11:54:15.995367 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:54:15.995319    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="70e9424f-0380-4a1e-b0b9-74e4f3776f2a" containerName="istio-proxy"
Jul 18 11:54:15.995406 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:54:15.995392    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="70e9424f-0380-4a1e-b0b9-74e4f3776f2a" containerName="istio-proxy"
Jul 18 11:54:15.998469 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:54:15.998448    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-a8e6b1ef-sz9f4"
Jul 18 11:54:16.000846 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:54:16.000817    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-99w6p\""
Jul 18 11:54:16.007456 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:54:16.007431    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-a8e6b1ef-sz9f4"]
Jul 18 11:54:16.086745 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:54:16.086707    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0608a562-144e-4a3f-a9f8-f60a142234c5-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-a8e6b1ef-sz9f4\" (UID: \"0608a562-144e-4a3f-a9f8-f60a142234c5\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-a8e6b1ef-sz9f4"
Jul 18 11:54:16.187645 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:54:16.187602    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0608a562-144e-4a3f-a9f8-f60a142234c5-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-a8e6b1ef-sz9f4\" (UID: \"0608a562-144e-4a3f-a9f8-f60a142234c5\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-a8e6b1ef-sz9f4"
Jul 18 11:54:16.188261 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:54:16.188243    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0608a562-144e-4a3f-a9f8-f60a142234c5-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-a8e6b1ef-sz9f4\" (UID: \"0608a562-144e-4a3f-a9f8-f60a142234c5\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-a8e6b1ef-sz9f4"
Jul 18 11:54:16.311911 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:54:16.311808    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-a8e6b1ef-sz9f4"
Jul 18 11:54:16.359933 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:54:16.359878    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-a8e6b1ef-openshift-default-86d8cf8c99-k9zfs" event={"ID":"be445a3f-848a-47d2-a111-2795fef74366","Type":"ContainerStarted","Data":"40628bac81574275841e387f0fe0e88f2a5408d8628a9a16319fdd661c1facf1"}
Jul 18 11:54:16.508179 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:54:16.508156    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-a8e6b1ef-sz9f4"]
Jul 18 11:54:16.510676 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:54:16.510649    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0608a562_144e_4a3f_a9f8_f60a142234c5.slice/crio-003accdeaea640f6ffde734a57a90fd341a7236edd592d2b1d7fdd163c9e9e39 WatchSource:0}: Error finding container 003accdeaea640f6ffde734a57a90fd341a7236edd592d2b1d7fdd163c9e9e39: Status 404 returned error can't find the container with id 003accdeaea640f6ffde734a57a90fd341a7236edd592d2b1d7fdd163c9e9e39
Jul 18 11:54:17.137880 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:54:17.137835    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-a8e6b1ef-openshift-default-86d8cf8c99-k9zfs"
Jul 18 11:54:17.138080 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:54:17.138047    2579 patch_prober.go:28] interesting pod/e2e-mt-a8e6b1ef-openshift-default-86d8cf8c99-k9zfs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused" start-of-body=
Jul 18 11:54:17.138186 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:54:17.138092    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-a8e6b1ef-openshift-default-86d8cf8c99-k9zfs" podUID="be445a3f-848a-47d2-a111-2795fef74366" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused"
Jul 18 11:54:17.366420 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:54:17.366380    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-a8e6b1ef-sz9f4" event={"ID":"0608a562-144e-4a3f-a9f8-f60a142234c5","Type":"ContainerStarted","Data":"3d130b2b2ddf38c6f81bfdf0c16f1aa4803d935cb7a44c379a789473dc5dda7c"}
Jul 18 11:54:17.366912 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:54:17.366447    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-a8e6b1ef-sz9f4" event={"ID":"0608a562-144e-4a3f-a9f8-f60a142234c5","Type":"ContainerStarted","Data":"003accdeaea640f6ffde734a57a90fd341a7236edd592d2b1d7fdd163c9e9e39"}
Jul 18 11:54:17.381089 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:54:17.381033    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-a8e6b1ef-sz9f4" podStartSLOduration=2.381015294 podStartE2EDuration="2.381015294s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 11:54:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 11:54:17.380164143 +0000 UTC m=+2076.995200456" watchObservedRunningTime="2026-07-18 11:54:17.381015294 +0000 UTC m=+2076.996051599"
Jul 18 11:54:18.143456 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:54:18.143407    2579 patch_prober.go:28] interesting pod/e2e-mt-a8e6b1ef-openshift-default-86d8cf8c99-k9zfs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused" start-of-body=
Jul 18 11:54:18.143748 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:54:18.143716    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-a8e6b1ef-openshift-default-86d8cf8c99-k9zfs" podUID="be445a3f-848a-47d2-a111-2795fef74366" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused"
Jul 18 11:54:18.282490 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:54:18.282449    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-a8e6b1ef-openshift-default-86d8cf8c99-k9zfs"
Jul 18 11:54:18.372429 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:54:18.372395    2579 generic.go:356] "Generic (PLEG): container finished" podID="0608a562-144e-4a3f-a9f8-f60a142234c5" containerID="3d130b2b2ddf38c6f81bfdf0c16f1aa4803d935cb7a44c379a789473dc5dda7c" exitCode=0
Jul 18 11:54:18.372821 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:54:18.372475    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-a8e6b1ef-sz9f4" event={"ID":"0608a562-144e-4a3f-a9f8-f60a142234c5","Type":"ContainerDied","Data":"3d130b2b2ddf38c6f81bfdf0c16f1aa4803d935cb7a44c379a789473dc5dda7c"}
Jul 18 11:54:19.136285 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:54:19.136250    2579 patch_prober.go:28] interesting pod/e2e-mt-a8e6b1ef-openshift-default-86d8cf8c99-k9zfs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused" start-of-body=
Jul 18 11:54:19.136571 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:54:19.136540    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-a8e6b1ef-openshift-default-86d8cf8c99-k9zfs" podUID="be445a3f-848a-47d2-a111-2795fef74366" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused"
Jul 18 11:54:19.557857 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:54:19.557825    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-a8e6b1ef-sz9f4"
Jul 18 11:54:19.619044 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:54:19.619018    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0608a562-144e-4a3f-a9f8-f60a142234c5-maas-api-service-ca\") pod \"0608a562-144e-4a3f-a9f8-f60a142234c5\" (UID: \"0608a562-144e-4a3f-a9f8-f60a142234c5\") "
Jul 18 11:54:19.619369 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:54:19.619345    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0608a562-144e-4a3f-a9f8-f60a142234c5-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "0608a562-144e-4a3f-a9f8-f60a142234c5" (UID: "0608a562-144e-4a3f-a9f8-f60a142234c5"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 18 11:54:19.720980 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:54:19.720847    2579 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0608a562-144e-4a3f-a9f8-f60a142234c5-maas-api-service-ca\") on node \"ip-10-0-133-122.ec2.internal\" DevicePath \"\""
Jul 18 11:54:20.136973 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:54:20.136490    2579 patch_prober.go:28] interesting pod/e2e-mt-a8e6b1ef-openshift-default-86d8cf8c99-k9zfs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused" start-of-body=
Jul 18 11:54:20.136973 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:54:20.136559    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-a8e6b1ef-openshift-default-86d8cf8c99-k9zfs" podUID="be445a3f-848a-47d2-a111-2795fef74366" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused"
Jul 18 11:54:20.383975 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:54:20.383944    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-a8e6b1ef-sz9f4"
Jul 18 11:54:20.384142 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:54:20.383979    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-a8e6b1ef-sz9f4" event={"ID":"0608a562-144e-4a3f-a9f8-f60a142234c5","Type":"ContainerDied","Data":"003accdeaea640f6ffde734a57a90fd341a7236edd592d2b1d7fdd163c9e9e39"}
Jul 18 11:54:20.384142 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:54:20.384025    2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="003accdeaea640f6ffde734a57a90fd341a7236edd592d2b1d7fdd163c9e9e39"
Jul 18 11:54:21.139901 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:54:21.139858    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-a8e6b1ef-openshift-default-86d8cf8c99-k9zfs"
Jul 18 11:54:21.140816 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:54:21.140801    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-a8e6b1ef-openshift-default-86d8cf8c99-k9zfs"
Jul 18 11:54:31.074032 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:54:31.073996    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-a8e6b1ef-sz9f4"]
Jul 18 11:54:31.077404 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:54:31.077378    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-a8e6b1ef-sz9f4"]
Jul 18 11:54:32.893898 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:54:32.893866    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0608a562-144e-4a3f-a9f8-f60a142234c5" path="/var/lib/kubelet/pods/0608a562-144e-4a3f-a9f8-f60a142234c5/volumes"
Jul 18 11:54:37.482609 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:54:37.482562    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-a8e6b1ef-openshift-default-86d8cf8c99-k9zfs"]
Jul 18 11:54:37.483163 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:54:37.482831    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-a8e6b1ef-openshift-default-86d8cf8c99-k9zfs" podUID="be445a3f-848a-47d2-a111-2795fef74366" containerName="istio-proxy" containerID="cri-o://40628bac81574275841e387f0fe0e88f2a5408d8628a9a16319fdd661c1facf1" gracePeriod=30
Jul 18 11:54:41.039798 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:54:41.039759    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-jfpn7_759a894c-1828-4ac9-a7c3-77354a104247/console-operator/2.log"
Jul 18 11:54:41.046787 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:54:41.046764    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-58jnn_40e8e19c-87b3-4cd6-81c1-0f404971a282/ovn-acl-logging/0.log"
Jul 18 11:54:41.054793 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:54:41.054777    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-jfpn7_759a894c-1828-4ac9-a7c3-77354a104247/console-operator/2.log"
Jul 18 11:54:41.058393 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:54:41.058375    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-58jnn_40e8e19c-87b3-4cd6-81c1-0f404971a282/ovn-acl-logging/0.log"
Jul 18 11:54:42.749947 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:54:42.749870    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-a8e6b1ef-openshift-default-86d8cf8c99-k9zfs"
Jul 18 11:54:42.831078 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:54:42.831046    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/be445a3f-848a-47d2-a111-2795fef74366-istiod-ca-cert\") pod \"be445a3f-848a-47d2-a111-2795fef74366\" (UID: \"be445a3f-848a-47d2-a111-2795fef74366\") "
Jul 18 11:54:42.831244 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:54:42.831095    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/be445a3f-848a-47d2-a111-2795fef74366-istio-data\") pod \"be445a3f-848a-47d2-a111-2795fef74366\" (UID: \"be445a3f-848a-47d2-a111-2795fef74366\") "
Jul 18 11:54:42.831244 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:54:42.831121    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-94s74\" (UniqueName: \"kubernetes.io/projected/be445a3f-848a-47d2-a111-2795fef74366-kube-api-access-94s74\") pod \"be445a3f-848a-47d2-a111-2795fef74366\" (UID: \"be445a3f-848a-47d2-a111-2795fef74366\") "
Jul 18 11:54:42.831335 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:54:42.831300    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/be445a3f-848a-47d2-a111-2795fef74366-workload-socket\") pod \"be445a3f-848a-47d2-a111-2795fef74366\" (UID: \"be445a3f-848a-47d2-a111-2795fef74366\") "
Jul 18 11:54:42.831388 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:54:42.831371    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/be445a3f-848a-47d2-a111-2795fef74366-credential-socket\") pod \"be445a3f-848a-47d2-a111-2795fef74366\" (UID: \"be445a3f-848a-47d2-a111-2795fef74366\") "
Jul 18 11:54:42.831433 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:54:42.831424    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/be445a3f-848a-47d2-a111-2795fef74366-istio-podinfo\") pod \"be445a3f-848a-47d2-a111-2795fef74366\" (UID: \"be445a3f-848a-47d2-a111-2795fef74366\") "
Jul 18 11:54:42.831484 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:54:42.831443    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/be445a3f-848a-47d2-a111-2795fef74366-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "be445a3f-848a-47d2-a111-2795fef74366" (UID: "be445a3f-848a-47d2-a111-2795fef74366"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 18 11:54:42.831484 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:54:42.831463    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/be445a3f-848a-47d2-a111-2795fef74366-istio-token\") pod \"be445a3f-848a-47d2-a111-2795fef74366\" (UID: \"be445a3f-848a-47d2-a111-2795fef74366\") "
Jul 18 11:54:42.831591 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:54:42.831506    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/be445a3f-848a-47d2-a111-2795fef74366-istio-envoy\") pod \"be445a3f-848a-47d2-a111-2795fef74366\" (UID: \"be445a3f-848a-47d2-a111-2795fef74366\") "
Jul 18 11:54:42.831591 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:54:42.831545    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/be445a3f-848a-47d2-a111-2795fef74366-workload-certs\") pod \"be445a3f-848a-47d2-a111-2795fef74366\" (UID: \"be445a3f-848a-47d2-a111-2795fef74366\") "
Jul 18 11:54:42.831591 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:54:42.831548    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/be445a3f-848a-47d2-a111-2795fef74366-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "be445a3f-848a-47d2-a111-2795fef74366" (UID: "be445a3f-848a-47d2-a111-2795fef74366"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 11:54:42.831751 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:54:42.831590    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/be445a3f-848a-47d2-a111-2795fef74366-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "be445a3f-848a-47d2-a111-2795fef74366" (UID: "be445a3f-848a-47d2-a111-2795fef74366"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 11:54:42.831809 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:54:42.831760    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/be445a3f-848a-47d2-a111-2795fef74366-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "be445a3f-848a-47d2-a111-2795fef74366" (UID: "be445a3f-848a-47d2-a111-2795fef74366"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 11:54:42.831973 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:54:42.831950    2579 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/be445a3f-848a-47d2-a111-2795fef74366-workload-certs\") on node \"ip-10-0-133-122.ec2.internal\" DevicePath \"\""
Jul 18 11:54:42.831973 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:54:42.831963    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/be445a3f-848a-47d2-a111-2795fef74366-istio-data" (OuterVolumeSpecName: "istio-data") pod "be445a3f-848a-47d2-a111-2795fef74366" (UID: "be445a3f-848a-47d2-a111-2795fef74366"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 11:54:42.832182 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:54:42.831972    2579 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/be445a3f-848a-47d2-a111-2795fef74366-istiod-ca-cert\") on node \"ip-10-0-133-122.ec2.internal\" DevicePath \"\""
Jul 18 11:54:42.832182 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:54:42.832011    2579 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/be445a3f-848a-47d2-a111-2795fef74366-workload-socket\") on node \"ip-10-0-133-122.ec2.internal\" DevicePath \"\""
Jul 18 11:54:42.832182 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:54:42.832029    2579 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/be445a3f-848a-47d2-a111-2795fef74366-credential-socket\") on node \"ip-10-0-133-122.ec2.internal\" DevicePath \"\""
Jul 18 11:54:42.833521 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:54:42.833491    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/be445a3f-848a-47d2-a111-2795fef74366-kube-api-access-94s74" (OuterVolumeSpecName: "kube-api-access-94s74") pod "be445a3f-848a-47d2-a111-2795fef74366" (UID: "be445a3f-848a-47d2-a111-2795fef74366"). InnerVolumeSpecName "kube-api-access-94s74". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 18 11:54:42.833635 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:54:42.833563    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/be445a3f-848a-47d2-a111-2795fef74366-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "be445a3f-848a-47d2-a111-2795fef74366" (UID: "be445a3f-848a-47d2-a111-2795fef74366"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 18 11:54:42.833635 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:54:42.833579    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/be445a3f-848a-47d2-a111-2795fef74366-istio-token" (OuterVolumeSpecName: "istio-token") pod "be445a3f-848a-47d2-a111-2795fef74366" (UID: "be445a3f-848a-47d2-a111-2795fef74366"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 18 11:54:42.833635 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:54:42.833601    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/be445a3f-848a-47d2-a111-2795fef74366-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "be445a3f-848a-47d2-a111-2795fef74366" (UID: "be445a3f-848a-47d2-a111-2795fef74366"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 11:54:42.933202 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:54:42.933170    2579 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/be445a3f-848a-47d2-a111-2795fef74366-istio-data\") on node \"ip-10-0-133-122.ec2.internal\" DevicePath \"\""
Jul 18 11:54:42.933202 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:54:42.933198    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-94s74\" (UniqueName: \"kubernetes.io/projected/be445a3f-848a-47d2-a111-2795fef74366-kube-api-access-94s74\") on node \"ip-10-0-133-122.ec2.internal\" DevicePath \"\""
Jul 18 11:54:42.933202 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:54:42.933209    2579 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/be445a3f-848a-47d2-a111-2795fef74366-istio-podinfo\") on node \"ip-10-0-133-122.ec2.internal\" DevicePath \"\""
Jul 18 11:54:42.933404 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:54:42.933218    2579 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/be445a3f-848a-47d2-a111-2795fef74366-istio-token\") on node \"ip-10-0-133-122.ec2.internal\" DevicePath \"\""
Jul 18 11:54:42.933404 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:54:42.933227    2579 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/be445a3f-848a-47d2-a111-2795fef74366-istio-envoy\") on node \"ip-10-0-133-122.ec2.internal\" DevicePath \"\""
Jul 18 11:54:43.508037 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:54:43.508000    2579 generic.go:356] "Generic (PLEG): container finished" podID="be445a3f-848a-47d2-a111-2795fef74366" containerID="40628bac81574275841e387f0fe0e88f2a5408d8628a9a16319fdd661c1facf1" exitCode=0
Jul 18 11:54:43.508243 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:54:43.508045    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-a8e6b1ef-openshift-default-86d8cf8c99-k9zfs"
Jul 18 11:54:43.508243 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:54:43.508078    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-a8e6b1ef-openshift-default-86d8cf8c99-k9zfs" event={"ID":"be445a3f-848a-47d2-a111-2795fef74366","Type":"ContainerDied","Data":"40628bac81574275841e387f0fe0e88f2a5408d8628a9a16319fdd661c1facf1"}
Jul 18 11:54:43.508243 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:54:43.508143    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-a8e6b1ef-openshift-default-86d8cf8c99-k9zfs" event={"ID":"be445a3f-848a-47d2-a111-2795fef74366","Type":"ContainerDied","Data":"140fa1573b246c943f0fe2c724b1f53235cd963fbd96ce31ea7b5e0e6de853d2"}
Jul 18 11:54:43.508243 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:54:43.508172    2579 scope.go:117] "RemoveContainer" containerID="40628bac81574275841e387f0fe0e88f2a5408d8628a9a16319fdd661c1facf1"
Jul 18 11:54:43.517773 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:54:43.517754    2579 scope.go:117] "RemoveContainer" containerID="c4ddb566511f02f00770168e0187f9ddb459faf64462bd431c9931fd63b3d251"
Jul 18 11:54:43.526955 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:54:43.526937    2579 scope.go:117] "RemoveContainer" containerID="40628bac81574275841e387f0fe0e88f2a5408d8628a9a16319fdd661c1facf1"
Jul 18 11:54:43.527218 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:54:43.527194    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-a8e6b1ef-openshift-default-86d8cf8c99-k9zfs"]
Jul 18 11:54:43.527313 ip-10-0-133-122 kubenswrapper[2579]: E0718 11:54:43.527224    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"40628bac81574275841e387f0fe0e88f2a5408d8628a9a16319fdd661c1facf1\": container with ID starting with 40628bac81574275841e387f0fe0e88f2a5408d8628a9a16319fdd661c1facf1 not found: ID does not exist" containerID="40628bac81574275841e387f0fe0e88f2a5408d8628a9a16319fdd661c1facf1"
Jul 18 11:54:43.527313 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:54:43.527248    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"40628bac81574275841e387f0fe0e88f2a5408d8628a9a16319fdd661c1facf1"} err="failed to get container status \"40628bac81574275841e387f0fe0e88f2a5408d8628a9a16319fdd661c1facf1\": rpc error: code = NotFound desc = could not find container \"40628bac81574275841e387f0fe0e88f2a5408d8628a9a16319fdd661c1facf1\": container with ID starting with 40628bac81574275841e387f0fe0e88f2a5408d8628a9a16319fdd661c1facf1 not found: ID does not exist"
Jul 18 11:54:43.527313 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:54:43.527278    2579 scope.go:117] "RemoveContainer" containerID="c4ddb566511f02f00770168e0187f9ddb459faf64462bd431c9931fd63b3d251"
Jul 18 11:54:43.527593 ip-10-0-133-122 kubenswrapper[2579]: E0718 11:54:43.527571    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c4ddb566511f02f00770168e0187f9ddb459faf64462bd431c9931fd63b3d251\": container with ID starting with c4ddb566511f02f00770168e0187f9ddb459faf64462bd431c9931fd63b3d251 not found: ID does not exist" containerID="c4ddb566511f02f00770168e0187f9ddb459faf64462bd431c9931fd63b3d251"
Jul 18 11:54:43.527692 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:54:43.527599    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c4ddb566511f02f00770168e0187f9ddb459faf64462bd431c9931fd63b3d251"} err="failed to get container status \"c4ddb566511f02f00770168e0187f9ddb459faf64462bd431c9931fd63b3d251\": rpc error: code = NotFound desc = could not find container \"c4ddb566511f02f00770168e0187f9ddb459faf64462bd431c9931fd63b3d251\": container with ID starting with c4ddb566511f02f00770168e0187f9ddb459faf64462bd431c9931fd63b3d251 not found: ID does not exist"
Jul 18 11:54:43.529944 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:54:43.529922    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-a8e6b1ef-openshift-default-86d8cf8c99-k9zfs"]
Jul 18 11:54:44.894452 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:54:44.894418    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="be445a3f-848a-47d2-a111-2795fef74366" path="/var/lib/kubelet/pods/be445a3f-848a-47d2-a111-2795fef74366/volumes"
Jul 18 11:54:56.776285 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:54:56.776245    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-ed7924cb-openshift-default-885b9956c-7ggd8"]
Jul 18 11:54:56.776859 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:54:56.776842    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="be445a3f-848a-47d2-a111-2795fef74366" containerName="istio-proxy"
Jul 18 11:54:56.776859 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:54:56.776861    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="be445a3f-848a-47d2-a111-2795fef74366" containerName="istio-proxy"
Jul 18 11:54:56.777053 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:54:56.776899    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="be445a3f-848a-47d2-a111-2795fef74366" containerName="istio-proxy"
Jul 18 11:54:56.777053 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:54:56.776908    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="be445a3f-848a-47d2-a111-2795fef74366" containerName="istio-proxy"
Jul 18 11:54:56.777053 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:54:56.776928    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0608a562-144e-4a3f-a9f8-f60a142234c5" containerName="revoke-keys"
Jul 18 11:54:56.777053 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:54:56.776936    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="0608a562-144e-4a3f-a9f8-f60a142234c5" containerName="revoke-keys"
Jul 18 11:54:56.777053 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:54:56.777024    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="be445a3f-848a-47d2-a111-2795fef74366" containerName="istio-proxy"
Jul 18 11:54:56.777053 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:54:56.777036    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="be445a3f-848a-47d2-a111-2795fef74366" containerName="istio-proxy"
Jul 18 11:54:56.777053 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:54:56.777047    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="0608a562-144e-4a3f-a9f8-f60a142234c5" containerName="revoke-keys"
Jul 18 11:54:56.780571 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:54:56.780550    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-ed7924cb-openshift-default-885b9956c-7ggd8"
Jul 18 11:54:56.782946 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:54:56.782928    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 18 11:54:56.783041 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:54:56.782959    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-ed7924cb-openshift-default-dockercfg-pk2sb\""
Jul 18 11:54:56.791200 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:54:56.791176    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-ed7924cb-openshift-default-885b9956c-7ggd8"]
Jul 18 11:54:56.863231 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:54:56.863198    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1c4b9ec5-2c95-4165-8e1d-fd1cd5736940-credential-socket\") pod \"e2e-mt-ed7924cb-openshift-default-885b9956c-7ggd8\" (UID: \"1c4b9ec5-2c95-4165-8e1d-fd1cd5736940\") " pod="openshift-ingress/e2e-mt-ed7924cb-openshift-default-885b9956c-7ggd8"
Jul 18 11:54:56.863402 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:54:56.863244    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1c4b9ec5-2c95-4165-8e1d-fd1cd5736940-workload-socket\") pod \"e2e-mt-ed7924cb-openshift-default-885b9956c-7ggd8\" (UID: \"1c4b9ec5-2c95-4165-8e1d-fd1cd5736940\") " pod="openshift-ingress/e2e-mt-ed7924cb-openshift-default-885b9956c-7ggd8"
Jul 18 11:54:56.863402 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:54:56.863268    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1c4b9ec5-2c95-4165-8e1d-fd1cd5736940-istio-token\") pod \"e2e-mt-ed7924cb-openshift-default-885b9956c-7ggd8\" (UID: \"1c4b9ec5-2c95-4165-8e1d-fd1cd5736940\") " pod="openshift-ingress/e2e-mt-ed7924cb-openshift-default-885b9956c-7ggd8"
Jul 18 11:54:56.863402 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:54:56.863286    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1c4b9ec5-2c95-4165-8e1d-fd1cd5736940-istiod-ca-cert\") pod \"e2e-mt-ed7924cb-openshift-default-885b9956c-7ggd8\" (UID: \"1c4b9ec5-2c95-4165-8e1d-fd1cd5736940\") " pod="openshift-ingress/e2e-mt-ed7924cb-openshift-default-885b9956c-7ggd8"
Jul 18 11:54:56.863402 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:54:56.863357    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1c4b9ec5-2c95-4165-8e1d-fd1cd5736940-istio-podinfo\") pod \"e2e-mt-ed7924cb-openshift-default-885b9956c-7ggd8\" (UID: \"1c4b9ec5-2c95-4165-8e1d-fd1cd5736940\") " pod="openshift-ingress/e2e-mt-ed7924cb-openshift-default-885b9956c-7ggd8"
Jul 18 11:54:56.863576 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:54:56.863407    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1c4b9ec5-2c95-4165-8e1d-fd1cd5736940-istio-envoy\") pod \"e2e-mt-ed7924cb-openshift-default-885b9956c-7ggd8\" (UID: \"1c4b9ec5-2c95-4165-8e1d-fd1cd5736940\") " pod="openshift-ingress/e2e-mt-ed7924cb-openshift-default-885b9956c-7ggd8"
Jul 18 11:54:56.863576 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:54:56.863440    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1c4b9ec5-2c95-4165-8e1d-fd1cd5736940-istio-data\") pod \"e2e-mt-ed7924cb-openshift-default-885b9956c-7ggd8\" (UID: \"1c4b9ec5-2c95-4165-8e1d-fd1cd5736940\") " pod="openshift-ingress/e2e-mt-ed7924cb-openshift-default-885b9956c-7ggd8"
Jul 18 11:54:56.863576 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:54:56.863500    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-75b8m\" (UniqueName: \"kubernetes.io/projected/1c4b9ec5-2c95-4165-8e1d-fd1cd5736940-kube-api-access-75b8m\") pod \"e2e-mt-ed7924cb-openshift-default-885b9956c-7ggd8\" (UID: \"1c4b9ec5-2c95-4165-8e1d-fd1cd5736940\") " pod="openshift-ingress/e2e-mt-ed7924cb-openshift-default-885b9956c-7ggd8"
Jul 18 11:54:56.863576 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:54:56.863530    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1c4b9ec5-2c95-4165-8e1d-fd1cd5736940-workload-certs\") pod \"e2e-mt-ed7924cb-openshift-default-885b9956c-7ggd8\" (UID: \"1c4b9ec5-2c95-4165-8e1d-fd1cd5736940\") " pod="openshift-ingress/e2e-mt-ed7924cb-openshift-default-885b9956c-7ggd8"
Jul 18 11:54:56.965062 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:54:56.965027    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1c4b9ec5-2c95-4165-8e1d-fd1cd5736940-istio-podinfo\") pod \"e2e-mt-ed7924cb-openshift-default-885b9956c-7ggd8\" (UID: \"1c4b9ec5-2c95-4165-8e1d-fd1cd5736940\") " pod="openshift-ingress/e2e-mt-ed7924cb-openshift-default-885b9956c-7ggd8"
Jul 18 11:54:56.965235 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:54:56.965067    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1c4b9ec5-2c95-4165-8e1d-fd1cd5736940-istio-envoy\") pod \"e2e-mt-ed7924cb-openshift-default-885b9956c-7ggd8\" (UID: \"1c4b9ec5-2c95-4165-8e1d-fd1cd5736940\") " pod="openshift-ingress/e2e-mt-ed7924cb-openshift-default-885b9956c-7ggd8"
Jul 18 11:54:56.965235 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:54:56.965095    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1c4b9ec5-2c95-4165-8e1d-fd1cd5736940-istio-data\") pod \"e2e-mt-ed7924cb-openshift-default-885b9956c-7ggd8\" (UID: \"1c4b9ec5-2c95-4165-8e1d-fd1cd5736940\") " pod="openshift-ingress/e2e-mt-ed7924cb-openshift-default-885b9956c-7ggd8"
Jul 18 11:54:56.965235 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:54:56.965149    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-75b8m\" (UniqueName: \"kubernetes.io/projected/1c4b9ec5-2c95-4165-8e1d-fd1cd5736940-kube-api-access-75b8m\") pod \"e2e-mt-ed7924cb-openshift-default-885b9956c-7ggd8\" (UID: \"1c4b9ec5-2c95-4165-8e1d-fd1cd5736940\") " pod="openshift-ingress/e2e-mt-ed7924cb-openshift-default-885b9956c-7ggd8"
Jul 18 11:54:56.965235 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:54:56.965179    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1c4b9ec5-2c95-4165-8e1d-fd1cd5736940-workload-certs\") pod \"e2e-mt-ed7924cb-openshift-default-885b9956c-7ggd8\" (UID: \"1c4b9ec5-2c95-4165-8e1d-fd1cd5736940\") " pod="openshift-ingress/e2e-mt-ed7924cb-openshift-default-885b9956c-7ggd8"
Jul 18 11:54:56.965457 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:54:56.965241    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1c4b9ec5-2c95-4165-8e1d-fd1cd5736940-credential-socket\") pod \"e2e-mt-ed7924cb-openshift-default-885b9956c-7ggd8\" (UID: \"1c4b9ec5-2c95-4165-8e1d-fd1cd5736940\") " pod="openshift-ingress/e2e-mt-ed7924cb-openshift-default-885b9956c-7ggd8"
Jul 18 11:54:56.965457 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:54:56.965299    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1c4b9ec5-2c95-4165-8e1d-fd1cd5736940-workload-socket\") pod \"e2e-mt-ed7924cb-openshift-default-885b9956c-7ggd8\" (UID: \"1c4b9ec5-2c95-4165-8e1d-fd1cd5736940\") " pod="openshift-ingress/e2e-mt-ed7924cb-openshift-default-885b9956c-7ggd8"
Jul 18 11:54:56.965457 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:54:56.965323    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1c4b9ec5-2c95-4165-8e1d-fd1cd5736940-istio-token\") pod \"e2e-mt-ed7924cb-openshift-default-885b9956c-7ggd8\" (UID: \"1c4b9ec5-2c95-4165-8e1d-fd1cd5736940\") " pod="openshift-ingress/e2e-mt-ed7924cb-openshift-default-885b9956c-7ggd8"
Jul 18 11:54:56.965457 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:54:56.965352    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1c4b9ec5-2c95-4165-8e1d-fd1cd5736940-istiod-ca-cert\") pod \"e2e-mt-ed7924cb-openshift-default-885b9956c-7ggd8\" (UID: \"1c4b9ec5-2c95-4165-8e1d-fd1cd5736940\") " pod="openshift-ingress/e2e-mt-ed7924cb-openshift-default-885b9956c-7ggd8"
Jul 18 11:54:56.965677 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:54:56.965509    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1c4b9ec5-2c95-4165-8e1d-fd1cd5736940-istio-data\") pod \"e2e-mt-ed7924cb-openshift-default-885b9956c-7ggd8\" (UID: \"1c4b9ec5-2c95-4165-8e1d-fd1cd5736940\") " pod="openshift-ingress/e2e-mt-ed7924cb-openshift-default-885b9956c-7ggd8"
Jul 18 11:54:56.965677 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:54:56.965608    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1c4b9ec5-2c95-4165-8e1d-fd1cd5736940-credential-socket\") pod \"e2e-mt-ed7924cb-openshift-default-885b9956c-7ggd8\" (UID: \"1c4b9ec5-2c95-4165-8e1d-fd1cd5736940\") " pod="openshift-ingress/e2e-mt-ed7924cb-openshift-default-885b9956c-7ggd8"
Jul 18 11:54:56.965790 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:54:56.965775    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1c4b9ec5-2c95-4165-8e1d-fd1cd5736940-workload-socket\") pod \"e2e-mt-ed7924cb-openshift-default-885b9956c-7ggd8\" (UID: \"1c4b9ec5-2c95-4165-8e1d-fd1cd5736940\") " pod="openshift-ingress/e2e-mt-ed7924cb-openshift-default-885b9956c-7ggd8"
Jul 18 11:54:56.965856 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:54:56.965834    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1c4b9ec5-2c95-4165-8e1d-fd1cd5736940-workload-certs\") pod \"e2e-mt-ed7924cb-openshift-default-885b9956c-7ggd8\" (UID: \"1c4b9ec5-2c95-4165-8e1d-fd1cd5736940\") " pod="openshift-ingress/e2e-mt-ed7924cb-openshift-default-885b9956c-7ggd8"
Jul 18 11:54:56.966040 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:54:56.966022    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1c4b9ec5-2c95-4165-8e1d-fd1cd5736940-istiod-ca-cert\") pod \"e2e-mt-ed7924cb-openshift-default-885b9956c-7ggd8\" (UID: \"1c4b9ec5-2c95-4165-8e1d-fd1cd5736940\") " pod="openshift-ingress/e2e-mt-ed7924cb-openshift-default-885b9956c-7ggd8"
Jul 18 11:54:56.967467 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:54:56.967440    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1c4b9ec5-2c95-4165-8e1d-fd1cd5736940-istio-envoy\") pod \"e2e-mt-ed7924cb-openshift-default-885b9956c-7ggd8\" (UID: \"1c4b9ec5-2c95-4165-8e1d-fd1cd5736940\") " pod="openshift-ingress/e2e-mt-ed7924cb-openshift-default-885b9956c-7ggd8"
Jul 18 11:54:56.967965 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:54:56.967946    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1c4b9ec5-2c95-4165-8e1d-fd1cd5736940-istio-podinfo\") pod \"e2e-mt-ed7924cb-openshift-default-885b9956c-7ggd8\" (UID: \"1c4b9ec5-2c95-4165-8e1d-fd1cd5736940\") " pod="openshift-ingress/e2e-mt-ed7924cb-openshift-default-885b9956c-7ggd8"
Jul 18 11:54:56.972807 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:54:56.972784    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1c4b9ec5-2c95-4165-8e1d-fd1cd5736940-istio-token\") pod \"e2e-mt-ed7924cb-openshift-default-885b9956c-7ggd8\" (UID: \"1c4b9ec5-2c95-4165-8e1d-fd1cd5736940\") " pod="openshift-ingress/e2e-mt-ed7924cb-openshift-default-885b9956c-7ggd8"
Jul 18 11:54:56.973244 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:54:56.973223    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-75b8m\" (UniqueName: \"kubernetes.io/projected/1c4b9ec5-2c95-4165-8e1d-fd1cd5736940-kube-api-access-75b8m\") pod \"e2e-mt-ed7924cb-openshift-default-885b9956c-7ggd8\" (UID: \"1c4b9ec5-2c95-4165-8e1d-fd1cd5736940\") " pod="openshift-ingress/e2e-mt-ed7924cb-openshift-default-885b9956c-7ggd8"
Jul 18 11:54:57.092294 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:54:57.092205    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-ed7924cb-openshift-default-885b9956c-7ggd8"
Jul 18 11:54:57.232189 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:54:57.232163    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-ed7924cb-openshift-default-885b9956c-7ggd8"]
Jul 18 11:54:57.233874 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:54:57.233849    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1c4b9ec5_2c95_4165_8e1d_fd1cd5736940.slice/crio-b04663641eb883ef835390574d28b98ee4abecdf012db73a0e2f1ebffd088f7a WatchSource:0}: Error finding container b04663641eb883ef835390574d28b98ee4abecdf012db73a0e2f1ebffd088f7a: Status 404 returned error can't find the container with id b04663641eb883ef835390574d28b98ee4abecdf012db73a0e2f1ebffd088f7a
Jul 18 11:54:57.235958 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:54:57.235930    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 18 11:54:57.236030 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:54:57.235990    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 18 11:54:57.236079 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:54:57.236029    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 18 11:54:57.586777 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:54:57.586742    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-ed7924cb-openshift-default-885b9956c-7ggd8" event={"ID":"1c4b9ec5-2c95-4165-8e1d-fd1cd5736940","Type":"ContainerStarted","Data":"b9e083636b4241ebe48026c8caac286c32a6cfbd378e01530bd624f251312f2e"}
Jul 18 11:54:57.586990 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:54:57.586803    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-ed7924cb-openshift-default-885b9956c-7ggd8" event={"ID":"1c4b9ec5-2c95-4165-8e1d-fd1cd5736940","Type":"ContainerStarted","Data":"b04663641eb883ef835390574d28b98ee4abecdf012db73a0e2f1ebffd088f7a"}
Jul 18 11:54:57.610629 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:54:57.610578    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-ed7924cb-openshift-default-885b9956c-7ggd8" podStartSLOduration=1.6105620680000001 podStartE2EDuration="1.610562068s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 11:54:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 11:54:57.608957351 +0000 UTC m=+2117.223993652" watchObservedRunningTime="2026-07-18 11:54:57.610562068 +0000 UTC m=+2117.225598370"
Jul 18 11:54:58.092612 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:54:58.092573    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-ed7924cb-openshift-default-885b9956c-7ggd8"
Jul 18 11:54:58.097641 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:54:58.097617    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-ed7924cb-openshift-default-885b9956c-7ggd8"
Jul 18 11:54:58.591694 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:54:58.591649    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-ed7924cb-openshift-default-885b9956c-7ggd8"
Jul 18 11:54:58.592574 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:54:58.592552    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-ed7924cb-openshift-default-885b9956c-7ggd8"
Jul 18 11:55:09.235191 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:55:09.235150    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-mt-ed7924cb/e2e-lifecycle-model-ed7924cb-kserve-6bb84df7f9-6rt2h"]
Jul 18 11:55:09.252365 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:55:09.251320    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-ed7924cb/e2e-lifecycle-model-ed7924cb-kserve-6bb84df7f9-6rt2h"
Jul 18 11:55:09.253649 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:55:09.253073    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-ed7924cb/e2e-lifecycle-model-ed7924cb-kserve-6bb84df7f9-6rt2h"]
Jul 18 11:55:09.257795 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:55:09.255329    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-ed7924cb\"/\"default-dockercfg-kcb6n\""
Jul 18 11:55:09.257795 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:55:09.255340    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-ed7924cb\"/\"openshift-service-ca.crt\""
Jul 18 11:55:09.257795 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:55:09.255518    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-ed7924cb\"/\"e2e-lifecycle-model-ed7924cb-kserve-self-signed-certs\""
Jul 18 11:55:09.257795 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:55:09.255599    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-ed7924cb\"/\"kube-root-ca.crt\""
Jul 18 11:55:09.380374 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:55:09.380333    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/03054328-22b7-4460-9dc7-281b828e7dfe-model-cache\") pod \"e2e-lifecycle-model-ed7924cb-kserve-6bb84df7f9-6rt2h\" (UID: \"03054328-22b7-4460-9dc7-281b828e7dfe\") " pod="ai-tenant-e2e-mt-ed7924cb/e2e-lifecycle-model-ed7924cb-kserve-6bb84df7f9-6rt2h"
Jul 18 11:55:09.380583 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:55:09.380383    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/03054328-22b7-4460-9dc7-281b828e7dfe-tmp-dir\") pod \"e2e-lifecycle-model-ed7924cb-kserve-6bb84df7f9-6rt2h\" (UID: \"03054328-22b7-4460-9dc7-281b828e7dfe\") " pod="ai-tenant-e2e-mt-ed7924cb/e2e-lifecycle-model-ed7924cb-kserve-6bb84df7f9-6rt2h"
Jul 18 11:55:09.380583 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:55:09.380414    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/03054328-22b7-4460-9dc7-281b828e7dfe-dshm\") pod \"e2e-lifecycle-model-ed7924cb-kserve-6bb84df7f9-6rt2h\" (UID: \"03054328-22b7-4460-9dc7-281b828e7dfe\") " pod="ai-tenant-e2e-mt-ed7924cb/e2e-lifecycle-model-ed7924cb-kserve-6bb84df7f9-6rt2h"
Jul 18 11:55:09.380583 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:55:09.380450    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/03054328-22b7-4460-9dc7-281b828e7dfe-tls-certs\") pod \"e2e-lifecycle-model-ed7924cb-kserve-6bb84df7f9-6rt2h\" (UID: \"03054328-22b7-4460-9dc7-281b828e7dfe\") " pod="ai-tenant-e2e-mt-ed7924cb/e2e-lifecycle-model-ed7924cb-kserve-6bb84df7f9-6rt2h"
Jul 18 11:55:09.380583 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:55:09.380489    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-22mjh\" (UniqueName: \"kubernetes.io/projected/03054328-22b7-4460-9dc7-281b828e7dfe-kube-api-access-22mjh\") pod \"e2e-lifecycle-model-ed7924cb-kserve-6bb84df7f9-6rt2h\" (UID: \"03054328-22b7-4460-9dc7-281b828e7dfe\") " pod="ai-tenant-e2e-mt-ed7924cb/e2e-lifecycle-model-ed7924cb-kserve-6bb84df7f9-6rt2h"
Jul 18 11:55:09.380583 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:55:09.380513    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/03054328-22b7-4460-9dc7-281b828e7dfe-home\") pod \"e2e-lifecycle-model-ed7924cb-kserve-6bb84df7f9-6rt2h\" (UID: \"03054328-22b7-4460-9dc7-281b828e7dfe\") " pod="ai-tenant-e2e-mt-ed7924cb/e2e-lifecycle-model-ed7924cb-kserve-6bb84df7f9-6rt2h"
Jul 18 11:55:09.481085 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:55:09.481053    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/03054328-22b7-4460-9dc7-281b828e7dfe-dshm\") pod \"e2e-lifecycle-model-ed7924cb-kserve-6bb84df7f9-6rt2h\" (UID: \"03054328-22b7-4460-9dc7-281b828e7dfe\") " pod="ai-tenant-e2e-mt-ed7924cb/e2e-lifecycle-model-ed7924cb-kserve-6bb84df7f9-6rt2h"
Jul 18 11:55:09.481085 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:55:09.481088    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/03054328-22b7-4460-9dc7-281b828e7dfe-tls-certs\") pod \"e2e-lifecycle-model-ed7924cb-kserve-6bb84df7f9-6rt2h\" (UID: \"03054328-22b7-4460-9dc7-281b828e7dfe\") " pod="ai-tenant-e2e-mt-ed7924cb/e2e-lifecycle-model-ed7924cb-kserve-6bb84df7f9-6rt2h"
Jul 18 11:55:09.481309 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:55:09.481214    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-22mjh\" (UniqueName: \"kubernetes.io/projected/03054328-22b7-4460-9dc7-281b828e7dfe-kube-api-access-22mjh\") pod \"e2e-lifecycle-model-ed7924cb-kserve-6bb84df7f9-6rt2h\" (UID: \"03054328-22b7-4460-9dc7-281b828e7dfe\") " pod="ai-tenant-e2e-mt-ed7924cb/e2e-lifecycle-model-ed7924cb-kserve-6bb84df7f9-6rt2h"
Jul 18 11:55:09.481309 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:55:09.481251    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/03054328-22b7-4460-9dc7-281b828e7dfe-home\") pod \"e2e-lifecycle-model-ed7924cb-kserve-6bb84df7f9-6rt2h\" (UID: \"03054328-22b7-4460-9dc7-281b828e7dfe\") " pod="ai-tenant-e2e-mt-ed7924cb/e2e-lifecycle-model-ed7924cb-kserve-6bb84df7f9-6rt2h"
Jul 18 11:55:09.481439 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:55:09.481422    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/03054328-22b7-4460-9dc7-281b828e7dfe-model-cache\") pod \"e2e-lifecycle-model-ed7924cb-kserve-6bb84df7f9-6rt2h\" (UID: \"03054328-22b7-4460-9dc7-281b828e7dfe\") " pod="ai-tenant-e2e-mt-ed7924cb/e2e-lifecycle-model-ed7924cb-kserve-6bb84df7f9-6rt2h"
Jul 18 11:55:09.481491 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:55:09.481480    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/03054328-22b7-4460-9dc7-281b828e7dfe-tmp-dir\") pod \"e2e-lifecycle-model-ed7924cb-kserve-6bb84df7f9-6rt2h\" (UID: \"03054328-22b7-4460-9dc7-281b828e7dfe\") " pod="ai-tenant-e2e-mt-ed7924cb/e2e-lifecycle-model-ed7924cb-kserve-6bb84df7f9-6rt2h"
Jul 18 11:55:09.481630 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:55:09.481599    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/03054328-22b7-4460-9dc7-281b828e7dfe-home\") pod \"e2e-lifecycle-model-ed7924cb-kserve-6bb84df7f9-6rt2h\" (UID: \"03054328-22b7-4460-9dc7-281b828e7dfe\") " pod="ai-tenant-e2e-mt-ed7924cb/e2e-lifecycle-model-ed7924cb-kserve-6bb84df7f9-6rt2h"
Jul 18 11:55:09.481794 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:55:09.481769    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/03054328-22b7-4460-9dc7-281b828e7dfe-tmp-dir\") pod \"e2e-lifecycle-model-ed7924cb-kserve-6bb84df7f9-6rt2h\" (UID: \"03054328-22b7-4460-9dc7-281b828e7dfe\") " pod="ai-tenant-e2e-mt-ed7924cb/e2e-lifecycle-model-ed7924cb-kserve-6bb84df7f9-6rt2h"
Jul 18 11:55:09.481910 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:55:09.481832    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/03054328-22b7-4460-9dc7-281b828e7dfe-model-cache\") pod \"e2e-lifecycle-model-ed7924cb-kserve-6bb84df7f9-6rt2h\" (UID: \"03054328-22b7-4460-9dc7-281b828e7dfe\") " pod="ai-tenant-e2e-mt-ed7924cb/e2e-lifecycle-model-ed7924cb-kserve-6bb84df7f9-6rt2h"
Jul 18 11:55:09.483527 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:55:09.483505    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/03054328-22b7-4460-9dc7-281b828e7dfe-dshm\") pod \"e2e-lifecycle-model-ed7924cb-kserve-6bb84df7f9-6rt2h\" (UID: \"03054328-22b7-4460-9dc7-281b828e7dfe\") " pod="ai-tenant-e2e-mt-ed7924cb/e2e-lifecycle-model-ed7924cb-kserve-6bb84df7f9-6rt2h"
Jul 18 11:55:09.483722 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:55:09.483707    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/03054328-22b7-4460-9dc7-281b828e7dfe-tls-certs\") pod \"e2e-lifecycle-model-ed7924cb-kserve-6bb84df7f9-6rt2h\" (UID: \"03054328-22b7-4460-9dc7-281b828e7dfe\") " pod="ai-tenant-e2e-mt-ed7924cb/e2e-lifecycle-model-ed7924cb-kserve-6bb84df7f9-6rt2h"
Jul 18 11:55:09.493110 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:55:09.493051    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-22mjh\" (UniqueName: \"kubernetes.io/projected/03054328-22b7-4460-9dc7-281b828e7dfe-kube-api-access-22mjh\") pod \"e2e-lifecycle-model-ed7924cb-kserve-6bb84df7f9-6rt2h\" (UID: \"03054328-22b7-4460-9dc7-281b828e7dfe\") " pod="ai-tenant-e2e-mt-ed7924cb/e2e-lifecycle-model-ed7924cb-kserve-6bb84df7f9-6rt2h"
Jul 18 11:55:09.564117 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:55:09.564078    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-ed7924cb/e2e-lifecycle-model-ed7924cb-kserve-6bb84df7f9-6rt2h"
Jul 18 11:55:09.728192 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:55:09.728164    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-ed7924cb/e2e-lifecycle-model-ed7924cb-kserve-6bb84df7f9-6rt2h"]
Jul 18 11:55:09.731716 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:55:09.731691    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod03054328_22b7_4460_9dc7_281b828e7dfe.slice/crio-fd6a86bd234043a8ae0d8acc9c8bb6f61380414f0ffc480eb911cfaab5345a2e WatchSource:0}: Error finding container fd6a86bd234043a8ae0d8acc9c8bb6f61380414f0ffc480eb911cfaab5345a2e: Status 404 returned error can't find the container with id fd6a86bd234043a8ae0d8acc9c8bb6f61380414f0ffc480eb911cfaab5345a2e
Jul 18 11:55:10.669195 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:55:10.669158    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-ed7924cb/e2e-lifecycle-model-ed7924cb-kserve-6bb84df7f9-6rt2h" event={"ID":"03054328-22b7-4460-9dc7-281b828e7dfe","Type":"ContainerStarted","Data":"3e5e999175ea5c2c32c822ffba86275c648c7f8487dd4bd95acdfafb88a0dd1b"}
Jul 18 11:55:10.669607 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:55:10.669208    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-ed7924cb/e2e-lifecycle-model-ed7924cb-kserve-6bb84df7f9-6rt2h" event={"ID":"03054328-22b7-4460-9dc7-281b828e7dfe","Type":"ContainerStarted","Data":"fd6a86bd234043a8ae0d8acc9c8bb6f61380414f0ffc480eb911cfaab5345a2e"}
Jul 18 11:55:10.692739 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:55:10.692680    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-mt-ed7924cb/e2e-lifecycle-model-ed7924cb-kserve-6bb84df7f9-6rt2h" podStartSLOduration=1.692663439 podStartE2EDuration="1.692663439s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 11:55:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 11:55:10.690413865 +0000 UTC m=+2130.305450169" watchObservedRunningTime="2026-07-18 11:55:10.692663439 +0000 UTC m=+2130.307699794"
Jul 18 11:55:12.682936 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:55:12.682899    2579 generic.go:356] "Generic (PLEG): container finished" podID="1c4b9ec5-2c95-4165-8e1d-fd1cd5736940" containerID="b9e083636b4241ebe48026c8caac286c32a6cfbd378e01530bd624f251312f2e" exitCode=0
Jul 18 11:55:12.683334 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:55:12.682958    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-ed7924cb-openshift-default-885b9956c-7ggd8" event={"ID":"1c4b9ec5-2c95-4165-8e1d-fd1cd5736940","Type":"ContainerDied","Data":"b9e083636b4241ebe48026c8caac286c32a6cfbd378e01530bd624f251312f2e"}
Jul 18 11:55:12.683378 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:55:12.683352    2579 scope.go:117] "RemoveContainer" containerID="b9e083636b4241ebe48026c8caac286c32a6cfbd378e01530bd624f251312f2e"
Jul 18 11:55:12.684396 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:55:12.684366    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 18 11:55:12.684496 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:55:12.684435    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 18 11:55:12.684496 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:55:12.684467    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 18 11:55:13.592451 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:55:13.592416    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-ed7924cb-openshift-default-885b9956c-7ggd8"
Jul 18 11:55:13.689672 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:55:13.689640    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-ed7924cb-openshift-default-885b9956c-7ggd8" event={"ID":"1c4b9ec5-2c95-4165-8e1d-fd1cd5736940","Type":"ContainerStarted","Data":"95369cf13063452b9a899d95b07d8173be42549ba55d9887374d41615cae3252"}
Jul 18 11:55:14.093321 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:55:14.093291    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-ed7924cb-openshift-default-885b9956c-7ggd8"
Jul 18 11:55:14.094679 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:55:14.094646    2579 patch_prober.go:28] interesting pod/e2e-mt-ed7924cb-openshift-default-885b9956c-7ggd8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused" start-of-body=
Jul 18 11:55:14.094813 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:55:14.094700    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-ed7924cb-openshift-default-885b9956c-7ggd8" podUID="1c4b9ec5-2c95-4165-8e1d-fd1cd5736940" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused"
Jul 18 11:55:15.093554 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:55:15.093514    2579 patch_prober.go:28] interesting pod/e2e-mt-ed7924cb-openshift-default-885b9956c-7ggd8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused" start-of-body=
Jul 18 11:55:15.094100 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:55:15.093578    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-ed7924cb-openshift-default-885b9956c-7ggd8" podUID="1c4b9ec5-2c95-4165-8e1d-fd1cd5736940" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused"
Jul 18 11:55:16.092707 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:55:16.092667    2579 patch_prober.go:28] interesting pod/e2e-mt-ed7924cb-openshift-default-885b9956c-7ggd8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused" start-of-body=
Jul 18 11:55:16.092925 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:55:16.092728    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-ed7924cb-openshift-default-885b9956c-7ggd8" podUID="1c4b9ec5-2c95-4165-8e1d-fd1cd5736940" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused"
Jul 18 11:55:17.093046 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:55:17.093010    2579 patch_prober.go:28] interesting pod/e2e-mt-ed7924cb-openshift-default-885b9956c-7ggd8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused" start-of-body=
Jul 18 11:55:17.093456 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:55:17.093068    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-ed7924cb-openshift-default-885b9956c-7ggd8" podUID="1c4b9ec5-2c95-4165-8e1d-fd1cd5736940" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused"
Jul 18 11:55:18.096850 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:55:18.096819    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-ed7924cb-openshift-default-885b9956c-7ggd8"
Jul 18 11:55:18.097360 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:55:18.097221    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-ed7924cb-openshift-default-885b9956c-7ggd8"
Jul 18 11:55:18.097922 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:55:18.097902    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-ed7924cb-openshift-default-885b9956c-7ggd8"
Jul 18 11:55:19.564316 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:55:19.564276    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-mt-ed7924cb/e2e-lifecycle-model-ed7924cb-kserve-6bb84df7f9-6rt2h"
Jul 18 11:55:19.564707 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:55:19.564338    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-mt-ed7924cb/e2e-lifecycle-model-ed7924cb-kserve-6bb84df7f9-6rt2h"
Jul 18 11:55:19.576991 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:55:19.576967    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-mt-ed7924cb/e2e-lifecycle-model-ed7924cb-kserve-6bb84df7f9-6rt2h"
Jul 18 11:55:19.738009 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:55:19.737982    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-mt-ed7924cb/e2e-lifecycle-model-ed7924cb-kserve-6bb84df7f9-6rt2h"
Jul 18 11:55:59.657898 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:55:59.657863    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-ed7924cb/e2e-lifecycle-model-ed7924cb-kserve-6bb84df7f9-6rt2h"]
Jul 18 11:56:14.678619 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:56:14.678566    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-mt-ed7924cb/e2e-lifecycle-model-ed7924cb-kserve-6bb84df7f9-6rt2h" podUID="03054328-22b7-4460-9dc7-281b828e7dfe" containerName="main" containerID="cri-o://3e5e999175ea5c2c32c822ffba86275c648c7f8487dd4bd95acdfafb88a0dd1b" gracePeriod=45
Jul 18 11:56:14.937810 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:56:14.937742    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-ed7924cb/e2e-lifecycle-model-ed7924cb-kserve-6bb84df7f9-6rt2h"
Jul 18 11:56:15.015391 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:56:15.015355    2579 generic.go:356] "Generic (PLEG): container finished" podID="03054328-22b7-4460-9dc7-281b828e7dfe" containerID="3e5e999175ea5c2c32c822ffba86275c648c7f8487dd4bd95acdfafb88a0dd1b" exitCode=0
Jul 18 11:56:15.015564 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:56:15.015398    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-ed7924cb/e2e-lifecycle-model-ed7924cb-kserve-6bb84df7f9-6rt2h"
Jul 18 11:56:15.015564 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:56:15.015414    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-ed7924cb/e2e-lifecycle-model-ed7924cb-kserve-6bb84df7f9-6rt2h" event={"ID":"03054328-22b7-4460-9dc7-281b828e7dfe","Type":"ContainerDied","Data":"3e5e999175ea5c2c32c822ffba86275c648c7f8487dd4bd95acdfafb88a0dd1b"}
Jul 18 11:56:15.015564 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:56:15.015447    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-ed7924cb/e2e-lifecycle-model-ed7924cb-kserve-6bb84df7f9-6rt2h" event={"ID":"03054328-22b7-4460-9dc7-281b828e7dfe","Type":"ContainerDied","Data":"fd6a86bd234043a8ae0d8acc9c8bb6f61380414f0ffc480eb911cfaab5345a2e"}
Jul 18 11:56:15.015564 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:56:15.015464    2579 scope.go:117] "RemoveContainer" containerID="3e5e999175ea5c2c32c822ffba86275c648c7f8487dd4bd95acdfafb88a0dd1b"
Jul 18 11:56:15.024228 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:56:15.024209    2579 scope.go:117] "RemoveContainer" containerID="3e5e999175ea5c2c32c822ffba86275c648c7f8487dd4bd95acdfafb88a0dd1b"
Jul 18 11:56:15.024510 ip-10-0-133-122 kubenswrapper[2579]: E0718 11:56:15.024488    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3e5e999175ea5c2c32c822ffba86275c648c7f8487dd4bd95acdfafb88a0dd1b\": container with ID starting with 3e5e999175ea5c2c32c822ffba86275c648c7f8487dd4bd95acdfafb88a0dd1b not found: ID does not exist" containerID="3e5e999175ea5c2c32c822ffba86275c648c7f8487dd4bd95acdfafb88a0dd1b"
Jul 18 11:56:15.024615 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:56:15.024517    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3e5e999175ea5c2c32c822ffba86275c648c7f8487dd4bd95acdfafb88a0dd1b"} err="failed to get container status \"3e5e999175ea5c2c32c822ffba86275c648c7f8487dd4bd95acdfafb88a0dd1b\": rpc error: code = NotFound desc = could not find container \"3e5e999175ea5c2c32c822ffba86275c648c7f8487dd4bd95acdfafb88a0dd1b\": container with ID starting with 3e5e999175ea5c2c32c822ffba86275c648c7f8487dd4bd95acdfafb88a0dd1b not found: ID does not exist"
Jul 18 11:56:15.070689 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:56:15.070656    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/03054328-22b7-4460-9dc7-281b828e7dfe-tls-certs\") pod \"03054328-22b7-4460-9dc7-281b828e7dfe\" (UID: \"03054328-22b7-4460-9dc7-281b828e7dfe\") "
Jul 18 11:56:15.070872 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:56:15.070762    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/03054328-22b7-4460-9dc7-281b828e7dfe-tmp-dir\") pod \"03054328-22b7-4460-9dc7-281b828e7dfe\" (UID: \"03054328-22b7-4460-9dc7-281b828e7dfe\") "
Jul 18 11:56:15.070872 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:56:15.070786    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/03054328-22b7-4460-9dc7-281b828e7dfe-dshm\") pod \"03054328-22b7-4460-9dc7-281b828e7dfe\" (UID: \"03054328-22b7-4460-9dc7-281b828e7dfe\") "
Jul 18 11:56:15.070872 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:56:15.070821    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/03054328-22b7-4460-9dc7-281b828e7dfe-home\") pod \"03054328-22b7-4460-9dc7-281b828e7dfe\" (UID: \"03054328-22b7-4460-9dc7-281b828e7dfe\") "
Jul 18 11:56:15.071076 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:56:15.070937    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/03054328-22b7-4460-9dc7-281b828e7dfe-model-cache\") pod \"03054328-22b7-4460-9dc7-281b828e7dfe\" (UID: \"03054328-22b7-4460-9dc7-281b828e7dfe\") "
Jul 18 11:56:15.071076 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:56:15.070974    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-22mjh\" (UniqueName: \"kubernetes.io/projected/03054328-22b7-4460-9dc7-281b828e7dfe-kube-api-access-22mjh\") pod \"03054328-22b7-4460-9dc7-281b828e7dfe\" (UID: \"03054328-22b7-4460-9dc7-281b828e7dfe\") "
Jul 18 11:56:15.071192 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:56:15.071104    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/03054328-22b7-4460-9dc7-281b828e7dfe-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "03054328-22b7-4460-9dc7-281b828e7dfe" (UID: "03054328-22b7-4460-9dc7-281b828e7dfe"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 11:56:15.071246 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:56:15.071196    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/03054328-22b7-4460-9dc7-281b828e7dfe-home" (OuterVolumeSpecName: "home") pod "03054328-22b7-4460-9dc7-281b828e7dfe" (UID: "03054328-22b7-4460-9dc7-281b828e7dfe"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 11:56:15.071302 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:56:15.071249    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/03054328-22b7-4460-9dc7-281b828e7dfe-model-cache" (OuterVolumeSpecName: "model-cache") pod "03054328-22b7-4460-9dc7-281b828e7dfe" (UID: "03054328-22b7-4460-9dc7-281b828e7dfe"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 11:56:15.071356 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:56:15.071317    2579 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/03054328-22b7-4460-9dc7-281b828e7dfe-home\") on node \"ip-10-0-133-122.ec2.internal\" DevicePath \"\""
Jul 18 11:56:15.071402 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:56:15.071364    2579 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/03054328-22b7-4460-9dc7-281b828e7dfe-tmp-dir\") on node \"ip-10-0-133-122.ec2.internal\" DevicePath \"\""
Jul 18 11:56:15.073088 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:56:15.073065    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/03054328-22b7-4460-9dc7-281b828e7dfe-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "03054328-22b7-4460-9dc7-281b828e7dfe" (UID: "03054328-22b7-4460-9dc7-281b828e7dfe"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 18 11:56:15.073197 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:56:15.073071    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/03054328-22b7-4460-9dc7-281b828e7dfe-dshm" (OuterVolumeSpecName: "dshm") pod "03054328-22b7-4460-9dc7-281b828e7dfe" (UID: "03054328-22b7-4460-9dc7-281b828e7dfe"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 11:56:15.073197 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:56:15.073108    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/03054328-22b7-4460-9dc7-281b828e7dfe-kube-api-access-22mjh" (OuterVolumeSpecName: "kube-api-access-22mjh") pod "03054328-22b7-4460-9dc7-281b828e7dfe" (UID: "03054328-22b7-4460-9dc7-281b828e7dfe"). InnerVolumeSpecName "kube-api-access-22mjh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 18 11:56:15.171992 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:56:15.171952    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-22mjh\" (UniqueName: \"kubernetes.io/projected/03054328-22b7-4460-9dc7-281b828e7dfe-kube-api-access-22mjh\") on node \"ip-10-0-133-122.ec2.internal\" DevicePath \"\""
Jul 18 11:56:15.171992 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:56:15.171984    2579 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/03054328-22b7-4460-9dc7-281b828e7dfe-tls-certs\") on node \"ip-10-0-133-122.ec2.internal\" DevicePath \"\""
Jul 18 11:56:15.171992 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:56:15.171994    2579 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/03054328-22b7-4460-9dc7-281b828e7dfe-dshm\") on node \"ip-10-0-133-122.ec2.internal\" DevicePath \"\""
Jul 18 11:56:15.171992 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:56:15.172001    2579 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/03054328-22b7-4460-9dc7-281b828e7dfe-model-cache\") on node \"ip-10-0-133-122.ec2.internal\" DevicePath \"\""
Jul 18 11:56:15.338348 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:56:15.338312    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-ed7924cb/e2e-lifecycle-model-ed7924cb-kserve-6bb84df7f9-6rt2h"]
Jul 18 11:56:15.341989 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:56:15.341963    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-mt-ed7924cb/e2e-lifecycle-model-ed7924cb-kserve-6bb84df7f9-6rt2h"]
Jul 18 11:56:16.895555 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:56:16.895518    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="03054328-22b7-4460-9dc7-281b828e7dfe" path="/var/lib/kubelet/pods/03054328-22b7-4460-9dc7-281b828e7dfe/volumes"
Jul 18 11:56:41.178692 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:56:41.178659    2579 scope.go:117] "RemoveContainer" containerID="9e1748bd5e4b46311b843b1a2c1b660fa3e249466df45c85a57b48d20e3549c9"
Jul 18 11:56:42.999455 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:56:42.999421    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-ed7924cb-openshift-default-885b9956c-7ggd8"]
Jul 18 11:56:43.000353 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:56:42.999664    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-ed7924cb-openshift-default-885b9956c-7ggd8" podUID="1c4b9ec5-2c95-4165-8e1d-fd1cd5736940" containerName="istio-proxy" containerID="cri-o://95369cf13063452b9a899d95b07d8173be42549ba55d9887374d41615cae3252" gracePeriod=30
Jul 18 11:56:48.098428 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:56:48.098389    2579 patch_prober.go:28] interesting pod/e2e-mt-ed7924cb-openshift-default-885b9956c-7ggd8 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused" start-of-body=
Jul 18 11:56:48.098936 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:56:48.098466    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-ed7924cb-openshift-default-885b9956c-7ggd8" podUID="1c4b9ec5-2c95-4165-8e1d-fd1cd5736940" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused"
Jul 18 11:56:48.197016 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:56:48.196977    2579 generic.go:356] "Generic (PLEG): container finished" podID="1c4b9ec5-2c95-4165-8e1d-fd1cd5736940" containerID="95369cf13063452b9a899d95b07d8173be42549ba55d9887374d41615cae3252" exitCode=0
Jul 18 11:56:48.197177 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:56:48.197050    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-ed7924cb-openshift-default-885b9956c-7ggd8" event={"ID":"1c4b9ec5-2c95-4165-8e1d-fd1cd5736940","Type":"ContainerDied","Data":"95369cf13063452b9a899d95b07d8173be42549ba55d9887374d41615cae3252"}
Jul 18 11:56:48.197177 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:56:48.197129    2579 scope.go:117] "RemoveContainer" containerID="b9e083636b4241ebe48026c8caac286c32a6cfbd378e01530bd624f251312f2e"
Jul 18 11:56:48.258702 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:56:48.258672    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-ed7924cb-openshift-default-885b9956c-7ggd8"
Jul 18 11:56:48.369607 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:56:48.369571    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1c4b9ec5-2c95-4165-8e1d-fd1cd5736940-istio-data\") pod \"1c4b9ec5-2c95-4165-8e1d-fd1cd5736940\" (UID: \"1c4b9ec5-2c95-4165-8e1d-fd1cd5736940\") "
Jul 18 11:56:48.369811 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:56:48.369642    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1c4b9ec5-2c95-4165-8e1d-fd1cd5736940-credential-socket\") pod \"1c4b9ec5-2c95-4165-8e1d-fd1cd5736940\" (UID: \"1c4b9ec5-2c95-4165-8e1d-fd1cd5736940\") "
Jul 18 11:56:48.369811 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:56:48.369694    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1c4b9ec5-2c95-4165-8e1d-fd1cd5736940-workload-socket\") pod \"1c4b9ec5-2c95-4165-8e1d-fd1cd5736940\" (UID: \"1c4b9ec5-2c95-4165-8e1d-fd1cd5736940\") "
Jul 18 11:56:48.369811 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:56:48.369711    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1c4b9ec5-2c95-4165-8e1d-fd1cd5736940-istiod-ca-cert\") pod \"1c4b9ec5-2c95-4165-8e1d-fd1cd5736940\" (UID: \"1c4b9ec5-2c95-4165-8e1d-fd1cd5736940\") "
Jul 18 11:56:48.369811 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:56:48.369726    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1c4b9ec5-2c95-4165-8e1d-fd1cd5736940-workload-certs\") pod \"1c4b9ec5-2c95-4165-8e1d-fd1cd5736940\" (UID: \"1c4b9ec5-2c95-4165-8e1d-fd1cd5736940\") "
Jul 18 11:56:48.369811 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:56:48.369753    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-75b8m\" (UniqueName: \"kubernetes.io/projected/1c4b9ec5-2c95-4165-8e1d-fd1cd5736940-kube-api-access-75b8m\") pod \"1c4b9ec5-2c95-4165-8e1d-fd1cd5736940\" (UID: \"1c4b9ec5-2c95-4165-8e1d-fd1cd5736940\") "
Jul 18 11:56:48.369811 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:56:48.369794    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1c4b9ec5-2c95-4165-8e1d-fd1cd5736940-istio-token\") pod \"1c4b9ec5-2c95-4165-8e1d-fd1cd5736940\" (UID: \"1c4b9ec5-2c95-4165-8e1d-fd1cd5736940\") "
Jul 18 11:56:48.370210 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:56:48.369832    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1c4b9ec5-2c95-4165-8e1d-fd1cd5736940-istio-podinfo\") pod \"1c4b9ec5-2c95-4165-8e1d-fd1cd5736940\" (UID: \"1c4b9ec5-2c95-4165-8e1d-fd1cd5736940\") "
Jul 18 11:56:48.370210 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:56:48.369857    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1c4b9ec5-2c95-4165-8e1d-fd1cd5736940-istio-envoy\") pod \"1c4b9ec5-2c95-4165-8e1d-fd1cd5736940\" (UID: \"1c4b9ec5-2c95-4165-8e1d-fd1cd5736940\") "
Jul 18 11:56:48.370210 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:56:48.369998    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1c4b9ec5-2c95-4165-8e1d-fd1cd5736940-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "1c4b9ec5-2c95-4165-8e1d-fd1cd5736940" (UID: "1c4b9ec5-2c95-4165-8e1d-fd1cd5736940"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 11:56:48.370210 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:56:48.370060    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1c4b9ec5-2c95-4165-8e1d-fd1cd5736940-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "1c4b9ec5-2c95-4165-8e1d-fd1cd5736940" (UID: "1c4b9ec5-2c95-4165-8e1d-fd1cd5736940"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 11:56:48.370210 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:56:48.370099    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1c4b9ec5-2c95-4165-8e1d-fd1cd5736940-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "1c4b9ec5-2c95-4165-8e1d-fd1cd5736940" (UID: "1c4b9ec5-2c95-4165-8e1d-fd1cd5736940"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 11:56:48.370210 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:56:48.370127    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1c4b9ec5-2c95-4165-8e1d-fd1cd5736940-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "1c4b9ec5-2c95-4165-8e1d-fd1cd5736940" (UID: "1c4b9ec5-2c95-4165-8e1d-fd1cd5736940"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 18 11:56:48.370485 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:56:48.370235    2579 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1c4b9ec5-2c95-4165-8e1d-fd1cd5736940-credential-socket\") on node \"ip-10-0-133-122.ec2.internal\" DevicePath \"\""
Jul 18 11:56:48.370485 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:56:48.370253    2579 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1c4b9ec5-2c95-4165-8e1d-fd1cd5736940-workload-socket\") on node \"ip-10-0-133-122.ec2.internal\" DevicePath \"\""
Jul 18 11:56:48.370485 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:56:48.370267    2579 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1c4b9ec5-2c95-4165-8e1d-fd1cd5736940-istiod-ca-cert\") on node \"ip-10-0-133-122.ec2.internal\" DevicePath \"\""
Jul 18 11:56:48.370485 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:56:48.370283    2579 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1c4b9ec5-2c95-4165-8e1d-fd1cd5736940-workload-certs\") on node \"ip-10-0-133-122.ec2.internal\" DevicePath \"\""
Jul 18 11:56:48.370670 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:56:48.370644    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1c4b9ec5-2c95-4165-8e1d-fd1cd5736940-istio-data" (OuterVolumeSpecName: "istio-data") pod "1c4b9ec5-2c95-4165-8e1d-fd1cd5736940" (UID: "1c4b9ec5-2c95-4165-8e1d-fd1cd5736940"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 11:56:48.372137 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:56:48.372116    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/1c4b9ec5-2c95-4165-8e1d-fd1cd5736940-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "1c4b9ec5-2c95-4165-8e1d-fd1cd5736940" (UID: "1c4b9ec5-2c95-4165-8e1d-fd1cd5736940"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 18 11:56:48.372137 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:56:48.372123    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1c4b9ec5-2c95-4165-8e1d-fd1cd5736940-istio-token" (OuterVolumeSpecName: "istio-token") pod "1c4b9ec5-2c95-4165-8e1d-fd1cd5736940" (UID: "1c4b9ec5-2c95-4165-8e1d-fd1cd5736940"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 18 11:56:48.372429 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:56:48.372414    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1c4b9ec5-2c95-4165-8e1d-fd1cd5736940-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "1c4b9ec5-2c95-4165-8e1d-fd1cd5736940" (UID: "1c4b9ec5-2c95-4165-8e1d-fd1cd5736940"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 11:56:48.372429 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:56:48.372419    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1c4b9ec5-2c95-4165-8e1d-fd1cd5736940-kube-api-access-75b8m" (OuterVolumeSpecName: "kube-api-access-75b8m") pod "1c4b9ec5-2c95-4165-8e1d-fd1cd5736940" (UID: "1c4b9ec5-2c95-4165-8e1d-fd1cd5736940"). InnerVolumeSpecName "kube-api-access-75b8m". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 18 11:56:48.471305 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:56:48.471267    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-75b8m\" (UniqueName: \"kubernetes.io/projected/1c4b9ec5-2c95-4165-8e1d-fd1cd5736940-kube-api-access-75b8m\") on node \"ip-10-0-133-122.ec2.internal\" DevicePath \"\""
Jul 18 11:56:48.471305 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:56:48.471300    2579 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1c4b9ec5-2c95-4165-8e1d-fd1cd5736940-istio-token\") on node \"ip-10-0-133-122.ec2.internal\" DevicePath \"\""
Jul 18 11:56:48.471305 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:56:48.471309    2579 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1c4b9ec5-2c95-4165-8e1d-fd1cd5736940-istio-podinfo\") on node \"ip-10-0-133-122.ec2.internal\" DevicePath \"\""
Jul 18 11:56:48.471554 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:56:48.471317    2579 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1c4b9ec5-2c95-4165-8e1d-fd1cd5736940-istio-envoy\") on node \"ip-10-0-133-122.ec2.internal\" DevicePath \"\""
Jul 18 11:56:48.471554 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:56:48.471325    2579 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1c4b9ec5-2c95-4165-8e1d-fd1cd5736940-istio-data\") on node \"ip-10-0-133-122.ec2.internal\" DevicePath \"\""
Jul 18 11:56:49.203860 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:56:49.203772    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-ed7924cb-openshift-default-885b9956c-7ggd8"
Jul 18 11:56:49.203860 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:56:49.203771    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-ed7924cb-openshift-default-885b9956c-7ggd8" event={"ID":"1c4b9ec5-2c95-4165-8e1d-fd1cd5736940","Type":"ContainerDied","Data":"b04663641eb883ef835390574d28b98ee4abecdf012db73a0e2f1ebffd088f7a"}
Jul 18 11:56:49.204418 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:56:49.203925    2579 scope.go:117] "RemoveContainer" containerID="95369cf13063452b9a899d95b07d8173be42549ba55d9887374d41615cae3252"
Jul 18 11:56:49.221964 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:56:49.221936    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-ed7924cb-openshift-default-885b9956c-7ggd8"]
Jul 18 11:56:49.229014 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:56:49.228988    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-ed7924cb-openshift-default-885b9956c-7ggd8"]
Jul 18 11:56:50.901342 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:56:50.901306    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1c4b9ec5-2c95-4165-8e1d-fd1cd5736940" path="/var/lib/kubelet/pods/1c4b9ec5-2c95-4165-8e1d-fd1cd5736940/volumes"
Jul 18 11:57:39.366861 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:57:39.366829    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-f7319d-openshift-default-6ddbbd4f57-hbg78"]
Jul 18 11:57:39.367477 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:57:39.367295    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1c4b9ec5-2c95-4165-8e1d-fd1cd5736940" containerName="istio-proxy"
Jul 18 11:57:39.367477 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:57:39.367310    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="1c4b9ec5-2c95-4165-8e1d-fd1cd5736940" containerName="istio-proxy"
Jul 18 11:57:39.367477 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:57:39.367318    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="03054328-22b7-4460-9dc7-281b828e7dfe" containerName="main"
Jul 18 11:57:39.367477 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:57:39.367323    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="03054328-22b7-4460-9dc7-281b828e7dfe" containerName="main"
Jul 18 11:57:39.367477 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:57:39.367403    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="03054328-22b7-4460-9dc7-281b828e7dfe" containerName="main"
Jul 18 11:57:39.367477 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:57:39.367410    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="1c4b9ec5-2c95-4165-8e1d-fd1cd5736940" containerName="istio-proxy"
Jul 18 11:57:39.367477 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:57:39.367417    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="1c4b9ec5-2c95-4165-8e1d-fd1cd5736940" containerName="istio-proxy"
Jul 18 11:57:39.370519 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:57:39.370501    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-f7319d-openshift-default-6ddbbd4f57-hbg78"
Jul 18 11:57:39.372990 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:57:39.372973    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-f7319d-openshift-default-dockercfg-r226s\""
Jul 18 11:57:39.373263 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:57:39.373246    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 18 11:57:39.383275 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:57:39.383226    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-f7319d-openshift-default-6ddbbd4f57-hbg78"]
Jul 18 11:57:39.432535 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:57:39.432496    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ded7ed55-8b67-4540-9168-64245fbf1807-istio-envoy\") pod \"e2e-inf-a-f7319d-openshift-default-6ddbbd4f57-hbg78\" (UID: \"ded7ed55-8b67-4540-9168-64245fbf1807\") " pod="openshift-ingress/e2e-inf-a-f7319d-openshift-default-6ddbbd4f57-hbg78"
Jul 18 11:57:39.432535 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:57:39.432535    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5dkmw\" (UniqueName: \"kubernetes.io/projected/ded7ed55-8b67-4540-9168-64245fbf1807-kube-api-access-5dkmw\") pod \"e2e-inf-a-f7319d-openshift-default-6ddbbd4f57-hbg78\" (UID: \"ded7ed55-8b67-4540-9168-64245fbf1807\") " pod="openshift-ingress/e2e-inf-a-f7319d-openshift-default-6ddbbd4f57-hbg78"
Jul 18 11:57:39.432800 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:57:39.432572    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ded7ed55-8b67-4540-9168-64245fbf1807-workload-socket\") pod \"e2e-inf-a-f7319d-openshift-default-6ddbbd4f57-hbg78\" (UID: \"ded7ed55-8b67-4540-9168-64245fbf1807\") " pod="openshift-ingress/e2e-inf-a-f7319d-openshift-default-6ddbbd4f57-hbg78"
Jul 18 11:57:39.432800 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:57:39.432619    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ded7ed55-8b67-4540-9168-64245fbf1807-istio-podinfo\") pod \"e2e-inf-a-f7319d-openshift-default-6ddbbd4f57-hbg78\" (UID: \"ded7ed55-8b67-4540-9168-64245fbf1807\") " pod="openshift-ingress/e2e-inf-a-f7319d-openshift-default-6ddbbd4f57-hbg78"
Jul 18 11:57:39.432800 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:57:39.432652    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ded7ed55-8b67-4540-9168-64245fbf1807-credential-socket\") pod \"e2e-inf-a-f7319d-openshift-default-6ddbbd4f57-hbg78\" (UID: \"ded7ed55-8b67-4540-9168-64245fbf1807\") " pod="openshift-ingress/e2e-inf-a-f7319d-openshift-default-6ddbbd4f57-hbg78"
Jul 18 11:57:39.432800 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:57:39.432671    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ded7ed55-8b67-4540-9168-64245fbf1807-workload-certs\") pod \"e2e-inf-a-f7319d-openshift-default-6ddbbd4f57-hbg78\" (UID: \"ded7ed55-8b67-4540-9168-64245fbf1807\") " pod="openshift-ingress/e2e-inf-a-f7319d-openshift-default-6ddbbd4f57-hbg78"
Jul 18 11:57:39.432800 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:57:39.432689    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ded7ed55-8b67-4540-9168-64245fbf1807-istio-token\") pod \"e2e-inf-a-f7319d-openshift-default-6ddbbd4f57-hbg78\" (UID: \"ded7ed55-8b67-4540-9168-64245fbf1807\") " pod="openshift-ingress/e2e-inf-a-f7319d-openshift-default-6ddbbd4f57-hbg78"
Jul 18 11:57:39.432800 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:57:39.432717    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ded7ed55-8b67-4540-9168-64245fbf1807-istiod-ca-cert\") pod \"e2e-inf-a-f7319d-openshift-default-6ddbbd4f57-hbg78\" (UID: \"ded7ed55-8b67-4540-9168-64245fbf1807\") " pod="openshift-ingress/e2e-inf-a-f7319d-openshift-default-6ddbbd4f57-hbg78"
Jul 18 11:57:39.432800 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:57:39.432771    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ded7ed55-8b67-4540-9168-64245fbf1807-istio-data\") pod \"e2e-inf-a-f7319d-openshift-default-6ddbbd4f57-hbg78\" (UID: \"ded7ed55-8b67-4540-9168-64245fbf1807\") " pod="openshift-ingress/e2e-inf-a-f7319d-openshift-default-6ddbbd4f57-hbg78"
Jul 18 11:57:39.533400 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:57:39.533357    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ded7ed55-8b67-4540-9168-64245fbf1807-workload-certs\") pod \"e2e-inf-a-f7319d-openshift-default-6ddbbd4f57-hbg78\" (UID: \"ded7ed55-8b67-4540-9168-64245fbf1807\") " pod="openshift-ingress/e2e-inf-a-f7319d-openshift-default-6ddbbd4f57-hbg78"
Jul 18 11:57:39.533400 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:57:39.533398    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ded7ed55-8b67-4540-9168-64245fbf1807-istio-token\") pod \"e2e-inf-a-f7319d-openshift-default-6ddbbd4f57-hbg78\" (UID: \"ded7ed55-8b67-4540-9168-64245fbf1807\") " pod="openshift-ingress/e2e-inf-a-f7319d-openshift-default-6ddbbd4f57-hbg78"
Jul 18 11:57:39.533673 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:57:39.533418    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ded7ed55-8b67-4540-9168-64245fbf1807-istiod-ca-cert\") pod \"e2e-inf-a-f7319d-openshift-default-6ddbbd4f57-hbg78\" (UID: \"ded7ed55-8b67-4540-9168-64245fbf1807\") " pod="openshift-ingress/e2e-inf-a-f7319d-openshift-default-6ddbbd4f57-hbg78"
Jul 18 11:57:39.533673 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:57:39.533436    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ded7ed55-8b67-4540-9168-64245fbf1807-istio-data\") pod \"e2e-inf-a-f7319d-openshift-default-6ddbbd4f57-hbg78\" (UID: \"ded7ed55-8b67-4540-9168-64245fbf1807\") " pod="openshift-ingress/e2e-inf-a-f7319d-openshift-default-6ddbbd4f57-hbg78"
Jul 18 11:57:39.533673 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:57:39.533505    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ded7ed55-8b67-4540-9168-64245fbf1807-istio-envoy\") pod \"e2e-inf-a-f7319d-openshift-default-6ddbbd4f57-hbg78\" (UID: \"ded7ed55-8b67-4540-9168-64245fbf1807\") " pod="openshift-ingress/e2e-inf-a-f7319d-openshift-default-6ddbbd4f57-hbg78"
Jul 18 11:57:39.533673 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:57:39.533528    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5dkmw\" (UniqueName: \"kubernetes.io/projected/ded7ed55-8b67-4540-9168-64245fbf1807-kube-api-access-5dkmw\") pod \"e2e-inf-a-f7319d-openshift-default-6ddbbd4f57-hbg78\" (UID: \"ded7ed55-8b67-4540-9168-64245fbf1807\") " pod="openshift-ingress/e2e-inf-a-f7319d-openshift-default-6ddbbd4f57-hbg78"
Jul 18 11:57:39.533673 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:57:39.533576    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ded7ed55-8b67-4540-9168-64245fbf1807-workload-socket\") pod \"e2e-inf-a-f7319d-openshift-default-6ddbbd4f57-hbg78\" (UID: \"ded7ed55-8b67-4540-9168-64245fbf1807\") " pod="openshift-ingress/e2e-inf-a-f7319d-openshift-default-6ddbbd4f57-hbg78"
Jul 18 11:57:39.533980 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:57:39.533663    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ded7ed55-8b67-4540-9168-64245fbf1807-istio-podinfo\") pod \"e2e-inf-a-f7319d-openshift-default-6ddbbd4f57-hbg78\" (UID: \"ded7ed55-8b67-4540-9168-64245fbf1807\") " pod="openshift-ingress/e2e-inf-a-f7319d-openshift-default-6ddbbd4f57-hbg78"
Jul 18 11:57:39.533980 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:57:39.533715    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ded7ed55-8b67-4540-9168-64245fbf1807-credential-socket\") pod \"e2e-inf-a-f7319d-openshift-default-6ddbbd4f57-hbg78\" (UID: \"ded7ed55-8b67-4540-9168-64245fbf1807\") " pod="openshift-ingress/e2e-inf-a-f7319d-openshift-default-6ddbbd4f57-hbg78"
Jul 18 11:57:39.533980 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:57:39.533858    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ded7ed55-8b67-4540-9168-64245fbf1807-workload-certs\") pod \"e2e-inf-a-f7319d-openshift-default-6ddbbd4f57-hbg78\" (UID: \"ded7ed55-8b67-4540-9168-64245fbf1807\") " pod="openshift-ingress/e2e-inf-a-f7319d-openshift-default-6ddbbd4f57-hbg78"
Jul 18 11:57:39.533980 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:57:39.533880    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ded7ed55-8b67-4540-9168-64245fbf1807-istio-data\") pod \"e2e-inf-a-f7319d-openshift-default-6ddbbd4f57-hbg78\" (UID: \"ded7ed55-8b67-4540-9168-64245fbf1807\") " pod="openshift-ingress/e2e-inf-a-f7319d-openshift-default-6ddbbd4f57-hbg78"
Jul 18 11:57:39.534197 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:57:39.534096    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ded7ed55-8b67-4540-9168-64245fbf1807-credential-socket\") pod \"e2e-inf-a-f7319d-openshift-default-6ddbbd4f57-hbg78\" (UID: \"ded7ed55-8b67-4540-9168-64245fbf1807\") " pod="openshift-ingress/e2e-inf-a-f7319d-openshift-default-6ddbbd4f57-hbg78"
Jul 18 11:57:39.534254 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:57:39.534202    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ded7ed55-8b67-4540-9168-64245fbf1807-workload-socket\") pod \"e2e-inf-a-f7319d-openshift-default-6ddbbd4f57-hbg78\" (UID: \"ded7ed55-8b67-4540-9168-64245fbf1807\") " pod="openshift-ingress/e2e-inf-a-f7319d-openshift-default-6ddbbd4f57-hbg78"
Jul 18 11:57:39.534979 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:57:39.534950    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ded7ed55-8b67-4540-9168-64245fbf1807-istiod-ca-cert\") pod \"e2e-inf-a-f7319d-openshift-default-6ddbbd4f57-hbg78\" (UID: \"ded7ed55-8b67-4540-9168-64245fbf1807\") " pod="openshift-ingress/e2e-inf-a-f7319d-openshift-default-6ddbbd4f57-hbg78"
Jul 18 11:57:39.536018 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:57:39.535994    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ded7ed55-8b67-4540-9168-64245fbf1807-istio-envoy\") pod \"e2e-inf-a-f7319d-openshift-default-6ddbbd4f57-hbg78\" (UID: \"ded7ed55-8b67-4540-9168-64245fbf1807\") " pod="openshift-ingress/e2e-inf-a-f7319d-openshift-default-6ddbbd4f57-hbg78"
Jul 18 11:57:39.536394 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:57:39.536372    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ded7ed55-8b67-4540-9168-64245fbf1807-istio-podinfo\") pod \"e2e-inf-a-f7319d-openshift-default-6ddbbd4f57-hbg78\" (UID: \"ded7ed55-8b67-4540-9168-64245fbf1807\") " pod="openshift-ingress/e2e-inf-a-f7319d-openshift-default-6ddbbd4f57-hbg78"
Jul 18 11:57:39.541373 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:57:39.541341    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ded7ed55-8b67-4540-9168-64245fbf1807-istio-token\") pod \"e2e-inf-a-f7319d-openshift-default-6ddbbd4f57-hbg78\" (UID: \"ded7ed55-8b67-4540-9168-64245fbf1807\") " pod="openshift-ingress/e2e-inf-a-f7319d-openshift-default-6ddbbd4f57-hbg78"
Jul 18 11:57:39.541518 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:57:39.541441    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5dkmw\" (UniqueName: \"kubernetes.io/projected/ded7ed55-8b67-4540-9168-64245fbf1807-kube-api-access-5dkmw\") pod \"e2e-inf-a-f7319d-openshift-default-6ddbbd4f57-hbg78\" (UID: \"ded7ed55-8b67-4540-9168-64245fbf1807\") " pod="openshift-ingress/e2e-inf-a-f7319d-openshift-default-6ddbbd4f57-hbg78"
Jul 18 11:57:39.681462 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:57:39.681372    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-f7319d-openshift-default-6ddbbd4f57-hbg78"
Jul 18 11:57:39.823904 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:57:39.823866    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-f7319d-openshift-default-6ddbbd4f57-hbg78"]
Jul 18 11:57:39.825877 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:57:39.825841    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podded7ed55_8b67_4540_9168_64245fbf1807.slice/crio-ad35ad8091f38c3848b265f1b5057b0de0dafa737c48906b1d0bf2524f30fe08 WatchSource:0}: Error finding container ad35ad8091f38c3848b265f1b5057b0de0dafa737c48906b1d0bf2524f30fe08: Status 404 returned error can't find the container with id ad35ad8091f38c3848b265f1b5057b0de0dafa737c48906b1d0bf2524f30fe08
Jul 18 11:57:39.828504 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:57:39.828464    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 18 11:57:39.828603 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:57:39.828569    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 18 11:57:39.828670 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:57:39.828613    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 18 11:57:40.474085 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:57:40.474026    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-f7319d-openshift-default-6ddbbd4f57-hbg78" event={"ID":"ded7ed55-8b67-4540-9168-64245fbf1807","Type":"ContainerStarted","Data":"9cf9d87154f44377968431784102800006e29b582dc1e829a7ca5fd43e9f941e"}
Jul 18 11:57:40.474464 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:57:40.474113    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-f7319d-openshift-default-6ddbbd4f57-hbg78" event={"ID":"ded7ed55-8b67-4540-9168-64245fbf1807","Type":"ContainerStarted","Data":"ad35ad8091f38c3848b265f1b5057b0de0dafa737c48906b1d0bf2524f30fe08"}
Jul 18 11:57:40.494167 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:57:40.494113    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-f7319d-openshift-default-6ddbbd4f57-hbg78" podStartSLOduration=1.494095772 podStartE2EDuration="1.494095772s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 11:57:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 11:57:40.492173666 +0000 UTC m=+2280.107209961" watchObservedRunningTime="2026-07-18 11:57:40.494095772 +0000 UTC m=+2280.109132125"
Jul 18 11:57:40.682035 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:57:40.682004    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-f7319d-openshift-default-6ddbbd4f57-hbg78"
Jul 18 11:57:40.686950 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:57:40.686921    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-f7319d-openshift-default-6ddbbd4f57-hbg78"
Jul 18 11:57:41.202923 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:57:41.202870    2579 scope.go:117] "RemoveContainer" containerID="87a2257aff1359739261f2f7fd17f8ee147486d3d6d2df212c690a4954ac0b93"
Jul 18 11:57:41.479080 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:57:41.478997    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-f7319d-openshift-default-6ddbbd4f57-hbg78"
Jul 18 11:57:41.480025 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:57:41.480001    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-f7319d-openshift-default-6ddbbd4f57-hbg78"
Jul 18 11:57:55.572725 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:57:55.572692    2579 generic.go:356] "Generic (PLEG): container finished" podID="ded7ed55-8b67-4540-9168-64245fbf1807" containerID="9cf9d87154f44377968431784102800006e29b582dc1e829a7ca5fd43e9f941e" exitCode=0
Jul 18 11:57:55.573158 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:57:55.572766    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-f7319d-openshift-default-6ddbbd4f57-hbg78" event={"ID":"ded7ed55-8b67-4540-9168-64245fbf1807","Type":"ContainerDied","Data":"9cf9d87154f44377968431784102800006e29b582dc1e829a7ca5fd43e9f941e"}
Jul 18 11:57:55.573214 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:57:55.573201    2579 scope.go:117] "RemoveContainer" containerID="9cf9d87154f44377968431784102800006e29b582dc1e829a7ca5fd43e9f941e"
Jul 18 11:57:55.574187 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:57:55.574161    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 18 11:57:55.574260 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:57:55.574226    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 18 11:57:55.574308 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:57:55.574259    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 18 11:57:56.479273 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:57:56.479236    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-f7319d-openshift-default-6ddbbd4f57-hbg78"
Jul 18 11:57:56.579394 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:57:56.579355    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-f7319d-openshift-default-6ddbbd4f57-hbg78" event={"ID":"ded7ed55-8b67-4540-9168-64245fbf1807","Type":"ContainerStarted","Data":"e0e15e9ae93972abc36196afeaa7e298b78af843eedaf688997778a9352d21d2"}
Jul 18 11:57:56.682533 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:57:56.682493    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-f7319d-openshift-default-6ddbbd4f57-hbg78"
Jul 18 11:57:56.683519 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:57:56.683493    2579 patch_prober.go:28] interesting pod/e2e-inf-a-f7319d-openshift-default-6ddbbd4f57-hbg78 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused" start-of-body=
Jul 18 11:57:56.683634 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:57:56.683542    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-f7319d-openshift-default-6ddbbd4f57-hbg78" podUID="ded7ed55-8b67-4540-9168-64245fbf1807" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused"
Jul 18 11:57:57.682056 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:57:57.682011    2579 patch_prober.go:28] interesting pod/e2e-inf-a-f7319d-openshift-default-6ddbbd4f57-hbg78 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused" start-of-body=
Jul 18 11:57:57.682560 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:57:57.682074    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-f7319d-openshift-default-6ddbbd4f57-hbg78" podUID="ded7ed55-8b67-4540-9168-64245fbf1807" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused"
Jul 18 11:57:58.681927 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:57:58.681867    2579 patch_prober.go:28] interesting pod/e2e-inf-a-f7319d-openshift-default-6ddbbd4f57-hbg78 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused" start-of-body=
Jul 18 11:57:58.682110 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:57:58.681957    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-f7319d-openshift-default-6ddbbd4f57-hbg78" podUID="ded7ed55-8b67-4540-9168-64245fbf1807" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused"
Jul 18 11:57:59.682141 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:57:59.682095    2579 patch_prober.go:28] interesting pod/e2e-inf-a-f7319d-openshift-default-6ddbbd4f57-hbg78 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused" start-of-body=
Jul 18 11:57:59.682618 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:57:59.682160    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-f7319d-openshift-default-6ddbbd4f57-hbg78" podUID="ded7ed55-8b67-4540-9168-64245fbf1807" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused"
Jul 18 11:58:00.686012 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:58:00.685983    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-f7319d-openshift-default-6ddbbd4f57-hbg78"
Jul 18 11:58:00.686404 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:58:00.686266    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-f7319d-openshift-default-6ddbbd4f57-hbg78"
Jul 18 11:58:00.686955 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:58:00.686938    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-f7319d-openshift-default-6ddbbd4f57-hbg78"
Jul 18 11:58:12.428381 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:58:12.428325    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-a-f7319d/test-model-f7319d-kserve-788b7f7ccc-m5v7r"]
Jul 18 11:58:12.429394 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:58:12.429370    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1c4b9ec5-2c95-4165-8e1d-fd1cd5736940" containerName="istio-proxy"
Jul 18 11:58:12.429394 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:58:12.429393    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="1c4b9ec5-2c95-4165-8e1d-fd1cd5736940" containerName="istio-proxy"
Jul 18 11:58:12.435198 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:58:12.435170    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-f7319d/test-model-f7319d-kserve-788b7f7ccc-m5v7r"
Jul 18 11:58:12.439732 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:58:12.439705    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-f7319d\"/\"openshift-service-ca.crt\""
Jul 18 11:58:12.440829 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:58:12.440670    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-f7319d\"/\"default-dockercfg-h877r\""
Jul 18 11:58:12.440986 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:58:12.440952    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-f7319d\"/\"kube-root-ca.crt\""
Jul 18 11:58:12.441052 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:58:12.440797    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-f7319d\"/\"test-model-f7319d-kserve-self-signed-certs\""
Jul 18 11:58:12.441668 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:58:12.441645    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-f7319d/test-model-f7319d-kserve-788b7f7ccc-m5v7r"]
Jul 18 11:58:12.539407 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:58:12.539368    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ee80784e-4b12-4b2d-9470-fc7a511291b6-tmp-dir\") pod \"test-model-f7319d-kserve-788b7f7ccc-m5v7r\" (UID: \"ee80784e-4b12-4b2d-9470-fc7a511291b6\") " pod="ai-tenant-e2e-inf-a-f7319d/test-model-f7319d-kserve-788b7f7ccc-m5v7r"
Jul 18 11:58:12.539564 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:58:12.539429    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ee80784e-4b12-4b2d-9470-fc7a511291b6-home\") pod \"test-model-f7319d-kserve-788b7f7ccc-m5v7r\" (UID: \"ee80784e-4b12-4b2d-9470-fc7a511291b6\") " pod="ai-tenant-e2e-inf-a-f7319d/test-model-f7319d-kserve-788b7f7ccc-m5v7r"
Jul 18 11:58:12.539564 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:58:12.539451    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ee80784e-4b12-4b2d-9470-fc7a511291b6-dshm\") pod \"test-model-f7319d-kserve-788b7f7ccc-m5v7r\" (UID: \"ee80784e-4b12-4b2d-9470-fc7a511291b6\") " pod="ai-tenant-e2e-inf-a-f7319d/test-model-f7319d-kserve-788b7f7ccc-m5v7r"
Jul 18 11:58:12.539564 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:58:12.539477    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ee80784e-4b12-4b2d-9470-fc7a511291b6-tls-certs\") pod \"test-model-f7319d-kserve-788b7f7ccc-m5v7r\" (UID: \"ee80784e-4b12-4b2d-9470-fc7a511291b6\") " pod="ai-tenant-e2e-inf-a-f7319d/test-model-f7319d-kserve-788b7f7ccc-m5v7r"
Jul 18 11:58:12.539564 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:58:12.539503    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ee80784e-4b12-4b2d-9470-fc7a511291b6-model-cache\") pod \"test-model-f7319d-kserve-788b7f7ccc-m5v7r\" (UID: \"ee80784e-4b12-4b2d-9470-fc7a511291b6\") " pod="ai-tenant-e2e-inf-a-f7319d/test-model-f7319d-kserve-788b7f7ccc-m5v7r"
Jul 18 11:58:12.539739 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:58:12.539571    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-txqdp\" (UniqueName: \"kubernetes.io/projected/ee80784e-4b12-4b2d-9470-fc7a511291b6-kube-api-access-txqdp\") pod \"test-model-f7319d-kserve-788b7f7ccc-m5v7r\" (UID: \"ee80784e-4b12-4b2d-9470-fc7a511291b6\") " pod="ai-tenant-e2e-inf-a-f7319d/test-model-f7319d-kserve-788b7f7ccc-m5v7r"
Jul 18 11:58:12.640161 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:58:12.640126    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ee80784e-4b12-4b2d-9470-fc7a511291b6-tmp-dir\") pod \"test-model-f7319d-kserve-788b7f7ccc-m5v7r\" (UID: \"ee80784e-4b12-4b2d-9470-fc7a511291b6\") " pod="ai-tenant-e2e-inf-a-f7319d/test-model-f7319d-kserve-788b7f7ccc-m5v7r"
Jul 18 11:58:12.640352 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:58:12.640192    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ee80784e-4b12-4b2d-9470-fc7a511291b6-home\") pod \"test-model-f7319d-kserve-788b7f7ccc-m5v7r\" (UID: \"ee80784e-4b12-4b2d-9470-fc7a511291b6\") " pod="ai-tenant-e2e-inf-a-f7319d/test-model-f7319d-kserve-788b7f7ccc-m5v7r"
Jul 18 11:58:12.640352 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:58:12.640211    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ee80784e-4b12-4b2d-9470-fc7a511291b6-dshm\") pod \"test-model-f7319d-kserve-788b7f7ccc-m5v7r\" (UID: \"ee80784e-4b12-4b2d-9470-fc7a511291b6\") " pod="ai-tenant-e2e-inf-a-f7319d/test-model-f7319d-kserve-788b7f7ccc-m5v7r"
Jul 18 11:58:12.640352 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:58:12.640242    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ee80784e-4b12-4b2d-9470-fc7a511291b6-tls-certs\") pod \"test-model-f7319d-kserve-788b7f7ccc-m5v7r\" (UID: \"ee80784e-4b12-4b2d-9470-fc7a511291b6\") " pod="ai-tenant-e2e-inf-a-f7319d/test-model-f7319d-kserve-788b7f7ccc-m5v7r"
Jul 18 11:58:12.640352 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:58:12.640269    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ee80784e-4b12-4b2d-9470-fc7a511291b6-model-cache\") pod \"test-model-f7319d-kserve-788b7f7ccc-m5v7r\" (UID: \"ee80784e-4b12-4b2d-9470-fc7a511291b6\") " pod="ai-tenant-e2e-inf-a-f7319d/test-model-f7319d-kserve-788b7f7ccc-m5v7r"
Jul 18 11:58:12.640352 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:58:12.640317    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-txqdp\" (UniqueName: \"kubernetes.io/projected/ee80784e-4b12-4b2d-9470-fc7a511291b6-kube-api-access-txqdp\") pod \"test-model-f7319d-kserve-788b7f7ccc-m5v7r\" (UID: \"ee80784e-4b12-4b2d-9470-fc7a511291b6\") " pod="ai-tenant-e2e-inf-a-f7319d/test-model-f7319d-kserve-788b7f7ccc-m5v7r"
Jul 18 11:58:12.640621 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:58:12.640585    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ee80784e-4b12-4b2d-9470-fc7a511291b6-tmp-dir\") pod \"test-model-f7319d-kserve-788b7f7ccc-m5v7r\" (UID: \"ee80784e-4b12-4b2d-9470-fc7a511291b6\") " pod="ai-tenant-e2e-inf-a-f7319d/test-model-f7319d-kserve-788b7f7ccc-m5v7r"
Jul 18 11:58:12.640621 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:58:12.640594    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ee80784e-4b12-4b2d-9470-fc7a511291b6-home\") pod \"test-model-f7319d-kserve-788b7f7ccc-m5v7r\" (UID: \"ee80784e-4b12-4b2d-9470-fc7a511291b6\") " pod="ai-tenant-e2e-inf-a-f7319d/test-model-f7319d-kserve-788b7f7ccc-m5v7r"
Jul 18 11:58:12.640841 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:58:12.640814    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ee80784e-4b12-4b2d-9470-fc7a511291b6-model-cache\") pod \"test-model-f7319d-kserve-788b7f7ccc-m5v7r\" (UID: \"ee80784e-4b12-4b2d-9470-fc7a511291b6\") " pod="ai-tenant-e2e-inf-a-f7319d/test-model-f7319d-kserve-788b7f7ccc-m5v7r"
Jul 18 11:58:12.642657 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:58:12.642627    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ee80784e-4b12-4b2d-9470-fc7a511291b6-dshm\") pod \"test-model-f7319d-kserve-788b7f7ccc-m5v7r\" (UID: \"ee80784e-4b12-4b2d-9470-fc7a511291b6\") " pod="ai-tenant-e2e-inf-a-f7319d/test-model-f7319d-kserve-788b7f7ccc-m5v7r"
Jul 18 11:58:12.642742 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:58:12.642674    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ee80784e-4b12-4b2d-9470-fc7a511291b6-tls-certs\") pod \"test-model-f7319d-kserve-788b7f7ccc-m5v7r\" (UID: \"ee80784e-4b12-4b2d-9470-fc7a511291b6\") " pod="ai-tenant-e2e-inf-a-f7319d/test-model-f7319d-kserve-788b7f7ccc-m5v7r"
Jul 18 11:58:12.647547 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:58:12.647525    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-txqdp\" (UniqueName: \"kubernetes.io/projected/ee80784e-4b12-4b2d-9470-fc7a511291b6-kube-api-access-txqdp\") pod \"test-model-f7319d-kserve-788b7f7ccc-m5v7r\" (UID: \"ee80784e-4b12-4b2d-9470-fc7a511291b6\") " pod="ai-tenant-e2e-inf-a-f7319d/test-model-f7319d-kserve-788b7f7ccc-m5v7r"
Jul 18 11:58:12.749271 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:58:12.749178    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-f7319d/test-model-f7319d-kserve-788b7f7ccc-m5v7r"
Jul 18 11:58:12.892878 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:58:12.892843    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podee80784e_4b12_4b2d_9470_fc7a511291b6.slice/crio-358cb22315c430646807283a32d0995ae7ccd7702b3eef1eb2d8828d5cbb868f WatchSource:0}: Error finding container 358cb22315c430646807283a32d0995ae7ccd7702b3eef1eb2d8828d5cbb868f: Status 404 returned error can't find the container with id 358cb22315c430646807283a32d0995ae7ccd7702b3eef1eb2d8828d5cbb868f
Jul 18 11:58:12.895813 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:58:12.895785    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-f7319d/test-model-f7319d-kserve-788b7f7ccc-m5v7r"]
Jul 18 11:58:13.666148 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:58:13.666115    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-f7319d/test-model-f7319d-kserve-788b7f7ccc-m5v7r" event={"ID":"ee80784e-4b12-4b2d-9470-fc7a511291b6","Type":"ContainerStarted","Data":"38470751fc9e3a69b5ebb248f09b51508e2911ebd3833ac6254d48e4fb110ac4"}
Jul 18 11:58:13.666531 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:58:13.666154    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-f7319d/test-model-f7319d-kserve-788b7f7ccc-m5v7r" event={"ID":"ee80784e-4b12-4b2d-9470-fc7a511291b6","Type":"ContainerStarted","Data":"358cb22315c430646807283a32d0995ae7ccd7702b3eef1eb2d8828d5cbb868f"}
Jul 18 11:58:13.682003 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:58:13.681943    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-a-f7319d/test-model-f7319d-kserve-788b7f7ccc-m5v7r" podStartSLOduration=1.681921875 podStartE2EDuration="1.681921875s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 11:58:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 11:58:13.681557238 +0000 UTC m=+2313.296593541" watchObservedRunningTime="2026-07-18 11:58:13.681921875 +0000 UTC m=+2313.296958174"
Jul 18 11:58:22.750333 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:58:22.750291    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-a-f7319d/test-model-f7319d-kserve-788b7f7ccc-m5v7r"
Jul 18 11:58:22.750845 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:58:22.750345    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-a-f7319d/test-model-f7319d-kserve-788b7f7ccc-m5v7r"
Jul 18 11:58:22.763006 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:58:22.762982    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-a-f7319d/test-model-f7319d-kserve-788b7f7ccc-m5v7r"
Jul 18 11:58:23.728179 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:58:23.728142    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-a-f7319d/test-model-f7319d-kserve-788b7f7ccc-m5v7r"
Jul 18 11:58:41.227675 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:58:41.227599    2579 scope.go:117] "RemoveContainer" containerID="73b972125d38251729f0a058f0c03ea1087ba51dd615be770507b686d4c00271"
Jul 18 11:59:09.457969 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:59:09.457928    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-f7319d/test-model-f7319d-kserve-788b7f7ccc-m5v7r"]
Jul 18 11:59:10.550743 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:59:10.550695    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-f7319d-c958b"]
Jul 18 11:59:10.554412 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:59:10.554385    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-f7319d-c958b"
Jul 18 11:59:10.556862 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:59:10.556839    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-99w6p\""
Jul 18 11:59:10.561617 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:59:10.561587    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-f7319d-c958b"]
Jul 18 11:59:10.658518 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:59:10.658483    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8e7034ea-bc5d-4ab4-b1f5-9d190724e96b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-f7319d-c958b\" (UID: \"8e7034ea-bc5d-4ab4-b1f5-9d190724e96b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-f7319d-c958b"
Jul 18 11:59:10.759351 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:59:10.759314    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8e7034ea-bc5d-4ab4-b1f5-9d190724e96b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-f7319d-c958b\" (UID: \"8e7034ea-bc5d-4ab4-b1f5-9d190724e96b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-f7319d-c958b"
Jul 18 11:59:10.759990 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:59:10.759968    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8e7034ea-bc5d-4ab4-b1f5-9d190724e96b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-f7319d-c958b\" (UID: \"8e7034ea-bc5d-4ab4-b1f5-9d190724e96b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-f7319d-c958b"
Jul 18 11:59:10.866153 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:59:10.866110    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-f7319d-c958b"
Jul 18 11:59:11.015303 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:59:11.015275    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-f7319d-c958b"]
Jul 18 11:59:11.017319 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:59:11.017288    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8e7034ea_bc5d_4ab4_b1f5_9d190724e96b.slice/crio-51aa2bcd5b1c1ec37daa215bc94d8076996a8ca30d76f6352f9be289114f1a2f WatchSource:0}: Error finding container 51aa2bcd5b1c1ec37daa215bc94d8076996a8ca30d76f6352f9be289114f1a2f: Status 404 returned error can't find the container with id 51aa2bcd5b1c1ec37daa215bc94d8076996a8ca30d76f6352f9be289114f1a2f
Jul 18 11:59:11.960533 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:59:11.960500    2579 generic.go:356] "Generic (PLEG): container finished" podID="8e7034ea-bc5d-4ab4-b1f5-9d190724e96b" containerID="12084d686b3eea91f988772714e6373b8fdbe4058b06558abb07f697b5ee7689" exitCode=0
Jul 18 11:59:11.961068 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:59:11.960585    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-f7319d-c958b" event={"ID":"8e7034ea-bc5d-4ab4-b1f5-9d190724e96b","Type":"ContainerDied","Data":"12084d686b3eea91f988772714e6373b8fdbe4058b06558abb07f697b5ee7689"}
Jul 18 11:59:11.961068 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:59:11.960651    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-f7319d-c958b" event={"ID":"8e7034ea-bc5d-4ab4-b1f5-9d190724e96b","Type":"ContainerStarted","Data":"51aa2bcd5b1c1ec37daa215bc94d8076996a8ca30d76f6352f9be289114f1a2f"}
Jul 18 11:59:13.105884 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:59:13.105854    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-f7319d-c958b"
Jul 18 11:59:13.184936 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:59:13.184879    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8e7034ea-bc5d-4ab4-b1f5-9d190724e96b-maas-api-service-ca\") pod \"8e7034ea-bc5d-4ab4-b1f5-9d190724e96b\" (UID: \"8e7034ea-bc5d-4ab4-b1f5-9d190724e96b\") "
Jul 18 11:59:13.185218 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:59:13.185196    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8e7034ea-bc5d-4ab4-b1f5-9d190724e96b-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "8e7034ea-bc5d-4ab4-b1f5-9d190724e96b" (UID: "8e7034ea-bc5d-4ab4-b1f5-9d190724e96b"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 18 11:59:13.286050 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:59:13.285958    2579 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8e7034ea-bc5d-4ab4-b1f5-9d190724e96b-maas-api-service-ca\") on node \"ip-10-0-133-122.ec2.internal\" DevicePath \"\""
Jul 18 11:59:13.978437 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:59:13.978407    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-f7319d-c958b"
Jul 18 11:59:13.978637 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:59:13.978408    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-f7319d-c958b" event={"ID":"8e7034ea-bc5d-4ab4-b1f5-9d190724e96b","Type":"ContainerDied","Data":"51aa2bcd5b1c1ec37daa215bc94d8076996a8ca30d76f6352f9be289114f1a2f"}
Jul 18 11:59:13.978637 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:59:13.978567    2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="51aa2bcd5b1c1ec37daa215bc94d8076996a8ca30d76f6352f9be289114f1a2f"
Jul 18 11:59:24.479124 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:59:24.479082    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-a-f7319d/test-model-f7319d-kserve-788b7f7ccc-m5v7r" podUID="ee80784e-4b12-4b2d-9470-fc7a511291b6" containerName="main" containerID="cri-o://38470751fc9e3a69b5ebb248f09b51508e2911ebd3833ac6254d48e4fb110ac4" gracePeriod=45
Jul 18 11:59:24.741696 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:59:24.741636    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-f7319d/test-model-f7319d-kserve-788b7f7ccc-m5v7r"
Jul 18 11:59:24.795738 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:59:24.795710    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ee80784e-4b12-4b2d-9470-fc7a511291b6-tmp-dir\") pod \"ee80784e-4b12-4b2d-9470-fc7a511291b6\" (UID: \"ee80784e-4b12-4b2d-9470-fc7a511291b6\") "
Jul 18 11:59:24.795937 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:59:24.795755    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-txqdp\" (UniqueName: \"kubernetes.io/projected/ee80784e-4b12-4b2d-9470-fc7a511291b6-kube-api-access-txqdp\") pod \"ee80784e-4b12-4b2d-9470-fc7a511291b6\" (UID: \"ee80784e-4b12-4b2d-9470-fc7a511291b6\") "
Jul 18 11:59:24.795937 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:59:24.795789    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ee80784e-4b12-4b2d-9470-fc7a511291b6-dshm\") pod \"ee80784e-4b12-4b2d-9470-fc7a511291b6\" (UID: \"ee80784e-4b12-4b2d-9470-fc7a511291b6\") "
Jul 18 11:59:24.795937 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:59:24.795926    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ee80784e-4b12-4b2d-9470-fc7a511291b6-tls-certs\") pod \"ee80784e-4b12-4b2d-9470-fc7a511291b6\" (UID: \"ee80784e-4b12-4b2d-9470-fc7a511291b6\") "
Jul 18 11:59:24.796068 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:59:24.795954    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ee80784e-4b12-4b2d-9470-fc7a511291b6-model-cache\") pod \"ee80784e-4b12-4b2d-9470-fc7a511291b6\" (UID: \"ee80784e-4b12-4b2d-9470-fc7a511291b6\") "
Jul 18 11:59:24.796068 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:59:24.796016    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ee80784e-4b12-4b2d-9470-fc7a511291b6-home\") pod \"ee80784e-4b12-4b2d-9470-fc7a511291b6\" (UID: \"ee80784e-4b12-4b2d-9470-fc7a511291b6\") "
Jul 18 11:59:24.796068 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:59:24.796030    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ee80784e-4b12-4b2d-9470-fc7a511291b6-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "ee80784e-4b12-4b2d-9470-fc7a511291b6" (UID: "ee80784e-4b12-4b2d-9470-fc7a511291b6"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 11:59:24.796268 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:59:24.796241    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ee80784e-4b12-4b2d-9470-fc7a511291b6-model-cache" (OuterVolumeSpecName: "model-cache") pod "ee80784e-4b12-4b2d-9470-fc7a511291b6" (UID: "ee80784e-4b12-4b2d-9470-fc7a511291b6"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 11:59:24.796386 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:59:24.796281    2579 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ee80784e-4b12-4b2d-9470-fc7a511291b6-tmp-dir\") on node \"ip-10-0-133-122.ec2.internal\" DevicePath \"\""
Jul 18 11:59:24.796386 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:59:24.796329    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ee80784e-4b12-4b2d-9470-fc7a511291b6-home" (OuterVolumeSpecName: "home") pod "ee80784e-4b12-4b2d-9470-fc7a511291b6" (UID: "ee80784e-4b12-4b2d-9470-fc7a511291b6"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 11:59:24.798070 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:59:24.798050    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ee80784e-4b12-4b2d-9470-fc7a511291b6-dshm" (OuterVolumeSpecName: "dshm") pod "ee80784e-4b12-4b2d-9470-fc7a511291b6" (UID: "ee80784e-4b12-4b2d-9470-fc7a511291b6"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 11:59:24.798151 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:59:24.798134    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ee80784e-4b12-4b2d-9470-fc7a511291b6-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "ee80784e-4b12-4b2d-9470-fc7a511291b6" (UID: "ee80784e-4b12-4b2d-9470-fc7a511291b6"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 18 11:59:24.798229 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:59:24.798210    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ee80784e-4b12-4b2d-9470-fc7a511291b6-kube-api-access-txqdp" (OuterVolumeSpecName: "kube-api-access-txqdp") pod "ee80784e-4b12-4b2d-9470-fc7a511291b6" (UID: "ee80784e-4b12-4b2d-9470-fc7a511291b6"). InnerVolumeSpecName "kube-api-access-txqdp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 18 11:59:24.896810 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:59:24.896776    2579 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ee80784e-4b12-4b2d-9470-fc7a511291b6-dshm\") on node \"ip-10-0-133-122.ec2.internal\" DevicePath \"\""
Jul 18 11:59:24.896810 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:59:24.896805    2579 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ee80784e-4b12-4b2d-9470-fc7a511291b6-tls-certs\") on node \"ip-10-0-133-122.ec2.internal\" DevicePath \"\""
Jul 18 11:59:24.896810 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:59:24.896819    2579 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ee80784e-4b12-4b2d-9470-fc7a511291b6-model-cache\") on node \"ip-10-0-133-122.ec2.internal\" DevicePath \"\""
Jul 18 11:59:24.897108 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:59:24.896830    2579 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ee80784e-4b12-4b2d-9470-fc7a511291b6-home\") on node \"ip-10-0-133-122.ec2.internal\" DevicePath \"\""
Jul 18 11:59:24.897108 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:59:24.896843    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-txqdp\" (UniqueName: \"kubernetes.io/projected/ee80784e-4b12-4b2d-9470-fc7a511291b6-kube-api-access-txqdp\") on node \"ip-10-0-133-122.ec2.internal\" DevicePath \"\""
Jul 18 11:59:25.040802 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:59:25.040713    2579 generic.go:356] "Generic (PLEG): container finished" podID="ee80784e-4b12-4b2d-9470-fc7a511291b6" containerID="38470751fc9e3a69b5ebb248f09b51508e2911ebd3833ac6254d48e4fb110ac4" exitCode=0
Jul 18 11:59:25.040802 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:59:25.040754    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-f7319d/test-model-f7319d-kserve-788b7f7ccc-m5v7r"
Jul 18 11:59:25.040802 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:59:25.040762    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-f7319d/test-model-f7319d-kserve-788b7f7ccc-m5v7r" event={"ID":"ee80784e-4b12-4b2d-9470-fc7a511291b6","Type":"ContainerDied","Data":"38470751fc9e3a69b5ebb248f09b51508e2911ebd3833ac6254d48e4fb110ac4"}
Jul 18 11:59:25.040802 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:59:25.040793    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-f7319d/test-model-f7319d-kserve-788b7f7ccc-m5v7r" event={"ID":"ee80784e-4b12-4b2d-9470-fc7a511291b6","Type":"ContainerDied","Data":"358cb22315c430646807283a32d0995ae7ccd7702b3eef1eb2d8828d5cbb868f"}
Jul 18 11:59:25.041134 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:59:25.040809    2579 scope.go:117] "RemoveContainer" containerID="38470751fc9e3a69b5ebb248f09b51508e2911ebd3833ac6254d48e4fb110ac4"
Jul 18 11:59:25.049488 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:59:25.049468    2579 scope.go:117] "RemoveContainer" containerID="38470751fc9e3a69b5ebb248f09b51508e2911ebd3833ac6254d48e4fb110ac4"
Jul 18 11:59:25.049761 ip-10-0-133-122 kubenswrapper[2579]: E0718 11:59:25.049736    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"38470751fc9e3a69b5ebb248f09b51508e2911ebd3833ac6254d48e4fb110ac4\": container with ID starting with 38470751fc9e3a69b5ebb248f09b51508e2911ebd3833ac6254d48e4fb110ac4 not found: ID does not exist" containerID="38470751fc9e3a69b5ebb248f09b51508e2911ebd3833ac6254d48e4fb110ac4"
Jul 18 11:59:25.049811 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:59:25.049772    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"38470751fc9e3a69b5ebb248f09b51508e2911ebd3833ac6254d48e4fb110ac4"} err="failed to get container status \"38470751fc9e3a69b5ebb248f09b51508e2911ebd3833ac6254d48e4fb110ac4\": rpc error: code = NotFound desc = could not find container \"38470751fc9e3a69b5ebb248f09b51508e2911ebd3833ac6254d48e4fb110ac4\": container with ID starting with 38470751fc9e3a69b5ebb248f09b51508e2911ebd3833ac6254d48e4fb110ac4 not found: ID does not exist"
Jul 18 11:59:25.056649 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:59:25.056625    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-f7319d/test-model-f7319d-kserve-788b7f7ccc-m5v7r"]
Jul 18 11:59:25.059033 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:59:25.059014    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-a-f7319d/test-model-f7319d-kserve-788b7f7ccc-m5v7r"]
Jul 18 11:59:25.657282 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:59:25.657240    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-f7319d-c958b"]
Jul 18 11:59:25.659648 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:59:25.659625    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-f7319d-c958b"]
Jul 18 11:59:26.894121 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:59:26.894086    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8e7034ea-bc5d-4ab4-b1f5-9d190724e96b" path="/var/lib/kubelet/pods/8e7034ea-bc5d-4ab4-b1f5-9d190724e96b/volumes"
Jul 18 11:59:26.894528 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:59:26.894513    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ee80784e-4b12-4b2d-9470-fc7a511291b6" path="/var/lib/kubelet/pods/ee80784e-4b12-4b2d-9470-fc7a511291b6/volumes"
Jul 18 11:59:31.977752 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:59:31.977710    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-f7319d-openshift-default-6ddbbd4f57-hbg78"]
Jul 18 11:59:31.978279 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:59:31.978004    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-f7319d-openshift-default-6ddbbd4f57-hbg78" podUID="ded7ed55-8b67-4540-9168-64245fbf1807" containerName="istio-proxy" containerID="cri-o://e0e15e9ae93972abc36196afeaa7e298b78af843eedaf688997778a9352d21d2" gracePeriod=30
Jul 18 11:59:32.366673 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:59:32.366634    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-3a9e62-xsv5b"]
Jul 18 11:59:32.367304 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:59:32.367280    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ee80784e-4b12-4b2d-9470-fc7a511291b6" containerName="main"
Jul 18 11:59:32.367361 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:59:32.367309    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="ee80784e-4b12-4b2d-9470-fc7a511291b6" containerName="main"
Jul 18 11:59:32.367361 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:59:32.367324    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8e7034ea-bc5d-4ab4-b1f5-9d190724e96b" containerName="revoke-keys"
Jul 18 11:59:32.367361 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:59:32.367333    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="8e7034ea-bc5d-4ab4-b1f5-9d190724e96b" containerName="revoke-keys"
Jul 18 11:59:32.367459 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:59:32.367426    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="8e7034ea-bc5d-4ab4-b1f5-9d190724e96b" containerName="revoke-keys"
Jul 18 11:59:32.367459 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:59:32.367439    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="ee80784e-4b12-4b2d-9470-fc7a511291b6" containerName="main"
Jul 18 11:59:32.372166 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:59:32.372145    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-3a9e62-xsv5b"
Jul 18 11:59:32.374829 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:59:32.374619    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-99w6p\""
Jul 18 11:59:32.375523 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:59:32.375501    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-3a9e62-xsv5b"]
Jul 18 11:59:32.464853 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:59:32.464813    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0d08c5a3-14f7-4f91-be20-38f931870424-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-3a9e62-xsv5b\" (UID: \"0d08c5a3-14f7-4f91-be20-38f931870424\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-3a9e62-xsv5b"
Jul 18 11:59:32.565549 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:59:32.565513    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0d08c5a3-14f7-4f91-be20-38f931870424-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-3a9e62-xsv5b\" (UID: \"0d08c5a3-14f7-4f91-be20-38f931870424\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-3a9e62-xsv5b"
Jul 18 11:59:32.566161 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:59:32.566138    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0d08c5a3-14f7-4f91-be20-38f931870424-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-3a9e62-xsv5b\" (UID: \"0d08c5a3-14f7-4f91-be20-38f931870424\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-3a9e62-xsv5b"
Jul 18 11:59:32.684153 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:59:32.684068    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-3a9e62-xsv5b"
Jul 18 11:59:32.821052 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:59:32.821017    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-3a9e62-xsv5b"]
Jul 18 11:59:32.822102 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:59:32.822074    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0d08c5a3_14f7_4f91_be20_38f931870424.slice/crio-ffdad3b5a197dd896a8ccd3fa3a2acf539fcb7d32449fbd77aea0cb6e1b5e3c8 WatchSource:0}: Error finding container ffdad3b5a197dd896a8ccd3fa3a2acf539fcb7d32449fbd77aea0cb6e1b5e3c8: Status 404 returned error can't find the container with id ffdad3b5a197dd896a8ccd3fa3a2acf539fcb7d32449fbd77aea0cb6e1b5e3c8
Jul 18 11:59:33.085272 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:59:33.085240    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-3a9e62-xsv5b" event={"ID":"0d08c5a3-14f7-4f91-be20-38f931870424","Type":"ContainerStarted","Data":"ffdad3b5a197dd896a8ccd3fa3a2acf539fcb7d32449fbd77aea0cb6e1b5e3c8"}
Jul 18 11:59:34.092006 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:59:34.091971    2579 generic.go:356] "Generic (PLEG): container finished" podID="0d08c5a3-14f7-4f91-be20-38f931870424" containerID="1ff396639da2393847a7f48ecbc99cd4f3315f3619e4d423b73dbfe4994ce67a" exitCode=0
Jul 18 11:59:34.092385 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:59:34.092034    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-3a9e62-xsv5b" event={"ID":"0d08c5a3-14f7-4f91-be20-38f931870424","Type":"ContainerDied","Data":"1ff396639da2393847a7f48ecbc99cd4f3315f3619e4d423b73dbfe4994ce67a"}
Jul 18 11:59:35.244152 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:59:35.244126    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-3a9e62-xsv5b"
Jul 18 11:59:35.400823 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:59:35.400737    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0d08c5a3-14f7-4f91-be20-38f931870424-maas-api-service-ca\") pod \"0d08c5a3-14f7-4f91-be20-38f931870424\" (UID: \"0d08c5a3-14f7-4f91-be20-38f931870424\") "
Jul 18 11:59:35.401107 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:59:35.401083    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0d08c5a3-14f7-4f91-be20-38f931870424-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "0d08c5a3-14f7-4f91-be20-38f931870424" (UID: "0d08c5a3-14f7-4f91-be20-38f931870424"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 18 11:59:35.501638 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:59:35.501605    2579 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0d08c5a3-14f7-4f91-be20-38f931870424-maas-api-service-ca\") on node \"ip-10-0-133-122.ec2.internal\" DevicePath \"\""
Jul 18 11:59:36.103539 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:59:36.103512    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-3a9e62-xsv5b"
Jul 18 11:59:36.103709 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:59:36.103517    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-3a9e62-xsv5b" event={"ID":"0d08c5a3-14f7-4f91-be20-38f931870424","Type":"ContainerDied","Data":"ffdad3b5a197dd896a8ccd3fa3a2acf539fcb7d32449fbd77aea0cb6e1b5e3c8"}
Jul 18 11:59:36.103709 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:59:36.103632    2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ffdad3b5a197dd896a8ccd3fa3a2acf539fcb7d32449fbd77aea0cb6e1b5e3c8"
Jul 18 11:59:37.111694 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:59:37.111666    2579 generic.go:356] "Generic (PLEG): container finished" podID="ded7ed55-8b67-4540-9168-64245fbf1807" containerID="e0e15e9ae93972abc36196afeaa7e298b78af843eedaf688997778a9352d21d2" exitCode=0
Jul 18 11:59:37.112090 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:59:37.111714    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-f7319d-openshift-default-6ddbbd4f57-hbg78" event={"ID":"ded7ed55-8b67-4540-9168-64245fbf1807","Type":"ContainerDied","Data":"e0e15e9ae93972abc36196afeaa7e298b78af843eedaf688997778a9352d21d2"}
Jul 18 11:59:37.112090 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:59:37.111770    2579 scope.go:117] "RemoveContainer" containerID="9cf9d87154f44377968431784102800006e29b582dc1e829a7ca5fd43e9f941e"
Jul 18 11:59:37.241035 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:59:37.240977    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-f7319d-openshift-default-6ddbbd4f57-hbg78"
Jul 18 11:59:37.420194 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:59:37.420150    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ded7ed55-8b67-4540-9168-64245fbf1807-workload-certs\") pod \"ded7ed55-8b67-4540-9168-64245fbf1807\" (UID: \"ded7ed55-8b67-4540-9168-64245fbf1807\") "
Jul 18 11:59:37.420194 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:59:37.420205    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ded7ed55-8b67-4540-9168-64245fbf1807-istio-token\") pod \"ded7ed55-8b67-4540-9168-64245fbf1807\" (UID: \"ded7ed55-8b67-4540-9168-64245fbf1807\") "
Jul 18 11:59:37.420405 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:59:37.420239    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ded7ed55-8b67-4540-9168-64245fbf1807-istio-podinfo\") pod \"ded7ed55-8b67-4540-9168-64245fbf1807\" (UID: \"ded7ed55-8b67-4540-9168-64245fbf1807\") "
Jul 18 11:59:37.420405 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:59:37.420288    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5dkmw\" (UniqueName: \"kubernetes.io/projected/ded7ed55-8b67-4540-9168-64245fbf1807-kube-api-access-5dkmw\") pod \"ded7ed55-8b67-4540-9168-64245fbf1807\" (UID: \"ded7ed55-8b67-4540-9168-64245fbf1807\") "
Jul 18 11:59:37.420405 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:59:37.420314    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ded7ed55-8b67-4540-9168-64245fbf1807-workload-socket\") pod \"ded7ed55-8b67-4540-9168-64245fbf1807\" (UID: \"ded7ed55-8b67-4540-9168-64245fbf1807\") "
Jul 18 11:59:37.420538 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:59:37.420436    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ded7ed55-8b67-4540-9168-64245fbf1807-credential-socket\") pod \"ded7ed55-8b67-4540-9168-64245fbf1807\" (UID: \"ded7ed55-8b67-4540-9168-64245fbf1807\") "
Jul 18 11:59:37.420538 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:59:37.420475    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ded7ed55-8b67-4540-9168-64245fbf1807-istio-data\") pod \"ded7ed55-8b67-4540-9168-64245fbf1807\" (UID: \"ded7ed55-8b67-4540-9168-64245fbf1807\") "
Jul 18 11:59:37.420538 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:59:37.420481    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ded7ed55-8b67-4540-9168-64245fbf1807-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "ded7ed55-8b67-4540-9168-64245fbf1807" (UID: "ded7ed55-8b67-4540-9168-64245fbf1807"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 11:59:37.420538 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:59:37.420533    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ded7ed55-8b67-4540-9168-64245fbf1807-istio-envoy\") pod \"ded7ed55-8b67-4540-9168-64245fbf1807\" (UID: \"ded7ed55-8b67-4540-9168-64245fbf1807\") "
Jul 18 11:59:37.420755 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:59:37.420572    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ded7ed55-8b67-4540-9168-64245fbf1807-istiod-ca-cert\") pod \"ded7ed55-8b67-4540-9168-64245fbf1807\" (UID: \"ded7ed55-8b67-4540-9168-64245fbf1807\") "
Jul 18 11:59:37.420755 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:59:37.420616    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ded7ed55-8b67-4540-9168-64245fbf1807-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "ded7ed55-8b67-4540-9168-64245fbf1807" (UID: "ded7ed55-8b67-4540-9168-64245fbf1807"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 11:59:37.420755 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:59:37.420721    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ded7ed55-8b67-4540-9168-64245fbf1807-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "ded7ed55-8b67-4540-9168-64245fbf1807" (UID: "ded7ed55-8b67-4540-9168-64245fbf1807"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 11:59:37.421069 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:59:37.421021    2579 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ded7ed55-8b67-4540-9168-64245fbf1807-workload-socket\") on node \"ip-10-0-133-122.ec2.internal\" DevicePath \"\""
Jul 18 11:59:37.421069 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:59:37.421044    2579 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ded7ed55-8b67-4540-9168-64245fbf1807-credential-socket\") on node \"ip-10-0-133-122.ec2.internal\" DevicePath \"\""
Jul 18 11:59:37.421069 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:59:37.421059    2579 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ded7ed55-8b67-4540-9168-64245fbf1807-workload-certs\") on node \"ip-10-0-133-122.ec2.internal\" DevicePath \"\""
Jul 18 11:59:37.421069 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:59:37.421057    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ded7ed55-8b67-4540-9168-64245fbf1807-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "ded7ed55-8b67-4540-9168-64245fbf1807" (UID: "ded7ed55-8b67-4540-9168-64245fbf1807"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 18 11:59:37.421526 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:59:37.421497    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ded7ed55-8b67-4540-9168-64245fbf1807-istio-data" (OuterVolumeSpecName: "istio-data") pod "ded7ed55-8b67-4540-9168-64245fbf1807" (UID: "ded7ed55-8b67-4540-9168-64245fbf1807"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 11:59:37.422536 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:59:37.422506    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/ded7ed55-8b67-4540-9168-64245fbf1807-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "ded7ed55-8b67-4540-9168-64245fbf1807" (UID: "ded7ed55-8b67-4540-9168-64245fbf1807"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 18 11:59:37.422656 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:59:37.422611    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ded7ed55-8b67-4540-9168-64245fbf1807-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "ded7ed55-8b67-4540-9168-64245fbf1807" (UID: "ded7ed55-8b67-4540-9168-64245fbf1807"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 11:59:37.422956 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:59:37.422940    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ded7ed55-8b67-4540-9168-64245fbf1807-istio-token" (OuterVolumeSpecName: "istio-token") pod "ded7ed55-8b67-4540-9168-64245fbf1807" (UID: "ded7ed55-8b67-4540-9168-64245fbf1807"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 18 11:59:37.423015 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:59:37.422963    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ded7ed55-8b67-4540-9168-64245fbf1807-kube-api-access-5dkmw" (OuterVolumeSpecName: "kube-api-access-5dkmw") pod "ded7ed55-8b67-4540-9168-64245fbf1807" (UID: "ded7ed55-8b67-4540-9168-64245fbf1807"). InnerVolumeSpecName "kube-api-access-5dkmw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 18 11:59:37.522280 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:59:37.522199    2579 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ded7ed55-8b67-4540-9168-64245fbf1807-istio-token\") on node \"ip-10-0-133-122.ec2.internal\" DevicePath \"\""
Jul 18 11:59:37.522280 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:59:37.522227    2579 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ded7ed55-8b67-4540-9168-64245fbf1807-istio-podinfo\") on node \"ip-10-0-133-122.ec2.internal\" DevicePath \"\""
Jul 18 11:59:37.522280 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:59:37.522241    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5dkmw\" (UniqueName: \"kubernetes.io/projected/ded7ed55-8b67-4540-9168-64245fbf1807-kube-api-access-5dkmw\") on node \"ip-10-0-133-122.ec2.internal\" DevicePath \"\""
Jul 18 11:59:37.522280 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:59:37.522252    2579 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ded7ed55-8b67-4540-9168-64245fbf1807-istio-data\") on node \"ip-10-0-133-122.ec2.internal\" DevicePath \"\""
Jul 18 11:59:37.522280 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:59:37.522260    2579 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ded7ed55-8b67-4540-9168-64245fbf1807-istio-envoy\") on node \"ip-10-0-133-122.ec2.internal\" DevicePath \"\""
Jul 18 11:59:37.522280 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:59:37.522267    2579 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ded7ed55-8b67-4540-9168-64245fbf1807-istiod-ca-cert\") on node \"ip-10-0-133-122.ec2.internal\" DevicePath \"\""
Jul 18 11:59:38.118380 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:59:38.118339    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-f7319d-openshift-default-6ddbbd4f57-hbg78"
Jul 18 11:59:38.118799 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:59:38.118378    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-f7319d-openshift-default-6ddbbd4f57-hbg78" event={"ID":"ded7ed55-8b67-4540-9168-64245fbf1807","Type":"ContainerDied","Data":"ad35ad8091f38c3848b265f1b5057b0de0dafa737c48906b1d0bf2524f30fe08"}
Jul 18 11:59:38.118799 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:59:38.118433    2579 scope.go:117] "RemoveContainer" containerID="e0e15e9ae93972abc36196afeaa7e298b78af843eedaf688997778a9352d21d2"
Jul 18 11:59:38.141775 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:59:38.141746    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-f7319d-openshift-default-6ddbbd4f57-hbg78"]
Jul 18 11:59:38.147486 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:59:38.147462    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-f7319d-openshift-default-6ddbbd4f57-hbg78"]
Jul 18 11:59:38.895337 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:59:38.895309    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ded7ed55-8b67-4540-9168-64245fbf1807" path="/var/lib/kubelet/pods/ded7ed55-8b67-4540-9168-64245fbf1807/volumes"
Jul 18 11:59:41.073051 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:59:41.073020    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-jfpn7_759a894c-1828-4ac9-a7c3-77354a104247/console-operator/2.log"
Jul 18 11:59:41.076745 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:59:41.076716    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-58jnn_40e8e19c-87b3-4cd6-81c1-0f404971a282/ovn-acl-logging/0.log"
Jul 18 11:59:41.086029 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:59:41.086007    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-jfpn7_759a894c-1828-4ac9-a7c3-77354a104247/console-operator/2.log"
Jul 18 11:59:41.089756 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:59:41.089738    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-58jnn_40e8e19c-87b3-4cd6-81c1-0f404971a282/ovn-acl-logging/0.log"
Jul 18 11:59:47.446438 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:59:47.446385    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-3a9e62-xsv5b"]
Jul 18 11:59:47.448915 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:59:47.448874    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-3a9e62-xsv5b"]
Jul 18 11:59:48.894368 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:59:48.894335    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0d08c5a3-14f7-4f91-be20-38f931870424" path="/var/lib/kubelet/pods/0d08c5a3-14f7-4f91-be20-38f931870424/volumes"
Jul 18 11:59:54.763914 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:59:54.763868    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-e3c095-openshift-default-59f988d99c-kqx9k"]
Jul 18 11:59:54.764452 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:59:54.764437    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ded7ed55-8b67-4540-9168-64245fbf1807" containerName="istio-proxy"
Jul 18 11:59:54.764497 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:59:54.764456    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="ded7ed55-8b67-4540-9168-64245fbf1807" containerName="istio-proxy"
Jul 18 11:59:54.764497 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:59:54.764468    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ded7ed55-8b67-4540-9168-64245fbf1807" containerName="istio-proxy"
Jul 18 11:59:54.764497 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:59:54.764477    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="ded7ed55-8b67-4540-9168-64245fbf1807" containerName="istio-proxy"
Jul 18 11:59:54.764596 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:59:54.764522    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0d08c5a3-14f7-4f91-be20-38f931870424" containerName="revoke-keys"
Jul 18 11:59:54.764596 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:59:54.764531    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="0d08c5a3-14f7-4f91-be20-38f931870424" containerName="revoke-keys"
Jul 18 11:59:54.764666 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:59:54.764615    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="ded7ed55-8b67-4540-9168-64245fbf1807" containerName="istio-proxy"
Jul 18 11:59:54.764666 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:59:54.764626    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="0d08c5a3-14f7-4f91-be20-38f931870424" containerName="revoke-keys"
Jul 18 11:59:54.768109 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:59:54.768092    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-e3c095-openshift-default-59f988d99c-kqx9k"
Jul 18 11:59:54.771192 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:59:54.771172    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 18 11:59:54.771316 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:59:54.771172    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-e3c095-openshift-default-dockercfg-5rmnj\""
Jul 18 11:59:54.781636 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:59:54.781607    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-e3c095-openshift-default-59f988d99c-kqx9k"]
Jul 18 11:59:54.852631 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:59:54.852595    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/34ef258a-f78b-4297-812a-e31c4a8dc24a-istio-envoy\") pod \"e2e-api-a-e3c095-openshift-default-59f988d99c-kqx9k\" (UID: \"34ef258a-f78b-4297-812a-e31c4a8dc24a\") " pod="openshift-ingress/e2e-api-a-e3c095-openshift-default-59f988d99c-kqx9k"
Jul 18 11:59:54.852631 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:59:54.852628    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/34ef258a-f78b-4297-812a-e31c4a8dc24a-istio-podinfo\") pod \"e2e-api-a-e3c095-openshift-default-59f988d99c-kqx9k\" (UID: \"34ef258a-f78b-4297-812a-e31c4a8dc24a\") " pod="openshift-ingress/e2e-api-a-e3c095-openshift-default-59f988d99c-kqx9k"
Jul 18 11:59:54.852922 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:59:54.852651    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/34ef258a-f78b-4297-812a-e31c4a8dc24a-workload-certs\") pod \"e2e-api-a-e3c095-openshift-default-59f988d99c-kqx9k\" (UID: \"34ef258a-f78b-4297-812a-e31c4a8dc24a\") " pod="openshift-ingress/e2e-api-a-e3c095-openshift-default-59f988d99c-kqx9k"
Jul 18 11:59:54.852922 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:59:54.852757    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/34ef258a-f78b-4297-812a-e31c4a8dc24a-credential-socket\") pod \"e2e-api-a-e3c095-openshift-default-59f988d99c-kqx9k\" (UID: \"34ef258a-f78b-4297-812a-e31c4a8dc24a\") " pod="openshift-ingress/e2e-api-a-e3c095-openshift-default-59f988d99c-kqx9k"
Jul 18 11:59:54.852922 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:59:54.852805    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kgtdg\" (UniqueName: \"kubernetes.io/projected/34ef258a-f78b-4297-812a-e31c4a8dc24a-kube-api-access-kgtdg\") pod \"e2e-api-a-e3c095-openshift-default-59f988d99c-kqx9k\" (UID: \"34ef258a-f78b-4297-812a-e31c4a8dc24a\") " pod="openshift-ingress/e2e-api-a-e3c095-openshift-default-59f988d99c-kqx9k"
Jul 18 11:59:54.852922 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:59:54.852848    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/34ef258a-f78b-4297-812a-e31c4a8dc24a-istio-data\") pod \"e2e-api-a-e3c095-openshift-default-59f988d99c-kqx9k\" (UID: \"34ef258a-f78b-4297-812a-e31c4a8dc24a\") " pod="openshift-ingress/e2e-api-a-e3c095-openshift-default-59f988d99c-kqx9k"
Jul 18 11:59:54.852922 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:59:54.852920    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/34ef258a-f78b-4297-812a-e31c4a8dc24a-istio-token\") pod \"e2e-api-a-e3c095-openshift-default-59f988d99c-kqx9k\" (UID: \"34ef258a-f78b-4297-812a-e31c4a8dc24a\") " pod="openshift-ingress/e2e-api-a-e3c095-openshift-default-59f988d99c-kqx9k"
Jul 18 11:59:54.853187 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:59:54.852965    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/34ef258a-f78b-4297-812a-e31c4a8dc24a-workload-socket\") pod \"e2e-api-a-e3c095-openshift-default-59f988d99c-kqx9k\" (UID: \"34ef258a-f78b-4297-812a-e31c4a8dc24a\") " pod="openshift-ingress/e2e-api-a-e3c095-openshift-default-59f988d99c-kqx9k"
Jul 18 11:59:54.853187 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:59:54.852997    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/34ef258a-f78b-4297-812a-e31c4a8dc24a-istiod-ca-cert\") pod \"e2e-api-a-e3c095-openshift-default-59f988d99c-kqx9k\" (UID: \"34ef258a-f78b-4297-812a-e31c4a8dc24a\") " pod="openshift-ingress/e2e-api-a-e3c095-openshift-default-59f988d99c-kqx9k"
Jul 18 11:59:54.953614 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:59:54.953577    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/34ef258a-f78b-4297-812a-e31c4a8dc24a-istio-data\") pod \"e2e-api-a-e3c095-openshift-default-59f988d99c-kqx9k\" (UID: \"34ef258a-f78b-4297-812a-e31c4a8dc24a\") " pod="openshift-ingress/e2e-api-a-e3c095-openshift-default-59f988d99c-kqx9k"
Jul 18 11:59:54.953803 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:59:54.953624    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/34ef258a-f78b-4297-812a-e31c4a8dc24a-istio-token\") pod \"e2e-api-a-e3c095-openshift-default-59f988d99c-kqx9k\" (UID: \"34ef258a-f78b-4297-812a-e31c4a8dc24a\") " pod="openshift-ingress/e2e-api-a-e3c095-openshift-default-59f988d99c-kqx9k"
Jul 18 11:59:54.953803 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:59:54.953659    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/34ef258a-f78b-4297-812a-e31c4a8dc24a-workload-socket\") pod \"e2e-api-a-e3c095-openshift-default-59f988d99c-kqx9k\" (UID: \"34ef258a-f78b-4297-812a-e31c4a8dc24a\") " pod="openshift-ingress/e2e-api-a-e3c095-openshift-default-59f988d99c-kqx9k"
Jul 18 11:59:54.953803 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:59:54.953686    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/34ef258a-f78b-4297-812a-e31c4a8dc24a-istiod-ca-cert\") pod \"e2e-api-a-e3c095-openshift-default-59f988d99c-kqx9k\" (UID: \"34ef258a-f78b-4297-812a-e31c4a8dc24a\") " pod="openshift-ingress/e2e-api-a-e3c095-openshift-default-59f988d99c-kqx9k"
Jul 18 11:59:54.953803 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:59:54.953735    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/34ef258a-f78b-4297-812a-e31c4a8dc24a-istio-envoy\") pod \"e2e-api-a-e3c095-openshift-default-59f988d99c-kqx9k\" (UID: \"34ef258a-f78b-4297-812a-e31c4a8dc24a\") " pod="openshift-ingress/e2e-api-a-e3c095-openshift-default-59f988d99c-kqx9k"
Jul 18 11:59:54.953803 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:59:54.953758    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/34ef258a-f78b-4297-812a-e31c4a8dc24a-istio-podinfo\") pod \"e2e-api-a-e3c095-openshift-default-59f988d99c-kqx9k\" (UID: \"34ef258a-f78b-4297-812a-e31c4a8dc24a\") " pod="openshift-ingress/e2e-api-a-e3c095-openshift-default-59f988d99c-kqx9k"
Jul 18 11:59:54.953803 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:59:54.953788    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/34ef258a-f78b-4297-812a-e31c4a8dc24a-workload-certs\") pod \"e2e-api-a-e3c095-openshift-default-59f988d99c-kqx9k\" (UID: \"34ef258a-f78b-4297-812a-e31c4a8dc24a\") " pod="openshift-ingress/e2e-api-a-e3c095-openshift-default-59f988d99c-kqx9k"
Jul 18 11:59:54.954197 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:59:54.953833    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/34ef258a-f78b-4297-812a-e31c4a8dc24a-credential-socket\") pod \"e2e-api-a-e3c095-openshift-default-59f988d99c-kqx9k\" (UID: \"34ef258a-f78b-4297-812a-e31c4a8dc24a\") " pod="openshift-ingress/e2e-api-a-e3c095-openshift-default-59f988d99c-kqx9k"
Jul 18 11:59:54.954197 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:59:54.953870    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kgtdg\" (UniqueName: \"kubernetes.io/projected/34ef258a-f78b-4297-812a-e31c4a8dc24a-kube-api-access-kgtdg\") pod \"e2e-api-a-e3c095-openshift-default-59f988d99c-kqx9k\" (UID: \"34ef258a-f78b-4297-812a-e31c4a8dc24a\") " pod="openshift-ingress/e2e-api-a-e3c095-openshift-default-59f988d99c-kqx9k"
Jul 18 11:59:54.954197 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:59:54.954177    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/34ef258a-f78b-4297-812a-e31c4a8dc24a-istio-data\") pod \"e2e-api-a-e3c095-openshift-default-59f988d99c-kqx9k\" (UID: \"34ef258a-f78b-4297-812a-e31c4a8dc24a\") " pod="openshift-ingress/e2e-api-a-e3c095-openshift-default-59f988d99c-kqx9k"
Jul 18 11:59:54.954355 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:59:54.954260    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/34ef258a-f78b-4297-812a-e31c4a8dc24a-workload-certs\") pod \"e2e-api-a-e3c095-openshift-default-59f988d99c-kqx9k\" (UID: \"34ef258a-f78b-4297-812a-e31c4a8dc24a\") " pod="openshift-ingress/e2e-api-a-e3c095-openshift-default-59f988d99c-kqx9k"
Jul 18 11:59:54.954423 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:59:54.954404    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/34ef258a-f78b-4297-812a-e31c4a8dc24a-workload-socket\") pod \"e2e-api-a-e3c095-openshift-default-59f988d99c-kqx9k\" (UID: \"34ef258a-f78b-4297-812a-e31c4a8dc24a\") " pod="openshift-ingress/e2e-api-a-e3c095-openshift-default-59f988d99c-kqx9k"
Jul 18 11:59:54.954462 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:59:54.954452    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/34ef258a-f78b-4297-812a-e31c4a8dc24a-credential-socket\") pod \"e2e-api-a-e3c095-openshift-default-59f988d99c-kqx9k\" (UID: \"34ef258a-f78b-4297-812a-e31c4a8dc24a\") " pod="openshift-ingress/e2e-api-a-e3c095-openshift-default-59f988d99c-kqx9k"
Jul 18 11:59:54.954508 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:59:54.954461    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/34ef258a-f78b-4297-812a-e31c4a8dc24a-istiod-ca-cert\") pod \"e2e-api-a-e3c095-openshift-default-59f988d99c-kqx9k\" (UID: \"34ef258a-f78b-4297-812a-e31c4a8dc24a\") " pod="openshift-ingress/e2e-api-a-e3c095-openshift-default-59f988d99c-kqx9k"
Jul 18 11:59:54.956559 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:59:54.956541    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/34ef258a-f78b-4297-812a-e31c4a8dc24a-istio-envoy\") pod \"e2e-api-a-e3c095-openshift-default-59f988d99c-kqx9k\" (UID: \"34ef258a-f78b-4297-812a-e31c4a8dc24a\") " pod="openshift-ingress/e2e-api-a-e3c095-openshift-default-59f988d99c-kqx9k"
Jul 18 11:59:54.956880 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:59:54.956857    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/34ef258a-f78b-4297-812a-e31c4a8dc24a-istio-podinfo\") pod \"e2e-api-a-e3c095-openshift-default-59f988d99c-kqx9k\" (UID: \"34ef258a-f78b-4297-812a-e31c4a8dc24a\") " pod="openshift-ingress/e2e-api-a-e3c095-openshift-default-59f988d99c-kqx9k"
Jul 18 11:59:54.964074 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:59:54.964044    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/34ef258a-f78b-4297-812a-e31c4a8dc24a-istio-token\") pod \"e2e-api-a-e3c095-openshift-default-59f988d99c-kqx9k\" (UID: \"34ef258a-f78b-4297-812a-e31c4a8dc24a\") " pod="openshift-ingress/e2e-api-a-e3c095-openshift-default-59f988d99c-kqx9k"
Jul 18 11:59:54.964249 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:59:54.964231    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kgtdg\" (UniqueName: \"kubernetes.io/projected/34ef258a-f78b-4297-812a-e31c4a8dc24a-kube-api-access-kgtdg\") pod \"e2e-api-a-e3c095-openshift-default-59f988d99c-kqx9k\" (UID: \"34ef258a-f78b-4297-812a-e31c4a8dc24a\") " pod="openshift-ingress/e2e-api-a-e3c095-openshift-default-59f988d99c-kqx9k"
Jul 18 11:59:55.080409 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:59:55.080321    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-e3c095-openshift-default-59f988d99c-kqx9k"
Jul 18 11:59:55.224368 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:59:55.224343    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-e3c095-openshift-default-59f988d99c-kqx9k"]
Jul 18 11:59:55.226247 ip-10-0-133-122 kubenswrapper[2579]: W0718 11:59:55.226216    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod34ef258a_f78b_4297_812a_e31c4a8dc24a.slice/crio-ea05a368f97a1d3b8c5799788c9c97f892af258c05cb965e35ef3545b6018325 WatchSource:0}: Error finding container ea05a368f97a1d3b8c5799788c9c97f892af258c05cb965e35ef3545b6018325: Status 404 returned error can't find the container with id ea05a368f97a1d3b8c5799788c9c97f892af258c05cb965e35ef3545b6018325
Jul 18 11:59:55.228995 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:59:55.228949    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 18 11:59:55.229137 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:59:55.229043    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 18 11:59:55.229137 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:59:55.229085    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 18 11:59:56.218559 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:59:56.218522    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-e3c095-openshift-default-59f988d99c-kqx9k" event={"ID":"34ef258a-f78b-4297-812a-e31c4a8dc24a","Type":"ContainerStarted","Data":"4cd4ea504de8ef07c7f6f3436b6ed90954195208a407f62a9db9a571e7ac4348"}
Jul 18 11:59:56.219098 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:59:56.218585    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-e3c095-openshift-default-59f988d99c-kqx9k" event={"ID":"34ef258a-f78b-4297-812a-e31c4a8dc24a","Type":"ContainerStarted","Data":"ea05a368f97a1d3b8c5799788c9c97f892af258c05cb965e35ef3545b6018325"}
Jul 18 11:59:56.241670 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:59:56.241611    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-e3c095-openshift-default-59f988d99c-kqx9k" podStartSLOduration=2.241596245 podStartE2EDuration="2.241596245s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 11:59:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 11:59:56.239339856 +0000 UTC m=+2415.854376160" watchObservedRunningTime="2026-07-18 11:59:56.241596245 +0000 UTC m=+2415.856632547"
Jul 18 11:59:57.080960 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:59:57.080919    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-e3c095-openshift-default-59f988d99c-kqx9k"
Jul 18 11:59:57.086050 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:59:57.086023    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-e3c095-openshift-default-59f988d99c-kqx9k"
Jul 18 11:59:57.223836 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:59:57.223797    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-e3c095-openshift-default-59f988d99c-kqx9k"
Jul 18 11:59:57.224946 ip-10-0-133-122 kubenswrapper[2579]: I0718 11:59:57.224926    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-e3c095-openshift-default-59f988d99c-kqx9k"
Jul 18 12:00:00.131875 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:00:00.131837    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29739600-2g2p4"]
Jul 18 12:00:00.132314 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:00:00.132300    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="ded7ed55-8b67-4540-9168-64245fbf1807" containerName="istio-proxy"
Jul 18 12:00:00.135498 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:00:00.135483    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29739600-2g2p4"
Jul 18 12:00:00.138045 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:00:00.138019    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-99w6p\""
Jul 18 12:00:00.145337 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:00:00.145315    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29739600-2g2p4"]
Jul 18 12:00:00.147605 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:00:00.147584    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29739600-2g2p4"
Jul 18 12:00:00.494216 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:00:00.494193    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29739600-2g2p4"]
Jul 18 12:00:00.496607 ip-10-0-133-122 kubenswrapper[2579]: W0718 12:00:00.496579    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6e2c0bed_1933_440b_b86d_09c5ef63a5e9.slice/crio-b138f4aefec5c9aa46e7d2d765ddc7c38443ed6797870b1b58ebd5df11f579c7 WatchSource:0}: Error finding container b138f4aefec5c9aa46e7d2d765ddc7c38443ed6797870b1b58ebd5df11f579c7: Status 404 returned error can't find the container with id b138f4aefec5c9aa46e7d2d765ddc7c38443ed6797870b1b58ebd5df11f579c7
Jul 18 12:00:01.251406 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:00:01.251374    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29739600-2g2p4" event={"ID":"6e2c0bed-1933-440b-b86d-09c5ef63a5e9","Type":"ContainerStarted","Data":"494d2d9afc619668956debfaa714697b18ea0cbd5dbc7e312fbdb0509ad345e6"}
Jul 18 12:00:01.251828 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:00:01.251423    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29739600-2g2p4" event={"ID":"6e2c0bed-1933-440b-b86d-09c5ef63a5e9","Type":"ContainerStarted","Data":"b138f4aefec5c9aa46e7d2d765ddc7c38443ed6797870b1b58ebd5df11f579c7"}
Jul 18 12:00:01.272652 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:00:01.270348    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29739600-2g2p4" podStartSLOduration=1.2703282630000001 podStartE2EDuration="1.270328263s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 12:00:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 12:00:01.264916677 +0000 UTC m=+2420.879952980" watchObservedRunningTime="2026-07-18 12:00:01.270328263 +0000 UTC m=+2420.885364567"
Jul 18 12:00:02.257575 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:00:02.257544    2579 generic.go:356] "Generic (PLEG): container finished" podID="6e2c0bed-1933-440b-b86d-09c5ef63a5e9" containerID="494d2d9afc619668956debfaa714697b18ea0cbd5dbc7e312fbdb0509ad345e6" exitCode=0
Jul 18 12:00:02.257999 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:00:02.257623    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29739600-2g2p4" event={"ID":"6e2c0bed-1933-440b-b86d-09c5ef63a5e9","Type":"ContainerDied","Data":"494d2d9afc619668956debfaa714697b18ea0cbd5dbc7e312fbdb0509ad345e6"}
Jul 18 12:00:03.402091 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:00:03.402064    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29739600-2g2p4"
Jul 18 12:00:03.553805 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:00:03.553720    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-1dc2c9-openshift-default-7b6459697-bdhsw"]
Jul 18 12:00:03.554232 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:00:03.554212    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6e2c0bed-1933-440b-b86d-09c5ef63a5e9" containerName="cleanup"
Jul 18 12:00:03.554330 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:00:03.554234    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="6e2c0bed-1933-440b-b86d-09c5ef63a5e9" containerName="cleanup"
Jul 18 12:00:03.554391 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:00:03.554334    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="6e2c0bed-1933-440b-b86d-09c5ef63a5e9" containerName="cleanup"
Jul 18 12:00:03.557571 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:00:03.557548    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-1dc2c9-openshift-default-7b6459697-bdhsw"
Jul 18 12:00:03.559860 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:00:03.559838    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-1dc2c9-openshift-default-dockercfg-kdmhk\""
Jul 18 12:00:03.571393 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:00:03.571365    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-1dc2c9-openshift-default-7b6459697-bdhsw"]
Jul 18 12:00:03.630936 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:00:03.630880    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/53be6190-474e-4dc7-a0bf-e79677dbcf80-workload-certs\") pod \"e2e-api-b-1dc2c9-openshift-default-7b6459697-bdhsw\" (UID: \"53be6190-474e-4dc7-a0bf-e79677dbcf80\") " pod="openshift-ingress/e2e-api-b-1dc2c9-openshift-default-7b6459697-bdhsw"
Jul 18 12:00:03.631123 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:00:03.630950    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/53be6190-474e-4dc7-a0bf-e79677dbcf80-istio-token\") pod \"e2e-api-b-1dc2c9-openshift-default-7b6459697-bdhsw\" (UID: \"53be6190-474e-4dc7-a0bf-e79677dbcf80\") " pod="openshift-ingress/e2e-api-b-1dc2c9-openshift-default-7b6459697-bdhsw"
Jul 18 12:00:03.631123 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:00:03.631015    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/53be6190-474e-4dc7-a0bf-e79677dbcf80-credential-socket\") pod \"e2e-api-b-1dc2c9-openshift-default-7b6459697-bdhsw\" (UID: \"53be6190-474e-4dc7-a0bf-e79677dbcf80\") " pod="openshift-ingress/e2e-api-b-1dc2c9-openshift-default-7b6459697-bdhsw"
Jul 18 12:00:03.631123 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:00:03.631041    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-km9j5\" (UniqueName: \"kubernetes.io/projected/53be6190-474e-4dc7-a0bf-e79677dbcf80-kube-api-access-km9j5\") pod \"e2e-api-b-1dc2c9-openshift-default-7b6459697-bdhsw\" (UID: \"53be6190-474e-4dc7-a0bf-e79677dbcf80\") " pod="openshift-ingress/e2e-api-b-1dc2c9-openshift-default-7b6459697-bdhsw"
Jul 18 12:00:03.631123 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:00:03.631103    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/53be6190-474e-4dc7-a0bf-e79677dbcf80-istiod-ca-cert\") pod \"e2e-api-b-1dc2c9-openshift-default-7b6459697-bdhsw\" (UID: \"53be6190-474e-4dc7-a0bf-e79677dbcf80\") " pod="openshift-ingress/e2e-api-b-1dc2c9-openshift-default-7b6459697-bdhsw"
Jul 18 12:00:03.631292 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:00:03.631183    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/53be6190-474e-4dc7-a0bf-e79677dbcf80-istio-envoy\") pod \"e2e-api-b-1dc2c9-openshift-default-7b6459697-bdhsw\" (UID: \"53be6190-474e-4dc7-a0bf-e79677dbcf80\") " pod="openshift-ingress/e2e-api-b-1dc2c9-openshift-default-7b6459697-bdhsw"
Jul 18 12:00:03.631292 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:00:03.631212    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/53be6190-474e-4dc7-a0bf-e79677dbcf80-workload-socket\") pod \"e2e-api-b-1dc2c9-openshift-default-7b6459697-bdhsw\" (UID: \"53be6190-474e-4dc7-a0bf-e79677dbcf80\") " pod="openshift-ingress/e2e-api-b-1dc2c9-openshift-default-7b6459697-bdhsw"
Jul 18 12:00:03.631292 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:00:03.631243    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/53be6190-474e-4dc7-a0bf-e79677dbcf80-istio-data\") pod \"e2e-api-b-1dc2c9-openshift-default-7b6459697-bdhsw\" (UID: \"53be6190-474e-4dc7-a0bf-e79677dbcf80\") " pod="openshift-ingress/e2e-api-b-1dc2c9-openshift-default-7b6459697-bdhsw"
Jul 18 12:00:03.631292 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:00:03.631265    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/53be6190-474e-4dc7-a0bf-e79677dbcf80-istio-podinfo\") pod \"e2e-api-b-1dc2c9-openshift-default-7b6459697-bdhsw\" (UID: \"53be6190-474e-4dc7-a0bf-e79677dbcf80\") " pod="openshift-ingress/e2e-api-b-1dc2c9-openshift-default-7b6459697-bdhsw"
Jul 18 12:00:03.732232 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:00:03.732199    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/53be6190-474e-4dc7-a0bf-e79677dbcf80-istio-envoy\") pod \"e2e-api-b-1dc2c9-openshift-default-7b6459697-bdhsw\" (UID: \"53be6190-474e-4dc7-a0bf-e79677dbcf80\") " pod="openshift-ingress/e2e-api-b-1dc2c9-openshift-default-7b6459697-bdhsw"
Jul 18 12:00:03.732426 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:00:03.732235    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/53be6190-474e-4dc7-a0bf-e79677dbcf80-workload-socket\") pod \"e2e-api-b-1dc2c9-openshift-default-7b6459697-bdhsw\" (UID: \"53be6190-474e-4dc7-a0bf-e79677dbcf80\") " pod="openshift-ingress/e2e-api-b-1dc2c9-openshift-default-7b6459697-bdhsw"
Jul 18 12:00:03.732426 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:00:03.732260    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/53be6190-474e-4dc7-a0bf-e79677dbcf80-istio-data\") pod \"e2e-api-b-1dc2c9-openshift-default-7b6459697-bdhsw\" (UID: \"53be6190-474e-4dc7-a0bf-e79677dbcf80\") " pod="openshift-ingress/e2e-api-b-1dc2c9-openshift-default-7b6459697-bdhsw"
Jul 18 12:00:03.732426 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:00:03.732281    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/53be6190-474e-4dc7-a0bf-e79677dbcf80-istio-podinfo\") pod \"e2e-api-b-1dc2c9-openshift-default-7b6459697-bdhsw\" (UID: \"53be6190-474e-4dc7-a0bf-e79677dbcf80\") " pod="openshift-ingress/e2e-api-b-1dc2c9-openshift-default-7b6459697-bdhsw"
Jul 18 12:00:03.732426 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:00:03.732309    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/53be6190-474e-4dc7-a0bf-e79677dbcf80-workload-certs\") pod \"e2e-api-b-1dc2c9-openshift-default-7b6459697-bdhsw\" (UID: \"53be6190-474e-4dc7-a0bf-e79677dbcf80\") " pod="openshift-ingress/e2e-api-b-1dc2c9-openshift-default-7b6459697-bdhsw"
Jul 18 12:00:03.732426 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:00:03.732337    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/53be6190-474e-4dc7-a0bf-e79677dbcf80-istio-token\") pod \"e2e-api-b-1dc2c9-openshift-default-7b6459697-bdhsw\" (UID: \"53be6190-474e-4dc7-a0bf-e79677dbcf80\") " pod="openshift-ingress/e2e-api-b-1dc2c9-openshift-default-7b6459697-bdhsw"
Jul 18 12:00:03.732426 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:00:03.732386    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/53be6190-474e-4dc7-a0bf-e79677dbcf80-credential-socket\") pod \"e2e-api-b-1dc2c9-openshift-default-7b6459697-bdhsw\" (UID: \"53be6190-474e-4dc7-a0bf-e79677dbcf80\") " pod="openshift-ingress/e2e-api-b-1dc2c9-openshift-default-7b6459697-bdhsw"
Jul 18 12:00:03.732426 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:00:03.732408    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-km9j5\" (UniqueName: \"kubernetes.io/projected/53be6190-474e-4dc7-a0bf-e79677dbcf80-kube-api-access-km9j5\") pod \"e2e-api-b-1dc2c9-openshift-default-7b6459697-bdhsw\" (UID: \"53be6190-474e-4dc7-a0bf-e79677dbcf80\") " pod="openshift-ingress/e2e-api-b-1dc2c9-openshift-default-7b6459697-bdhsw"
Jul 18 12:00:03.732786 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:00:03.732470    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/53be6190-474e-4dc7-a0bf-e79677dbcf80-istiod-ca-cert\") pod \"e2e-api-b-1dc2c9-openshift-default-7b6459697-bdhsw\" (UID: \"53be6190-474e-4dc7-a0bf-e79677dbcf80\") " pod="openshift-ingress/e2e-api-b-1dc2c9-openshift-default-7b6459697-bdhsw"
Jul 18 12:00:03.732786 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:00:03.732672    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/53be6190-474e-4dc7-a0bf-e79677dbcf80-workload-socket\") pod \"e2e-api-b-1dc2c9-openshift-default-7b6459697-bdhsw\" (UID: \"53be6190-474e-4dc7-a0bf-e79677dbcf80\") " pod="openshift-ingress/e2e-api-b-1dc2c9-openshift-default-7b6459697-bdhsw"
Jul 18 12:00:03.732786 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:00:03.732752    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/53be6190-474e-4dc7-a0bf-e79677dbcf80-credential-socket\") pod \"e2e-api-b-1dc2c9-openshift-default-7b6459697-bdhsw\" (UID: \"53be6190-474e-4dc7-a0bf-e79677dbcf80\") " pod="openshift-ingress/e2e-api-b-1dc2c9-openshift-default-7b6459697-bdhsw"
Jul 18 12:00:03.732971 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:00:03.732934    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/53be6190-474e-4dc7-a0bf-e79677dbcf80-workload-certs\") pod \"e2e-api-b-1dc2c9-openshift-default-7b6459697-bdhsw\" (UID: \"53be6190-474e-4dc7-a0bf-e79677dbcf80\") " pod="openshift-ingress/e2e-api-b-1dc2c9-openshift-default-7b6459697-bdhsw"
Jul 18 12:00:03.733127 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:00:03.733077    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/53be6190-474e-4dc7-a0bf-e79677dbcf80-istio-data\") pod \"e2e-api-b-1dc2c9-openshift-default-7b6459697-bdhsw\" (UID: \"53be6190-474e-4dc7-a0bf-e79677dbcf80\") " pod="openshift-ingress/e2e-api-b-1dc2c9-openshift-default-7b6459697-bdhsw"
Jul 18 12:00:03.733286 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:00:03.733266    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/53be6190-474e-4dc7-a0bf-e79677dbcf80-istiod-ca-cert\") pod \"e2e-api-b-1dc2c9-openshift-default-7b6459697-bdhsw\" (UID: \"53be6190-474e-4dc7-a0bf-e79677dbcf80\") " pod="openshift-ingress/e2e-api-b-1dc2c9-openshift-default-7b6459697-bdhsw"
Jul 18 12:00:03.734813 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:00:03.734793    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/53be6190-474e-4dc7-a0bf-e79677dbcf80-istio-envoy\") pod \"e2e-api-b-1dc2c9-openshift-default-7b6459697-bdhsw\" (UID: \"53be6190-474e-4dc7-a0bf-e79677dbcf80\") " pod="openshift-ingress/e2e-api-b-1dc2c9-openshift-default-7b6459697-bdhsw"
Jul 18 12:00:03.735305 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:00:03.735287    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/53be6190-474e-4dc7-a0bf-e79677dbcf80-istio-podinfo\") pod \"e2e-api-b-1dc2c9-openshift-default-7b6459697-bdhsw\" (UID: \"53be6190-474e-4dc7-a0bf-e79677dbcf80\") " pod="openshift-ingress/e2e-api-b-1dc2c9-openshift-default-7b6459697-bdhsw"
Jul 18 12:00:03.740426 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:00:03.740406    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/53be6190-474e-4dc7-a0bf-e79677dbcf80-istio-token\") pod \"e2e-api-b-1dc2c9-openshift-default-7b6459697-bdhsw\" (UID: \"53be6190-474e-4dc7-a0bf-e79677dbcf80\") " pod="openshift-ingress/e2e-api-b-1dc2c9-openshift-default-7b6459697-bdhsw"
Jul 18 12:00:03.740426 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:00:03.740418    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-km9j5\" (UniqueName: \"kubernetes.io/projected/53be6190-474e-4dc7-a0bf-e79677dbcf80-kube-api-access-km9j5\") pod \"e2e-api-b-1dc2c9-openshift-default-7b6459697-bdhsw\" (UID: \"53be6190-474e-4dc7-a0bf-e79677dbcf80\") " pod="openshift-ingress/e2e-api-b-1dc2c9-openshift-default-7b6459697-bdhsw"
Jul 18 12:00:03.868075 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:00:03.868040    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-1dc2c9-openshift-default-7b6459697-bdhsw"
Jul 18 12:00:04.018940 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:00:04.018852    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-1dc2c9-openshift-default-7b6459697-bdhsw"]
Jul 18 12:00:04.022374 ip-10-0-133-122 kubenswrapper[2579]: W0718 12:00:04.022339    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod53be6190_474e_4dc7_a0bf_e79677dbcf80.slice/crio-caa9c315b43d046d8834575b3b4d8519013646f3b47ab3dbcc0330d9b07ad695 WatchSource:0}: Error finding container caa9c315b43d046d8834575b3b4d8519013646f3b47ab3dbcc0330d9b07ad695: Status 404 returned error can't find the container with id caa9c315b43d046d8834575b3b4d8519013646f3b47ab3dbcc0330d9b07ad695
Jul 18 12:00:04.024710 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:00:04.024675    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 18 12:00:04.024805 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:00:04.024744    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 18 12:00:04.024805 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:00:04.024772    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 18 12:00:04.270877 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:00:04.270770    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-1dc2c9-openshift-default-7b6459697-bdhsw" event={"ID":"53be6190-474e-4dc7-a0bf-e79677dbcf80","Type":"ContainerStarted","Data":"b822fa52f68e8ea7cccb6b0632fda48e69f0ade271af665a93d147777480d6bc"}
Jul 18 12:00:04.270877 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:00:04.270839    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-1dc2c9-openshift-default-7b6459697-bdhsw" event={"ID":"53be6190-474e-4dc7-a0bf-e79677dbcf80","Type":"ContainerStarted","Data":"caa9c315b43d046d8834575b3b4d8519013646f3b47ab3dbcc0330d9b07ad695"}
Jul 18 12:00:04.272311 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:00:04.272288    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29739600-2g2p4"
Jul 18 12:00:04.272419 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:00:04.272313    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29739600-2g2p4" event={"ID":"6e2c0bed-1933-440b-b86d-09c5ef63a5e9","Type":"ContainerDied","Data":"b138f4aefec5c9aa46e7d2d765ddc7c38443ed6797870b1b58ebd5df11f579c7"}
Jul 18 12:00:04.272419 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:00:04.272352    2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b138f4aefec5c9aa46e7d2d765ddc7c38443ed6797870b1b58ebd5df11f579c7"
Jul 18 12:00:04.290121 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:00:04.290078    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-1dc2c9-openshift-default-7b6459697-bdhsw" podStartSLOduration=1.290062691 podStartE2EDuration="1.290062691s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 12:00:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 12:00:04.289318667 +0000 UTC m=+2423.904354968" watchObservedRunningTime="2026-07-18 12:00:04.290062691 +0000 UTC m=+2423.905098994"
Jul 18 12:00:04.868638 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:00:04.868601    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-1dc2c9-openshift-default-7b6459697-bdhsw"
Jul 18 12:00:05.874796 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:00:05.874757    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-1dc2c9-openshift-default-7b6459697-bdhsw"
Jul 18 12:00:06.284558 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:00:06.284469    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-1dc2c9-openshift-default-7b6459697-bdhsw"
Jul 18 12:00:06.295628 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:00:06.295595    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-1dc2c9-openshift-default-7b6459697-bdhsw"
Jul 18 12:00:12.266150 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:00:12.265115    2579 patch_prober.go:28] interesting pod/e2e-api-a-e3c095-openshift-default-59f988d99c-kqx9k container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.72:15021/healthz/ready\": read tcp 10.132.0.2:35366->10.132.0.72:15021: read: connection reset by peer" start-of-body=
Jul 18 12:00:12.266150 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:00:12.265182    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-e3c095-openshift-default-59f988d99c-kqx9k" podUID="34ef258a-f78b-4297-812a-e31c4a8dc24a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.72:15021/healthz/ready\": read tcp 10.132.0.2:35366->10.132.0.72:15021: read: connection reset by peer"
Jul 18 12:00:12.320618 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:00:12.320583    2579 generic.go:356] "Generic (PLEG): container finished" podID="34ef258a-f78b-4297-812a-e31c4a8dc24a" containerID="4cd4ea504de8ef07c7f6f3436b6ed90954195208a407f62a9db9a571e7ac4348" exitCode=0
Jul 18 12:00:12.321012 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:00:12.320986    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-e3c095-openshift-default-59f988d99c-kqx9k" event={"ID":"34ef258a-f78b-4297-812a-e31c4a8dc24a","Type":"ContainerDied","Data":"4cd4ea504de8ef07c7f6f3436b6ed90954195208a407f62a9db9a571e7ac4348"}
Jul 18 12:00:12.321601 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:00:12.321581    2579 scope.go:117] "RemoveContainer" containerID="4cd4ea504de8ef07c7f6f3436b6ed90954195208a407f62a9db9a571e7ac4348"
Jul 18 12:00:12.323955 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:00:12.323597    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 18 12:00:12.323955 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:00:12.323683    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 18 12:00:12.323955 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:00:12.323761    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 18 12:00:13.331786 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:00:13.331738    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-e3c095-openshift-default-59f988d99c-kqx9k" event={"ID":"34ef258a-f78b-4297-812a-e31c4a8dc24a","Type":"ContainerStarted","Data":"da82806c17fdf57661e458e573d180712e7f4c1910863399daa15047b0a99e24"}
Jul 18 12:00:14.081207 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:00:14.081162    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-e3c095-openshift-default-59f988d99c-kqx9k"
Jul 18 12:00:14.081485 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:00:14.081462    2579 patch_prober.go:28] interesting pod/e2e-api-a-e3c095-openshift-default-59f988d99c-kqx9k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.72:15021/healthz/ready\": dial tcp 10.132.0.72:15021: connect: connection refused" start-of-body=
Jul 18 12:00:14.081565 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:00:14.081536    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-e3c095-openshift-default-59f988d99c-kqx9k" podUID="34ef258a-f78b-4297-812a-e31c4a8dc24a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.72:15021/healthz/ready\": dial tcp 10.132.0.72:15021: connect: connection refused"
Jul 18 12:00:15.080759 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:00:15.080711    2579 patch_prober.go:28] interesting pod/e2e-api-a-e3c095-openshift-default-59f988d99c-kqx9k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.72:15021/healthz/ready\": dial tcp 10.132.0.72:15021: connect: connection refused" start-of-body=
Jul 18 12:00:15.081300 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:00:15.080770    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-e3c095-openshift-default-59f988d99c-kqx9k" podUID="34ef258a-f78b-4297-812a-e31c4a8dc24a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.72:15021/healthz/ready\": dial tcp 10.132.0.72:15021: connect: connection refused"
Jul 18 12:00:16.080836 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:00:16.080796    2579 patch_prober.go:28] interesting pod/e2e-api-a-e3c095-openshift-default-59f988d99c-kqx9k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.72:15021/healthz/ready\": dial tcp 10.132.0.72:15021: connect: connection refused" start-of-body=
Jul 18 12:00:16.081225 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:00:16.080866    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-e3c095-openshift-default-59f988d99c-kqx9k" podUID="34ef258a-f78b-4297-812a-e31c4a8dc24a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.72:15021/healthz/ready\": dial tcp 10.132.0.72:15021: connect: connection refused"
Jul 18 12:00:17.080791 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:00:17.080748    2579 patch_prober.go:28] interesting pod/e2e-api-a-e3c095-openshift-default-59f988d99c-kqx9k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.72:15021/healthz/ready\": dial tcp 10.132.0.72:15021: connect: connection refused" start-of-body=
Jul 18 12:00:17.081027 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:00:17.080823    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-e3c095-openshift-default-59f988d99c-kqx9k" podUID="34ef258a-f78b-4297-812a-e31c4a8dc24a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.72:15021/healthz/ready\": dial tcp 10.132.0.72:15021: connect: connection refused"
Jul 18 12:00:18.084582 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:00:18.084546    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-e3c095-openshift-default-59f988d99c-kqx9k"
Jul 18 12:00:18.085055 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:00:18.084919    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-e3c095-openshift-default-59f988d99c-kqx9k"
Jul 18 12:00:18.085685 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:00:18.085663    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-e3c095-openshift-default-59f988d99c-kqx9k"
Jul 18 12:00:19.378167 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:00:19.378084    2579 generic.go:356] "Generic (PLEG): container finished" podID="53be6190-474e-4dc7-a0bf-e79677dbcf80" containerID="b822fa52f68e8ea7cccb6b0632fda48e69f0ade271af665a93d147777480d6bc" exitCode=0
Jul 18 12:00:19.378592 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:00:19.378155    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-1dc2c9-openshift-default-7b6459697-bdhsw" event={"ID":"53be6190-474e-4dc7-a0bf-e79677dbcf80","Type":"ContainerDied","Data":"b822fa52f68e8ea7cccb6b0632fda48e69f0ade271af665a93d147777480d6bc"}
Jul 18 12:00:19.378664 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:00:19.378646    2579 scope.go:117] "RemoveContainer" containerID="b822fa52f68e8ea7cccb6b0632fda48e69f0ade271af665a93d147777480d6bc"
Jul 18 12:00:19.379653 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:00:19.379627    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 18 12:00:19.379739 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:00:19.379692    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 18 12:00:19.379779 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:00:19.379763    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 18 12:00:20.385619 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:00:20.385584    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-1dc2c9-openshift-default-7b6459697-bdhsw" event={"ID":"53be6190-474e-4dc7-a0bf-e79677dbcf80","Type":"ContainerStarted","Data":"4cd09f21cac546019a0dcb67e02233c80196ba01f4448c114194c464e9465baa"}
Jul 18 12:00:20.869085 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:00:20.869043    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-1dc2c9-openshift-default-7b6459697-bdhsw"
Jul 18 12:00:20.870313 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:00:20.870290    2579 patch_prober.go:28] interesting pod/e2e-api-b-1dc2c9-openshift-default-7b6459697-bdhsw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused" start-of-body=
Jul 18 12:00:20.870382 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:00:20.870341    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-1dc2c9-openshift-default-7b6459697-bdhsw" podUID="53be6190-474e-4dc7-a0bf-e79677dbcf80" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused"
Jul 18 12:00:21.285173 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:00:21.285072    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-1dc2c9-openshift-default-7b6459697-bdhsw"
Jul 18 12:00:21.869063 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:00:21.869018    2579 patch_prober.go:28] interesting pod/e2e-api-b-1dc2c9-openshift-default-7b6459697-bdhsw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused" start-of-body=
Jul 18 12:00:21.869484 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:00:21.869082    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-1dc2c9-openshift-default-7b6459697-bdhsw" podUID="53be6190-474e-4dc7-a0bf-e79677dbcf80" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused"
Jul 18 12:00:22.869335 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:00:22.869289    2579 patch_prober.go:28] interesting pod/e2e-api-b-1dc2c9-openshift-default-7b6459697-bdhsw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused" start-of-body=
Jul 18 12:00:22.869779 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:00:22.869366    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-1dc2c9-openshift-default-7b6459697-bdhsw" podUID="53be6190-474e-4dc7-a0bf-e79677dbcf80" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused"
Jul 18 12:00:23.869121 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:00:23.869076    2579 patch_prober.go:28] interesting pod/e2e-api-b-1dc2c9-openshift-default-7b6459697-bdhsw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused" start-of-body=
Jul 18 12:00:23.869325 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:00:23.869145    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-1dc2c9-openshift-default-7b6459697-bdhsw" podUID="53be6190-474e-4dc7-a0bf-e79677dbcf80" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused"
Jul 18 12:00:24.872819 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:00:24.872784    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-1dc2c9-openshift-default-7b6459697-bdhsw"
Jul 18 12:00:24.873747 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:00:24.873727    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-1dc2c9-openshift-default-7b6459697-bdhsw"
Jul 18 12:00:41.262170 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:00:41.262136    2579 scope.go:117] "RemoveContainer" containerID="3d130b2b2ddf38c6f81bfdf0c16f1aa4803d935cb7a44c379a789473dc5dda7c"
Jul 18 12:00:45.278513 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:00:45.278480    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-e3c095-openshift-default-59f988d99c-kqx9k"]
Jul 18 12:00:45.278977 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:00:45.278714    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-e3c095-openshift-default-59f988d99c-kqx9k" podUID="34ef258a-f78b-4297-812a-e31c4a8dc24a" containerName="istio-proxy" containerID="cri-o://da82806c17fdf57661e458e573d180712e7f4c1910863399daa15047b0a99e24" gracePeriod=30
Jul 18 12:00:48.087441 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:00:48.087405    2579 patch_prober.go:28] interesting pod/e2e-api-a-e3c095-openshift-default-59f988d99c-kqx9k container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 18 12:00:48.087837 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:00:48.087478    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-e3c095-openshift-default-59f988d99c-kqx9k" podUID="34ef258a-f78b-4297-812a-e31c4a8dc24a" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 18 12:00:50.526240 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:00:50.526206    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-e3c095-openshift-default-59f988d99c-kqx9k"
Jul 18 12:00:50.562597 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:00:50.562506    2579 generic.go:356] "Generic (PLEG): container finished" podID="34ef258a-f78b-4297-812a-e31c4a8dc24a" containerID="da82806c17fdf57661e458e573d180712e7f4c1910863399daa15047b0a99e24" exitCode=0
Jul 18 12:00:50.562597 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:00:50.562564    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-e3c095-openshift-default-59f988d99c-kqx9k"
Jul 18 12:00:50.562821 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:00:50.562595    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-e3c095-openshift-default-59f988d99c-kqx9k" event={"ID":"34ef258a-f78b-4297-812a-e31c4a8dc24a","Type":"ContainerDied","Data":"da82806c17fdf57661e458e573d180712e7f4c1910863399daa15047b0a99e24"}
Jul 18 12:00:50.562821 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:00:50.562664    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-e3c095-openshift-default-59f988d99c-kqx9k" event={"ID":"34ef258a-f78b-4297-812a-e31c4a8dc24a","Type":"ContainerDied","Data":"ea05a368f97a1d3b8c5799788c9c97f892af258c05cb965e35ef3545b6018325"}
Jul 18 12:00:50.562821 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:00:50.562697    2579 scope.go:117] "RemoveContainer" containerID="da82806c17fdf57661e458e573d180712e7f4c1910863399daa15047b0a99e24"
Jul 18 12:00:50.571622 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:00:50.571603    2579 scope.go:117] "RemoveContainer" containerID="4cd4ea504de8ef07c7f6f3436b6ed90954195208a407f62a9db9a571e7ac4348"
Jul 18 12:00:50.580231 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:00:50.580214    2579 scope.go:117] "RemoveContainer" containerID="da82806c17fdf57661e458e573d180712e7f4c1910863399daa15047b0a99e24"
Jul 18 12:00:50.580493 ip-10-0-133-122 kubenswrapper[2579]: E0718 12:00:50.580475    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"da82806c17fdf57661e458e573d180712e7f4c1910863399daa15047b0a99e24\": container with ID starting with da82806c17fdf57661e458e573d180712e7f4c1910863399daa15047b0a99e24 not found: ID does not exist" containerID="da82806c17fdf57661e458e573d180712e7f4c1910863399daa15047b0a99e24"
Jul 18 12:00:50.580549 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:00:50.580503    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"da82806c17fdf57661e458e573d180712e7f4c1910863399daa15047b0a99e24"} err="failed to get container status \"da82806c17fdf57661e458e573d180712e7f4c1910863399daa15047b0a99e24\": rpc error: code = NotFound desc = could not find container \"da82806c17fdf57661e458e573d180712e7f4c1910863399daa15047b0a99e24\": container with ID starting with da82806c17fdf57661e458e573d180712e7f4c1910863399daa15047b0a99e24 not found: ID does not exist"
Jul 18 12:00:50.580549 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:00:50.580522    2579 scope.go:117] "RemoveContainer" containerID="4cd4ea504de8ef07c7f6f3436b6ed90954195208a407f62a9db9a571e7ac4348"
Jul 18 12:00:50.580792 ip-10-0-133-122 kubenswrapper[2579]: E0718 12:00:50.580774    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4cd4ea504de8ef07c7f6f3436b6ed90954195208a407f62a9db9a571e7ac4348\": container with ID starting with 4cd4ea504de8ef07c7f6f3436b6ed90954195208a407f62a9db9a571e7ac4348 not found: ID does not exist" containerID="4cd4ea504de8ef07c7f6f3436b6ed90954195208a407f62a9db9a571e7ac4348"
Jul 18 12:00:50.580832 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:00:50.580799    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4cd4ea504de8ef07c7f6f3436b6ed90954195208a407f62a9db9a571e7ac4348"} err="failed to get container status \"4cd4ea504de8ef07c7f6f3436b6ed90954195208a407f62a9db9a571e7ac4348\": rpc error: code = NotFound desc = could not find container \"4cd4ea504de8ef07c7f6f3436b6ed90954195208a407f62a9db9a571e7ac4348\": container with ID starting with 4cd4ea504de8ef07c7f6f3436b6ed90954195208a407f62a9db9a571e7ac4348 not found: ID does not exist"
Jul 18 12:00:50.597169 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:00:50.597143    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/34ef258a-f78b-4297-812a-e31c4a8dc24a-istiod-ca-cert\") pod \"34ef258a-f78b-4297-812a-e31c4a8dc24a\" (UID: \"34ef258a-f78b-4297-812a-e31c4a8dc24a\") "
Jul 18 12:00:50.597294 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:00:50.597189    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/34ef258a-f78b-4297-812a-e31c4a8dc24a-istio-data\") pod \"34ef258a-f78b-4297-812a-e31c4a8dc24a\" (UID: \"34ef258a-f78b-4297-812a-e31c4a8dc24a\") "
Jul 18 12:00:50.597294 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:00:50.597213    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/34ef258a-f78b-4297-812a-e31c4a8dc24a-istio-podinfo\") pod \"34ef258a-f78b-4297-812a-e31c4a8dc24a\" (UID: \"34ef258a-f78b-4297-812a-e31c4a8dc24a\") "
Jul 18 12:00:50.597294 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:00:50.597247    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/34ef258a-f78b-4297-812a-e31c4a8dc24a-istio-token\") pod \"34ef258a-f78b-4297-812a-e31c4a8dc24a\" (UID: \"34ef258a-f78b-4297-812a-e31c4a8dc24a\") "
Jul 18 12:00:50.597294 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:00:50.597272    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kgtdg\" (UniqueName: \"kubernetes.io/projected/34ef258a-f78b-4297-812a-e31c4a8dc24a-kube-api-access-kgtdg\") pod \"34ef258a-f78b-4297-812a-e31c4a8dc24a\" (UID: \"34ef258a-f78b-4297-812a-e31c4a8dc24a\") "
Jul 18 12:00:50.597464 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:00:50.597296    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/34ef258a-f78b-4297-812a-e31c4a8dc24a-credential-socket\") pod \"34ef258a-f78b-4297-812a-e31c4a8dc24a\" (UID: \"34ef258a-f78b-4297-812a-e31c4a8dc24a\") "
Jul 18 12:00:50.597464 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:00:50.597347    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/34ef258a-f78b-4297-812a-e31c4a8dc24a-workload-socket\") pod \"34ef258a-f78b-4297-812a-e31c4a8dc24a\" (UID: \"34ef258a-f78b-4297-812a-e31c4a8dc24a\") "
Jul 18 12:00:50.597464 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:00:50.597384    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/34ef258a-f78b-4297-812a-e31c4a8dc24a-workload-certs\") pod \"34ef258a-f78b-4297-812a-e31c4a8dc24a\" (UID: \"34ef258a-f78b-4297-812a-e31c4a8dc24a\") "
Jul 18 12:00:50.597464 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:00:50.597419    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/34ef258a-f78b-4297-812a-e31c4a8dc24a-istio-envoy\") pod \"34ef258a-f78b-4297-812a-e31c4a8dc24a\" (UID: \"34ef258a-f78b-4297-812a-e31c4a8dc24a\") "
Jul 18 12:00:50.597659 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:00:50.597561    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/34ef258a-f78b-4297-812a-e31c4a8dc24a-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "34ef258a-f78b-4297-812a-e31c4a8dc24a" (UID: "34ef258a-f78b-4297-812a-e31c4a8dc24a"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 18 12:00:50.598158 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:00:50.597860    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/34ef258a-f78b-4297-812a-e31c4a8dc24a-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "34ef258a-f78b-4297-812a-e31c4a8dc24a" (UID: "34ef258a-f78b-4297-812a-e31c4a8dc24a"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 12:00:50.598158 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:00:50.597967    2579 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/34ef258a-f78b-4297-812a-e31c4a8dc24a-istiod-ca-cert\") on node \"ip-10-0-133-122.ec2.internal\" DevicePath \"\""
Jul 18 12:00:50.598158 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:00:50.597980    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/34ef258a-f78b-4297-812a-e31c4a8dc24a-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "34ef258a-f78b-4297-812a-e31c4a8dc24a" (UID: "34ef258a-f78b-4297-812a-e31c4a8dc24a"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 12:00:50.598158 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:00:50.598096    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/34ef258a-f78b-4297-812a-e31c4a8dc24a-istio-data" (OuterVolumeSpecName: "istio-data") pod "34ef258a-f78b-4297-812a-e31c4a8dc24a" (UID: "34ef258a-f78b-4297-812a-e31c4a8dc24a"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 12:00:50.598158 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:00:50.598115    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/34ef258a-f78b-4297-812a-e31c4a8dc24a-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "34ef258a-f78b-4297-812a-e31c4a8dc24a" (UID: "34ef258a-f78b-4297-812a-e31c4a8dc24a"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 12:00:50.599695 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:00:50.599664    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/34ef258a-f78b-4297-812a-e31c4a8dc24a-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "34ef258a-f78b-4297-812a-e31c4a8dc24a" (UID: "34ef258a-f78b-4297-812a-e31c4a8dc24a"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 12:00:50.599695 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:00:50.599676    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/34ef258a-f78b-4297-812a-e31c4a8dc24a-istio-token" (OuterVolumeSpecName: "istio-token") pod "34ef258a-f78b-4297-812a-e31c4a8dc24a" (UID: "34ef258a-f78b-4297-812a-e31c4a8dc24a"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 18 12:00:50.599858 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:00:50.599717    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/34ef258a-f78b-4297-812a-e31c4a8dc24a-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "34ef258a-f78b-4297-812a-e31c4a8dc24a" (UID: "34ef258a-f78b-4297-812a-e31c4a8dc24a"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 18 12:00:50.599858 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:00:50.599724    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/34ef258a-f78b-4297-812a-e31c4a8dc24a-kube-api-access-kgtdg" (OuterVolumeSpecName: "kube-api-access-kgtdg") pod "34ef258a-f78b-4297-812a-e31c4a8dc24a" (UID: "34ef258a-f78b-4297-812a-e31c4a8dc24a"). InnerVolumeSpecName "kube-api-access-kgtdg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 18 12:00:50.699421 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:00:50.699386    2579 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/34ef258a-f78b-4297-812a-e31c4a8dc24a-istio-data\") on node \"ip-10-0-133-122.ec2.internal\" DevicePath \"\""
Jul 18 12:00:50.699421 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:00:50.699415    2579 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/34ef258a-f78b-4297-812a-e31c4a8dc24a-istio-podinfo\") on node \"ip-10-0-133-122.ec2.internal\" DevicePath \"\""
Jul 18 12:00:50.699421 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:00:50.699425    2579 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/34ef258a-f78b-4297-812a-e31c4a8dc24a-istio-token\") on node \"ip-10-0-133-122.ec2.internal\" DevicePath \"\""
Jul 18 12:00:50.699669 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:00:50.699434    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kgtdg\" (UniqueName: \"kubernetes.io/projected/34ef258a-f78b-4297-812a-e31c4a8dc24a-kube-api-access-kgtdg\") on node \"ip-10-0-133-122.ec2.internal\" DevicePath \"\""
Jul 18 12:00:50.699669 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:00:50.699443    2579 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/34ef258a-f78b-4297-812a-e31c4a8dc24a-credential-socket\") on node \"ip-10-0-133-122.ec2.internal\" DevicePath \"\""
Jul 18 12:00:50.699669 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:00:50.699452    2579 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/34ef258a-f78b-4297-812a-e31c4a8dc24a-workload-socket\") on node \"ip-10-0-133-122.ec2.internal\" DevicePath \"\""
Jul 18 12:00:50.699669 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:00:50.699462    2579 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/34ef258a-f78b-4297-812a-e31c4a8dc24a-workload-certs\") on node \"ip-10-0-133-122.ec2.internal\" DevicePath \"\""
Jul 18 12:00:50.699669 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:00:50.699471    2579 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/34ef258a-f78b-4297-812a-e31c4a8dc24a-istio-envoy\") on node \"ip-10-0-133-122.ec2.internal\" DevicePath \"\""
Jul 18 12:00:50.885359 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:00:50.885322    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-e3c095-openshift-default-59f988d99c-kqx9k"]
Jul 18 12:00:50.895356 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:00:50.895327    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-e3c095-openshift-default-59f988d99c-kqx9k"]
Jul 18 12:00:52.894625 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:00:52.894590    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="34ef258a-f78b-4297-812a-e31c4a8dc24a" path="/var/lib/kubelet/pods/34ef258a-f78b-4297-812a-e31c4a8dc24a/volumes"
Jul 18 12:01:12.295303 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:01:12.295266    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-1dc2c9-openshift-default-7b6459697-bdhsw"]
Jul 18 12:01:12.295760 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:01:12.295480    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-1dc2c9-openshift-default-7b6459697-bdhsw" podUID="53be6190-474e-4dc7-a0bf-e79677dbcf80" containerName="istio-proxy" containerID="cri-o://4cd09f21cac546019a0dcb67e02233c80196ba01f4448c114194c464e9465baa" gracePeriod=30
Jul 18 12:01:13.231347 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:01:13.231306    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-399bd8-openshift-default-56b4b5f97f-d72mp"]
Jul 18 12:01:13.231747 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:01:13.231734    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="34ef258a-f78b-4297-812a-e31c4a8dc24a" containerName="istio-proxy"
Jul 18 12:01:13.231789 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:01:13.231750    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="34ef258a-f78b-4297-812a-e31c4a8dc24a" containerName="istio-proxy"
Jul 18 12:01:13.231789 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:01:13.231774    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="34ef258a-f78b-4297-812a-e31c4a8dc24a" containerName="istio-proxy"
Jul 18 12:01:13.231789 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:01:13.231782    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="34ef258a-f78b-4297-812a-e31c4a8dc24a" containerName="istio-proxy"
Jul 18 12:01:13.231907 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:01:13.231852    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="34ef258a-f78b-4297-812a-e31c4a8dc24a" containerName="istio-proxy"
Jul 18 12:01:13.231907 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:01:13.231861    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="34ef258a-f78b-4297-812a-e31c4a8dc24a" containerName="istio-proxy"
Jul 18 12:01:13.236490 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:01:13.236468    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-399bd8-openshift-default-56b4b5f97f-d72mp"
Jul 18 12:01:13.238989 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:01:13.238965    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-399bd8-openshift-default-dockercfg-mbn2p\""
Jul 18 12:01:13.249771 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:01:13.249745    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-399bd8-openshift-default-56b4b5f97f-d72mp"]
Jul 18 12:01:13.306475 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:01:13.306439    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2ltsh\" (UniqueName: \"kubernetes.io/projected/df118917-490f-4cec-b699-aae5edcae68c-kube-api-access-2ltsh\") pod \"e2e-shared-a-399bd8-openshift-default-56b4b5f97f-d72mp\" (UID: \"df118917-490f-4cec-b699-aae5edcae68c\") " pod="openshift-ingress/e2e-shared-a-399bd8-openshift-default-56b4b5f97f-d72mp"
Jul 18 12:01:13.306910 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:01:13.306490    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/df118917-490f-4cec-b699-aae5edcae68c-credential-socket\") pod \"e2e-shared-a-399bd8-openshift-default-56b4b5f97f-d72mp\" (UID: \"df118917-490f-4cec-b699-aae5edcae68c\") " pod="openshift-ingress/e2e-shared-a-399bd8-openshift-default-56b4b5f97f-d72mp"
Jul 18 12:01:13.306910 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:01:13.306554    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/df118917-490f-4cec-b699-aae5edcae68c-workload-socket\") pod \"e2e-shared-a-399bd8-openshift-default-56b4b5f97f-d72mp\" (UID: \"df118917-490f-4cec-b699-aae5edcae68c\") " pod="openshift-ingress/e2e-shared-a-399bd8-openshift-default-56b4b5f97f-d72mp"
Jul 18 12:01:13.306910 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:01:13.306619    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/df118917-490f-4cec-b699-aae5edcae68c-istio-token\") pod \"e2e-shared-a-399bd8-openshift-default-56b4b5f97f-d72mp\" (UID: \"df118917-490f-4cec-b699-aae5edcae68c\") " pod="openshift-ingress/e2e-shared-a-399bd8-openshift-default-56b4b5f97f-d72mp"
Jul 18 12:01:13.306910 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:01:13.306677    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/df118917-490f-4cec-b699-aae5edcae68c-istio-data\") pod \"e2e-shared-a-399bd8-openshift-default-56b4b5f97f-d72mp\" (UID: \"df118917-490f-4cec-b699-aae5edcae68c\") " pod="openshift-ingress/e2e-shared-a-399bd8-openshift-default-56b4b5f97f-d72mp"
Jul 18 12:01:13.306910 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:01:13.306716    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/df118917-490f-4cec-b699-aae5edcae68c-istio-envoy\") pod \"e2e-shared-a-399bd8-openshift-default-56b4b5f97f-d72mp\" (UID: \"df118917-490f-4cec-b699-aae5edcae68c\") " pod="openshift-ingress/e2e-shared-a-399bd8-openshift-default-56b4b5f97f-d72mp"
Jul 18 12:01:13.306910 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:01:13.306743    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/df118917-490f-4cec-b699-aae5edcae68c-istio-podinfo\") pod \"e2e-shared-a-399bd8-openshift-default-56b4b5f97f-d72mp\" (UID: \"df118917-490f-4cec-b699-aae5edcae68c\") " pod="openshift-ingress/e2e-shared-a-399bd8-openshift-default-56b4b5f97f-d72mp"
Jul 18 12:01:13.306910 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:01:13.306784    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/df118917-490f-4cec-b699-aae5edcae68c-istiod-ca-cert\") pod \"e2e-shared-a-399bd8-openshift-default-56b4b5f97f-d72mp\" (UID: \"df118917-490f-4cec-b699-aae5edcae68c\") " pod="openshift-ingress/e2e-shared-a-399bd8-openshift-default-56b4b5f97f-d72mp"
Jul 18 12:01:13.306910 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:01:13.306840    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/df118917-490f-4cec-b699-aae5edcae68c-workload-certs\") pod \"e2e-shared-a-399bd8-openshift-default-56b4b5f97f-d72mp\" (UID: \"df118917-490f-4cec-b699-aae5edcae68c\") " pod="openshift-ingress/e2e-shared-a-399bd8-openshift-default-56b4b5f97f-d72mp"
Jul 18 12:01:13.407657 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:01:13.407621    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/df118917-490f-4cec-b699-aae5edcae68c-istio-token\") pod \"e2e-shared-a-399bd8-openshift-default-56b4b5f97f-d72mp\" (UID: \"df118917-490f-4cec-b699-aae5edcae68c\") " pod="openshift-ingress/e2e-shared-a-399bd8-openshift-default-56b4b5f97f-d72mp"
Jul 18 12:01:13.407862 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:01:13.407673    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/df118917-490f-4cec-b699-aae5edcae68c-istio-data\") pod \"e2e-shared-a-399bd8-openshift-default-56b4b5f97f-d72mp\" (UID: \"df118917-490f-4cec-b699-aae5edcae68c\") " pod="openshift-ingress/e2e-shared-a-399bd8-openshift-default-56b4b5f97f-d72mp"
Jul 18 12:01:13.407862 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:01:13.407694    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/df118917-490f-4cec-b699-aae5edcae68c-istio-envoy\") pod \"e2e-shared-a-399bd8-openshift-default-56b4b5f97f-d72mp\" (UID: \"df118917-490f-4cec-b699-aae5edcae68c\") " pod="openshift-ingress/e2e-shared-a-399bd8-openshift-default-56b4b5f97f-d72mp"
Jul 18 12:01:13.407862 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:01:13.407822    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/df118917-490f-4cec-b699-aae5edcae68c-istio-podinfo\") pod \"e2e-shared-a-399bd8-openshift-default-56b4b5f97f-d72mp\" (UID: \"df118917-490f-4cec-b699-aae5edcae68c\") " pod="openshift-ingress/e2e-shared-a-399bd8-openshift-default-56b4b5f97f-d72mp"
Jul 18 12:01:13.408130 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:01:13.407905    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/df118917-490f-4cec-b699-aae5edcae68c-istiod-ca-cert\") pod \"e2e-shared-a-399bd8-openshift-default-56b4b5f97f-d72mp\" (UID: \"df118917-490f-4cec-b699-aae5edcae68c\") " pod="openshift-ingress/e2e-shared-a-399bd8-openshift-default-56b4b5f97f-d72mp"
Jul 18 12:01:13.408130 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:01:13.407947    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/df118917-490f-4cec-b699-aae5edcae68c-workload-certs\") pod \"e2e-shared-a-399bd8-openshift-default-56b4b5f97f-d72mp\" (UID: \"df118917-490f-4cec-b699-aae5edcae68c\") " pod="openshift-ingress/e2e-shared-a-399bd8-openshift-default-56b4b5f97f-d72mp"
Jul 18 12:01:13.408130 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:01:13.407999    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2ltsh\" (UniqueName: \"kubernetes.io/projected/df118917-490f-4cec-b699-aae5edcae68c-kube-api-access-2ltsh\") pod \"e2e-shared-a-399bd8-openshift-default-56b4b5f97f-d72mp\" (UID: \"df118917-490f-4cec-b699-aae5edcae68c\") " pod="openshift-ingress/e2e-shared-a-399bd8-openshift-default-56b4b5f97f-d72mp"
Jul 18 12:01:13.408130 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:01:13.408060    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/df118917-490f-4cec-b699-aae5edcae68c-credential-socket\") pod \"e2e-shared-a-399bd8-openshift-default-56b4b5f97f-d72mp\" (UID: \"df118917-490f-4cec-b699-aae5edcae68c\") " pod="openshift-ingress/e2e-shared-a-399bd8-openshift-default-56b4b5f97f-d72mp"
Jul 18 12:01:13.408130 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:01:13.408094    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/df118917-490f-4cec-b699-aae5edcae68c-workload-socket\") pod \"e2e-shared-a-399bd8-openshift-default-56b4b5f97f-d72mp\" (UID: \"df118917-490f-4cec-b699-aae5edcae68c\") " pod="openshift-ingress/e2e-shared-a-399bd8-openshift-default-56b4b5f97f-d72mp"
Jul 18 12:01:13.408339 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:01:13.408169    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/df118917-490f-4cec-b699-aae5edcae68c-istio-data\") pod \"e2e-shared-a-399bd8-openshift-default-56b4b5f97f-d72mp\" (UID: \"df118917-490f-4cec-b699-aae5edcae68c\") " pod="openshift-ingress/e2e-shared-a-399bd8-openshift-default-56b4b5f97f-d72mp"
Jul 18 12:01:13.408737 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:01:13.408697    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/df118917-490f-4cec-b699-aae5edcae68c-workload-certs\") pod \"e2e-shared-a-399bd8-openshift-default-56b4b5f97f-d72mp\" (UID: \"df118917-490f-4cec-b699-aae5edcae68c\") " pod="openshift-ingress/e2e-shared-a-399bd8-openshift-default-56b4b5f97f-d72mp"
Jul 18 12:01:13.408853 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:01:13.408719    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/df118917-490f-4cec-b699-aae5edcae68c-istiod-ca-cert\") pod \"e2e-shared-a-399bd8-openshift-default-56b4b5f97f-d72mp\" (UID: \"df118917-490f-4cec-b699-aae5edcae68c\") " pod="openshift-ingress/e2e-shared-a-399bd8-openshift-default-56b4b5f97f-d72mp"
Jul 18 12:01:13.408853 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:01:13.408783    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/df118917-490f-4cec-b699-aae5edcae68c-workload-socket\") pod \"e2e-shared-a-399bd8-openshift-default-56b4b5f97f-d72mp\" (UID: \"df118917-490f-4cec-b699-aae5edcae68c\") " pod="openshift-ingress/e2e-shared-a-399bd8-openshift-default-56b4b5f97f-d72mp"
Jul 18 12:01:13.408853 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:01:13.408809    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/df118917-490f-4cec-b699-aae5edcae68c-credential-socket\") pod \"e2e-shared-a-399bd8-openshift-default-56b4b5f97f-d72mp\" (UID: \"df118917-490f-4cec-b699-aae5edcae68c\") " pod="openshift-ingress/e2e-shared-a-399bd8-openshift-default-56b4b5f97f-d72mp"
Jul 18 12:01:13.418212 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:01:13.410717    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/df118917-490f-4cec-b699-aae5edcae68c-istio-podinfo\") pod \"e2e-shared-a-399bd8-openshift-default-56b4b5f97f-d72mp\" (UID: \"df118917-490f-4cec-b699-aae5edcae68c\") " pod="openshift-ingress/e2e-shared-a-399bd8-openshift-default-56b4b5f97f-d72mp"
Jul 18 12:01:13.418212 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:01:13.410723    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/df118917-490f-4cec-b699-aae5edcae68c-istio-envoy\") pod \"e2e-shared-a-399bd8-openshift-default-56b4b5f97f-d72mp\" (UID: \"df118917-490f-4cec-b699-aae5edcae68c\") " pod="openshift-ingress/e2e-shared-a-399bd8-openshift-default-56b4b5f97f-d72mp"
Jul 18 12:01:13.422284 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:01:13.422254    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/df118917-490f-4cec-b699-aae5edcae68c-istio-token\") pod \"e2e-shared-a-399bd8-openshift-default-56b4b5f97f-d72mp\" (UID: \"df118917-490f-4cec-b699-aae5edcae68c\") " pod="openshift-ingress/e2e-shared-a-399bd8-openshift-default-56b4b5f97f-d72mp"
Jul 18 12:01:13.422504 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:01:13.422479    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2ltsh\" (UniqueName: \"kubernetes.io/projected/df118917-490f-4cec-b699-aae5edcae68c-kube-api-access-2ltsh\") pod \"e2e-shared-a-399bd8-openshift-default-56b4b5f97f-d72mp\" (UID: \"df118917-490f-4cec-b699-aae5edcae68c\") " pod="openshift-ingress/e2e-shared-a-399bd8-openshift-default-56b4b5f97f-d72mp"
Jul 18 12:01:13.547473 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:01:13.547378    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-399bd8-openshift-default-56b4b5f97f-d72mp"
Jul 18 12:01:13.696282 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:01:13.696253    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-399bd8-openshift-default-56b4b5f97f-d72mp"]
Jul 18 12:01:13.698610 ip-10-0-133-122 kubenswrapper[2579]: W0718 12:01:13.698585    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddf118917_490f_4cec_b699_aae5edcae68c.slice/crio-bf3028d961f9fd1b57fbcdffbb2a743eb381f1bb230df9d98fde8f71e566b83c WatchSource:0}: Error finding container bf3028d961f9fd1b57fbcdffbb2a743eb381f1bb230df9d98fde8f71e566b83c: Status 404 returned error can't find the container with id bf3028d961f9fd1b57fbcdffbb2a743eb381f1bb230df9d98fde8f71e566b83c
Jul 18 12:01:13.701139 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:01:13.701101    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 18 12:01:13.701224 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:01:13.701172    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 18 12:01:13.701224 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:01:13.701200    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 18 12:01:14.690328 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:01:14.690289    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-399bd8-openshift-default-56b4b5f97f-d72mp" event={"ID":"df118917-490f-4cec-b699-aae5edcae68c","Type":"ContainerStarted","Data":"76d5888cc55addfb80532e34e0fa6c56480ceee807efc3a25b26aa983a125a12"}
Jul 18 12:01:14.690733 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:01:14.690342    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-399bd8-openshift-default-56b4b5f97f-d72mp" event={"ID":"df118917-490f-4cec-b699-aae5edcae68c","Type":"ContainerStarted","Data":"bf3028d961f9fd1b57fbcdffbb2a743eb381f1bb230df9d98fde8f71e566b83c"}
Jul 18 12:01:14.711858 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:01:14.711803    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-399bd8-openshift-default-56b4b5f97f-d72mp" podStartSLOduration=1.711784472 podStartE2EDuration="1.711784472s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 12:01:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 12:01:14.709035209 +0000 UTC m=+2494.324071512" watchObservedRunningTime="2026-07-18 12:01:14.711784472 +0000 UTC m=+2494.326820773"
Jul 18 12:01:15.548229 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:01:15.548186    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-399bd8-openshift-default-56b4b5f97f-d72mp"
Jul 18 12:01:15.553493 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:01:15.553467    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-399bd8-openshift-default-56b4b5f97f-d72mp"
Jul 18 12:01:15.696262 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:01:15.696230    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-399bd8-openshift-default-56b4b5f97f-d72mp"
Jul 18 12:01:15.697201 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:01:15.697183    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-399bd8-openshift-default-56b4b5f97f-d72mp"
Jul 18 12:01:17.560904 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:01:17.560831    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-1dc2c9-openshift-default-7b6459697-bdhsw"
Jul 18 12:01:17.650283 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:01:17.650244    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/53be6190-474e-4dc7-a0bf-e79677dbcf80-istio-token\") pod \"53be6190-474e-4dc7-a0bf-e79677dbcf80\" (UID: \"53be6190-474e-4dc7-a0bf-e79677dbcf80\") "
Jul 18 12:01:17.650283 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:01:17.650285    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/53be6190-474e-4dc7-a0bf-e79677dbcf80-istio-envoy\") pod \"53be6190-474e-4dc7-a0bf-e79677dbcf80\" (UID: \"53be6190-474e-4dc7-a0bf-e79677dbcf80\") "
Jul 18 12:01:17.650550 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:01:17.650317    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-km9j5\" (UniqueName: \"kubernetes.io/projected/53be6190-474e-4dc7-a0bf-e79677dbcf80-kube-api-access-km9j5\") pod \"53be6190-474e-4dc7-a0bf-e79677dbcf80\" (UID: \"53be6190-474e-4dc7-a0bf-e79677dbcf80\") "
Jul 18 12:01:17.650550 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:01:17.650352    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/53be6190-474e-4dc7-a0bf-e79677dbcf80-istio-data\") pod \"53be6190-474e-4dc7-a0bf-e79677dbcf80\" (UID: \"53be6190-474e-4dc7-a0bf-e79677dbcf80\") "
Jul 18 12:01:17.650550 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:01:17.650414    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/53be6190-474e-4dc7-a0bf-e79677dbcf80-istiod-ca-cert\") pod \"53be6190-474e-4dc7-a0bf-e79677dbcf80\" (UID: \"53be6190-474e-4dc7-a0bf-e79677dbcf80\") "
Jul 18 12:01:17.650550 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:01:17.650480    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/53be6190-474e-4dc7-a0bf-e79677dbcf80-workload-certs\") pod \"53be6190-474e-4dc7-a0bf-e79677dbcf80\" (UID: \"53be6190-474e-4dc7-a0bf-e79677dbcf80\") "
Jul 18 12:01:17.650765 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:01:17.650557    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/53be6190-474e-4dc7-a0bf-e79677dbcf80-istio-podinfo\") pod \"53be6190-474e-4dc7-a0bf-e79677dbcf80\" (UID: \"53be6190-474e-4dc7-a0bf-e79677dbcf80\") "
Jul 18 12:01:17.650765 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:01:17.650601    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/53be6190-474e-4dc7-a0bf-e79677dbcf80-credential-socket\") pod \"53be6190-474e-4dc7-a0bf-e79677dbcf80\" (UID: \"53be6190-474e-4dc7-a0bf-e79677dbcf80\") "
Jul 18 12:01:17.650765 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:01:17.650629    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/53be6190-474e-4dc7-a0bf-e79677dbcf80-workload-socket\") pod \"53be6190-474e-4dc7-a0bf-e79677dbcf80\" (UID: \"53be6190-474e-4dc7-a0bf-e79677dbcf80\") "
Jul 18 12:01:17.650991 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:01:17.650777    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/53be6190-474e-4dc7-a0bf-e79677dbcf80-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "53be6190-474e-4dc7-a0bf-e79677dbcf80" (UID: "53be6190-474e-4dc7-a0bf-e79677dbcf80"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 12:01:17.650991 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:01:17.650975    2579 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/53be6190-474e-4dc7-a0bf-e79677dbcf80-workload-certs\") on node \"ip-10-0-133-122.ec2.internal\" DevicePath \"\""
Jul 18 12:01:17.651105 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:01:17.650995    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/53be6190-474e-4dc7-a0bf-e79677dbcf80-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "53be6190-474e-4dc7-a0bf-e79677dbcf80" (UID: "53be6190-474e-4dc7-a0bf-e79677dbcf80"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 12:01:17.651209 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:01:17.651187    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/53be6190-474e-4dc7-a0bf-e79677dbcf80-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "53be6190-474e-4dc7-a0bf-e79677dbcf80" (UID: "53be6190-474e-4dc7-a0bf-e79677dbcf80"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 12:01:17.651269 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:01:17.651113    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/53be6190-474e-4dc7-a0bf-e79677dbcf80-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "53be6190-474e-4dc7-a0bf-e79677dbcf80" (UID: "53be6190-474e-4dc7-a0bf-e79677dbcf80"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 18 12:01:17.651386 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:01:17.651361    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/53be6190-474e-4dc7-a0bf-e79677dbcf80-istio-data" (OuterVolumeSpecName: "istio-data") pod "53be6190-474e-4dc7-a0bf-e79677dbcf80" (UID: "53be6190-474e-4dc7-a0bf-e79677dbcf80"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 12:01:17.652691 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:01:17.652662    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/53be6190-474e-4dc7-a0bf-e79677dbcf80-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "53be6190-474e-4dc7-a0bf-e79677dbcf80" (UID: "53be6190-474e-4dc7-a0bf-e79677dbcf80"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 12:01:17.652819 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:01:17.652756    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/53be6190-474e-4dc7-a0bf-e79677dbcf80-kube-api-access-km9j5" (OuterVolumeSpecName: "kube-api-access-km9j5") pod "53be6190-474e-4dc7-a0bf-e79677dbcf80" (UID: "53be6190-474e-4dc7-a0bf-e79677dbcf80"). InnerVolumeSpecName "kube-api-access-km9j5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 18 12:01:17.652971 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:01:17.652954    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/53be6190-474e-4dc7-a0bf-e79677dbcf80-istio-token" (OuterVolumeSpecName: "istio-token") pod "53be6190-474e-4dc7-a0bf-e79677dbcf80" (UID: "53be6190-474e-4dc7-a0bf-e79677dbcf80"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 18 12:01:17.653144 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:01:17.653121    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/53be6190-474e-4dc7-a0bf-e79677dbcf80-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "53be6190-474e-4dc7-a0bf-e79677dbcf80" (UID: "53be6190-474e-4dc7-a0bf-e79677dbcf80"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 18 12:01:17.707823 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:01:17.707789    2579 generic.go:356] "Generic (PLEG): container finished" podID="53be6190-474e-4dc7-a0bf-e79677dbcf80" containerID="4cd09f21cac546019a0dcb67e02233c80196ba01f4448c114194c464e9465baa" exitCode=0
Jul 18 12:01:17.708013 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:01:17.707838    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-1dc2c9-openshift-default-7b6459697-bdhsw"
Jul 18 12:01:17.708013 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:01:17.707873    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-1dc2c9-openshift-default-7b6459697-bdhsw" event={"ID":"53be6190-474e-4dc7-a0bf-e79677dbcf80","Type":"ContainerDied","Data":"4cd09f21cac546019a0dcb67e02233c80196ba01f4448c114194c464e9465baa"}
Jul 18 12:01:17.708013 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:01:17.707947    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-1dc2c9-openshift-default-7b6459697-bdhsw" event={"ID":"53be6190-474e-4dc7-a0bf-e79677dbcf80","Type":"ContainerDied","Data":"caa9c315b43d046d8834575b3b4d8519013646f3b47ab3dbcc0330d9b07ad695"}
Jul 18 12:01:17.708013 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:01:17.707971    2579 scope.go:117] "RemoveContainer" containerID="4cd09f21cac546019a0dcb67e02233c80196ba01f4448c114194c464e9465baa"
Jul 18 12:01:17.717700 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:01:17.717680    2579 scope.go:117] "RemoveContainer" containerID="b822fa52f68e8ea7cccb6b0632fda48e69f0ade271af665a93d147777480d6bc"
Jul 18 12:01:17.727641 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:01:17.727621    2579 scope.go:117] "RemoveContainer" containerID="4cd09f21cac546019a0dcb67e02233c80196ba01f4448c114194c464e9465baa"
Jul 18 12:01:17.727938 ip-10-0-133-122 kubenswrapper[2579]: E0718 12:01:17.727918    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4cd09f21cac546019a0dcb67e02233c80196ba01f4448c114194c464e9465baa\": container with ID starting with 4cd09f21cac546019a0dcb67e02233c80196ba01f4448c114194c464e9465baa not found: ID does not exist" containerID="4cd09f21cac546019a0dcb67e02233c80196ba01f4448c114194c464e9465baa"
Jul 18 12:01:17.728029 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:01:17.727951    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4cd09f21cac546019a0dcb67e02233c80196ba01f4448c114194c464e9465baa"} err="failed to get container status \"4cd09f21cac546019a0dcb67e02233c80196ba01f4448c114194c464e9465baa\": rpc error: code = NotFound desc = could not find container \"4cd09f21cac546019a0dcb67e02233c80196ba01f4448c114194c464e9465baa\": container with ID starting with 4cd09f21cac546019a0dcb67e02233c80196ba01f4448c114194c464e9465baa not found: ID does not exist"
Jul 18 12:01:17.728029 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:01:17.727976    2579 scope.go:117] "RemoveContainer" containerID="b822fa52f68e8ea7cccb6b0632fda48e69f0ade271af665a93d147777480d6bc"
Jul 18 12:01:17.728269 ip-10-0-133-122 kubenswrapper[2579]: E0718 12:01:17.728252    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b822fa52f68e8ea7cccb6b0632fda48e69f0ade271af665a93d147777480d6bc\": container with ID starting with b822fa52f68e8ea7cccb6b0632fda48e69f0ade271af665a93d147777480d6bc not found: ID does not exist" containerID="b822fa52f68e8ea7cccb6b0632fda48e69f0ade271af665a93d147777480d6bc"
Jul 18 12:01:17.728313 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:01:17.728277    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b822fa52f68e8ea7cccb6b0632fda48e69f0ade271af665a93d147777480d6bc"} err="failed to get container status \"b822fa52f68e8ea7cccb6b0632fda48e69f0ade271af665a93d147777480d6bc\": rpc error: code = NotFound desc = could not find container \"b822fa52f68e8ea7cccb6b0632fda48e69f0ade271af665a93d147777480d6bc\": container with ID starting with b822fa52f68e8ea7cccb6b0632fda48e69f0ade271af665a93d147777480d6bc not found: ID does not exist"
Jul 18 12:01:17.732638 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:01:17.732613    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-1dc2c9-openshift-default-7b6459697-bdhsw"]
Jul 18 12:01:17.737904 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:01:17.737871    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-1dc2c9-openshift-default-7b6459697-bdhsw"]
Jul 18 12:01:17.752180 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:01:17.752149    2579 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/53be6190-474e-4dc7-a0bf-e79677dbcf80-istio-podinfo\") on node \"ip-10-0-133-122.ec2.internal\" DevicePath \"\""
Jul 18 12:01:17.752180 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:01:17.752175    2579 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/53be6190-474e-4dc7-a0bf-e79677dbcf80-credential-socket\") on node \"ip-10-0-133-122.ec2.internal\" DevicePath \"\""
Jul 18 12:01:17.752375 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:01:17.752192    2579 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/53be6190-474e-4dc7-a0bf-e79677dbcf80-workload-socket\") on node \"ip-10-0-133-122.ec2.internal\" DevicePath \"\""
Jul 18 12:01:17.752375 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:01:17.752206    2579 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/53be6190-474e-4dc7-a0bf-e79677dbcf80-istio-token\") on node \"ip-10-0-133-122.ec2.internal\" DevicePath \"\""
Jul 18 12:01:17.752375 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:01:17.752222    2579 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/53be6190-474e-4dc7-a0bf-e79677dbcf80-istio-envoy\") on node \"ip-10-0-133-122.ec2.internal\" DevicePath \"\""
Jul 18 12:01:17.752375 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:01:17.752236    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-km9j5\" (UniqueName: \"kubernetes.io/projected/53be6190-474e-4dc7-a0bf-e79677dbcf80-kube-api-access-km9j5\") on node \"ip-10-0-133-122.ec2.internal\" DevicePath \"\""
Jul 18 12:01:17.752375 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:01:17.752246    2579 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/53be6190-474e-4dc7-a0bf-e79677dbcf80-istio-data\") on node \"ip-10-0-133-122.ec2.internal\" DevicePath \"\""
Jul 18 12:01:17.752375 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:01:17.752255    2579 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/53be6190-474e-4dc7-a0bf-e79677dbcf80-istiod-ca-cert\") on node \"ip-10-0-133-122.ec2.internal\" DevicePath \"\""
Jul 18 12:01:18.895032 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:01:18.895001    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="53be6190-474e-4dc7-a0bf-e79677dbcf80" path="/var/lib/kubelet/pods/53be6190-474e-4dc7-a0bf-e79677dbcf80/volumes"
Jul 18 12:01:21.801686 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:01:21.801652    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-276d7e-openshift-default-844b468f7f-78tmb"]
Jul 18 12:01:21.802169 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:01:21.802151    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="53be6190-474e-4dc7-a0bf-e79677dbcf80" containerName="istio-proxy"
Jul 18 12:01:21.802215 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:01:21.802172    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="53be6190-474e-4dc7-a0bf-e79677dbcf80" containerName="istio-proxy"
Jul 18 12:01:21.802215 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:01:21.802189    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="53be6190-474e-4dc7-a0bf-e79677dbcf80" containerName="istio-proxy"
Jul 18 12:01:21.802215 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:01:21.802195    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="53be6190-474e-4dc7-a0bf-e79677dbcf80" containerName="istio-proxy"
Jul 18 12:01:21.802320 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:01:21.802287    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="53be6190-474e-4dc7-a0bf-e79677dbcf80" containerName="istio-proxy"
Jul 18 12:01:21.805265 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:01:21.805240    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-276d7e-openshift-default-844b468f7f-78tmb"
Jul 18 12:01:21.807843 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:01:21.807821    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-276d7e-openshift-default-dockercfg-nt6dh\""
Jul 18 12:01:21.817504 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:01:21.817480    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-276d7e-openshift-default-844b468f7f-78tmb"]
Jul 18 12:01:21.888626 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:01:21.888589    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5327e344-9bf0-4742-88dd-aff196c8994c-credential-socket\") pod \"e2e-shared-b-276d7e-openshift-default-844b468f7f-78tmb\" (UID: \"5327e344-9bf0-4742-88dd-aff196c8994c\") " pod="openshift-ingress/e2e-shared-b-276d7e-openshift-default-844b468f7f-78tmb"
Jul 18 12:01:21.888793 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:01:21.888635    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5327e344-9bf0-4742-88dd-aff196c8994c-workload-socket\") pod \"e2e-shared-b-276d7e-openshift-default-844b468f7f-78tmb\" (UID: \"5327e344-9bf0-4742-88dd-aff196c8994c\") " pod="openshift-ingress/e2e-shared-b-276d7e-openshift-default-844b468f7f-78tmb"
Jul 18 12:01:21.888793 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:01:21.888741    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5327e344-9bf0-4742-88dd-aff196c8994c-workload-certs\") pod \"e2e-shared-b-276d7e-openshift-default-844b468f7f-78tmb\" (UID: \"5327e344-9bf0-4742-88dd-aff196c8994c\") " pod="openshift-ingress/e2e-shared-b-276d7e-openshift-default-844b468f7f-78tmb"
Jul 18 12:01:21.888793 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:01:21.888778    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5327e344-9bf0-4742-88dd-aff196c8994c-istio-podinfo\") pod \"e2e-shared-b-276d7e-openshift-default-844b468f7f-78tmb\" (UID: \"5327e344-9bf0-4742-88dd-aff196c8994c\") " pod="openshift-ingress/e2e-shared-b-276d7e-openshift-default-844b468f7f-78tmb"
Jul 18 12:01:21.888978 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:01:21.888815    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5327e344-9bf0-4742-88dd-aff196c8994c-istiod-ca-cert\") pod \"e2e-shared-b-276d7e-openshift-default-844b468f7f-78tmb\" (UID: \"5327e344-9bf0-4742-88dd-aff196c8994c\") " pod="openshift-ingress/e2e-shared-b-276d7e-openshift-default-844b468f7f-78tmb"
Jul 18 12:01:21.888978 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:01:21.888842    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5327e344-9bf0-4742-88dd-aff196c8994c-istio-token\") pod \"e2e-shared-b-276d7e-openshift-default-844b468f7f-78tmb\" (UID: \"5327e344-9bf0-4742-88dd-aff196c8994c\") " pod="openshift-ingress/e2e-shared-b-276d7e-openshift-default-844b468f7f-78tmb"
Jul 18 12:01:21.888978 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:01:21.888865    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5327e344-9bf0-4742-88dd-aff196c8994c-istio-envoy\") pod \"e2e-shared-b-276d7e-openshift-default-844b468f7f-78tmb\" (UID: \"5327e344-9bf0-4742-88dd-aff196c8994c\") " pod="openshift-ingress/e2e-shared-b-276d7e-openshift-default-844b468f7f-78tmb"
Jul 18 12:01:21.888978 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:01:21.888943    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qt6rv\" (UniqueName: \"kubernetes.io/projected/5327e344-9bf0-4742-88dd-aff196c8994c-kube-api-access-qt6rv\") pod \"e2e-shared-b-276d7e-openshift-default-844b468f7f-78tmb\" (UID: \"5327e344-9bf0-4742-88dd-aff196c8994c\") " pod="openshift-ingress/e2e-shared-b-276d7e-openshift-default-844b468f7f-78tmb"
Jul 18 12:01:21.889133 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:01:21.889020    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5327e344-9bf0-4742-88dd-aff196c8994c-istio-data\") pod \"e2e-shared-b-276d7e-openshift-default-844b468f7f-78tmb\" (UID: \"5327e344-9bf0-4742-88dd-aff196c8994c\") " pod="openshift-ingress/e2e-shared-b-276d7e-openshift-default-844b468f7f-78tmb"
Jul 18 12:01:21.990341 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:01:21.990309    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5327e344-9bf0-4742-88dd-aff196c8994c-istio-data\") pod \"e2e-shared-b-276d7e-openshift-default-844b468f7f-78tmb\" (UID: \"5327e344-9bf0-4742-88dd-aff196c8994c\") " pod="openshift-ingress/e2e-shared-b-276d7e-openshift-default-844b468f7f-78tmb"
Jul 18 12:01:21.990341 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:01:21.990344    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5327e344-9bf0-4742-88dd-aff196c8994c-credential-socket\") pod \"e2e-shared-b-276d7e-openshift-default-844b468f7f-78tmb\" (UID: \"5327e344-9bf0-4742-88dd-aff196c8994c\") " pod="openshift-ingress/e2e-shared-b-276d7e-openshift-default-844b468f7f-78tmb"
Jul 18 12:01:21.990592 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:01:21.990363    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5327e344-9bf0-4742-88dd-aff196c8994c-workload-socket\") pod \"e2e-shared-b-276d7e-openshift-default-844b468f7f-78tmb\" (UID: \"5327e344-9bf0-4742-88dd-aff196c8994c\") " pod="openshift-ingress/e2e-shared-b-276d7e-openshift-default-844b468f7f-78tmb"
Jul 18 12:01:21.990592 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:01:21.990410    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5327e344-9bf0-4742-88dd-aff196c8994c-workload-certs\") pod \"e2e-shared-b-276d7e-openshift-default-844b468f7f-78tmb\" (UID: \"5327e344-9bf0-4742-88dd-aff196c8994c\") " pod="openshift-ingress/e2e-shared-b-276d7e-openshift-default-844b468f7f-78tmb"
Jul 18 12:01:21.990592 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:01:21.990431    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5327e344-9bf0-4742-88dd-aff196c8994c-istio-podinfo\") pod \"e2e-shared-b-276d7e-openshift-default-844b468f7f-78tmb\" (UID: \"5327e344-9bf0-4742-88dd-aff196c8994c\") " pod="openshift-ingress/e2e-shared-b-276d7e-openshift-default-844b468f7f-78tmb"
Jul 18 12:01:21.990592 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:01:21.990456    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5327e344-9bf0-4742-88dd-aff196c8994c-istiod-ca-cert\") pod \"e2e-shared-b-276d7e-openshift-default-844b468f7f-78tmb\" (UID: \"5327e344-9bf0-4742-88dd-aff196c8994c\") " pod="openshift-ingress/e2e-shared-b-276d7e-openshift-default-844b468f7f-78tmb"
Jul 18 12:01:21.990592 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:01:21.990491    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5327e344-9bf0-4742-88dd-aff196c8994c-istio-token\") pod \"e2e-shared-b-276d7e-openshift-default-844b468f7f-78tmb\" (UID: \"5327e344-9bf0-4742-88dd-aff196c8994c\") " pod="openshift-ingress/e2e-shared-b-276d7e-openshift-default-844b468f7f-78tmb"
Jul 18 12:01:21.990592 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:01:21.990525    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5327e344-9bf0-4742-88dd-aff196c8994c-istio-envoy\") pod \"e2e-shared-b-276d7e-openshift-default-844b468f7f-78tmb\" (UID: \"5327e344-9bf0-4742-88dd-aff196c8994c\") " pod="openshift-ingress/e2e-shared-b-276d7e-openshift-default-844b468f7f-78tmb"
Jul 18 12:01:21.990592 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:01:21.990552    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qt6rv\" (UniqueName: \"kubernetes.io/projected/5327e344-9bf0-4742-88dd-aff196c8994c-kube-api-access-qt6rv\") pod \"e2e-shared-b-276d7e-openshift-default-844b468f7f-78tmb\" (UID: \"5327e344-9bf0-4742-88dd-aff196c8994c\") " pod="openshift-ingress/e2e-shared-b-276d7e-openshift-default-844b468f7f-78tmb"
Jul 18 12:01:21.990990 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:01:21.990766    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5327e344-9bf0-4742-88dd-aff196c8994c-credential-socket\") pod \"e2e-shared-b-276d7e-openshift-default-844b468f7f-78tmb\" (UID: \"5327e344-9bf0-4742-88dd-aff196c8994c\") " pod="openshift-ingress/e2e-shared-b-276d7e-openshift-default-844b468f7f-78tmb"
Jul 18 12:01:21.991164 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:01:21.991136    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5327e344-9bf0-4742-88dd-aff196c8994c-workload-certs\") pod \"e2e-shared-b-276d7e-openshift-default-844b468f7f-78tmb\" (UID: \"5327e344-9bf0-4742-88dd-aff196c8994c\") " pod="openshift-ingress/e2e-shared-b-276d7e-openshift-default-844b468f7f-78tmb"
Jul 18 12:01:21.991310 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:01:21.991196    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5327e344-9bf0-4742-88dd-aff196c8994c-workload-socket\") pod \"e2e-shared-b-276d7e-openshift-default-844b468f7f-78tmb\" (UID: \"5327e344-9bf0-4742-88dd-aff196c8994c\") " pod="openshift-ingress/e2e-shared-b-276d7e-openshift-default-844b468f7f-78tmb"
Jul 18 12:01:21.991310 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:01:21.991228    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5327e344-9bf0-4742-88dd-aff196c8994c-istio-data\") pod \"e2e-shared-b-276d7e-openshift-default-844b468f7f-78tmb\" (UID: \"5327e344-9bf0-4742-88dd-aff196c8994c\") " pod="openshift-ingress/e2e-shared-b-276d7e-openshift-default-844b468f7f-78tmb"
Jul 18 12:01:21.991559 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:01:21.991539    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5327e344-9bf0-4742-88dd-aff196c8994c-istiod-ca-cert\") pod \"e2e-shared-b-276d7e-openshift-default-844b468f7f-78tmb\" (UID: \"5327e344-9bf0-4742-88dd-aff196c8994c\") " pod="openshift-ingress/e2e-shared-b-276d7e-openshift-default-844b468f7f-78tmb"
Jul 18 12:01:21.993098 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:01:21.993077    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5327e344-9bf0-4742-88dd-aff196c8994c-istio-envoy\") pod \"e2e-shared-b-276d7e-openshift-default-844b468f7f-78tmb\" (UID: \"5327e344-9bf0-4742-88dd-aff196c8994c\") " pod="openshift-ingress/e2e-shared-b-276d7e-openshift-default-844b468f7f-78tmb"
Jul 18 12:01:21.993098 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:01:21.993094    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5327e344-9bf0-4742-88dd-aff196c8994c-istio-podinfo\") pod \"e2e-shared-b-276d7e-openshift-default-844b468f7f-78tmb\" (UID: \"5327e344-9bf0-4742-88dd-aff196c8994c\") " pod="openshift-ingress/e2e-shared-b-276d7e-openshift-default-844b468f7f-78tmb"
Jul 18 12:01:21.998160 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:01:21.998132    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5327e344-9bf0-4742-88dd-aff196c8994c-istio-token\") pod \"e2e-shared-b-276d7e-openshift-default-844b468f7f-78tmb\" (UID: \"5327e344-9bf0-4742-88dd-aff196c8994c\") " pod="openshift-ingress/e2e-shared-b-276d7e-openshift-default-844b468f7f-78tmb"
Jul 18 12:01:21.998384 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:01:21.998362    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qt6rv\" (UniqueName: \"kubernetes.io/projected/5327e344-9bf0-4742-88dd-aff196c8994c-kube-api-access-qt6rv\") pod \"e2e-shared-b-276d7e-openshift-default-844b468f7f-78tmb\" (UID: \"5327e344-9bf0-4742-88dd-aff196c8994c\") " pod="openshift-ingress/e2e-shared-b-276d7e-openshift-default-844b468f7f-78tmb"
Jul 18 12:01:22.116004 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:01:22.115973    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-276d7e-openshift-default-844b468f7f-78tmb"
Jul 18 12:01:22.257421 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:01:22.257392    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-276d7e-openshift-default-844b468f7f-78tmb"]
Jul 18 12:01:22.259001 ip-10-0-133-122 kubenswrapper[2579]: W0718 12:01:22.258975    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5327e344_9bf0_4742_88dd_aff196c8994c.slice/crio-638138324ea0e9114d0e633129005148795bf74efd509cfd592ab0b162050e1d WatchSource:0}: Error finding container 638138324ea0e9114d0e633129005148795bf74efd509cfd592ab0b162050e1d: Status 404 returned error can't find the container with id 638138324ea0e9114d0e633129005148795bf74efd509cfd592ab0b162050e1d
Jul 18 12:01:22.261178 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:01:22.261145    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 18 12:01:22.261250 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:01:22.261217    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 18 12:01:22.261288 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:01:22.261246    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 18 12:01:22.735191 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:01:22.735155    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-276d7e-openshift-default-844b468f7f-78tmb" event={"ID":"5327e344-9bf0-4742-88dd-aff196c8994c","Type":"ContainerStarted","Data":"de9de7f262122cf3d44d3a358959fa096aecd1ee42284644d0b83ed22dd32ba4"}
Jul 18 12:01:22.735376 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:01:22.735211    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-276d7e-openshift-default-844b468f7f-78tmb" event={"ID":"5327e344-9bf0-4742-88dd-aff196c8994c","Type":"ContainerStarted","Data":"638138324ea0e9114d0e633129005148795bf74efd509cfd592ab0b162050e1d"}
Jul 18 12:01:22.754758 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:01:22.754704    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-276d7e-openshift-default-844b468f7f-78tmb" podStartSLOduration=1.754686258 podStartE2EDuration="1.754686258s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 12:01:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 12:01:22.75238876 +0000 UTC m=+2502.367425065" watchObservedRunningTime="2026-07-18 12:01:22.754686258 +0000 UTC m=+2502.369722560"
Jul 18 12:01:23.116203 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:01:23.116164    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-276d7e-openshift-default-844b468f7f-78tmb"
Jul 18 12:01:23.121315 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:01:23.121285    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-276d7e-openshift-default-844b468f7f-78tmb"
Jul 18 12:01:23.740586 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:01:23.740553    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-276d7e-openshift-default-844b468f7f-78tmb"
Jul 18 12:01:23.741569 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:01:23.741550    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-276d7e-openshift-default-844b468f7f-78tmb"
Jul 18 12:01:33.798638 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:01:33.798550    2579 generic.go:356] "Generic (PLEG): container finished" podID="df118917-490f-4cec-b699-aae5edcae68c" containerID="76d5888cc55addfb80532e34e0fa6c56480ceee807efc3a25b26aa983a125a12" exitCode=0
Jul 18 12:01:33.799113 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:01:33.798637    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-399bd8-openshift-default-56b4b5f97f-d72mp" event={"ID":"df118917-490f-4cec-b699-aae5edcae68c","Type":"ContainerDied","Data":"76d5888cc55addfb80532e34e0fa6c56480ceee807efc3a25b26aa983a125a12"}
Jul 18 12:01:33.799113 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:01:33.799102    2579 scope.go:117] "RemoveContainer" containerID="76d5888cc55addfb80532e34e0fa6c56480ceee807efc3a25b26aa983a125a12"
Jul 18 12:01:33.800083 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:01:33.800054    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 18 12:01:33.800155 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:01:33.800124    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 18 12:01:33.800192 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:01:33.800155    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 18 12:01:34.805842 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:01:34.805809    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-399bd8-openshift-default-56b4b5f97f-d72mp" event={"ID":"df118917-490f-4cec-b699-aae5edcae68c","Type":"ContainerStarted","Data":"13a02e3cbfe2ec5523c69d3c2cb3f2efa1d41c052dc907a71ca6463d481a4830"}
Jul 18 12:01:35.548854 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:01:35.548812    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-399bd8-openshift-default-56b4b5f97f-d72mp"
Jul 18 12:01:35.549092 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:01:35.548967    2579 patch_prober.go:28] interesting pod/e2e-shared-a-399bd8-openshift-default-56b4b5f97f-d72mp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.75:15021/healthz/ready\": dial tcp 10.132.0.75:15021: connect: connection refused" start-of-body=
Jul 18 12:01:35.549092 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:01:35.549013    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-399bd8-openshift-default-56b4b5f97f-d72mp" podUID="df118917-490f-4cec-b699-aae5edcae68c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.75:15021/healthz/ready\": dial tcp 10.132.0.75:15021: connect: connection refused"
Jul 18 12:01:36.548637 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:01:36.548571    2579 patch_prober.go:28] interesting pod/e2e-shared-a-399bd8-openshift-default-56b4b5f97f-d72mp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.75:15021/healthz/ready\": dial tcp 10.132.0.75:15021: connect: connection refused" start-of-body=
Jul 18 12:01:36.549204 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:01:36.548666    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-399bd8-openshift-default-56b4b5f97f-d72mp" podUID="df118917-490f-4cec-b699-aae5edcae68c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.75:15021/healthz/ready\": dial tcp 10.132.0.75:15021: connect: connection refused"
Jul 18 12:01:37.548364 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:01:37.547874    2579 patch_prober.go:28] interesting pod/e2e-shared-a-399bd8-openshift-default-56b4b5f97f-d72mp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.75:15021/healthz/ready\": dial tcp 10.132.0.75:15021: connect: connection refused" start-of-body=
Jul 18 12:01:37.548364 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:01:37.547958    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-399bd8-openshift-default-56b4b5f97f-d72mp" podUID="df118917-490f-4cec-b699-aae5edcae68c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.75:15021/healthz/ready\": dial tcp 10.132.0.75:15021: connect: connection refused"
Jul 18 12:01:38.548456 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:01:38.548403    2579 patch_prober.go:28] interesting pod/e2e-shared-a-399bd8-openshift-default-56b4b5f97f-d72mp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.75:15021/healthz/ready\": dial tcp 10.132.0.75:15021: connect: connection refused" start-of-body=
Jul 18 12:01:38.549024 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:01:38.548480    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-399bd8-openshift-default-56b4b5f97f-d72mp" podUID="df118917-490f-4cec-b699-aae5edcae68c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.75:15021/healthz/ready\": dial tcp 10.132.0.75:15021: connect: connection refused"
Jul 18 12:01:39.551930 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:01:39.551872    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-399bd8-openshift-default-56b4b5f97f-d72mp"
Jul 18 12:01:39.552415 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:01:39.552391    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-399bd8-openshift-default-56b4b5f97f-d72mp"
Jul 18 12:01:39.553229 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:01:39.553204    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-399bd8-openshift-default-56b4b5f97f-d72mp"
Jul 18 12:01:41.852789 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:01:41.852763    2579 generic.go:356] "Generic (PLEG): container finished" podID="5327e344-9bf0-4742-88dd-aff196c8994c" containerID="de9de7f262122cf3d44d3a358959fa096aecd1ee42284644d0b83ed22dd32ba4" exitCode=0
Jul 18 12:01:41.853222 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:01:41.852846    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-276d7e-openshift-default-844b468f7f-78tmb" event={"ID":"5327e344-9bf0-4742-88dd-aff196c8994c","Type":"ContainerDied","Data":"de9de7f262122cf3d44d3a358959fa096aecd1ee42284644d0b83ed22dd32ba4"}
Jul 18 12:01:41.853268 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:01:41.853249    2579 scope.go:117] "RemoveContainer" containerID="de9de7f262122cf3d44d3a358959fa096aecd1ee42284644d0b83ed22dd32ba4"
Jul 18 12:01:41.854280 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:01:41.854253    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 18 12:01:41.854361 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:01:41.854336    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 18 12:01:41.854401 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:01:41.854389    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 18 12:01:42.860538 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:01:42.860503    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-276d7e-openshift-default-844b468f7f-78tmb" event={"ID":"5327e344-9bf0-4742-88dd-aff196c8994c","Type":"ContainerStarted","Data":"656cf99620d350d5ecf27390108994e8d6c64d9df73426f2c6bcd670041cda7e"}
Jul 18 12:01:43.116265 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:01:43.116164    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-276d7e-openshift-default-844b468f7f-78tmb"
Jul 18 12:01:43.116426 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:01:43.116360    2579 patch_prober.go:28] interesting pod/e2e-shared-b-276d7e-openshift-default-844b468f7f-78tmb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.76:15021/healthz/ready\": dial tcp 10.132.0.76:15021: connect: connection refused" start-of-body=
Jul 18 12:01:43.116509 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:01:43.116423    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-276d7e-openshift-default-844b468f7f-78tmb" podUID="5327e344-9bf0-4742-88dd-aff196c8994c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.76:15021/healthz/ready\": dial tcp 10.132.0.76:15021: connect: connection refused"
Jul 18 12:01:44.117168 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:01:44.117128    2579 patch_prober.go:28] interesting pod/e2e-shared-b-276d7e-openshift-default-844b468f7f-78tmb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.76:15021/healthz/ready\": dial tcp 10.132.0.76:15021: connect: connection refused" start-of-body=
Jul 18 12:01:44.117566 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:01:44.117192    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-276d7e-openshift-default-844b468f7f-78tmb" podUID="5327e344-9bf0-4742-88dd-aff196c8994c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.76:15021/healthz/ready\": dial tcp 10.132.0.76:15021: connect: connection refused"
Jul 18 12:01:45.117131 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:01:45.117088    2579 patch_prober.go:28] interesting pod/e2e-shared-b-276d7e-openshift-default-844b468f7f-78tmb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.76:15021/healthz/ready\": dial tcp 10.132.0.76:15021: connect: connection refused" start-of-body=
Jul 18 12:01:45.117297 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:01:45.117145    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-276d7e-openshift-default-844b468f7f-78tmb" podUID="5327e344-9bf0-4742-88dd-aff196c8994c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.76:15021/healthz/ready\": dial tcp 10.132.0.76:15021: connect: connection refused"
Jul 18 12:01:46.116983 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:01:46.116946    2579 patch_prober.go:28] interesting pod/e2e-shared-b-276d7e-openshift-default-844b468f7f-78tmb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.76:15021/healthz/ready\": dial tcp 10.132.0.76:15021: connect: connection refused" start-of-body=
Jul 18 12:01:46.117204 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:01:46.117009    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-276d7e-openshift-default-844b468f7f-78tmb" podUID="5327e344-9bf0-4742-88dd-aff196c8994c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.76:15021/healthz/ready\": dial tcp 10.132.0.76:15021: connect: connection refused"
Jul 18 12:01:47.120318 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:01:47.120290    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-276d7e-openshift-default-844b468f7f-78tmb"
Jul 18 12:01:47.120723 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:01:47.120606    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-276d7e-openshift-default-844b468f7f-78tmb"
Jul 18 12:01:47.121421 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:01:47.121403    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-276d7e-openshift-default-844b468f7f-78tmb"
Jul 18 12:04:41.105328 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:04:41.105249    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-jfpn7_759a894c-1828-4ac9-a7c3-77354a104247/console-operator/2.log"
Jul 18 12:04:41.109251 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:04:41.109230    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-58jnn_40e8e19c-87b3-4cd6-81c1-0f404971a282/ovn-acl-logging/0.log"
Jul 18 12:04:41.120463 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:04:41.120440    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-jfpn7_759a894c-1828-4ac9-a7c3-77354a104247/console-operator/2.log"
Jul 18 12:04:41.124951 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:04:41.124931    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-58jnn_40e8e19c-87b3-4cd6-81c1-0f404971a282/ovn-acl-logging/0.log"
Jul 18 12:05:15.734502 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:05:15.734468    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-276d7e/sub-test-model-276d7e-kserve-fdc4486f-7h2w4"]
Jul 18 12:05:15.735223 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:05:15.735202    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="53be6190-474e-4dc7-a0bf-e79677dbcf80" containerName="istio-proxy"
Jul 18 12:05:15.738338 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:05:15.738317    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-276d7e/sub-test-model-276d7e-kserve-fdc4486f-7h2w4"
Jul 18 12:05:15.740826 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:05:15.740805    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-276d7e\"/\"openshift-service-ca.crt\""
Jul 18 12:05:15.741688 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:05:15.741665    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-276d7e\"/\"kube-root-ca.crt\""
Jul 18 12:05:15.741834 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:05:15.741781    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-276d7e\"/\"default-dockercfg-z2j7j\""
Jul 18 12:05:15.741834 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:05:15.741781    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-276d7e\"/\"sub-test-model-276d7e-kserve-self-signed-certs\""
Jul 18 12:05:15.745997 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:05:15.745701    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-276d7e/sub-test-model-276d7e-kserve-fdc4486f-7h2w4"]
Jul 18 12:05:15.792674 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:05:15.792638    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a02e2964-2032-4c4f-b36c-63d293df834c-tls-certs\") pod \"sub-test-model-276d7e-kserve-fdc4486f-7h2w4\" (UID: \"a02e2964-2032-4c4f-b36c-63d293df834c\") " pod="ai-tenant-e2e-shared-b-276d7e/sub-test-model-276d7e-kserve-fdc4486f-7h2w4"
Jul 18 12:05:15.792674 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:05:15.792675    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a02e2964-2032-4c4f-b36c-63d293df834c-dshm\") pod \"sub-test-model-276d7e-kserve-fdc4486f-7h2w4\" (UID: \"a02e2964-2032-4c4f-b36c-63d293df834c\") " pod="ai-tenant-e2e-shared-b-276d7e/sub-test-model-276d7e-kserve-fdc4486f-7h2w4"
Jul 18 12:05:15.792878 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:05:15.792711    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a02e2964-2032-4c4f-b36c-63d293df834c-home\") pod \"sub-test-model-276d7e-kserve-fdc4486f-7h2w4\" (UID: \"a02e2964-2032-4c4f-b36c-63d293df834c\") " pod="ai-tenant-e2e-shared-b-276d7e/sub-test-model-276d7e-kserve-fdc4486f-7h2w4"
Jul 18 12:05:15.792878 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:05:15.792761    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a02e2964-2032-4c4f-b36c-63d293df834c-model-cache\") pod \"sub-test-model-276d7e-kserve-fdc4486f-7h2w4\" (UID: \"a02e2964-2032-4c4f-b36c-63d293df834c\") " pod="ai-tenant-e2e-shared-b-276d7e/sub-test-model-276d7e-kserve-fdc4486f-7h2w4"
Jul 18 12:05:15.792878 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:05:15.792807    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a02e2964-2032-4c4f-b36c-63d293df834c-tmp-dir\") pod \"sub-test-model-276d7e-kserve-fdc4486f-7h2w4\" (UID: \"a02e2964-2032-4c4f-b36c-63d293df834c\") " pod="ai-tenant-e2e-shared-b-276d7e/sub-test-model-276d7e-kserve-fdc4486f-7h2w4"
Jul 18 12:05:15.792878 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:05:15.792830    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fhqjw\" (UniqueName: \"kubernetes.io/projected/a02e2964-2032-4c4f-b36c-63d293df834c-kube-api-access-fhqjw\") pod \"sub-test-model-276d7e-kserve-fdc4486f-7h2w4\" (UID: \"a02e2964-2032-4c4f-b36c-63d293df834c\") " pod="ai-tenant-e2e-shared-b-276d7e/sub-test-model-276d7e-kserve-fdc4486f-7h2w4"
Jul 18 12:05:15.894182 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:05:15.894142    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a02e2964-2032-4c4f-b36c-63d293df834c-tmp-dir\") pod \"sub-test-model-276d7e-kserve-fdc4486f-7h2w4\" (UID: \"a02e2964-2032-4c4f-b36c-63d293df834c\") " pod="ai-tenant-e2e-shared-b-276d7e/sub-test-model-276d7e-kserve-fdc4486f-7h2w4"
Jul 18 12:05:15.894182 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:05:15.894188    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fhqjw\" (UniqueName: \"kubernetes.io/projected/a02e2964-2032-4c4f-b36c-63d293df834c-kube-api-access-fhqjw\") pod \"sub-test-model-276d7e-kserve-fdc4486f-7h2w4\" (UID: \"a02e2964-2032-4c4f-b36c-63d293df834c\") " pod="ai-tenant-e2e-shared-b-276d7e/sub-test-model-276d7e-kserve-fdc4486f-7h2w4"
Jul 18 12:05:15.894413 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:05:15.894238    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a02e2964-2032-4c4f-b36c-63d293df834c-tls-certs\") pod \"sub-test-model-276d7e-kserve-fdc4486f-7h2w4\" (UID: \"a02e2964-2032-4c4f-b36c-63d293df834c\") " pod="ai-tenant-e2e-shared-b-276d7e/sub-test-model-276d7e-kserve-fdc4486f-7h2w4"
Jul 18 12:05:15.894413 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:05:15.894258    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a02e2964-2032-4c4f-b36c-63d293df834c-dshm\") pod \"sub-test-model-276d7e-kserve-fdc4486f-7h2w4\" (UID: \"a02e2964-2032-4c4f-b36c-63d293df834c\") " pod="ai-tenant-e2e-shared-b-276d7e/sub-test-model-276d7e-kserve-fdc4486f-7h2w4"
Jul 18 12:05:15.894413 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:05:15.894283    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a02e2964-2032-4c4f-b36c-63d293df834c-home\") pod \"sub-test-model-276d7e-kserve-fdc4486f-7h2w4\" (UID: \"a02e2964-2032-4c4f-b36c-63d293df834c\") " pod="ai-tenant-e2e-shared-b-276d7e/sub-test-model-276d7e-kserve-fdc4486f-7h2w4"
Jul 18 12:05:15.894591 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:05:15.894431    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a02e2964-2032-4c4f-b36c-63d293df834c-model-cache\") pod \"sub-test-model-276d7e-kserve-fdc4486f-7h2w4\" (UID: \"a02e2964-2032-4c4f-b36c-63d293df834c\") " pod="ai-tenant-e2e-shared-b-276d7e/sub-test-model-276d7e-kserve-fdc4486f-7h2w4"
Jul 18 12:05:15.894660 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:05:15.894603    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a02e2964-2032-4c4f-b36c-63d293df834c-tmp-dir\") pod \"sub-test-model-276d7e-kserve-fdc4486f-7h2w4\" (UID: \"a02e2964-2032-4c4f-b36c-63d293df834c\") " pod="ai-tenant-e2e-shared-b-276d7e/sub-test-model-276d7e-kserve-fdc4486f-7h2w4"
Jul 18 12:05:15.894728 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:05:15.894656    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a02e2964-2032-4c4f-b36c-63d293df834c-home\") pod \"sub-test-model-276d7e-kserve-fdc4486f-7h2w4\" (UID: \"a02e2964-2032-4c4f-b36c-63d293df834c\") " pod="ai-tenant-e2e-shared-b-276d7e/sub-test-model-276d7e-kserve-fdc4486f-7h2w4"
Jul 18 12:05:15.894829 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:05:15.894809    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a02e2964-2032-4c4f-b36c-63d293df834c-model-cache\") pod \"sub-test-model-276d7e-kserve-fdc4486f-7h2w4\" (UID: \"a02e2964-2032-4c4f-b36c-63d293df834c\") " pod="ai-tenant-e2e-shared-b-276d7e/sub-test-model-276d7e-kserve-fdc4486f-7h2w4"
Jul 18 12:05:15.896584 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:05:15.896563    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a02e2964-2032-4c4f-b36c-63d293df834c-dshm\") pod \"sub-test-model-276d7e-kserve-fdc4486f-7h2w4\" (UID: \"a02e2964-2032-4c4f-b36c-63d293df834c\") " pod="ai-tenant-e2e-shared-b-276d7e/sub-test-model-276d7e-kserve-fdc4486f-7h2w4"
Jul 18 12:05:15.896819 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:05:15.896803    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a02e2964-2032-4c4f-b36c-63d293df834c-tls-certs\") pod \"sub-test-model-276d7e-kserve-fdc4486f-7h2w4\" (UID: \"a02e2964-2032-4c4f-b36c-63d293df834c\") " pod="ai-tenant-e2e-shared-b-276d7e/sub-test-model-276d7e-kserve-fdc4486f-7h2w4"
Jul 18 12:05:15.902634 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:05:15.902611    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fhqjw\" (UniqueName: \"kubernetes.io/projected/a02e2964-2032-4c4f-b36c-63d293df834c-kube-api-access-fhqjw\") pod \"sub-test-model-276d7e-kserve-fdc4486f-7h2w4\" (UID: \"a02e2964-2032-4c4f-b36c-63d293df834c\") " pod="ai-tenant-e2e-shared-b-276d7e/sub-test-model-276d7e-kserve-fdc4486f-7h2w4"
Jul 18 12:05:16.048950 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:05:16.048811    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-276d7e/sub-test-model-276d7e-kserve-fdc4486f-7h2w4"
Jul 18 12:05:16.197004 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:05:16.196976    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-276d7e/sub-test-model-276d7e-kserve-fdc4486f-7h2w4"]
Jul 18 12:05:16.199138 ip-10-0-133-122 kubenswrapper[2579]: W0718 12:05:16.199092    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda02e2964_2032_4c4f_b36c_63d293df834c.slice/crio-5715a5f90ebcf34327bdbf16672160a066fc9c831823bd20c7fda605f5fe0502 WatchSource:0}: Error finding container 5715a5f90ebcf34327bdbf16672160a066fc9c831823bd20c7fda605f5fe0502: Status 404 returned error can't find the container with id 5715a5f90ebcf34327bdbf16672160a066fc9c831823bd20c7fda605f5fe0502
Jul 18 12:05:16.974390 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:05:16.974346    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-276d7e/sub-test-model-276d7e-kserve-fdc4486f-7h2w4" event={"ID":"a02e2964-2032-4c4f-b36c-63d293df834c","Type":"ContainerStarted","Data":"449a7893afb33b2b50b745e9abe5f5ccfac8cd7833702319949839a1a70259aa"}
Jul 18 12:05:16.974814 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:05:16.974395    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-276d7e/sub-test-model-276d7e-kserve-fdc4486f-7h2w4" event={"ID":"a02e2964-2032-4c4f-b36c-63d293df834c","Type":"ContainerStarted","Data":"5715a5f90ebcf34327bdbf16672160a066fc9c831823bd20c7fda605f5fe0502"}
Jul 18 12:05:16.991002 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:05:16.990949    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-276d7e/sub-test-model-276d7e-kserve-fdc4486f-7h2w4" podStartSLOduration=1.990932353 podStartE2EDuration="1.990932353s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 12:05:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 12:05:16.990019928 +0000 UTC m=+2736.605056231" watchObservedRunningTime="2026-07-18 12:05:16.990932353 +0000 UTC m=+2736.605968655"
Jul 18 12:05:26.049418 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:05:26.049377    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-276d7e/sub-test-model-276d7e-kserve-fdc4486f-7h2w4"
Jul 18 12:05:26.049920 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:05:26.049446    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-276d7e/sub-test-model-276d7e-kserve-fdc4486f-7h2w4"
Jul 18 12:05:26.062361 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:05:26.062337    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-276d7e/sub-test-model-276d7e-kserve-fdc4486f-7h2w4"
Jul 18 12:05:27.046103 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:05:27.046074    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-276d7e/sub-test-model-276d7e-kserve-fdc4486f-7h2w4"
Jul 18 12:05:41.325383 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:05:41.325348    2579 scope.go:117] "RemoveContainer" containerID="1ff396639da2393847a7f48ecbc99cd4f3315f3619e4d423b73dbfe4994ce67a"
Jul 18 12:05:41.334370 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:05:41.334346    2579 scope.go:117] "RemoveContainer" containerID="12084d686b3eea91f988772714e6373b8fdbe4058b06558abb07f697b5ee7689"
Jul 18 12:05:51.807653 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:05:51.807618    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-276d7e/sub-test-model-276d7e-kserve-fdc4486f-7h2w4"]
Jul 18 12:06:06.828921 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:06:06.828810    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-276d7e/sub-test-model-276d7e-kserve-fdc4486f-7h2w4" podUID="a02e2964-2032-4c4f-b36c-63d293df834c" containerName="main" containerID="cri-o://449a7893afb33b2b50b745e9abe5f5ccfac8cd7833702319949839a1a70259aa" gracePeriod=45
Jul 18 12:06:07.094287 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:06:07.094212    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-276d7e/sub-test-model-276d7e-kserve-fdc4486f-7h2w4"
Jul 18 12:06:07.196608 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:06:07.196571    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a02e2964-2032-4c4f-b36c-63d293df834c-tmp-dir\") pod \"a02e2964-2032-4c4f-b36c-63d293df834c\" (UID: \"a02e2964-2032-4c4f-b36c-63d293df834c\") "
Jul 18 12:06:07.196831 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:06:07.196694    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a02e2964-2032-4c4f-b36c-63d293df834c-tls-certs\") pod \"a02e2964-2032-4c4f-b36c-63d293df834c\" (UID: \"a02e2964-2032-4c4f-b36c-63d293df834c\") "
Jul 18 12:06:07.196831 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:06:07.196719    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fhqjw\" (UniqueName: \"kubernetes.io/projected/a02e2964-2032-4c4f-b36c-63d293df834c-kube-api-access-fhqjw\") pod \"a02e2964-2032-4c4f-b36c-63d293df834c\" (UID: \"a02e2964-2032-4c4f-b36c-63d293df834c\") "
Jul 18 12:06:07.196831 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:06:07.196756    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a02e2964-2032-4c4f-b36c-63d293df834c-home\") pod \"a02e2964-2032-4c4f-b36c-63d293df834c\" (UID: \"a02e2964-2032-4c4f-b36c-63d293df834c\") "
Jul 18 12:06:07.196831 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:06:07.196809    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a02e2964-2032-4c4f-b36c-63d293df834c-model-cache\") pod \"a02e2964-2032-4c4f-b36c-63d293df834c\" (UID: \"a02e2964-2032-4c4f-b36c-63d293df834c\") "
Jul 18 12:06:07.197084 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:06:07.196845    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a02e2964-2032-4c4f-b36c-63d293df834c-dshm\") pod \"a02e2964-2032-4c4f-b36c-63d293df834c\" (UID: \"a02e2964-2032-4c4f-b36c-63d293df834c\") "
Jul 18 12:06:07.197084 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:06:07.196867    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a02e2964-2032-4c4f-b36c-63d293df834c-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "a02e2964-2032-4c4f-b36c-63d293df834c" (UID: "a02e2964-2032-4c4f-b36c-63d293df834c"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 12:06:07.197084 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:06:07.197069    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a02e2964-2032-4c4f-b36c-63d293df834c-home" (OuterVolumeSpecName: "home") pod "a02e2964-2032-4c4f-b36c-63d293df834c" (UID: "a02e2964-2032-4c4f-b36c-63d293df834c"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 12:06:07.197213 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:06:07.197084    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a02e2964-2032-4c4f-b36c-63d293df834c-model-cache" (OuterVolumeSpecName: "model-cache") pod "a02e2964-2032-4c4f-b36c-63d293df834c" (UID: "a02e2964-2032-4c4f-b36c-63d293df834c"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 12:06:07.197213 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:06:07.197209    2579 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a02e2964-2032-4c4f-b36c-63d293df834c-home\") on node \"ip-10-0-133-122.ec2.internal\" DevicePath \"\""
Jul 18 12:06:07.197326 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:06:07.197222    2579 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a02e2964-2032-4c4f-b36c-63d293df834c-model-cache\") on node \"ip-10-0-133-122.ec2.internal\" DevicePath \"\""
Jul 18 12:06:07.197326 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:06:07.197233    2579 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a02e2964-2032-4c4f-b36c-63d293df834c-tmp-dir\") on node \"ip-10-0-133-122.ec2.internal\" DevicePath \"\""
Jul 18 12:06:07.199164 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:06:07.199133    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a02e2964-2032-4c4f-b36c-63d293df834c-dshm" (OuterVolumeSpecName: "dshm") pod "a02e2964-2032-4c4f-b36c-63d293df834c" (UID: "a02e2964-2032-4c4f-b36c-63d293df834c"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 12:06:07.199306 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:06:07.199287    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a02e2964-2032-4c4f-b36c-63d293df834c-kube-api-access-fhqjw" (OuterVolumeSpecName: "kube-api-access-fhqjw") pod "a02e2964-2032-4c4f-b36c-63d293df834c" (UID: "a02e2964-2032-4c4f-b36c-63d293df834c"). InnerVolumeSpecName "kube-api-access-fhqjw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 18 12:06:07.199365 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:06:07.199345    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a02e2964-2032-4c4f-b36c-63d293df834c-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "a02e2964-2032-4c4f-b36c-63d293df834c" (UID: "a02e2964-2032-4c4f-b36c-63d293df834c"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 18 12:06:07.254496 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:06:07.254460    2579 generic.go:356] "Generic (PLEG): container finished" podID="a02e2964-2032-4c4f-b36c-63d293df834c" containerID="449a7893afb33b2b50b745e9abe5f5ccfac8cd7833702319949839a1a70259aa" exitCode=0
Jul 18 12:06:07.254672 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:06:07.254502    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-276d7e/sub-test-model-276d7e-kserve-fdc4486f-7h2w4" event={"ID":"a02e2964-2032-4c4f-b36c-63d293df834c","Type":"ContainerDied","Data":"449a7893afb33b2b50b745e9abe5f5ccfac8cd7833702319949839a1a70259aa"}
Jul 18 12:06:07.254672 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:06:07.254504    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-276d7e/sub-test-model-276d7e-kserve-fdc4486f-7h2w4"
Jul 18 12:06:07.254672 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:06:07.254541    2579 scope.go:117] "RemoveContainer" containerID="449a7893afb33b2b50b745e9abe5f5ccfac8cd7833702319949839a1a70259aa"
Jul 18 12:06:07.254672 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:06:07.254531    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-276d7e/sub-test-model-276d7e-kserve-fdc4486f-7h2w4" event={"ID":"a02e2964-2032-4c4f-b36c-63d293df834c","Type":"ContainerDied","Data":"5715a5f90ebcf34327bdbf16672160a066fc9c831823bd20c7fda605f5fe0502"}
Jul 18 12:06:07.264769 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:06:07.264749    2579 scope.go:117] "RemoveContainer" containerID="449a7893afb33b2b50b745e9abe5f5ccfac8cd7833702319949839a1a70259aa"
Jul 18 12:06:07.265135 ip-10-0-133-122 kubenswrapper[2579]: E0718 12:06:07.265112    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"449a7893afb33b2b50b745e9abe5f5ccfac8cd7833702319949839a1a70259aa\": container with ID starting with 449a7893afb33b2b50b745e9abe5f5ccfac8cd7833702319949839a1a70259aa not found: ID does not exist" containerID="449a7893afb33b2b50b745e9abe5f5ccfac8cd7833702319949839a1a70259aa"
Jul 18 12:06:07.265204 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:06:07.265148    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"449a7893afb33b2b50b745e9abe5f5ccfac8cd7833702319949839a1a70259aa"} err="failed to get container status \"449a7893afb33b2b50b745e9abe5f5ccfac8cd7833702319949839a1a70259aa\": rpc error: code = NotFound desc = could not find container \"449a7893afb33b2b50b745e9abe5f5ccfac8cd7833702319949839a1a70259aa\": container with ID starting with 449a7893afb33b2b50b745e9abe5f5ccfac8cd7833702319949839a1a70259aa not found: ID does not exist"
Jul 18 12:06:07.276256 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:06:07.276225    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-276d7e/sub-test-model-276d7e-kserve-fdc4486f-7h2w4"]
Jul 18 12:06:07.282434 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:06:07.282396    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-276d7e/sub-test-model-276d7e-kserve-fdc4486f-7h2w4"]
Jul 18 12:06:07.298666 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:06:07.298637    2579 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a02e2964-2032-4c4f-b36c-63d293df834c-dshm\") on node \"ip-10-0-133-122.ec2.internal\" DevicePath \"\""
Jul 18 12:06:07.298666 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:06:07.298665    2579 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a02e2964-2032-4c4f-b36c-63d293df834c-tls-certs\") on node \"ip-10-0-133-122.ec2.internal\" DevicePath \"\""
Jul 18 12:06:07.298863 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:06:07.298675    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fhqjw\" (UniqueName: \"kubernetes.io/projected/a02e2964-2032-4c4f-b36c-63d293df834c-kube-api-access-fhqjw\") on node \"ip-10-0-133-122.ec2.internal\" DevicePath \"\""
Jul 18 12:06:08.894913 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:06:08.894862    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a02e2964-2032-4c4f-b36c-63d293df834c" path="/var/lib/kubelet/pods/a02e2964-2032-4c4f-b36c-63d293df834c/volumes"
Jul 18 12:06:12.036079 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:06:12.036031    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="ai-tenant-e2e-shared-b-276d7e/sub-test-model-276d7e-kserve-fdc4486f-7h2w4" podUID="a02e2964-2032-4c4f-b36c-63d293df834c" containerName="main" probeResult="failure" output="Get \"https://10.132.0.77:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Jul 18 12:07:20.121477 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:07:20.121441    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7870-140525223250480"]
Jul 18 12:07:20.123945 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:07:20.121876    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a02e2964-2032-4c4f-b36c-63d293df834c" containerName="main"
Jul 18 12:07:20.123945 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:07:20.121901    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="a02e2964-2032-4c4f-b36c-63d293df834c" containerName="main"
Jul 18 12:07:20.123945 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:07:20.121993    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="a02e2964-2032-4c4f-b36c-63d293df834c" containerName="main"
Jul 18 12:07:20.125010 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:07:20.124994    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7870-140525223250480"
Jul 18 12:07:20.127239 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:07:20.127214    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-7l9gx\""
Jul 18 12:07:20.129206 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:07:20.129181    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7870-140525223250480"]
Jul 18 12:07:20.192463 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:07:20.192435    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sm872\" (UniqueName: \"kubernetes.io/projected/bcecce9a-ce28-4108-91db-8b6fb2db7ff1-kube-api-access-sm872\") pod \"test-curl-7870-140525223250480\" (UID: \"bcecce9a-ce28-4108-91db-8b6fb2db7ff1\") " pod="opendatahub/test-curl-7870-140525223250480"
Jul 18 12:07:20.293850 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:07:20.293812    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sm872\" (UniqueName: \"kubernetes.io/projected/bcecce9a-ce28-4108-91db-8b6fb2db7ff1-kube-api-access-sm872\") pod \"test-curl-7870-140525223250480\" (UID: \"bcecce9a-ce28-4108-91db-8b6fb2db7ff1\") " pod="opendatahub/test-curl-7870-140525223250480"
Jul 18 12:07:20.302809 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:07:20.302786    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sm872\" (UniqueName: \"kubernetes.io/projected/bcecce9a-ce28-4108-91db-8b6fb2db7ff1-kube-api-access-sm872\") pod \"test-curl-7870-140525223250480\" (UID: \"bcecce9a-ce28-4108-91db-8b6fb2db7ff1\") " pod="opendatahub/test-curl-7870-140525223250480"
Jul 18 12:07:20.435860 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:07:20.435772    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7870-140525223250480"
Jul 18 12:07:20.571336 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:07:20.571310    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7870-140525223250480"]
Jul 18 12:07:20.576549 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:07:20.576526    2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 18 12:07:20.639065 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:07:20.639026    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7870-140525223250480" event={"ID":"bcecce9a-ce28-4108-91db-8b6fb2db7ff1","Type":"ContainerStarted","Data":"2e111a3bf45bc0743e6aeb4bcbbed8d6b61f56d813b16b7cc42cdca39773559b"}
Jul 18 12:07:21.646563 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:07:21.646527    2579 generic.go:356] "Generic (PLEG): container finished" podID="bcecce9a-ce28-4108-91db-8b6fb2db7ff1" containerID="49079ccbc8bfbb2ee8ceba13afb52eaab2434b22fe2c0fcd325c1e0fa2a5c3a8" exitCode=0
Jul 18 12:07:21.646971 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:07:21.646610    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7870-140525223250480" event={"ID":"bcecce9a-ce28-4108-91db-8b6fb2db7ff1","Type":"ContainerDied","Data":"49079ccbc8bfbb2ee8ceba13afb52eaab2434b22fe2c0fcd325c1e0fa2a5c3a8"}
Jul 18 12:07:22.793854 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:07:22.793829    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7870-140525223250480"
Jul 18 12:07:22.830650 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:07:22.830615    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7870-140525223250480_bcecce9a-ce28-4108-91db-8b6fb2db7ff1/test-curl-7870-140525223250480/0.log"
Jul 18 12:07:22.856224 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:07:22.856197    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7870-140525223250480"]
Jul 18 12:07:22.860024 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:07:22.859999    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7870-140525223250480"]
Jul 18 12:07:22.920458 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:07:22.920379    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sm872\" (UniqueName: \"kubernetes.io/projected/bcecce9a-ce28-4108-91db-8b6fb2db7ff1-kube-api-access-sm872\") pod \"bcecce9a-ce28-4108-91db-8b6fb2db7ff1\" (UID: \"bcecce9a-ce28-4108-91db-8b6fb2db7ff1\") "
Jul 18 12:07:22.922497 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:07:22.922471    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bcecce9a-ce28-4108-91db-8b6fb2db7ff1-kube-api-access-sm872" (OuterVolumeSpecName: "kube-api-access-sm872") pod "bcecce9a-ce28-4108-91db-8b6fb2db7ff1" (UID: "bcecce9a-ce28-4108-91db-8b6fb2db7ff1"). InnerVolumeSpecName "kube-api-access-sm872". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 18 12:07:22.989552 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:07:22.989517    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7870-140525223220144"]
Jul 18 12:07:22.990003 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:07:22.989987    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bcecce9a-ce28-4108-91db-8b6fb2db7ff1" containerName="test-curl-7870-140525223250480"
Jul 18 12:07:22.990058 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:07:22.990005    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="bcecce9a-ce28-4108-91db-8b6fb2db7ff1" containerName="test-curl-7870-140525223250480"
Jul 18 12:07:22.990095 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:07:22.990069    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="bcecce9a-ce28-4108-91db-8b6fb2db7ff1" containerName="test-curl-7870-140525223250480"
Jul 18 12:07:22.993178 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:07:22.993161    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7870-140525223220144"
Jul 18 12:07:22.997232 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:07:22.997206    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7870-140525223220144"]
Jul 18 12:07:23.021989 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:07:23.021957    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sm872\" (UniqueName: \"kubernetes.io/projected/bcecce9a-ce28-4108-91db-8b6fb2db7ff1-kube-api-access-sm872\") on node \"ip-10-0-133-122.ec2.internal\" DevicePath \"\""
Jul 18 12:07:23.123128 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:07:23.123089    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c7tt5\" (UniqueName: \"kubernetes.io/projected/e28747c3-89c0-41d8-9300-d741a87c3d94-kube-api-access-c7tt5\") pod \"test-curl-7870-140525223220144\" (UID: \"e28747c3-89c0-41d8-9300-d741a87c3d94\") " pod="opendatahub/test-curl-7870-140525223220144"
Jul 18 12:07:23.223858 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:07:23.223759    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c7tt5\" (UniqueName: \"kubernetes.io/projected/e28747c3-89c0-41d8-9300-d741a87c3d94-kube-api-access-c7tt5\") pod \"test-curl-7870-140525223220144\" (UID: \"e28747c3-89c0-41d8-9300-d741a87c3d94\") " pod="opendatahub/test-curl-7870-140525223220144"
Jul 18 12:07:23.232836 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:07:23.232799    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c7tt5\" (UniqueName: \"kubernetes.io/projected/e28747c3-89c0-41d8-9300-d741a87c3d94-kube-api-access-c7tt5\") pod \"test-curl-7870-140525223220144\" (UID: \"e28747c3-89c0-41d8-9300-d741a87c3d94\") " pod="opendatahub/test-curl-7870-140525223220144"
Jul 18 12:07:23.303668 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:07:23.303636    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7870-140525223220144"
Jul 18 12:07:23.438644 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:07:23.438622    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7870-140525223220144"]
Jul 18 12:07:23.440366 ip-10-0-133-122 kubenswrapper[2579]: W0718 12:07:23.440344    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode28747c3_89c0_41d8_9300_d741a87c3d94.slice/crio-bdb9fb0651e2a9221f5eda733804add9b36d35f1118693c6a4ffeb0bb5a12ec3 WatchSource:0}: Error finding container bdb9fb0651e2a9221f5eda733804add9b36d35f1118693c6a4ffeb0bb5a12ec3: Status 404 returned error can't find the container with id bdb9fb0651e2a9221f5eda733804add9b36d35f1118693c6a4ffeb0bb5a12ec3
Jul 18 12:07:23.659586 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:07:23.659559    2579 scope.go:117] "RemoveContainer" containerID="49079ccbc8bfbb2ee8ceba13afb52eaab2434b22fe2c0fcd325c1e0fa2a5c3a8"
Jul 18 12:07:23.659790 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:07:23.659588    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7870-140525223250480"
Jul 18 12:07:23.661176 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:07:23.661152    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7870-140525223220144" event={"ID":"e28747c3-89c0-41d8-9300-d741a87c3d94","Type":"ContainerStarted","Data":"bdb9fb0651e2a9221f5eda733804add9b36d35f1118693c6a4ffeb0bb5a12ec3"}
Jul 18 12:07:24.668585 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:07:24.668548    2579 generic.go:356] "Generic (PLEG): container finished" podID="e28747c3-89c0-41d8-9300-d741a87c3d94" containerID="fc29057823da15430c39e42fa0e78f67e42159faf310f16b3c2fe045d4ba4097" exitCode=0
Jul 18 12:07:24.669056 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:07:24.668591    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7870-140525223220144" event={"ID":"e28747c3-89c0-41d8-9300-d741a87c3d94","Type":"ContainerDied","Data":"fc29057823da15430c39e42fa0e78f67e42159faf310f16b3c2fe045d4ba4097"}
Jul 18 12:07:24.894663 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:07:24.894629    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bcecce9a-ce28-4108-91db-8b6fb2db7ff1" path="/var/lib/kubelet/pods/bcecce9a-ce28-4108-91db-8b6fb2db7ff1/volumes"
Jul 18 12:07:25.814569 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:07:25.814547    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7870-140525223220144"
Jul 18 12:07:25.834929 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:07:25.834902    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7870-140525223220144_e28747c3-89c0-41d8-9300-d741a87c3d94/test-curl-7870-140525223220144/0.log"
Jul 18 12:07:25.857391 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:07:25.857360    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7870-140525223220144"]
Jul 18 12:07:25.861300 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:07:25.861276    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7870-140525223220144"]
Jul 18 12:07:25.950380 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:07:25.950351    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c7tt5\" (UniqueName: \"kubernetes.io/projected/e28747c3-89c0-41d8-9300-d741a87c3d94-kube-api-access-c7tt5\") pod \"e28747c3-89c0-41d8-9300-d741a87c3d94\" (UID: \"e28747c3-89c0-41d8-9300-d741a87c3d94\") "
Jul 18 12:07:25.952402 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:07:25.952371    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e28747c3-89c0-41d8-9300-d741a87c3d94-kube-api-access-c7tt5" (OuterVolumeSpecName: "kube-api-access-c7tt5") pod "e28747c3-89c0-41d8-9300-d741a87c3d94" (UID: "e28747c3-89c0-41d8-9300-d741a87c3d94"). InnerVolumeSpecName "kube-api-access-c7tt5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 18 12:07:26.036347 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:07:26.036311    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7870-140525223080848"]
Jul 18 12:07:26.036747 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:07:26.036732    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e28747c3-89c0-41d8-9300-d741a87c3d94" containerName="test-curl-7870-140525223220144"
Jul 18 12:07:26.036800 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:07:26.036749    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="e28747c3-89c0-41d8-9300-d741a87c3d94" containerName="test-curl-7870-140525223220144"
Jul 18 12:07:26.036836 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:07:26.036812    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="e28747c3-89c0-41d8-9300-d741a87c3d94" containerName="test-curl-7870-140525223220144"
Jul 18 12:07:26.039968 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:07:26.039952    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7870-140525223080848"
Jul 18 12:07:26.044647 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:07:26.044623    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7870-140525223080848"]
Jul 18 12:07:26.051778 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:07:26.051755    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c7tt5\" (UniqueName: \"kubernetes.io/projected/e28747c3-89c0-41d8-9300-d741a87c3d94-kube-api-access-c7tt5\") on node \"ip-10-0-133-122.ec2.internal\" DevicePath \"\""
Jul 18 12:07:26.153107 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:07:26.153001    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d25z2\" (UniqueName: \"kubernetes.io/projected/ae54114b-8f4a-4c76-bb22-3703de5f9614-kube-api-access-d25z2\") pod \"test-curl-7870-140525223080848\" (UID: \"ae54114b-8f4a-4c76-bb22-3703de5f9614\") " pod="opendatahub/test-curl-7870-140525223080848"
Jul 18 12:07:26.254026 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:07:26.253976    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d25z2\" (UniqueName: \"kubernetes.io/projected/ae54114b-8f4a-4c76-bb22-3703de5f9614-kube-api-access-d25z2\") pod \"test-curl-7870-140525223080848\" (UID: \"ae54114b-8f4a-4c76-bb22-3703de5f9614\") " pod="opendatahub/test-curl-7870-140525223080848"
Jul 18 12:07:26.262026 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:07:26.261998    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d25z2\" (UniqueName: \"kubernetes.io/projected/ae54114b-8f4a-4c76-bb22-3703de5f9614-kube-api-access-d25z2\") pod \"test-curl-7870-140525223080848\" (UID: \"ae54114b-8f4a-4c76-bb22-3703de5f9614\") " pod="opendatahub/test-curl-7870-140525223080848"
Jul 18 12:07:26.350581 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:07:26.350544    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7870-140525223080848"
Jul 18 12:07:26.487408 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:07:26.487383    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7870-140525223080848"]
Jul 18 12:07:26.489200 ip-10-0-133-122 kubenswrapper[2579]: W0718 12:07:26.489172    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podae54114b_8f4a_4c76_bb22_3703de5f9614.slice/crio-f10066fc136723f7f35f38f1a45de3dd9a0e8a008333a10929652ec7fa2c3641 WatchSource:0}: Error finding container f10066fc136723f7f35f38f1a45de3dd9a0e8a008333a10929652ec7fa2c3641: Status 404 returned error can't find the container with id f10066fc136723f7f35f38f1a45de3dd9a0e8a008333a10929652ec7fa2c3641
Jul 18 12:07:26.679749 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:07:26.679715    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7870-140525223220144"
Jul 18 12:07:26.679749 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:07:26.679729    2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="bdb9fb0651e2a9221f5eda733804add9b36d35f1118693c6a4ffeb0bb5a12ec3"
Jul 18 12:07:26.680995 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:07:26.680970    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7870-140525223080848" event={"ID":"ae54114b-8f4a-4c76-bb22-3703de5f9614","Type":"ContainerStarted","Data":"f10066fc136723f7f35f38f1a45de3dd9a0e8a008333a10929652ec7fa2c3641"}
Jul 18 12:07:26.690407 ip-10-0-133-122 kubenswrapper[2579]: E0718 12:07:26.690380    2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7870-140525223220144\" is forbidden: User \"system:node:ip-10-0-133-122.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-133-122.ec2.internal' and this object" podUID="e28747c3-89c0-41d8-9300-d741a87c3d94" pod="opendatahub/test-curl-7870-140525223220144"
Jul 18 12:07:26.895310 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:07:26.895284    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e28747c3-89c0-41d8-9300-d741a87c3d94" path="/var/lib/kubelet/pods/e28747c3-89c0-41d8-9300-d741a87c3d94/volumes"
Jul 18 12:07:27.687230 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:07:27.687194    2579 generic.go:356] "Generic (PLEG): container finished" podID="ae54114b-8f4a-4c76-bb22-3703de5f9614" containerID="57310e673ea5bdb53c660f412a9c04fc9b3fd554536c891dd891672f2dc1e510" exitCode=0
Jul 18 12:07:27.687392 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:07:27.687285    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7870-140525223080848" event={"ID":"ae54114b-8f4a-4c76-bb22-3703de5f9614","Type":"ContainerDied","Data":"57310e673ea5bdb53c660f412a9c04fc9b3fd554536c891dd891672f2dc1e510"}
Jul 18 12:07:28.834421 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:07:28.834395    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7870-140525223080848"
Jul 18 12:07:28.854503 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:07:28.854477    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7870-140525223080848_ae54114b-8f4a-4c76-bb22-3703de5f9614/test-curl-7870-140525223080848/0.log"
Jul 18 12:07:28.881262 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:07:28.881218    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7870-140525223080848"]
Jul 18 12:07:28.884063 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:07:28.884036    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7870-140525223080848"]
Jul 18 12:07:28.980922 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:07:28.980814    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d25z2\" (UniqueName: \"kubernetes.io/projected/ae54114b-8f4a-4c76-bb22-3703de5f9614-kube-api-access-d25z2\") pod \"ae54114b-8f4a-4c76-bb22-3703de5f9614\" (UID: \"ae54114b-8f4a-4c76-bb22-3703de5f9614\") "
Jul 18 12:07:28.982874 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:07:28.982841    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ae54114b-8f4a-4c76-bb22-3703de5f9614-kube-api-access-d25z2" (OuterVolumeSpecName: "kube-api-access-d25z2") pod "ae54114b-8f4a-4c76-bb22-3703de5f9614" (UID: "ae54114b-8f4a-4c76-bb22-3703de5f9614"). InnerVolumeSpecName "kube-api-access-d25z2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 18 12:07:29.026056 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:07:29.026028    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7870-140525223080848"]
Jul 18 12:07:29.026424 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:07:29.026411    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ae54114b-8f4a-4c76-bb22-3703de5f9614" containerName="test-curl-7870-140525223080848"
Jul 18 12:07:29.026486 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:07:29.026425    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="ae54114b-8f4a-4c76-bb22-3703de5f9614" containerName="test-curl-7870-140525223080848"
Jul 18 12:07:29.026529 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:07:29.026505    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="ae54114b-8f4a-4c76-bb22-3703de5f9614" containerName="test-curl-7870-140525223080848"
Jul 18 12:07:29.029568 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:07:29.029551    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7870-140525223080848"
Jul 18 12:07:29.036294 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:07:29.036264    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7870-140525223080848"]
Jul 18 12:07:29.082044 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:07:29.082017    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d25z2\" (UniqueName: \"kubernetes.io/projected/ae54114b-8f4a-4c76-bb22-3703de5f9614-kube-api-access-d25z2\") on node \"ip-10-0-133-122.ec2.internal\" DevicePath \"\""
Jul 18 12:07:29.183181 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:07:29.183128    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jtqmf\" (UniqueName: \"kubernetes.io/projected/d8636b5d-5d8c-4348-96af-da8e3dee1829-kube-api-access-jtqmf\") pod \"test-curl-7870-140525223080848\" (UID: \"d8636b5d-5d8c-4348-96af-da8e3dee1829\") " pod="opendatahub/test-curl-7870-140525223080848"
Jul 18 12:07:29.284635 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:07:29.284541    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jtqmf\" (UniqueName: \"kubernetes.io/projected/d8636b5d-5d8c-4348-96af-da8e3dee1829-kube-api-access-jtqmf\") pod \"test-curl-7870-140525223080848\" (UID: \"d8636b5d-5d8c-4348-96af-da8e3dee1829\") " pod="opendatahub/test-curl-7870-140525223080848"
Jul 18 12:07:29.292750 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:07:29.292724    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jtqmf\" (UniqueName: \"kubernetes.io/projected/d8636b5d-5d8c-4348-96af-da8e3dee1829-kube-api-access-jtqmf\") pod \"test-curl-7870-140525223080848\" (UID: \"d8636b5d-5d8c-4348-96af-da8e3dee1829\") " pod="opendatahub/test-curl-7870-140525223080848"
Jul 18 12:07:29.339913 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:07:29.339856    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7870-140525223080848"
Jul 18 12:07:29.472172 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:07:29.472143    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7870-140525223080848"]
Jul 18 12:07:29.474138 ip-10-0-133-122 kubenswrapper[2579]: W0718 12:07:29.474107    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd8636b5d_5d8c_4348_96af_da8e3dee1829.slice/crio-16b66a3552379cf592588a56b18ce6c8837891ab83955e4dfbbdea99ed01e8c8 WatchSource:0}: Error finding container 16b66a3552379cf592588a56b18ce6c8837891ab83955e4dfbbdea99ed01e8c8: Status 404 returned error can't find the container with id 16b66a3552379cf592588a56b18ce6c8837891ab83955e4dfbbdea99ed01e8c8
Jul 18 12:07:29.698976 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:07:29.698939    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7870-140525223080848" event={"ID":"d8636b5d-5d8c-4348-96af-da8e3dee1829","Type":"ContainerStarted","Data":"16b66a3552379cf592588a56b18ce6c8837891ab83955e4dfbbdea99ed01e8c8"}
Jul 18 12:07:29.700146 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:07:29.700129    2579 scope.go:117] "RemoveContainer" containerID="57310e673ea5bdb53c660f412a9c04fc9b3fd554536c891dd891672f2dc1e510"
Jul 18 12:07:29.700146 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:07:29.700137    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7870-140525223080848"
Jul 18 12:07:30.707623 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:07:30.707587    2579 generic.go:356] "Generic (PLEG): container finished" podID="d8636b5d-5d8c-4348-96af-da8e3dee1829" containerID="68caec4766203ec2254df675bcb809ba43ad41d74350bc5083ed9e3ca27266f3" exitCode=0
Jul 18 12:07:30.708079 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:07:30.707676    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7870-140525223080848" event={"ID":"d8636b5d-5d8c-4348-96af-da8e3dee1829","Type":"ContainerDied","Data":"68caec4766203ec2254df675bcb809ba43ad41d74350bc5083ed9e3ca27266f3"}
Jul 18 12:07:30.894476 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:07:30.894441    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ae54114b-8f4a-4c76-bb22-3703de5f9614" path="/var/lib/kubelet/pods/ae54114b-8f4a-4c76-bb22-3703de5f9614/volumes"
Jul 18 12:07:31.846151 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:07:31.846126    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7870-140525223080848"
Jul 18 12:07:31.864687 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:07:31.864661    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7870-140525223080848_d8636b5d-5d8c-4348-96af-da8e3dee1829/test-curl-7870-140525223080848/0.log"
Jul 18 12:07:31.896065 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:07:31.896034    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7870-140525223080848"]
Jul 18 12:07:31.900193 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:07:31.900171    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7870-140525223080848"]
Jul 18 12:07:31.907721 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:07:31.907703    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jtqmf\" (UniqueName: \"kubernetes.io/projected/d8636b5d-5d8c-4348-96af-da8e3dee1829-kube-api-access-jtqmf\") pod \"d8636b5d-5d8c-4348-96af-da8e3dee1829\" (UID: \"d8636b5d-5d8c-4348-96af-da8e3dee1829\") "
Jul 18 12:07:31.909760 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:07:31.909738    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d8636b5d-5d8c-4348-96af-da8e3dee1829-kube-api-access-jtqmf" (OuterVolumeSpecName: "kube-api-access-jtqmf") pod "d8636b5d-5d8c-4348-96af-da8e3dee1829" (UID: "d8636b5d-5d8c-4348-96af-da8e3dee1829"). InnerVolumeSpecName "kube-api-access-jtqmf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 18 12:07:32.009440 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:07:32.009356    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jtqmf\" (UniqueName: \"kubernetes.io/projected/d8636b5d-5d8c-4348-96af-da8e3dee1829-kube-api-access-jtqmf\") on node \"ip-10-0-133-122.ec2.internal\" DevicePath \"\""
Jul 18 12:07:32.026139 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:07:32.026108    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7870-140525223081856"]
Jul 18 12:07:32.026557 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:07:32.026543    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d8636b5d-5d8c-4348-96af-da8e3dee1829" containerName="test-curl-7870-140525223080848"
Jul 18 12:07:32.026607 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:07:32.026559    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="d8636b5d-5d8c-4348-96af-da8e3dee1829" containerName="test-curl-7870-140525223080848"
Jul 18 12:07:32.026649 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:07:32.026639    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="d8636b5d-5d8c-4348-96af-da8e3dee1829" containerName="test-curl-7870-140525223080848"
Jul 18 12:07:32.029607 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:07:32.029588    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7870-140525223081856"
Jul 18 12:07:32.033598 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:07:32.033571    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7870-140525223081856"]
Jul 18 12:07:32.110206 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:07:32.110164    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wlbfr\" (UniqueName: \"kubernetes.io/projected/e6670a1e-2904-4e00-af9a-f455cdbd8180-kube-api-access-wlbfr\") pod \"test-curl-7870-140525223081856\" (UID: \"e6670a1e-2904-4e00-af9a-f455cdbd8180\") " pod="opendatahub/test-curl-7870-140525223081856"
Jul 18 12:07:32.211094 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:07:32.211057    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wlbfr\" (UniqueName: \"kubernetes.io/projected/e6670a1e-2904-4e00-af9a-f455cdbd8180-kube-api-access-wlbfr\") pod \"test-curl-7870-140525223081856\" (UID: \"e6670a1e-2904-4e00-af9a-f455cdbd8180\") " pod="opendatahub/test-curl-7870-140525223081856"
Jul 18 12:07:32.219328 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:07:32.219301    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wlbfr\" (UniqueName: \"kubernetes.io/projected/e6670a1e-2904-4e00-af9a-f455cdbd8180-kube-api-access-wlbfr\") pod \"test-curl-7870-140525223081856\" (UID: \"e6670a1e-2904-4e00-af9a-f455cdbd8180\") " pod="opendatahub/test-curl-7870-140525223081856"
Jul 18 12:07:32.340462 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:07:32.340374    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7870-140525223081856"
Jul 18 12:07:32.475676 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:07:32.475651    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7870-140525223081856"]
Jul 18 12:07:32.477801 ip-10-0-133-122 kubenswrapper[2579]: W0718 12:07:32.477771    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode6670a1e_2904_4e00_af9a_f455cdbd8180.slice/crio-764374a04ecaa1827cc3d34fb7d39ea621890e870da6bbc89ac3ca6712d20c6b WatchSource:0}: Error finding container 764374a04ecaa1827cc3d34fb7d39ea621890e870da6bbc89ac3ca6712d20c6b: Status 404 returned error can't find the container with id 764374a04ecaa1827cc3d34fb7d39ea621890e870da6bbc89ac3ca6712d20c6b
Jul 18 12:07:32.719914 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:07:32.719860    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7870-140525223080848"
Jul 18 12:07:32.719914 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:07:32.719881    2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="16b66a3552379cf592588a56b18ce6c8837891ab83955e4dfbbdea99ed01e8c8"
Jul 18 12:07:32.721218 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:07:32.721194    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7870-140525223081856" event={"ID":"e6670a1e-2904-4e00-af9a-f455cdbd8180","Type":"ContainerStarted","Data":"764374a04ecaa1827cc3d34fb7d39ea621890e870da6bbc89ac3ca6712d20c6b"}
Jul 18 12:07:32.731070 ip-10-0-133-122 kubenswrapper[2579]: E0718 12:07:32.731042    2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7870-140525223080848\" is forbidden: User \"system:node:ip-10-0-133-122.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-133-122.ec2.internal' and this object" podUID="d8636b5d-5d8c-4348-96af-da8e3dee1829" pod="opendatahub/test-curl-7870-140525223080848"
Jul 18 12:07:32.895076 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:07:32.895042    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d8636b5d-5d8c-4348-96af-da8e3dee1829" path="/var/lib/kubelet/pods/d8636b5d-5d8c-4348-96af-da8e3dee1829/volumes"
Jul 18 12:07:33.729474 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:07:33.729381    2579 generic.go:356] "Generic (PLEG): container finished" podID="e6670a1e-2904-4e00-af9a-f455cdbd8180" containerID="7fea610cf426b318f1205dcc47d8bde6fba114ddfa9af037ae7e34c3a153c266" exitCode=0
Jul 18 12:07:33.729638 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:07:33.729474    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7870-140525223081856" event={"ID":"e6670a1e-2904-4e00-af9a-f455cdbd8180","Type":"ContainerDied","Data":"7fea610cf426b318f1205dcc47d8bde6fba114ddfa9af037ae7e34c3a153c266"}
Jul 18 12:07:34.878612 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:07:34.878587    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7870-140525223081856"
Jul 18 12:07:34.900959 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:07:34.900929    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7870-140525223081856_e6670a1e-2904-4e00-af9a-f455cdbd8180/test-curl-7870-140525223081856/0.log"
Jul 18 12:07:34.926019 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:07:34.925985    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7870-140525223081856"]
Jul 18 12:07:34.929255 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:07:34.929227    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7870-140525223081856"]
Jul 18 12:07:35.036621 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:07:35.036529    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wlbfr\" (UniqueName: \"kubernetes.io/projected/e6670a1e-2904-4e00-af9a-f455cdbd8180-kube-api-access-wlbfr\") pod \"e6670a1e-2904-4e00-af9a-f455cdbd8180\" (UID: \"e6670a1e-2904-4e00-af9a-f455cdbd8180\") "
Jul 18 12:07:35.038636 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:07:35.038602    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e6670a1e-2904-4e00-af9a-f455cdbd8180-kube-api-access-wlbfr" (OuterVolumeSpecName: "kube-api-access-wlbfr") pod "e6670a1e-2904-4e00-af9a-f455cdbd8180" (UID: "e6670a1e-2904-4e00-af9a-f455cdbd8180"). InnerVolumeSpecName "kube-api-access-wlbfr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 18 12:07:35.138274 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:07:35.138241    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wlbfr\" (UniqueName: \"kubernetes.io/projected/e6670a1e-2904-4e00-af9a-f455cdbd8180-kube-api-access-wlbfr\") on node \"ip-10-0-133-122.ec2.internal\" DevicePath \"\""
Jul 18 12:07:35.742254 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:07:35.742226    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7870-140525223081856"
Jul 18 12:07:35.742412 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:07:35.742261    2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="764374a04ecaa1827cc3d34fb7d39ea621890e870da6bbc89ac3ca6712d20c6b"
Jul 18 12:07:35.752163 ip-10-0-133-122 kubenswrapper[2579]: E0718 12:07:35.752134    2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7870-140525223081856\" is forbidden: User \"system:node:ip-10-0-133-122.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-133-122.ec2.internal' and this object" podUID="e6670a1e-2904-4e00-af9a-f455cdbd8180" pod="opendatahub/test-curl-7870-140525223081856"
Jul 18 12:07:36.894002 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:07:36.893971    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e6670a1e-2904-4e00-af9a-f455cdbd8180" path="/var/lib/kubelet/pods/e6670a1e-2904-4e00-af9a-f455cdbd8180/volumes"
Jul 18 12:07:59.622237 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:07:59.622198    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-399bd8-openshift-default-56b4b5f97f-d72mp"]
Jul 18 12:07:59.622872 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:07:59.622440    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-399bd8-openshift-default-56b4b5f97f-d72mp" podUID="df118917-490f-4cec-b699-aae5edcae68c" containerName="istio-proxy" containerID="cri-o://13a02e3cbfe2ec5523c69d3c2cb3f2efa1d41c052dc907a71ca6463d481a4830" gracePeriod=30
Jul 18 12:08:04.891839 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:08:04.891774    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-399bd8-openshift-default-56b4b5f97f-d72mp"
Jul 18 12:08:04.898531 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:08:04.898501    2579 generic.go:356] "Generic (PLEG): container finished" podID="df118917-490f-4cec-b699-aae5edcae68c" containerID="13a02e3cbfe2ec5523c69d3c2cb3f2efa1d41c052dc907a71ca6463d481a4830" exitCode=0
Jul 18 12:08:04.898674 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:08:04.898547    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-399bd8-openshift-default-56b4b5f97f-d72mp"
Jul 18 12:08:04.898674 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:08:04.898545    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-399bd8-openshift-default-56b4b5f97f-d72mp" event={"ID":"df118917-490f-4cec-b699-aae5edcae68c","Type":"ContainerDied","Data":"13a02e3cbfe2ec5523c69d3c2cb3f2efa1d41c052dc907a71ca6463d481a4830"}
Jul 18 12:08:04.898760 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:08:04.898676    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-399bd8-openshift-default-56b4b5f97f-d72mp" event={"ID":"df118917-490f-4cec-b699-aae5edcae68c","Type":"ContainerDied","Data":"bf3028d961f9fd1b57fbcdffbb2a743eb381f1bb230df9d98fde8f71e566b83c"}
Jul 18 12:08:04.898760 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:08:04.898707    2579 scope.go:117] "RemoveContainer" containerID="13a02e3cbfe2ec5523c69d3c2cb3f2efa1d41c052dc907a71ca6463d481a4830"
Jul 18 12:08:04.907622 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:08:04.907599    2579 scope.go:117] "RemoveContainer" containerID="76d5888cc55addfb80532e34e0fa6c56480ceee807efc3a25b26aa983a125a12"
Jul 18 12:08:04.918794 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:08:04.918772    2579 scope.go:117] "RemoveContainer" containerID="13a02e3cbfe2ec5523c69d3c2cb3f2efa1d41c052dc907a71ca6463d481a4830"
Jul 18 12:08:04.919155 ip-10-0-133-122 kubenswrapper[2579]: E0718 12:08:04.919129    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"13a02e3cbfe2ec5523c69d3c2cb3f2efa1d41c052dc907a71ca6463d481a4830\": container with ID starting with 13a02e3cbfe2ec5523c69d3c2cb3f2efa1d41c052dc907a71ca6463d481a4830 not found: ID does not exist" containerID="13a02e3cbfe2ec5523c69d3c2cb3f2efa1d41c052dc907a71ca6463d481a4830"
Jul 18 12:08:04.919305 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:08:04.919161    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"13a02e3cbfe2ec5523c69d3c2cb3f2efa1d41c052dc907a71ca6463d481a4830"} err="failed to get container status \"13a02e3cbfe2ec5523c69d3c2cb3f2efa1d41c052dc907a71ca6463d481a4830\": rpc error: code = NotFound desc = could not find container \"13a02e3cbfe2ec5523c69d3c2cb3f2efa1d41c052dc907a71ca6463d481a4830\": container with ID starting with 13a02e3cbfe2ec5523c69d3c2cb3f2efa1d41c052dc907a71ca6463d481a4830 not found: ID does not exist"
Jul 18 12:08:04.919305 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:08:04.919179    2579 scope.go:117] "RemoveContainer" containerID="76d5888cc55addfb80532e34e0fa6c56480ceee807efc3a25b26aa983a125a12"
Jul 18 12:08:04.919491 ip-10-0-133-122 kubenswrapper[2579]: E0718 12:08:04.919471    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"76d5888cc55addfb80532e34e0fa6c56480ceee807efc3a25b26aa983a125a12\": container with ID starting with 76d5888cc55addfb80532e34e0fa6c56480ceee807efc3a25b26aa983a125a12 not found: ID does not exist" containerID="76d5888cc55addfb80532e34e0fa6c56480ceee807efc3a25b26aa983a125a12"
Jul 18 12:08:04.919561 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:08:04.919498    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"76d5888cc55addfb80532e34e0fa6c56480ceee807efc3a25b26aa983a125a12"} err="failed to get container status \"76d5888cc55addfb80532e34e0fa6c56480ceee807efc3a25b26aa983a125a12\": rpc error: code = NotFound desc = could not find container \"76d5888cc55addfb80532e34e0fa6c56480ceee807efc3a25b26aa983a125a12\": container with ID starting with 76d5888cc55addfb80532e34e0fa6c56480ceee807efc3a25b26aa983a125a12 not found: ID does not exist"
Jul 18 12:08:05.027491 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:08:05.027457    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/df118917-490f-4cec-b699-aae5edcae68c-istio-podinfo\") pod \"df118917-490f-4cec-b699-aae5edcae68c\" (UID: \"df118917-490f-4cec-b699-aae5edcae68c\") "
Jul 18 12:08:05.027709 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:08:05.027502    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/df118917-490f-4cec-b699-aae5edcae68c-workload-certs\") pod \"df118917-490f-4cec-b699-aae5edcae68c\" (UID: \"df118917-490f-4cec-b699-aae5edcae68c\") "
Jul 18 12:08:05.027709 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:08:05.027520    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/df118917-490f-4cec-b699-aae5edcae68c-credential-socket\") pod \"df118917-490f-4cec-b699-aae5edcae68c\" (UID: \"df118917-490f-4cec-b699-aae5edcae68c\") "
Jul 18 12:08:05.027709 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:08:05.027562    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/df118917-490f-4cec-b699-aae5edcae68c-istio-envoy\") pod \"df118917-490f-4cec-b699-aae5edcae68c\" (UID: \"df118917-490f-4cec-b699-aae5edcae68c\") "
Jul 18 12:08:05.027709 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:08:05.027592    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/df118917-490f-4cec-b699-aae5edcae68c-istio-token\") pod \"df118917-490f-4cec-b699-aae5edcae68c\" (UID: \"df118917-490f-4cec-b699-aae5edcae68c\") "
Jul 18 12:08:05.027709 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:08:05.027636    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2ltsh\" (UniqueName: \"kubernetes.io/projected/df118917-490f-4cec-b699-aae5edcae68c-kube-api-access-2ltsh\") pod \"df118917-490f-4cec-b699-aae5edcae68c\" (UID: \"df118917-490f-4cec-b699-aae5edcae68c\") "
Jul 18 12:08:05.027709 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:08:05.027661    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/df118917-490f-4cec-b699-aae5edcae68c-workload-socket\") pod \"df118917-490f-4cec-b699-aae5edcae68c\" (UID: \"df118917-490f-4cec-b699-aae5edcae68c\") "
Jul 18 12:08:05.027709 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:08:05.027685    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/df118917-490f-4cec-b699-aae5edcae68c-istiod-ca-cert\") pod \"df118917-490f-4cec-b699-aae5edcae68c\" (UID: \"df118917-490f-4cec-b699-aae5edcae68c\") "
Jul 18 12:08:05.028164 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:08:05.027744    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/df118917-490f-4cec-b699-aae5edcae68c-istio-data\") pod \"df118917-490f-4cec-b699-aae5edcae68c\" (UID: \"df118917-490f-4cec-b699-aae5edcae68c\") "
Jul 18 12:08:05.028164 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:08:05.027816    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/df118917-490f-4cec-b699-aae5edcae68c-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "df118917-490f-4cec-b699-aae5edcae68c" (UID: "df118917-490f-4cec-b699-aae5edcae68c"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 12:08:05.028164 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:08:05.027853    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/df118917-490f-4cec-b699-aae5edcae68c-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "df118917-490f-4cec-b699-aae5edcae68c" (UID: "df118917-490f-4cec-b699-aae5edcae68c"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 12:08:05.028164 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:08:05.028148    2579 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/df118917-490f-4cec-b699-aae5edcae68c-workload-certs\") on node \"ip-10-0-133-122.ec2.internal\" DevicePath \"\""
Jul 18 12:08:05.028366 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:08:05.028169    2579 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/df118917-490f-4cec-b699-aae5edcae68c-credential-socket\") on node \"ip-10-0-133-122.ec2.internal\" DevicePath \"\""
Jul 18 12:08:05.028366 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:08:05.028181    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/df118917-490f-4cec-b699-aae5edcae68c-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "df118917-490f-4cec-b699-aae5edcae68c" (UID: "df118917-490f-4cec-b699-aae5edcae68c"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 18 12:08:05.028366 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:08:05.028254    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/df118917-490f-4cec-b699-aae5edcae68c-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "df118917-490f-4cec-b699-aae5edcae68c" (UID: "df118917-490f-4cec-b699-aae5edcae68c"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 12:08:05.028678 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:08:05.028655    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/df118917-490f-4cec-b699-aae5edcae68c-istio-data" (OuterVolumeSpecName: "istio-data") pod "df118917-490f-4cec-b699-aae5edcae68c" (UID: "df118917-490f-4cec-b699-aae5edcae68c"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 12:08:05.029987 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:08:05.029950    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/df118917-490f-4cec-b699-aae5edcae68c-istio-token" (OuterVolumeSpecName: "istio-token") pod "df118917-490f-4cec-b699-aae5edcae68c" (UID: "df118917-490f-4cec-b699-aae5edcae68c"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 18 12:08:05.030119 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:08:05.029986    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/df118917-490f-4cec-b699-aae5edcae68c-kube-api-access-2ltsh" (OuterVolumeSpecName: "kube-api-access-2ltsh") pod "df118917-490f-4cec-b699-aae5edcae68c" (UID: "df118917-490f-4cec-b699-aae5edcae68c"). InnerVolumeSpecName "kube-api-access-2ltsh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 18 12:08:05.030285 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:08:05.030257    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/df118917-490f-4cec-b699-aae5edcae68c-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "df118917-490f-4cec-b699-aae5edcae68c" (UID: "df118917-490f-4cec-b699-aae5edcae68c"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 12:08:05.030401 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:08:05.030259    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/df118917-490f-4cec-b699-aae5edcae68c-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "df118917-490f-4cec-b699-aae5edcae68c" (UID: "df118917-490f-4cec-b699-aae5edcae68c"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 18 12:08:05.129602 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:08:05.129565    2579 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/df118917-490f-4cec-b699-aae5edcae68c-istio-envoy\") on node \"ip-10-0-133-122.ec2.internal\" DevicePath \"\""
Jul 18 12:08:05.129602 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:08:05.129595    2579 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/df118917-490f-4cec-b699-aae5edcae68c-istio-token\") on node \"ip-10-0-133-122.ec2.internal\" DevicePath \"\""
Jul 18 12:08:05.129602 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:08:05.129605    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2ltsh\" (UniqueName: \"kubernetes.io/projected/df118917-490f-4cec-b699-aae5edcae68c-kube-api-access-2ltsh\") on node \"ip-10-0-133-122.ec2.internal\" DevicePath \"\""
Jul 18 12:08:05.129840 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:08:05.129615    2579 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/df118917-490f-4cec-b699-aae5edcae68c-workload-socket\") on node \"ip-10-0-133-122.ec2.internal\" DevicePath \"\""
Jul 18 12:08:05.129840 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:08:05.129623    2579 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/df118917-490f-4cec-b699-aae5edcae68c-istiod-ca-cert\") on node \"ip-10-0-133-122.ec2.internal\" DevicePath \"\""
Jul 18 12:08:05.129840 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:08:05.129632    2579 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/df118917-490f-4cec-b699-aae5edcae68c-istio-data\") on node \"ip-10-0-133-122.ec2.internal\" DevicePath \"\""
Jul 18 12:08:05.129840 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:08:05.129639    2579 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/df118917-490f-4cec-b699-aae5edcae68c-istio-podinfo\") on node \"ip-10-0-133-122.ec2.internal\" DevicePath \"\""
Jul 18 12:08:05.223914 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:08:05.223869    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-399bd8-openshift-default-56b4b5f97f-d72mp"]
Jul 18 12:08:05.229870 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:08:05.229841    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-399bd8-openshift-default-56b4b5f97f-d72mp"]
Jul 18 12:08:06.895241 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:08:06.895206    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="df118917-490f-4cec-b699-aae5edcae68c" path="/var/lib/kubelet/pods/df118917-490f-4cec-b699-aae5edcae68c/volumes"
Jul 18 12:08:21.772434 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:08:21.772395    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-276d7e-openshift-default-844b468f7f-78tmb"]
Jul 18 12:08:21.772951 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:08:21.772658    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-276d7e-openshift-default-844b468f7f-78tmb" podUID="5327e344-9bf0-4742-88dd-aff196c8994c" containerName="istio-proxy" containerID="cri-o://656cf99620d350d5ecf27390108994e8d6c64d9df73426f2c6bcd670041cda7e" gracePeriod=30
Jul 18 12:08:27.012725 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:08:27.012697    2579 generic.go:356] "Generic (PLEG): container finished" podID="5327e344-9bf0-4742-88dd-aff196c8994c" containerID="656cf99620d350d5ecf27390108994e8d6c64d9df73426f2c6bcd670041cda7e" exitCode=0
Jul 18 12:08:27.013121 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:08:27.012755    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-276d7e-openshift-default-844b468f7f-78tmb" event={"ID":"5327e344-9bf0-4742-88dd-aff196c8994c","Type":"ContainerDied","Data":"656cf99620d350d5ecf27390108994e8d6c64d9df73426f2c6bcd670041cda7e"}
Jul 18 12:08:27.013121 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:08:27.012821    2579 scope.go:117] "RemoveContainer" containerID="de9de7f262122cf3d44d3a358959fa096aecd1ee42284644d0b83ed22dd32ba4"
Jul 18 12:08:27.032688 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:08:27.032666    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-276d7e-openshift-default-844b468f7f-78tmb"
Jul 18 12:08:27.135846 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:08:27.135816    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5327e344-9bf0-4742-88dd-aff196c8994c-workload-certs\") pod \"5327e344-9bf0-4742-88dd-aff196c8994c\" (UID: \"5327e344-9bf0-4742-88dd-aff196c8994c\") "
Jul 18 12:08:27.136065 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:08:27.135868    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5327e344-9bf0-4742-88dd-aff196c8994c-workload-socket\") pod \"5327e344-9bf0-4742-88dd-aff196c8994c\" (UID: \"5327e344-9bf0-4742-88dd-aff196c8994c\") "
Jul 18 12:08:27.136065 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:08:27.135908    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qt6rv\" (UniqueName: \"kubernetes.io/projected/5327e344-9bf0-4742-88dd-aff196c8994c-kube-api-access-qt6rv\") pod \"5327e344-9bf0-4742-88dd-aff196c8994c\" (UID: \"5327e344-9bf0-4742-88dd-aff196c8994c\") "
Jul 18 12:08:27.136065 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:08:27.135931    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5327e344-9bf0-4742-88dd-aff196c8994c-credential-socket\") pod \"5327e344-9bf0-4742-88dd-aff196c8994c\" (UID: \"5327e344-9bf0-4742-88dd-aff196c8994c\") "
Jul 18 12:08:27.136065 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:08:27.135956    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5327e344-9bf0-4742-88dd-aff196c8994c-istio-envoy\") pod \"5327e344-9bf0-4742-88dd-aff196c8994c\" (UID: \"5327e344-9bf0-4742-88dd-aff196c8994c\") "
Jul 18 12:08:27.136065 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:08:27.135988    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5327e344-9bf0-4742-88dd-aff196c8994c-istiod-ca-cert\") pod \"5327e344-9bf0-4742-88dd-aff196c8994c\" (UID: \"5327e344-9bf0-4742-88dd-aff196c8994c\") "
Jul 18 12:08:27.136065 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:08:27.136006    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5327e344-9bf0-4742-88dd-aff196c8994c-istio-data\") pod \"5327e344-9bf0-4742-88dd-aff196c8994c\" (UID: \"5327e344-9bf0-4742-88dd-aff196c8994c\") "
Jul 18 12:08:27.136065 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:08:27.136048    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5327e344-9bf0-4742-88dd-aff196c8994c-istio-podinfo\") pod \"5327e344-9bf0-4742-88dd-aff196c8994c\" (UID: \"5327e344-9bf0-4742-88dd-aff196c8994c\") "
Jul 18 12:08:27.136391 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:08:27.136079    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5327e344-9bf0-4742-88dd-aff196c8994c-istio-token\") pod \"5327e344-9bf0-4742-88dd-aff196c8994c\" (UID: \"5327e344-9bf0-4742-88dd-aff196c8994c\") "
Jul 18 12:08:27.136391 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:08:27.136176    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5327e344-9bf0-4742-88dd-aff196c8994c-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "5327e344-9bf0-4742-88dd-aff196c8994c" (UID: "5327e344-9bf0-4742-88dd-aff196c8994c"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 12:08:27.136391 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:08:27.136277    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5327e344-9bf0-4742-88dd-aff196c8994c-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "5327e344-9bf0-4742-88dd-aff196c8994c" (UID: "5327e344-9bf0-4742-88dd-aff196c8994c"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 12:08:27.136548 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:08:27.136419    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5327e344-9bf0-4742-88dd-aff196c8994c-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "5327e344-9bf0-4742-88dd-aff196c8994c" (UID: "5327e344-9bf0-4742-88dd-aff196c8994c"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 12:08:27.136548 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:08:27.136427    2579 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5327e344-9bf0-4742-88dd-aff196c8994c-workload-certs\") on node \"ip-10-0-133-122.ec2.internal\" DevicePath \"\""
Jul 18 12:08:27.136548 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:08:27.136472    2579 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5327e344-9bf0-4742-88dd-aff196c8994c-workload-socket\") on node \"ip-10-0-133-122.ec2.internal\" DevicePath \"\""
Jul 18 12:08:27.136548 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:08:27.136469    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5327e344-9bf0-4742-88dd-aff196c8994c-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "5327e344-9bf0-4742-88dd-aff196c8994c" (UID: "5327e344-9bf0-4742-88dd-aff196c8994c"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 18 12:08:27.136860 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:08:27.136792    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5327e344-9bf0-4742-88dd-aff196c8994c-istio-data" (OuterVolumeSpecName: "istio-data") pod "5327e344-9bf0-4742-88dd-aff196c8994c" (UID: "5327e344-9bf0-4742-88dd-aff196c8994c"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 12:08:27.138326 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:08:27.138294    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/5327e344-9bf0-4742-88dd-aff196c8994c-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "5327e344-9bf0-4742-88dd-aff196c8994c" (UID: "5327e344-9bf0-4742-88dd-aff196c8994c"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 18 12:08:27.138326 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:08:27.138306    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5327e344-9bf0-4742-88dd-aff196c8994c-kube-api-access-qt6rv" (OuterVolumeSpecName: "kube-api-access-qt6rv") pod "5327e344-9bf0-4742-88dd-aff196c8994c" (UID: "5327e344-9bf0-4742-88dd-aff196c8994c"). InnerVolumeSpecName "kube-api-access-qt6rv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 18 12:08:27.138467 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:08:27.138355    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5327e344-9bf0-4742-88dd-aff196c8994c-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "5327e344-9bf0-4742-88dd-aff196c8994c" (UID: "5327e344-9bf0-4742-88dd-aff196c8994c"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 12:08:27.138467 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:08:27.138414    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5327e344-9bf0-4742-88dd-aff196c8994c-istio-token" (OuterVolumeSpecName: "istio-token") pod "5327e344-9bf0-4742-88dd-aff196c8994c" (UID: "5327e344-9bf0-4742-88dd-aff196c8994c"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 18 12:08:27.237750 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:08:27.237711    2579 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5327e344-9bf0-4742-88dd-aff196c8994c-istiod-ca-cert\") on node \"ip-10-0-133-122.ec2.internal\" DevicePath \"\""
Jul 18 12:08:27.237750 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:08:27.237744    2579 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5327e344-9bf0-4742-88dd-aff196c8994c-istio-data\") on node \"ip-10-0-133-122.ec2.internal\" DevicePath \"\""
Jul 18 12:08:27.237750 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:08:27.237753    2579 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5327e344-9bf0-4742-88dd-aff196c8994c-istio-podinfo\") on node \"ip-10-0-133-122.ec2.internal\" DevicePath \"\""
Jul 18 12:08:27.238015 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:08:27.237762    2579 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5327e344-9bf0-4742-88dd-aff196c8994c-istio-token\") on node \"ip-10-0-133-122.ec2.internal\" DevicePath \"\""
Jul 18 12:08:27.238015 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:08:27.237770    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qt6rv\" (UniqueName: \"kubernetes.io/projected/5327e344-9bf0-4742-88dd-aff196c8994c-kube-api-access-qt6rv\") on node \"ip-10-0-133-122.ec2.internal\" DevicePath \"\""
Jul 18 12:08:27.238015 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:08:27.237779    2579 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5327e344-9bf0-4742-88dd-aff196c8994c-credential-socket\") on node \"ip-10-0-133-122.ec2.internal\" DevicePath \"\""
Jul 18 12:08:27.238015 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:08:27.237787    2579 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5327e344-9bf0-4742-88dd-aff196c8994c-istio-envoy\") on node \"ip-10-0-133-122.ec2.internal\" DevicePath \"\""
Jul 18 12:08:28.019032 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:08:28.018995    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-276d7e-openshift-default-844b468f7f-78tmb" event={"ID":"5327e344-9bf0-4742-88dd-aff196c8994c","Type":"ContainerDied","Data":"638138324ea0e9114d0e633129005148795bf74efd509cfd592ab0b162050e1d"}
Jul 18 12:08:28.019485 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:08:28.019080    2579 scope.go:117] "RemoveContainer" containerID="656cf99620d350d5ecf27390108994e8d6c64d9df73426f2c6bcd670041cda7e"
Jul 18 12:08:28.019485 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:08:28.019011    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-276d7e-openshift-default-844b468f7f-78tmb"
Jul 18 12:08:28.051831 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:08:28.051802    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-276d7e-openshift-default-844b468f7f-78tmb"]
Jul 18 12:08:28.055119 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:08:28.055092    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-276d7e-openshift-default-844b468f7f-78tmb"]
Jul 18 12:08:28.175958 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:08:28.175930    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-b98bf4979-vp7dc_8edc7039-0a69-4921-a1a1-a3d67a9df116/manager/0.log"
Jul 18 12:08:28.291385 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:08:28.291304    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-gt9q8_457d77bd-9dba-45f9-b058-e7e858552e30/server/0.log"
Jul 18 12:08:28.414673 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:08:28.414638    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-zr4nk_94c96214-64fb-45bd-839d-363d257601b1/manager/0.log"
Jul 18 12:08:28.656114 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:08:28.656087    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-78b8cdd6f7-m4f5l_2d639e51-1a11-4bd6-84aa-c98a1478b0d1/copy-manifests/0.log"
Jul 18 12:08:28.662802 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:08:28.662775    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-78b8cdd6f7-m4f5l_2d639e51-1a11-4bd6-84aa-c98a1478b0d1/manager/0.log"
Jul 18 12:08:28.894480 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:08:28.894447    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5327e344-9bf0-4742-88dd-aff196c8994c" path="/var/lib/kubelet/pods/5327e344-9bf0-4742-88dd-aff196c8994c/volumes"
Jul 18 12:08:29.117395 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:08:29.117367    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-c9b7d9585-dfsk8_dac0d1f3-4b8f-440c-aca3-6f9cc02fd1b8/maas-api/0.log"
Jul 18 12:08:29.237848 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:08:29.237822    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29739585-n8bv4_ab9d055e-1bb5-4a55-96a6-3597995699c8/cleanup/0.log"
Jul 18 12:08:29.350742 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:08:29.350715    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29739600-2g2p4_6e2c0bed-1933-440b-b86d-09c5ef63a5e9/cleanup/0.log"
Jul 18 12:08:29.469682 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:08:29.469607    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-69fb4594cf-jvdfg_6a1d8986-a31b-4af0-ab23-836e6bd9cf88/postgres/0.log"
Jul 18 12:08:30.913662 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:08:30.913630    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-shm4n_ad8005db-d17d-4b41-9c21-d591ebbaa531/manager/0.log"
Jul 18 12:08:31.028140 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:08:31.028109    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-9wcs7_3e20b43a-6546-4d4f-a035-4a2f1a2e2b29/manager/0.log"
Jul 18 12:08:31.262474 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:08:31.262390    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-s65nm_8c6394f8-d608-425a-bec8-b33c5fe82ef8/registry-server/0.log"
Jul 18 12:08:31.383394 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:08:31.383364    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-xxwh9_135abbdc-a94a-45c3-a6ac-fe5fd28156be/manager/0.log"
Jul 18 12:08:31.613672 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:08:31.613641    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-psgjq_1b58326c-69ea-4a70-822c-ae0c7f6e9bfe/manager/0.log"
Jul 18 12:08:32.204492 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:08:32.204463    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6df8599d98-ln7qm_640816cf-eb9e-415c-a697-251d12cdc225/kube-auth-proxy/0.log"
Jul 18 12:08:32.800986 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:08:32.800942    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-64cdb59cb-q4c6l_067c96d7-6025-43a0-872a-9134f16c8221/router/0.log"
Jul 18 12:08:33.253620 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:08:33.253588    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-wptft_41f1408a-25d0-4d54-b07e-db50e046aba7/main/0.log"
Jul 18 12:08:33.480854 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:08:33.480822    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f5rj8f_bd776893-4c58-4515-aa7b-f0210d9dfe35/main/0.log"
Jul 18 12:08:39.762295 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:08:39.762266    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-9kfp5/must-gather-s25s5"]
Jul 18 12:08:39.762707 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:08:39.762662    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5327e344-9bf0-4742-88dd-aff196c8994c" containerName="istio-proxy"
Jul 18 12:08:39.762707 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:08:39.762674    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="5327e344-9bf0-4742-88dd-aff196c8994c" containerName="istio-proxy"
Jul 18 12:08:39.762707 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:08:39.762689    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="df118917-490f-4cec-b699-aae5edcae68c" containerName="istio-proxy"
Jul 18 12:08:39.762707 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:08:39.762695    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="df118917-490f-4cec-b699-aae5edcae68c" containerName="istio-proxy"
Jul 18 12:08:39.762867 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:08:39.762719    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="df118917-490f-4cec-b699-aae5edcae68c" containerName="istio-proxy"
Jul 18 12:08:39.762867 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:08:39.762724    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="df118917-490f-4cec-b699-aae5edcae68c" containerName="istio-proxy"
Jul 18 12:08:39.762867 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:08:39.762729    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e6670a1e-2904-4e00-af9a-f455cdbd8180" containerName="test-curl-7870-140525223081856"
Jul 18 12:08:39.762867 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:08:39.762735    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="e6670a1e-2904-4e00-af9a-f455cdbd8180" containerName="test-curl-7870-140525223081856"
Jul 18 12:08:39.762867 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:08:39.762811    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="5327e344-9bf0-4742-88dd-aff196c8994c" containerName="istio-proxy"
Jul 18 12:08:39.762867 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:08:39.762820    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="df118917-490f-4cec-b699-aae5edcae68c" containerName="istio-proxy"
Jul 18 12:08:39.762867 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:08:39.762827    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="5327e344-9bf0-4742-88dd-aff196c8994c" containerName="istio-proxy"
Jul 18 12:08:39.762867 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:08:39.762834    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="e6670a1e-2904-4e00-af9a-f455cdbd8180" containerName="test-curl-7870-140525223081856"
Jul 18 12:08:39.763187 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:08:39.762935    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5327e344-9bf0-4742-88dd-aff196c8994c" containerName="istio-proxy"
Jul 18 12:08:39.763187 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:08:39.762942    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="5327e344-9bf0-4742-88dd-aff196c8994c" containerName="istio-proxy"
Jul 18 12:08:39.763187 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:08:39.763031    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="df118917-490f-4cec-b699-aae5edcae68c" containerName="istio-proxy"
Jul 18 12:08:39.767537 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:08:39.767516    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-9kfp5/must-gather-s25s5"
Jul 18 12:08:39.770169 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:08:39.770148    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-9kfp5\"/\"openshift-service-ca.crt\""
Jul 18 12:08:39.770302 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:08:39.770153    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-9kfp5\"/\"kube-root-ca.crt\""
Jul 18 12:08:39.770883 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:08:39.770868    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-9kfp5\"/\"default-dockercfg-jf7sl\""
Jul 18 12:08:39.775393 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:08:39.775371    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-9kfp5/must-gather-s25s5"]
Jul 18 12:08:39.836006 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:08:39.835974    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lp6h2\" (UniqueName: \"kubernetes.io/projected/884771bb-2108-479c-8e8f-f614d073c7a8-kube-api-access-lp6h2\") pod \"must-gather-s25s5\" (UID: \"884771bb-2108-479c-8e8f-f614d073c7a8\") " pod="openshift-must-gather-9kfp5/must-gather-s25s5"
Jul 18 12:08:39.836180 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:08:39.836011    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/884771bb-2108-479c-8e8f-f614d073c7a8-must-gather-output\") pod \"must-gather-s25s5\" (UID: \"884771bb-2108-479c-8e8f-f614d073c7a8\") " pod="openshift-must-gather-9kfp5/must-gather-s25s5"
Jul 18 12:08:39.936809 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:08:39.936778    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lp6h2\" (UniqueName: \"kubernetes.io/projected/884771bb-2108-479c-8e8f-f614d073c7a8-kube-api-access-lp6h2\") pod \"must-gather-s25s5\" (UID: \"884771bb-2108-479c-8e8f-f614d073c7a8\") " pod="openshift-must-gather-9kfp5/must-gather-s25s5"
Jul 18 12:08:39.936809 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:08:39.936810    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/884771bb-2108-479c-8e8f-f614d073c7a8-must-gather-output\") pod \"must-gather-s25s5\" (UID: \"884771bb-2108-479c-8e8f-f614d073c7a8\") " pod="openshift-must-gather-9kfp5/must-gather-s25s5"
Jul 18 12:08:39.937183 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:08:39.937166    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/884771bb-2108-479c-8e8f-f614d073c7a8-must-gather-output\") pod \"must-gather-s25s5\" (UID: \"884771bb-2108-479c-8e8f-f614d073c7a8\") " pod="openshift-must-gather-9kfp5/must-gather-s25s5"
Jul 18 12:08:39.949848 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:08:39.949823    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lp6h2\" (UniqueName: \"kubernetes.io/projected/884771bb-2108-479c-8e8f-f614d073c7a8-kube-api-access-lp6h2\") pod \"must-gather-s25s5\" (UID: \"884771bb-2108-479c-8e8f-f614d073c7a8\") " pod="openshift-must-gather-9kfp5/must-gather-s25s5"
Jul 18 12:08:40.077634 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:08:40.077544    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-9kfp5/must-gather-s25s5"
Jul 18 12:08:40.214300 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:08:40.214271    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-9kfp5/must-gather-s25s5"]
Jul 18 12:08:40.216000 ip-10-0-133-122 kubenswrapper[2579]: W0718 12:08:40.215968    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod884771bb_2108_479c_8e8f_f614d073c7a8.slice/crio-678b7bdb498637eefd960ebee4b72d780159b92965c4d2070d75f52420ce7015 WatchSource:0}: Error finding container 678b7bdb498637eefd960ebee4b72d780159b92965c4d2070d75f52420ce7015: Status 404 returned error can't find the container with id 678b7bdb498637eefd960ebee4b72d780159b92965c4d2070d75f52420ce7015
Jul 18 12:08:41.085362 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:08:41.085328    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-9kfp5/must-gather-s25s5" event={"ID":"884771bb-2108-479c-8e8f-f614d073c7a8","Type":"ContainerStarted","Data":"678b7bdb498637eefd960ebee4b72d780159b92965c4d2070d75f52420ce7015"}
Jul 18 12:08:42.094954 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:08:42.094918    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-9kfp5/must-gather-s25s5" event={"ID":"884771bb-2108-479c-8e8f-f614d073c7a8","Type":"ContainerStarted","Data":"48e9d95d350a36f2a2dd2f94fea72cc08b69b288c314f3b55caa2fa10de2f92a"}
Jul 18 12:08:42.095432 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:08:42.094972    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-9kfp5/must-gather-s25s5" event={"ID":"884771bb-2108-479c-8e8f-f614d073c7a8","Type":"ContainerStarted","Data":"31fac8beba625f41fff297bdbe078086919c86edd0798ee1886f63985d5d1c29"}
Jul 18 12:08:42.639263 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:08:42.639235    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-6j4vg_b4c72690-9e6e-4826-8ff8-95eeea44b5d0/global-pull-secret-syncer/0.log"
Jul 18 12:08:42.799996 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:08:42.799965    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-hnt7j_e0f67788-e972-49ff-b611-b9835f528d81/konnectivity-agent/0.log"
Jul 18 12:08:42.875504 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:08:42.875475    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-133-122.ec2.internal_2a172972fbb39a4c6031f848e0d266ff/haproxy/0.log"
Jul 18 12:08:47.748011 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:08:47.747974    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-shm4n_ad8005db-d17d-4b41-9c21-d591ebbaa531/manager/0.log"
Jul 18 12:08:47.780226 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:08:47.780139    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-9wcs7_3e20b43a-6546-4d4f-a035-4a2f1a2e2b29/manager/0.log"
Jul 18 12:08:47.851435 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:08:47.851391    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-s65nm_8c6394f8-d608-425a-bec8-b33c5fe82ef8/registry-server/0.log"
Jul 18 12:08:47.985049 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:08:47.984993    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-xxwh9_135abbdc-a94a-45c3-a6ac-fe5fd28156be/manager/0.log"
Jul 18 12:08:48.117910 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:08:48.116991    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-psgjq_1b58326c-69ea-4a70-822c-ae0c7f6e9bfe/manager/0.log"
Jul 18 12:08:49.842483 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:08:49.842445    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-76cf8966f8-fzxs7_f4e046d0-f0d1-453c-8729-b2191f050b73/cluster-monitoring-operator/0.log"
Jul 18 12:08:50.069307 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:08:50.069274    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-hlhp7_41df8388-1932-4d01-b750-9d1648196b4c/node-exporter/0.log"
Jul 18 12:08:50.091230 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:08:50.091174    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-hlhp7_41df8388-1932-4d01-b750-9d1648196b4c/kube-rbac-proxy/0.log"
Jul 18 12:08:50.111696 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:08:50.111653    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-hlhp7_41df8388-1932-4d01-b750-9d1648196b4c/init-textfile/0.log"
Jul 18 12:08:52.075017 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:08:52.074977    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-7bc7489cb5-v6n2x_63d7c8c7-1716-489e-8698-e49c93a85050/networking-console-plugin/0.log"
Jul 18 12:08:52.669702 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:08:52.669669    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-jfpn7_759a894c-1828-4ac9-a7c3-77354a104247/console-operator/2.log"
Jul 18 12:08:52.676005 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:08:52.675955    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-jfpn7_759a894c-1828-4ac9-a7c3-77354a104247/console-operator/3.log"
Jul 18 12:08:52.955175 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:08:52.955028    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-9kfp5/must-gather-s25s5" podStartSLOduration=13.048542632 podStartE2EDuration="13.955005407s" totalImagesPullingTime="906.462775ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 12:08:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 12:08:42.113108221 +0000 UTC m=+2941.728144535" watchObservedRunningTime="2026-07-18 12:08:52.955005407 +0000 UTC m=+2952.570041710"
Jul 18 12:08:52.957813 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:08:52.957782    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-9kfp5/perf-node-gather-daemonset-5nv4h"]
Jul 18 12:08:52.963446 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:08:52.963416    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-9kfp5/perf-node-gather-daemonset-5nv4h"
Jul 18 12:08:52.967976 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:08:52.967948    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-9kfp5/perf-node-gather-daemonset-5nv4h"]
Jul 18 12:08:53.085740 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:08:53.085698    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/466a3c65-cf1a-4c38-bba0-3cdb2004586f-proc\") pod \"perf-node-gather-daemonset-5nv4h\" (UID: \"466a3c65-cf1a-4c38-bba0-3cdb2004586f\") " pod="openshift-must-gather-9kfp5/perf-node-gather-daemonset-5nv4h"
Jul 18 12:08:53.086267 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:08:53.085780    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/466a3c65-cf1a-4c38-bba0-3cdb2004586f-sys\") pod \"perf-node-gather-daemonset-5nv4h\" (UID: \"466a3c65-cf1a-4c38-bba0-3cdb2004586f\") " pod="openshift-must-gather-9kfp5/perf-node-gather-daemonset-5nv4h"
Jul 18 12:08:53.086267 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:08:53.085858    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/466a3c65-cf1a-4c38-bba0-3cdb2004586f-podres\") pod \"perf-node-gather-daemonset-5nv4h\" (UID: \"466a3c65-cf1a-4c38-bba0-3cdb2004586f\") " pod="openshift-must-gather-9kfp5/perf-node-gather-daemonset-5nv4h"
Jul 18 12:08:53.086267 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:08:53.085997    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/466a3c65-cf1a-4c38-bba0-3cdb2004586f-lib-modules\") pod \"perf-node-gather-daemonset-5nv4h\" (UID: \"466a3c65-cf1a-4c38-bba0-3cdb2004586f\") " pod="openshift-must-gather-9kfp5/perf-node-gather-daemonset-5nv4h"
Jul 18 12:08:53.086267 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:08:53.086088    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qmxfv\" (UniqueName: \"kubernetes.io/projected/466a3c65-cf1a-4c38-bba0-3cdb2004586f-kube-api-access-qmxfv\") pod \"perf-node-gather-daemonset-5nv4h\" (UID: \"466a3c65-cf1a-4c38-bba0-3cdb2004586f\") " pod="openshift-must-gather-9kfp5/perf-node-gather-daemonset-5nv4h"
Jul 18 12:08:53.187725 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:08:53.187670    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/466a3c65-cf1a-4c38-bba0-3cdb2004586f-lib-modules\") pod \"perf-node-gather-daemonset-5nv4h\" (UID: \"466a3c65-cf1a-4c38-bba0-3cdb2004586f\") " pod="openshift-must-gather-9kfp5/perf-node-gather-daemonset-5nv4h"
Jul 18 12:08:53.187963 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:08:53.187760    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qmxfv\" (UniqueName: \"kubernetes.io/projected/466a3c65-cf1a-4c38-bba0-3cdb2004586f-kube-api-access-qmxfv\") pod \"perf-node-gather-daemonset-5nv4h\" (UID: \"466a3c65-cf1a-4c38-bba0-3cdb2004586f\") " pod="openshift-must-gather-9kfp5/perf-node-gather-daemonset-5nv4h"
Jul 18 12:08:53.187963 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:08:53.187855    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/466a3c65-cf1a-4c38-bba0-3cdb2004586f-proc\") pod \"perf-node-gather-daemonset-5nv4h\" (UID: \"466a3c65-cf1a-4c38-bba0-3cdb2004586f\") " pod="openshift-must-gather-9kfp5/perf-node-gather-daemonset-5nv4h"
Jul 18 12:08:53.187963 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:08:53.187911    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/466a3c65-cf1a-4c38-bba0-3cdb2004586f-sys\") pod \"perf-node-gather-daemonset-5nv4h\" (UID: \"466a3c65-cf1a-4c38-bba0-3cdb2004586f\") " pod="openshift-must-gather-9kfp5/perf-node-gather-daemonset-5nv4h"
Jul 18 12:08:53.187963 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:08:53.187937    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/466a3c65-cf1a-4c38-bba0-3cdb2004586f-podres\") pod \"perf-node-gather-daemonset-5nv4h\" (UID: \"466a3c65-cf1a-4c38-bba0-3cdb2004586f\") " pod="openshift-must-gather-9kfp5/perf-node-gather-daemonset-5nv4h"
Jul 18 12:08:53.188226 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:08:53.188095    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/466a3c65-cf1a-4c38-bba0-3cdb2004586f-podres\") pod \"perf-node-gather-daemonset-5nv4h\" (UID: \"466a3c65-cf1a-4c38-bba0-3cdb2004586f\") " pod="openshift-must-gather-9kfp5/perf-node-gather-daemonset-5nv4h"
Jul 18 12:08:53.188226 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:08:53.188189    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/466a3c65-cf1a-4c38-bba0-3cdb2004586f-lib-modules\") pod \"perf-node-gather-daemonset-5nv4h\" (UID: \"466a3c65-cf1a-4c38-bba0-3cdb2004586f\") " pod="openshift-must-gather-9kfp5/perf-node-gather-daemonset-5nv4h"
Jul 18 12:08:53.188562 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:08:53.188533    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/466a3c65-cf1a-4c38-bba0-3cdb2004586f-proc\") pod \"perf-node-gather-daemonset-5nv4h\" (UID: \"466a3c65-cf1a-4c38-bba0-3cdb2004586f\") " pod="openshift-must-gather-9kfp5/perf-node-gather-daemonset-5nv4h"
Jul 18 12:08:53.188800 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:08:53.188768    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/466a3c65-cf1a-4c38-bba0-3cdb2004586f-sys\") pod \"perf-node-gather-daemonset-5nv4h\" (UID: \"466a3c65-cf1a-4c38-bba0-3cdb2004586f\") " pod="openshift-must-gather-9kfp5/perf-node-gather-daemonset-5nv4h"
Jul 18 12:08:53.198931 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:08:53.198881    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qmxfv\" (UniqueName: \"kubernetes.io/projected/466a3c65-cf1a-4c38-bba0-3cdb2004586f-kube-api-access-qmxfv\") pod \"perf-node-gather-daemonset-5nv4h\" (UID: \"466a3c65-cf1a-4c38-bba0-3cdb2004586f\") " pod="openshift-must-gather-9kfp5/perf-node-gather-daemonset-5nv4h"
Jul 18 12:08:53.278098 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:08:53.278000    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-9kfp5/perf-node-gather-daemonset-5nv4h"
Jul 18 12:08:53.476524 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:08:53.476494    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-9kfp5/perf-node-gather-daemonset-5nv4h"]
Jul 18 12:08:53.934419 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:08:53.934393    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-78cf4c6f6-rtpfm_1deb912b-fac4-4121-a030-3a5ae9700aa0/volume-data-source-validator/0.log"
Jul 18 12:08:54.195194 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:08:54.195107    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-9kfp5/perf-node-gather-daemonset-5nv4h" event={"ID":"466a3c65-cf1a-4c38-bba0-3cdb2004586f","Type":"ContainerStarted","Data":"50c9ae83fe80f147c041aee4a11f1005ee44dd6def3f81d6eee27517ab8afb3e"}
Jul 18 12:08:54.195194 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:08:54.195161    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-9kfp5/perf-node-gather-daemonset-5nv4h" event={"ID":"466a3c65-cf1a-4c38-bba0-3cdb2004586f","Type":"ContainerStarted","Data":"753320de4301760b71162198bc25950c808d3e85482e0c5807b4413f713155b4"}
Jul 18 12:08:54.195708 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:08:54.195202    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-9kfp5/perf-node-gather-daemonset-5nv4h"
Jul 18 12:08:54.213618 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:08:54.213538    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-9kfp5/perf-node-gather-daemonset-5nv4h" podStartSLOduration=2.213515335 podStartE2EDuration="2.213515335s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-18 12:08:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 12:08:54.212175228 +0000 UTC m=+2953.827211531" watchObservedRunningTime="2026-07-18 12:08:54.213515335 +0000 UTC m=+2953.828551642"
Jul 18 12:08:54.976184 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:08:54.976158    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-kv2jv_57dfdac3-878d-43df-84ab-0996f5fba323/dns/0.log"
Jul 18 12:08:55.000478 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:08:55.000446    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-kv2jv_57dfdac3-878d-43df-84ab-0996f5fba323/kube-rbac-proxy/0.log"
Jul 18 12:08:55.111774 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:08:55.111749    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-4522z_899ed5f2-c702-4904-82e7-0ab5570dd7d3/dns-node-resolver/0.log"
Jul 18 12:08:55.709076 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:08:55.709043    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-649ff8c9d5-svm5g_7620d14f-9a52-46b0-9bfd-15432e78b658/registry/0.log"
Jul 18 12:08:55.752852 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:08:55.752824    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-bz5mq_e24556f0-f108-4c9d-a3b1-5d0548925197/node-ca/0.log"
Jul 18 12:08:56.840985 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:08:56.840956    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6df8599d98-ln7qm_640816cf-eb9e-415c-a697-251d12cdc225/kube-auth-proxy/0.log"
Jul 18 12:08:56.993243 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:08:56.993215    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-64cdb59cb-q4c6l_067c96d7-6025-43a0-872a-9134f16c8221/router/0.log"
Jul 18 12:08:57.665884 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:08:57.665853    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-ljssw_446260ea-ffd2-4b81-8455-4d2052b97c2a/serve-healthcheck-canary/0.log"
Jul 18 12:08:58.136224 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:08:58.136189    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-555d9d7885-qs8cs_e0a05104-9f66-40b5-8d49-2bf876d64b5c/insights-operator/0.log"
Jul 18 12:08:58.138800 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:08:58.138777    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-555d9d7885-qs8cs_e0a05104-9f66-40b5-8d49-2bf876d64b5c/insights-operator/1.log"
Jul 18 12:08:58.157761 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:08:58.157729    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-2l7gv_33c02514-4254-498e-86eb-8d7d858bc338/kube-rbac-proxy/0.log"
Jul 18 12:08:58.177336 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:08:58.177304    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-2l7gv_33c02514-4254-498e-86eb-8d7d858bc338/exporter/0.log"
Jul 18 12:08:58.200219 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:08:58.200187    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-2l7gv_33c02514-4254-498e-86eb-8d7d858bc338/extractor/0.log"
Jul 18 12:09:00.214195 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:09:00.214169    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-9kfp5/perf-node-gather-daemonset-5nv4h"
Jul 18 12:09:00.734529 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:09:00.734499    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-b98bf4979-vp7dc_8edc7039-0a69-4921-a1a1-a3d67a9df116/manager/0.log"
Jul 18 12:09:00.754986 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:09:00.754960    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-gt9q8_457d77bd-9dba-45f9-b058-e7e858552e30/server/0.log"
Jul 18 12:09:00.843053 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:09:00.843015    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-zr4nk_94c96214-64fb-45bd-839d-363d257601b1/manager/0.log"
Jul 18 12:09:00.957704 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:09:00.957650    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-78b8cdd6f7-m4f5l_2d639e51-1a11-4bd6-84aa-c98a1478b0d1/manager/0.log"
Jul 18 12:09:00.977960 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:09:00.977933    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-78b8cdd6f7-m4f5l_2d639e51-1a11-4bd6-84aa-c98a1478b0d1/copy-manifests/0.log"
Jul 18 12:09:03.662236 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:09:03.662207    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6df8599d98-ln7qm_640816cf-eb9e-415c-a697-251d12cdc225/kube-auth-proxy/0.log"
Jul 18 12:09:03.767988 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:09:03.767956    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-64cdb59cb-q4c6l_067c96d7-6025-43a0-872a-9134f16c8221/router/0.log"
Jul 18 12:09:05.171814 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:09:05.171782    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6df8599d98-ln7qm_640816cf-eb9e-415c-a697-251d12cdc225/kube-auth-proxy/0.log"
Jul 18 12:09:05.294721 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:09:05.294693    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-64cdb59cb-q4c6l_067c96d7-6025-43a0-872a-9134f16c8221/router/0.log"
Jul 18 12:09:07.814227 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:09:07.814195    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7cc9c7ffd7-m68sg_cea912a4-ac4a-4b4d-979e-812f1ac845ed/migrator/0.log"
Jul 18 12:09:07.838033 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:09:07.838008    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7cc9c7ffd7-m68sg_cea912a4-ac4a-4b4d-979e-812f1ac845ed/graceful-termination/0.log"
Jul 18 12:09:08.185229 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:09:08.185175    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-7658d9b749-p7shj_e6cc6097-8792-4b98-ab5f-085dac6a9dc7/kube-storage-version-migrator-operator/1.log"
Jul 18 12:09:08.186175 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:09:08.186154    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-7658d9b749-p7shj_e6cc6097-8792-4b98-ab5f-085dac6a9dc7/kube-storage-version-migrator-operator/0.log"
Jul 18 12:09:09.562469 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:09:09.562440    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-lmf4l_49f40ae2-d33c-4284-a889-0d9b27421bf4/kube-multus-additional-cni-plugins/0.log"
Jul 18 12:09:09.582414 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:09:09.582386    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-lmf4l_49f40ae2-d33c-4284-a889-0d9b27421bf4/egress-router-binary-copy/0.log"
Jul 18 12:09:09.602977 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:09:09.602946    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-lmf4l_49f40ae2-d33c-4284-a889-0d9b27421bf4/cni-plugins/0.log"
Jul 18 12:09:09.623489 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:09:09.623457    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-lmf4l_49f40ae2-d33c-4284-a889-0d9b27421bf4/bond-cni-plugin/0.log"
Jul 18 12:09:09.645503 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:09:09.645475    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-lmf4l_49f40ae2-d33c-4284-a889-0d9b27421bf4/routeoverride-cni/0.log"
Jul 18 12:09:09.666296 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:09:09.666272    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-lmf4l_49f40ae2-d33c-4284-a889-0d9b27421bf4/whereabouts-cni-bincopy/0.log"
Jul 18 12:09:09.686007 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:09:09.685977    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-lmf4l_49f40ae2-d33c-4284-a889-0d9b27421bf4/whereabouts-cni/0.log"
Jul 18 12:09:09.727171 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:09:09.727138    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-rc6td_914d8131-27d9-481c-b7e2-484f467526dc/kube-multus/0.log"
Jul 18 12:09:09.794338 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:09:09.794293    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-ljhk6_0e090c50-e996-4eda-b8c0-46d7f7d7dde3/network-metrics-daemon/0.log"
Jul 18 12:09:09.813617 ip-10-0-133-122 kubenswrapper[2579]: I0718 12:09:09.813533    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-ljhk6_0e090c50-e996-4eda-b8c0-46d7f7d7dde3/kube-rbac-proxy/0.log"