Jul 16 11:08:19.503227 ip-10-0-135-184 systemd[1]: Starting Kubernetes Kubelet...
Jul 16 11:08:19.985616 ip-10-0-135-184 kubenswrapper[2564]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 16 11:08:19.985616 ip-10-0-135-184 kubenswrapper[2564]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 16 11:08:19.985616 ip-10-0-135-184 kubenswrapper[2564]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 16 11:08:19.985616 ip-10-0-135-184 kubenswrapper[2564]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 16 11:08:19.985616 ip-10-0-135-184 kubenswrapper[2564]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 16 11:08:19.985616 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:19.948347    2564 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 16 11:08:19.985616 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.954338    2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 16 11:08:19.985616 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.954361    2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 16 11:08:19.985616 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.954365    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 16 11:08:19.985616 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.954369    2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 16 11:08:19.985616 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.954372    2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 16 11:08:19.985616 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.954377    2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 16 11:08:19.985616 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.954381    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 16 11:08:19.985616 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.954384    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 16 11:08:19.988400 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.954392    2564 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 16 11:08:19.988400 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.954396    2564 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 16 11:08:19.988400 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.954399    2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 16 11:08:19.988400 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.954401    2564 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 16 11:08:19.988400 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.954413    2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 16 11:08:19.988400 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.954416    2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 16 11:08:19.988400 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.954419    2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 16 11:08:19.988400 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.954422    2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 16 11:08:19.988400 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.954424    2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 16 11:08:19.988400 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.954428    2564 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 16 11:08:19.988400 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.954433    2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 16 11:08:19.988400 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.954438    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 16 11:08:19.988400 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.954441    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 16 11:08:19.988400 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.954444    2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 16 11:08:19.988400 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.954448    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 16 11:08:19.988400 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.954451    2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 16 11:08:19.988400 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.954454    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 16 11:08:19.988400 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.954457    2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 16 11:08:19.988400 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.954460    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 16 11:08:19.988400 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.954464    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 16 11:08:19.989044 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.954466    2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 16 11:08:19.989044 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.954469    2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 16 11:08:19.989044 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.954472    2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 16 11:08:19.989044 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.954475    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 16 11:08:19.989044 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.954477    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 16 11:08:19.989044 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.954480    2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 16 11:08:19.989044 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.954484    2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 16 11:08:19.989044 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.954487    2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 16 11:08:19.989044 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.954496    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 16 11:08:19.989044 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.954499    2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 16 11:08:19.989044 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.954501    2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 16 11:08:19.989044 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.954504    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 16 11:08:19.989044 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.954507    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 16 11:08:19.989044 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.954510    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 16 11:08:19.989044 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.954512    2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 16 11:08:19.989044 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.954516    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 16 11:08:19.989044 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.954520    2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 16 11:08:19.989044 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.954525    2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 16 11:08:19.989044 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.954529    2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 16 11:08:19.989773 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.954531    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 16 11:08:19.989773 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.954534    2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 16 11:08:19.989773 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.954537    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 16 11:08:19.989773 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.954540    2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 16 11:08:19.989773 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.954542    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 16 11:08:19.989773 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.954545    2564 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 16 11:08:19.989773 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.954548    2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 16 11:08:19.989773 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.954550    2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 16 11:08:19.989773 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.954553    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 16 11:08:19.989773 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.954556    2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 16 11:08:19.989773 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.954559    2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 16 11:08:19.989773 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.954562    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 16 11:08:19.989773 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.954567    2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 16 11:08:19.989773 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.954570    2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 16 11:08:19.989773 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.954573    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 16 11:08:19.989773 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.954575    2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 16 11:08:19.989773 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.954578    2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 16 11:08:19.989773 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.954581    2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 16 11:08:19.989773 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.954584    2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 16 11:08:19.989773 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.954586    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 16 11:08:19.990435 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.954589    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 16 11:08:19.990435 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.954591    2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 16 11:08:19.990435 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.954600    2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 16 11:08:19.990435 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.954603    2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 16 11:08:19.990435 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.954606    2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 16 11:08:19.990435 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.954608    2564 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 16 11:08:19.990435 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.954611    2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 16 11:08:19.990435 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.954614    2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 16 11:08:19.990435 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.954617    2564 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 16 11:08:19.990435 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.954619    2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 16 11:08:19.990435 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.954622    2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 16 11:08:19.990435 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.954624    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 16 11:08:19.990435 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.954627    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 16 11:08:19.990435 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.954630    2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 16 11:08:19.990435 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.954632    2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 16 11:08:19.990435 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.954635    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 16 11:08:19.990435 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.954638    2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 16 11:08:19.990435 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.954640    2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 16 11:08:19.990435 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.954646    2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 16 11:08:19.991318 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.954649    2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 16 11:08:19.991318 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.954653    2564 feature_gate.go:328] unrecognized feature gate: Example
Jul 16 11:08:19.991318 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.954656    2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 16 11:08:19.991318 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.954661    2564 feature_gate.go:328] unrecognized feature gate: Example2
Jul 16 11:08:19.991318 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.954664    2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 16 11:08:19.991318 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.954667    2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 16 11:08:19.991318 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.954670    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 16 11:08:19.991318 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.954673    2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 16 11:08:19.991318 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.954675    2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 16 11:08:19.991318 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.954679    2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 16 11:08:19.991318 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.954681    2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 16 11:08:19.991318 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.954684    2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 16 11:08:19.991318 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.954687    2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 16 11:08:19.991318 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.965972    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 16 11:08:19.991318 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.966092    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 16 11:08:19.991318 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.966165    2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 16 11:08:19.991318 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.966169    2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 16 11:08:19.991318 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.966177    2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 16 11:08:19.991318 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.966184    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 16 11:08:19.991318 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.966188    2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 16 11:08:19.992347 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.966192    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 16 11:08:19.992347 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.966196    2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 16 11:08:19.992347 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.966199    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 16 11:08:19.992347 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.966202    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 16 11:08:19.992347 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.966205    2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 16 11:08:19.992347 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.966208    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 16 11:08:19.992347 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.966211    2564 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 16 11:08:19.992347 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.966215    2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 16 11:08:19.992347 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.966217    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 16 11:08:19.992347 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.966220    2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 16 11:08:19.992347 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.966223    2564 feature_gate.go:328] unrecognized feature gate: Example
Jul 16 11:08:19.992347 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.966226    2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 16 11:08:19.992347 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.966230    2564 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 16 11:08:19.992347 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.966233    2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 16 11:08:19.992347 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.966237    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 16 11:08:19.992347 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.966240    2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 16 11:08:19.992347 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.966244    2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 16 11:08:19.992347 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.966247    2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 16 11:08:19.992347 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.966252    2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 16 11:08:19.995629 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.966259    2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 16 11:08:19.995629 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.966262    2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 16 11:08:19.995629 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.966265    2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 16 11:08:19.995629 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.966268    2564 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 16 11:08:19.995629 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.966271    2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 16 11:08:19.995629 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.966276    2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 16 11:08:19.995629 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.966279    2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 16 11:08:19.995629 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.966283    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 16 11:08:19.995629 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.966286    2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 16 11:08:19.995629 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.966289    2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 16 11:08:19.995629 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.966292    2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 16 11:08:19.995629 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.966295    2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 16 11:08:19.995629 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.966298    2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 16 11:08:19.995629 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.966303    2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 16 11:08:19.995629 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.966306    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 16 11:08:19.995629 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.966309    2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 16 11:08:19.995629 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.966312    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 16 11:08:19.995629 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.966315    2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 16 11:08:19.995629 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.966318    2564 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 16 11:08:19.995629 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.966321    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 16 11:08:19.996520 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.966324    2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 16 11:08:19.996520 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.966327    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 16 11:08:19.996520 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.966330    2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 16 11:08:19.996520 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.966332    2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 16 11:08:19.996520 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.966336    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 16 11:08:19.996520 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.966338    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 16 11:08:19.996520 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.966341    2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 16 11:08:19.996520 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.966344    2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 16 11:08:19.996520 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.966349    2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 16 11:08:19.996520 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.966352    2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 16 11:08:19.996520 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.966355    2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 16 11:08:19.996520 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.966359    2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 16 11:08:19.996520 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.966362    2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 16 11:08:19.996520 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.966364    2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 16 11:08:19.996520 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.966369    2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 16 11:08:19.996520 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.966372    2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 16 11:08:19.996520 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.966375    2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 16 11:08:19.996520 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.966378    2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 16 11:08:19.996520 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.966381    2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 16 11:08:19.996520 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.966384    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 16 11:08:19.998785 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.966386    2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 16 11:08:19.998785 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.966389    2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 16 11:08:19.998785 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.966392    2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 16 11:08:19.998785 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.966395    2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 16 11:08:19.998785 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.966398    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 16 11:08:19.998785 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.966401    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 16 11:08:19.998785 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.966403    2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 16 11:08:19.998785 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.966406    2564 feature_gate.go:328] unrecognized feature gate: Example2
Jul 16 11:08:19.998785 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.966411    2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 16 11:08:19.998785 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.966415    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 16 11:08:19.998785 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.966420    2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 16 11:08:19.998785 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.966423    2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 16 11:08:19.998785 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.966427    2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 16 11:08:19.998785 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.966434    2564 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 16 11:08:19.998785 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.966437    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 16 11:08:19.998785 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.966440    2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 16 11:08:19.998785 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.966444    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 16 11:08:19.998785 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.966448    2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 16 11:08:19.998785 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.966451    2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 16 11:08:19.998785 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.966454    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 16 11:08:19.999463 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.966457    2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 16 11:08:19.999463 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.966461    2564 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 16 11:08:19.999463 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.966464    2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 16 11:08:19.999463 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.966467    2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 16 11:08:19.999463 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.966470    2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 16 11:08:19.999463 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.966473    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 16 11:08:19.999463 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.966476    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 16 11:08:19.999463 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.966479    2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 16 11:08:19.999463 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.966482    2564 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 16 11:08:19.999463 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.966484    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 16 11:08:19.999463 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.966488    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 16 11:08:19.999463 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.966491    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 16 11:08:19.999463 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.966494    2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 16 11:08:19.999463 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.967023    2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 16 11:08:19.999463 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.967030    2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 16 11:08:19.999463 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.967033    2564 feature_gate.go:328] unrecognized feature gate: Example
Jul 16 11:08:19.999463 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.967036    2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 16 11:08:19.999463 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.967039    2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 16 11:08:19.999463 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.967042    2564 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 16 11:08:19.999463 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.967045    2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 16 11:08:20.000898 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.967049    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 16 11:08:20.000898 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.967052    2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 16 11:08:20.000898 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.967056    2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 16 11:08:20.000898 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.967060    2564 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 16 11:08:20.000898 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.967064    2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 16 11:08:20.000898 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.967072    2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 16 11:08:20.000898 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.967076    2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 16 11:08:20.000898 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.967079    2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 16 11:08:20.000898 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.967082    2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 16 11:08:20.000898 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.967086    2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 16 11:08:20.000898 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.967089    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 16 11:08:20.000898 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.967091    2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 16 11:08:20.000898 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.967094    2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 16 11:08:20.000898 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.967097    2564 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 16 11:08:20.000898 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.967100    2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 16 11:08:20.000898 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.967103    2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 16 11:08:20.000898 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.967105    2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 16 11:08:20.000898 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.967108    2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 16 11:08:20.000898 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.967113    2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 16 11:08:20.001522 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.967118    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 16 11:08:20.001522 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.967121    2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 16 11:08:20.001522 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.967124    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 16 11:08:20.001522 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.967127    2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 16 11:08:20.001522 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.967130    2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 16 11:08:20.001522 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.967133    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 16 11:08:20.001522 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.967135    2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 16 11:08:20.001522 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.967138    2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 16 11:08:20.001522 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.967141    2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 16 11:08:20.001522 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.967143    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 16 11:08:20.001522 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.967146    2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 16 11:08:20.001522 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.967149    2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 16 11:08:20.001522 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.967152    2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 16 11:08:20.001522 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.967155    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 16 11:08:20.001522 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.967181    2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 16 11:08:20.001522 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.967185    2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 16 11:08:20.001522 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.967189    2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 16 11:08:20.001522 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.967192    2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 16 11:08:20.001522 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.967198    2564 feature_gate.go:328] unrecognized feature gate: Example2
Jul 16 11:08:20.001522 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.967202    2564 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 16 11:08:20.002521 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.967204    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 16 11:08:20.002521 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.967207    2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 16 11:08:20.002521 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.967210    2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 16 11:08:20.002521 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.967213    2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 16 11:08:20.002521 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.967216    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 16 11:08:20.002521 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.967219    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 16 11:08:20.002521 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.967222    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 16 11:08:20.002521 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.967225    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 16 11:08:20.002521 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.967228    2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 16 11:08:20.002521 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.967230    2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 16 11:08:20.002521 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.967233    2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 16 11:08:20.002521 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.967236    2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 16 11:08:20.002521 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.967239    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 16 11:08:20.002521 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.967241    2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 16 11:08:20.002521 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.967244    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 16 11:08:20.002521 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.967247    2564 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 16 11:08:20.002521 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.967250    2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 16 11:08:20.002521 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.967253    2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 16 11:08:20.002521 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.967256    2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 16 11:08:20.002521 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.967259    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 16 11:08:20.003170 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.967262    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 16 11:08:20.003170 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.967265    2564 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 16 11:08:20.003170 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.967268    2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 16 11:08:20.003170 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.967271    2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 16 11:08:20.003170 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.967273    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 16 11:08:20.003170 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.967277    2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 16 11:08:20.003170 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.967279    2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 16 11:08:20.003170 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.967282    2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 16 11:08:20.003170 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.967285    2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 16 11:08:20.003170 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.967287    2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 16 11:08:20.003170 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.967293    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 16 11:08:20.003170 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.967296    2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 16 11:08:20.003170 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.967299    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 16 11:08:20.003170 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.967302    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 16 11:08:20.003170 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.967305    2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 16 11:08:20.003170 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.967308    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 16 11:08:20.003170 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.967311    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 16 11:08:20.003170 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.967314    2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 16 11:08:20.003170 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.967317    2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 16 11:08:20.003170 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.967320    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 16 11:08:20.077455 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.967323    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 16 11:08:20.077455 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.967325    2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 16 11:08:20.077455 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.967328    2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 16 11:08:20.077455 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.967331    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 16 11:08:20.077455 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.967334    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 16 11:08:20.077455 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.967336    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 16 11:08:20.077455 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.967339    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 16 11:08:20.077455 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.967342    2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 16 11:08:20.077455 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.967345    2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 16 11:08:20.077455 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.967348    2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 16 11:08:20.077455 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.967350    2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 16 11:08:20.077455 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.967353    2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 16 11:08:20.077455 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.967356    2564 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 16 11:08:20.077455 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:19.967439    2564 flags.go:64] FLAG: --address="0.0.0.0"
Jul 16 11:08:20.077455 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:19.967447    2564 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 16 11:08:20.077455 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:19.967455    2564 flags.go:64] FLAG: --anonymous-auth="true"
Jul 16 11:08:20.077455 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:19.967460    2564 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 16 11:08:20.077455 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:19.967465    2564 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 16 11:08:20.077455 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:19.967468    2564 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 16 11:08:20.077455 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:19.967472    2564 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 16 11:08:20.077455 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:19.967478    2564 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 16 11:08:20.056098 ip-10-0-135-184 systemd[1]: Started Kubernetes Kubelet.
Jul 16 11:08:20.079139 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:19.967481    2564 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 16 11:08:20.079139 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:19.967488    2564 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 16 11:08:20.079139 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:19.967493    2564 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 16 11:08:20.079139 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:19.967496    2564 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 16 11:08:20.079139 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:19.967500    2564 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 16 11:08:20.079139 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:19.967504    2564 flags.go:64] FLAG: --cgroup-root=""
Jul 16 11:08:20.079139 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:19.967507    2564 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 16 11:08:20.079139 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:19.967510    2564 flags.go:64] FLAG: --client-ca-file=""
Jul 16 11:08:20.079139 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:19.967514    2564 flags.go:64] FLAG: --cloud-provider="external"
Jul 16 11:08:20.079139 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:19.967518    2564 flags.go:64] FLAG: --cluster-dns="[]"
Jul 16 11:08:20.079139 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:19.967522    2564 flags.go:64] FLAG: --cluster-domain=""
Jul 16 11:08:20.079139 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:19.967525    2564 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 16 11:08:20.079139 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:19.967528    2564 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 16 11:08:20.079139 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:19.967532    2564 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 16 11:08:20.079139 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:19.967536    2564 flags.go:64] FLAG: --container-log-max-files="5"
Jul 16 11:08:20.079139 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:19.967540    2564 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 16 11:08:20.079139 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:19.967543    2564 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 16 11:08:20.079139 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:19.967546    2564 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 16 11:08:20.079139 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:19.967550    2564 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 16 11:08:20.079139 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:19.967554    2564 flags.go:64] FLAG: --contention-profiling="false"
Jul 16 11:08:20.079139 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:19.967557    2564 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 16 11:08:20.079139 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:19.967560    2564 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 16 11:08:20.079139 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:19.967564    2564 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 16 11:08:20.079139 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:19.967567    2564 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 16 11:08:20.082200 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:19.967572    2564 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 16 11:08:20.082200 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:19.967576    2564 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 16 11:08:20.082200 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:19.967579    2564 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 16 11:08:20.082200 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:19.967582    2564 flags.go:64] FLAG: --enable-load-reader="false"
Jul 16 11:08:20.082200 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:19.967585    2564 flags.go:64] FLAG: --enable-server="true"
Jul 16 11:08:20.082200 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:19.967589    2564 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 16 11:08:20.082200 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:19.967594    2564 flags.go:64] FLAG: --event-burst="100"
Jul 16 11:08:20.082200 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:19.967598    2564 flags.go:64] FLAG: --event-qps="50"
Jul 16 11:08:20.082200 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:19.967601    2564 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 16 11:08:20.082200 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:19.967606    2564 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 16 11:08:20.082200 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:19.967610    2564 flags.go:64] FLAG: --eviction-hard=""
Jul 16 11:08:20.082200 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:19.967614    2564 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 16 11:08:20.082200 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:19.967617    2564 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 16 11:08:20.082200 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:19.967621    2564 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 16 11:08:20.082200 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:19.967624    2564 flags.go:64] FLAG: --eviction-soft=""
Jul 16 11:08:20.082200 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:19.967627    2564 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 16 11:08:20.082200 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:19.967630    2564 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 16 11:08:20.082200 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:19.967634    2564 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 16 11:08:20.082200 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:19.967638    2564 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 16 11:08:20.082200 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:19.967641    2564 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 16 11:08:20.082200 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:19.967644    2564 flags.go:64] FLAG: --fail-swap-on="true"
Jul 16 11:08:20.082200 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:19.967648    2564 flags.go:64] FLAG: --feature-gates=""
Jul 16 11:08:20.082200 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:19.967652    2564 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 16 11:08:20.082200 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:19.967655    2564 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 16 11:08:20.082200 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:19.967659    2564 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 16 11:08:20.083637 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:19.967663    2564 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 16 11:08:20.083637 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:19.967667    2564 flags.go:64] FLAG: --healthz-port="10248"
Jul 16 11:08:20.083637 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:19.967670    2564 flags.go:64] FLAG: --help="false"
Jul 16 11:08:20.083637 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:19.967673    2564 flags.go:64] FLAG: --hostname-override="ip-10-0-135-184.ec2.internal"
Jul 16 11:08:20.083637 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:19.967677    2564 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 16 11:08:20.083637 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:19.967680    2564 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 16 11:08:20.083637 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:19.967683    2564 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 16 11:08:20.083637 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:19.967686    2564 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 16 11:08:20.083637 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:19.967690    2564 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 16 11:08:20.083637 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:19.967693    2564 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 16 11:08:20.083637 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:19.967696    2564 flags.go:64] FLAG: --image-service-endpoint=""
Jul 16 11:08:20.083637 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:19.967700    2564 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 16 11:08:20.083637 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:19.967703    2564 flags.go:64] FLAG: --kube-api-burst="100"
Jul 16 11:08:20.083637 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:19.967706    2564 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 16 11:08:20.083637 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:19.967709    2564 flags.go:64] FLAG: --kube-api-qps="50"
Jul 16 11:08:20.083637 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:19.967712    2564 flags.go:64] FLAG: --kube-reserved=""
Jul 16 11:08:20.083637 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:19.967719    2564 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 16 11:08:20.083637 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:19.967723    2564 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 16 11:08:20.083637 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:19.967726    2564 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 16 11:08:20.083637 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:19.967729    2564 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 16 11:08:20.083637 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:19.967732    2564 flags.go:64] FLAG: --lock-file=""
Jul 16 11:08:20.083637 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:19.967735    2564 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 16 11:08:20.083637 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:19.967739    2564 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 16 11:08:20.083637 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:19.967742    2564 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 16 11:08:20.086423 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:19.967749    2564 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 16 11:08:20.086423 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:19.967752    2564 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 16 11:08:20.086423 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:19.967756    2564 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 16 11:08:20.086423 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:19.967759    2564 flags.go:64] FLAG: --logging-format="text"
Jul 16 11:08:20.086423 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:19.967763    2564 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 16 11:08:20.086423 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:19.967766    2564 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 16 11:08:20.086423 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:19.967770    2564 flags.go:64] FLAG: --manifest-url=""
Jul 16 11:08:20.086423 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:19.967773    2564 flags.go:64] FLAG: --manifest-url-header=""
Jul 16 11:08:20.086423 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:19.967778    2564 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 16 11:08:20.086423 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:19.967781    2564 flags.go:64] FLAG: --max-open-files="1000000"
Jul 16 11:08:20.086423 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:19.967786    2564 flags.go:64] FLAG: --max-pods="110"
Jul 16 11:08:20.086423 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:19.967789    2564 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 16 11:08:20.086423 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:19.967792    2564 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 16 11:08:20.086423 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:19.967795    2564 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 16 11:08:20.086423 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:19.967798    2564 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 16 11:08:20.086423 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:19.967802    2564 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 16 11:08:20.086423 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:19.967805    2564 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 16 11:08:20.086423 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:19.967808    2564 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 16 11:08:20.086423 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:19.967816    2564 flags.go:64] FLAG: --node-status-max-images="50"
Jul 16 11:08:20.086423 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:19.967820    2564 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 16 11:08:20.086423 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:19.967823    2564 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 16 11:08:20.086423 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:19.967826    2564 flags.go:64] FLAG: --pod-cidr=""
Jul 16 11:08:20.086423 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:19.967829    2564 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b04c0b1f73af4d021dd8f0b51bfeb302c24482c093de5f2c43654ab56c506926"
Jul 16 11:08:20.087843 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:19.967836    2564 flags.go:64] FLAG: --pod-manifest-path=""
Jul 16 11:08:20.087843 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:19.967841    2564 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 16 11:08:20.087843 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:19.967861    2564 flags.go:64] FLAG: --pods-per-core="0"
Jul 16 11:08:20.087843 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:19.967865    2564 flags.go:64] FLAG: --port="10250"
Jul 16 11:08:20.087843 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:19.967868    2564 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 16 11:08:20.087843 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:19.967871    2564 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0c62996c1bb28dfb1"
Jul 16 11:08:20.087843 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:19.967875    2564 flags.go:64] FLAG: --qos-reserved=""
Jul 16 11:08:20.087843 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:19.967878    2564 flags.go:64] FLAG: --read-only-port="10255"
Jul 16 11:08:20.087843 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:19.967882    2564 flags.go:64] FLAG: --register-node="true"
Jul 16 11:08:20.087843 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:19.967885    2564 flags.go:64] FLAG: --register-with-taints=""
Jul 16 11:08:20.087843 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:19.967889    2564 flags.go:64] FLAG: --registry-burst="10"
Jul 16 11:08:20.087843 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:19.967893    2564 flags.go:64] FLAG: --registry-qps="5"
Jul 16 11:08:20.087843 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:19.967896    2564 flags.go:64] FLAG: --reserved-cpus=""
Jul 16 11:08:20.087843 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:19.967899    2564 flags.go:64] FLAG: --reserved-memory=""
Jul 16 11:08:20.087843 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:19.967904    2564 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 16 11:08:20.087843 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:19.967907    2564 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 16 11:08:20.087843 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:19.967910    2564 flags.go:64] FLAG: --rotate-certificates="false"
Jul 16 11:08:20.087843 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:19.967914    2564 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 16 11:08:20.087843 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:19.967917    2564 flags.go:64] FLAG: --runonce="false"
Jul 16 11:08:20.087843 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:19.967920    2564 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 16 11:08:20.087843 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:19.967924    2564 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 16 11:08:20.087843 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:19.967927    2564 flags.go:64] FLAG: --seccomp-default="false"
Jul 16 11:08:20.087843 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:19.967930    2564 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 16 11:08:20.087843 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:19.967933    2564 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 16 11:08:20.087843 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:19.967936    2564 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 16 11:08:20.087843 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:19.967940    2564 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 16 11:08:20.091404 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:19.967943    2564 flags.go:64] FLAG: --storage-driver-password="root"
Jul 16 11:08:20.091404 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:19.967946    2564 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 16 11:08:20.091404 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:19.967950    2564 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 16 11:08:20.091404 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:19.967953    2564 flags.go:64] FLAG: --storage-driver-user="root"
Jul 16 11:08:20.091404 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:19.967956    2564 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 16 11:08:20.091404 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:19.967959    2564 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 16 11:08:20.091404 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:19.967963    2564 flags.go:64] FLAG: --system-cgroups=""
Jul 16 11:08:20.091404 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:19.967967    2564 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 16 11:08:20.091404 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:19.967975    2564 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 16 11:08:20.091404 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:19.967978    2564 flags.go:64] FLAG: --tls-cert-file=""
Jul 16 11:08:20.091404 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:19.967981    2564 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 16 11:08:20.091404 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:19.967986    2564 flags.go:64] FLAG: --tls-min-version=""
Jul 16 11:08:20.091404 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:19.967989    2564 flags.go:64] FLAG: --tls-private-key-file=""
Jul 16 11:08:20.091404 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:19.967992    2564 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 16 11:08:20.091404 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:19.967995    2564 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 16 11:08:20.091404 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:19.967998    2564 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 16 11:08:20.091404 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:19.968001    2564 flags.go:64] FLAG: --v="2"
Jul 16 11:08:20.091404 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:19.968006    2564 flags.go:64] FLAG: --version="false"
Jul 16 11:08:20.091404 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:19.968011    2564 flags.go:64] FLAG: --vmodule=""
Jul 16 11:08:20.091404 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:19.968015    2564 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 16 11:08:20.091404 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:19.968018    2564 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 16 11:08:20.091404 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.968184    2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 16 11:08:20.091404 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.968189    2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 16 11:08:20.091404 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.968192    2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 16 11:08:20.092593 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.968195    2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 16 11:08:20.092593 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.968198    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 16 11:08:20.092593 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.968201    2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 16 11:08:20.092593 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.968205    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 16 11:08:20.092593 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.968208    2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 16 11:08:20.092593 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.968211    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 16 11:08:20.092593 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.968214    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 16 11:08:20.092593 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.968216    2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 16 11:08:20.092593 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.968219    2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 16 11:08:20.092593 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.968222    2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 16 11:08:20.092593 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.968224    2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 16 11:08:20.092593 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.968227    2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 16 11:08:20.092593 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.968232    2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 16 11:08:20.092593 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.968236    2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 16 11:08:20.092593 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.968239    2564 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 16 11:08:20.092593 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.968244    2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 16 11:08:20.092593 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.968248    2564 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 16 11:08:20.092593 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.968251    2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 16 11:08:20.092593 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.968254    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 16 11:08:20.092593 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.968257    2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 16 11:08:20.096624 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.968260    2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 16 11:08:20.096624 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.968263    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 16 11:08:20.096624 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.968266    2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 16 11:08:20.096624 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.968269    2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 16 11:08:20.096624 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.968271    2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 16 11:08:20.096624 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.968274    2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 16 11:08:20.096624 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.968278    2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 16 11:08:20.096624 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.968282    2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 16 11:08:20.096624 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.968286    2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 16 11:08:20.096624 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.968289    2564 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 16 11:08:20.096624 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.968291    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 16 11:08:20.096624 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.968294    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 16 11:08:20.096624 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.968297    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 16 11:08:20.096624 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.968299    2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 16 11:08:20.096624 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.968303    2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 16 11:08:20.096624 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.968306    2564 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 16 11:08:20.096624 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.968308    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 16 11:08:20.096624 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.968311    2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 16 11:08:20.096624 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.968314    2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 16 11:08:20.097593 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.968317    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 16 11:08:20.097593 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.968319    2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 16 11:08:20.097593 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.968324    2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 16 11:08:20.097593 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.968327    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 16 11:08:20.097593 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.968330    2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 16 11:08:20.097593 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.968333    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 16 11:08:20.097593 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.968337    2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 16 11:08:20.097593 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.968339    2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 16 11:08:20.097593 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.968347    2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 16 11:08:20.097593 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.968352    2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 16 11:08:20.097593 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.968354    2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 16 11:08:20.097593 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.968358    2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 16 11:08:20.097593 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.968361    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 16 11:08:20.097593 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.968364    2564 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 16 11:08:20.097593 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.968366    2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 16 11:08:20.097593 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.968369    2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 16 11:08:20.097593 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.968372    2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 16 11:08:20.097593 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.968375    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 16 11:08:20.097593 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.968378    2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 16 11:08:20.098554 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.968380    2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 16 11:08:20.098554 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.968383    2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 16 11:08:20.098554 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.968387    2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 16 11:08:20.098554 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.968390    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 16 11:08:20.098554 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.968393    2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 16 11:08:20.098554 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.968396    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 16 11:08:20.098554 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.968399    2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 16 11:08:20.098554 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.968402    2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 16 11:08:20.098554 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.968405    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 16 11:08:20.098554 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.968408    2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 16 11:08:20.098554 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.968411    2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 16 11:08:20.098554 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.968414    2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 16 11:08:20.098554 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.968416    2564 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 16 11:08:20.098554 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.968419    2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 16 11:08:20.098554 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.968422    2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 16 11:08:20.098554 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.968425    2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 16 11:08:20.098554 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.968428    2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 16 11:08:20.098554 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.968430    2564 feature_gate.go:328] unrecognized feature gate: Example2
Jul 16 11:08:20.098554 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.968433    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 16 11:08:20.098554 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.968436    2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 16 11:08:20.102075 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.968439    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 16 11:08:20.102075 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.968443    2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 16 11:08:20.102075 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.968448    2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 16 11:08:20.102075 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.968451    2564 feature_gate.go:328] unrecognized feature gate: Example
Jul 16 11:08:20.102075 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.968454    2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 16 11:08:20.102075 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.968457    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 16 11:08:20.102075 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.968460    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 16 11:08:20.102075 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.968463    2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 16 11:08:20.102075 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.968466    2564 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 16 11:08:20.102075 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.968469    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 16 11:08:20.102075 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.968471    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 16 11:08:20.102075 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.968474    2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 16 11:08:20.102075 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.968477    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 16 11:08:20.102075 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.968480    2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 16 11:08:20.102075 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.968483    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 16 11:08:20.102075 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.968487    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 16 11:08:20.102075 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.968490    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 16 11:08:20.102075 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.968493    2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 16 11:08:20.103032 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:19.969204    2564 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 16 11:08:20.103032 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:19.976995    2564 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 16 11:08:20.103032 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:19.977021    2564 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 16 11:08:20.103032 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:19.977044    2564 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 16 11:08:20.103032 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:19.977054    2564 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 16 11:08:20.103032 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.977120    2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 16 11:08:20.103032 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.977126    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 16 11:08:20.103032 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.977130    2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 16 11:08:20.103032 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.977133    2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 16 11:08:20.103032 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.977137    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 16 11:08:20.103032 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.977141    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 16 11:08:20.103032 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.977145    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 16 11:08:20.103032 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.977148    2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 16 11:08:20.103032 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.977152    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 16 11:08:20.103032 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.977155    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 16 11:08:20.104200 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.977158    2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 16 11:08:20.104200 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.977161    2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 16 11:08:20.104200 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.977164    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 16 11:08:20.104200 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.977167    2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 16 11:08:20.104200 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.977169    2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 16 11:08:20.104200 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.977173    2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 16 11:08:20.104200 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.977176    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 16 11:08:20.104200 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.977179    2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 16 11:08:20.104200 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.977181    2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 16 11:08:20.104200 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.977184    2564 feature_gate.go:328] unrecognized feature gate: Example
Jul 16 11:08:20.104200 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.977187    2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 16 11:08:20.104200 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.977192    2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 16 11:08:20.104200 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.977196    2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 16 11:08:20.104200 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.977200    2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 16 11:08:20.104200 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.977203    2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 16 11:08:20.104200 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.977206    2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 16 11:08:20.104200 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.977210    2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 16 11:08:20.104200 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.977213    2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 16 11:08:20.104200 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.977216    2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 16 11:08:20.104200 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.977220    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 16 11:08:20.106305 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.977223    2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 16 11:08:20.106305 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.977226    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 16 11:08:20.106305 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.977230    2564 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 16 11:08:20.106305 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.977233    2564 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 16 11:08:20.106305 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.977236    2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 16 11:08:20.106305 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.977239    2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 16 11:08:20.106305 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.977242    2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 16 11:08:20.106305 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.977245    2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 16 11:08:20.106305 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.977248    2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 16 11:08:20.106305 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.977251    2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 16 11:08:20.106305 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.977254    2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 16 11:08:20.106305 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.977257    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 16 11:08:20.106305 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.977259    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 16 11:08:20.106305 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.977262    2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 16 11:08:20.106305 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.977265    2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 16 11:08:20.106305 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.977268    2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 16 11:08:20.106305 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.977271    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 16 11:08:20.106305 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.977274    2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 16 11:08:20.106305 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.977277    2564 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 16 11:08:20.106305 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.977280    2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 16 11:08:20.107245 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.977283    2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 16 11:08:20.107245 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.977288    2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 16 11:08:20.107245 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.977291    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 16 11:08:20.107245 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.977294    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 16 11:08:20.107245 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.977297    2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 16 11:08:20.107245 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.977300    2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 16 11:08:20.107245 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.977303    2564 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 16 11:08:20.107245 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.977306    2564 feature_gate.go:328] unrecognized feature gate: Example2
Jul 16 11:08:20.107245 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.977309    2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 16 11:08:20.107245 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.977312    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 16 11:08:20.107245 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.977315    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 16 11:08:20.107245 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.977317    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 16 11:08:20.107245 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.977323    2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 16 11:08:20.107245 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.977327    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 16 11:08:20.107245 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.977331    2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 16 11:08:20.107245 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.977334    2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 16 11:08:20.107245 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.977336    2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 16 11:08:20.107245 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.977339    2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 16 11:08:20.107245 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.977342    2564 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 16 11:08:20.188627 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.977349    2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 16 11:08:20.188627 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.977352    2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 16 11:08:20.188627 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.977355    2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 16 11:08:20.188627 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.977358    2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 16 11:08:20.188627 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.977360    2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 16 11:08:20.188627 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.977363    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 16 11:08:20.188627 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.977366    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 16 11:08:20.188627 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.977369    2564 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 16 11:08:20.188627 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.977372    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 16 11:08:20.188627 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.977375    2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 16 11:08:20.188627 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.977378    2564 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 16 11:08:20.188627 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.977382    2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 16 11:08:20.188627 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.977385    2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 16 11:08:20.188627 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.977388    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 16 11:08:20.188627 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.977390    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 16 11:08:20.188627 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.977393    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 16 11:08:20.188627 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.977397    2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 16 11:08:20.188627 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.977399    2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 16 11:08:20.188627 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.977402    2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 16 11:08:20.188627 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.977405    2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 16 11:08:20.189904 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.977408    2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 16 11:08:20.189904 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.977411    2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 16 11:08:20.189904 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.977414    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 16 11:08:20.189904 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.977417    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 16 11:08:20.189904 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.977420    2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 16 11:08:20.189904 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.977423    2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 16 11:08:20.189904 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.977426    2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 16 11:08:20.189904 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.977429    2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 16 11:08:20.189904 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.977432    2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 16 11:08:20.189904 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.977435    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 16 11:08:20.189904 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:19.977440    2564 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 16 11:08:20.189904 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.977574    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 16 11:08:20.189904 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.977580    2564 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 16 11:08:20.189904 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.977584    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 16 11:08:20.189904 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.977587    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 16 11:08:20.192950 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.977589    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 16 11:08:20.192950 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.977592    2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 16 11:08:20.192950 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.977595    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 16 11:08:20.192950 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.977598    2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 16 11:08:20.192950 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.977601    2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 16 11:08:20.192950 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.977604    2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 16 11:08:20.192950 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.977606    2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 16 11:08:20.192950 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.977609    2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 16 11:08:20.192950 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.977613    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 16 11:08:20.192950 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.977619    2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 16 11:08:20.192950 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.977622    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 16 11:08:20.192950 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.977625    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 16 11:08:20.192950 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.977628    2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 16 11:08:20.192950 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.977631    2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 16 11:08:20.192950 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.977633    2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 16 11:08:20.192950 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.977636    2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 16 11:08:20.192950 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.977639    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 16 11:08:20.192950 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.977641    2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 16 11:08:20.192950 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.977644    2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 16 11:08:20.193897 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.977647    2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 16 11:08:20.193897 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.977650    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 16 11:08:20.193897 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.977652    2564 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 16 11:08:20.193897 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.977655    2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 16 11:08:20.193897 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.977658    2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 16 11:08:20.193897 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.977662    2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 16 11:08:20.193897 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.977664    2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 16 11:08:20.193897 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.977667    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 16 11:08:20.193897 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.977670    2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 16 11:08:20.193897 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.977672    2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 16 11:08:20.193897 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.977676    2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 16 11:08:20.193897 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.977679    2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 16 11:08:20.193897 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.977682    2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 16 11:08:20.193897 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.977685    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 16 11:08:20.193897 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.977688    2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 16 11:08:20.193897 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.977691    2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 16 11:08:20.193897 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.977693    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 16 11:08:20.193897 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.977696    2564 feature_gate.go:328] unrecognized feature gate: Example2
Jul 16 11:08:20.193897 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.977699    2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 16 11:08:20.193897 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.977702    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 16 11:08:20.295556 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.977704    2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 16 11:08:20.295556 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.977707    2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 16 11:08:20.295556 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.977711    2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 16 11:08:20.295556 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.977714    2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 16 11:08:20.295556 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.977717    2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 16 11:08:20.295556 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.977720    2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 16 11:08:20.295556 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.977722    2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 16 11:08:20.295556 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.977725    2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 16 11:08:20.295556 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.977728    2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 16 11:08:20.295556 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.977731    2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 16 11:08:20.295556 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.977734    2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 16 11:08:20.295556 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.977736    2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 16 11:08:20.295556 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.977739    2564 feature_gate.go:328] unrecognized feature gate: Example
Jul 16 11:08:20.295556 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.977742    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 16 11:08:20.295556 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.977744    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 16 11:08:20.295556 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.977747    2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 16 11:08:20.295556 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.977750    2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 16 11:08:20.295556 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.977753    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 16 11:08:20.295556 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.977756    2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 16 11:08:20.295556 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.977759    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 16 11:08:20.297301 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.977763    2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 16 11:08:20.297301 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.977767    2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 16 11:08:20.297301 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.977773    2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 16 11:08:20.297301 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.977775    2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 16 11:08:20.297301 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.977778    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 16 11:08:20.297301 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.977781    2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 16 11:08:20.297301 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.977783    2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 16 11:08:20.297301 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.977786    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 16 11:08:20.297301 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.977789    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 16 11:08:20.297301 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.977796    2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 16 11:08:20.297301 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.977799    2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 16 11:08:20.297301 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.977802    2564 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 16 11:08:20.297301 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.977805    2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 16 11:08:20.297301 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.977808    2564 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 16 11:08:20.297301 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.977812    2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 16 11:08:20.297301 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.977815    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 16 11:08:20.297301 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.977819    2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 16 11:08:20.297301 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.977822    2564 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 16 11:08:20.297301 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.977825    2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 16 11:08:20.298227 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.977827    2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 16 11:08:20.298227 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.977830    2564 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 16 11:08:20.298227 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.977833    2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 16 11:08:20.298227 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.977835    2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 16 11:08:20.298227 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.977838    2564 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 16 11:08:20.298227 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.977840    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 16 11:08:20.298227 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.977858    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 16 11:08:20.298227 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.977865    2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 16 11:08:20.298227 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.977869    2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 16 11:08:20.298227 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.977872    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 16 11:08:20.298227 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.977875    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 16 11:08:20.298227 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.977878    2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 16 11:08:20.298227 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.977882    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 16 11:08:20.298227 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.977886    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 16 11:08:20.298227 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.977888    2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 16 11:08:20.298227 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.977892    2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 16 11:08:20.298227 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:19.977895    2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 16 11:08:20.300262 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:19.977901    2564 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 16 11:08:20.300262 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:19.978086    2564 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 16 11:08:20.300262 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:19.980315    2564 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 16 11:08:20.300262 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:19.981732    2564 server.go:1019] "Starting client certificate rotation"
Jul 16 11:08:20.300262 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:19.981845    2564 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 16 11:08:20.300262 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:19.981892    2564 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 16 11:08:20.300262 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:19.984432    2564 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 16 11:08:20.300262 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:19.986204    2564 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 16 11:08:20.300262 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:20.007588    2564 log.go:25] "Validated CRI v1 runtime API"
Jul 16 11:08:20.300262 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:20.009905    2564 log.go:25] "Validated CRI v1 image API"
Jul 16 11:08:20.300262 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:20.027499    2564 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 16 11:08:20.300262 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:20.030092    2564 fs.go:135] Filesystem UUIDs: map[37cd61af-3901-4f88-93a0-c69d810cbfee:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 cb0761ab-303e-423b-9b75-5bbe0b926292:/dev/nvme0n1p4]
Jul 16 11:08:20.301148 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:20.030111    2564 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 16 11:08:20.301617 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:20.035054    2564 manager.go:216] Machine: {Timestamp:2026-07-16 11:08:20.034443276 +0000 UTC m=+0.405980306 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099553 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2ebcf8d3ddeebb1141f5b2fc4027d0 SystemUUID:ec2ebcf8-d3dd-eebb-1141-f5b2fc4027d0 BootID:46ea5b52-5343-4b40-818b-e94207130d0d Filesystems:[{Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:b7:f0:8a:57:39 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:b7:f0:8a:57:39 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:ce:33:9e:31:fb:e6 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 16 11:08:20.301617 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:20.035181    2564 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 16 11:08:20.301617 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:20.035280    2564 manager.go:232] Version: {KernelVersion:5.14.0-570.126.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260702-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 16 11:08:20.301617 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:20.036620    2564 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 16 11:08:20.301617 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:20.036659    2564 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-135-184.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 16 11:08:20.301617 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:20.038015    2564 topology_manager.go:138] "Creating topology manager with none policy"
Jul 16 11:08:20.301617 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:20.038031    2564 container_manager_linux.go:309] "Creating device plugin manager"
Jul 16 11:08:20.301617 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:20.038042    2564 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 16 11:08:20.302089 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:20.038879    2564 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 16 11:08:20.302089 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:20.040214    2564 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 16 11:08:20.302089 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:20.043277    2564 state_mem.go:36] "Initialized new in-memory state store"
Jul 16 11:08:20.302089 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:20.043421    2564 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 16 11:08:20.302089 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:20.044100    2564 kubelet.go:486] "Attempting to sync node with API server"
Jul 16 11:08:20.302089 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:20.044113    2564 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 16 11:08:20.302089 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:20.044132    2564 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 16 11:08:20.302089 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:20.044143    2564 kubelet.go:398] "Adding apiserver pod source"
Jul 16 11:08:20.302089 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:20.044153    2564 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 16 11:08:20.302089 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:20.044563    2564 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 16 11:08:20.302089 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:20.044580    2564 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 16 11:08:20.302089 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:20.047147    2564 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 16 11:08:20.302089 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:20.049157    2564 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 16 11:08:20.302089 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:20.049199    2564 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 16 11:08:20.302089 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:20.049978    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 16 11:08:20.302089 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:20.050000    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 16 11:08:20.302089 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:20.050011    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 16 11:08:20.302089 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:20.050021    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 16 11:08:20.302089 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:20.050035    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 16 11:08:20.302089 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:20.050044    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 16 11:08:20.302089 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:20.050057    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 16 11:08:20.302089 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:20.050065    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 16 11:08:20.302089 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:20.050076    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 16 11:08:20.302089 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:20.050087    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 16 11:08:20.302089 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:20.050101    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 16 11:08:20.302089 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:20.050111    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 16 11:08:20.302089 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:20.050144    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 16 11:08:20.302089 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:20.050153    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 16 11:08:20.302089 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:20.054933    2564 server.go:1268] "Started kubelet"
Jul 16 11:08:20.302089 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:20.055002    2564 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 16 11:08:20.302089 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:20.055206    2564 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 16 11:08:20.302089 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:20.055600    2564 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 16 11:08:20.302089 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:20.056120    2564 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-135-184.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 16 11:08:20.302089 ip-10-0-135-184 kubenswrapper[2564]: E0716 11:08:20.056250    2564 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 16 11:08:20.302089 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:20.060191    2564 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 16 11:08:20.302089 ip-10-0-135-184 kubenswrapper[2564]: E0716 11:08:20.060600    2564 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-135-184.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 16 11:08:20.302089 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:20.061621    2564 server.go:310] "Adding debug handlers to kubelet server"
Jul 16 11:08:20.302089 ip-10-0-135-184 kubenswrapper[2564]: E0716 11:08:20.063599    2564 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 16 11:08:20.303698 ip-10-0-135-184 kubenswrapper[2564]: E0716 11:08:20.064728    2564 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-135-184.ec2.internal.18c2c089b3fcf654  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-135-184.ec2.internal,UID:ip-10-0-135-184.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-135-184.ec2.internal,},FirstTimestamp:2026-07-16 11:08:20.054890068 +0000 UTC m=+0.426427117,LastTimestamp:2026-07-16 11:08:20.054890068 +0000 UTC m=+0.426427117,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-135-184.ec2.internal,}"
Jul 16 11:08:20.303698 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:20.067339    2564 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 16 11:08:20.303698 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:20.067346    2564 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 16 11:08:20.303698 ip-10-0-135-184 kubenswrapper[2564]: E0716 11:08:20.067432    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-184.ec2.internal\" not found"
Jul 16 11:08:20.303698 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:20.067920    2564 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 16 11:08:20.303698 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:20.067921    2564 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 16 11:08:20.303698 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:20.067950    2564 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 16 11:08:20.303698 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:20.068108    2564 reconstruct.go:97] "Volume reconstruction finished"
Jul 16 11:08:20.303698 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:20.068120    2564 reconciler.go:29] "Reconciler: start to sync state"
Jul 16 11:08:20.303698 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:20.068425    2564 factory.go:55] Registering systemd factory
Jul 16 11:08:20.303698 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:20.068443    2564 factory.go:223] Registration of the systemd container factory successfully
Jul 16 11:08:20.303698 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:20.068780    2564 factory.go:153] Registering CRI-O factory
Jul 16 11:08:20.303698 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:20.068792    2564 factory.go:223] Registration of the crio container factory successfully
Jul 16 11:08:20.303698 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:20.068867    2564 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 16 11:08:20.303698 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:20.068889    2564 factory.go:103] Registering Raw factory
Jul 16 11:08:20.303698 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:20.068902    2564 manager.go:1196] Started watching for new ooms in manager
Jul 16 11:08:20.303698 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:20.069397    2564 manager.go:349] Starting recovery of all containers
Jul 16 11:08:20.303698 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:20.081183    2564 manager.go:354] Recovery completed
Jul 16 11:08:20.303698 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:20.086506    2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 16 11:08:20.303698 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:20.088823    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-184.ec2.internal" event="NodeHasSufficientMemory"
Jul 16 11:08:20.303698 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:20.088883    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-184.ec2.internal" event="NodeHasNoDiskPressure"
Jul 16 11:08:20.303698 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:20.088899    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-184.ec2.internal" event="NodeHasSufficientPID"
Jul 16 11:08:20.303698 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:20.089423    2564 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 16 11:08:20.303698 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:20.089439    2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 16 11:08:20.303698 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:20.089437    2564 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 16 11:08:20.303698 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:20.089475    2564 state_mem.go:36] "Initialized new in-memory state store"
Jul 16 11:08:20.303698 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:20.090396    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-184.ec2.internal" event="NodeHasSufficientMemory"
Jul 16 11:08:20.303698 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:20.090428    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-184.ec2.internal" event="NodeHasNoDiskPressure"
Jul 16 11:08:20.303698 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:20.090461    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-184.ec2.internal" event="NodeHasSufficientPID"
Jul 16 11:08:20.303698 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:20.091025    2564 policy_none.go:49] "None policy: Start"
Jul 16 11:08:20.303698 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:20.091042    2564 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 16 11:08:20.303698 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:20.091055    2564 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 16 11:08:20.303698 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:20.092336    2564 policy_none.go:47] "Start"
Jul 16 11:08:20.303698 ip-10-0-135-184 kubenswrapper[2564]: E0716 11:08:20.130957    2564 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-135-184.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 16 11:08:20.305546 ip-10-0-135-184 kubenswrapper[2564]: E0716 11:08:20.130957    2564 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 16 11:08:20.305546 ip-10-0-135-184 kubenswrapper[2564]: E0716 11:08:20.131169    2564 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-135-184.ec2.internal.18c2c089b603671c  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-135-184.ec2.internal,UID:ip-10-0-135-184.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-135-184.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-135-184.ec2.internal,},FirstTimestamp:2026-07-16 11:08:20.088866588 +0000 UTC m=+0.460403618,LastTimestamp:2026-07-16 11:08:20.088866588 +0000 UTC m=+0.460403618,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-135-184.ec2.internal,}"
Jul 16 11:08:20.305546 ip-10-0-135-184 kubenswrapper[2564]: E0716 11:08:20.133119    2564 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-135-184.ec2.internal.18c2c089b603c547  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-135-184.ec2.internal,UID:ip-10-0-135-184.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-135-184.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-135-184.ec2.internal,},FirstTimestamp:2026-07-16 11:08:20.088890695 +0000 UTC m=+0.460427944,LastTimestamp:2026-07-16 11:08:20.088890695 +0000 UTC m=+0.460427944,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-135-184.ec2.internal,}"
Jul 16 11:08:20.305546 ip-10-0-135-184 kubenswrapper[2564]: E0716 11:08:20.157915    2564 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-135-184.ec2.internal.18c2c089b603fa5b  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-135-184.ec2.internal,UID:ip-10-0-135-184.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-135-184.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-135-184.ec2.internal,},FirstTimestamp:2026-07-16 11:08:20.088904283 +0000 UTC m=+0.460441313,LastTimestamp:2026-07-16 11:08:20.088904283 +0000 UTC m=+0.460441313,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-135-184.ec2.internal,}"
Jul 16 11:08:20.305546 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:20.163526    2564 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 16 11:08:20.305546 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:20.163610    2564 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-5rmtj"
Jul 16 11:08:20.305546 ip-10-0-135-184 kubenswrapper[2564]: E0716 11:08:20.167561    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-184.ec2.internal\" not found"
Jul 16 11:08:20.305546 ip-10-0-135-184 kubenswrapper[2564]: E0716 11:08:20.172109    2564 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-135-184.ec2.internal.18c2c089b603671c\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-135-184.ec2.internal.18c2c089b603671c  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-135-184.ec2.internal,UID:ip-10-0-135-184.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-135-184.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-135-184.ec2.internal,},FirstTimestamp:2026-07-16 11:08:20.088866588 +0000 UTC m=+0.460403618,LastTimestamp:2026-07-16 11:08:20.090411456 +0000 UTC m=+0.461948492,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-135-184.ec2.internal,}"
Jul 16 11:08:20.305998 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:20.179661    2564 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-5rmtj"
Jul 16 11:08:20.305998 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:20.213841    2564 manager.go:337] "Starting Device Plugin manager"
Jul 16 11:08:20.305998 ip-10-0-135-184 kubenswrapper[2564]: E0716 11:08:20.213894    2564 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 16 11:08:20.305998 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:20.213906    2564 server.go:87] "Starting device plugin registration server"
Jul 16 11:08:20.305998 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:20.214181    2564 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 16 11:08:20.305998 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:20.214193    2564 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 16 11:08:20.305998 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:20.214303    2564 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 16 11:08:20.305998 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:20.214408    2564 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 16 11:08:20.305998 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:20.214419    2564 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 16 11:08:20.305998 ip-10-0-135-184 kubenswrapper[2564]: E0716 11:08:20.215079    2564 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 16 11:08:20.305998 ip-10-0-135-184 kubenswrapper[2564]: E0716 11:08:20.215143    2564 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-135-184.ec2.internal\" not found"
Jul 16 11:08:20.305998 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:20.293333    2564 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 16 11:08:20.305998 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:20.294755    2564 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 16 11:08:20.305998 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:20.294790    2564 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 16 11:08:20.305998 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:20.294815    2564 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 16 11:08:20.305998 ip-10-0-135-184 kubenswrapper[2564]: E0716 11:08:20.294871    2564 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 16 11:08:20.305998 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:20.297878    2564 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 16 11:08:20.314424 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:20.314397    2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 16 11:08:20.316116 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:20.316089    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-184.ec2.internal" event="NodeHasSufficientMemory"
Jul 16 11:08:20.316244 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:20.316134    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-184.ec2.internal" event="NodeHasNoDiskPressure"
Jul 16 11:08:20.316244 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:20.316148    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-184.ec2.internal" event="NodeHasSufficientPID"
Jul 16 11:08:20.316244 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:20.316174    2564 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-135-184.ec2.internal"
Jul 16 11:08:20.324907 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:20.324881    2564 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-135-184.ec2.internal"
Jul 16 11:08:20.324907 ip-10-0-135-184 kubenswrapper[2564]: E0716 11:08:20.324913    2564 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-135-184.ec2.internal\": node \"ip-10-0-135-184.ec2.internal\" not found"
Jul 16 11:08:20.350295 ip-10-0-135-184 kubenswrapper[2564]: E0716 11:08:20.350262    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-184.ec2.internal\" not found"
Jul 16 11:08:20.396170 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:20.396134    2564 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-184.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-135-184.ec2.internal"]
Jul 16 11:08:20.396257 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:20.396226    2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 16 11:08:20.398103 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:20.398078    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-184.ec2.internal" event="NodeHasSufficientMemory"
Jul 16 11:08:20.398250 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:20.398119    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-184.ec2.internal" event="NodeHasNoDiskPressure"
Jul 16 11:08:20.398250 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:20.398131    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-184.ec2.internal" event="NodeHasSufficientPID"
Jul 16 11:08:20.399808 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:20.399793    2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 16 11:08:20.399920 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:20.399903    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-184.ec2.internal"
Jul 16 11:08:20.399968 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:20.399959    2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 16 11:08:20.400783 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:20.400765    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-184.ec2.internal" event="NodeHasSufficientMemory"
Jul 16 11:08:20.400864 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:20.400771    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-184.ec2.internal" event="NodeHasSufficientMemory"
Jul 16 11:08:20.400864 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:20.400809    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-184.ec2.internal" event="NodeHasNoDiskPressure"
Jul 16 11:08:20.400864 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:20.400822    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-184.ec2.internal" event="NodeHasSufficientPID"
Jul 16 11:08:20.400864 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:20.400825    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-184.ec2.internal" event="NodeHasNoDiskPressure"
Jul 16 11:08:20.400864 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:20.400837    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-184.ec2.internal" event="NodeHasSufficientPID"
Jul 16 11:08:20.402242 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:20.402227    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-184.ec2.internal"
Jul 16 11:08:20.402289 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:20.402257    2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 16 11:08:20.403170 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:20.403151    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-184.ec2.internal" event="NodeHasSufficientMemory"
Jul 16 11:08:20.403248 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:20.403180    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-184.ec2.internal" event="NodeHasNoDiskPressure"
Jul 16 11:08:20.403248 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:20.403192    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-184.ec2.internal" event="NodeHasSufficientPID"
Jul 16 11:08:20.431073 ip-10-0-135-184 kubenswrapper[2564]: E0716 11:08:20.431046    2564 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-135-184.ec2.internal\" not found" node="ip-10-0-135-184.ec2.internal"
Jul 16 11:08:20.436184 ip-10-0-135-184 kubenswrapper[2564]: E0716 11:08:20.436158    2564 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-135-184.ec2.internal\" not found" node="ip-10-0-135-184.ec2.internal"
Jul 16 11:08:20.450827 ip-10-0-135-184 kubenswrapper[2564]: E0716 11:08:20.450770    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-184.ec2.internal\" not found"
Jul 16 11:08:20.477919 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:20.477878    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ac5863ecfed3d0f647282c9bdf712234-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-184.ec2.internal\" (UID: \"ac5863ecfed3d0f647282c9bdf712234\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-184.ec2.internal"
Jul 16 11:08:20.477919 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:20.477916    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ac5863ecfed3d0f647282c9bdf712234-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-184.ec2.internal\" (UID: \"ac5863ecfed3d0f647282c9bdf712234\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-184.ec2.internal"
Jul 16 11:08:20.478148 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:20.477935    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/5e44ce4b9dc5eed0a3686382d6febba7-config\") pod \"kube-apiserver-proxy-ip-10-0-135-184.ec2.internal\" (UID: \"5e44ce4b9dc5eed0a3686382d6febba7\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-184.ec2.internal"
Jul 16 11:08:20.551896 ip-10-0-135-184 kubenswrapper[2564]: E0716 11:08:20.551800    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-184.ec2.internal\" not found"
Jul 16 11:08:20.579108 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:20.579078    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ac5863ecfed3d0f647282c9bdf712234-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-184.ec2.internal\" (UID: \"ac5863ecfed3d0f647282c9bdf712234\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-184.ec2.internal"
Jul 16 11:08:20.579178 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:20.579116    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/5e44ce4b9dc5eed0a3686382d6febba7-config\") pod \"kube-apiserver-proxy-ip-10-0-135-184.ec2.internal\" (UID: \"5e44ce4b9dc5eed0a3686382d6febba7\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-184.ec2.internal"
Jul 16 11:08:20.579178 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:20.579134    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ac5863ecfed3d0f647282c9bdf712234-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-184.ec2.internal\" (UID: \"ac5863ecfed3d0f647282c9bdf712234\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-184.ec2.internal"
Jul 16 11:08:20.579269 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:20.579189    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/5e44ce4b9dc5eed0a3686382d6febba7-config\") pod \"kube-apiserver-proxy-ip-10-0-135-184.ec2.internal\" (UID: \"5e44ce4b9dc5eed0a3686382d6febba7\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-184.ec2.internal"
Jul 16 11:08:20.579269 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:20.579201    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ac5863ecfed3d0f647282c9bdf712234-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-184.ec2.internal\" (UID: \"ac5863ecfed3d0f647282c9bdf712234\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-184.ec2.internal"
Jul 16 11:08:20.579269 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:20.579243    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ac5863ecfed3d0f647282c9bdf712234-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-184.ec2.internal\" (UID: \"ac5863ecfed3d0f647282c9bdf712234\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-184.ec2.internal"
Jul 16 11:08:20.657199 ip-10-0-135-184 kubenswrapper[2564]: E0716 11:08:20.657157    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-184.ec2.internal\" not found"
Jul 16 11:08:20.736337 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:20.736288    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-184.ec2.internal"
Jul 16 11:08:20.739107 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:20.739065    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-184.ec2.internal"
Jul 16 11:08:20.758142 ip-10-0-135-184 kubenswrapper[2564]: E0716 11:08:20.758115    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-184.ec2.internal\" not found"
Jul 16 11:08:20.860080 ip-10-0-135-184 kubenswrapper[2564]: E0716 11:08:20.859968    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-184.ec2.internal\" not found"
Jul 16 11:08:20.960241 ip-10-0-135-184 kubenswrapper[2564]: E0716 11:08:20.960202    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-184.ec2.internal\" not found"
Jul 16 11:08:20.981346 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:20.981320    2564 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 16 11:08:20.981509 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:20.981490    2564 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 16 11:08:21.006355 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:21.006330    2564 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 16 11:08:21.045479 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:21.045443    2564 apiserver.go:52] "Watching apiserver"
Jul 16 11:08:21.054321 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:21.054291    2564 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 16 11:08:21.055476 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:21.055452    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/node-resolver-44kqf","openshift-image-registry/node-ca-2frcp","openshift-network-diagnostics/network-check-target-hwl88","openshift-ovn-kubernetes/ovnkube-node-fchvw","kube-system/global-pull-secret-syncer-pzsf4","openshift-cluster-node-tuning-operator/tuned-qnhsv","openshift-multus/multus-additional-cni-plugins-klw5l","openshift-multus/multus-f2bxq","openshift-multus/network-metrics-daemon-pxp5q","openshift-network-operator/iptables-alerter-47b72","kube-system/konnectivity-agent-hbhws","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n7bx8"]
Jul 16 11:08:21.057240 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:21.057220    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hwl88"
Jul 16 11:08:21.057337 ip-10-0-135-184 kubenswrapper[2564]: E0716 11:08:21.057314    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hwl88" podUID="0e88ea25-f79a-4275-a633-ba76d5b1ec27"
Jul 16 11:08:21.059576 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:21.059166    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-fchvw"
Jul 16 11:08:21.061391 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:21.061238    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-klw5l"
Jul 16 11:08:21.061391 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:21.061550    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 16 11:08:21.062729 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:21.062638    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 16 11:08:21.062729 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:21.062658    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 16 11:08:21.062729 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:21.062671    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-mdkpw\""
Jul 16 11:08:21.062729 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:21.062711    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 16 11:08:21.063010 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:21.062977    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 16 11:08:21.063138 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:21.063120    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 16 11:08:21.063192 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:21.063161    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-f2bxq"
Jul 16 11:08:21.063494 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:21.063445    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-m6rlw\""
Jul 16 11:08:21.063578 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:21.063549    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 16 11:08:21.063612 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:21.063597    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 16 11:08:21.063946 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:21.063930    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 16 11:08:21.064048 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:21.064031    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 16 11:08:21.064137 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:21.064122    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 16 11:08:21.064701 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:21.064684    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pxp5q"
Jul 16 11:08:21.064766 ip-10-0-135-184 kubenswrapper[2564]: E0716 11:08:21.064740    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pxp5q" podUID="28bc7393-164f-4deb-89da-69443b46c55e"
Jul 16 11:08:21.065048 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:21.065032    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-fvlq9\""
Jul 16 11:08:21.065178 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:21.065162    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 16 11:08:21.065896 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:21.065879    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-47b72"
Jul 16 11:08:21.067419 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:21.067401    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-hbhws"
Jul 16 11:08:21.067520 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:21.067499    2564 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-184.ec2.internal"
Jul 16 11:08:21.067573 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:21.067536    2564 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 16 11:08:21.067965 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:21.067950    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 16 11:08:21.068030 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:21.067973    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-pkpwc\""
Jul 16 11:08:21.068030 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:21.067993    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 16 11:08:21.068030 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:21.068001    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 16 11:08:21.068816 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:21.068800    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-44kqf"
Jul 16 11:08:21.069439 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:21.069420    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-jxmcr\""
Jul 16 11:08:21.069506 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:21.069420    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 16 11:08:21.069506 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:21.069497    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 16 11:08:21.070098 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:21.070083    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-2frcp"
Jul 16 11:08:21.070689 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:21.070675    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 16 11:08:21.070748 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:21.070694    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 16 11:08:21.070800 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:21.070676    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-szdqr\""
Jul 16 11:08:21.071677 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:21.071663    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pzsf4"
Jul 16 11:08:21.071770 ip-10-0-135-184 kubenswrapper[2564]: E0716 11:08:21.071749    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pzsf4" podUID="55506f12-a9f6-4576-b250-576b091deb19"
Jul 16 11:08:21.072021 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:21.072003    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 16 11:08:21.072170 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:21.072142    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 16 11:08:21.072228 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:21.072167    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 16 11:08:21.072303 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:21.072286    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-f2ddm\""
Jul 16 11:08:21.073220 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:21.073203    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-qnhsv"
Jul 16 11:08:21.074711 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:21.074689    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n7bx8"
Jul 16 11:08:21.075249 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:21.075229    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 16 11:08:21.075331 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:21.075309    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 16 11:08:21.075388 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:21.075359    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-p2hxt\""
Jul 16 11:08:21.076647 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:21.076631    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-kxxcz\""
Jul 16 11:08:21.076710 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:21.076655    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 16 11:08:21.076894 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:21.076881    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 16 11:08:21.077253 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:21.077239    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 16 11:08:21.079257 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:21.079238    2564 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 16 11:08:21.079382 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:21.079367    2564 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-184.ec2.internal"
Jul 16 11:08:21.079429 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:21.079414    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-184.ec2.internal"]
Jul 16 11:08:21.081720 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:21.081700    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/aee7cbaf-a5e0-4e57-a9c1-504820f7f036-ovn-node-metrics-cert\") pod \"ovnkube-node-fchvw\" (UID: \"aee7cbaf-a5e0-4e57-a9c1-504820f7f036\") " pod="openshift-ovn-kubernetes/ovnkube-node-fchvw"
Jul 16 11:08:21.081809 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:21.081734    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/dfe01fed-00e2-4080-941e-d27f5d4c9770-host-slash\") pod \"iptables-alerter-47b72\" (UID: \"dfe01fed-00e2-4080-941e-d27f5d4c9770\") " pod="openshift-network-operator/iptables-alerter-47b72"
Jul 16 11:08:21.081809 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:21.081769    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/8987957b-efce-44fe-9da6-d3d7d4c06b6c-host-run-k8s-cni-cncf-io\") pod \"multus-f2bxq\" (UID: \"8987957b-efce-44fe-9da6-d3d7d4c06b6c\") " pod="openshift-multus/multus-f2bxq"
Jul 16 11:08:21.081900 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:21.081833    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/aee7cbaf-a5e0-4e57-a9c1-504820f7f036-run-ovn\") pod \"ovnkube-node-fchvw\" (UID: \"aee7cbaf-a5e0-4e57-a9c1-504820f7f036\") " pod="openshift-ovn-kubernetes/ovnkube-node-fchvw"
Jul 16 11:08:21.081900 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:21.081884    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/60499157-9d8a-4985-802c-be1c0ae7f411-cnibin\") pod \"multus-additional-cni-plugins-klw5l\" (UID: \"60499157-9d8a-4985-802c-be1c0ae7f411\") " pod="openshift-multus/multus-additional-cni-plugins-klw5l"
Jul 16 11:08:21.081995 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:21.081907    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8987957b-efce-44fe-9da6-d3d7d4c06b6c-system-cni-dir\") pod \"multus-f2bxq\" (UID: \"8987957b-efce-44fe-9da6-d3d7d4c06b6c\") " pod="openshift-multus/multus-f2bxq"
Jul 16 11:08:21.081995 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:21.081924    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8987957b-efce-44fe-9da6-d3d7d4c06b6c-multus-conf-dir\") pod \"multus-f2bxq\" (UID: \"8987957b-efce-44fe-9da6-d3d7d4c06b6c\") " pod="openshift-multus/multus-f2bxq"
Jul 16 11:08:21.081995 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:21.081946    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/aee7cbaf-a5e0-4e57-a9c1-504820f7f036-run-systemd\") pod \"ovnkube-node-fchvw\" (UID: \"aee7cbaf-a5e0-4e57-a9c1-504820f7f036\") " pod="openshift-ovn-kubernetes/ovnkube-node-fchvw"
Jul 16 11:08:21.081995 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:21.081969    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/aee7cbaf-a5e0-4e57-a9c1-504820f7f036-var-lib-openvswitch\") pod \"ovnkube-node-fchvw\" (UID: \"aee7cbaf-a5e0-4e57-a9c1-504820f7f036\") " pod="openshift-ovn-kubernetes/ovnkube-node-fchvw"
Jul 16 11:08:21.081995 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:21.081987    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/aee7cbaf-a5e0-4e57-a9c1-504820f7f036-host-run-ovn-kubernetes\") pod \"ovnkube-node-fchvw\" (UID: \"aee7cbaf-a5e0-4e57-a9c1-504820f7f036\") " pod="openshift-ovn-kubernetes/ovnkube-node-fchvw"
Jul 16 11:08:21.082180 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:21.082005    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/aee7cbaf-a5e0-4e57-a9c1-504820f7f036-node-log\") pod \"ovnkube-node-fchvw\" (UID: \"aee7cbaf-a5e0-4e57-a9c1-504820f7f036\") " pod="openshift-ovn-kubernetes/ovnkube-node-fchvw"
Jul 16 11:08:21.082180 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:21.082028    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8987957b-efce-44fe-9da6-d3d7d4c06b6c-multus-cni-dir\") pod \"multus-f2bxq\" (UID: \"8987957b-efce-44fe-9da6-d3d7d4c06b6c\") " pod="openshift-multus/multus-f2bxq"
Jul 16 11:08:21.082526 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:21.082506    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/8987957b-efce-44fe-9da6-d3d7d4c06b6c-multus-socket-dir-parent\") pod \"multus-f2bxq\" (UID: \"8987957b-efce-44fe-9da6-d3d7d4c06b6c\") " pod="openshift-multus/multus-f2bxq"
Jul 16 11:08:21.082563 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:21.082544    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/aee7cbaf-a5e0-4e57-a9c1-504820f7f036-host-kubelet\") pod \"ovnkube-node-fchvw\" (UID: \"aee7cbaf-a5e0-4e57-a9c1-504820f7f036\") " pod="openshift-ovn-kubernetes/ovnkube-node-fchvw"
Jul 16 11:08:21.082597 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:21.082565    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/60499157-9d8a-4985-802c-be1c0ae7f411-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-klw5l\" (UID: \"60499157-9d8a-4985-802c-be1c0ae7f411\") " pod="openshift-multus/multus-additional-cni-plugins-klw5l"
Jul 16 11:08:21.082597 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:21.082583    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8987957b-efce-44fe-9da6-d3d7d4c06b6c-cni-binary-copy\") pod \"multus-f2bxq\" (UID: \"8987957b-efce-44fe-9da6-d3d7d4c06b6c\") " pod="openshift-multus/multus-f2bxq"
Jul 16 11:08:21.082677 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:21.082598    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/8987957b-efce-44fe-9da6-d3d7d4c06b6c-host-var-lib-cni-multus\") pod \"multus-f2bxq\" (UID: \"8987957b-efce-44fe-9da6-d3d7d4c06b6c\") " pod="openshift-multus/multus-f2bxq"
Jul 16 11:08:21.082677 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:21.082625    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/e335433b-f42b-4f52-b88e-02f36ff33f83-hosts-file\") pod \"node-resolver-44kqf\" (UID: \"e335433b-f42b-4f52-b88e-02f36ff33f83\") " pod="openshift-dns/node-resolver-44kqf"
Jul 16 11:08:21.082677 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:21.082651    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/60499157-9d8a-4985-802c-be1c0ae7f411-tuning-conf-dir\") pod \"multus-additional-cni-plugins-klw5l\" (UID: \"60499157-9d8a-4985-802c-be1c0ae7f411\") " pod="openshift-multus/multus-additional-cni-plugins-klw5l"
Jul 16 11:08:21.082677 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:21.082667    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8987957b-efce-44fe-9da6-d3d7d4c06b6c-cnibin\") pod \"multus-f2bxq\" (UID: \"8987957b-efce-44fe-9da6-d3d7d4c06b6c\") " pod="openshift-multus/multus-f2bxq"
Jul 16 11:08:21.082827 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:21.082687    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/8987957b-efce-44fe-9da6-d3d7d4c06b6c-hostroot\") pod \"multus-f2bxq\" (UID: \"8987957b-efce-44fe-9da6-d3d7d4c06b6c\") " pod="openshift-multus/multus-f2bxq"
Jul 16 11:08:21.082827 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:21.082705    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e335433b-f42b-4f52-b88e-02f36ff33f83-tmp-dir\") pod \"node-resolver-44kqf\" (UID: \"e335433b-f42b-4f52-b88e-02f36ff33f83\") " pod="openshift-dns/node-resolver-44kqf"
Jul 16 11:08:21.082827 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:21.082765    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/aee7cbaf-a5e0-4e57-a9c1-504820f7f036-env-overrides\") pod \"ovnkube-node-fchvw\" (UID: \"aee7cbaf-a5e0-4e57-a9c1-504820f7f036\") " pod="openshift-ovn-kubernetes/ovnkube-node-fchvw"
Jul 16 11:08:21.082989 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:21.082823    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/60499157-9d8a-4985-802c-be1c0ae7f411-system-cni-dir\") pod \"multus-additional-cni-plugins-klw5l\" (UID: \"60499157-9d8a-4985-802c-be1c0ae7f411\") " pod="openshift-multus/multus-additional-cni-plugins-klw5l"
Jul 16 11:08:21.082989 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:21.082890    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/aee7cbaf-a5e0-4e57-a9c1-504820f7f036-host-slash\") pod \"ovnkube-node-fchvw\" (UID: \"aee7cbaf-a5e0-4e57-a9c1-504820f7f036\") " pod="openshift-ovn-kubernetes/ovnkube-node-fchvw"
Jul 16 11:08:21.082989 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:21.082931    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/aee7cbaf-a5e0-4e57-a9c1-504820f7f036-host-cni-netd\") pod \"ovnkube-node-fchvw\" (UID: \"aee7cbaf-a5e0-4e57-a9c1-504820f7f036\") " pod="openshift-ovn-kubernetes/ovnkube-node-fchvw"
Jul 16 11:08:21.082989 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:21.082962    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8987957b-efce-44fe-9da6-d3d7d4c06b6c-host-run-netns\") pod \"multus-f2bxq\" (UID: \"8987957b-efce-44fe-9da6-d3d7d4c06b6c\") " pod="openshift-multus/multus-f2bxq"
Jul 16 11:08:21.083172 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:21.082983    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/aee7cbaf-a5e0-4e57-a9c1-504820f7f036-ovnkube-script-lib\") pod \"ovnkube-node-fchvw\" (UID: \"aee7cbaf-a5e0-4e57-a9c1-504820f7f036\") " pod="openshift-ovn-kubernetes/ovnkube-node-fchvw"
Jul 16 11:08:21.083172 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:21.083010    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/8987957b-efce-44fe-9da6-d3d7d4c06b6c-host-run-multus-certs\") pod \"multus-f2bxq\" (UID: \"8987957b-efce-44fe-9da6-d3d7d4c06b6c\") " pod="openshift-multus/multus-f2bxq"
Jul 16 11:08:21.083172 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:21.083047    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ccnqd\" (UniqueName: \"kubernetes.io/projected/8987957b-efce-44fe-9da6-d3d7d4c06b6c-kube-api-access-ccnqd\") pod \"multus-f2bxq\" (UID: \"8987957b-efce-44fe-9da6-d3d7d4c06b6c\") " pod="openshift-multus/multus-f2bxq"
Jul 16 11:08:21.083172 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:21.083076    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7h444\" (UniqueName: \"kubernetes.io/projected/28bc7393-164f-4deb-89da-69443b46c55e-kube-api-access-7h444\") pod \"network-metrics-daemon-pxp5q\" (UID: \"28bc7393-164f-4deb-89da-69443b46c55e\") " pod="openshift-multus/network-metrics-daemon-pxp5q"
Jul 16 11:08:21.083172 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:21.083118    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/1654c4da-b013-4bca-a0a8-5efe36c38fee-agent-certs\") pod \"konnectivity-agent-hbhws\" (UID: \"1654c4da-b013-4bca-a0a8-5efe36c38fee\") " pod="kube-system/konnectivity-agent-hbhws"
Jul 16 11:08:21.083172 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:21.083148    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/aee7cbaf-a5e0-4e57-a9c1-504820f7f036-host-cni-bin\") pod \"ovnkube-node-fchvw\" (UID: \"aee7cbaf-a5e0-4e57-a9c1-504820f7f036\") " pod="openshift-ovn-kubernetes/ovnkube-node-fchvw"
Jul 16 11:08:21.083361 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:21.083191    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8987957b-efce-44fe-9da6-d3d7d4c06b6c-etc-kubernetes\") pod \"multus-f2bxq\" (UID: \"8987957b-efce-44fe-9da6-d3d7d4c06b6c\") " pod="openshift-multus/multus-f2bxq"
Jul 16 11:08:21.083361 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:21.083207    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8987957b-efce-44fe-9da6-d3d7d4c06b6c-host-var-lib-cni-bin\") pod \"multus-f2bxq\" (UID: \"8987957b-efce-44fe-9da6-d3d7d4c06b6c\") " pod="openshift-multus/multus-f2bxq"
Jul 16 11:08:21.083361 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:21.083225    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/60499157-9d8a-4985-802c-be1c0ae7f411-os-release\") pod \"multus-additional-cni-plugins-klw5l\" (UID: \"60499157-9d8a-4985-802c-be1c0ae7f411\") " pod="openshift-multus/multus-additional-cni-plugins-klw5l"
Jul 16 11:08:21.083361 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:21.083248    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/aee7cbaf-a5e0-4e57-a9c1-504820f7f036-run-openvswitch\") pod \"ovnkube-node-fchvw\" (UID: \"aee7cbaf-a5e0-4e57-a9c1-504820f7f036\") " pod="openshift-ovn-kubernetes/ovnkube-node-fchvw"
Jul 16 11:08:21.083361 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:21.083206    2564 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 16 11:08:21.083361 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:21.083301    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/60499157-9d8a-4985-802c-be1c0ae7f411-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-klw5l\" (UID: \"60499157-9d8a-4985-802c-be1c0ae7f411\") " pod="openshift-multus/multus-additional-cni-plugins-klw5l"
Jul 16 11:08:21.083361 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:21.083324    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-frzsp\" (UniqueName: \"kubernetes.io/projected/0e88ea25-f79a-4275-a633-ba76d5b1ec27-kube-api-access-frzsp\") pod \"network-check-target-hwl88\" (UID: \"0e88ea25-f79a-4275-a633-ba76d5b1ec27\") " pod="openshift-network-diagnostics/network-check-target-hwl88"
Jul 16 11:08:21.083361 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:21.083344    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8987957b-efce-44fe-9da6-d3d7d4c06b6c-host-var-lib-kubelet\") pod \"multus-f2bxq\" (UID: \"8987957b-efce-44fe-9da6-d3d7d4c06b6c\") " pod="openshift-multus/multus-f2bxq"
Jul 16 11:08:21.083361 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:21.083360    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/8987957b-efce-44fe-9da6-d3d7d4c06b6c-multus-daemon-config\") pod \"multus-f2bxq\" (UID: \"8987957b-efce-44fe-9da6-d3d7d4c06b6c\") " pod="openshift-multus/multus-f2bxq"
Jul 16 11:08:21.083609 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:21.083377    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/aee7cbaf-a5e0-4e57-a9c1-504820f7f036-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-fchvw\" (UID: \"aee7cbaf-a5e0-4e57-a9c1-504820f7f036\") " pod="openshift-ovn-kubernetes/ovnkube-node-fchvw"
Jul 16 11:08:21.083609 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:21.083411    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v7sgv\" (UniqueName: \"kubernetes.io/projected/e335433b-f42b-4f52-b88e-02f36ff33f83-kube-api-access-v7sgv\") pod \"node-resolver-44kqf\" (UID: \"e335433b-f42b-4f52-b88e-02f36ff33f83\") " pod="openshift-dns/node-resolver-44kqf"
Jul 16 11:08:21.083609 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:21.083472    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/aee7cbaf-a5e0-4e57-a9c1-504820f7f036-log-socket\") pod \"ovnkube-node-fchvw\" (UID: \"aee7cbaf-a5e0-4e57-a9c1-504820f7f036\") " pod="openshift-ovn-kubernetes/ovnkube-node-fchvw"
Jul 16 11:08:21.083609 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:21.083493    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/aee7cbaf-a5e0-4e57-a9c1-504820f7f036-host-run-netns\") pod \"ovnkube-node-fchvw\" (UID: \"aee7cbaf-a5e0-4e57-a9c1-504820f7f036\") " pod="openshift-ovn-kubernetes/ovnkube-node-fchvw"
Jul 16 11:08:21.083609 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:21.083518    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/aee7cbaf-a5e0-4e57-a9c1-504820f7f036-ovnkube-config\") pod \"ovnkube-node-fchvw\" (UID: \"aee7cbaf-a5e0-4e57-a9c1-504820f7f036\") " pod="openshift-ovn-kubernetes/ovnkube-node-fchvw"
Jul 16 11:08:21.083609 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:21.083542    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/28bc7393-164f-4deb-89da-69443b46c55e-metrics-certs\") pod \"network-metrics-daemon-pxp5q\" (UID: \"28bc7393-164f-4deb-89da-69443b46c55e\") " pod="openshift-multus/network-metrics-daemon-pxp5q"
Jul 16 11:08:21.083609 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:21.083561    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/1654c4da-b013-4bca-a0a8-5efe36c38fee-konnectivity-ca\") pod \"konnectivity-agent-hbhws\" (UID: \"1654c4da-b013-4bca-a0a8-5efe36c38fee\") " pod="kube-system/konnectivity-agent-hbhws"
Jul 16 11:08:21.083609 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:21.083576    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/aee7cbaf-a5e0-4e57-a9c1-504820f7f036-etc-openvswitch\") pod \"ovnkube-node-fchvw\" (UID: \"aee7cbaf-a5e0-4e57-a9c1-504820f7f036\") " pod="openshift-ovn-kubernetes/ovnkube-node-fchvw"
Jul 16 11:08:21.083609 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:21.083593    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/60499157-9d8a-4985-802c-be1c0ae7f411-cni-binary-copy\") pod \"multus-additional-cni-plugins-klw5l\" (UID: \"60499157-9d8a-4985-802c-be1c0ae7f411\") " pod="openshift-multus/multus-additional-cni-plugins-klw5l"
Jul 16 11:08:21.083609 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:21.083610    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nkrpb\" (UniqueName: \"kubernetes.io/projected/60499157-9d8a-4985-802c-be1c0ae7f411-kube-api-access-nkrpb\") pod \"multus-additional-cni-plugins-klw5l\" (UID: \"60499157-9d8a-4985-802c-be1c0ae7f411\") " pod="openshift-multus/multus-additional-cni-plugins-klw5l"
Jul 16 11:08:21.083908 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:21.083628    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/dfe01fed-00e2-4080-941e-d27f5d4c9770-iptables-alerter-script\") pod \"iptables-alerter-47b72\" (UID: \"dfe01fed-00e2-4080-941e-d27f5d4c9770\") " pod="openshift-network-operator/iptables-alerter-47b72"
Jul 16 11:08:21.083908 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:21.083643    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6gwrv\" (UniqueName: \"kubernetes.io/projected/dfe01fed-00e2-4080-941e-d27f5d4c9770-kube-api-access-6gwrv\") pod \"iptables-alerter-47b72\" (UID: \"dfe01fed-00e2-4080-941e-d27f5d4c9770\") " pod="openshift-network-operator/iptables-alerter-47b72"
Jul 16 11:08:21.083908 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:21.083659    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/8987957b-efce-44fe-9da6-d3d7d4c06b6c-os-release\") pod \"multus-f2bxq\" (UID: \"8987957b-efce-44fe-9da6-d3d7d4c06b6c\") " pod="openshift-multus/multus-f2bxq"
Jul 16 11:08:21.083908 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:21.083673    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/aee7cbaf-a5e0-4e57-a9c1-504820f7f036-systemd-units\") pod \"ovnkube-node-fchvw\" (UID: \"aee7cbaf-a5e0-4e57-a9c1-504820f7f036\") " pod="openshift-ovn-kubernetes/ovnkube-node-fchvw"
Jul 16 11:08:21.083908 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:21.083689    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h4dtg\" (UniqueName: \"kubernetes.io/projected/aee7cbaf-a5e0-4e57-a9c1-504820f7f036-kube-api-access-h4dtg\") pod \"ovnkube-node-fchvw\" (UID: \"aee7cbaf-a5e0-4e57-a9c1-504820f7f036\") " pod="openshift-ovn-kubernetes/ovnkube-node-fchvw"
Jul 16 11:08:21.087410 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:21.087389    2564 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 16 11:08:21.087631 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:21.087615    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-135-184.ec2.internal"]
Jul 16 11:08:21.115580 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:21.115548    2564 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-r44hr"
Jul 16 11:08:21.123763 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:21.123732    2564 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-r44hr"
Jul 16 11:08:21.168572 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:21.168548    2564 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 16 11:08:21.183976 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:21.183908    2564 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-15 11:03:20 +0000 UTC" deadline="2028-04-17 07:53:36.935245898 +0000 UTC"
Jul 16 11:08:21.183976 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:21.183971    2564 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15380h45m15.75127836s"
Jul 16 11:08:21.183976 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:21.183996    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e335433b-f42b-4f52-b88e-02f36ff33f83-tmp-dir\") pod \"node-resolver-44kqf\" (UID: \"e335433b-f42b-4f52-b88e-02f36ff33f83\") " pod="openshift-dns/node-resolver-44kqf"
Jul 16 11:08:21.183976 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:21.184026    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/aee7cbaf-a5e0-4e57-a9c1-504820f7f036-env-overrides\") pod \"ovnkube-node-fchvw\" (UID: \"aee7cbaf-a5e0-4e57-a9c1-504820f7f036\") " pod="openshift-ovn-kubernetes/ovnkube-node-fchvw"
Jul 16 11:08:21.184340 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:21.184052    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/9c276d4c-a51d-4372-b426-64f3a255a06a-socket-dir\") pod \"aws-ebs-csi-driver-node-n7bx8\" (UID: \"9c276d4c-a51d-4372-b426-64f3a255a06a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n7bx8"
Jul 16 11:08:21.184340 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:21.184078    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/60499157-9d8a-4985-802c-be1c0ae7f411-system-cni-dir\") pod \"multus-additional-cni-plugins-klw5l\" (UID: \"60499157-9d8a-4985-802c-be1c0ae7f411\") " pod="openshift-multus/multus-additional-cni-plugins-klw5l"
Jul 16 11:08:21.184340 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:21.184101    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/aee7cbaf-a5e0-4e57-a9c1-504820f7f036-host-slash\") pod \"ovnkube-node-fchvw\" (UID: \"aee7cbaf-a5e0-4e57-a9c1-504820f7f036\") " pod="openshift-ovn-kubernetes/ovnkube-node-fchvw"
Jul 16 11:08:21.184340 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:21.184123    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/aee7cbaf-a5e0-4e57-a9c1-504820f7f036-host-cni-netd\") pod \"ovnkube-node-fchvw\" (UID: \"aee7cbaf-a5e0-4e57-a9c1-504820f7f036\") " pod="openshift-ovn-kubernetes/ovnkube-node-fchvw"
Jul 16 11:08:21.184340 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:21.184151    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8987957b-efce-44fe-9da6-d3d7d4c06b6c-host-run-netns\") pod \"multus-f2bxq\" (UID: \"8987957b-efce-44fe-9da6-d3d7d4c06b6c\") " pod="openshift-multus/multus-f2bxq"
Jul 16 11:08:21.184340 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:21.184176    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/aee7cbaf-a5e0-4e57-a9c1-504820f7f036-ovnkube-script-lib\") pod \"ovnkube-node-fchvw\" (UID: \"aee7cbaf-a5e0-4e57-a9c1-504820f7f036\") " pod="openshift-ovn-kubernetes/ovnkube-node-fchvw"
Jul 16 11:08:21.184340 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:21.184186    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/aee7cbaf-a5e0-4e57-a9c1-504820f7f036-host-slash\") pod \"ovnkube-node-fchvw\" (UID: \"aee7cbaf-a5e0-4e57-a9c1-504820f7f036\") " pod="openshift-ovn-kubernetes/ovnkube-node-fchvw"
Jul 16 11:08:21.184340 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:21.184201    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/8987957b-efce-44fe-9da6-d3d7d4c06b6c-host-run-multus-certs\") pod \"multus-f2bxq\" (UID: \"8987957b-efce-44fe-9da6-d3d7d4c06b6c\") " pod="openshift-multus/multus-f2bxq"
Jul 16 11:08:21.184340 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:21.184149    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/60499157-9d8a-4985-802c-be1c0ae7f411-system-cni-dir\") pod \"multus-additional-cni-plugins-klw5l\" (UID: \"60499157-9d8a-4985-802c-be1c0ae7f411\") " pod="openshift-multus/multus-additional-cni-plugins-klw5l"
Jul 16 11:08:21.184340 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:21.184243    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ccnqd\" (UniqueName: \"kubernetes.io/projected/8987957b-efce-44fe-9da6-d3d7d4c06b6c-kube-api-access-ccnqd\") pod \"multus-f2bxq\" (UID: \"8987957b-efce-44fe-9da6-d3d7d4c06b6c\") " pod="openshift-multus/multus-f2bxq"
Jul 16 11:08:21.184340 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:21.184225    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/aee7cbaf-a5e0-4e57-a9c1-504820f7f036-host-cni-netd\") pod \"ovnkube-node-fchvw\" (UID: \"aee7cbaf-a5e0-4e57-a9c1-504820f7f036\") " pod="openshift-ovn-kubernetes/ovnkube-node-fchvw"
Jul 16 11:08:21.184340 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:21.184274    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7h444\" (UniqueName: \"kubernetes.io/projected/28bc7393-164f-4deb-89da-69443b46c55e-kube-api-access-7h444\") pod \"network-metrics-daemon-pxp5q\" (UID: \"28bc7393-164f-4deb-89da-69443b46c55e\") " pod="openshift-multus/network-metrics-daemon-pxp5q"
Jul 16 11:08:21.184340 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:21.184251    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8987957b-efce-44fe-9da6-d3d7d4c06b6c-host-run-netns\") pod \"multus-f2bxq\" (UID: \"8987957b-efce-44fe-9da6-d3d7d4c06b6c\") " pod="openshift-multus/multus-f2bxq"
Jul 16 11:08:21.184340 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:21.184310    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/1654c4da-b013-4bca-a0a8-5efe36c38fee-agent-certs\") pod \"konnectivity-agent-hbhws\" (UID: \"1654c4da-b013-4bca-a0a8-5efe36c38fee\") " pod="kube-system/konnectivity-agent-hbhws"
Jul 16 11:08:21.185095 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:21.184428    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/8987957b-efce-44fe-9da6-d3d7d4c06b6c-host-run-multus-certs\") pod \"multus-f2bxq\" (UID: \"8987957b-efce-44fe-9da6-d3d7d4c06b6c\") " pod="openshift-multus/multus-f2bxq"
Jul 16 11:08:21.185095 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:21.184495    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/aee7cbaf-a5e0-4e57-a9c1-504820f7f036-host-cni-bin\") pod \"ovnkube-node-fchvw\" (UID: \"aee7cbaf-a5e0-4e57-a9c1-504820f7f036\") " pod="openshift-ovn-kubernetes/ovnkube-node-fchvw"
Jul 16 11:08:21.185095 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:21.184544    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8987957b-efce-44fe-9da6-d3d7d4c06b6c-etc-kubernetes\") pod \"multus-f2bxq\" (UID: \"8987957b-efce-44fe-9da6-d3d7d4c06b6c\") " pod="openshift-multus/multus-f2bxq"
Jul 16 11:08:21.185095 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:21.184573    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/47ecd32d-7f31-43d9-9828-d2621113d37c-host\") pod \"node-ca-2frcp\" (UID: \"47ecd32d-7f31-43d9-9828-d2621113d37c\") " pod="openshift-image-registry/node-ca-2frcp"
Jul 16 11:08:21.185095 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:21.184584    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/aee7cbaf-a5e0-4e57-a9c1-504820f7f036-host-cni-bin\") pod \"ovnkube-node-fchvw\" (UID: \"aee7cbaf-a5e0-4e57-a9c1-504820f7f036\") " pod="openshift-ovn-kubernetes/ovnkube-node-fchvw"
Jul 16 11:08:21.185095 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:21.184606    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/f4253474-3da3-431f-a86c-28e25e1c7a52-etc-tuned\") pod \"tuned-qnhsv\" (UID: \"f4253474-3da3-431f-a86c-28e25e1c7a52\") " pod="openshift-cluster-node-tuning-operator/tuned-qnhsv"
Jul 16 11:08:21.185095 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:21.184683    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8987957b-efce-44fe-9da6-d3d7d4c06b6c-host-var-lib-cni-bin\") pod \"multus-f2bxq\" (UID: \"8987957b-efce-44fe-9da6-d3d7d4c06b6c\") " pod="openshift-multus/multus-f2bxq"
Jul 16 11:08:21.185095 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:21.184731    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8987957b-efce-44fe-9da6-d3d7d4c06b6c-host-var-lib-cni-bin\") pod \"multus-f2bxq\" (UID: \"8987957b-efce-44fe-9da6-d3d7d4c06b6c\") " pod="openshift-multus/multus-f2bxq"
Jul 16 11:08:21.185095 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:21.184731    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/55506f12-a9f6-4576-b250-576b091deb19-original-pull-secret\") pod \"global-pull-secret-syncer-pzsf4\" (UID: \"55506f12-a9f6-4576-b250-576b091deb19\") " pod="kube-system/global-pull-secret-syncer-pzsf4"
Jul 16 11:08:21.185095 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:21.184755    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8987957b-efce-44fe-9da6-d3d7d4c06b6c-etc-kubernetes\") pod \"multus-f2bxq\" (UID: \"8987957b-efce-44fe-9da6-d3d7d4c06b6c\") " pod="openshift-multus/multus-f2bxq"
Jul 16 11:08:21.185095 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:21.184749    2564 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 16 11:08:21.185095 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:21.184793    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/9c276d4c-a51d-4372-b426-64f3a255a06a-sys-fs\") pod \"aws-ebs-csi-driver-node-n7bx8\" (UID: \"9c276d4c-a51d-4372-b426-64f3a255a06a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n7bx8"
Jul 16 11:08:21.185095 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:21.184854    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/f4253474-3da3-431f-a86c-28e25e1c7a52-etc-sysctl-d\") pod \"tuned-qnhsv\" (UID: \"f4253474-3da3-431f-a86c-28e25e1c7a52\") " pod="openshift-cluster-node-tuning-operator/tuned-qnhsv"
Jul 16 11:08:21.185095 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:21.184882    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/60499157-9d8a-4985-802c-be1c0ae7f411-os-release\") pod \"multus-additional-cni-plugins-klw5l\" (UID: \"60499157-9d8a-4985-802c-be1c0ae7f411\") " pod="openshift-multus/multus-additional-cni-plugins-klw5l"
Jul 16 11:08:21.185095 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:21.184920    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/aee7cbaf-a5e0-4e57-a9c1-504820f7f036-run-openvswitch\") pod \"ovnkube-node-fchvw\" (UID: \"aee7cbaf-a5e0-4e57-a9c1-504820f7f036\") " pod="openshift-ovn-kubernetes/ovnkube-node-fchvw"
Jul 16 11:08:21.185688 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:21.184959    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/60499157-9d8a-4985-802c-be1c0ae7f411-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-klw5l\" (UID: \"60499157-9d8a-4985-802c-be1c0ae7f411\") " pod="openshift-multus/multus-additional-cni-plugins-klw5l"
Jul 16 11:08:21.185688 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:21.184973    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/aee7cbaf-a5e0-4e57-a9c1-504820f7f036-run-openvswitch\") pod \"ovnkube-node-fchvw\" (UID: \"aee7cbaf-a5e0-4e57-a9c1-504820f7f036\") " pod="openshift-ovn-kubernetes/ovnkube-node-fchvw"
Jul 16 11:08:21.185688 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:21.185034    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/60499157-9d8a-4985-802c-be1c0ae7f411-os-release\") pod \"multus-additional-cni-plugins-klw5l\" (UID: \"60499157-9d8a-4985-802c-be1c0ae7f411\") " pod="openshift-multus/multus-additional-cni-plugins-klw5l"
Jul 16 11:08:21.185688 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:21.185057    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-frzsp\" (UniqueName: \"kubernetes.io/projected/0e88ea25-f79a-4275-a633-ba76d5b1ec27-kube-api-access-frzsp\") pod \"network-check-target-hwl88\" (UID: \"0e88ea25-f79a-4275-a633-ba76d5b1ec27\") " pod="openshift-network-diagnostics/network-check-target-hwl88"
Jul 16 11:08:21.185688 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:21.185079    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8987957b-efce-44fe-9da6-d3d7d4c06b6c-host-var-lib-kubelet\") pod \"multus-f2bxq\" (UID: \"8987957b-efce-44fe-9da6-d3d7d4c06b6c\") " pod="openshift-multus/multus-f2bxq"
Jul 16 11:08:21.185688 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:21.185111    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/8987957b-efce-44fe-9da6-d3d7d4c06b6c-multus-daemon-config\") pod \"multus-f2bxq\" (UID: \"8987957b-efce-44fe-9da6-d3d7d4c06b6c\") " pod="openshift-multus/multus-f2bxq"
Jul 16 11:08:21.185688 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:21.185134    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f4253474-3da3-431f-a86c-28e25e1c7a52-lib-modules\") pod \"tuned-qnhsv\" (UID: \"f4253474-3da3-431f-a86c-28e25e1c7a52\") " pod="openshift-cluster-node-tuning-operator/tuned-qnhsv"
Jul 16 11:08:21.185688 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:21.185152    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/aee7cbaf-a5e0-4e57-a9c1-504820f7f036-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-fchvw\" (UID: \"aee7cbaf-a5e0-4e57-a9c1-504820f7f036\") " pod="openshift-ovn-kubernetes/ovnkube-node-fchvw"
Jul 16 11:08:21.185688 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:21.185160    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8987957b-efce-44fe-9da6-d3d7d4c06b6c-host-var-lib-kubelet\") pod \"multus-f2bxq\" (UID: \"8987957b-efce-44fe-9da6-d3d7d4c06b6c\") " pod="openshift-multus/multus-f2bxq"
Jul 16 11:08:21.185688 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:21.185171    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v7sgv\" (UniqueName: \"kubernetes.io/projected/e335433b-f42b-4f52-b88e-02f36ff33f83-kube-api-access-v7sgv\") pod \"node-resolver-44kqf\" (UID: \"e335433b-f42b-4f52-b88e-02f36ff33f83\") " pod="openshift-dns/node-resolver-44kqf"
Jul 16 11:08:21.185688 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:21.185191    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f4253474-3da3-431f-a86c-28e25e1c7a52-var-lib-kubelet\") pod \"tuned-qnhsv\" (UID: \"f4253474-3da3-431f-a86c-28e25e1c7a52\") " pod="openshift-cluster-node-tuning-operator/tuned-qnhsv"
Jul 16 11:08:21.185688 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:21.185216    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/aee7cbaf-a5e0-4e57-a9c1-504820f7f036-log-socket\") pod \"ovnkube-node-fchvw\" (UID: \"aee7cbaf-a5e0-4e57-a9c1-504820f7f036\") " pod="openshift-ovn-kubernetes/ovnkube-node-fchvw"
Jul 16 11:08:21.185688 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:21.185240    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/aee7cbaf-a5e0-4e57-a9c1-504820f7f036-host-run-netns\") pod \"ovnkube-node-fchvw\" (UID: \"aee7cbaf-a5e0-4e57-a9c1-504820f7f036\") " pod="openshift-ovn-kubernetes/ovnkube-node-fchvw"
Jul 16 11:08:21.185688 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:21.185258    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/aee7cbaf-a5e0-4e57-a9c1-504820f7f036-ovnkube-config\") pod \"ovnkube-node-fchvw\" (UID: \"aee7cbaf-a5e0-4e57-a9c1-504820f7f036\") " pod="openshift-ovn-kubernetes/ovnkube-node-fchvw"
Jul 16 11:08:21.186326 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:21.185274    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/28bc7393-164f-4deb-89da-69443b46c55e-metrics-certs\") pod \"network-metrics-daemon-pxp5q\" (UID: \"28bc7393-164f-4deb-89da-69443b46c55e\") " pod="openshift-multus/network-metrics-daemon-pxp5q"
Jul 16 11:08:21.186326 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:21.185320    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/1654c4da-b013-4bca-a0a8-5efe36c38fee-konnectivity-ca\") pod \"konnectivity-agent-hbhws\" (UID: \"1654c4da-b013-4bca-a0a8-5efe36c38fee\") " pod="kube-system/konnectivity-agent-hbhws"
Jul 16 11:08:21.186326 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:21.185339    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/55506f12-a9f6-4576-b250-576b091deb19-kubelet-config\") pod \"global-pull-secret-syncer-pzsf4\" (UID: \"55506f12-a9f6-4576-b250-576b091deb19\") " pod="kube-system/global-pull-secret-syncer-pzsf4"
Jul 16 11:08:21.186326 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:21.185355    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/aee7cbaf-a5e0-4e57-a9c1-504820f7f036-etc-openvswitch\") pod \"ovnkube-node-fchvw\" (UID: \"aee7cbaf-a5e0-4e57-a9c1-504820f7f036\") " pod="openshift-ovn-kubernetes/ovnkube-node-fchvw"
Jul 16 11:08:21.186326 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:21.185359    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e335433b-f42b-4f52-b88e-02f36ff33f83-tmp-dir\") pod \"node-resolver-44kqf\" (UID: \"e335433b-f42b-4f52-b88e-02f36ff33f83\") " pod="openshift-dns/node-resolver-44kqf"
Jul 16 11:08:21.186326 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:21.185381    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/60499157-9d8a-4985-802c-be1c0ae7f411-cni-binary-copy\") pod \"multus-additional-cni-plugins-klw5l\" (UID: \"60499157-9d8a-4985-802c-be1c0ae7f411\") " pod="openshift-multus/multus-additional-cni-plugins-klw5l"
Jul 16 11:08:21.186326 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:21.185402    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nkrpb\" (UniqueName: \"kubernetes.io/projected/60499157-9d8a-4985-802c-be1c0ae7f411-kube-api-access-nkrpb\") pod \"multus-additional-cni-plugins-klw5l\" (UID: \"60499157-9d8a-4985-802c-be1c0ae7f411\") " pod="openshift-multus/multus-additional-cni-plugins-klw5l"
Jul 16 11:08:21.186326 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:21.185431    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/aee7cbaf-a5e0-4e57-a9c1-504820f7f036-log-socket\") pod \"ovnkube-node-fchvw\" (UID: \"aee7cbaf-a5e0-4e57-a9c1-504820f7f036\") " pod="openshift-ovn-kubernetes/ovnkube-node-fchvw"
Jul 16 11:08:21.186326 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:21.185436    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/dfe01fed-00e2-4080-941e-d27f5d4c9770-iptables-alerter-script\") pod \"iptables-alerter-47b72\" (UID: \"dfe01fed-00e2-4080-941e-d27f5d4c9770\") " pod="openshift-network-operator/iptables-alerter-47b72"
Jul 16 11:08:21.186326 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:21.185490    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/aee7cbaf-a5e0-4e57-a9c1-504820f7f036-host-run-netns\") pod \"ovnkube-node-fchvw\" (UID: \"aee7cbaf-a5e0-4e57-a9c1-504820f7f036\") " pod="openshift-ovn-kubernetes/ovnkube-node-fchvw"
Jul 16 11:08:21.186326 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:21.186003    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/60499157-9d8a-4985-802c-be1c0ae7f411-cni-binary-copy\") pod \"multus-additional-cni-plugins-klw5l\" (UID: \"60499157-9d8a-4985-802c-be1c0ae7f411\") " pod="openshift-multus/multus-additional-cni-plugins-klw5l"
Jul 16 11:08:21.186326 ip-10-0-135-184 kubenswrapper[2564]: E0716 11:08:21.186095    2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 16 11:08:21.186326 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:21.186168    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/1654c4da-b013-4bca-a0a8-5efe36c38fee-konnectivity-ca\") pod \"konnectivity-agent-hbhws\" (UID: \"1654c4da-b013-4bca-a0a8-5efe36c38fee\") " pod="kube-system/konnectivity-agent-hbhws"
Jul 16 11:08:21.186326 ip-10-0-135-184 kubenswrapper[2564]: E0716 11:08:21.186178    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/28bc7393-164f-4deb-89da-69443b46c55e-metrics-certs podName:28bc7393-164f-4deb-89da-69443b46c55e nodeName:}" failed. No retries permitted until 2026-07-16 11:08:21.686149702 +0000 UTC m=+2.057686723 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/28bc7393-164f-4deb-89da-69443b46c55e-metrics-certs") pod "network-metrics-daemon-pxp5q" (UID: "28bc7393-164f-4deb-89da-69443b46c55e") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 16 11:08:21.187044 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:21.186198    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/8987957b-efce-44fe-9da6-d3d7d4c06b6c-multus-daemon-config\") pod \"multus-f2bxq\" (UID: \"8987957b-efce-44fe-9da6-d3d7d4c06b6c\") " pod="openshift-multus/multus-f2bxq"
Jul 16 11:08:21.187044 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:21.186250    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/aee7cbaf-a5e0-4e57-a9c1-504820f7f036-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-fchvw\" (UID: \"aee7cbaf-a5e0-4e57-a9c1-504820f7f036\") " pod="openshift-ovn-kubernetes/ovnkube-node-fchvw"
Jul 16 11:08:21.187044 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:21.186261    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6gwrv\" (UniqueName: \"kubernetes.io/projected/dfe01fed-00e2-4080-941e-d27f5d4c9770-kube-api-access-6gwrv\") pod \"iptables-alerter-47b72\" (UID: \"dfe01fed-00e2-4080-941e-d27f5d4c9770\") " pod="openshift-network-operator/iptables-alerter-47b72"
Jul 16 11:08:21.187044 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:21.186302    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/dfe01fed-00e2-4080-941e-d27f5d4c9770-iptables-alerter-script\") pod \"iptables-alerter-47b72\" (UID: \"dfe01fed-00e2-4080-941e-d27f5d4c9770\") " pod="openshift-network-operator/iptables-alerter-47b72"
Jul 16 11:08:21.187044 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:21.186356    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/8987957b-efce-44fe-9da6-d3d7d4c06b6c-os-release\") pod \"multus-f2bxq\" (UID: \"8987957b-efce-44fe-9da6-d3d7d4c06b6c\") " pod="openshift-multus/multus-f2bxq"
Jul 16 11:08:21.187044 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:21.186374    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/60499157-9d8a-4985-802c-be1c0ae7f411-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-klw5l\" (UID: \"60499157-9d8a-4985-802c-be1c0ae7f411\") " pod="openshift-multus/multus-additional-cni-plugins-klw5l"
Jul 16 11:08:21.187044 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:21.186390    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/aee7cbaf-a5e0-4e57-a9c1-504820f7f036-etc-openvswitch\") pod \"ovnkube-node-fchvw\" (UID: \"aee7cbaf-a5e0-4e57-a9c1-504820f7f036\") " pod="openshift-ovn-kubernetes/ovnkube-node-fchvw"
Jul 16 11:08:21.187044 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:21.186426    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/9c276d4c-a51d-4372-b426-64f3a255a06a-registration-dir\") pod \"aws-ebs-csi-driver-node-n7bx8\" (UID: \"9c276d4c-a51d-4372-b426-64f3a255a06a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n7bx8"
Jul 16 11:08:21.187044 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:21.186467    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/8987957b-efce-44fe-9da6-d3d7d4c06b6c-os-release\") pod \"multus-f2bxq\" (UID: \"8987957b-efce-44fe-9da6-d3d7d4c06b6c\") " pod="openshift-multus/multus-f2bxq"
Jul 16 11:08:21.187044 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:21.186513    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/f4253474-3da3-431f-a86c-28e25e1c7a52-etc-modprobe-d\") pod \"tuned-qnhsv\" (UID: \"f4253474-3da3-431f-a86c-28e25e1c7a52\") " pod="openshift-cluster-node-tuning-operator/tuned-qnhsv"
Jul 16 11:08:21.187044 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:21.186547    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/aee7cbaf-a5e0-4e57-a9c1-504820f7f036-systemd-units\") pod \"ovnkube-node-fchvw\" (UID: \"aee7cbaf-a5e0-4e57-a9c1-504820f7f036\") " pod="openshift-ovn-kubernetes/ovnkube-node-fchvw"
Jul 16 11:08:21.187044 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:21.186593    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h4dtg\" (UniqueName: \"kubernetes.io/projected/aee7cbaf-a5e0-4e57-a9c1-504820f7f036-kube-api-access-h4dtg\") pod \"ovnkube-node-fchvw\" (UID: \"aee7cbaf-a5e0-4e57-a9c1-504820f7f036\") " pod="openshift-ovn-kubernetes/ovnkube-node-fchvw"
Jul 16 11:08:21.187044 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:21.186621    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/9c276d4c-a51d-4372-b426-64f3a255a06a-etc-selinux\") pod \"aws-ebs-csi-driver-node-n7bx8\" (UID: \"9c276d4c-a51d-4372-b426-64f3a255a06a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n7bx8"
Jul 16 11:08:21.187044 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:21.186650    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fb8hd\" (UniqueName: \"kubernetes.io/projected/9c276d4c-a51d-4372-b426-64f3a255a06a-kube-api-access-fb8hd\") pod \"aws-ebs-csi-driver-node-n7bx8\" (UID: \"9c276d4c-a51d-4372-b426-64f3a255a06a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n7bx8"
Jul 16 11:08:21.187664 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:21.186681    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/f4253474-3da3-431f-a86c-28e25e1c7a52-etc-sysconfig\") pod \"tuned-qnhsv\" (UID: \"f4253474-3da3-431f-a86c-28e25e1c7a52\") " pod="openshift-cluster-node-tuning-operator/tuned-qnhsv"
Jul 16 11:08:21.187664 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:21.186737    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f4253474-3da3-431f-a86c-28e25e1c7a52-etc-kubernetes\") pod \"tuned-qnhsv\" (UID: \"f4253474-3da3-431f-a86c-28e25e1c7a52\") " pod="openshift-cluster-node-tuning-operator/tuned-qnhsv"
Jul 16 11:08:21.187664 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:21.186765    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/f4253474-3da3-431f-a86c-28e25e1c7a52-etc-systemd\") pod \"tuned-qnhsv\" (UID: \"f4253474-3da3-431f-a86c-28e25e1c7a52\") " pod="openshift-cluster-node-tuning-operator/tuned-qnhsv"
Jul 16 11:08:21.187664 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:21.186794    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/f4253474-3da3-431f-a86c-28e25e1c7a52-run\") pod \"tuned-qnhsv\" (UID: \"f4253474-3da3-431f-a86c-28e25e1c7a52\") " pod="openshift-cluster-node-tuning-operator/tuned-qnhsv"
Jul 16 11:08:21.187664 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:21.186822    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/aee7cbaf-a5e0-4e57-a9c1-504820f7f036-ovn-node-metrics-cert\") pod \"ovnkube-node-fchvw\" (UID: \"aee7cbaf-a5e0-4e57-a9c1-504820f7f036\") " pod="openshift-ovn-kubernetes/ovnkube-node-fchvw"
Jul 16 11:08:21.187664 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:21.186871    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/dfe01fed-00e2-4080-941e-d27f5d4c9770-host-slash\") pod \"iptables-alerter-47b72\" (UID: \"dfe01fed-00e2-4080-941e-d27f5d4c9770\") " pod="openshift-network-operator/iptables-alerter-47b72"
Jul 16 11:08:21.187664 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:21.186901    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/8987957b-efce-44fe-9da6-d3d7d4c06b6c-host-run-k8s-cni-cncf-io\") pod \"multus-f2bxq\" (UID: \"8987957b-efce-44fe-9da6-d3d7d4c06b6c\") " pod="openshift-multus/multus-f2bxq"
Jul 16 11:08:21.187664 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:21.186951    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/aee7cbaf-a5e0-4e57-a9c1-504820f7f036-env-overrides\") pod \"ovnkube-node-fchvw\" (UID: \"aee7cbaf-a5e0-4e57-a9c1-504820f7f036\") " pod="openshift-ovn-kubernetes/ovnkube-node-fchvw"
Jul 16 11:08:21.187664 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:21.186994    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/9c276d4c-a51d-4372-b426-64f3a255a06a-kubelet-dir\") pod \"aws-ebs-csi-driver-node-n7bx8\" (UID: \"9c276d4c-a51d-4372-b426-64f3a255a06a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n7bx8"
Jul 16 11:08:21.187664 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:21.187015    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/dfe01fed-00e2-4080-941e-d27f5d4c9770-host-slash\") pod \"iptables-alerter-47b72\" (UID: \"dfe01fed-00e2-4080-941e-d27f5d4c9770\") " pod="openshift-network-operator/iptables-alerter-47b72"
Jul 16 11:08:21.187664 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:21.187023    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f4253474-3da3-431f-a86c-28e25e1c7a52-sys\") pod \"tuned-qnhsv\" (UID: \"f4253474-3da3-431f-a86c-28e25e1c7a52\") " pod="openshift-cluster-node-tuning-operator/tuned-qnhsv"
Jul 16 11:08:21.187664 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:21.187051    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/aee7cbaf-a5e0-4e57-a9c1-504820f7f036-run-ovn\") pod \"ovnkube-node-fchvw\" (UID: \"aee7cbaf-a5e0-4e57-a9c1-504820f7f036\") " pod="openshift-ovn-kubernetes/ovnkube-node-fchvw"
Jul 16 11:08:21.187664 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:21.187071    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/8987957b-efce-44fe-9da6-d3d7d4c06b6c-host-run-k8s-cni-cncf-io\") pod \"multus-f2bxq\" (UID: \"8987957b-efce-44fe-9da6-d3d7d4c06b6c\") " pod="openshift-multus/multus-f2bxq"
Jul 16 11:08:21.187664 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:21.187092    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/aee7cbaf-a5e0-4e57-a9c1-504820f7f036-systemd-units\") pod \"ovnkube-node-fchvw\" (UID: \"aee7cbaf-a5e0-4e57-a9c1-504820f7f036\") " pod="openshift-ovn-kubernetes/ovnkube-node-fchvw"
Jul 16 11:08:21.188380 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:21.187124    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/aee7cbaf-a5e0-4e57-a9c1-504820f7f036-ovnkube-script-lib\") pod \"ovnkube-node-fchvw\" (UID: \"aee7cbaf-a5e0-4e57-a9c1-504820f7f036\") " pod="openshift-ovn-kubernetes/ovnkube-node-fchvw"
Jul 16 11:08:21.188380 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:21.187161    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/aee7cbaf-a5e0-4e57-a9c1-504820f7f036-run-ovn\") pod \"ovnkube-node-fchvw\" (UID: \"aee7cbaf-a5e0-4e57-a9c1-504820f7f036\") " pod="openshift-ovn-kubernetes/ovnkube-node-fchvw"
Jul 16 11:08:21.188380 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:21.187173    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/60499157-9d8a-4985-802c-be1c0ae7f411-cnibin\") pod \"multus-additional-cni-plugins-klw5l\" (UID: \"60499157-9d8a-4985-802c-be1c0ae7f411\") " pod="openshift-multus/multus-additional-cni-plugins-klw5l"
Jul 16 11:08:21.188380 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:21.187242    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/60499157-9d8a-4985-802c-be1c0ae7f411-cnibin\") pod \"multus-additional-cni-plugins-klw5l\" (UID: \"60499157-9d8a-4985-802c-be1c0ae7f411\") " pod="openshift-multus/multus-additional-cni-plugins-klw5l"
Jul 16 11:08:21.188380 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:21.187293    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8987957b-efce-44fe-9da6-d3d7d4c06b6c-system-cni-dir\") pod \"multus-f2bxq\" (UID: \"8987957b-efce-44fe-9da6-d3d7d4c06b6c\") " pod="openshift-multus/multus-f2bxq"
Jul 16 11:08:21.188380 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:21.187363    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8987957b-efce-44fe-9da6-d3d7d4c06b6c-system-cni-dir\") pod \"multus-f2bxq\" (UID: \"8987957b-efce-44fe-9da6-d3d7d4c06b6c\") " pod="openshift-multus/multus-f2bxq"
Jul 16 11:08:21.188380 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:21.187440    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8987957b-efce-44fe-9da6-d3d7d4c06b6c-multus-conf-dir\") pod \"multus-f2bxq\" (UID: \"8987957b-efce-44fe-9da6-d3d7d4c06b6c\") " pod="openshift-multus/multus-f2bxq"
Jul 16 11:08:21.188380 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:21.187443    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8987957b-efce-44fe-9da6-d3d7d4c06b6c-multus-conf-dir\") pod \"multus-f2bxq\" (UID: \"8987957b-efce-44fe-9da6-d3d7d4c06b6c\") " pod="openshift-multus/multus-f2bxq"
Jul 16 11:08:21.188380 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:21.187469    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/55506f12-a9f6-4576-b250-576b091deb19-dbus\") pod \"global-pull-secret-syncer-pzsf4\" (UID: \"55506f12-a9f6-4576-b250-576b091deb19\") " pod="kube-system/global-pull-secret-syncer-pzsf4"
Jul 16 11:08:21.188380 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:21.187496    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/f4253474-3da3-431f-a86c-28e25e1c7a52-etc-sysctl-conf\") pod \"tuned-qnhsv\" (UID: \"f4253474-3da3-431f-a86c-28e25e1c7a52\") " pod="openshift-cluster-node-tuning-operator/tuned-qnhsv"
Jul 16 11:08:21.188380 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:21.187520    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f4253474-3da3-431f-a86c-28e25e1c7a52-tmp\") pod \"tuned-qnhsv\" (UID: \"f4253474-3da3-431f-a86c-28e25e1c7a52\") " pod="openshift-cluster-node-tuning-operator/tuned-qnhsv"
Jul 16 11:08:21.188380 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:21.187546    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/aee7cbaf-a5e0-4e57-a9c1-504820f7f036-run-systemd\") pod \"ovnkube-node-fchvw\" (UID: \"aee7cbaf-a5e0-4e57-a9c1-504820f7f036\") " pod="openshift-ovn-kubernetes/ovnkube-node-fchvw"
Jul 16 11:08:21.188380 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:21.187571    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/aee7cbaf-a5e0-4e57-a9c1-504820f7f036-var-lib-openvswitch\") pod \"ovnkube-node-fchvw\" (UID: \"aee7cbaf-a5e0-4e57-a9c1-504820f7f036\") " pod="openshift-ovn-kubernetes/ovnkube-node-fchvw"
Jul 16 11:08:21.188380 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:21.187651    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/aee7cbaf-a5e0-4e57-a9c1-504820f7f036-ovnkube-config\") pod \"ovnkube-node-fchvw\" (UID: \"aee7cbaf-a5e0-4e57-a9c1-504820f7f036\") " pod="openshift-ovn-kubernetes/ovnkube-node-fchvw"
Jul 16 11:08:21.188380 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:21.187645    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/aee7cbaf-a5e0-4e57-a9c1-504820f7f036-host-run-ovn-kubernetes\") pod \"ovnkube-node-fchvw\" (UID: \"aee7cbaf-a5e0-4e57-a9c1-504820f7f036\") " pod="openshift-ovn-kubernetes/ovnkube-node-fchvw"
Jul 16 11:08:21.189076 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:21.187746    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/9c276d4c-a51d-4372-b426-64f3a255a06a-device-dir\") pod \"aws-ebs-csi-driver-node-n7bx8\" (UID: \"9c276d4c-a51d-4372-b426-64f3a255a06a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n7bx8"
Jul 16 11:08:21.189076 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:21.187802    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rfkrl\" (UniqueName: \"kubernetes.io/projected/47ecd32d-7f31-43d9-9828-d2621113d37c-kube-api-access-rfkrl\") pod \"node-ca-2frcp\" (UID: \"47ecd32d-7f31-43d9-9828-d2621113d37c\") " pod="openshift-image-registry/node-ca-2frcp"
Jul 16 11:08:21.189076 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:21.187806    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/aee7cbaf-a5e0-4e57-a9c1-504820f7f036-host-run-ovn-kubernetes\") pod \"ovnkube-node-fchvw\" (UID: \"aee7cbaf-a5e0-4e57-a9c1-504820f7f036\") " pod="openshift-ovn-kubernetes/ovnkube-node-fchvw"
Jul 16 11:08:21.189076 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:21.187712    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/aee7cbaf-a5e0-4e57-a9c1-504820f7f036-run-systemd\") pod \"ovnkube-node-fchvw\" (UID: \"aee7cbaf-a5e0-4e57-a9c1-504820f7f036\") " pod="openshift-ovn-kubernetes/ovnkube-node-fchvw"
Jul 16 11:08:21.189076 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:21.187832    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/aee7cbaf-a5e0-4e57-a9c1-504820f7f036-node-log\") pod \"ovnkube-node-fchvw\" (UID: \"aee7cbaf-a5e0-4e57-a9c1-504820f7f036\") " pod="openshift-ovn-kubernetes/ovnkube-node-fchvw"
Jul 16 11:08:21.189076 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:21.187882    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8987957b-efce-44fe-9da6-d3d7d4c06b6c-multus-cni-dir\") pod \"multus-f2bxq\" (UID: \"8987957b-efce-44fe-9da6-d3d7d4c06b6c\") " pod="openshift-multus/multus-f2bxq"
Jul 16 11:08:21.189076 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:21.187888    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/aee7cbaf-a5e0-4e57-a9c1-504820f7f036-node-log\") pod \"ovnkube-node-fchvw\" (UID: \"aee7cbaf-a5e0-4e57-a9c1-504820f7f036\") " pod="openshift-ovn-kubernetes/ovnkube-node-fchvw"
Jul 16 11:08:21.189076 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:21.187935    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/8987957b-efce-44fe-9da6-d3d7d4c06b6c-multus-socket-dir-parent\") pod \"multus-f2bxq\" (UID: \"8987957b-efce-44fe-9da6-d3d7d4c06b6c\") " pod="openshift-multus/multus-f2bxq"
Jul 16 11:08:21.189076 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:21.188028    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/47ecd32d-7f31-43d9-9828-d2621113d37c-serviceca\") pod \"node-ca-2frcp\" (UID: \"47ecd32d-7f31-43d9-9828-d2621113d37c\") " pod="openshift-image-registry/node-ca-2frcp"
Jul 16 11:08:21.189076 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:21.188062    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f4253474-3da3-431f-a86c-28e25e1c7a52-host\") pod \"tuned-qnhsv\" (UID: \"f4253474-3da3-431f-a86c-28e25e1c7a52\") " pod="openshift-cluster-node-tuning-operator/tuned-qnhsv"
Jul 16 11:08:21.189076 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:21.188062    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/8987957b-efce-44fe-9da6-d3d7d4c06b6c-multus-socket-dir-parent\") pod \"multus-f2bxq\" (UID: \"8987957b-efce-44fe-9da6-d3d7d4c06b6c\") " pod="openshift-multus/multus-f2bxq"
Jul 16 11:08:21.189076 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:21.188123    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lmsbz\" (UniqueName: \"kubernetes.io/projected/f4253474-3da3-431f-a86c-28e25e1c7a52-kube-api-access-lmsbz\") pod \"tuned-qnhsv\" (UID: \"f4253474-3da3-431f-a86c-28e25e1c7a52\") " pod="openshift-cluster-node-tuning-operator/tuned-qnhsv"
Jul 16 11:08:21.189076 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:21.188160    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/aee7cbaf-a5e0-4e57-a9c1-504820f7f036-host-kubelet\") pod \"ovnkube-node-fchvw\" (UID: \"aee7cbaf-a5e0-4e57-a9c1-504820f7f036\") " pod="openshift-ovn-kubernetes/ovnkube-node-fchvw"
Jul 16 11:08:21.189076 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:21.188218    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8987957b-efce-44fe-9da6-d3d7d4c06b6c-multus-cni-dir\") pod \"multus-f2bxq\" (UID: \"8987957b-efce-44fe-9da6-d3d7d4c06b6c\") " pod="openshift-multus/multus-f2bxq"
Jul 16 11:08:21.189076 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:21.188223    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/aee7cbaf-a5e0-4e57-a9c1-504820f7f036-host-kubelet\") pod \"ovnkube-node-fchvw\" (UID: \"aee7cbaf-a5e0-4e57-a9c1-504820f7f036\") " pod="openshift-ovn-kubernetes/ovnkube-node-fchvw"
Jul 16 11:08:21.189660 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:21.188228    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/60499157-9d8a-4985-802c-be1c0ae7f411-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-klw5l\" (UID: \"60499157-9d8a-4985-802c-be1c0ae7f411\") " pod="openshift-multus/multus-additional-cni-plugins-klw5l"
Jul 16 11:08:21.189660 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:21.187630    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/aee7cbaf-a5e0-4e57-a9c1-504820f7f036-var-lib-openvswitch\") pod \"ovnkube-node-fchvw\" (UID: \"aee7cbaf-a5e0-4e57-a9c1-504820f7f036\") " pod="openshift-ovn-kubernetes/ovnkube-node-fchvw"
Jul 16 11:08:21.189660 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:21.188262    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8987957b-efce-44fe-9da6-d3d7d4c06b6c-cni-binary-copy\") pod \"multus-f2bxq\" (UID: \"8987957b-efce-44fe-9da6-d3d7d4c06b6c\") " pod="openshift-multus/multus-f2bxq"
Jul 16 11:08:21.189660 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:21.188315    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/8987957b-efce-44fe-9da6-d3d7d4c06b6c-host-var-lib-cni-multus\") pod \"multus-f2bxq\" (UID: \"8987957b-efce-44fe-9da6-d3d7d4c06b6c\") " pod="openshift-multus/multus-f2bxq"
Jul 16 11:08:21.189660 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:21.188364    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/e335433b-f42b-4f52-b88e-02f36ff33f83-hosts-file\") pod \"node-resolver-44kqf\" (UID: \"e335433b-f42b-4f52-b88e-02f36ff33f83\") " pod="openshift-dns/node-resolver-44kqf"
Jul 16 11:08:21.189660 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:21.188385    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/8987957b-efce-44fe-9da6-d3d7d4c06b6c-host-var-lib-cni-multus\") pod \"multus-f2bxq\" (UID: \"8987957b-efce-44fe-9da6-d3d7d4c06b6c\") " pod="openshift-multus/multus-f2bxq"
Jul 16 11:08:21.189660 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:21.188451    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/60499157-9d8a-4985-802c-be1c0ae7f411-tuning-conf-dir\") pod \"multus-additional-cni-plugins-klw5l\" (UID: \"60499157-9d8a-4985-802c-be1c0ae7f411\") " pod="openshift-multus/multus-additional-cni-plugins-klw5l"
Jul 16 11:08:21.189660 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:21.188508    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/e335433b-f42b-4f52-b88e-02f36ff33f83-hosts-file\") pod \"node-resolver-44kqf\" (UID: \"e335433b-f42b-4f52-b88e-02f36ff33f83\") " pod="openshift-dns/node-resolver-44kqf"
Jul 16 11:08:21.189660 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:21.188540    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8987957b-efce-44fe-9da6-d3d7d4c06b6c-cnibin\") pod \"multus-f2bxq\" (UID: \"8987957b-efce-44fe-9da6-d3d7d4c06b6c\") " pod="openshift-multus/multus-f2bxq"
Jul 16 11:08:21.189660 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:21.188590    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8987957b-efce-44fe-9da6-d3d7d4c06b6c-cnibin\") pod \"multus-f2bxq\" (UID: \"8987957b-efce-44fe-9da6-d3d7d4c06b6c\") " pod="openshift-multus/multus-f2bxq"
Jul 16 11:08:21.189660 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:21.188622    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/8987957b-efce-44fe-9da6-d3d7d4c06b6c-hostroot\") pod \"multus-f2bxq\" (UID: \"8987957b-efce-44fe-9da6-d3d7d4c06b6c\") " pod="openshift-multus/multus-f2bxq"
Jul 16 11:08:21.189660 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:21.188622    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/60499157-9d8a-4985-802c-be1c0ae7f411-tuning-conf-dir\") pod \"multus-additional-cni-plugins-klw5l\" (UID: \"60499157-9d8a-4985-802c-be1c0ae7f411\") " pod="openshift-multus/multus-additional-cni-plugins-klw5l"
Jul 16 11:08:21.189660 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:21.188664    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/8987957b-efce-44fe-9da6-d3d7d4c06b6c-hostroot\") pod \"multus-f2bxq\" (UID: \"8987957b-efce-44fe-9da6-d3d7d4c06b6c\") " pod="openshift-multus/multus-f2bxq"
Jul 16 11:08:21.189660 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:21.188784    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8987957b-efce-44fe-9da6-d3d7d4c06b6c-cni-binary-copy\") pod \"multus-f2bxq\" (UID: \"8987957b-efce-44fe-9da6-d3d7d4c06b6c\") " pod="openshift-multus/multus-f2bxq"
Jul 16 11:08:21.189660 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:21.188907    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/60499157-9d8a-4985-802c-be1c0ae7f411-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-klw5l\" (UID: \"60499157-9d8a-4985-802c-be1c0ae7f411\") " pod="openshift-multus/multus-additional-cni-plugins-klw5l"
Jul 16 11:08:21.190266 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:21.189381    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/1654c4da-b013-4bca-a0a8-5efe36c38fee-agent-certs\") pod \"konnectivity-agent-hbhws\" (UID: \"1654c4da-b013-4bca-a0a8-5efe36c38fee\") " pod="kube-system/konnectivity-agent-hbhws"
Jul 16 11:08:21.190266 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:21.189619    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/aee7cbaf-a5e0-4e57-a9c1-504820f7f036-ovn-node-metrics-cert\") pod \"ovnkube-node-fchvw\" (UID: \"aee7cbaf-a5e0-4e57-a9c1-504820f7f036\") " pod="openshift-ovn-kubernetes/ovnkube-node-fchvw"
Jul 16 11:08:21.194397 ip-10-0-135-184 kubenswrapper[2564]: E0716 11:08:21.194377    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 16 11:08:21.194475 ip-10-0-135-184 kubenswrapper[2564]: E0716 11:08:21.194402    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 16 11:08:21.194475 ip-10-0-135-184 kubenswrapper[2564]: E0716 11:08:21.194414    2564 projected.go:196] Error preparing data for projected volume kube-api-access-frzsp for pod openshift-network-diagnostics/network-check-target-hwl88: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 16 11:08:21.194574 ip-10-0-135-184 kubenswrapper[2564]: E0716 11:08:21.194495    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0e88ea25-f79a-4275-a633-ba76d5b1ec27-kube-api-access-frzsp podName:0e88ea25-f79a-4275-a633-ba76d5b1ec27 nodeName:}" failed. No retries permitted until 2026-07-16 11:08:21.694456274 +0000 UTC m=+2.065993317 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-frzsp" (UniqueName: "kubernetes.io/projected/0e88ea25-f79a-4275-a633-ba76d5b1ec27-kube-api-access-frzsp") pod "network-check-target-hwl88" (UID: "0e88ea25-f79a-4275-a633-ba76d5b1ec27") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 16 11:08:21.197821 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:21.197783    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ccnqd\" (UniqueName: \"kubernetes.io/projected/8987957b-efce-44fe-9da6-d3d7d4c06b6c-kube-api-access-ccnqd\") pod \"multus-f2bxq\" (UID: \"8987957b-efce-44fe-9da6-d3d7d4c06b6c\") " pod="openshift-multus/multus-f2bxq"
Jul 16 11:08:21.197985 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:21.197936    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nkrpb\" (UniqueName: \"kubernetes.io/projected/60499157-9d8a-4985-802c-be1c0ae7f411-kube-api-access-nkrpb\") pod \"multus-additional-cni-plugins-klw5l\" (UID: \"60499157-9d8a-4985-802c-be1c0ae7f411\") " pod="openshift-multus/multus-additional-cni-plugins-klw5l"
Jul 16 11:08:21.198098 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:21.198073    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7h444\" (UniqueName: \"kubernetes.io/projected/28bc7393-164f-4deb-89da-69443b46c55e-kube-api-access-7h444\") pod \"network-metrics-daemon-pxp5q\" (UID: \"28bc7393-164f-4deb-89da-69443b46c55e\") " pod="openshift-multus/network-metrics-daemon-pxp5q"
Jul 16 11:08:21.198390 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:21.198359    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v7sgv\" (UniqueName: \"kubernetes.io/projected/e335433b-f42b-4f52-b88e-02f36ff33f83-kube-api-access-v7sgv\") pod \"node-resolver-44kqf\" (UID: \"e335433b-f42b-4f52-b88e-02f36ff33f83\") " pod="openshift-dns/node-resolver-44kqf"
Jul 16 11:08:21.198884 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:21.198864    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6gwrv\" (UniqueName: \"kubernetes.io/projected/dfe01fed-00e2-4080-941e-d27f5d4c9770-kube-api-access-6gwrv\") pod \"iptables-alerter-47b72\" (UID: \"dfe01fed-00e2-4080-941e-d27f5d4c9770\") " pod="openshift-network-operator/iptables-alerter-47b72"
Jul 16 11:08:21.199256 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:21.199236    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h4dtg\" (UniqueName: \"kubernetes.io/projected/aee7cbaf-a5e0-4e57-a9c1-504820f7f036-kube-api-access-h4dtg\") pod \"ovnkube-node-fchvw\" (UID: \"aee7cbaf-a5e0-4e57-a9c1-504820f7f036\") " pod="openshift-ovn-kubernetes/ovnkube-node-fchvw"
Jul 16 11:08:21.290087 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:21.290035    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/55506f12-a9f6-4576-b250-576b091deb19-kubelet-config\") pod \"global-pull-secret-syncer-pzsf4\" (UID: \"55506f12-a9f6-4576-b250-576b091deb19\") " pod="kube-system/global-pull-secret-syncer-pzsf4"
Jul 16 11:08:21.290087 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:21.290086    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/9c276d4c-a51d-4372-b426-64f3a255a06a-registration-dir\") pod \"aws-ebs-csi-driver-node-n7bx8\" (UID: \"9c276d4c-a51d-4372-b426-64f3a255a06a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n7bx8"
Jul 16 11:08:21.290392 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:21.290249    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/55506f12-a9f6-4576-b250-576b091deb19-kubelet-config\") pod \"global-pull-secret-syncer-pzsf4\" (UID: \"55506f12-a9f6-4576-b250-576b091deb19\") " pod="kube-system/global-pull-secret-syncer-pzsf4"
Jul 16 11:08:21.290392 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:21.290281    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/f4253474-3da3-431f-a86c-28e25e1c7a52-etc-modprobe-d\") pod \"tuned-qnhsv\" (UID: \"f4253474-3da3-431f-a86c-28e25e1c7a52\") " pod="openshift-cluster-node-tuning-operator/tuned-qnhsv"
Jul 16 11:08:21.290392 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:21.290317    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/9c276d4c-a51d-4372-b426-64f3a255a06a-etc-selinux\") pod \"aws-ebs-csi-driver-node-n7bx8\" (UID: \"9c276d4c-a51d-4372-b426-64f3a255a06a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n7bx8"
Jul 16 11:08:21.290392 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:21.290256    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/9c276d4c-a51d-4372-b426-64f3a255a06a-registration-dir\") pod \"aws-ebs-csi-driver-node-n7bx8\" (UID: \"9c276d4c-a51d-4372-b426-64f3a255a06a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n7bx8"
Jul 16 11:08:21.290392 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:21.290346    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fb8hd\" (UniqueName: \"kubernetes.io/projected/9c276d4c-a51d-4372-b426-64f3a255a06a-kube-api-access-fb8hd\") pod \"aws-ebs-csi-driver-node-n7bx8\" (UID: \"9c276d4c-a51d-4372-b426-64f3a255a06a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n7bx8"
Jul 16 11:08:21.290392 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:21.290377    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/f4253474-3da3-431f-a86c-28e25e1c7a52-etc-sysconfig\") pod \"tuned-qnhsv\" (UID: \"f4253474-3da3-431f-a86c-28e25e1c7a52\") " pod="openshift-cluster-node-tuning-operator/tuned-qnhsv"
Jul 16 11:08:21.290669 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:21.290402    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f4253474-3da3-431f-a86c-28e25e1c7a52-etc-kubernetes\") pod \"tuned-qnhsv\" (UID: \"f4253474-3da3-431f-a86c-28e25e1c7a52\") " pod="openshift-cluster-node-tuning-operator/tuned-qnhsv"
Jul 16 11:08:21.290669 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:21.290428    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/f4253474-3da3-431f-a86c-28e25e1c7a52-etc-systemd\") pod \"tuned-qnhsv\" (UID: \"f4253474-3da3-431f-a86c-28e25e1c7a52\") " pod="openshift-cluster-node-tuning-operator/tuned-qnhsv"
Jul 16 11:08:21.290669 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:21.290427    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/9c276d4c-a51d-4372-b426-64f3a255a06a-etc-selinux\") pod \"aws-ebs-csi-driver-node-n7bx8\" (UID: \"9c276d4c-a51d-4372-b426-64f3a255a06a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n7bx8"
Jul 16 11:08:21.290669 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:21.290454    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/f4253474-3da3-431f-a86c-28e25e1c7a52-run\") pod \"tuned-qnhsv\" (UID: \"f4253474-3da3-431f-a86c-28e25e1c7a52\") " pod="openshift-cluster-node-tuning-operator/tuned-qnhsv"
Jul 16 11:08:21.290669 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:21.290459    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/f4253474-3da3-431f-a86c-28e25e1c7a52-etc-sysconfig\") pod \"tuned-qnhsv\" (UID: \"f4253474-3da3-431f-a86c-28e25e1c7a52\") " pod="openshift-cluster-node-tuning-operator/tuned-qnhsv"
Jul 16 11:08:21.290669 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:21.290452    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/f4253474-3da3-431f-a86c-28e25e1c7a52-etc-modprobe-d\") pod \"tuned-qnhsv\" (UID: \"f4253474-3da3-431f-a86c-28e25e1c7a52\") " pod="openshift-cluster-node-tuning-operator/tuned-qnhsv"
Jul 16 11:08:21.290669 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:21.290534    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f4253474-3da3-431f-a86c-28e25e1c7a52-etc-kubernetes\") pod \"tuned-qnhsv\" (UID: \"f4253474-3da3-431f-a86c-28e25e1c7a52\") " pod="openshift-cluster-node-tuning-operator/tuned-qnhsv"
Jul 16 11:08:21.290669 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:21.290593    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/f4253474-3da3-431f-a86c-28e25e1c7a52-etc-systemd\") pod \"tuned-qnhsv\" (UID: \"f4253474-3da3-431f-a86c-28e25e1c7a52\") " pod="openshift-cluster-node-tuning-operator/tuned-qnhsv"
Jul 16 11:08:21.290669 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:21.290634    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/f4253474-3da3-431f-a86c-28e25e1c7a52-run\") pod \"tuned-qnhsv\" (UID: \"f4253474-3da3-431f-a86c-28e25e1c7a52\") " pod="openshift-cluster-node-tuning-operator/tuned-qnhsv"
Jul 16 11:08:21.290669 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:21.290658    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/9c276d4c-a51d-4372-b426-64f3a255a06a-kubelet-dir\") pod \"aws-ebs-csi-driver-node-n7bx8\" (UID: \"9c276d4c-a51d-4372-b426-64f3a255a06a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n7bx8"
Jul 16 11:08:21.291173 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:21.290677    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f4253474-3da3-431f-a86c-28e25e1c7a52-sys\") pod \"tuned-qnhsv\" (UID: \"f4253474-3da3-431f-a86c-28e25e1c7a52\") " pod="openshift-cluster-node-tuning-operator/tuned-qnhsv"
Jul 16 11:08:21.291173 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:21.290697    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/55506f12-a9f6-4576-b250-576b091deb19-dbus\") pod \"global-pull-secret-syncer-pzsf4\" (UID: \"55506f12-a9f6-4576-b250-576b091deb19\") " pod="kube-system/global-pull-secret-syncer-pzsf4"
Jul 16 11:08:21.291173 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:21.290709    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/9c276d4c-a51d-4372-b426-64f3a255a06a-kubelet-dir\") pod \"aws-ebs-csi-driver-node-n7bx8\" (UID: \"9c276d4c-a51d-4372-b426-64f3a255a06a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n7bx8"
Jul 16 11:08:21.291173 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:21.290754    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/55506f12-a9f6-4576-b250-576b091deb19-dbus\") pod \"global-pull-secret-syncer-pzsf4\" (UID: \"55506f12-a9f6-4576-b250-576b091deb19\") " pod="kube-system/global-pull-secret-syncer-pzsf4"
Jul 16 11:08:21.291173 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:21.290713    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/f4253474-3da3-431f-a86c-28e25e1c7a52-etc-sysctl-conf\") pod \"tuned-qnhsv\" (UID: \"f4253474-3da3-431f-a86c-28e25e1c7a52\") " pod="openshift-cluster-node-tuning-operator/tuned-qnhsv"
Jul 16 11:08:21.291173 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:21.290788    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f4253474-3da3-431f-a86c-28e25e1c7a52-sys\") pod \"tuned-qnhsv\" (UID: \"f4253474-3da3-431f-a86c-28e25e1c7a52\") " pod="openshift-cluster-node-tuning-operator/tuned-qnhsv"
Jul 16 11:08:21.291173 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:21.290825    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/f4253474-3da3-431f-a86c-28e25e1c7a52-etc-sysctl-conf\") pod \"tuned-qnhsv\" (UID: \"f4253474-3da3-431f-a86c-28e25e1c7a52\") " pod="openshift-cluster-node-tuning-operator/tuned-qnhsv"
Jul 16 11:08:21.291173 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:21.290827    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f4253474-3da3-431f-a86c-28e25e1c7a52-tmp\") pod \"tuned-qnhsv\" (UID: \"f4253474-3da3-431f-a86c-28e25e1c7a52\") " pod="openshift-cluster-node-tuning-operator/tuned-qnhsv"
Jul 16 11:08:21.291173 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:21.290869    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/9c276d4c-a51d-4372-b426-64f3a255a06a-device-dir\") pod \"aws-ebs-csi-driver-node-n7bx8\" (UID: \"9c276d4c-a51d-4372-b426-64f3a255a06a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n7bx8"
Jul 16 11:08:21.291173 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:21.290897    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rfkrl\" (UniqueName: \"kubernetes.io/projected/47ecd32d-7f31-43d9-9828-d2621113d37c-kube-api-access-rfkrl\") pod \"node-ca-2frcp\" (UID: \"47ecd32d-7f31-43d9-9828-d2621113d37c\") " pod="openshift-image-registry/node-ca-2frcp"
Jul 16 11:08:21.291173 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:21.290936    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/9c276d4c-a51d-4372-b426-64f3a255a06a-device-dir\") pod \"aws-ebs-csi-driver-node-n7bx8\" (UID: \"9c276d4c-a51d-4372-b426-64f3a255a06a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n7bx8"
Jul 16 11:08:21.291173 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:21.290941    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/47ecd32d-7f31-43d9-9828-d2621113d37c-serviceca\") pod \"node-ca-2frcp\" (UID: \"47ecd32d-7f31-43d9-9828-d2621113d37c\") " pod="openshift-image-registry/node-ca-2frcp"
Jul 16 11:08:21.291173 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:21.290989    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f4253474-3da3-431f-a86c-28e25e1c7a52-host\") pod \"tuned-qnhsv\" (UID: \"f4253474-3da3-431f-a86c-28e25e1c7a52\") " pod="openshift-cluster-node-tuning-operator/tuned-qnhsv"
Jul 16 11:08:21.291173 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:21.291012    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lmsbz\" (UniqueName: \"kubernetes.io/projected/f4253474-3da3-431f-a86c-28e25e1c7a52-kube-api-access-lmsbz\") pod \"tuned-qnhsv\" (UID: \"f4253474-3da3-431f-a86c-28e25e1c7a52\") " pod="openshift-cluster-node-tuning-operator/tuned-qnhsv"
Jul 16 11:08:21.291173 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:21.291048    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/9c276d4c-a51d-4372-b426-64f3a255a06a-socket-dir\") pod \"aws-ebs-csi-driver-node-n7bx8\" (UID: \"9c276d4c-a51d-4372-b426-64f3a255a06a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n7bx8"
Jul 16 11:08:21.292032 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:21.291094    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f4253474-3da3-431f-a86c-28e25e1c7a52-host\") pod \"tuned-qnhsv\" (UID: \"f4253474-3da3-431f-a86c-28e25e1c7a52\") " pod="openshift-cluster-node-tuning-operator/tuned-qnhsv"
Jul 16 11:08:21.292032 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:21.291101    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/47ecd32d-7f31-43d9-9828-d2621113d37c-host\") pod \"node-ca-2frcp\" (UID: \"47ecd32d-7f31-43d9-9828-d2621113d37c\") " pod="openshift-image-registry/node-ca-2frcp"
Jul 16 11:08:21.292032 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:21.291137    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/47ecd32d-7f31-43d9-9828-d2621113d37c-host\") pod \"node-ca-2frcp\" (UID: \"47ecd32d-7f31-43d9-9828-d2621113d37c\") " pod="openshift-image-registry/node-ca-2frcp"
Jul 16 11:08:21.292032 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:21.291136    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/f4253474-3da3-431f-a86c-28e25e1c7a52-etc-tuned\") pod \"tuned-qnhsv\" (UID: \"f4253474-3da3-431f-a86c-28e25e1c7a52\") " pod="openshift-cluster-node-tuning-operator/tuned-qnhsv"
Jul 16 11:08:21.292032 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:21.291180    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/55506f12-a9f6-4576-b250-576b091deb19-original-pull-secret\") pod \"global-pull-secret-syncer-pzsf4\" (UID: \"55506f12-a9f6-4576-b250-576b091deb19\") " pod="kube-system/global-pull-secret-syncer-pzsf4"
Jul 16 11:08:21.292032 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:21.291211    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/9c276d4c-a51d-4372-b426-64f3a255a06a-sys-fs\") pod \"aws-ebs-csi-driver-node-n7bx8\" (UID: \"9c276d4c-a51d-4372-b426-64f3a255a06a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n7bx8"
Jul 16 11:08:21.292032 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:21.291239    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/f4253474-3da3-431f-a86c-28e25e1c7a52-etc-sysctl-d\") pod \"tuned-qnhsv\" (UID: \"f4253474-3da3-431f-a86c-28e25e1c7a52\") " pod="openshift-cluster-node-tuning-operator/tuned-qnhsv"
Jul 16 11:08:21.292032 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:21.291283    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/9c276d4c-a51d-4372-b426-64f3a255a06a-socket-dir\") pod \"aws-ebs-csi-driver-node-n7bx8\" (UID: \"9c276d4c-a51d-4372-b426-64f3a255a06a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n7bx8"
Jul 16 11:08:21.292032 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:21.291297    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f4253474-3da3-431f-a86c-28e25e1c7a52-lib-modules\") pod \"tuned-qnhsv\" (UID: \"f4253474-3da3-431f-a86c-28e25e1c7a52\") " pod="openshift-cluster-node-tuning-operator/tuned-qnhsv"
Jul 16 11:08:21.292032 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:21.291361    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/9c276d4c-a51d-4372-b426-64f3a255a06a-sys-fs\") pod \"aws-ebs-csi-driver-node-n7bx8\" (UID: \"9c276d4c-a51d-4372-b426-64f3a255a06a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n7bx8"
Jul 16 11:08:21.292032 ip-10-0-135-184 kubenswrapper[2564]: E0716 11:08:21.291397    2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 16 11:08:21.292032 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:21.291420    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f4253474-3da3-431f-a86c-28e25e1c7a52-var-lib-kubelet\") pod \"tuned-qnhsv\" (UID: \"f4253474-3da3-431f-a86c-28e25e1c7a52\") " pod="openshift-cluster-node-tuning-operator/tuned-qnhsv"
Jul 16 11:08:21.292032 ip-10-0-135-184 kubenswrapper[2564]: E0716 11:08:21.291467    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/55506f12-a9f6-4576-b250-576b091deb19-original-pull-secret podName:55506f12-a9f6-4576-b250-576b091deb19 nodeName:}" failed. No retries permitted until 2026-07-16 11:08:21.791448723 +0000 UTC m=+2.162985764 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/55506f12-a9f6-4576-b250-576b091deb19-original-pull-secret") pod "global-pull-secret-syncer-pzsf4" (UID: "55506f12-a9f6-4576-b250-576b091deb19") : object "kube-system"/"original-pull-secret" not registered
Jul 16 11:08:21.292032 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:21.291551    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/f4253474-3da3-431f-a86c-28e25e1c7a52-etc-sysctl-d\") pod \"tuned-qnhsv\" (UID: \"f4253474-3da3-431f-a86c-28e25e1c7a52\") " pod="openshift-cluster-node-tuning-operator/tuned-qnhsv"
Jul 16 11:08:21.292566 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:21.291605    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f4253474-3da3-431f-a86c-28e25e1c7a52-var-lib-kubelet\") pod \"tuned-qnhsv\" (UID: \"f4253474-3da3-431f-a86c-28e25e1c7a52\") " pod="openshift-cluster-node-tuning-operator/tuned-qnhsv"
Jul 16 11:08:21.292566 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:21.291704    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f4253474-3da3-431f-a86c-28e25e1c7a52-lib-modules\") pod \"tuned-qnhsv\" (UID: \"f4253474-3da3-431f-a86c-28e25e1c7a52\") " pod="openshift-cluster-node-tuning-operator/tuned-qnhsv"
Jul 16 11:08:21.292566 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:21.292237    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/47ecd32d-7f31-43d9-9828-d2621113d37c-serviceca\") pod \"node-ca-2frcp\" (UID: \"47ecd32d-7f31-43d9-9828-d2621113d37c\") " pod="openshift-image-registry/node-ca-2frcp"
Jul 16 11:08:21.293672 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:21.293647    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f4253474-3da3-431f-a86c-28e25e1c7a52-tmp\") pod \"tuned-qnhsv\" (UID: \"f4253474-3da3-431f-a86c-28e25e1c7a52\") " pod="openshift-cluster-node-tuning-operator/tuned-qnhsv"
Jul 16 11:08:21.293773 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:21.293709    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/f4253474-3da3-431f-a86c-28e25e1c7a52-etc-tuned\") pod \"tuned-qnhsv\" (UID: \"f4253474-3da3-431f-a86c-28e25e1c7a52\") " pod="openshift-cluster-node-tuning-operator/tuned-qnhsv"
Jul 16 11:08:21.301362 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:21.301324    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rfkrl\" (UniqueName: \"kubernetes.io/projected/47ecd32d-7f31-43d9-9828-d2621113d37c-kube-api-access-rfkrl\") pod \"node-ca-2frcp\" (UID: \"47ecd32d-7f31-43d9-9828-d2621113d37c\") " pod="openshift-image-registry/node-ca-2frcp"
Jul 16 11:08:21.301362 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:21.301350    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lmsbz\" (UniqueName: \"kubernetes.io/projected/f4253474-3da3-431f-a86c-28e25e1c7a52-kube-api-access-lmsbz\") pod \"tuned-qnhsv\" (UID: \"f4253474-3da3-431f-a86c-28e25e1c7a52\") " pod="openshift-cluster-node-tuning-operator/tuned-qnhsv"
Jul 16 11:08:21.301560 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:21.301512    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fb8hd\" (UniqueName: \"kubernetes.io/projected/9c276d4c-a51d-4372-b426-64f3a255a06a-kube-api-access-fb8hd\") pod \"aws-ebs-csi-driver-node-n7bx8\" (UID: \"9c276d4c-a51d-4372-b426-64f3a255a06a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n7bx8"
Jul 16 11:08:21.373764 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:21.373720    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5e44ce4b9dc5eed0a3686382d6febba7.slice/crio-906d5da7236ee8fe02872f6a43da93c22cd5be50892750387d6388e92c1bfd41 WatchSource:0}: Error finding container 906d5da7236ee8fe02872f6a43da93c22cd5be50892750387d6388e92c1bfd41: Status 404 returned error can't find the container with id 906d5da7236ee8fe02872f6a43da93c22cd5be50892750387d6388e92c1bfd41
Jul 16 11:08:21.374057 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:21.374033    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podac5863ecfed3d0f647282c9bdf712234.slice/crio-cab0a7654d5dc5c528ca782685a87b2a5ac8531dd77eb13b5d6ea4ae01395fb5 WatchSource:0}: Error finding container cab0a7654d5dc5c528ca782685a87b2a5ac8531dd77eb13b5d6ea4ae01395fb5: Status 404 returned error can't find the container with id cab0a7654d5dc5c528ca782685a87b2a5ac8531dd77eb13b5d6ea4ae01395fb5
Jul 16 11:08:21.379270 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:21.379247    2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 16 11:08:21.393461 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:21.393433    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-fchvw"
Jul 16 11:08:21.402334 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:21.402307    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaee7cbaf_a5e0_4e57_a9c1_504820f7f036.slice/crio-2de9b367c9afcf8a7d99266c6fc140edffbfd622e4208491dbcea4e52c1fcfea WatchSource:0}: Error finding container 2de9b367c9afcf8a7d99266c6fc140edffbfd622e4208491dbcea4e52c1fcfea: Status 404 returned error can't find the container with id 2de9b367c9afcf8a7d99266c6fc140edffbfd622e4208491dbcea4e52c1fcfea
Jul 16 11:08:21.410486 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:21.410462    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-klw5l"
Jul 16 11:08:21.418767 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:21.418736    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod60499157_9d8a_4985_802c_be1c0ae7f411.slice/crio-270e60ec8fb002d2d1bb43daa89ec6da45a841ecad2bdb6177c126b411b54245 WatchSource:0}: Error finding container 270e60ec8fb002d2d1bb43daa89ec6da45a841ecad2bdb6177c126b411b54245: Status 404 returned error can't find the container with id 270e60ec8fb002d2d1bb43daa89ec6da45a841ecad2bdb6177c126b411b54245
Jul 16 11:08:21.428260 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:21.428237    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-f2bxq"
Jul 16 11:08:21.436374 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:21.436345    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8987957b_efce_44fe_9da6_d3d7d4c06b6c.slice/crio-c9932c66e2b1f6d7a80e63a901e7790345b6818a4bcfe04ad1fca5789178fdf0 WatchSource:0}: Error finding container c9932c66e2b1f6d7a80e63a901e7790345b6818a4bcfe04ad1fca5789178fdf0: Status 404 returned error can't find the container with id c9932c66e2b1f6d7a80e63a901e7790345b6818a4bcfe04ad1fca5789178fdf0
Jul 16 11:08:21.446352 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:21.446324    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-47b72"
Jul 16 11:08:21.454210 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:21.454184    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddfe01fed_00e2_4080_941e_d27f5d4c9770.slice/crio-c848fb6052296d4a6e56cfde6185761050d11dce0a646fc1e4b938bd542d34b7 WatchSource:0}: Error finding container c848fb6052296d4a6e56cfde6185761050d11dce0a646fc1e4b938bd542d34b7: Status 404 returned error can't find the container with id c848fb6052296d4a6e56cfde6185761050d11dce0a646fc1e4b938bd542d34b7
Jul 16 11:08:21.470870 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:21.470840    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-hbhws"
Jul 16 11:08:21.479776 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:21.479742    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1654c4da_b013_4bca_a0a8_5efe36c38fee.slice/crio-83aaac024e0687d93100ae7b0090e41c6fef39b6e73d7d56fa0d1c4df6b524bc WatchSource:0}: Error finding container 83aaac024e0687d93100ae7b0090e41c6fef39b6e73d7d56fa0d1c4df6b524bc: Status 404 returned error can't find the container with id 83aaac024e0687d93100ae7b0090e41c6fef39b6e73d7d56fa0d1c4df6b524bc
Jul 16 11:08:21.485036 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:21.485010    2564 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 16 11:08:21.488549 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:21.488526    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-44kqf"
Jul 16 11:08:21.496906 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:21.496876    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode335433b_f42b_4f52_b88e_02f36ff33f83.slice/crio-16b65b5fbf1eb828d8368a79f148d68d705e9a954d1d167be16d17032e2ee7e2 WatchSource:0}: Error finding container 16b65b5fbf1eb828d8368a79f148d68d705e9a954d1d167be16d17032e2ee7e2: Status 404 returned error can't find the container with id 16b65b5fbf1eb828d8368a79f148d68d705e9a954d1d167be16d17032e2ee7e2
Jul 16 11:08:21.513485 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:21.513454    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-2frcp"
Jul 16 11:08:21.522397 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:21.522367    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod47ecd32d_7f31_43d9_9828_d2621113d37c.slice/crio-d7b3e2ff0e5e9f0d593ceab8d2e80df10e70eb563aaaec22bf52f7142d7ef902 WatchSource:0}: Error finding container d7b3e2ff0e5e9f0d593ceab8d2e80df10e70eb563aaaec22bf52f7142d7ef902: Status 404 returned error can't find the container with id d7b3e2ff0e5e9f0d593ceab8d2e80df10e70eb563aaaec22bf52f7142d7ef902
Jul 16 11:08:21.524154 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:21.524129    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-qnhsv"
Jul 16 11:08:21.529895 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:21.529871    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n7bx8"
Jul 16 11:08:21.533466 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:21.533421    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf4253474_3da3_431f_a86c_28e25e1c7a52.slice/crio-a7f1ea8035bd06ce86ee799279f448407b05535284fc636cad3c211c0c4bda0d WatchSource:0}: Error finding container a7f1ea8035bd06ce86ee799279f448407b05535284fc636cad3c211c0c4bda0d: Status 404 returned error can't find the container with id a7f1ea8035bd06ce86ee799279f448407b05535284fc636cad3c211c0c4bda0d
Jul 16 11:08:21.539506 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:21.539477    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9c276d4c_a51d_4372_b426_64f3a255a06a.slice/crio-cacb11ce0acd17635068e743f4739d6a71dfa4c4275fc0a8aa6f62ec8e7b344d WatchSource:0}: Error finding container cacb11ce0acd17635068e743f4739d6a71dfa4c4275fc0a8aa6f62ec8e7b344d: Status 404 returned error can't find the container with id cacb11ce0acd17635068e743f4739d6a71dfa4c4275fc0a8aa6f62ec8e7b344d
Jul 16 11:08:21.541506 ip-10-0-135-184 kubenswrapper[2564]: E0716 11:08:21.541477    2564 kuberuntime_manager.go:1459] "Unhandled Error" err="container csi-driver start failed in pod aws-ebs-csi-driver-node-n7bx8_openshift-cluster-csi-drivers(9c276d4c-a51d-4372-b426-64f3a255a06a): ErrImagePull: pull QPS exceeded" logger="UnhandledError"
Jul 16 11:08:21.542512 ip-10-0-135-184 kubenswrapper[2564]: E0716 11:08:21.542492    2564 kuberuntime_manager.go:1459] "Unhandled Error" err="container csi-node-driver-registrar start failed in pod aws-ebs-csi-driver-node-n7bx8_openshift-cluster-csi-drivers(9c276d4c-a51d-4372-b426-64f3a255a06a): ErrImagePull: pull QPS exceeded" logger="UnhandledError"
Jul 16 11:08:21.543294 ip-10-0-135-184 kubenswrapper[2564]: E0716 11:08:21.543277    2564 kuberuntime_manager.go:1459] "Unhandled Error" err="container csi-liveness-probe start failed in pod aws-ebs-csi-driver-node-n7bx8_openshift-cluster-csi-drivers(9c276d4c-a51d-4372-b426-64f3a255a06a): ErrImagePull: pull QPS exceeded" logger="UnhandledError"
Jul 16 11:08:21.544487 ip-10-0-135-184 kubenswrapper[2564]: E0716 11:08:21.544459    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="[failed to \"StartContainer\" for \"csi-driver\" with ErrImagePull: \"pull QPS exceeded\", failed to \"StartContainer\" for \"csi-node-driver-registrar\" with ErrImagePull: \"pull QPS exceeded\", failed to \"StartContainer\" for \"csi-liveness-probe\" with ErrImagePull: \"pull QPS exceeded\"]" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n7bx8" podUID="9c276d4c-a51d-4372-b426-64f3a255a06a"
Jul 16 11:08:21.628699 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:21.628597    2564 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 16 11:08:21.694626 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:21.694588    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-frzsp\" (UniqueName: \"kubernetes.io/projected/0e88ea25-f79a-4275-a633-ba76d5b1ec27-kube-api-access-frzsp\") pod \"network-check-target-hwl88\" (UID: \"0e88ea25-f79a-4275-a633-ba76d5b1ec27\") " pod="openshift-network-diagnostics/network-check-target-hwl88"
Jul 16 11:08:21.694806 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:21.694634    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/28bc7393-164f-4deb-89da-69443b46c55e-metrics-certs\") pod \"network-metrics-daemon-pxp5q\" (UID: \"28bc7393-164f-4deb-89da-69443b46c55e\") " pod="openshift-multus/network-metrics-daemon-pxp5q"
Jul 16 11:08:21.694806 ip-10-0-135-184 kubenswrapper[2564]: E0716 11:08:21.694773    2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 16 11:08:21.694902 ip-10-0-135-184 kubenswrapper[2564]: E0716 11:08:21.694802    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 16 11:08:21.694902 ip-10-0-135-184 kubenswrapper[2564]: E0716 11:08:21.694827    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 16 11:08:21.694902 ip-10-0-135-184 kubenswrapper[2564]: E0716 11:08:21.694837    2564 projected.go:196] Error preparing data for projected volume kube-api-access-frzsp for pod openshift-network-diagnostics/network-check-target-hwl88: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 16 11:08:21.694902 ip-10-0-135-184 kubenswrapper[2564]: E0716 11:08:21.694848    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/28bc7393-164f-4deb-89da-69443b46c55e-metrics-certs podName:28bc7393-164f-4deb-89da-69443b46c55e nodeName:}" failed. No retries permitted until 2026-07-16 11:08:22.694832402 +0000 UTC m=+3.066369422 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/28bc7393-164f-4deb-89da-69443b46c55e-metrics-certs") pod "network-metrics-daemon-pxp5q" (UID: "28bc7393-164f-4deb-89da-69443b46c55e") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 16 11:08:21.694902 ip-10-0-135-184 kubenswrapper[2564]: E0716 11:08:21.694885    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0e88ea25-f79a-4275-a633-ba76d5b1ec27-kube-api-access-frzsp podName:0e88ea25-f79a-4275-a633-ba76d5b1ec27 nodeName:}" failed. No retries permitted until 2026-07-16 11:08:22.69487178 +0000 UTC m=+3.066408801 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-frzsp" (UniqueName: "kubernetes.io/projected/0e88ea25-f79a-4275-a633-ba76d5b1ec27-kube-api-access-frzsp") pod "network-check-target-hwl88" (UID: "0e88ea25-f79a-4275-a633-ba76d5b1ec27") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 16 11:08:21.795518 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:21.795481    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/55506f12-a9f6-4576-b250-576b091deb19-original-pull-secret\") pod \"global-pull-secret-syncer-pzsf4\" (UID: \"55506f12-a9f6-4576-b250-576b091deb19\") " pod="kube-system/global-pull-secret-syncer-pzsf4"
Jul 16 11:08:21.795712 ip-10-0-135-184 kubenswrapper[2564]: E0716 11:08:21.795636    2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 16 11:08:21.795712 ip-10-0-135-184 kubenswrapper[2564]: E0716 11:08:21.795705    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/55506f12-a9f6-4576-b250-576b091deb19-original-pull-secret podName:55506f12-a9f6-4576-b250-576b091deb19 nodeName:}" failed. No retries permitted until 2026-07-16 11:08:22.795685852 +0000 UTC m=+3.167222878 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/55506f12-a9f6-4576-b250-576b091deb19-original-pull-secret") pod "global-pull-secret-syncer-pzsf4" (UID: "55506f12-a9f6-4576-b250-576b091deb19") : object "kube-system"/"original-pull-secret" not registered
Jul 16 11:08:22.126988 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:22.126815    2564 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-15 11:03:21 +0000 UTC" deadline="2028-01-31 15:38:16.920345527 +0000 UTC"
Jul 16 11:08:22.126988 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:22.126863    2564 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13540h29m54.793488045s"
Jul 16 11:08:22.298891 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:22.298318    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hwl88"
Jul 16 11:08:22.298891 ip-10-0-135-184 kubenswrapper[2564]: E0716 11:08:22.298463    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hwl88" podUID="0e88ea25-f79a-4275-a633-ba76d5b1ec27"
Jul 16 11:08:22.325377 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:22.325303    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-hbhws" event={"ID":"1654c4da-b013-4bca-a0a8-5efe36c38fee","Type":"ContainerStarted","Data":"83aaac024e0687d93100ae7b0090e41c6fef39b6e73d7d56fa0d1c4df6b524bc"}
Jul 16 11:08:22.326862 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:22.326817    2564 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 16 11:08:22.336868 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:22.336813    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fchvw" event={"ID":"aee7cbaf-a5e0-4e57-a9c1-504820f7f036","Type":"ContainerStarted","Data":"2de9b367c9afcf8a7d99266c6fc140edffbfd622e4208491dbcea4e52c1fcfea"}
Jul 16 11:08:22.353888 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:22.351924    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-184.ec2.internal" event={"ID":"5e44ce4b9dc5eed0a3686382d6febba7","Type":"ContainerStarted","Data":"906d5da7236ee8fe02872f6a43da93c22cd5be50892750387d6388e92c1bfd41"}
Jul 16 11:08:22.363716 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:22.362225    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-qnhsv" event={"ID":"f4253474-3da3-431f-a86c-28e25e1c7a52","Type":"ContainerStarted","Data":"a7f1ea8035bd06ce86ee799279f448407b05535284fc636cad3c211c0c4bda0d"}
Jul 16 11:08:22.382633 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:22.382527    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-2frcp" event={"ID":"47ecd32d-7f31-43d9-9828-d2621113d37c","Type":"ContainerStarted","Data":"d7b3e2ff0e5e9f0d593ceab8d2e80df10e70eb563aaaec22bf52f7142d7ef902"}
Jul 16 11:08:22.395916 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:22.395798    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-44kqf" event={"ID":"e335433b-f42b-4f52-b88e-02f36ff33f83","Type":"ContainerStarted","Data":"16b65b5fbf1eb828d8368a79f148d68d705e9a954d1d167be16d17032e2ee7e2"}
Jul 16 11:08:22.411646 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:22.411570    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-47b72" event={"ID":"dfe01fed-00e2-4080-941e-d27f5d4c9770","Type":"ContainerStarted","Data":"c848fb6052296d4a6e56cfde6185761050d11dce0a646fc1e4b938bd542d34b7"}
Jul 16 11:08:22.436366 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:22.436317    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-f2bxq" event={"ID":"8987957b-efce-44fe-9da6-d3d7d4c06b6c","Type":"ContainerStarted","Data":"c9932c66e2b1f6d7a80e63a901e7790345b6818a4bcfe04ad1fca5789178fdf0"}
Jul 16 11:08:22.441444 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:22.441401    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-klw5l" event={"ID":"60499157-9d8a-4985-802c-be1c0ae7f411","Type":"ContainerStarted","Data":"270e60ec8fb002d2d1bb43daa89ec6da45a841ecad2bdb6177c126b411b54245"}
Jul 16 11:08:22.461528 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:22.461276    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-184.ec2.internal" event={"ID":"ac5863ecfed3d0f647282c9bdf712234","Type":"ContainerStarted","Data":"cab0a7654d5dc5c528ca782685a87b2a5ac8531dd77eb13b5d6ea4ae01395fb5"}
Jul 16 11:08:22.478129 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:22.478084    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n7bx8" event={"ID":"9c276d4c-a51d-4372-b426-64f3a255a06a","Type":"ContainerStarted","Data":"cacb11ce0acd17635068e743f4739d6a71dfa4c4275fc0a8aa6f62ec8e7b344d"}
Jul 16 11:08:22.501662 ip-10-0-135-184 kubenswrapper[2564]: E0716 11:08:22.501585    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="[failed to \"StartContainer\" for \"csi-driver\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:23e38a7cf7c4e5c572a5461047f39d2f821e55490088f442a842f66da801ae99\\\": ErrImagePull: pull QPS exceeded\", failed to \"StartContainer\" for \"csi-node-driver-registrar\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:0512f4cb34792d3c7553c42a85869c34b5953550c019b958649e3246d6540d94\\\": ErrImagePull: pull QPS exceeded\", failed to \"StartContainer\" for \"csi-liveness-probe\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:0f984e9f25655116e61604ac13881b82e2830789119e02b44a338cea95f30425\\\": ErrImagePull: pull QPS exceeded\"]" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n7bx8" podUID="9c276d4c-a51d-4372-b426-64f3a255a06a"
Jul 16 11:08:22.705750 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:22.705639    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-frzsp\" (UniqueName: \"kubernetes.io/projected/0e88ea25-f79a-4275-a633-ba76d5b1ec27-kube-api-access-frzsp\") pod \"network-check-target-hwl88\" (UID: \"0e88ea25-f79a-4275-a633-ba76d5b1ec27\") " pod="openshift-network-diagnostics/network-check-target-hwl88"
Jul 16 11:08:22.705750 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:22.705702    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/28bc7393-164f-4deb-89da-69443b46c55e-metrics-certs\") pod \"network-metrics-daemon-pxp5q\" (UID: \"28bc7393-164f-4deb-89da-69443b46c55e\") " pod="openshift-multus/network-metrics-daemon-pxp5q"
Jul 16 11:08:22.706040 ip-10-0-135-184 kubenswrapper[2564]: E0716 11:08:22.705884    2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 16 11:08:22.706040 ip-10-0-135-184 kubenswrapper[2564]: E0716 11:08:22.705955    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/28bc7393-164f-4deb-89da-69443b46c55e-metrics-certs podName:28bc7393-164f-4deb-89da-69443b46c55e nodeName:}" failed. No retries permitted until 2026-07-16 11:08:24.705935305 +0000 UTC m=+5.077472340 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/28bc7393-164f-4deb-89da-69443b46c55e-metrics-certs") pod "network-metrics-daemon-pxp5q" (UID: "28bc7393-164f-4deb-89da-69443b46c55e") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 16 11:08:22.706168 ip-10-0-135-184 kubenswrapper[2564]: E0716 11:08:22.706078    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 16 11:08:22.706168 ip-10-0-135-184 kubenswrapper[2564]: E0716 11:08:22.706136    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 16 11:08:22.706168 ip-10-0-135-184 kubenswrapper[2564]: E0716 11:08:22.706151    2564 projected.go:196] Error preparing data for projected volume kube-api-access-frzsp for pod openshift-network-diagnostics/network-check-target-hwl88: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 16 11:08:22.706331 ip-10-0-135-184 kubenswrapper[2564]: E0716 11:08:22.706250    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0e88ea25-f79a-4275-a633-ba76d5b1ec27-kube-api-access-frzsp podName:0e88ea25-f79a-4275-a633-ba76d5b1ec27 nodeName:}" failed. No retries permitted until 2026-07-16 11:08:24.706183147 +0000 UTC m=+5.077720169 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-frzsp" (UniqueName: "kubernetes.io/projected/0e88ea25-f79a-4275-a633-ba76d5b1ec27-kube-api-access-frzsp") pod "network-check-target-hwl88" (UID: "0e88ea25-f79a-4275-a633-ba76d5b1ec27") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 16 11:08:22.806276 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:22.806234    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/55506f12-a9f6-4576-b250-576b091deb19-original-pull-secret\") pod \"global-pull-secret-syncer-pzsf4\" (UID: \"55506f12-a9f6-4576-b250-576b091deb19\") " pod="kube-system/global-pull-secret-syncer-pzsf4"
Jul 16 11:08:22.806481 ip-10-0-135-184 kubenswrapper[2564]: E0716 11:08:22.806436    2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 16 11:08:22.806554 ip-10-0-135-184 kubenswrapper[2564]: E0716 11:08:22.806504    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/55506f12-a9f6-4576-b250-576b091deb19-original-pull-secret podName:55506f12-a9f6-4576-b250-576b091deb19 nodeName:}" failed. No retries permitted until 2026-07-16 11:08:24.806483719 +0000 UTC m=+5.178020738 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/55506f12-a9f6-4576-b250-576b091deb19-original-pull-secret") pod "global-pull-secret-syncer-pzsf4" (UID: "55506f12-a9f6-4576-b250-576b091deb19") : object "kube-system"/"original-pull-secret" not registered
Jul 16 11:08:23.128026 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:23.127902    2564 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-15 11:03:21 +0000 UTC" deadline="2028-01-25 17:54:44.945206763 +0000 UTC"
Jul 16 11:08:23.128026 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:23.127973    2564 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13398h46m21.817237794s"
Jul 16 11:08:23.296144 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:23.295340    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pxp5q"
Jul 16 11:08:23.296144 ip-10-0-135-184 kubenswrapper[2564]: E0716 11:08:23.295509    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pxp5q" podUID="28bc7393-164f-4deb-89da-69443b46c55e"
Jul 16 11:08:23.296144 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:23.295976    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pzsf4"
Jul 16 11:08:23.296144 ip-10-0-135-184 kubenswrapper[2564]: E0716 11:08:23.296090    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pzsf4" podUID="55506f12-a9f6-4576-b250-576b091deb19"
Jul 16 11:08:24.295459 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:24.295076    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hwl88"
Jul 16 11:08:24.295993 ip-10-0-135-184 kubenswrapper[2564]: E0716 11:08:24.295507    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hwl88" podUID="0e88ea25-f79a-4275-a633-ba76d5b1ec27"
Jul 16 11:08:24.723776 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:24.722673    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-frzsp\" (UniqueName: \"kubernetes.io/projected/0e88ea25-f79a-4275-a633-ba76d5b1ec27-kube-api-access-frzsp\") pod \"network-check-target-hwl88\" (UID: \"0e88ea25-f79a-4275-a633-ba76d5b1ec27\") " pod="openshift-network-diagnostics/network-check-target-hwl88"
Jul 16 11:08:24.723776 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:24.722727    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/28bc7393-164f-4deb-89da-69443b46c55e-metrics-certs\") pod \"network-metrics-daemon-pxp5q\" (UID: \"28bc7393-164f-4deb-89da-69443b46c55e\") " pod="openshift-multus/network-metrics-daemon-pxp5q"
Jul 16 11:08:24.723776 ip-10-0-135-184 kubenswrapper[2564]: E0716 11:08:24.723015    2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 16 11:08:24.723776 ip-10-0-135-184 kubenswrapper[2564]: E0716 11:08:24.723088    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/28bc7393-164f-4deb-89da-69443b46c55e-metrics-certs podName:28bc7393-164f-4deb-89da-69443b46c55e nodeName:}" failed. No retries permitted until 2026-07-16 11:08:28.723066886 +0000 UTC m=+9.094603907 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/28bc7393-164f-4deb-89da-69443b46c55e-metrics-certs") pod "network-metrics-daemon-pxp5q" (UID: "28bc7393-164f-4deb-89da-69443b46c55e") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 16 11:08:24.723776 ip-10-0-135-184 kubenswrapper[2564]: E0716 11:08:24.723581    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 16 11:08:24.723776 ip-10-0-135-184 kubenswrapper[2564]: E0716 11:08:24.723606    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 16 11:08:24.723776 ip-10-0-135-184 kubenswrapper[2564]: E0716 11:08:24.723621    2564 projected.go:196] Error preparing data for projected volume kube-api-access-frzsp for pod openshift-network-diagnostics/network-check-target-hwl88: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 16 11:08:24.723776 ip-10-0-135-184 kubenswrapper[2564]: E0716 11:08:24.723679    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0e88ea25-f79a-4275-a633-ba76d5b1ec27-kube-api-access-frzsp podName:0e88ea25-f79a-4275-a633-ba76d5b1ec27 nodeName:}" failed. No retries permitted until 2026-07-16 11:08:28.723661472 +0000 UTC m=+9.095198489 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-frzsp" (UniqueName: "kubernetes.io/projected/0e88ea25-f79a-4275-a633-ba76d5b1ec27-kube-api-access-frzsp") pod "network-check-target-hwl88" (UID: "0e88ea25-f79a-4275-a633-ba76d5b1ec27") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 16 11:08:24.824353 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:24.823619    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/55506f12-a9f6-4576-b250-576b091deb19-original-pull-secret\") pod \"global-pull-secret-syncer-pzsf4\" (UID: \"55506f12-a9f6-4576-b250-576b091deb19\") " pod="kube-system/global-pull-secret-syncer-pzsf4"
Jul 16 11:08:24.824353 ip-10-0-135-184 kubenswrapper[2564]: E0716 11:08:24.823844    2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 16 11:08:24.824353 ip-10-0-135-184 kubenswrapper[2564]: E0716 11:08:24.823923    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/55506f12-a9f6-4576-b250-576b091deb19-original-pull-secret podName:55506f12-a9f6-4576-b250-576b091deb19 nodeName:}" failed. No retries permitted until 2026-07-16 11:08:28.823899642 +0000 UTC m=+9.195436659 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/55506f12-a9f6-4576-b250-576b091deb19-original-pull-secret") pod "global-pull-secret-syncer-pzsf4" (UID: "55506f12-a9f6-4576-b250-576b091deb19") : object "kube-system"/"original-pull-secret" not registered
Jul 16 11:08:25.295319 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:25.295278    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pxp5q"
Jul 16 11:08:25.295636 ip-10-0-135-184 kubenswrapper[2564]: E0716 11:08:25.295446    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pxp5q" podUID="28bc7393-164f-4deb-89da-69443b46c55e"
Jul 16 11:08:25.295636 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:25.295504    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pzsf4"
Jul 16 11:08:25.296208 ip-10-0-135-184 kubenswrapper[2564]: E0716 11:08:25.295651    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pzsf4" podUID="55506f12-a9f6-4576-b250-576b091deb19"
Jul 16 11:08:26.297483 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:26.296860    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hwl88"
Jul 16 11:08:26.297483 ip-10-0-135-184 kubenswrapper[2564]: E0716 11:08:26.297017    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hwl88" podUID="0e88ea25-f79a-4275-a633-ba76d5b1ec27"
Jul 16 11:08:27.295618 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:27.295463    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pxp5q"
Jul 16 11:08:27.295618 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:27.295505    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pzsf4"
Jul 16 11:08:27.295994 ip-10-0-135-184 kubenswrapper[2564]: E0716 11:08:27.295626    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pxp5q" podUID="28bc7393-164f-4deb-89da-69443b46c55e"
Jul 16 11:08:27.296061 ip-10-0-135-184 kubenswrapper[2564]: E0716 11:08:27.296021    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pzsf4" podUID="55506f12-a9f6-4576-b250-576b091deb19"
Jul 16 11:08:28.299207 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:28.299065    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hwl88"
Jul 16 11:08:28.299207 ip-10-0-135-184 kubenswrapper[2564]: E0716 11:08:28.299192    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hwl88" podUID="0e88ea25-f79a-4275-a633-ba76d5b1ec27"
Jul 16 11:08:28.759817 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:28.759707    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-frzsp\" (UniqueName: \"kubernetes.io/projected/0e88ea25-f79a-4275-a633-ba76d5b1ec27-kube-api-access-frzsp\") pod \"network-check-target-hwl88\" (UID: \"0e88ea25-f79a-4275-a633-ba76d5b1ec27\") " pod="openshift-network-diagnostics/network-check-target-hwl88"
Jul 16 11:08:28.759817 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:28.759783    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/28bc7393-164f-4deb-89da-69443b46c55e-metrics-certs\") pod \"network-metrics-daemon-pxp5q\" (UID: \"28bc7393-164f-4deb-89da-69443b46c55e\") " pod="openshift-multus/network-metrics-daemon-pxp5q"
Jul 16 11:08:28.760064 ip-10-0-135-184 kubenswrapper[2564]: E0716 11:08:28.759946    2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 16 11:08:28.760064 ip-10-0-135-184 kubenswrapper[2564]: E0716 11:08:28.760009    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 16 11:08:28.760064 ip-10-0-135-184 kubenswrapper[2564]: E0716 11:08:28.760031    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 16 11:08:28.760064 ip-10-0-135-184 kubenswrapper[2564]: E0716 11:08:28.760043    2564 projected.go:196] Error preparing data for projected volume kube-api-access-frzsp for pod openshift-network-diagnostics/network-check-target-hwl88: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 16 11:08:28.760279 ip-10-0-135-184 kubenswrapper[2564]: E0716 11:08:28.760017    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/28bc7393-164f-4deb-89da-69443b46c55e-metrics-certs podName:28bc7393-164f-4deb-89da-69443b46c55e nodeName:}" failed. No retries permitted until 2026-07-16 11:08:36.759997037 +0000 UTC m=+17.131534052 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/28bc7393-164f-4deb-89da-69443b46c55e-metrics-certs") pod "network-metrics-daemon-pxp5q" (UID: "28bc7393-164f-4deb-89da-69443b46c55e") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 16 11:08:28.760279 ip-10-0-135-184 kubenswrapper[2564]: E0716 11:08:28.760121    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0e88ea25-f79a-4275-a633-ba76d5b1ec27-kube-api-access-frzsp podName:0e88ea25-f79a-4275-a633-ba76d5b1ec27 nodeName:}" failed. No retries permitted until 2026-07-16 11:08:36.760108461 +0000 UTC m=+17.131645486 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-frzsp" (UniqueName: "kubernetes.io/projected/0e88ea25-f79a-4275-a633-ba76d5b1ec27-kube-api-access-frzsp") pod "network-check-target-hwl88" (UID: "0e88ea25-f79a-4275-a633-ba76d5b1ec27") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 16 11:08:28.861037 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:28.860991    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/55506f12-a9f6-4576-b250-576b091deb19-original-pull-secret\") pod \"global-pull-secret-syncer-pzsf4\" (UID: \"55506f12-a9f6-4576-b250-576b091deb19\") " pod="kube-system/global-pull-secret-syncer-pzsf4"
Jul 16 11:08:28.861239 ip-10-0-135-184 kubenswrapper[2564]: E0716 11:08:28.861222    2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 16 11:08:28.861304 ip-10-0-135-184 kubenswrapper[2564]: E0716 11:08:28.861289    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/55506f12-a9f6-4576-b250-576b091deb19-original-pull-secret podName:55506f12-a9f6-4576-b250-576b091deb19 nodeName:}" failed. No retries permitted until 2026-07-16 11:08:36.861270789 +0000 UTC m=+17.232807808 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/55506f12-a9f6-4576-b250-576b091deb19-original-pull-secret") pod "global-pull-secret-syncer-pzsf4" (UID: "55506f12-a9f6-4576-b250-576b091deb19") : object "kube-system"/"original-pull-secret" not registered
Jul 16 11:08:29.295722 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:29.295182    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pxp5q"
Jul 16 11:08:29.295722 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:29.295213    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pzsf4"
Jul 16 11:08:29.295722 ip-10-0-135-184 kubenswrapper[2564]: E0716 11:08:29.295341    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pxp5q" podUID="28bc7393-164f-4deb-89da-69443b46c55e"
Jul 16 11:08:29.295722 ip-10-0-135-184 kubenswrapper[2564]: E0716 11:08:29.295470    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pzsf4" podUID="55506f12-a9f6-4576-b250-576b091deb19"
Jul 16 11:08:30.296329 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:30.296292    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hwl88"
Jul 16 11:08:30.296842 ip-10-0-135-184 kubenswrapper[2564]: E0716 11:08:30.296425    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hwl88" podUID="0e88ea25-f79a-4275-a633-ba76d5b1ec27"
Jul 16 11:08:31.296016 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:31.295975    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pzsf4"
Jul 16 11:08:31.296221 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:31.295974    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pxp5q"
Jul 16 11:08:31.296221 ip-10-0-135-184 kubenswrapper[2564]: E0716 11:08:31.296120    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pzsf4" podUID="55506f12-a9f6-4576-b250-576b091deb19"
Jul 16 11:08:31.296221 ip-10-0-135-184 kubenswrapper[2564]: E0716 11:08:31.296210    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pxp5q" podUID="28bc7393-164f-4deb-89da-69443b46c55e"
Jul 16 11:08:32.295342 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:32.295303    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hwl88"
Jul 16 11:08:32.295792 ip-10-0-135-184 kubenswrapper[2564]: E0716 11:08:32.295441    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hwl88" podUID="0e88ea25-f79a-4275-a633-ba76d5b1ec27"
Jul 16 11:08:33.295518 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:33.295481    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pxp5q"
Jul 16 11:08:33.295518 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:33.295511    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pzsf4"
Jul 16 11:08:33.296052 ip-10-0-135-184 kubenswrapper[2564]: E0716 11:08:33.295625    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pxp5q" podUID="28bc7393-164f-4deb-89da-69443b46c55e"
Jul 16 11:08:33.296088 ip-10-0-135-184 kubenswrapper[2564]: E0716 11:08:33.296064    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pzsf4" podUID="55506f12-a9f6-4576-b250-576b091deb19"
Jul 16 11:08:34.295589 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:34.295550    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hwl88"
Jul 16 11:08:34.296097 ip-10-0-135-184 kubenswrapper[2564]: E0716 11:08:34.295696    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hwl88" podUID="0e88ea25-f79a-4275-a633-ba76d5b1ec27"
Jul 16 11:08:35.296086 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:35.296043    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pzsf4"
Jul 16 11:08:35.296519 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:35.296046    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pxp5q"
Jul 16 11:08:35.296519 ip-10-0-135-184 kubenswrapper[2564]: E0716 11:08:35.296179    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pzsf4" podUID="55506f12-a9f6-4576-b250-576b091deb19"
Jul 16 11:08:35.296519 ip-10-0-135-184 kubenswrapper[2564]: E0716 11:08:35.296275    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pxp5q" podUID="28bc7393-164f-4deb-89da-69443b46c55e"
Jul 16 11:08:36.295466 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:36.295430    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hwl88"
Jul 16 11:08:36.295674 ip-10-0-135-184 kubenswrapper[2564]: E0716 11:08:36.295564    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hwl88" podUID="0e88ea25-f79a-4275-a633-ba76d5b1ec27"
Jul 16 11:08:36.821853 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:36.821799    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-frzsp\" (UniqueName: \"kubernetes.io/projected/0e88ea25-f79a-4275-a633-ba76d5b1ec27-kube-api-access-frzsp\") pod \"network-check-target-hwl88\" (UID: \"0e88ea25-f79a-4275-a633-ba76d5b1ec27\") " pod="openshift-network-diagnostics/network-check-target-hwl88"
Jul 16 11:08:36.821853 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:36.821854    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/28bc7393-164f-4deb-89da-69443b46c55e-metrics-certs\") pod \"network-metrics-daemon-pxp5q\" (UID: \"28bc7393-164f-4deb-89da-69443b46c55e\") " pod="openshift-multus/network-metrics-daemon-pxp5q"
Jul 16 11:08:36.822383 ip-10-0-135-184 kubenswrapper[2564]: E0716 11:08:36.821977    2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 16 11:08:36.822383 ip-10-0-135-184 kubenswrapper[2564]: E0716 11:08:36.822000    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 16 11:08:36.822383 ip-10-0-135-184 kubenswrapper[2564]: E0716 11:08:36.822030    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 16 11:08:36.822383 ip-10-0-135-184 kubenswrapper[2564]: E0716 11:08:36.822043    2564 projected.go:196] Error preparing data for projected volume kube-api-access-frzsp for pod openshift-network-diagnostics/network-check-target-hwl88: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 16 11:08:36.822383 ip-10-0-135-184 kubenswrapper[2564]: E0716 11:08:36.822048    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/28bc7393-164f-4deb-89da-69443b46c55e-metrics-certs podName:28bc7393-164f-4deb-89da-69443b46c55e nodeName:}" failed. No retries permitted until 2026-07-16 11:08:52.822027957 +0000 UTC m=+33.193564991 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/28bc7393-164f-4deb-89da-69443b46c55e-metrics-certs") pod "network-metrics-daemon-pxp5q" (UID: "28bc7393-164f-4deb-89da-69443b46c55e") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 16 11:08:36.822383 ip-10-0-135-184 kubenswrapper[2564]: E0716 11:08:36.822095    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0e88ea25-f79a-4275-a633-ba76d5b1ec27-kube-api-access-frzsp podName:0e88ea25-f79a-4275-a633-ba76d5b1ec27 nodeName:}" failed. No retries permitted until 2026-07-16 11:08:52.822077946 +0000 UTC m=+33.193614984 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-frzsp" (UniqueName: "kubernetes.io/projected/0e88ea25-f79a-4275-a633-ba76d5b1ec27-kube-api-access-frzsp") pod "network-check-target-hwl88" (UID: "0e88ea25-f79a-4275-a633-ba76d5b1ec27") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 16 11:08:36.922873 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:36.922826    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/55506f12-a9f6-4576-b250-576b091deb19-original-pull-secret\") pod \"global-pull-secret-syncer-pzsf4\" (UID: \"55506f12-a9f6-4576-b250-576b091deb19\") " pod="kube-system/global-pull-secret-syncer-pzsf4"
Jul 16 11:08:36.923093 ip-10-0-135-184 kubenswrapper[2564]: E0716 11:08:36.922993    2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 16 11:08:36.923093 ip-10-0-135-184 kubenswrapper[2564]: E0716 11:08:36.923068    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/55506f12-a9f6-4576-b250-576b091deb19-original-pull-secret podName:55506f12-a9f6-4576-b250-576b091deb19 nodeName:}" failed. No retries permitted until 2026-07-16 11:08:52.923049301 +0000 UTC m=+33.294586318 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/55506f12-a9f6-4576-b250-576b091deb19-original-pull-secret") pod "global-pull-secret-syncer-pzsf4" (UID: "55506f12-a9f6-4576-b250-576b091deb19") : object "kube-system"/"original-pull-secret" not registered
Jul 16 11:08:37.295987 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:37.295902    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pxp5q"
Jul 16 11:08:37.296165 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:37.295913    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pzsf4"
Jul 16 11:08:37.296165 ip-10-0-135-184 kubenswrapper[2564]: E0716 11:08:37.296050    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pxp5q" podUID="28bc7393-164f-4deb-89da-69443b46c55e"
Jul 16 11:08:37.296165 ip-10-0-135-184 kubenswrapper[2564]: E0716 11:08:37.296123    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pzsf4" podUID="55506f12-a9f6-4576-b250-576b091deb19"
Jul 16 11:08:38.295402 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:38.295358    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hwl88"
Jul 16 11:08:38.295901 ip-10-0-135-184 kubenswrapper[2564]: E0716 11:08:38.295506    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hwl88" podUID="0e88ea25-f79a-4275-a633-ba76d5b1ec27"
Jul 16 11:08:39.295239 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:39.295208    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pzsf4"
Jul 16 11:08:39.295239 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:39.295248    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pxp5q"
Jul 16 11:08:39.295475 ip-10-0-135-184 kubenswrapper[2564]: E0716 11:08:39.295345    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pzsf4" podUID="55506f12-a9f6-4576-b250-576b091deb19"
Jul 16 11:08:39.295847 ip-10-0-135-184 kubenswrapper[2564]: E0716 11:08:39.295505    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pxp5q" podUID="28bc7393-164f-4deb-89da-69443b46c55e"
Jul 16 11:08:40.296493 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:40.296444    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hwl88"
Jul 16 11:08:40.296963 ip-10-0-135-184 kubenswrapper[2564]: E0716 11:08:40.296562    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hwl88" podUID="0e88ea25-f79a-4275-a633-ba76d5b1ec27"
Jul 16 11:08:41.295265 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:41.295234    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pxp5q"
Jul 16 11:08:41.295265 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:41.295261    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pzsf4"
Jul 16 11:08:41.295485 ip-10-0-135-184 kubenswrapper[2564]: E0716 11:08:41.295382    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pxp5q" podUID="28bc7393-164f-4deb-89da-69443b46c55e"
Jul 16 11:08:41.295542 ip-10-0-135-184 kubenswrapper[2564]: E0716 11:08:41.295508    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pzsf4" podUID="55506f12-a9f6-4576-b250-576b091deb19"
Jul 16 11:08:41.544597 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:41.544555    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-184.ec2.internal" event={"ID":"5e44ce4b9dc5eed0a3686382d6febba7","Type":"ContainerStarted","Data":"720c8258aed0b2444572a7b632851e9cd3438cfa3f747847037e8ae3cdd1e60a"}
Jul 16 11:08:42.296288 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:42.295861    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hwl88"
Jul 16 11:08:42.296542 ip-10-0-135-184 kubenswrapper[2564]: E0716 11:08:42.296350    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hwl88" podUID="0e88ea25-f79a-4275-a633-ba76d5b1ec27"
Jul 16 11:08:42.548620 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:42.548485    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-qnhsv" event={"ID":"f4253474-3da3-431f-a86c-28e25e1c7a52","Type":"ContainerStarted","Data":"ff91adf8a01af8650324928d1c8b9dd571100de85d858cb2fe1b64cc098829ae"}
Jul 16 11:08:42.550067 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:42.550026    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-2frcp" event={"ID":"47ecd32d-7f31-43d9-9828-d2621113d37c","Type":"ContainerStarted","Data":"e2887fcbc8386953c00880e7d789593b1fa5c2744e155ac4a3e62e6f4896f86a"}
Jul 16 11:08:42.551702 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:42.551670    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-44kqf" event={"ID":"e335433b-f42b-4f52-b88e-02f36ff33f83","Type":"ContainerStarted","Data":"2fea8cfcc6cae8b37fdefee1fff585e8c7a65dff5ac330d416308115be59b077"}
Jul 16 11:08:42.553560 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:42.553484    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-f2bxq" event={"ID":"8987957b-efce-44fe-9da6-d3d7d4c06b6c","Type":"ContainerStarted","Data":"be52a886599ddf21835f53e34522cf74acb87313e2b57a0bd4dab42eca5f0dab"}
Jul 16 11:08:42.555413 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:42.555386    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-klw5l" event={"ID":"60499157-9d8a-4985-802c-be1c0ae7f411","Type":"ContainerStarted","Data":"794477cfca0f2bf168e60730fab0d483a528f8a64e74eabb414c4cd8015510fe"}
Jul 16 11:08:42.557107 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:42.557082    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-184.ec2.internal" event={"ID":"ac5863ecfed3d0f647282c9bdf712234","Type":"ContainerStarted","Data":"86c9d78b60fe1745109811afb4563f2e001ec1501a8bd8a8e3634a2feb74b27c"}
Jul 16 11:08:42.558640 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:42.558611    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-hbhws" event={"ID":"1654c4da-b013-4bca-a0a8-5efe36c38fee","Type":"ContainerStarted","Data":"0935f9f9eaef114ff6001f175a6e9a251616ada6801f7a76fca2da9ccbdf948a"}
Jul 16 11:08:42.561091 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:42.561056    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fchvw" event={"ID":"aee7cbaf-a5e0-4e57-a9c1-504820f7f036","Type":"ContainerStarted","Data":"4cca917d3a6c9b92e297228e1b24fed26d885e16bfcefb86520a9e92660363ad"}
Jul 16 11:08:42.561232 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:42.561133    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fchvw" event={"ID":"aee7cbaf-a5e0-4e57-a9c1-504820f7f036","Type":"ContainerStarted","Data":"b95b34b5595ab04b3c90f06c19b0795f9d068240eb153de9856285f017732e68"}
Jul 16 11:08:42.565451 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:42.565399    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-qnhsv" podStartSLOduration=1.775121719 podStartE2EDuration="21.565385411s" totalImagesPullingTime="19.790263692s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 11:08:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 11:08:42.565276969 +0000 UTC m=+22.936814004" watchObservedRunningTime="2026-07-16 11:08:42.565385411 +0000 UTC m=+22.936922446"
Jul 16 11:08:42.565705 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:42.565686    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-184.ec2.internal" podStartSLOduration=21.565679524 podStartE2EDuration="21.565679524s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 11:08:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 11:08:41.561824039 +0000 UTC m=+21.933361069" watchObservedRunningTime="2026-07-16 11:08:42.565679524 +0000 UTC m=+22.937216559"
Jul 16 11:08:42.597445 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:42.597378    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-f2bxq" podStartSLOduration=2.691124741 podStartE2EDuration="22.597354878s" totalImagesPullingTime="19.906230137s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 11:08:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 11:08:42.581211095 +0000 UTC m=+22.952748156" watchObservedRunningTime="2026-07-16 11:08:42.597354878 +0000 UTC m=+22.968891917"
Jul 16 11:08:42.597721 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:42.597694    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-hbhws" podStartSLOduration=2.781711628 podStartE2EDuration="22.597683594s" totalImagesPullingTime="19.815971966s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 11:08:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 11:08:42.596755752 +0000 UTC m=+22.968292787" watchObservedRunningTime="2026-07-16 11:08:42.597683594 +0000 UTC m=+22.969220634"
Jul 16 11:08:42.610759 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:42.610698    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-44kqf" podStartSLOduration=1.8361996390000002 podStartE2EDuration="21.610675935s" totalImagesPullingTime="19.774476296s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 11:08:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 11:08:42.610189727 +0000 UTC m=+22.981726778" watchObservedRunningTime="2026-07-16 11:08:42.610675935 +0000 UTC m=+22.982212971"
Jul 16 11:08:42.624285 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:42.624233    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-2frcp" podStartSLOduration=1.8504206010000002 podStartE2EDuration="21.624217393s" totalImagesPullingTime="19.773796792s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 11:08:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 11:08:42.623981631 +0000 UTC m=+22.995518706" watchObservedRunningTime="2026-07-16 11:08:42.624217393 +0000 UTC m=+22.995754420"
Jul 16 11:08:43.235181 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:43.235145    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-hbhws"
Jul 16 11:08:43.235765 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:43.235740    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-hbhws"
Jul 16 11:08:43.295988 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:43.295958    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pzsf4"
Jul 16 11:08:43.296174 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:43.295965    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pxp5q"
Jul 16 11:08:43.296237 ip-10-0-135-184 kubenswrapper[2564]: E0716 11:08:43.296062    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pzsf4" podUID="55506f12-a9f6-4576-b250-576b091deb19"
Jul 16 11:08:43.296237 ip-10-0-135-184 kubenswrapper[2564]: E0716 11:08:43.296185    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pxp5q" podUID="28bc7393-164f-4deb-89da-69443b46c55e"
Jul 16 11:08:43.564788 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:43.564740    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-47b72" event={"ID":"dfe01fed-00e2-4080-941e-d27f5d4c9770","Type":"ContainerStarted","Data":"f751687be1317960594acc14d7dfa687e847a137467a426e9e4624363137d4ac"}
Jul 16 11:08:43.566247 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:43.566221    2564 generic.go:356] "Generic (PLEG): container finished" podID="60499157-9d8a-4985-802c-be1c0ae7f411" containerID="794477cfca0f2bf168e60730fab0d483a528f8a64e74eabb414c4cd8015510fe" exitCode=0
Jul 16 11:08:43.566372 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:43.566303    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-klw5l" event={"ID":"60499157-9d8a-4985-802c-be1c0ae7f411","Type":"ContainerDied","Data":"794477cfca0f2bf168e60730fab0d483a528f8a64e74eabb414c4cd8015510fe"}
Jul 16 11:08:43.567861 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:43.567837    2564 generic.go:356] "Generic (PLEG): container finished" podID="ac5863ecfed3d0f647282c9bdf712234" containerID="86c9d78b60fe1745109811afb4563f2e001ec1501a8bd8a8e3634a2feb74b27c" exitCode=0
Jul 16 11:08:43.567949 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:43.567920    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-184.ec2.internal" event={"ID":"ac5863ecfed3d0f647282c9bdf712234","Type":"ContainerDied","Data":"86c9d78b60fe1745109811afb4563f2e001ec1501a8bd8a8e3634a2feb74b27c"}
Jul 16 11:08:43.571958 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:43.571929    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n7bx8" event={"ID":"9c276d4c-a51d-4372-b426-64f3a255a06a","Type":"ContainerStarted","Data":"4da62340c6d380fa414853334fc4c14c577700b25f68f5eb875d0049f7ec8fa1"}
Jul 16 11:08:43.574926 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:43.574907    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fchvw_aee7cbaf-a5e0-4e57-a9c1-504820f7f036/ovn-acl-logging/0.log"
Jul 16 11:08:43.575266 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:43.575246    2564 generic.go:356] "Generic (PLEG): container finished" podID="aee7cbaf-a5e0-4e57-a9c1-504820f7f036" containerID="4cca917d3a6c9b92e297228e1b24fed26d885e16bfcefb86520a9e92660363ad" exitCode=1
Jul 16 11:08:43.575363 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:43.575341    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fchvw" event={"ID":"aee7cbaf-a5e0-4e57-a9c1-504820f7f036","Type":"ContainerDied","Data":"4cca917d3a6c9b92e297228e1b24fed26d885e16bfcefb86520a9e92660363ad"}
Jul 16 11:08:43.575482 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:43.575426    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fchvw" event={"ID":"aee7cbaf-a5e0-4e57-a9c1-504820f7f036","Type":"ContainerStarted","Data":"1c6384f77bdc1c9d0e0b3be56e77d3c313e29df2d9d1b83ab5db5bd3fa921de3"}
Jul 16 11:08:43.575482 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:43.575479    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fchvw" event={"ID":"aee7cbaf-a5e0-4e57-a9c1-504820f7f036","Type":"ContainerStarted","Data":"deaedf1fb84233175bebadadbcd51ed8eefb74af673a4c8ea70ea177eec44f05"}
Jul 16 11:08:43.575569 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:43.575555    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-hbhws"
Jul 16 11:08:43.575621 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:43.575593    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fchvw" event={"ID":"aee7cbaf-a5e0-4e57-a9c1-504820f7f036","Type":"ContainerStarted","Data":"3b1fca74138b63dff66f2fd22b9deedb6acb717e3c5e59532bc10c2a3105c4c3"}
Jul 16 11:08:43.575672 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:43.575658    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fchvw" event={"ID":"aee7cbaf-a5e0-4e57-a9c1-504820f7f036","Type":"ContainerStarted","Data":"ddb9790ab2fa56ade83aa03a0617c6b1d06e607c4585c57923a296537bbb8e3e"}
Jul 16 11:08:43.576104 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:43.576087    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-hbhws"
Jul 16 11:08:43.581277 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:43.581231    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-47b72" podStartSLOduration=3.712983541 podStartE2EDuration="23.581216115s" totalImagesPullingTime="19.868232574s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 11:08:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 11:08:43.580923815 +0000 UTC m=+23.952460849" watchObservedRunningTime="2026-07-16 11:08:43.581216115 +0000 UTC m=+23.952753145"
Jul 16 11:08:44.295999 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:44.295961    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hwl88"
Jul 16 11:08:44.296250 ip-10-0-135-184 kubenswrapper[2564]: E0716 11:08:44.296075    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hwl88" podUID="0e88ea25-f79a-4275-a633-ba76d5b1ec27"
Jul 16 11:08:44.579105 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:44.579020    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-184.ec2.internal" event={"ID":"ac5863ecfed3d0f647282c9bdf712234","Type":"ContainerStarted","Data":"1740d0e6e850ccbf03cf125b3f4eca444ec4f5a31e894110c61379adaba31511"}
Jul 16 11:08:44.596096 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:44.596054    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-184.ec2.internal" podStartSLOduration=23.596023647 podStartE2EDuration="23.596023647s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 11:08:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 11:08:44.595758548 +0000 UTC m=+24.967295584" watchObservedRunningTime="2026-07-16 11:08:44.596023647 +0000 UTC m=+24.967560683"
Jul 16 11:08:45.295866 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:45.295576    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pxp5q"
Jul 16 11:08:45.295866 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:45.295881    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pzsf4"
Jul 16 11:08:45.296095 ip-10-0-135-184 kubenswrapper[2564]: E0716 11:08:45.295974    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pxp5q" podUID="28bc7393-164f-4deb-89da-69443b46c55e"
Jul 16 11:08:45.296178 ip-10-0-135-184 kubenswrapper[2564]: E0716 11:08:45.296157    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pzsf4" podUID="55506f12-a9f6-4576-b250-576b091deb19"
Jul 16 11:08:45.955229 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:45.955194    2564 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 16 11:08:46.229821 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:46.229641    2564 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-16T11:08:45.955220272Z","UUID":"03e05fbe-358e-404e-a26b-5dec3fa5ee6f","Handler":null,"Name":"","Endpoint":""}
Jul 16 11:08:46.233910 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:46.233115    2564 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 16 11:08:46.233910 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:46.233167    2564 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 16 11:08:46.295499 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:46.295460    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hwl88"
Jul 16 11:08:46.295676 ip-10-0-135-184 kubenswrapper[2564]: E0716 11:08:46.295603    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hwl88" podUID="0e88ea25-f79a-4275-a633-ba76d5b1ec27"
Jul 16 11:08:46.586740 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:46.586705    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n7bx8" event={"ID":"9c276d4c-a51d-4372-b426-64f3a255a06a","Type":"ContainerStarted","Data":"4386142eef79d9290c05a484c0b490aab2b906407878690e6ee89385df057958"}
Jul 16 11:08:46.590693 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:46.590667    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fchvw_aee7cbaf-a5e0-4e57-a9c1-504820f7f036/ovn-acl-logging/0.log"
Jul 16 11:08:46.591190 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:46.591138    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fchvw" event={"ID":"aee7cbaf-a5e0-4e57-a9c1-504820f7f036","Type":"ContainerStarted","Data":"f49a5064d7c2158c6abedc070e825f213be518aba23ed80107c80cb90b52f2e6"}
Jul 16 11:08:47.296071 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:47.296034    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pxp5q"
Jul 16 11:08:47.296698 ip-10-0-135-184 kubenswrapper[2564]: E0716 11:08:47.296165    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pxp5q" podUID="28bc7393-164f-4deb-89da-69443b46c55e"
Jul 16 11:08:47.296698 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:47.296202    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pzsf4"
Jul 16 11:08:47.296698 ip-10-0-135-184 kubenswrapper[2564]: E0716 11:08:47.296269    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pzsf4" podUID="55506f12-a9f6-4576-b250-576b091deb19"
Jul 16 11:08:47.327985 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:47.327950    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:08:47.495359 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:47.495321    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:08:47.596560 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:47.596469    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n7bx8" event={"ID":"9c276d4c-a51d-4372-b426-64f3a255a06a","Type":"ContainerStarted","Data":"bf136a7c3abb5cf0b3de2b86c66d2c4e60442f4c5246d7254bcf130e74f037bc"}
Jul 16 11:08:47.614263 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:47.614202    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n7bx8" podStartSLOduration=1.161244405 podStartE2EDuration="26.614180977s" totalImagesPullingTime="25.452936572s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 11:08:21 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=3 observedRunningTime="2026-07-16 11:08:47.61381702 +0000 UTC m=+27.985354059" watchObservedRunningTime="2026-07-16 11:08:47.614180977 +0000 UTC m=+27.985718066"
Jul 16 11:08:48.295846 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:48.295533    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hwl88"
Jul 16 11:08:48.296278 ip-10-0-135-184 kubenswrapper[2564]: E0716 11:08:48.295973    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hwl88" podUID="0e88ea25-f79a-4275-a633-ba76d5b1ec27"
Jul 16 11:08:48.603668 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:48.603579    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fchvw_aee7cbaf-a5e0-4e57-a9c1-504820f7f036/ovn-acl-logging/0.log"
Jul 16 11:08:48.604113 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:48.604082    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fchvw" event={"ID":"aee7cbaf-a5e0-4e57-a9c1-504820f7f036","Type":"ContainerStarted","Data":"3f348859cf1ad4e805a75686ffc5d5febaadae394185d31e404469aebacdb426"}
Jul 16 11:08:48.604742 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:48.604721    2564 scope.go:117] "RemoveContainer" containerID="4cca917d3a6c9b92e297228e1b24fed26d885e16bfcefb86520a9e92660363ad"
Jul 16 11:08:49.295735 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:49.295701    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pxp5q"
Jul 16 11:08:49.295946 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:49.295709    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pzsf4"
Jul 16 11:08:49.295946 ip-10-0-135-184 kubenswrapper[2564]: E0716 11:08:49.295869    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pxp5q" podUID="28bc7393-164f-4deb-89da-69443b46c55e"
Jul 16 11:08:49.295946 ip-10-0-135-184 kubenswrapper[2564]: E0716 11:08:49.295928    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pzsf4" podUID="55506f12-a9f6-4576-b250-576b091deb19"
Jul 16 11:08:49.611989 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:49.611962    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fchvw_aee7cbaf-a5e0-4e57-a9c1-504820f7f036/ovn-acl-logging/0.log"
Jul 16 11:08:49.612578 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:49.612542    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fchvw" event={"ID":"aee7cbaf-a5e0-4e57-a9c1-504820f7f036","Type":"ContainerStarted","Data":"18e78611143d040cd1158a0284dea0cd8cbeaf9a7ec3f6a022d35d5844b4275a"}
Jul 16 11:08:49.612814 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:49.612796    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-fchvw"
Jul 16 11:08:49.612953 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:49.612938    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-fchvw"
Jul 16 11:08:49.613021 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:49.613008    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-fchvw"
Jul 16 11:08:49.632157 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:49.632126    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-fchvw"
Jul 16 11:08:49.632312 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:49.632263    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-fchvw"
Jul 16 11:08:49.651244 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:49.651198    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-fchvw" podStartSLOduration=9.357036351 podStartE2EDuration="29.651181858s" totalImagesPullingTime="20.294145507s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 11:08:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 11:08:49.650195866 +0000 UTC m=+30.021732943" watchObservedRunningTime="2026-07-16 11:08:49.651181858 +0000 UTC m=+30.022718909"
Jul 16 11:08:50.035739 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:50.035541    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-pzsf4"]
Jul 16 11:08:50.035924 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:50.035847    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pzsf4"
Jul 16 11:08:50.036000 ip-10-0-135-184 kubenswrapper[2564]: E0716 11:08:50.035963    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pzsf4" podUID="55506f12-a9f6-4576-b250-576b091deb19"
Jul 16 11:08:50.038892 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:50.038861    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-hwl88"]
Jul 16 11:08:50.039044 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:50.038995    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hwl88"
Jul 16 11:08:50.039150 ip-10-0-135-184 kubenswrapper[2564]: E0716 11:08:50.039130    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hwl88" podUID="0e88ea25-f79a-4275-a633-ba76d5b1ec27"
Jul 16 11:08:50.039710 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:50.039689    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-pxp5q"]
Jul 16 11:08:50.039826 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:50.039812    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pxp5q"
Jul 16 11:08:50.039947 ip-10-0-135-184 kubenswrapper[2564]: E0716 11:08:50.039924    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pxp5q" podUID="28bc7393-164f-4deb-89da-69443b46c55e"
Jul 16 11:08:50.617228 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:50.617187    2564 generic.go:356] "Generic (PLEG): container finished" podID="60499157-9d8a-4985-802c-be1c0ae7f411" containerID="c009da51612a08c43ca372c3b44766fcc0aa23345940d724bd53073ae2384804" exitCode=0
Jul 16 11:08:50.617705 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:50.617235    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-klw5l" event={"ID":"60499157-9d8a-4985-802c-be1c0ae7f411","Type":"ContainerDied","Data":"c009da51612a08c43ca372c3b44766fcc0aa23345940d724bd53073ae2384804"}
Jul 16 11:08:50.956855 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:50.956757    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:08:51.066832 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:51.066801    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:08:51.296006 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:51.295969    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pzsf4"
Jul 16 11:08:51.296006 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:51.295985    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hwl88"
Jul 16 11:08:51.296278 ip-10-0-135-184 kubenswrapper[2564]: E0716 11:08:51.296111    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pzsf4" podUID="55506f12-a9f6-4576-b250-576b091deb19"
Jul 16 11:08:51.296278 ip-10-0-135-184 kubenswrapper[2564]: E0716 11:08:51.296235    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hwl88" podUID="0e88ea25-f79a-4275-a633-ba76d5b1ec27"
Jul 16 11:08:51.621515 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:51.621427    2564 generic.go:356] "Generic (PLEG): container finished" podID="60499157-9d8a-4985-802c-be1c0ae7f411" containerID="91abb243bcaf337434c2456b0f86570246b9e019496863acaad63bb1fba8839b" exitCode=0
Jul 16 11:08:51.621515 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:51.621498    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-klw5l" event={"ID":"60499157-9d8a-4985-802c-be1c0ae7f411","Type":"ContainerDied","Data":"91abb243bcaf337434c2456b0f86570246b9e019496863acaad63bb1fba8839b"}
Jul 16 11:08:52.295444 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:52.295401    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pxp5q"
Jul 16 11:08:52.295595 ip-10-0-135-184 kubenswrapper[2564]: E0716 11:08:52.295566    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pxp5q" podUID="28bc7393-164f-4deb-89da-69443b46c55e"
Jul 16 11:08:52.625883 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:52.625797    2564 generic.go:356] "Generic (PLEG): container finished" podID="60499157-9d8a-4985-802c-be1c0ae7f411" containerID="ea249c85f4e5e47d20d3877a2c61d74e55a802e0c993f6626dd35655fa9c8ba3" exitCode=0
Jul 16 11:08:52.625883 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:52.625839    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-klw5l" event={"ID":"60499157-9d8a-4985-802c-be1c0ae7f411","Type":"ContainerDied","Data":"ea249c85f4e5e47d20d3877a2c61d74e55a802e0c993f6626dd35655fa9c8ba3"}
Jul 16 11:08:52.843588 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:52.843533    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-frzsp\" (UniqueName: \"kubernetes.io/projected/0e88ea25-f79a-4275-a633-ba76d5b1ec27-kube-api-access-frzsp\") pod \"network-check-target-hwl88\" (UID: \"0e88ea25-f79a-4275-a633-ba76d5b1ec27\") " pod="openshift-network-diagnostics/network-check-target-hwl88"
Jul 16 11:08:52.843588 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:52.843587    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/28bc7393-164f-4deb-89da-69443b46c55e-metrics-certs\") pod \"network-metrics-daemon-pxp5q\" (UID: \"28bc7393-164f-4deb-89da-69443b46c55e\") " pod="openshift-multus/network-metrics-daemon-pxp5q"
Jul 16 11:08:52.843851 ip-10-0-135-184 kubenswrapper[2564]: E0716 11:08:52.843690    2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 16 11:08:52.843851 ip-10-0-135-184 kubenswrapper[2564]: E0716 11:08:52.843714    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 16 11:08:52.843851 ip-10-0-135-184 kubenswrapper[2564]: E0716 11:08:52.843739    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 16 11:08:52.843851 ip-10-0-135-184 kubenswrapper[2564]: E0716 11:08:52.843748    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/28bc7393-164f-4deb-89da-69443b46c55e-metrics-certs podName:28bc7393-164f-4deb-89da-69443b46c55e nodeName:}" failed. No retries permitted until 2026-07-16 11:09:24.843733506 +0000 UTC m=+65.215270520 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/28bc7393-164f-4deb-89da-69443b46c55e-metrics-certs") pod "network-metrics-daemon-pxp5q" (UID: "28bc7393-164f-4deb-89da-69443b46c55e") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 16 11:08:52.843851 ip-10-0-135-184 kubenswrapper[2564]: E0716 11:08:52.843749    2564 projected.go:196] Error preparing data for projected volume kube-api-access-frzsp for pod openshift-network-diagnostics/network-check-target-hwl88: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 16 11:08:52.843851 ip-10-0-135-184 kubenswrapper[2564]: E0716 11:08:52.843823    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0e88ea25-f79a-4275-a633-ba76d5b1ec27-kube-api-access-frzsp podName:0e88ea25-f79a-4275-a633-ba76d5b1ec27 nodeName:}" failed. No retries permitted until 2026-07-16 11:09:24.843811526 +0000 UTC m=+65.215348539 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-frzsp" (UniqueName: "kubernetes.io/projected/0e88ea25-f79a-4275-a633-ba76d5b1ec27-kube-api-access-frzsp") pod "network-check-target-hwl88" (UID: "0e88ea25-f79a-4275-a633-ba76d5b1ec27") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 16 11:08:52.945001 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:52.944912    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/55506f12-a9f6-4576-b250-576b091deb19-original-pull-secret\") pod \"global-pull-secret-syncer-pzsf4\" (UID: \"55506f12-a9f6-4576-b250-576b091deb19\") " pod="kube-system/global-pull-secret-syncer-pzsf4"
Jul 16 11:08:52.945154 ip-10-0-135-184 kubenswrapper[2564]: E0716 11:08:52.945029    2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 16 11:08:52.945154 ip-10-0-135-184 kubenswrapper[2564]: E0716 11:08:52.945083    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/55506f12-a9f6-4576-b250-576b091deb19-original-pull-secret podName:55506f12-a9f6-4576-b250-576b091deb19 nodeName:}" failed. No retries permitted until 2026-07-16 11:09:24.945069881 +0000 UTC m=+65.316606896 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/55506f12-a9f6-4576-b250-576b091deb19-original-pull-secret") pod "global-pull-secret-syncer-pzsf4" (UID: "55506f12-a9f6-4576-b250-576b091deb19") : object "kube-system"/"original-pull-secret" not registered
Jul 16 11:08:53.295521 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:53.295486    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hwl88"
Jul 16 11:08:53.295716 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:53.295534    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pzsf4"
Jul 16 11:08:53.295716 ip-10-0-135-184 kubenswrapper[2564]: E0716 11:08:53.295638    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hwl88" podUID="0e88ea25-f79a-4275-a633-ba76d5b1ec27"
Jul 16 11:08:53.295842 ip-10-0-135-184 kubenswrapper[2564]: E0716 11:08:53.295761    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pzsf4" podUID="55506f12-a9f6-4576-b250-576b091deb19"
Jul 16 11:08:54.269273 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:54.269230    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:08:54.296026 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:54.295995    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pxp5q"
Jul 16 11:08:54.296271 ip-10-0-135-184 kubenswrapper[2564]: E0716 11:08:54.296127    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pxp5q" podUID="28bc7393-164f-4deb-89da-69443b46c55e"
Jul 16 11:08:54.369622 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:54.369578    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:08:54.467381 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:54.467343    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:08:55.295987 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:55.295951    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pzsf4"
Jul 16 11:08:55.296402 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:55.295951    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hwl88"
Jul 16 11:08:55.296402 ip-10-0-135-184 kubenswrapper[2564]: E0716 11:08:55.296096    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pzsf4" podUID="55506f12-a9f6-4576-b250-576b091deb19"
Jul 16 11:08:55.296402 ip-10-0-135-184 kubenswrapper[2564]: E0716 11:08:55.296189    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hwl88" podUID="0e88ea25-f79a-4275-a633-ba76d5b1ec27"
Jul 16 11:08:56.296301 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:56.296091    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pxp5q"
Jul 16 11:08:56.296730 ip-10-0-135-184 kubenswrapper[2564]: E0716 11:08:56.296418    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pxp5q" podUID="28bc7393-164f-4deb-89da-69443b46c55e"
Jul 16 11:08:56.581232 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:56.581207    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-184.ec2.internal" event="NodeReady"
Jul 16 11:08:56.581402 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:56.581344    2564 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 16 11:08:56.629268 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:56.629235    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-k69kw"]
Jul 16 11:08:56.641542 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:56.641511    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-6x8n4"]
Jul 16 11:08:56.641697 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:56.641640    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-k69kw"
Jul 16 11:08:56.646280 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:56.646222    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 16 11:08:56.646453 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:56.646403    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-jnq66\""
Jul 16 11:08:56.646453 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:56.646420    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 16 11:08:56.665938 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:56.665903    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-k69kw"]
Jul 16 11:08:56.665938 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:56.665943    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-6x8n4"]
Jul 16 11:08:56.666121 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:56.666029    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-6x8n4"
Jul 16 11:08:56.668251 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:56.668224    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 16 11:08:56.668378 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:56.668326    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 16 11:08:56.668554 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:56.668530    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 16 11:08:56.668668 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:56.668533    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-mgj7r\""
Jul 16 11:08:56.773025 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:56.772995    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/a87056cf-7dba-4395-b644-4aeb45e9b8e7-config-volume\") pod \"dns-default-k69kw\" (UID: \"a87056cf-7dba-4395-b644-4aeb45e9b8e7\") " pod="openshift-dns/dns-default-k69kw"
Jul 16 11:08:56.773025 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:56.773031    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5vmvf\" (UniqueName: \"kubernetes.io/projected/a87056cf-7dba-4395-b644-4aeb45e9b8e7-kube-api-access-5vmvf\") pod \"dns-default-k69kw\" (UID: \"a87056cf-7dba-4395-b644-4aeb45e9b8e7\") " pod="openshift-dns/dns-default-k69kw"
Jul 16 11:08:56.773286 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:56.773064    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6gxjs\" (UniqueName: \"kubernetes.io/projected/57dd81c5-98a2-455f-bb65-4f35f1979846-kube-api-access-6gxjs\") pod \"ingress-canary-6x8n4\" (UID: \"57dd81c5-98a2-455f-bb65-4f35f1979846\") " pod="openshift-ingress-canary/ingress-canary-6x8n4"
Jul 16 11:08:56.773286 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:56.773162    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a87056cf-7dba-4395-b644-4aeb45e9b8e7-metrics-tls\") pod \"dns-default-k69kw\" (UID: \"a87056cf-7dba-4395-b644-4aeb45e9b8e7\") " pod="openshift-dns/dns-default-k69kw"
Jul 16 11:08:56.773286 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:56.773200    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a87056cf-7dba-4395-b644-4aeb45e9b8e7-tmp-dir\") pod \"dns-default-k69kw\" (UID: \"a87056cf-7dba-4395-b644-4aeb45e9b8e7\") " pod="openshift-dns/dns-default-k69kw"
Jul 16 11:08:56.773286 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:56.773275    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/57dd81c5-98a2-455f-bb65-4f35f1979846-cert\") pod \"ingress-canary-6x8n4\" (UID: \"57dd81c5-98a2-455f-bb65-4f35f1979846\") " pod="openshift-ingress-canary/ingress-canary-6x8n4"
Jul 16 11:08:56.779993 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:56.779957    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:08:56.874375 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:56.874296    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/a87056cf-7dba-4395-b644-4aeb45e9b8e7-config-volume\") pod \"dns-default-k69kw\" (UID: \"a87056cf-7dba-4395-b644-4aeb45e9b8e7\") " pod="openshift-dns/dns-default-k69kw"
Jul 16 11:08:56.874375 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:56.874333    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5vmvf\" (UniqueName: \"kubernetes.io/projected/a87056cf-7dba-4395-b644-4aeb45e9b8e7-kube-api-access-5vmvf\") pod \"dns-default-k69kw\" (UID: \"a87056cf-7dba-4395-b644-4aeb45e9b8e7\") " pod="openshift-dns/dns-default-k69kw"
Jul 16 11:08:56.874601 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:56.874407    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6gxjs\" (UniqueName: \"kubernetes.io/projected/57dd81c5-98a2-455f-bb65-4f35f1979846-kube-api-access-6gxjs\") pod \"ingress-canary-6x8n4\" (UID: \"57dd81c5-98a2-455f-bb65-4f35f1979846\") " pod="openshift-ingress-canary/ingress-canary-6x8n4"
Jul 16 11:08:56.874601 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:56.874453    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a87056cf-7dba-4395-b644-4aeb45e9b8e7-metrics-tls\") pod \"dns-default-k69kw\" (UID: \"a87056cf-7dba-4395-b644-4aeb45e9b8e7\") " pod="openshift-dns/dns-default-k69kw"
Jul 16 11:08:56.874601 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:56.874476    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a87056cf-7dba-4395-b644-4aeb45e9b8e7-tmp-dir\") pod \"dns-default-k69kw\" (UID: \"a87056cf-7dba-4395-b644-4aeb45e9b8e7\") " pod="openshift-dns/dns-default-k69kw"
Jul 16 11:08:56.874601 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:56.874526    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/57dd81c5-98a2-455f-bb65-4f35f1979846-cert\") pod \"ingress-canary-6x8n4\" (UID: \"57dd81c5-98a2-455f-bb65-4f35f1979846\") " pod="openshift-ingress-canary/ingress-canary-6x8n4"
Jul 16 11:08:56.874601 ip-10-0-135-184 kubenswrapper[2564]: E0716 11:08:56.874591    2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 16 11:08:56.874854 ip-10-0-135-184 kubenswrapper[2564]: E0716 11:08:56.874663    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a87056cf-7dba-4395-b644-4aeb45e9b8e7-metrics-tls podName:a87056cf-7dba-4395-b644-4aeb45e9b8e7 nodeName:}" failed. No retries permitted until 2026-07-16 11:08:57.374642841 +0000 UTC m=+37.746179874 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a87056cf-7dba-4395-b644-4aeb45e9b8e7-metrics-tls") pod "dns-default-k69kw" (UID: "a87056cf-7dba-4395-b644-4aeb45e9b8e7") : secret "dns-default-metrics-tls" not found
Jul 16 11:08:56.874854 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:56.874763    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a87056cf-7dba-4395-b644-4aeb45e9b8e7-tmp-dir\") pod \"dns-default-k69kw\" (UID: \"a87056cf-7dba-4395-b644-4aeb45e9b8e7\") " pod="openshift-dns/dns-default-k69kw"
Jul 16 11:08:56.874997 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:56.874981    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/a87056cf-7dba-4395-b644-4aeb45e9b8e7-config-volume\") pod \"dns-default-k69kw\" (UID: \"a87056cf-7dba-4395-b644-4aeb45e9b8e7\") " pod="openshift-dns/dns-default-k69kw"
Jul 16 11:08:56.878870 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:56.878835    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/57dd81c5-98a2-455f-bb65-4f35f1979846-cert\") pod \"ingress-canary-6x8n4\" (UID: \"57dd81c5-98a2-455f-bb65-4f35f1979846\") " pod="openshift-ingress-canary/ingress-canary-6x8n4"
Jul 16 11:08:56.883305 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:56.883278    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5vmvf\" (UniqueName: \"kubernetes.io/projected/a87056cf-7dba-4395-b644-4aeb45e9b8e7-kube-api-access-5vmvf\") pod \"dns-default-k69kw\" (UID: \"a87056cf-7dba-4395-b644-4aeb45e9b8e7\") " pod="openshift-dns/dns-default-k69kw"
Jul 16 11:08:56.883424 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:56.883381    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6gxjs\" (UniqueName: \"kubernetes.io/projected/57dd81c5-98a2-455f-bb65-4f35f1979846-kube-api-access-6gxjs\") pod \"ingress-canary-6x8n4\" (UID: \"57dd81c5-98a2-455f-bb65-4f35f1979846\") " pod="openshift-ingress-canary/ingress-canary-6x8n4"
Jul 16 11:08:56.974557 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:56.974526    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-6x8n4"
Jul 16 11:08:57.172716 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:57.172683    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-6x8n4"]
Jul 16 11:08:57.191844 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:08:57.191803    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod57dd81c5_98a2_455f_bb65_4f35f1979846.slice/crio-ad94ee71b4e21ffacd463df2a49e34b15936b42428accec93d953b672292df28 WatchSource:0}: Error finding container ad94ee71b4e21ffacd463df2a49e34b15936b42428accec93d953b672292df28: Status 404 returned error can't find the container with id ad94ee71b4e21ffacd463df2a49e34b15936b42428accec93d953b672292df28
Jul 16 11:08:57.295374 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:57.295333    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hwl88"
Jul 16 11:08:57.295374 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:57.295374    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pzsf4"
Jul 16 11:08:57.298168 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:57.298145    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-wdm79\""
Jul 16 11:08:57.298564 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:57.298481    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 16 11:08:57.298616 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:57.298570    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 16 11:08:57.298741 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:57.298723    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 16 11:08:57.379266 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:57.379168    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a87056cf-7dba-4395-b644-4aeb45e9b8e7-metrics-tls\") pod \"dns-default-k69kw\" (UID: \"a87056cf-7dba-4395-b644-4aeb45e9b8e7\") " pod="openshift-dns/dns-default-k69kw"
Jul 16 11:08:57.379414 ip-10-0-135-184 kubenswrapper[2564]: E0716 11:08:57.379327    2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 16 11:08:57.379452 ip-10-0-135-184 kubenswrapper[2564]: E0716 11:08:57.379426    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a87056cf-7dba-4395-b644-4aeb45e9b8e7-metrics-tls podName:a87056cf-7dba-4395-b644-4aeb45e9b8e7 nodeName:}" failed. No retries permitted until 2026-07-16 11:08:58.379407107 +0000 UTC m=+38.750944122 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a87056cf-7dba-4395-b644-4aeb45e9b8e7-metrics-tls") pod "dns-default-k69kw" (UID: "a87056cf-7dba-4395-b644-4aeb45e9b8e7") : secret "dns-default-metrics-tls" not found
Jul 16 11:08:57.641003 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:57.640919    2564 generic.go:356] "Generic (PLEG): container finished" podID="60499157-9d8a-4985-802c-be1c0ae7f411" containerID="8e43405757ecd7ba8806b8872d68d842dccce2cd2a1a8fe70bd56e8f3428faa7" exitCode=0
Jul 16 11:08:57.641170 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:57.640999    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-klw5l" event={"ID":"60499157-9d8a-4985-802c-be1c0ae7f411","Type":"ContainerDied","Data":"8e43405757ecd7ba8806b8872d68d842dccce2cd2a1a8fe70bd56e8f3428faa7"}
Jul 16 11:08:57.642242 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:57.642219    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-6x8n4" event={"ID":"57dd81c5-98a2-455f-bb65-4f35f1979846","Type":"ContainerStarted","Data":"ad94ee71b4e21ffacd463df2a49e34b15936b42428accec93d953b672292df28"}
Jul 16 11:08:58.296222 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:58.296034    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pxp5q"
Jul 16 11:08:58.298404 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:58.298379    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 16 11:08:58.298404 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:58.298396    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-hjhcs\""
Jul 16 11:08:58.378111 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:58.378075    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:08:58.388105 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:58.388076    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a87056cf-7dba-4395-b644-4aeb45e9b8e7-metrics-tls\") pod \"dns-default-k69kw\" (UID: \"a87056cf-7dba-4395-b644-4aeb45e9b8e7\") " pod="openshift-dns/dns-default-k69kw"
Jul 16 11:08:58.388237 ip-10-0-135-184 kubenswrapper[2564]: E0716 11:08:58.388220    2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 16 11:08:58.388290 ip-10-0-135-184 kubenswrapper[2564]: E0716 11:08:58.388280    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a87056cf-7dba-4395-b644-4aeb45e9b8e7-metrics-tls podName:a87056cf-7dba-4395-b644-4aeb45e9b8e7 nodeName:}" failed. No retries permitted until 2026-07-16 11:09:00.388264043 +0000 UTC m=+40.759801056 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a87056cf-7dba-4395-b644-4aeb45e9b8e7-metrics-tls") pod "dns-default-k69kw" (UID: "a87056cf-7dba-4395-b644-4aeb45e9b8e7") : secret "dns-default-metrics-tls" not found
Jul 16 11:08:58.648443 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:58.648343    2564 generic.go:356] "Generic (PLEG): container finished" podID="60499157-9d8a-4985-802c-be1c0ae7f411" containerID="a48e8a16296220a4549f679ec315a06fda4be4b51e5cb0e80ec1a9f8f342629c" exitCode=0
Jul 16 11:08:58.648443 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:58.648421    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-klw5l" event={"ID":"60499157-9d8a-4985-802c-be1c0ae7f411","Type":"ContainerDied","Data":"a48e8a16296220a4549f679ec315a06fda4be4b51e5cb0e80ec1a9f8f342629c"}
Jul 16 11:08:59.006212 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:59.006171    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:08:59.107050 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:59.107018    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:08:59.655566 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:59.655484    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-klw5l" event={"ID":"60499157-9d8a-4985-802c-be1c0ae7f411","Type":"ContainerStarted","Data":"c14d121fabd3a05848b170b3cd1fa74dea4f224dd89b4ae64797a2b6964c0d2d"}
Jul 16 11:08:59.680502 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:59.680411    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-klw5l" podStartSLOduration=8.202022276 podStartE2EDuration="39.680393732s" totalImagesPullingTime="31.478371456s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 11:08:20 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 11:08:59.680231444 +0000 UTC m=+40.051768481" watchObservedRunningTime="2026-07-16 11:08:59.680393732 +0000 UTC m=+40.051930759"
Jul 16 11:08:59.808367 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:59.808330    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:08:59.892763 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:59.892716    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:08:59.974979 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:08:59.974881    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:09:00.076659 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:00.076623    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:09:00.176924 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:00.176815    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:09:00.258297 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:00.258267    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:09:00.352596 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:00.352552    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:09:00.405420 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:00.405379    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a87056cf-7dba-4395-b644-4aeb45e9b8e7-metrics-tls\") pod \"dns-default-k69kw\" (UID: \"a87056cf-7dba-4395-b644-4aeb45e9b8e7\") " pod="openshift-dns/dns-default-k69kw"
Jul 16 11:09:00.405683 ip-10-0-135-184 kubenswrapper[2564]: E0716 11:09:00.405561    2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 16 11:09:00.405683 ip-10-0-135-184 kubenswrapper[2564]: E0716 11:09:00.405658    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a87056cf-7dba-4395-b644-4aeb45e9b8e7-metrics-tls podName:a87056cf-7dba-4395-b644-4aeb45e9b8e7 nodeName:}" failed. No retries permitted until 2026-07-16 11:09:04.405636484 +0000 UTC m=+44.777173510 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a87056cf-7dba-4395-b644-4aeb45e9b8e7-metrics-tls") pod "dns-default-k69kw" (UID: "a87056cf-7dba-4395-b644-4aeb45e9b8e7") : secret "dns-default-metrics-tls" not found
Jul 16 11:09:00.452423 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:00.452374    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:09:02.664137 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:02.664103    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-6x8n4" event={"ID":"57dd81c5-98a2-455f-bb65-4f35f1979846","Type":"ContainerStarted","Data":"78fceb63e379497caea8f19651d1cd9507a6ba47cf49c5a9991e1b081b36688e"}
Jul 16 11:09:02.682857 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:02.682802    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-6x8n4" podStartSLOduration=2.063402942 podStartE2EDuration="6.682763518s" totalImagesPullingTime="4.619360576s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 11:08:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 11:09:02.682289055 +0000 UTC m=+43.053826111" watchObservedRunningTime="2026-07-16 11:09:02.682763518 +0000 UTC m=+43.054300553"
Jul 16 11:09:03.988609 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:03.988570    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:09:04.436063 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:04.436020    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a87056cf-7dba-4395-b644-4aeb45e9b8e7-metrics-tls\") pod \"dns-default-k69kw\" (UID: \"a87056cf-7dba-4395-b644-4aeb45e9b8e7\") " pod="openshift-dns/dns-default-k69kw"
Jul 16 11:09:04.436248 ip-10-0-135-184 kubenswrapper[2564]: E0716 11:09:04.436183    2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 16 11:09:04.436288 ip-10-0-135-184 kubenswrapper[2564]: E0716 11:09:04.436254    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a87056cf-7dba-4395-b644-4aeb45e9b8e7-metrics-tls podName:a87056cf-7dba-4395-b644-4aeb45e9b8e7 nodeName:}" failed. No retries permitted until 2026-07-16 11:09:12.436234897 +0000 UTC m=+52.807771911 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a87056cf-7dba-4395-b644-4aeb45e9b8e7-metrics-tls") pod "dns-default-k69kw" (UID: "a87056cf-7dba-4395-b644-4aeb45e9b8e7") : secret "dns-default-metrics-tls" not found
Jul 16 11:09:06.883248 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:06.883215    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-869dcfcdcd-5jghx"]
Jul 16 11:09:06.936378 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:06.936336    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-869dcfcdcd-5jghx"]
Jul 16 11:09:06.936541 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:06.936466    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-5jghx"
Jul 16 11:09:06.938453 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:06.938432    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-4qpcm\""
Jul 16 11:09:06.992456 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:06.992426    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7695fc6c8c-kmkpn"]
Jul 16 11:09:07.013985 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:07.013960    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-kmkpn"
Jul 16 11:09:07.014146 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:07.013955    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7695fc6c8c-kmkpn"]
Jul 16 11:09:07.016113 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:07.016093    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Jul 16 11:09:07.016113 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:07.016106    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Jul 16 11:09:07.016249 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:07.016166    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Jul 16 11:09:07.016482 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:07.016465    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Jul 16 11:09:07.016482 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:07.016469    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-54rqf\""
Jul 16 11:09:07.057725 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:07.055627    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xg87h\" (UniqueName: \"kubernetes.io/projected/6616b0ad-d677-4d49-85cd-9be622d8de71-kube-api-access-xg87h\") pod \"network-check-source-869dcfcdcd-5jghx\" (UID: \"6616b0ad-d677-4d49-85cd-9be622d8de71\") " pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-5jghx"
Jul 16 11:09:07.090658 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:07.090624    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-6cf856758c-shdrh"]
Jul 16 11:09:07.115762 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:07.115724    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-7866497494-lwmwf"]
Jul 16 11:09:07.116660 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:07.116604    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6cf856758c-shdrh"
Jul 16 11:09:07.119628 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:07.119587    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-h646k\""
Jul 16 11:09:07.119932 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:07.119912    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
Jul 16 11:09:07.120042 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:07.119915    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
Jul 16 11:09:07.131829 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:07.131803    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-65978f8f75-jt6p5"]
Jul 16 11:09:07.131970 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:07.131878    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-7866497494-lwmwf"
Jul 16 11:09:07.133978 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:07.133917    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
Jul 16 11:09:07.133978 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:07.133952    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
Jul 16 11:09:07.134179 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:07.134009    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-dh74d\""
Jul 16 11:09:07.134179 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:07.134141    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
Jul 16 11:09:07.134392 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:07.134378    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
Jul 16 11:09:07.139845 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:07.139820    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
Jul 16 11:09:07.150076 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:07.150047    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-7f4487f9c8-wnk66"]
Jul 16 11:09:07.150200 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:07.150174    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-65978f8f75-jt6p5"
Jul 16 11:09:07.152351 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:07.152325    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 16 11:09:07.152465 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:07.152359    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 16 11:09:07.152465 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:07.152328    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 16 11:09:07.152465 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:07.152445    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-bq7p2\""
Jul 16 11:09:07.158568 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:07.158544    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 16 11:09:07.158854 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:07.158541    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xg87h\" (UniqueName: \"kubernetes.io/projected/6616b0ad-d677-4d49-85cd-9be622d8de71-kube-api-access-xg87h\") pod \"network-check-source-869dcfcdcd-5jghx\" (UID: \"6616b0ad-d677-4d49-85cd-9be622d8de71\") " pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-5jghx"
Jul 16 11:09:07.159015 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:07.158999    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/bb246ab5-caf3-4eef-b0fe-07e6f3d447b7-config\") pod \"service-ca-operator-7695fc6c8c-kmkpn\" (UID: \"bb246ab5-caf3-4eef-b0fe-07e6f3d447b7\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-kmkpn"
Jul 16 11:09:07.159201 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:07.159185    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tz686\" (UniqueName: \"kubernetes.io/projected/bb246ab5-caf3-4eef-b0fe-07e6f3d447b7-kube-api-access-tz686\") pod \"service-ca-operator-7695fc6c8c-kmkpn\" (UID: \"bb246ab5-caf3-4eef-b0fe-07e6f3d447b7\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-kmkpn"
Jul 16 11:09:07.159351 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:07.159334    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/bb246ab5-caf3-4eef-b0fe-07e6f3d447b7-serving-cert\") pod \"service-ca-operator-7695fc6c8c-kmkpn\" (UID: \"bb246ab5-caf3-4eef-b0fe-07e6f3d447b7\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-kmkpn"
Jul 16 11:09:07.167983 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:07.167881    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xg87h\" (UniqueName: \"kubernetes.io/projected/6616b0ad-d677-4d49-85cd-9be622d8de71-kube-api-access-xg87h\") pod \"network-check-source-869dcfcdcd-5jghx\" (UID: \"6616b0ad-d677-4d49-85cd-9be622d8de71\") " pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-5jghx"
Jul 16 11:09:07.170124 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:07.170103    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6cf856758c-shdrh"]
Jul 16 11:09:07.170203 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:07.170137    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-7866497494-lwmwf"]
Jul 16 11:09:07.170203 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:07.170150    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-7f4487f9c8-wnk66"]
Jul 16 11:09:07.170203 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:07.170162    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-65978f8f75-jt6p5"]
Jul 16 11:09:07.170295 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:07.170215    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-7f4487f9c8-wnk66"
Jul 16 11:09:07.172252 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:07.172233    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-246zp\""
Jul 16 11:09:07.172453 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:07.172431    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 16 11:09:07.172570 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:07.172497    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Jul 16 11:09:07.172632 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:07.172573    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Jul 16 11:09:07.172673 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:07.172653    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Jul 16 11:09:07.172908 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:07.172890    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Jul 16 11:09:07.172974 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:07.172916    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 16 11:09:07.226657 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:07.226623    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:09:07.245542 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:07.245508    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-5jghx"
Jul 16 11:09:07.259900 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:07.259861    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/9cc04542-5f65-43d8-b15f-5647477c2927-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-shdrh\" (UID: \"9cc04542-5f65-43d8-b15f-5647477c2927\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-shdrh"
Jul 16 11:09:07.259900 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:07.259900    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/3983837b-b29b-41d3-ab7f-2247c578e01f-image-registry-private-configuration\") pod \"image-registry-65978f8f75-jt6p5\" (UID: \"3983837b-b29b-41d3-ab7f-2247c578e01f\") " pod="openshift-image-registry/image-registry-65978f8f75-jt6p5"
Jul 16 11:09:07.260086 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:07.259952    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tz686\" (UniqueName: \"kubernetes.io/projected/bb246ab5-caf3-4eef-b0fe-07e6f3d447b7-kube-api-access-tz686\") pod \"service-ca-operator-7695fc6c8c-kmkpn\" (UID: \"bb246ab5-caf3-4eef-b0fe-07e6f3d447b7\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-kmkpn"
Jul 16 11:09:07.260086 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:07.259974    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/9cc04542-5f65-43d8-b15f-5647477c2927-nginx-conf\") pod \"networking-console-plugin-6cf856758c-shdrh\" (UID: \"9cc04542-5f65-43d8-b15f-5647477c2927\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-shdrh"
Jul 16 11:09:07.260086 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:07.259990    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4cb63124-522c-41e2-9d85-c2af29ac8eff-trusted-ca\") pod \"console-operator-7866497494-lwmwf\" (UID: \"4cb63124-522c-41e2-9d85-c2af29ac8eff\") " pod="openshift-console-operator/console-operator-7866497494-lwmwf"
Jul 16 11:09:07.260086 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:07.260015    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/4cb63124-522c-41e2-9d85-c2af29ac8eff-config\") pod \"console-operator-7866497494-lwmwf\" (UID: \"4cb63124-522c-41e2-9d85-c2af29ac8eff\") " pod="openshift-console-operator/console-operator-7866497494-lwmwf"
Jul 16 11:09:07.260086 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:07.260034    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3983837b-b29b-41d3-ab7f-2247c578e01f-registry-tls\") pod \"image-registry-65978f8f75-jt6p5\" (UID: \"3983837b-b29b-41d3-ab7f-2247c578e01f\") " pod="openshift-image-registry/image-registry-65978f8f75-jt6p5"
Jul 16 11:09:07.260249 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:07.260104    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/3983837b-b29b-41d3-ab7f-2247c578e01f-registry-certificates\") pod \"image-registry-65978f8f75-jt6p5\" (UID: \"3983837b-b29b-41d3-ab7f-2247c578e01f\") " pod="openshift-image-registry/image-registry-65978f8f75-jt6p5"
Jul 16 11:09:07.260249 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:07.260127    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hhm9w\" (UniqueName: \"kubernetes.io/projected/3983837b-b29b-41d3-ab7f-2247c578e01f-kube-api-access-hhm9w\") pod \"image-registry-65978f8f75-jt6p5\" (UID: \"3983837b-b29b-41d3-ab7f-2247c578e01f\") " pod="openshift-image-registry/image-registry-65978f8f75-jt6p5"
Jul 16 11:09:07.260249 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:07.260147    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/bb246ab5-caf3-4eef-b0fe-07e6f3d447b7-serving-cert\") pod \"service-ca-operator-7695fc6c8c-kmkpn\" (UID: \"bb246ab5-caf3-4eef-b0fe-07e6f3d447b7\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-kmkpn"
Jul 16 11:09:07.260249 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:07.260164    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/4cb63124-522c-41e2-9d85-c2af29ac8eff-serving-cert\") pod \"console-operator-7866497494-lwmwf\" (UID: \"4cb63124-522c-41e2-9d85-c2af29ac8eff\") " pod="openshift-console-operator/console-operator-7866497494-lwmwf"
Jul 16 11:09:07.260249 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:07.260185    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/3983837b-b29b-41d3-ab7f-2247c578e01f-ca-trust-extracted\") pod \"image-registry-65978f8f75-jt6p5\" (UID: \"3983837b-b29b-41d3-ab7f-2247c578e01f\") " pod="openshift-image-registry/image-registry-65978f8f75-jt6p5"
Jul 16 11:09:07.260433 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:07.260283    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/3983837b-b29b-41d3-ab7f-2247c578e01f-installation-pull-secrets\") pod \"image-registry-65978f8f75-jt6p5\" (UID: \"3983837b-b29b-41d3-ab7f-2247c578e01f\") " pod="openshift-image-registry/image-registry-65978f8f75-jt6p5"
Jul 16 11:09:07.260433 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:07.260331    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ggdkz\" (UniqueName: \"kubernetes.io/projected/4cb63124-522c-41e2-9d85-c2af29ac8eff-kube-api-access-ggdkz\") pod \"console-operator-7866497494-lwmwf\" (UID: \"4cb63124-522c-41e2-9d85-c2af29ac8eff\") " pod="openshift-console-operator/console-operator-7866497494-lwmwf"
Jul 16 11:09:07.260433 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:07.260354    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/3983837b-b29b-41d3-ab7f-2247c578e01f-trusted-ca\") pod \"image-registry-65978f8f75-jt6p5\" (UID: \"3983837b-b29b-41d3-ab7f-2247c578e01f\") " pod="openshift-image-registry/image-registry-65978f8f75-jt6p5"
Jul 16 11:09:07.260433 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:07.260369    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3983837b-b29b-41d3-ab7f-2247c578e01f-bound-sa-token\") pod \"image-registry-65978f8f75-jt6p5\" (UID: \"3983837b-b29b-41d3-ab7f-2247c578e01f\") " pod="openshift-image-registry/image-registry-65978f8f75-jt6p5"
Jul 16 11:09:07.260433 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:07.260401    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/bb246ab5-caf3-4eef-b0fe-07e6f3d447b7-config\") pod \"service-ca-operator-7695fc6c8c-kmkpn\" (UID: \"bb246ab5-caf3-4eef-b0fe-07e6f3d447b7\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-kmkpn"
Jul 16 11:09:07.260925 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:07.260908    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/bb246ab5-caf3-4eef-b0fe-07e6f3d447b7-config\") pod \"service-ca-operator-7695fc6c8c-kmkpn\" (UID: \"bb246ab5-caf3-4eef-b0fe-07e6f3d447b7\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-kmkpn"
Jul 16 11:09:07.262449 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:07.262415    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/bb246ab5-caf3-4eef-b0fe-07e6f3d447b7-serving-cert\") pod \"service-ca-operator-7695fc6c8c-kmkpn\" (UID: \"bb246ab5-caf3-4eef-b0fe-07e6f3d447b7\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-kmkpn"
Jul 16 11:09:07.268241 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:07.268218    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tz686\" (UniqueName: \"kubernetes.io/projected/bb246ab5-caf3-4eef-b0fe-07e6f3d447b7-kube-api-access-tz686\") pod \"service-ca-operator-7695fc6c8c-kmkpn\" (UID: \"bb246ab5-caf3-4eef-b0fe-07e6f3d447b7\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-kmkpn"
Jul 16 11:09:07.323146 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:07.323114    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-kmkpn"
Jul 16 11:09:07.332790 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:07.332724    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:09:07.360912 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:07.360873    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ggdkz\" (UniqueName: \"kubernetes.io/projected/4cb63124-522c-41e2-9d85-c2af29ac8eff-kube-api-access-ggdkz\") pod \"console-operator-7866497494-lwmwf\" (UID: \"4cb63124-522c-41e2-9d85-c2af29ac8eff\") " pod="openshift-console-operator/console-operator-7866497494-lwmwf"
Jul 16 11:09:07.361072 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:07.360935    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/9cc04542-5f65-43d8-b15f-5647477c2927-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-shdrh\" (UID: \"9cc04542-5f65-43d8-b15f-5647477c2927\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-shdrh"
Jul 16 11:09:07.361072 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:07.361001    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/13fa2ca5-b90c-46e7-92bc-7a8cb4c036a2-default-certificate\") pod \"router-default-7f4487f9c8-wnk66\" (UID: \"13fa2ca5-b90c-46e7-92bc-7a8cb4c036a2\") " pod="openshift-ingress/router-default-7f4487f9c8-wnk66"
Jul 16 11:09:07.361072 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:07.361045    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3983837b-b29b-41d3-ab7f-2247c578e01f-bound-sa-token\") pod \"image-registry-65978f8f75-jt6p5\" (UID: \"3983837b-b29b-41d3-ab7f-2247c578e01f\") " pod="openshift-image-registry/image-registry-65978f8f75-jt6p5"
Jul 16 11:09:07.361072 ip-10-0-135-184 kubenswrapper[2564]: E0716 11:09:07.361051    2564 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 16 11:09:07.361072 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:07.361068    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4cb63124-522c-41e2-9d85-c2af29ac8eff-trusted-ca\") pod \"console-operator-7866497494-lwmwf\" (UID: \"4cb63124-522c-41e2-9d85-c2af29ac8eff\") " pod="openshift-console-operator/console-operator-7866497494-lwmwf"
Jul 16 11:09:07.361341 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:07.361087    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hhm9w\" (UniqueName: \"kubernetes.io/projected/3983837b-b29b-41d3-ab7f-2247c578e01f-kube-api-access-hhm9w\") pod \"image-registry-65978f8f75-jt6p5\" (UID: \"3983837b-b29b-41d3-ab7f-2247c578e01f\") " pod="openshift-image-registry/image-registry-65978f8f75-jt6p5"
Jul 16 11:09:07.361341 ip-10-0-135-184 kubenswrapper[2564]: E0716 11:09:07.361118    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9cc04542-5f65-43d8-b15f-5647477c2927-networking-console-plugin-cert podName:9cc04542-5f65-43d8-b15f-5647477c2927 nodeName:}" failed. No retries permitted until 2026-07-16 11:09:07.861096184 +0000 UTC m=+48.232633215 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/9cc04542-5f65-43d8-b15f-5647477c2927-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-shdrh" (UID: "9cc04542-5f65-43d8-b15f-5647477c2927") : secret "networking-console-plugin-cert" not found
Jul 16 11:09:07.361341 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:07.361168    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/4cb63124-522c-41e2-9d85-c2af29ac8eff-config\") pod \"console-operator-7866497494-lwmwf\" (UID: \"4cb63124-522c-41e2-9d85-c2af29ac8eff\") " pod="openshift-console-operator/console-operator-7866497494-lwmwf"
Jul 16 11:09:07.361341 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:07.361206    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/3983837b-b29b-41d3-ab7f-2247c578e01f-registry-certificates\") pod \"image-registry-65978f8f75-jt6p5\" (UID: \"3983837b-b29b-41d3-ab7f-2247c578e01f\") " pod="openshift-image-registry/image-registry-65978f8f75-jt6p5"
Jul 16 11:09:07.361341 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:07.361259    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/4cb63124-522c-41e2-9d85-c2af29ac8eff-serving-cert\") pod \"console-operator-7866497494-lwmwf\" (UID: \"4cb63124-522c-41e2-9d85-c2af29ac8eff\") " pod="openshift-console-operator/console-operator-7866497494-lwmwf"
Jul 16 11:09:07.361341 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:07.361299    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/13fa2ca5-b90c-46e7-92bc-7a8cb4c036a2-stats-auth\") pod \"router-default-7f4487f9c8-wnk66\" (UID: \"13fa2ca5-b90c-46e7-92bc-7a8cb4c036a2\") " pod="openshift-ingress/router-default-7f4487f9c8-wnk66"
Jul 16 11:09:07.361667 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:07.361355    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/3983837b-b29b-41d3-ab7f-2247c578e01f-image-registry-private-configuration\") pod \"image-registry-65978f8f75-jt6p5\" (UID: \"3983837b-b29b-41d3-ab7f-2247c578e01f\") " pod="openshift-image-registry/image-registry-65978f8f75-jt6p5"
Jul 16 11:09:07.361667 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:07.361385    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kjcrf\" (UniqueName: \"kubernetes.io/projected/13fa2ca5-b90c-46e7-92bc-7a8cb4c036a2-kube-api-access-kjcrf\") pod \"router-default-7f4487f9c8-wnk66\" (UID: \"13fa2ca5-b90c-46e7-92bc-7a8cb4c036a2\") " pod="openshift-ingress/router-default-7f4487f9c8-wnk66"
Jul 16 11:09:07.361667 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:07.361409    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/3983837b-b29b-41d3-ab7f-2247c578e01f-trusted-ca\") pod \"image-registry-65978f8f75-jt6p5\" (UID: \"3983837b-b29b-41d3-ab7f-2247c578e01f\") " pod="openshift-image-registry/image-registry-65978f8f75-jt6p5"
Jul 16 11:09:07.361667 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:07.361449    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/9cc04542-5f65-43d8-b15f-5647477c2927-nginx-conf\") pod \"networking-console-plugin-6cf856758c-shdrh\" (UID: \"9cc04542-5f65-43d8-b15f-5647477c2927\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-shdrh"
Jul 16 11:09:07.361667 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:07.361472    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/3983837b-b29b-41d3-ab7f-2247c578e01f-installation-pull-secrets\") pod \"image-registry-65978f8f75-jt6p5\" (UID: \"3983837b-b29b-41d3-ab7f-2247c578e01f\") " pod="openshift-image-registry/image-registry-65978f8f75-jt6p5"
Jul 16 11:09:07.361667 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:07.361511    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3983837b-b29b-41d3-ab7f-2247c578e01f-registry-tls\") pod \"image-registry-65978f8f75-jt6p5\" (UID: \"3983837b-b29b-41d3-ab7f-2247c578e01f\") " pod="openshift-image-registry/image-registry-65978f8f75-jt6p5"
Jul 16 11:09:07.361667 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:07.361533    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/13fa2ca5-b90c-46e7-92bc-7a8cb4c036a2-metrics-certs\") pod \"router-default-7f4487f9c8-wnk66\" (UID: \"13fa2ca5-b90c-46e7-92bc-7a8cb4c036a2\") " pod="openshift-ingress/router-default-7f4487f9c8-wnk66"
Jul 16 11:09:07.361667 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:07.361576    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/3983837b-b29b-41d3-ab7f-2247c578e01f-ca-trust-extracted\") pod \"image-registry-65978f8f75-jt6p5\" (UID: \"3983837b-b29b-41d3-ab7f-2247c578e01f\") " pod="openshift-image-registry/image-registry-65978f8f75-jt6p5"
Jul 16 11:09:07.361667 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:07.361609    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/13fa2ca5-b90c-46e7-92bc-7a8cb4c036a2-service-ca-bundle\") pod \"router-default-7f4487f9c8-wnk66\" (UID: \"13fa2ca5-b90c-46e7-92bc-7a8cb4c036a2\") " pod="openshift-ingress/router-default-7f4487f9c8-wnk66"
Jul 16 11:09:07.362126 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:07.361874    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/3983837b-b29b-41d3-ab7f-2247c578e01f-registry-certificates\") pod \"image-registry-65978f8f75-jt6p5\" (UID: \"3983837b-b29b-41d3-ab7f-2247c578e01f\") " pod="openshift-image-registry/image-registry-65978f8f75-jt6p5"
Jul 16 11:09:07.362281 ip-10-0-135-184 kubenswrapper[2564]: E0716 11:09:07.362229    2564 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 16 11:09:07.362281 ip-10-0-135-184 kubenswrapper[2564]: E0716 11:09:07.362249    2564 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-65978f8f75-jt6p5: secret "image-registry-tls" not found
Jul 16 11:09:07.362404 ip-10-0-135-184 kubenswrapper[2564]: E0716 11:09:07.362307    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3983837b-b29b-41d3-ab7f-2247c578e01f-registry-tls podName:3983837b-b29b-41d3-ab7f-2247c578e01f nodeName:}" failed. No retries permitted until 2026-07-16 11:09:07.862290566 +0000 UTC m=+48.233827592 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/3983837b-b29b-41d3-ab7f-2247c578e01f-registry-tls") pod "image-registry-65978f8f75-jt6p5" (UID: "3983837b-b29b-41d3-ab7f-2247c578e01f") : secret "image-registry-tls" not found
Jul 16 11:09:07.362467 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:07.362419    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/4cb63124-522c-41e2-9d85-c2af29ac8eff-config\") pod \"console-operator-7866497494-lwmwf\" (UID: \"4cb63124-522c-41e2-9d85-c2af29ac8eff\") " pod="openshift-console-operator/console-operator-7866497494-lwmwf"
Jul 16 11:09:07.362467 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:07.362232    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4cb63124-522c-41e2-9d85-c2af29ac8eff-trusted-ca\") pod \"console-operator-7866497494-lwmwf\" (UID: \"4cb63124-522c-41e2-9d85-c2af29ac8eff\") " pod="openshift-console-operator/console-operator-7866497494-lwmwf"
Jul 16 11:09:07.362865 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:07.362719    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/3983837b-b29b-41d3-ab7f-2247c578e01f-trusted-ca\") pod \"image-registry-65978f8f75-jt6p5\" (UID: \"3983837b-b29b-41d3-ab7f-2247c578e01f\") " pod="openshift-image-registry/image-registry-65978f8f75-jt6p5"
Jul 16 11:09:07.362865 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:07.362802    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/3983837b-b29b-41d3-ab7f-2247c578e01f-ca-trust-extracted\") pod \"image-registry-65978f8f75-jt6p5\" (UID: \"3983837b-b29b-41d3-ab7f-2247c578e01f\") " pod="openshift-image-registry/image-registry-65978f8f75-jt6p5"
Jul 16 11:09:07.363068 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:07.362922    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/9cc04542-5f65-43d8-b15f-5647477c2927-nginx-conf\") pod \"networking-console-plugin-6cf856758c-shdrh\" (UID: \"9cc04542-5f65-43d8-b15f-5647477c2927\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-shdrh"
Jul 16 11:09:07.364678 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:07.364534    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/4cb63124-522c-41e2-9d85-c2af29ac8eff-serving-cert\") pod \"console-operator-7866497494-lwmwf\" (UID: \"4cb63124-522c-41e2-9d85-c2af29ac8eff\") " pod="openshift-console-operator/console-operator-7866497494-lwmwf"
Jul 16 11:09:07.365487 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:07.365459    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/3983837b-b29b-41d3-ab7f-2247c578e01f-image-registry-private-configuration\") pod \"image-registry-65978f8f75-jt6p5\" (UID: \"3983837b-b29b-41d3-ab7f-2247c578e01f\") " pod="openshift-image-registry/image-registry-65978f8f75-jt6p5"
Jul 16 11:09:07.366327 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:07.366300    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/3983837b-b29b-41d3-ab7f-2247c578e01f-installation-pull-secrets\") pod \"image-registry-65978f8f75-jt6p5\" (UID: \"3983837b-b29b-41d3-ab7f-2247c578e01f\") " pod="openshift-image-registry/image-registry-65978f8f75-jt6p5"
Jul 16 11:09:07.369714 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:07.369660    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3983837b-b29b-41d3-ab7f-2247c578e01f-bound-sa-token\") pod \"image-registry-65978f8f75-jt6p5\" (UID: \"3983837b-b29b-41d3-ab7f-2247c578e01f\") " pod="openshift-image-registry/image-registry-65978f8f75-jt6p5"
Jul 16 11:09:07.369928 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:07.369751    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ggdkz\" (UniqueName: \"kubernetes.io/projected/4cb63124-522c-41e2-9d85-c2af29ac8eff-kube-api-access-ggdkz\") pod \"console-operator-7866497494-lwmwf\" (UID: \"4cb63124-522c-41e2-9d85-c2af29ac8eff\") " pod="openshift-console-operator/console-operator-7866497494-lwmwf"
Jul 16 11:09:07.370133 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:07.370113    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hhm9w\" (UniqueName: \"kubernetes.io/projected/3983837b-b29b-41d3-ab7f-2247c578e01f-kube-api-access-hhm9w\") pod \"image-registry-65978f8f75-jt6p5\" (UID: \"3983837b-b29b-41d3-ab7f-2247c578e01f\") " pod="openshift-image-registry/image-registry-65978f8f75-jt6p5"
Jul 16 11:09:07.397174 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:07.397094    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-869dcfcdcd-5jghx"]
Jul 16 11:09:07.400631 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:09:07.400599    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6616b0ad_d677_4d49_85cd_9be622d8de71.slice/crio-5972ae545ba5fd1b5dbb535742e3037117a49802a56ed397b32fc300b3d7f309 WatchSource:0}: Error finding container 5972ae545ba5fd1b5dbb535742e3037117a49802a56ed397b32fc300b3d7f309: Status 404 returned error can't find the container with id 5972ae545ba5fd1b5dbb535742e3037117a49802a56ed397b32fc300b3d7f309
Jul 16 11:09:07.400908 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:07.400878    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:09:07.442013 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:07.441978    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-7866497494-lwmwf"
Jul 16 11:09:07.462637 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:07.462550    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/13fa2ca5-b90c-46e7-92bc-7a8cb4c036a2-default-certificate\") pod \"router-default-7f4487f9c8-wnk66\" (UID: \"13fa2ca5-b90c-46e7-92bc-7a8cb4c036a2\") " pod="openshift-ingress/router-default-7f4487f9c8-wnk66"
Jul 16 11:09:07.462637 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:07.462615    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/13fa2ca5-b90c-46e7-92bc-7a8cb4c036a2-stats-auth\") pod \"router-default-7f4487f9c8-wnk66\" (UID: \"13fa2ca5-b90c-46e7-92bc-7a8cb4c036a2\") " pod="openshift-ingress/router-default-7f4487f9c8-wnk66"
Jul 16 11:09:07.462881 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:07.462660    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kjcrf\" (UniqueName: \"kubernetes.io/projected/13fa2ca5-b90c-46e7-92bc-7a8cb4c036a2-kube-api-access-kjcrf\") pod \"router-default-7f4487f9c8-wnk66\" (UID: \"13fa2ca5-b90c-46e7-92bc-7a8cb4c036a2\") " pod="openshift-ingress/router-default-7f4487f9c8-wnk66"
Jul 16 11:09:07.462921 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:07.462867    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/13fa2ca5-b90c-46e7-92bc-7a8cb4c036a2-metrics-certs\") pod \"router-default-7f4487f9c8-wnk66\" (UID: \"13fa2ca5-b90c-46e7-92bc-7a8cb4c036a2\") " pod="openshift-ingress/router-default-7f4487f9c8-wnk66"
Jul 16 11:09:07.462962 ip-10-0-135-184 kubenswrapper[2564]: E0716 11:09:07.462941    2564 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 16 11:09:07.463026 ip-10-0-135-184 kubenswrapper[2564]: E0716 11:09:07.463012    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/13fa2ca5-b90c-46e7-92bc-7a8cb4c036a2-metrics-certs podName:13fa2ca5-b90c-46e7-92bc-7a8cb4c036a2 nodeName:}" failed. No retries permitted until 2026-07-16 11:09:07.962990896 +0000 UTC m=+48.334527915 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/13fa2ca5-b90c-46e7-92bc-7a8cb4c036a2-metrics-certs") pod "router-default-7f4487f9c8-wnk66" (UID: "13fa2ca5-b90c-46e7-92bc-7a8cb4c036a2") : secret "router-metrics-certs-default" not found
Jul 16 11:09:07.463088 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:07.462943    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/13fa2ca5-b90c-46e7-92bc-7a8cb4c036a2-service-ca-bundle\") pod \"router-default-7f4487f9c8-wnk66\" (UID: \"13fa2ca5-b90c-46e7-92bc-7a8cb4c036a2\") " pod="openshift-ingress/router-default-7f4487f9c8-wnk66"
Jul 16 11:09:07.463088 ip-10-0-135-184 kubenswrapper[2564]: E0716 11:09:07.463049    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/13fa2ca5-b90c-46e7-92bc-7a8cb4c036a2-service-ca-bundle podName:13fa2ca5-b90c-46e7-92bc-7a8cb4c036a2 nodeName:}" failed. No retries permitted until 2026-07-16 11:09:07.963031912 +0000 UTC m=+48.334568945 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/13fa2ca5-b90c-46e7-92bc-7a8cb4c036a2-service-ca-bundle") pod "router-default-7f4487f9c8-wnk66" (UID: "13fa2ca5-b90c-46e7-92bc-7a8cb4c036a2") : configmap references non-existent config key: service-ca.crt
Jul 16 11:09:07.465208 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:07.465180    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/13fa2ca5-b90c-46e7-92bc-7a8cb4c036a2-default-certificate\") pod \"router-default-7f4487f9c8-wnk66\" (UID: \"13fa2ca5-b90c-46e7-92bc-7a8cb4c036a2\") " pod="openshift-ingress/router-default-7f4487f9c8-wnk66"
Jul 16 11:09:07.465311 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:07.465232    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/13fa2ca5-b90c-46e7-92bc-7a8cb4c036a2-stats-auth\") pod \"router-default-7f4487f9c8-wnk66\" (UID: \"13fa2ca5-b90c-46e7-92bc-7a8cb4c036a2\") " pod="openshift-ingress/router-default-7f4487f9c8-wnk66"
Jul 16 11:09:07.471864 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:07.471838    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kjcrf\" (UniqueName: \"kubernetes.io/projected/13fa2ca5-b90c-46e7-92bc-7a8cb4c036a2-kube-api-access-kjcrf\") pod \"router-default-7f4487f9c8-wnk66\" (UID: \"13fa2ca5-b90c-46e7-92bc-7a8cb4c036a2\") " pod="openshift-ingress/router-default-7f4487f9c8-wnk66"
Jul 16 11:09:07.497739 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:07.497698    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7695fc6c8c-kmkpn"]
Jul 16 11:09:07.500627 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:09:07.500597    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbb246ab5_caf3_4eef_b0fe_07e6f3d447b7.slice/crio-e0e690b411f0b732496aa5bd9fc49dd49fddc6bdc45a7609aa2d5236f3cbd48d WatchSource:0}: Error finding container e0e690b411f0b732496aa5bd9fc49dd49fddc6bdc45a7609aa2d5236f3cbd48d: Status 404 returned error can't find the container with id e0e690b411f0b732496aa5bd9fc49dd49fddc6bdc45a7609aa2d5236f3cbd48d
Jul 16 11:09:07.602429 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:07.602393    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-7866497494-lwmwf"]
Jul 16 11:09:07.605988 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:09:07.605960    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4cb63124_522c_41e2_9d85_c2af29ac8eff.slice/crio-8ba8caefb4b8398bd9059cd1945152261a6e47add1a70a6ab0c4e5f2116d6506 WatchSource:0}: Error finding container 8ba8caefb4b8398bd9059cd1945152261a6e47add1a70a6ab0c4e5f2116d6506: Status 404 returned error can't find the container with id 8ba8caefb4b8398bd9059cd1945152261a6e47add1a70a6ab0c4e5f2116d6506
Jul 16 11:09:07.677276 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:07.677189    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-lwmwf" event={"ID":"4cb63124-522c-41e2-9d85-c2af29ac8eff","Type":"ContainerStarted","Data":"8ba8caefb4b8398bd9059cd1945152261a6e47add1a70a6ab0c4e5f2116d6506"}
Jul 16 11:09:07.678360 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:07.678331    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-kmkpn" event={"ID":"bb246ab5-caf3-4eef-b0fe-07e6f3d447b7","Type":"ContainerStarted","Data":"e0e690b411f0b732496aa5bd9fc49dd49fddc6bdc45a7609aa2d5236f3cbd48d"}
Jul 16 11:09:07.679351 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:07.679332    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-5jghx" event={"ID":"6616b0ad-d677-4d49-85cd-9be622d8de71","Type":"ContainerStarted","Data":"5972ae545ba5fd1b5dbb535742e3037117a49802a56ed397b32fc300b3d7f309"}
Jul 16 11:09:07.865781 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:07.865745    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3983837b-b29b-41d3-ab7f-2247c578e01f-registry-tls\") pod \"image-registry-65978f8f75-jt6p5\" (UID: \"3983837b-b29b-41d3-ab7f-2247c578e01f\") " pod="openshift-image-registry/image-registry-65978f8f75-jt6p5"
Jul 16 11:09:07.865981 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:07.865861    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/9cc04542-5f65-43d8-b15f-5647477c2927-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-shdrh\" (UID: \"9cc04542-5f65-43d8-b15f-5647477c2927\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-shdrh"
Jul 16 11:09:07.865981 ip-10-0-135-184 kubenswrapper[2564]: E0716 11:09:07.865904    2564 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 16 11:09:07.865981 ip-10-0-135-184 kubenswrapper[2564]: E0716 11:09:07.865921    2564 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-65978f8f75-jt6p5: secret "image-registry-tls" not found
Jul 16 11:09:07.865981 ip-10-0-135-184 kubenswrapper[2564]: E0716 11:09:07.865980    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3983837b-b29b-41d3-ab7f-2247c578e01f-registry-tls podName:3983837b-b29b-41d3-ab7f-2247c578e01f nodeName:}" failed. No retries permitted until 2026-07-16 11:09:08.865960621 +0000 UTC m=+49.237497652 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/3983837b-b29b-41d3-ab7f-2247c578e01f-registry-tls") pod "image-registry-65978f8f75-jt6p5" (UID: "3983837b-b29b-41d3-ab7f-2247c578e01f") : secret "image-registry-tls" not found
Jul 16 11:09:07.866206 ip-10-0-135-184 kubenswrapper[2564]: E0716 11:09:07.866037    2564 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 16 11:09:07.866206 ip-10-0-135-184 kubenswrapper[2564]: E0716 11:09:07.866147    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9cc04542-5f65-43d8-b15f-5647477c2927-networking-console-plugin-cert podName:9cc04542-5f65-43d8-b15f-5647477c2927 nodeName:}" failed. No retries permitted until 2026-07-16 11:09:08.866125644 +0000 UTC m=+49.237662681 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/9cc04542-5f65-43d8-b15f-5647477c2927-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-shdrh" (UID: "9cc04542-5f65-43d8-b15f-5647477c2927") : secret "networking-console-plugin-cert" not found
Jul 16 11:09:07.966841 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:07.966736    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/13fa2ca5-b90c-46e7-92bc-7a8cb4c036a2-metrics-certs\") pod \"router-default-7f4487f9c8-wnk66\" (UID: \"13fa2ca5-b90c-46e7-92bc-7a8cb4c036a2\") " pod="openshift-ingress/router-default-7f4487f9c8-wnk66"
Jul 16 11:09:07.966841 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:07.966797    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/13fa2ca5-b90c-46e7-92bc-7a8cb4c036a2-service-ca-bundle\") pod \"router-default-7f4487f9c8-wnk66\" (UID: \"13fa2ca5-b90c-46e7-92bc-7a8cb4c036a2\") " pod="openshift-ingress/router-default-7f4487f9c8-wnk66"
Jul 16 11:09:07.967319 ip-10-0-135-184 kubenswrapper[2564]: E0716 11:09:07.966907    2564 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 16 11:09:07.967319 ip-10-0-135-184 kubenswrapper[2564]: E0716 11:09:07.966960    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/13fa2ca5-b90c-46e7-92bc-7a8cb4c036a2-service-ca-bundle podName:13fa2ca5-b90c-46e7-92bc-7a8cb4c036a2 nodeName:}" failed. No retries permitted until 2026-07-16 11:09:08.966940382 +0000 UTC m=+49.338477399 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/13fa2ca5-b90c-46e7-92bc-7a8cb4c036a2-service-ca-bundle") pod "router-default-7f4487f9c8-wnk66" (UID: "13fa2ca5-b90c-46e7-92bc-7a8cb4c036a2") : configmap references non-existent config key: service-ca.crt
Jul 16 11:09:07.967319 ip-10-0-135-184 kubenswrapper[2564]: E0716 11:09:07.966988    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/13fa2ca5-b90c-46e7-92bc-7a8cb4c036a2-metrics-certs podName:13fa2ca5-b90c-46e7-92bc-7a8cb4c036a2 nodeName:}" failed. No retries permitted until 2026-07-16 11:09:08.966972489 +0000 UTC m=+49.338509509 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/13fa2ca5-b90c-46e7-92bc-7a8cb4c036a2-metrics-certs") pod "router-default-7f4487f9c8-wnk66" (UID: "13fa2ca5-b90c-46e7-92bc-7a8cb4c036a2") : secret "router-metrics-certs-default" not found
Jul 16 11:09:08.874266 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:08.874225    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/9cc04542-5f65-43d8-b15f-5647477c2927-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-shdrh\" (UID: \"9cc04542-5f65-43d8-b15f-5647477c2927\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-shdrh"
Jul 16 11:09:08.874454 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:08.874345    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3983837b-b29b-41d3-ab7f-2247c578e01f-registry-tls\") pod \"image-registry-65978f8f75-jt6p5\" (UID: \"3983837b-b29b-41d3-ab7f-2247c578e01f\") " pod="openshift-image-registry/image-registry-65978f8f75-jt6p5"
Jul 16 11:09:08.874454 ip-10-0-135-184 kubenswrapper[2564]: E0716 11:09:08.874406    2564 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 16 11:09:08.874534 ip-10-0-135-184 kubenswrapper[2564]: E0716 11:09:08.874473    2564 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 16 11:09:08.874534 ip-10-0-135-184 kubenswrapper[2564]: E0716 11:09:08.874485    2564 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-65978f8f75-jt6p5: secret "image-registry-tls" not found
Jul 16 11:09:08.874534 ip-10-0-135-184 kubenswrapper[2564]: E0716 11:09:08.874487    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9cc04542-5f65-43d8-b15f-5647477c2927-networking-console-plugin-cert podName:9cc04542-5f65-43d8-b15f-5647477c2927 nodeName:}" failed. No retries permitted until 2026-07-16 11:09:10.87446598 +0000 UTC m=+51.246003007 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/9cc04542-5f65-43d8-b15f-5647477c2927-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-shdrh" (UID: "9cc04542-5f65-43d8-b15f-5647477c2927") : secret "networking-console-plugin-cert" not found
Jul 16 11:09:08.874656 ip-10-0-135-184 kubenswrapper[2564]: E0716 11:09:08.874540    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3983837b-b29b-41d3-ab7f-2247c578e01f-registry-tls podName:3983837b-b29b-41d3-ab7f-2247c578e01f nodeName:}" failed. No retries permitted until 2026-07-16 11:09:10.874522433 +0000 UTC m=+51.246059451 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/3983837b-b29b-41d3-ab7f-2247c578e01f-registry-tls") pod "image-registry-65978f8f75-jt6p5" (UID: "3983837b-b29b-41d3-ab7f-2247c578e01f") : secret "image-registry-tls" not found
Jul 16 11:09:08.963579 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:08.963458    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:09:08.975821 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:08.975689    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/13fa2ca5-b90c-46e7-92bc-7a8cb4c036a2-metrics-certs\") pod \"router-default-7f4487f9c8-wnk66\" (UID: \"13fa2ca5-b90c-46e7-92bc-7a8cb4c036a2\") " pod="openshift-ingress/router-default-7f4487f9c8-wnk66"
Jul 16 11:09:08.975821 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:08.975747    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/13fa2ca5-b90c-46e7-92bc-7a8cb4c036a2-service-ca-bundle\") pod \"router-default-7f4487f9c8-wnk66\" (UID: \"13fa2ca5-b90c-46e7-92bc-7a8cb4c036a2\") " pod="openshift-ingress/router-default-7f4487f9c8-wnk66"
Jul 16 11:09:08.976354 ip-10-0-135-184 kubenswrapper[2564]: E0716 11:09:08.975892    2564 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 16 11:09:08.976354 ip-10-0-135-184 kubenswrapper[2564]: E0716 11:09:08.975903    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/13fa2ca5-b90c-46e7-92bc-7a8cb4c036a2-service-ca-bundle podName:13fa2ca5-b90c-46e7-92bc-7a8cb4c036a2 nodeName:}" failed. No retries permitted until 2026-07-16 11:09:10.975883492 +0000 UTC m=+51.347420511 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/13fa2ca5-b90c-46e7-92bc-7a8cb4c036a2-service-ca-bundle") pod "router-default-7f4487f9c8-wnk66" (UID: "13fa2ca5-b90c-46e7-92bc-7a8cb4c036a2") : configmap references non-existent config key: service-ca.crt
Jul 16 11:09:08.976354 ip-10-0-135-184 kubenswrapper[2564]: E0716 11:09:08.975975    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/13fa2ca5-b90c-46e7-92bc-7a8cb4c036a2-metrics-certs podName:13fa2ca5-b90c-46e7-92bc-7a8cb4c036a2 nodeName:}" failed. No retries permitted until 2026-07-16 11:09:10.975955899 +0000 UTC m=+51.347492919 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/13fa2ca5-b90c-46e7-92bc-7a8cb4c036a2-metrics-certs") pod "router-default-7f4487f9c8-wnk66" (UID: "13fa2ca5-b90c-46e7-92bc-7a8cb4c036a2") : secret "router-metrics-certs-default" not found
Jul 16 11:09:09.062843 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:09.062806    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:09:10.555312 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:10.555264    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:09:10.890218 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:10.890131    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/9cc04542-5f65-43d8-b15f-5647477c2927-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-shdrh\" (UID: \"9cc04542-5f65-43d8-b15f-5647477c2927\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-shdrh"
Jul 16 11:09:10.890364 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:10.890254    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3983837b-b29b-41d3-ab7f-2247c578e01f-registry-tls\") pod \"image-registry-65978f8f75-jt6p5\" (UID: \"3983837b-b29b-41d3-ab7f-2247c578e01f\") " pod="openshift-image-registry/image-registry-65978f8f75-jt6p5"
Jul 16 11:09:10.890364 ip-10-0-135-184 kubenswrapper[2564]: E0716 11:09:10.890298    2564 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 16 11:09:10.890426 ip-10-0-135-184 kubenswrapper[2564]: E0716 11:09:10.890365    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9cc04542-5f65-43d8-b15f-5647477c2927-networking-console-plugin-cert podName:9cc04542-5f65-43d8-b15f-5647477c2927 nodeName:}" failed. No retries permitted until 2026-07-16 11:09:14.890350639 +0000 UTC m=+55.261887653 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/9cc04542-5f65-43d8-b15f-5647477c2927-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-shdrh" (UID: "9cc04542-5f65-43d8-b15f-5647477c2927") : secret "networking-console-plugin-cert" not found
Jul 16 11:09:10.890426 ip-10-0-135-184 kubenswrapper[2564]: E0716 11:09:10.890398    2564 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 16 11:09:10.890426 ip-10-0-135-184 kubenswrapper[2564]: E0716 11:09:10.890417    2564 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-65978f8f75-jt6p5: secret "image-registry-tls" not found
Jul 16 11:09:10.890527 ip-10-0-135-184 kubenswrapper[2564]: E0716 11:09:10.890477    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3983837b-b29b-41d3-ab7f-2247c578e01f-registry-tls podName:3983837b-b29b-41d3-ab7f-2247c578e01f nodeName:}" failed. No retries permitted until 2026-07-16 11:09:14.890462997 +0000 UTC m=+55.262000011 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/3983837b-b29b-41d3-ab7f-2247c578e01f-registry-tls") pod "image-registry-65978f8f75-jt6p5" (UID: "3983837b-b29b-41d3-ab7f-2247c578e01f") : secret "image-registry-tls" not found
Jul 16 11:09:10.990910 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:10.990871    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/13fa2ca5-b90c-46e7-92bc-7a8cb4c036a2-metrics-certs\") pod \"router-default-7f4487f9c8-wnk66\" (UID: \"13fa2ca5-b90c-46e7-92bc-7a8cb4c036a2\") " pod="openshift-ingress/router-default-7f4487f9c8-wnk66"
Jul 16 11:09:10.991072 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:10.990939    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/13fa2ca5-b90c-46e7-92bc-7a8cb4c036a2-service-ca-bundle\") pod \"router-default-7f4487f9c8-wnk66\" (UID: \"13fa2ca5-b90c-46e7-92bc-7a8cb4c036a2\") " pod="openshift-ingress/router-default-7f4487f9c8-wnk66"
Jul 16 11:09:10.991072 ip-10-0-135-184 kubenswrapper[2564]: E0716 11:09:10.991023    2564 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 16 11:09:10.991072 ip-10-0-135-184 kubenswrapper[2564]: E0716 11:09:10.991055    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/13fa2ca5-b90c-46e7-92bc-7a8cb4c036a2-service-ca-bundle podName:13fa2ca5-b90c-46e7-92bc-7a8cb4c036a2 nodeName:}" failed. No retries permitted until 2026-07-16 11:09:14.991040947 +0000 UTC m=+55.362577963 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/13fa2ca5-b90c-46e7-92bc-7a8cb4c036a2-service-ca-bundle") pod "router-default-7f4487f9c8-wnk66" (UID: "13fa2ca5-b90c-46e7-92bc-7a8cb4c036a2") : configmap references non-existent config key: service-ca.crt
Jul 16 11:09:10.991193 ip-10-0-135-184 kubenswrapper[2564]: E0716 11:09:10.991091    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/13fa2ca5-b90c-46e7-92bc-7a8cb4c036a2-metrics-certs podName:13fa2ca5-b90c-46e7-92bc-7a8cb4c036a2 nodeName:}" failed. No retries permitted until 2026-07-16 11:09:14.991076302 +0000 UTC m=+55.362613316 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/13fa2ca5-b90c-46e7-92bc-7a8cb4c036a2-metrics-certs") pod "router-default-7f4487f9c8-wnk66" (UID: "13fa2ca5-b90c-46e7-92bc-7a8cb4c036a2") : secret "router-metrics-certs-default" not found
Jul 16 11:09:12.260130 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:12.260090    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:09:12.370404 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:12.370367    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:09:12.503947 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:12.503901    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a87056cf-7dba-4395-b644-4aeb45e9b8e7-metrics-tls\") pod \"dns-default-k69kw\" (UID: \"a87056cf-7dba-4395-b644-4aeb45e9b8e7\") " pod="openshift-dns/dns-default-k69kw"
Jul 16 11:09:12.504157 ip-10-0-135-184 kubenswrapper[2564]: E0716 11:09:12.504078    2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 16 11:09:12.504226 ip-10-0-135-184 kubenswrapper[2564]: E0716 11:09:12.504160    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a87056cf-7dba-4395-b644-4aeb45e9b8e7-metrics-tls podName:a87056cf-7dba-4395-b644-4aeb45e9b8e7 nodeName:}" failed. No retries permitted until 2026-07-16 11:09:28.504140512 +0000 UTC m=+68.875677549 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a87056cf-7dba-4395-b644-4aeb45e9b8e7-metrics-tls") pod "dns-default-k69kw" (UID: "a87056cf-7dba-4395-b644-4aeb45e9b8e7") : secret "dns-default-metrics-tls" not found
Jul 16 11:09:12.678045 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:12.677943    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:09:12.696402 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:12.696372    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-5jghx" event={"ID":"6616b0ad-d677-4d49-85cd-9be622d8de71","Type":"ContainerStarted","Data":"9621c9889bacbf6db1a258be0703e70c25fe860de7dfe1bb3d01f4d22551805e"}
Jul 16 11:09:12.698168 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:12.698145    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-lwmwf_4cb63124-522c-41e2-9d85-c2af29ac8eff/console-operator/0.log"
Jul 16 11:09:12.698406 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:12.698183    2564 generic.go:356] "Generic (PLEG): container finished" podID="4cb63124-522c-41e2-9d85-c2af29ac8eff" containerID="3c1bc1f78424c463f3bac14fabd493309434b488d035d0c808abe2d9e4f99ff8" exitCode=255
Jul 16 11:09:12.698406 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:12.698264    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-lwmwf" event={"ID":"4cb63124-522c-41e2-9d85-c2af29ac8eff","Type":"ContainerDied","Data":"3c1bc1f78424c463f3bac14fabd493309434b488d035d0c808abe2d9e4f99ff8"}
Jul 16 11:09:12.698521 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:12.698505    2564 scope.go:117] "RemoveContainer" containerID="3c1bc1f78424c463f3bac14fabd493309434b488d035d0c808abe2d9e4f99ff8"
Jul 16 11:09:12.699953 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:12.699929    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-kmkpn" event={"ID":"bb246ab5-caf3-4eef-b0fe-07e6f3d447b7","Type":"ContainerStarted","Data":"8ede4dbd574d9ffb77221bb309db8862cd0e6eb88c76a5114396da47c2014e29"}
Jul 16 11:09:12.714125 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:12.714060    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-5jghx" podStartSLOduration=2.211975083 podStartE2EDuration="6.714038328s" totalImagesPullingTime="4.502063245s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 11:09:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 11:09:12.713228488 +0000 UTC m=+53.084765526" watchObservedRunningTime="2026-07-16 11:09:12.714038328 +0000 UTC m=+53.085575364"
Jul 16 11:09:12.733123 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:12.733070    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-kmkpn" podStartSLOduration=2.331659828 podStartE2EDuration="6.733053524s" totalImagesPullingTime="4.401393696s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 11:09:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 11:09:12.732450698 +0000 UTC m=+53.103987746" watchObservedRunningTime="2026-07-16 11:09:12.733053524 +0000 UTC m=+53.104590561"
Jul 16 11:09:12.926751 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:12.926712    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-fd9q7"]
Jul 16 11:09:12.944156 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:12.944088    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-fd9q7"]
Jul 16 11:09:12.944320 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:12.944233    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-fd9q7"
Jul 16 11:09:12.946448 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:12.946186    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-hljx9\""
Jul 16 11:09:12.946709 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:12.946684    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 16 11:09:12.946789 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:12.946732    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 16 11:09:12.947182 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:12.947017    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 16 11:09:12.947182 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:12.946684    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 16 11:09:12.971084 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:12.971047    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:09:13.008933 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:13.008894    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/8cb7db93-eb1a-4540-b167-9d6efbe4b524-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-fd9q7\" (UID: \"8cb7db93-eb1a-4540-b167-9d6efbe4b524\") " pod="openshift-insights/insights-runtime-extractor-fd9q7"
Jul 16 11:09:13.008933 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:13.008940    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8cb7db93-eb1a-4540-b167-9d6efbe4b524-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-fd9q7\" (UID: \"8cb7db93-eb1a-4540-b167-9d6efbe4b524\") " pod="openshift-insights/insights-runtime-extractor-fd9q7"
Jul 16 11:09:13.009154 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:13.009092    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/8cb7db93-eb1a-4540-b167-9d6efbe4b524-crio-socket\") pod \"insights-runtime-extractor-fd9q7\" (UID: \"8cb7db93-eb1a-4540-b167-9d6efbe4b524\") " pod="openshift-insights/insights-runtime-extractor-fd9q7"
Jul 16 11:09:13.009154 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:13.009138    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/8cb7db93-eb1a-4540-b167-9d6efbe4b524-data-volume\") pod \"insights-runtime-extractor-fd9q7\" (UID: \"8cb7db93-eb1a-4540-b167-9d6efbe4b524\") " pod="openshift-insights/insights-runtime-extractor-fd9q7"
Jul 16 11:09:13.009268 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:13.009210    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ntnjj\" (UniqueName: \"kubernetes.io/projected/8cb7db93-eb1a-4540-b167-9d6efbe4b524-kube-api-access-ntnjj\") pod \"insights-runtime-extractor-fd9q7\" (UID: \"8cb7db93-eb1a-4540-b167-9d6efbe4b524\") " pod="openshift-insights/insights-runtime-extractor-fd9q7"
Jul 16 11:09:13.059109 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:13.059070    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:09:13.109605 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:13.109557    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/8cb7db93-eb1a-4540-b167-9d6efbe4b524-crio-socket\") pod \"insights-runtime-extractor-fd9q7\" (UID: \"8cb7db93-eb1a-4540-b167-9d6efbe4b524\") " pod="openshift-insights/insights-runtime-extractor-fd9q7"
Jul 16 11:09:13.109605 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:13.109617    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/8cb7db93-eb1a-4540-b167-9d6efbe4b524-data-volume\") pod \"insights-runtime-extractor-fd9q7\" (UID: \"8cb7db93-eb1a-4540-b167-9d6efbe4b524\") " pod="openshift-insights/insights-runtime-extractor-fd9q7"
Jul 16 11:09:13.109884 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:13.109739    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ntnjj\" (UniqueName: \"kubernetes.io/projected/8cb7db93-eb1a-4540-b167-9d6efbe4b524-kube-api-access-ntnjj\") pod \"insights-runtime-extractor-fd9q7\" (UID: \"8cb7db93-eb1a-4540-b167-9d6efbe4b524\") " pod="openshift-insights/insights-runtime-extractor-fd9q7"
Jul 16 11:09:13.109884 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:13.109828    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/8cb7db93-eb1a-4540-b167-9d6efbe4b524-crio-socket\") pod \"insights-runtime-extractor-fd9q7\" (UID: \"8cb7db93-eb1a-4540-b167-9d6efbe4b524\") " pod="openshift-insights/insights-runtime-extractor-fd9q7"
Jul 16 11:09:13.109884 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:13.109833    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/8cb7db93-eb1a-4540-b167-9d6efbe4b524-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-fd9q7\" (UID: \"8cb7db93-eb1a-4540-b167-9d6efbe4b524\") " pod="openshift-insights/insights-runtime-extractor-fd9q7"
Jul 16 11:09:13.110040 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:13.109892    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8cb7db93-eb1a-4540-b167-9d6efbe4b524-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-fd9q7\" (UID: \"8cb7db93-eb1a-4540-b167-9d6efbe4b524\") " pod="openshift-insights/insights-runtime-extractor-fd9q7"
Jul 16 11:09:13.110040 ip-10-0-135-184 kubenswrapper[2564]: E0716 11:09:13.109912    2564 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 16 11:09:13.110040 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:13.109944    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/8cb7db93-eb1a-4540-b167-9d6efbe4b524-data-volume\") pod \"insights-runtime-extractor-fd9q7\" (UID: \"8cb7db93-eb1a-4540-b167-9d6efbe4b524\") " pod="openshift-insights/insights-runtime-extractor-fd9q7"
Jul 16 11:09:13.110040 ip-10-0-135-184 kubenswrapper[2564]: E0716 11:09:13.109968    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8cb7db93-eb1a-4540-b167-9d6efbe4b524-kube-rbac-proxy-cm podName:8cb7db93-eb1a-4540-b167-9d6efbe4b524 nodeName:}" failed. No retries permitted until 2026-07-16 11:09:13.609949059 +0000 UTC m=+53.981486088 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/8cb7db93-eb1a-4540-b167-9d6efbe4b524-kube-rbac-proxy-cm") pod "insights-runtime-extractor-fd9q7" (UID: "8cb7db93-eb1a-4540-b167-9d6efbe4b524") : configmap "kube-rbac-proxy" not found
Jul 16 11:09:13.110040 ip-10-0-135-184 kubenswrapper[2564]: E0716 11:09:13.110009    2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 16 11:09:13.110296 ip-10-0-135-184 kubenswrapper[2564]: E0716 11:09:13.110045    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8cb7db93-eb1a-4540-b167-9d6efbe4b524-insights-runtime-extractor-tls podName:8cb7db93-eb1a-4540-b167-9d6efbe4b524 nodeName:}" failed. No retries permitted until 2026-07-16 11:09:13.610033782 +0000 UTC m=+53.981570796 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/8cb7db93-eb1a-4540-b167-9d6efbe4b524-insights-runtime-extractor-tls") pod "insights-runtime-extractor-fd9q7" (UID: "8cb7db93-eb1a-4540-b167-9d6efbe4b524") : secret "insights-runtime-extractor-tls" not found
Jul 16 11:09:13.137261 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:13.137222    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ntnjj\" (UniqueName: \"kubernetes.io/projected/8cb7db93-eb1a-4540-b167-9d6efbe4b524-kube-api-access-ntnjj\") pod \"insights-runtime-extractor-fd9q7\" (UID: \"8cb7db93-eb1a-4540-b167-9d6efbe4b524\") " pod="openshift-insights/insights-runtime-extractor-fd9q7"
Jul 16 11:09:13.613964 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:13.613922    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/8cb7db93-eb1a-4540-b167-9d6efbe4b524-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-fd9q7\" (UID: \"8cb7db93-eb1a-4540-b167-9d6efbe4b524\") " pod="openshift-insights/insights-runtime-extractor-fd9q7"
Jul 16 11:09:13.613964 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:13.613967    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8cb7db93-eb1a-4540-b167-9d6efbe4b524-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-fd9q7\" (UID: \"8cb7db93-eb1a-4540-b167-9d6efbe4b524\") " pod="openshift-insights/insights-runtime-extractor-fd9q7"
Jul 16 11:09:13.614383 ip-10-0-135-184 kubenswrapper[2564]: E0716 11:09:13.614069    2564 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 16 11:09:13.614383 ip-10-0-135-184 kubenswrapper[2564]: E0716 11:09:13.614115    2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 16 11:09:13.614383 ip-10-0-135-184 kubenswrapper[2564]: E0716 11:09:13.614154    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8cb7db93-eb1a-4540-b167-9d6efbe4b524-kube-rbac-proxy-cm podName:8cb7db93-eb1a-4540-b167-9d6efbe4b524 nodeName:}" failed. No retries permitted until 2026-07-16 11:09:14.614132057 +0000 UTC m=+54.985669078 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/8cb7db93-eb1a-4540-b167-9d6efbe4b524-kube-rbac-proxy-cm") pod "insights-runtime-extractor-fd9q7" (UID: "8cb7db93-eb1a-4540-b167-9d6efbe4b524") : configmap "kube-rbac-proxy" not found
Jul 16 11:09:13.614383 ip-10-0-135-184 kubenswrapper[2564]: E0716 11:09:13.614175    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8cb7db93-eb1a-4540-b167-9d6efbe4b524-insights-runtime-extractor-tls podName:8cb7db93-eb1a-4540-b167-9d6efbe4b524 nodeName:}" failed. No retries permitted until 2026-07-16 11:09:14.614164852 +0000 UTC m=+54.985701868 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/8cb7db93-eb1a-4540-b167-9d6efbe4b524-insights-runtime-extractor-tls") pod "insights-runtime-extractor-fd9q7" (UID: "8cb7db93-eb1a-4540-b167-9d6efbe4b524") : secret "insights-runtime-extractor-tls" not found
Jul 16 11:09:13.705986 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:13.705955    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-lwmwf_4cb63124-522c-41e2-9d85-c2af29ac8eff/console-operator/1.log"
Jul 16 11:09:13.706510 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:13.706490    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-lwmwf_4cb63124-522c-41e2-9d85-c2af29ac8eff/console-operator/0.log"
Jul 16 11:09:13.706618 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:13.706531    2564 generic.go:356] "Generic (PLEG): container finished" podID="4cb63124-522c-41e2-9d85-c2af29ac8eff" containerID="376e4941576566819e96ae649b5e3e2da9f8525ffbd00807d25d63a78563904f" exitCode=255
Jul 16 11:09:13.706681 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:13.706624    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-lwmwf" event={"ID":"4cb63124-522c-41e2-9d85-c2af29ac8eff","Type":"ContainerDied","Data":"376e4941576566819e96ae649b5e3e2da9f8525ffbd00807d25d63a78563904f"}
Jul 16 11:09:13.706738 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:13.706682    2564 scope.go:117] "RemoveContainer" containerID="3c1bc1f78424c463f3bac14fabd493309434b488d035d0c808abe2d9e4f99ff8"
Jul 16 11:09:13.706975 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:13.706961    2564 scope.go:117] "RemoveContainer" containerID="376e4941576566819e96ae649b5e3e2da9f8525ffbd00807d25d63a78563904f"
Jul 16 11:09:13.707187 ip-10-0-135-184 kubenswrapper[2564]: E0716 11:09:13.707165    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7866497494-lwmwf_openshift-console-operator(4cb63124-522c-41e2-9d85-c2af29ac8eff)\"" pod="openshift-console-operator/console-operator-7866497494-lwmwf" podUID="4cb63124-522c-41e2-9d85-c2af29ac8eff"
Jul 16 11:09:13.837308 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:13.837268    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:09:14.072245 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:14.072215    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:09:14.179631 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:14.179582    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:09:14.535058 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:14.535025    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:09:14.623305 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:14.623263    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/8cb7db93-eb1a-4540-b167-9d6efbe4b524-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-fd9q7\" (UID: \"8cb7db93-eb1a-4540-b167-9d6efbe4b524\") " pod="openshift-insights/insights-runtime-extractor-fd9q7"
Jul 16 11:09:14.623305 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:14.623303    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8cb7db93-eb1a-4540-b167-9d6efbe4b524-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-fd9q7\" (UID: \"8cb7db93-eb1a-4540-b167-9d6efbe4b524\") " pod="openshift-insights/insights-runtime-extractor-fd9q7"
Jul 16 11:09:14.623742 ip-10-0-135-184 kubenswrapper[2564]: E0716 11:09:14.623387    2564 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 16 11:09:14.623742 ip-10-0-135-184 kubenswrapper[2564]: E0716 11:09:14.623402    2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 16 11:09:14.623742 ip-10-0-135-184 kubenswrapper[2564]: E0716 11:09:14.623457    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8cb7db93-eb1a-4540-b167-9d6efbe4b524-insights-runtime-extractor-tls podName:8cb7db93-eb1a-4540-b167-9d6efbe4b524 nodeName:}" failed. No retries permitted until 2026-07-16 11:09:16.623442172 +0000 UTC m=+56.994979186 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/8cb7db93-eb1a-4540-b167-9d6efbe4b524-insights-runtime-extractor-tls") pod "insights-runtime-extractor-fd9q7" (UID: "8cb7db93-eb1a-4540-b167-9d6efbe4b524") : secret "insights-runtime-extractor-tls" not found
Jul 16 11:09:14.623742 ip-10-0-135-184 kubenswrapper[2564]: E0716 11:09:14.623521    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8cb7db93-eb1a-4540-b167-9d6efbe4b524-kube-rbac-proxy-cm podName:8cb7db93-eb1a-4540-b167-9d6efbe4b524 nodeName:}" failed. No retries permitted until 2026-07-16 11:09:16.623503745 +0000 UTC m=+56.995040769 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/8cb7db93-eb1a-4540-b167-9d6efbe4b524-kube-rbac-proxy-cm") pod "insights-runtime-extractor-fd9q7" (UID: "8cb7db93-eb1a-4540-b167-9d6efbe4b524") : configmap "kube-rbac-proxy" not found
Jul 16 11:09:14.637011 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:14.636984    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:09:14.710670 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:14.710641    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-lwmwf_4cb63124-522c-41e2-9d85-c2af29ac8eff/console-operator/1.log"
Jul 16 11:09:14.711026 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:14.711007    2564 scope.go:117] "RemoveContainer" containerID="376e4941576566819e96ae649b5e3e2da9f8525ffbd00807d25d63a78563904f"
Jul 16 11:09:14.711222 ip-10-0-135-184 kubenswrapper[2564]: E0716 11:09:14.711199    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7866497494-lwmwf_openshift-console-operator(4cb63124-522c-41e2-9d85-c2af29ac8eff)\"" pod="openshift-console-operator/console-operator-7866497494-lwmwf" podUID="4cb63124-522c-41e2-9d85-c2af29ac8eff"
Jul 16 11:09:14.926150 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:14.926048    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3983837b-b29b-41d3-ab7f-2247c578e01f-registry-tls\") pod \"image-registry-65978f8f75-jt6p5\" (UID: \"3983837b-b29b-41d3-ab7f-2247c578e01f\") " pod="openshift-image-registry/image-registry-65978f8f75-jt6p5"
Jul 16 11:09:14.926150 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:14.926118    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/9cc04542-5f65-43d8-b15f-5647477c2927-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-shdrh\" (UID: \"9cc04542-5f65-43d8-b15f-5647477c2927\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-shdrh"
Jul 16 11:09:14.926389 ip-10-0-135-184 kubenswrapper[2564]: E0716 11:09:14.926223    2564 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 16 11:09:14.926389 ip-10-0-135-184 kubenswrapper[2564]: E0716 11:09:14.926226    2564 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 16 11:09:14.926389 ip-10-0-135-184 kubenswrapper[2564]: E0716 11:09:14.926246    2564 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-65978f8f75-jt6p5: secret "image-registry-tls" not found
Jul 16 11:09:14.926389 ip-10-0-135-184 kubenswrapper[2564]: E0716 11:09:14.926278    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9cc04542-5f65-43d8-b15f-5647477c2927-networking-console-plugin-cert podName:9cc04542-5f65-43d8-b15f-5647477c2927 nodeName:}" failed. No retries permitted until 2026-07-16 11:09:22.926264094 +0000 UTC m=+63.297801108 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/9cc04542-5f65-43d8-b15f-5647477c2927-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-shdrh" (UID: "9cc04542-5f65-43d8-b15f-5647477c2927") : secret "networking-console-plugin-cert" not found
Jul 16 11:09:14.926389 ip-10-0-135-184 kubenswrapper[2564]: E0716 11:09:14.926311    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3983837b-b29b-41d3-ab7f-2247c578e01f-registry-tls podName:3983837b-b29b-41d3-ab7f-2247c578e01f nodeName:}" failed. No retries permitted until 2026-07-16 11:09:22.926294257 +0000 UTC m=+63.297831272 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/3983837b-b29b-41d3-ab7f-2247c578e01f-registry-tls") pod "image-registry-65978f8f75-jt6p5" (UID: "3983837b-b29b-41d3-ab7f-2247c578e01f") : secret "image-registry-tls" not found
Jul 16 11:09:15.027347 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:15.027304    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/13fa2ca5-b90c-46e7-92bc-7a8cb4c036a2-metrics-certs\") pod \"router-default-7f4487f9c8-wnk66\" (UID: \"13fa2ca5-b90c-46e7-92bc-7a8cb4c036a2\") " pod="openshift-ingress/router-default-7f4487f9c8-wnk66"
Jul 16 11:09:15.027347 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:15.027351    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/13fa2ca5-b90c-46e7-92bc-7a8cb4c036a2-service-ca-bundle\") pod \"router-default-7f4487f9c8-wnk66\" (UID: \"13fa2ca5-b90c-46e7-92bc-7a8cb4c036a2\") " pod="openshift-ingress/router-default-7f4487f9c8-wnk66"
Jul 16 11:09:15.027599 ip-10-0-135-184 kubenswrapper[2564]: E0716 11:09:15.027465    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/13fa2ca5-b90c-46e7-92bc-7a8cb4c036a2-service-ca-bundle podName:13fa2ca5-b90c-46e7-92bc-7a8cb4c036a2 nodeName:}" failed. No retries permitted until 2026-07-16 11:09:23.027451882 +0000 UTC m=+63.398988896 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/13fa2ca5-b90c-46e7-92bc-7a8cb4c036a2-service-ca-bundle") pod "router-default-7f4487f9c8-wnk66" (UID: "13fa2ca5-b90c-46e7-92bc-7a8cb4c036a2") : configmap references non-existent config key: service-ca.crt
Jul 16 11:09:15.027599 ip-10-0-135-184 kubenswrapper[2564]: E0716 11:09:15.027467    2564 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 16 11:09:15.027599 ip-10-0-135-184 kubenswrapper[2564]: E0716 11:09:15.027524    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/13fa2ca5-b90c-46e7-92bc-7a8cb4c036a2-metrics-certs podName:13fa2ca5-b90c-46e7-92bc-7a8cb4c036a2 nodeName:}" failed. No retries permitted until 2026-07-16 11:09:23.02750942 +0000 UTC m=+63.399046435 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/13fa2ca5-b90c-46e7-92bc-7a8cb4c036a2-metrics-certs") pod "router-default-7f4487f9c8-wnk66" (UID: "13fa2ca5-b90c-46e7-92bc-7a8cb4c036a2") : secret "router-metrics-certs-default" not found
Jul 16 11:09:15.499873 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:15.499847    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-44kqf_e335433b-f42b-4f52-b88e-02f36ff33f83/dns-node-resolver/0.log"
Jul 16 11:09:16.117944 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:16.117902    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:09:16.215961 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:16.215924    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:09:16.315896 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:16.315858    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:09:16.499667 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:16.499640    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-2frcp_47ecd32d-7f31-43d9-9828-d2621113d37c/node-ca/0.log"
Jul 16 11:09:16.641286 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:16.641239    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/8cb7db93-eb1a-4540-b167-9d6efbe4b524-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-fd9q7\" (UID: \"8cb7db93-eb1a-4540-b167-9d6efbe4b524\") " pod="openshift-insights/insights-runtime-extractor-fd9q7"
Jul 16 11:09:16.641286 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:16.641283    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8cb7db93-eb1a-4540-b167-9d6efbe4b524-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-fd9q7\" (UID: \"8cb7db93-eb1a-4540-b167-9d6efbe4b524\") " pod="openshift-insights/insights-runtime-extractor-fd9q7"
Jul 16 11:09:16.641502 ip-10-0-135-184 kubenswrapper[2564]: E0716 11:09:16.641372    2564 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 16 11:09:16.641502 ip-10-0-135-184 kubenswrapper[2564]: E0716 11:09:16.641387    2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 16 11:09:16.641502 ip-10-0-135-184 kubenswrapper[2564]: E0716 11:09:16.641443    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8cb7db93-eb1a-4540-b167-9d6efbe4b524-insights-runtime-extractor-tls podName:8cb7db93-eb1a-4540-b167-9d6efbe4b524 nodeName:}" failed. No retries permitted until 2026-07-16 11:09:20.641427503 +0000 UTC m=+61.012964517 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/8cb7db93-eb1a-4540-b167-9d6efbe4b524-insights-runtime-extractor-tls") pod "insights-runtime-extractor-fd9q7" (UID: "8cb7db93-eb1a-4540-b167-9d6efbe4b524") : secret "insights-runtime-extractor-tls" not found
Jul 16 11:09:16.641502 ip-10-0-135-184 kubenswrapper[2564]: E0716 11:09:16.641458    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8cb7db93-eb1a-4540-b167-9d6efbe4b524-kube-rbac-proxy-cm podName:8cb7db93-eb1a-4540-b167-9d6efbe4b524 nodeName:}" failed. No retries permitted until 2026-07-16 11:09:20.64145127 +0000 UTC m=+61.012988283 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/8cb7db93-eb1a-4540-b167-9d6efbe4b524-kube-rbac-proxy-cm") pod "insights-runtime-extractor-fd9q7" (UID: "8cb7db93-eb1a-4540-b167-9d6efbe4b524") : configmap "kube-rbac-proxy" not found
Jul 16 11:09:17.166493 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:17.166459    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:09:17.300211 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:17.300165    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-6x8n4_57dd81c5-98a2-455f-bb65-4f35f1979846/serve-healthcheck-canary/0.log"
Jul 16 11:09:17.442939 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:17.442848    2564 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-7866497494-lwmwf"
Jul 16 11:09:17.442939 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:17.442904    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7866497494-lwmwf"
Jul 16 11:09:17.443247 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:17.443235    2564 scope.go:117] "RemoveContainer" containerID="376e4941576566819e96ae649b5e3e2da9f8525ffbd00807d25d63a78563904f"
Jul 16 11:09:17.443397 ip-10-0-135-184 kubenswrapper[2564]: E0716 11:09:17.443379    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7866497494-lwmwf_openshift-console-operator(4cb63124-522c-41e2-9d85-c2af29ac8eff)\"" pod="openshift-console-operator/console-operator-7866497494-lwmwf" podUID="4cb63124-522c-41e2-9d85-c2af29ac8eff"
Jul 16 11:09:20.389341 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:20.389300    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:09:20.673518 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:20.673426    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/8cb7db93-eb1a-4540-b167-9d6efbe4b524-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-fd9q7\" (UID: \"8cb7db93-eb1a-4540-b167-9d6efbe4b524\") " pod="openshift-insights/insights-runtime-extractor-fd9q7"
Jul 16 11:09:20.673518 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:20.673472    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8cb7db93-eb1a-4540-b167-9d6efbe4b524-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-fd9q7\" (UID: \"8cb7db93-eb1a-4540-b167-9d6efbe4b524\") " pod="openshift-insights/insights-runtime-extractor-fd9q7"
Jul 16 11:09:20.673699 ip-10-0-135-184 kubenswrapper[2564]: E0716 11:09:20.673575    2564 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 16 11:09:20.673699 ip-10-0-135-184 kubenswrapper[2564]: E0716 11:09:20.673659    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8cb7db93-eb1a-4540-b167-9d6efbe4b524-kube-rbac-proxy-cm podName:8cb7db93-eb1a-4540-b167-9d6efbe4b524 nodeName:}" failed. No retries permitted until 2026-07-16 11:09:28.673640454 +0000 UTC m=+69.045177467 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/8cb7db93-eb1a-4540-b167-9d6efbe4b524-kube-rbac-proxy-cm") pod "insights-runtime-extractor-fd9q7" (UID: "8cb7db93-eb1a-4540-b167-9d6efbe4b524") : configmap "kube-rbac-proxy" not found
Jul 16 11:09:20.673699 ip-10-0-135-184 kubenswrapper[2564]: E0716 11:09:20.673666    2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 16 11:09:20.673830 ip-10-0-135-184 kubenswrapper[2564]: E0716 11:09:20.673718    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8cb7db93-eb1a-4540-b167-9d6efbe4b524-insights-runtime-extractor-tls podName:8cb7db93-eb1a-4540-b167-9d6efbe4b524 nodeName:}" failed. No retries permitted until 2026-07-16 11:09:28.673706228 +0000 UTC m=+69.045243264 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/8cb7db93-eb1a-4540-b167-9d6efbe4b524-insights-runtime-extractor-tls") pod "insights-runtime-extractor-fd9q7" (UID: "8cb7db93-eb1a-4540-b167-9d6efbe4b524") : secret "insights-runtime-extractor-tls" not found
Jul 16 11:09:20.875408 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:20.875367    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:09:20.980716 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:20.980621    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:09:21.195902 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:21.195860    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:09:21.293897 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:21.293861    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:09:21.391499 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:21.391465    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:09:21.599301 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:21.599213    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:09:21.641398 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:21.641369    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-fchvw"
Jul 16 11:09:22.565800 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:22.565749    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:09:22.743277 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:22.743236    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:09:22.995065 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:22.994977    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/9cc04542-5f65-43d8-b15f-5647477c2927-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-shdrh\" (UID: \"9cc04542-5f65-43d8-b15f-5647477c2927\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-shdrh"
Jul 16 11:09:22.995222 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:22.995087    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3983837b-b29b-41d3-ab7f-2247c578e01f-registry-tls\") pod \"image-registry-65978f8f75-jt6p5\" (UID: \"3983837b-b29b-41d3-ab7f-2247c578e01f\") " pod="openshift-image-registry/image-registry-65978f8f75-jt6p5"
Jul 16 11:09:22.995222 ip-10-0-135-184 kubenswrapper[2564]: E0716 11:09:22.995139    2564 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 16 11:09:22.995222 ip-10-0-135-184 kubenswrapper[2564]: E0716 11:09:22.995197    2564 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 16 11:09:22.995222 ip-10-0-135-184 kubenswrapper[2564]: E0716 11:09:22.995208    2564 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-65978f8f75-jt6p5: secret "image-registry-tls" not found
Jul 16 11:09:22.995345 ip-10-0-135-184 kubenswrapper[2564]: E0716 11:09:22.995224    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9cc04542-5f65-43d8-b15f-5647477c2927-networking-console-plugin-cert podName:9cc04542-5f65-43d8-b15f-5647477c2927 nodeName:}" failed. No retries permitted until 2026-07-16 11:09:38.99520657 +0000 UTC m=+79.366743584 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/9cc04542-5f65-43d8-b15f-5647477c2927-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-shdrh" (UID: "9cc04542-5f65-43d8-b15f-5647477c2927") : secret "networking-console-plugin-cert" not found
Jul 16 11:09:22.995345 ip-10-0-135-184 kubenswrapper[2564]: E0716 11:09:22.995245    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3983837b-b29b-41d3-ab7f-2247c578e01f-registry-tls podName:3983837b-b29b-41d3-ab7f-2247c578e01f nodeName:}" failed. No retries permitted until 2026-07-16 11:09:38.995234214 +0000 UTC m=+79.366771228 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/3983837b-b29b-41d3-ab7f-2247c578e01f-registry-tls") pod "image-registry-65978f8f75-jt6p5" (UID: "3983837b-b29b-41d3-ab7f-2247c578e01f") : secret "image-registry-tls" not found
Jul 16 11:09:23.096408 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:23.096373    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/13fa2ca5-b90c-46e7-92bc-7a8cb4c036a2-metrics-certs\") pod \"router-default-7f4487f9c8-wnk66\" (UID: \"13fa2ca5-b90c-46e7-92bc-7a8cb4c036a2\") " pod="openshift-ingress/router-default-7f4487f9c8-wnk66"
Jul 16 11:09:23.096561 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:23.096420    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/13fa2ca5-b90c-46e7-92bc-7a8cb4c036a2-service-ca-bundle\") pod \"router-default-7f4487f9c8-wnk66\" (UID: \"13fa2ca5-b90c-46e7-92bc-7a8cb4c036a2\") " pod="openshift-ingress/router-default-7f4487f9c8-wnk66"
Jul 16 11:09:23.096561 ip-10-0-135-184 kubenswrapper[2564]: E0716 11:09:23.096529    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/13fa2ca5-b90c-46e7-92bc-7a8cb4c036a2-service-ca-bundle podName:13fa2ca5-b90c-46e7-92bc-7a8cb4c036a2 nodeName:}" failed. No retries permitted until 2026-07-16 11:09:39.096516013 +0000 UTC m=+79.468053026 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/13fa2ca5-b90c-46e7-92bc-7a8cb4c036a2-service-ca-bundle") pod "router-default-7f4487f9c8-wnk66" (UID: "13fa2ca5-b90c-46e7-92bc-7a8cb4c036a2") : configmap references non-existent config key: service-ca.crt
Jul 16 11:09:23.096561 ip-10-0-135-184 kubenswrapper[2564]: E0716 11:09:23.096528    2564 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 16 11:09:23.096680 ip-10-0-135-184 kubenswrapper[2564]: E0716 11:09:23.096588    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/13fa2ca5-b90c-46e7-92bc-7a8cb4c036a2-metrics-certs podName:13fa2ca5-b90c-46e7-92bc-7a8cb4c036a2 nodeName:}" failed. No retries permitted until 2026-07-16 11:09:39.096570809 +0000 UTC m=+79.468107833 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/13fa2ca5-b90c-46e7-92bc-7a8cb4c036a2-metrics-certs") pod "router-default-7f4487f9c8-wnk66" (UID: "13fa2ca5-b90c-46e7-92bc-7a8cb4c036a2") : secret "router-metrics-certs-default" not found
Jul 16 11:09:23.164259 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:23.164222    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:09:23.346418 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:23.346384    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:09:23.711072 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:23.710946    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:09:23.812426 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:23.812392    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:09:24.144837 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:24.144802    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:09:24.280497 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:24.280465    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:09:24.395592 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:24.395497    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:09:24.453912 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:24.453880    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:09:24.544499 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:24.544465    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:09:24.741793 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:24.741692    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:09:24.913535 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:24.913495    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-frzsp\" (UniqueName: \"kubernetes.io/projected/0e88ea25-f79a-4275-a633-ba76d5b1ec27-kube-api-access-frzsp\") pod \"network-check-target-hwl88\" (UID: \"0e88ea25-f79a-4275-a633-ba76d5b1ec27\") " pod="openshift-network-diagnostics/network-check-target-hwl88"
Jul 16 11:09:24.913742 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:24.913718    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/28bc7393-164f-4deb-89da-69443b46c55e-metrics-certs\") pod \"network-metrics-daemon-pxp5q\" (UID: \"28bc7393-164f-4deb-89da-69443b46c55e\") " pod="openshift-multus/network-metrics-daemon-pxp5q"
Jul 16 11:09:24.915684 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:24.915663    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 16 11:09:24.916179 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:24.916159    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-frzsp\" (UniqueName: \"kubernetes.io/projected/0e88ea25-f79a-4275-a633-ba76d5b1ec27-kube-api-access-frzsp\") pod \"network-check-target-hwl88\" (UID: \"0e88ea25-f79a-4275-a633-ba76d5b1ec27\") " pod="openshift-network-diagnostics/network-check-target-hwl88"
Jul 16 11:09:24.924395 ip-10-0-135-184 kubenswrapper[2564]: E0716 11:09:24.924362    2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 16 11:09:24.924558 ip-10-0-135-184 kubenswrapper[2564]: E0716 11:09:24.924455    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/28bc7393-164f-4deb-89da-69443b46c55e-metrics-certs podName:28bc7393-164f-4deb-89da-69443b46c55e nodeName:}" failed. No retries permitted until 2026-07-16 11:10:28.924436069 +0000 UTC m=+129.295973082 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/28bc7393-164f-4deb-89da-69443b46c55e-metrics-certs") pod "network-metrics-daemon-pxp5q" (UID: "28bc7393-164f-4deb-89da-69443b46c55e") : secret "metrics-daemon-secret" not found
Jul 16 11:09:24.940556 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:24.940529    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:09:25.004260 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:25.004232    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:09:25.014473 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:25.014435    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/55506f12-a9f6-4576-b250-576b091deb19-original-pull-secret\") pod \"global-pull-secret-syncer-pzsf4\" (UID: \"55506f12-a9f6-4576-b250-576b091deb19\") " pod="kube-system/global-pull-secret-syncer-pzsf4"
Jul 16 11:09:25.016839 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:25.016818    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 16 11:09:25.027217 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:25.027193    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/55506f12-a9f6-4576-b250-576b091deb19-original-pull-secret\") pod \"global-pull-secret-syncer-pzsf4\" (UID: \"55506f12-a9f6-4576-b250-576b091deb19\") " pod="kube-system/global-pull-secret-syncer-pzsf4"
Jul 16 11:09:25.149812 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:25.149758    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:09:25.208853 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:25.208822    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-wdm79\""
Jul 16 11:09:25.211556 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:25.211536    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pzsf4"
Jul 16 11:09:25.216851 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:25.216809    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hwl88"
Jul 16 11:09:25.358457 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:25.358425    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-hwl88"]
Jul 16 11:09:25.361541 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:09:25.361501    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0e88ea25_f79a_4275_a633_ba76d5b1ec27.slice/crio-7767a009c0e8b46451c0a179e95de9cd239f22e719f56921eabb32f4fa5696d9 WatchSource:0}: Error finding container 7767a009c0e8b46451c0a179e95de9cd239f22e719f56921eabb32f4fa5696d9: Status 404 returned error can't find the container with id 7767a009c0e8b46451c0a179e95de9cd239f22e719f56921eabb32f4fa5696d9
Jul 16 11:09:25.374846 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:25.374823    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-pzsf4"]
Jul 16 11:09:25.378080 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:09:25.378051    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod55506f12_a9f6_4576_b250_576b091deb19.slice/crio-2d7057139f2e8f08d9d25928510eae4ac785a50239764059f55ea1105bb56d2a WatchSource:0}: Error finding container 2d7057139f2e8f08d9d25928510eae4ac785a50239764059f55ea1105bb56d2a: Status 404 returned error can't find the container with id 2d7057139f2e8f08d9d25928510eae4ac785a50239764059f55ea1105bb56d2a
Jul 16 11:09:25.740993 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:25.740899    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-pzsf4" event={"ID":"55506f12-a9f6-4576-b250-576b091deb19","Type":"ContainerStarted","Data":"2d7057139f2e8f08d9d25928510eae4ac785a50239764059f55ea1105bb56d2a"}
Jul 16 11:09:25.742192 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:25.742174    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-hwl88" event={"ID":"0e88ea25-f79a-4275-a633-ba76d5b1ec27","Type":"ContainerStarted","Data":"ba32b041e15a6dd4e0db203b795f13bbb18696245ef69df7d50f936a9cb984c4"}
Jul 16 11:09:25.742509 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:25.742209    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-hwl88" event={"ID":"0e88ea25-f79a-4275-a633-ba76d5b1ec27","Type":"ContainerStarted","Data":"7767a009c0e8b46451c0a179e95de9cd239f22e719f56921eabb32f4fa5696d9"}
Jul 16 11:09:25.742509 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:25.742310    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-hwl88"
Jul 16 11:09:25.759006 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:25.758954    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-hwl88" podStartSLOduration=65.758934617 podStartE2EDuration="1m5.758934617s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 11:08:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 11:09:25.758819521 +0000 UTC m=+66.130356557" watchObservedRunningTime="2026-07-16 11:09:25.758934617 +0000 UTC m=+66.130471654"
Jul 16 11:09:26.144664 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:26.144629    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:09:26.352474 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:26.352439    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:09:26.542438 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:26.542400    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:09:26.750020 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:26.749981    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:09:26.942295 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:26.942212    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:09:27.342742 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:27.342705    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:09:27.983494 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:27.983453    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:09:28.142584 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:28.142545    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:09:28.345323 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:28.345280    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:09:28.549136 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:28.549101    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a87056cf-7dba-4395-b644-4aeb45e9b8e7-metrics-tls\") pod \"dns-default-k69kw\" (UID: \"a87056cf-7dba-4395-b644-4aeb45e9b8e7\") " pod="openshift-dns/dns-default-k69kw"
Jul 16 11:09:28.551875 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:28.551842    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a87056cf-7dba-4395-b644-4aeb45e9b8e7-metrics-tls\") pod \"dns-default-k69kw\" (UID: \"a87056cf-7dba-4395-b644-4aeb45e9b8e7\") " pod="openshift-dns/dns-default-k69kw"
Jul 16 11:09:28.751972 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:28.751934    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/8cb7db93-eb1a-4540-b167-9d6efbe4b524-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-fd9q7\" (UID: \"8cb7db93-eb1a-4540-b167-9d6efbe4b524\") " pod="openshift-insights/insights-runtime-extractor-fd9q7"
Jul 16 11:09:28.751972 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:28.751979    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8cb7db93-eb1a-4540-b167-9d6efbe4b524-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-fd9q7\" (UID: \"8cb7db93-eb1a-4540-b167-9d6efbe4b524\") " pod="openshift-insights/insights-runtime-extractor-fd9q7"
Jul 16 11:09:28.752247 ip-10-0-135-184 kubenswrapper[2564]: E0716 11:09:28.752148    2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 16 11:09:28.752247 ip-10-0-135-184 kubenswrapper[2564]: E0716 11:09:28.752204    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8cb7db93-eb1a-4540-b167-9d6efbe4b524-insights-runtime-extractor-tls podName:8cb7db93-eb1a-4540-b167-9d6efbe4b524 nodeName:}" failed. No retries permitted until 2026-07-16 11:09:44.752190475 +0000 UTC m=+85.123727502 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/8cb7db93-eb1a-4540-b167-9d6efbe4b524-insights-runtime-extractor-tls") pod "insights-runtime-extractor-fd9q7" (UID: "8cb7db93-eb1a-4540-b167-9d6efbe4b524") : secret "insights-runtime-extractor-tls" not found
Jul 16 11:09:28.752985 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:28.752954    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/8cb7db93-eb1a-4540-b167-9d6efbe4b524-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-fd9q7\" (UID: \"8cb7db93-eb1a-4540-b167-9d6efbe4b524\") " pod="openshift-insights/insights-runtime-extractor-fd9q7"
Jul 16 11:09:28.758090 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:28.758063    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-jnq66\""
Jul 16 11:09:28.766888 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:28.766851    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-k69kw"
Jul 16 11:09:28.809194 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:28.809157    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:09:29.350680 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:29.350646    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-k69kw"]
Jul 16 11:09:29.354893 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:09:29.354863    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda87056cf_7dba_4395_b644_4aeb45e9b8e7.slice/crio-cc5898fdb1b98c4e7e7e2c507fbc0dc8aa9072bf122521cae262e6fa47b60282 WatchSource:0}: Error finding container cc5898fdb1b98c4e7e7e2c507fbc0dc8aa9072bf122521cae262e6fa47b60282: Status 404 returned error can't find the container with id cc5898fdb1b98c4e7e7e2c507fbc0dc8aa9072bf122521cae262e6fa47b60282
Jul 16 11:09:29.542122 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:29.542068    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:09:29.758383 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:29.758332    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-k69kw" event={"ID":"a87056cf-7dba-4395-b644-4aeb45e9b8e7","Type":"ContainerStarted","Data":"cc5898fdb1b98c4e7e7e2c507fbc0dc8aa9072bf122521cae262e6fa47b60282"}
Jul 16 11:09:29.760083 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:29.760041    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-pzsf4" event={"ID":"55506f12-a9f6-4576-b250-576b091deb19","Type":"ContainerStarted","Data":"cb8c0cb9403c9f0568630ff9a49c0d31e2ac5201a6070a437627faceed2701e4"}
Jul 16 11:09:29.768873 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:29.768816    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:09:29.776564 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:29.776510    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-pzsf4" podStartSLOduration=64.905631363 podStartE2EDuration="1m8.77649183s" totalImagesPullingTime="3.870860467s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 11:08:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 11:09:29.775795096 +0000 UTC m=+70.147332159" watchObservedRunningTime="2026-07-16 11:09:29.77649183 +0000 UTC m=+70.148028865"
Jul 16 11:09:29.936726 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:29.936624    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:09:30.137928 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:30.137893    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:09:30.342788 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:30.342740    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:09:31.143993 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:31.143901    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:09:31.295377 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:31.295345    2564 scope.go:117] "RemoveContainer" containerID="376e4941576566819e96ae649b5e3e2da9f8525ffbd00807d25d63a78563904f"
Jul 16 11:09:31.344598 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:31.344567    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:09:31.546365 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:31.546313    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:09:31.769356 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:31.769328    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-lwmwf_4cb63124-522c-41e2-9d85-c2af29ac8eff/console-operator/1.log"
Jul 16 11:09:31.769544 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:31.769417    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-lwmwf" event={"ID":"4cb63124-522c-41e2-9d85-c2af29ac8eff","Type":"ContainerStarted","Data":"8d38665d8f3f4afb29a723af79f1e8dab648e25652850eb9e7f12794ad556725"}
Jul 16 11:09:31.769749 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:31.769720    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7866497494-lwmwf"
Jul 16 11:09:31.771505 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:31.771472    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-k69kw" event={"ID":"a87056cf-7dba-4395-b644-4aeb45e9b8e7","Type":"ContainerStarted","Data":"375fe2e0545f5e95e1c451e4f661eeb14af3f296ea2cbccda135ab223441d3c5"}
Jul 16 11:09:31.771619 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:31.771530    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-k69kw" event={"ID":"a87056cf-7dba-4395-b644-4aeb45e9b8e7","Type":"ContainerStarted","Data":"db169de0e6fe94eab8f361cba3b2bf23c824becb7423f45c36a165c39079259e"}
Jul 16 11:09:31.771619 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:31.771564    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-k69kw"
Jul 16 11:09:31.775046 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:31.775021    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-7866497494-lwmwf"
Jul 16 11:09:31.797617 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:31.797510    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-7866497494-lwmwf" podStartSLOduration=20.495447875 podStartE2EDuration="24.797490699s" totalImagesPullingTime="4.302042824s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 11:09:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 11:09:31.796643267 +0000 UTC m=+72.168180303" watchObservedRunningTime="2026-07-16 11:09:31.797490699 +0000 UTC m=+72.169027771"
Jul 16 11:09:31.808553 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:31.808524    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:09:31.822376 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:31.822320    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-k69kw" podStartSLOduration=34.395004087 podStartE2EDuration="35.822299517s" totalImagesPullingTime="1.42729543s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 11:08:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 11:09:31.821328239 +0000 UTC m=+72.192865275" watchObservedRunningTime="2026-07-16 11:09:31.822299517 +0000 UTC m=+72.193836552"
Jul 16 11:09:31.881983 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:31.881949    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:09:32.280940 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:32.280902    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:09:32.453056 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:32.453018    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:09:32.554099 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:32.554012    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:09:32.664522 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:32.664489    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:09:32.883841 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:32.883739    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:09:32.974444 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:32.974410    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:09:33.105634 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:33.105600    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:09:33.170405 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:33.170316    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:09:33.270506 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:33.270476    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:09:33.485595 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:33.485512    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:09:34.029172 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:34.029142    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:09:34.684501 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:34.684464    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:09:34.785914 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:34.785882    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:09:39.044838 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:39.044796    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3983837b-b29b-41d3-ab7f-2247c578e01f-registry-tls\") pod \"image-registry-65978f8f75-jt6p5\" (UID: \"3983837b-b29b-41d3-ab7f-2247c578e01f\") " pod="openshift-image-registry/image-registry-65978f8f75-jt6p5"
Jul 16 11:09:39.045339 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:39.044880    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/9cc04542-5f65-43d8-b15f-5647477c2927-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-shdrh\" (UID: \"9cc04542-5f65-43d8-b15f-5647477c2927\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-shdrh"
Jul 16 11:09:39.047983 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:39.047959    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3983837b-b29b-41d3-ab7f-2247c578e01f-registry-tls\") pod \"image-registry-65978f8f75-jt6p5\" (UID: \"3983837b-b29b-41d3-ab7f-2247c578e01f\") " pod="openshift-image-registry/image-registry-65978f8f75-jt6p5"
Jul 16 11:09:39.048110 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:39.048042    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/9cc04542-5f65-43d8-b15f-5647477c2927-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-shdrh\" (UID: \"9cc04542-5f65-43d8-b15f-5647477c2927\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-shdrh"
Jul 16 11:09:39.086214 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:39.086179    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-65978f8f75-jt6p5"]
Jul 16 11:09:39.089281 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:39.089251    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-bq7p2\""
Jul 16 11:09:39.097055 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:39.097022    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-65978f8f75-jt6p5"
Jul 16 11:09:39.145544 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:39.145507    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/13fa2ca5-b90c-46e7-92bc-7a8cb4c036a2-metrics-certs\") pod \"router-default-7f4487f9c8-wnk66\" (UID: \"13fa2ca5-b90c-46e7-92bc-7a8cb4c036a2\") " pod="openshift-ingress/router-default-7f4487f9c8-wnk66"
Jul 16 11:09:39.145747 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:39.145564    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/13fa2ca5-b90c-46e7-92bc-7a8cb4c036a2-service-ca-bundle\") pod \"router-default-7f4487f9c8-wnk66\" (UID: \"13fa2ca5-b90c-46e7-92bc-7a8cb4c036a2\") " pod="openshift-ingress/router-default-7f4487f9c8-wnk66"
Jul 16 11:09:39.146318 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:39.146294    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/13fa2ca5-b90c-46e7-92bc-7a8cb4c036a2-service-ca-bundle\") pod \"router-default-7f4487f9c8-wnk66\" (UID: \"13fa2ca5-b90c-46e7-92bc-7a8cb4c036a2\") " pod="openshift-ingress/router-default-7f4487f9c8-wnk66"
Jul 16 11:09:39.148894 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:39.148517    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/13fa2ca5-b90c-46e7-92bc-7a8cb4c036a2-metrics-certs\") pod \"router-default-7f4487f9c8-wnk66\" (UID: \"13fa2ca5-b90c-46e7-92bc-7a8cb4c036a2\") " pod="openshift-ingress/router-default-7f4487f9c8-wnk66"
Jul 16 11:09:39.180679 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:39.180642    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:09:39.229242 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:39.229213    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-h646k\""
Jul 16 11:09:39.237884 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:39.237846    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6cf856758c-shdrh"
Jul 16 11:09:39.244074 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:39.244043    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-65978f8f75-jt6p5"]
Jul 16 11:09:39.247638 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:09:39.247493    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3983837b_b29b_41d3_ab7f_2247c578e01f.slice/crio-45554b888a2d0038c1147d7175a46960a67ff043323a24f1d4952cd96d04a6f9 WatchSource:0}: Error finding container 45554b888a2d0038c1147d7175a46960a67ff043323a24f1d4952cd96d04a6f9: Status 404 returned error can't find the container with id 45554b888a2d0038c1147d7175a46960a67ff043323a24f1d4952cd96d04a6f9
Jul 16 11:09:39.262633 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:39.262602    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:09:39.283200 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:39.283163    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-246zp\""
Jul 16 11:09:39.291921 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:39.291889    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-7f4487f9c8-wnk66"
Jul 16 11:09:39.339308 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:39.339270    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:09:39.384227 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:39.383858    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6cf856758c-shdrh"]
Jul 16 11:09:39.387228 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:09:39.387200    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9cc04542_5f65_43d8_b15f_5647477c2927.slice/crio-2e61c0cc87e63f90c7e7ee975b0c05a62a9d3bc8fdf7a5adf97a8ca9ed9e2e9f WatchSource:0}: Error finding container 2e61c0cc87e63f90c7e7ee975b0c05a62a9d3bc8fdf7a5adf97a8ca9ed9e2e9f: Status 404 returned error can't find the container with id 2e61c0cc87e63f90c7e7ee975b0c05a62a9d3bc8fdf7a5adf97a8ca9ed9e2e9f
Jul 16 11:09:39.445572 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:39.445529    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-7f4487f9c8-wnk66"]
Jul 16 11:09:39.445735 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:39.445642    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:09:39.451701 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:09:39.449195    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod13fa2ca5_b90c_46e7_92bc_7a8cb4c036a2.slice/crio-f0e792d2340969ca2df659f5de2d2300f2f3a4c3881dd36c4bedb77baacfcd95 WatchSource:0}: Error finding container f0e792d2340969ca2df659f5de2d2300f2f3a4c3881dd36c4bedb77baacfcd95: Status 404 returned error can't find the container with id f0e792d2340969ca2df659f5de2d2300f2f3a4c3881dd36c4bedb77baacfcd95
Jul 16 11:09:39.539839 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:39.539788    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:09:39.799918 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:39.799875    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-65978f8f75-jt6p5" event={"ID":"3983837b-b29b-41d3-ab7f-2247c578e01f","Type":"ContainerStarted","Data":"13fb5b613b1e645e64a4c19e87641059dbc0beaed738ed921e20a38e4ad3e089"}
Jul 16 11:09:39.800180 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:39.799936    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-65978f8f75-jt6p5" event={"ID":"3983837b-b29b-41d3-ab7f-2247c578e01f","Type":"ContainerStarted","Data":"45554b888a2d0038c1147d7175a46960a67ff043323a24f1d4952cd96d04a6f9"}
Jul 16 11:09:39.800180 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:39.800057    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-65978f8f75-jt6p5"
Jul 16 11:09:39.801410 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:39.801382    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6cf856758c-shdrh" event={"ID":"9cc04542-5f65-43d8-b15f-5647477c2927","Type":"ContainerStarted","Data":"2e61c0cc87e63f90c7e7ee975b0c05a62a9d3bc8fdf7a5adf97a8ca9ed9e2e9f"}
Jul 16 11:09:39.803241 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:39.803208    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-7f4487f9c8-wnk66" event={"ID":"13fa2ca5-b90c-46e7-92bc-7a8cb4c036a2","Type":"ContainerStarted","Data":"ff64b7ca7148f81871adec67e85cec4647fd153e9ed3c2a3e79d4553c3ba1cdd"}
Jul 16 11:09:39.803434 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:39.803260    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-7f4487f9c8-wnk66" event={"ID":"13fa2ca5-b90c-46e7-92bc-7a8cb4c036a2","Type":"ContainerStarted","Data":"f0e792d2340969ca2df659f5de2d2300f2f3a4c3881dd36c4bedb77baacfcd95"}
Jul 16 11:09:39.823882 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:39.821492    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-65978f8f75-jt6p5" podStartSLOduration=32.821466817 podStartE2EDuration="32.821466817s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 11:09:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 11:09:39.819251713 +0000 UTC m=+80.190788750" watchObservedRunningTime="2026-07-16 11:09:39.821466817 +0000 UTC m=+80.193003855"
Jul 16 11:09:39.840846 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:39.840759    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-7f4487f9c8-wnk66" podStartSLOduration=32.84074118 podStartE2EDuration="32.84074118s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 11:09:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 11:09:39.839397442 +0000 UTC m=+80.210934477" watchObservedRunningTime="2026-07-16 11:09:39.84074118 +0000 UTC m=+80.212278216"
Jul 16 11:09:40.292513 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:40.292476    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-7f4487f9c8-wnk66"
Jul 16 11:09:40.299912 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:40.299888    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-7f4487f9c8-wnk66"
Jul 16 11:09:40.807029 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:40.806994    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-7f4487f9c8-wnk66"
Jul 16 11:09:40.808358 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:40.808335    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-7f4487f9c8-wnk66"
Jul 16 11:09:40.855324 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:40.855287    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:09:41.008126 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:41.008077    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:09:41.185541 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:41.185505    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:09:41.776561 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:41.776532    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-k69kw"
Jul 16 11:09:41.812431 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:41.812394    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6cf856758c-shdrh" event={"ID":"9cc04542-5f65-43d8-b15f-5647477c2927","Type":"ContainerStarted","Data":"6409aabcbdffaee85269e7e04939cc4017f4027be3857c95c22fb79cb1c6e580"}
Jul 16 11:09:41.830587 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:41.830534    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-6cf856758c-shdrh" podStartSLOduration=33.231911141 podStartE2EDuration="34.830512612s" totalImagesPullingTime="1.598601471s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 11:09:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 11:09:41.830246547 +0000 UTC m=+82.201783601" watchObservedRunningTime="2026-07-16 11:09:41.830512612 +0000 UTC m=+82.202049650"
Jul 16 11:09:41.957343 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:41.957302    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:09:42.026480 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:42.026445    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:09:43.105090 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:43.105053    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:09:43.230236 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:43.230203    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:09:44.793762 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:44.793718    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8cb7db93-eb1a-4540-b167-9d6efbe4b524-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-fd9q7\" (UID: \"8cb7db93-eb1a-4540-b167-9d6efbe4b524\") " pod="openshift-insights/insights-runtime-extractor-fd9q7"
Jul 16 11:09:44.796195 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:44.796168    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8cb7db93-eb1a-4540-b167-9d6efbe4b524-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-fd9q7\" (UID: \"8cb7db93-eb1a-4540-b167-9d6efbe4b524\") " pod="openshift-insights/insights-runtime-extractor-fd9q7"
Jul 16 11:09:45.056871 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:45.056767    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-hljx9\""
Jul 16 11:09:45.065532 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:45.065496    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-fd9q7"
Jul 16 11:09:45.067587 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:45.067560    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:09:45.139235 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:45.139202    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:09:45.207128 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:45.207087    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-fd9q7"]
Jul 16 11:09:45.210516 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:09:45.210482    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8cb7db93_eb1a_4540_b167_9d6efbe4b524.slice/crio-001aa5282f1f6aceaae94297de595038c16ef034794268a93219e7352e242b64 WatchSource:0}: Error finding container 001aa5282f1f6aceaae94297de595038c16ef034794268a93219e7352e242b64: Status 404 returned error can't find the container with id 001aa5282f1f6aceaae94297de595038c16ef034794268a93219e7352e242b64
Jul 16 11:09:45.224085 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:45.224054    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:09:45.287013 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:45.286976    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:09:45.347195 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:45.347105    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:09:45.482026 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:45.481993    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:09:45.825454 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:45.825420    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-fd9q7" event={"ID":"8cb7db93-eb1a-4540-b167-9d6efbe4b524","Type":"ContainerStarted","Data":"001aa5282f1f6aceaae94297de595038c16ef034794268a93219e7352e242b64"}
Jul 16 11:09:46.889826 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:46.889791    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:09:48.526377 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:48.526337    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:09:48.607977 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:48.607922    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:09:50.192100 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:50.192062    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:09:52.855136 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:52.855090    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-fd9q7" event={"ID":"8cb7db93-eb1a-4540-b167-9d6efbe4b524","Type":"ContainerStarted","Data":"73db5636f0528455e2561e13c9494863cfaf44cb6c80d815615eccd463cf2699"}
Jul 16 11:09:53.109284 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:53.109199    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:09:53.211311 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:53.211276    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:09:54.905820 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:54.905694    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:09:55.006089 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:55.006054    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:09:55.868477 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:55.868375    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-fd9q7" event={"ID":"8cb7db93-eb1a-4540-b167-9d6efbe4b524","Type":"ContainerStarted","Data":"d92272fd08ae0d46ba4f60fbc7c45eab9e2a1eb664fc27d1f26a78817025ca62"}
Jul 16 11:09:56.297156 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:56.297099    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:09:56.364579 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:56.364536    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:09:56.748400 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:56.748312    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-hwl88"
Jul 16 11:09:56.795292 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:56.795241    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:09:56.896208 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:56.896172    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:09:59.173565 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:59.173515    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:09:59.275131 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:59.275093    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:09:59.807111 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:09:59.807082    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-65978f8f75-jt6p5"
Jul 16 11:10:01.892095 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:10:01.892058    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-fd9q7" event={"ID":"8cb7db93-eb1a-4540-b167-9d6efbe4b524","Type":"ContainerStarted","Data":"e79e7353cc1ad6d24bbb5b6c5443bf144fa1bfc0f9aa0b8dc500a5a9e38aedf4"}
Jul 16 11:10:01.914215 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:10:01.914160    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-fd9q7" podStartSLOduration=34.229799694 podStartE2EDuration="49.914140265s" totalImagesPullingTime="15.684340571s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 11:09:12 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 11:10:01.912603863 +0000 UTC m=+102.284140901" watchObservedRunningTime="2026-07-16 11:10:01.914140265 +0000 UTC m=+102.285677302"
Jul 16 11:10:02.762113 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:10:02.762079    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:10:02.865640 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:10:02.865601    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:10:04.820345 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:10:04.820300    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-65978f8f75-jt6p5" podUID="3983837b-b29b-41d3-ab7f-2247c578e01f" containerName="registry" containerID="cri-o://13fb5b613b1e645e64a4c19e87641059dbc0beaed738ed921e20a38e4ad3e089" gracePeriod=30
Jul 16 11:10:05.063817 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:10:05.063790    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-65978f8f75-jt6p5"
Jul 16 11:10:05.162428 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:10:05.162333    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3983837b-b29b-41d3-ab7f-2247c578e01f-registry-tls\") pod \"3983837b-b29b-41d3-ab7f-2247c578e01f\" (UID: \"3983837b-b29b-41d3-ab7f-2247c578e01f\") "
Jul 16 11:10:05.162428 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:10:05.162417    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hhm9w\" (UniqueName: \"kubernetes.io/projected/3983837b-b29b-41d3-ab7f-2247c578e01f-kube-api-access-hhm9w\") pod \"3983837b-b29b-41d3-ab7f-2247c578e01f\" (UID: \"3983837b-b29b-41d3-ab7f-2247c578e01f\") "
Jul 16 11:10:05.162645 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:10:05.162446    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3983837b-b29b-41d3-ab7f-2247c578e01f-bound-sa-token\") pod \"3983837b-b29b-41d3-ab7f-2247c578e01f\" (UID: \"3983837b-b29b-41d3-ab7f-2247c578e01f\") "
Jul 16 11:10:05.162645 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:10:05.162483    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/3983837b-b29b-41d3-ab7f-2247c578e01f-installation-pull-secrets\") pod \"3983837b-b29b-41d3-ab7f-2247c578e01f\" (UID: \"3983837b-b29b-41d3-ab7f-2247c578e01f\") "
Jul 16 11:10:05.162645 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:10:05.162509    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/3983837b-b29b-41d3-ab7f-2247c578e01f-trusted-ca\") pod \"3983837b-b29b-41d3-ab7f-2247c578e01f\" (UID: \"3983837b-b29b-41d3-ab7f-2247c578e01f\") "
Jul 16 11:10:05.162645 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:10:05.162553    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/3983837b-b29b-41d3-ab7f-2247c578e01f-registry-certificates\") pod \"3983837b-b29b-41d3-ab7f-2247c578e01f\" (UID: \"3983837b-b29b-41d3-ab7f-2247c578e01f\") "
Jul 16 11:10:05.162645 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:10:05.162587    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/3983837b-b29b-41d3-ab7f-2247c578e01f-ca-trust-extracted\") pod \"3983837b-b29b-41d3-ab7f-2247c578e01f\" (UID: \"3983837b-b29b-41d3-ab7f-2247c578e01f\") "
Jul 16 11:10:05.162645 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:10:05.162624    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/3983837b-b29b-41d3-ab7f-2247c578e01f-image-registry-private-configuration\") pod \"3983837b-b29b-41d3-ab7f-2247c578e01f\" (UID: \"3983837b-b29b-41d3-ab7f-2247c578e01f\") "
Jul 16 11:10:05.163353 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:10:05.163269    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3983837b-b29b-41d3-ab7f-2247c578e01f-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "3983837b-b29b-41d3-ab7f-2247c578e01f" (UID: "3983837b-b29b-41d3-ab7f-2247c578e01f"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 11:10:05.163353 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:10:05.163296    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3983837b-b29b-41d3-ab7f-2247c578e01f-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "3983837b-b29b-41d3-ab7f-2247c578e01f" (UID: "3983837b-b29b-41d3-ab7f-2247c578e01f"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 11:10:05.165530 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:10:05.165451    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3983837b-b29b-41d3-ab7f-2247c578e01f-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "3983837b-b29b-41d3-ab7f-2247c578e01f" (UID: "3983837b-b29b-41d3-ab7f-2247c578e01f"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 11:10:05.165530 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:10:05.165463    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3983837b-b29b-41d3-ab7f-2247c578e01f-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "3983837b-b29b-41d3-ab7f-2247c578e01f" (UID: "3983837b-b29b-41d3-ab7f-2247c578e01f"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 11:10:05.165530 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:10:05.165501    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3983837b-b29b-41d3-ab7f-2247c578e01f-kube-api-access-hhm9w" (OuterVolumeSpecName: "kube-api-access-hhm9w") pod "3983837b-b29b-41d3-ab7f-2247c578e01f" (UID: "3983837b-b29b-41d3-ab7f-2247c578e01f"). InnerVolumeSpecName "kube-api-access-hhm9w". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 11:10:05.165832 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:10:05.165800    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3983837b-b29b-41d3-ab7f-2247c578e01f-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "3983837b-b29b-41d3-ab7f-2247c578e01f" (UID: "3983837b-b29b-41d3-ab7f-2247c578e01f"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 11:10:05.165951 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:10:05.165812    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3983837b-b29b-41d3-ab7f-2247c578e01f-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "3983837b-b29b-41d3-ab7f-2247c578e01f" (UID: "3983837b-b29b-41d3-ab7f-2247c578e01f"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 11:10:05.172672 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:10:05.172633    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3983837b-b29b-41d3-ab7f-2247c578e01f-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "3983837b-b29b-41d3-ab7f-2247c578e01f" (UID: "3983837b-b29b-41d3-ab7f-2247c578e01f"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 11:10:05.213375 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:10:05.213338    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:10:05.264113 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:10:05.264074    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hhm9w\" (UniqueName: \"kubernetes.io/projected/3983837b-b29b-41d3-ab7f-2247c578e01f-kube-api-access-hhm9w\") on node \"ip-10-0-135-184.ec2.internal\" DevicePath \"\""
Jul 16 11:10:05.264113 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:10:05.264107    2564 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3983837b-b29b-41d3-ab7f-2247c578e01f-bound-sa-token\") on node \"ip-10-0-135-184.ec2.internal\" DevicePath \"\""
Jul 16 11:10:05.264113 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:10:05.264116    2564 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/3983837b-b29b-41d3-ab7f-2247c578e01f-installation-pull-secrets\") on node \"ip-10-0-135-184.ec2.internal\" DevicePath \"\""
Jul 16 11:10:05.264314 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:10:05.264125    2564 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/3983837b-b29b-41d3-ab7f-2247c578e01f-trusted-ca\") on node \"ip-10-0-135-184.ec2.internal\" DevicePath \"\""
Jul 16 11:10:05.264314 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:10:05.264134    2564 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/3983837b-b29b-41d3-ab7f-2247c578e01f-registry-certificates\") on node \"ip-10-0-135-184.ec2.internal\" DevicePath \"\""
Jul 16 11:10:05.264314 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:10:05.264142    2564 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/3983837b-b29b-41d3-ab7f-2247c578e01f-ca-trust-extracted\") on node \"ip-10-0-135-184.ec2.internal\" DevicePath \"\""
Jul 16 11:10:05.264314 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:10:05.264151    2564 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/3983837b-b29b-41d3-ab7f-2247c578e01f-image-registry-private-configuration\") on node \"ip-10-0-135-184.ec2.internal\" DevicePath \"\""
Jul 16 11:10:05.264314 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:10:05.264160    2564 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3983837b-b29b-41d3-ab7f-2247c578e01f-registry-tls\") on node \"ip-10-0-135-184.ec2.internal\" DevicePath \"\""
Jul 16 11:10:05.506669 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:10:05.506636    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-84bd68b896-gmzk4"]
Jul 16 11:10:05.506917 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:10:05.506905    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3983837b-b29b-41d3-ab7f-2247c578e01f" containerName="registry"
Jul 16 11:10:05.506966 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:10:05.506919    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="3983837b-b29b-41d3-ab7f-2247c578e01f" containerName="registry"
Jul 16 11:10:05.506966 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:10:05.506962    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="3983837b-b29b-41d3-ab7f-2247c578e01f" containerName="registry"
Jul 16 11:10:05.527314 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:10:05.527280    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-84bd68b896-gmzk4"]
Jul 16 11:10:05.527504 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:10:05.527427    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-gmzk4"
Jul 16 11:10:05.530587 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:10:05.530553    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 16 11:10:05.530587 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:10:05.530552    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 16 11:10:05.530853 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:10:05.530553    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
Jul 16 11:10:05.530853 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:10:05.530630    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 16 11:10:05.530966 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:10:05.530945    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
Jul 16 11:10:05.531154 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:10:05.531136    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-bkksj\""
Jul 16 11:10:05.533669 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:10:05.533536    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-45594"]
Jul 16 11:10:05.546276 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:10:05.546247    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-785778ff74-pwndd"]
Jul 16 11:10:05.546425 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:10:05.546364    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-45594"
Jul 16 11:10:05.548558 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:10:05.548534    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 16 11:10:05.549401 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:10:05.549103    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-qvwlj\""
Jul 16 11:10:05.549401 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:10:05.549164    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 16 11:10:05.549401 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:10:05.549186    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 16 11:10:05.559043 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:10:05.559018    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-785778ff74-pwndd"]
Jul 16 11:10:05.559187 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:10:05.559102    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-785778ff74-pwndd"
Jul 16 11:10:05.561554 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:10:05.561510    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
Jul 16 11:10:05.561734 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:10:05.561559    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
Jul 16 11:10:05.561734 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:10:05.561648    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-fgllx\""
Jul 16 11:10:05.561916 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:10:05.561862    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
Jul 16 11:10:05.565680 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:10:05.565649    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a6d30211-1115-44b6-b751-34ddc73cacbb-metrics-client-ca\") pod \"openshift-state-metrics-84bd68b896-gmzk4\" (UID: \"a6d30211-1115-44b6-b751-34ddc73cacbb\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-gmzk4"
Jul 16 11:10:05.565853 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:10:05.565697    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a6d30211-1115-44b6-b751-34ddc73cacbb-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-84bd68b896-gmzk4\" (UID: \"a6d30211-1115-44b6-b751-34ddc73cacbb\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-gmzk4"
Jul 16 11:10:05.565853 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:10:05.565730    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d78wx\" (UniqueName: \"kubernetes.io/projected/a6d30211-1115-44b6-b751-34ddc73cacbb-kube-api-access-d78wx\") pod \"openshift-state-metrics-84bd68b896-gmzk4\" (UID: \"a6d30211-1115-44b6-b751-34ddc73cacbb\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-gmzk4"
Jul 16 11:10:05.565975 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:10:05.565848    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/a6d30211-1115-44b6-b751-34ddc73cacbb-openshift-state-metrics-tls\") pod \"openshift-state-metrics-84bd68b896-gmzk4\" (UID: \"a6d30211-1115-44b6-b751-34ddc73cacbb\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-gmzk4"
Jul 16 11:10:05.666590 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:10:05.666550    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/a6d30211-1115-44b6-b751-34ddc73cacbb-openshift-state-metrics-tls\") pod \"openshift-state-metrics-84bd68b896-gmzk4\" (UID: \"a6d30211-1115-44b6-b751-34ddc73cacbb\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-gmzk4"
Jul 16 11:10:05.666590 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:10:05.666594    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/92d26de8-4fb0-4807-917c-bbad2af89377-metrics-client-ca\") pod \"node-exporter-45594\" (UID: \"92d26de8-4fb0-4807-917c-bbad2af89377\") " pod="openshift-monitoring/node-exporter-45594"
Jul 16 11:10:05.666850 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:10:05.666614    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/92d26de8-4fb0-4807-917c-bbad2af89377-root\") pod \"node-exporter-45594\" (UID: \"92d26de8-4fb0-4807-917c-bbad2af89377\") " pod="openshift-monitoring/node-exporter-45594"
Jul 16 11:10:05.666850 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:10:05.666634    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c02fa2f9-7be3-472b-8078-55cfc78a2be7-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-785778ff74-pwndd\" (UID: \"c02fa2f9-7be3-472b-8078-55cfc78a2be7\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-pwndd"
Jul 16 11:10:05.666850 ip-10-0-135-184 kubenswrapper[2564]: E0716 11:10:05.666724    2564 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found
Jul 16 11:10:05.666850 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:10:05.666766    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/92d26de8-4fb0-4807-917c-bbad2af89377-node-exporter-accelerators-collector-config\") pod \"node-exporter-45594\" (UID: \"92d26de8-4fb0-4807-917c-bbad2af89377\") " pod="openshift-monitoring/node-exporter-45594"
Jul 16 11:10:05.666850 ip-10-0-135-184 kubenswrapper[2564]: E0716 11:10:05.666819    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a6d30211-1115-44b6-b751-34ddc73cacbb-openshift-state-metrics-tls podName:a6d30211-1115-44b6-b751-34ddc73cacbb nodeName:}" failed. No retries permitted until 2026-07-16 11:10:06.166795668 +0000 UTC m=+106.538332696 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/a6d30211-1115-44b6-b751-34ddc73cacbb-openshift-state-metrics-tls") pod "openshift-state-metrics-84bd68b896-gmzk4" (UID: "a6d30211-1115-44b6-b751-34ddc73cacbb") : secret "openshift-state-metrics-tls" not found
Jul 16 11:10:05.667014 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:10:05.666882    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/c02fa2f9-7be3-472b-8078-55cfc78a2be7-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-785778ff74-pwndd\" (UID: \"c02fa2f9-7be3-472b-8078-55cfc78a2be7\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-pwndd"
Jul 16 11:10:05.667014 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:10:05.666922    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/92d26de8-4fb0-4807-917c-bbad2af89377-node-exporter-wtmp\") pod \"node-exporter-45594\" (UID: \"92d26de8-4fb0-4807-917c-bbad2af89377\") " pod="openshift-monitoring/node-exporter-45594"
Jul 16 11:10:05.667014 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:10:05.666940    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/92d26de8-4fb0-4807-917c-bbad2af89377-node-exporter-textfile\") pod \"node-exporter-45594\" (UID: \"92d26de8-4fb0-4807-917c-bbad2af89377\") " pod="openshift-monitoring/node-exporter-45594"
Jul 16 11:10:05.667014 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:10:05.666984    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t6f8c\" (UniqueName: \"kubernetes.io/projected/c02fa2f9-7be3-472b-8078-55cfc78a2be7-kube-api-access-t6f8c\") pod \"kube-state-metrics-785778ff74-pwndd\" (UID: \"c02fa2f9-7be3-472b-8078-55cfc78a2be7\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-pwndd"
Jul 16 11:10:05.667014 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:10:05.667004    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c02fa2f9-7be3-472b-8078-55cfc78a2be7-metrics-client-ca\") pod \"kube-state-metrics-785778ff74-pwndd\" (UID: \"c02fa2f9-7be3-472b-8078-55cfc78a2be7\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-pwndd"
Jul 16 11:10:05.667191 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:10:05.667048    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a6d30211-1115-44b6-b751-34ddc73cacbb-metrics-client-ca\") pod \"openshift-state-metrics-84bd68b896-gmzk4\" (UID: \"a6d30211-1115-44b6-b751-34ddc73cacbb\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-gmzk4"
Jul 16 11:10:05.667191 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:10:05.667086    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/92d26de8-4fb0-4807-917c-bbad2af89377-node-exporter-tls\") pod \"node-exporter-45594\" (UID: \"92d26de8-4fb0-4807-917c-bbad2af89377\") " pod="openshift-monitoring/node-exporter-45594"
Jul 16 11:10:05.667191 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:10:05.667115    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/c02fa2f9-7be3-472b-8078-55cfc78a2be7-volume-directive-shadow\") pod \"kube-state-metrics-785778ff74-pwndd\" (UID: \"c02fa2f9-7be3-472b-8078-55cfc78a2be7\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-pwndd"
Jul 16 11:10:05.667191 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:10:05.667153    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a6d30211-1115-44b6-b751-34ddc73cacbb-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-84bd68b896-gmzk4\" (UID: \"a6d30211-1115-44b6-b751-34ddc73cacbb\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-gmzk4"
Jul 16 11:10:05.667191 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:10:05.667181    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/92d26de8-4fb0-4807-917c-bbad2af89377-sys\") pod \"node-exporter-45594\" (UID: \"92d26de8-4fb0-4807-917c-bbad2af89377\") " pod="openshift-monitoring/node-exporter-45594"
Jul 16 11:10:05.667409 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:10:05.667208    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d78wx\" (UniqueName: \"kubernetes.io/projected/a6d30211-1115-44b6-b751-34ddc73cacbb-kube-api-access-d78wx\") pod \"openshift-state-metrics-84bd68b896-gmzk4\" (UID: \"a6d30211-1115-44b6-b751-34ddc73cacbb\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-gmzk4"
Jul 16 11:10:05.667409 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:10:05.667247    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lrgkm\" (UniqueName: \"kubernetes.io/projected/92d26de8-4fb0-4807-917c-bbad2af89377-kube-api-access-lrgkm\") pod \"node-exporter-45594\" (UID: \"92d26de8-4fb0-4807-917c-bbad2af89377\") " pod="openshift-monitoring/node-exporter-45594"
Jul 16 11:10:05.667409 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:10:05.667271    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/c02fa2f9-7be3-472b-8078-55cfc78a2be7-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-pwndd\" (UID: \"c02fa2f9-7be3-472b-8078-55cfc78a2be7\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-pwndd"
Jul 16 11:10:05.667409 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:10:05.667302    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/92d26de8-4fb0-4807-917c-bbad2af89377-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-45594\" (UID: \"92d26de8-4fb0-4807-917c-bbad2af89377\") " pod="openshift-monitoring/node-exporter-45594"
Jul 16 11:10:05.667712 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:10:05.667694    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a6d30211-1115-44b6-b751-34ddc73cacbb-metrics-client-ca\") pod \"openshift-state-metrics-84bd68b896-gmzk4\" (UID: \"a6d30211-1115-44b6-b751-34ddc73cacbb\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-gmzk4"
Jul 16 11:10:05.669430 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:10:05.669409    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a6d30211-1115-44b6-b751-34ddc73cacbb-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-84bd68b896-gmzk4\" (UID: \"a6d30211-1115-44b6-b751-34ddc73cacbb\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-gmzk4"
Jul 16 11:10:05.681936 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:10:05.681909    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d78wx\" (UniqueName: \"kubernetes.io/projected/a6d30211-1115-44b6-b751-34ddc73cacbb-kube-api-access-d78wx\") pod \"openshift-state-metrics-84bd68b896-gmzk4\" (UID: \"a6d30211-1115-44b6-b751-34ddc73cacbb\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-gmzk4"
Jul 16 11:10:05.768271 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:10:05.768179    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lrgkm\" (UniqueName: \"kubernetes.io/projected/92d26de8-4fb0-4807-917c-bbad2af89377-kube-api-access-lrgkm\") pod \"node-exporter-45594\" (UID: \"92d26de8-4fb0-4807-917c-bbad2af89377\") " pod="openshift-monitoring/node-exporter-45594"
Jul 16 11:10:05.768271 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:10:05.768219    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/c02fa2f9-7be3-472b-8078-55cfc78a2be7-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-pwndd\" (UID: \"c02fa2f9-7be3-472b-8078-55cfc78a2be7\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-pwndd"
Jul 16 11:10:05.768271 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:10:05.768249    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/92d26de8-4fb0-4807-917c-bbad2af89377-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-45594\" (UID: \"92d26de8-4fb0-4807-917c-bbad2af89377\") " pod="openshift-monitoring/node-exporter-45594"
Jul 16 11:10:05.768578 ip-10-0-135-184 kubenswrapper[2564]: E0716 11:10:05.768346    2564 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found
Jul 16 11:10:05.768578 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:10:05.768424    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/92d26de8-4fb0-4807-917c-bbad2af89377-metrics-client-ca\") pod \"node-exporter-45594\" (UID: \"92d26de8-4fb0-4807-917c-bbad2af89377\") " pod="openshift-monitoring/node-exporter-45594"
Jul 16 11:10:05.768578 ip-10-0-135-184 kubenswrapper[2564]: E0716 11:10:05.768432    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c02fa2f9-7be3-472b-8078-55cfc78a2be7-kube-state-metrics-tls podName:c02fa2f9-7be3-472b-8078-55cfc78a2be7 nodeName:}" failed. No retries permitted until 2026-07-16 11:10:06.268414965 +0000 UTC m=+106.639951979 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/c02fa2f9-7be3-472b-8078-55cfc78a2be7-kube-state-metrics-tls") pod "kube-state-metrics-785778ff74-pwndd" (UID: "c02fa2f9-7be3-472b-8078-55cfc78a2be7") : secret "kube-state-metrics-tls" not found
Jul 16 11:10:05.768578 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:10:05.768477    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/92d26de8-4fb0-4807-917c-bbad2af89377-root\") pod \"node-exporter-45594\" (UID: \"92d26de8-4fb0-4807-917c-bbad2af89377\") " pod="openshift-monitoring/node-exporter-45594"
Jul 16 11:10:05.768578 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:10:05.768507    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c02fa2f9-7be3-472b-8078-55cfc78a2be7-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-785778ff74-pwndd\" (UID: \"c02fa2f9-7be3-472b-8078-55cfc78a2be7\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-pwndd"
Jul 16 11:10:05.768578 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:10:05.768543    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/92d26de8-4fb0-4807-917c-bbad2af89377-node-exporter-accelerators-collector-config\") pod \"node-exporter-45594\" (UID: \"92d26de8-4fb0-4807-917c-bbad2af89377\") " pod="openshift-monitoring/node-exporter-45594"
Jul 16 11:10:05.768578 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:10:05.768549    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/92d26de8-4fb0-4807-917c-bbad2af89377-root\") pod \"node-exporter-45594\" (UID: \"92d26de8-4fb0-4807-917c-bbad2af89377\") " pod="openshift-monitoring/node-exporter-45594"
Jul 16 11:10:05.768578 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:10:05.768573    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/c02fa2f9-7be3-472b-8078-55cfc78a2be7-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-785778ff74-pwndd\" (UID: \"c02fa2f9-7be3-472b-8078-55cfc78a2be7\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-pwndd"
Jul 16 11:10:05.769016 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:10:05.768610    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/92d26de8-4fb0-4807-917c-bbad2af89377-node-exporter-wtmp\") pod \"node-exporter-45594\" (UID: \"92d26de8-4fb0-4807-917c-bbad2af89377\") " pod="openshift-monitoring/node-exporter-45594"
Jul 16 11:10:05.769016 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:10:05.768640    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/92d26de8-4fb0-4807-917c-bbad2af89377-node-exporter-textfile\") pod \"node-exporter-45594\" (UID: \"92d26de8-4fb0-4807-917c-bbad2af89377\") " pod="openshift-monitoring/node-exporter-45594"
Jul 16 11:10:05.769016 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:10:05.768686    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t6f8c\" (UniqueName: \"kubernetes.io/projected/c02fa2f9-7be3-472b-8078-55cfc78a2be7-kube-api-access-t6f8c\") pod \"kube-state-metrics-785778ff74-pwndd\" (UID: \"c02fa2f9-7be3-472b-8078-55cfc78a2be7\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-pwndd"
Jul 16 11:10:05.769016 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:10:05.768718    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c02fa2f9-7be3-472b-8078-55cfc78a2be7-metrics-client-ca\") pod \"kube-state-metrics-785778ff74-pwndd\" (UID: \"c02fa2f9-7be3-472b-8078-55cfc78a2be7\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-pwndd"
Jul 16 11:10:05.769016 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:10:05.768760    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/92d26de8-4fb0-4807-917c-bbad2af89377-node-exporter-tls\") pod \"node-exporter-45594\" (UID: \"92d26de8-4fb0-4807-917c-bbad2af89377\") " pod="openshift-monitoring/node-exporter-45594"
Jul 16 11:10:05.769016 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:10:05.768814    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/c02fa2f9-7be3-472b-8078-55cfc78a2be7-volume-directive-shadow\") pod \"kube-state-metrics-785778ff74-pwndd\" (UID: \"c02fa2f9-7be3-472b-8078-55cfc78a2be7\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-pwndd"
Jul 16 11:10:05.769016 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:10:05.768842    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/92d26de8-4fb0-4807-917c-bbad2af89377-node-exporter-wtmp\") pod \"node-exporter-45594\" (UID: \"92d26de8-4fb0-4807-917c-bbad2af89377\") " pod="openshift-monitoring/node-exporter-45594"
Jul 16 11:10:05.769016 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:10:05.768897    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/92d26de8-4fb0-4807-917c-bbad2af89377-sys\") pod \"node-exporter-45594\" (UID: \"92d26de8-4fb0-4807-917c-bbad2af89377\") " pod="openshift-monitoring/node-exporter-45594"
Jul 16 11:10:05.769016 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:10:05.768849    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/92d26de8-4fb0-4807-917c-bbad2af89377-sys\") pod \"node-exporter-45594\" (UID: \"92d26de8-4fb0-4807-917c-bbad2af89377\") " pod="openshift-monitoring/node-exporter-45594"
Jul 16 11:10:05.769462 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:10:05.769101    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/92d26de8-4fb0-4807-917c-bbad2af89377-metrics-client-ca\") pod \"node-exporter-45594\" (UID: \"92d26de8-4fb0-4807-917c-bbad2af89377\") " pod="openshift-monitoring/node-exporter-45594"
Jul 16 11:10:05.769462 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:10:05.769284    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/c02fa2f9-7be3-472b-8078-55cfc78a2be7-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-785778ff74-pwndd\" (UID: \"c02fa2f9-7be3-472b-8078-55cfc78a2be7\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-pwndd"
Jul 16 11:10:05.769462 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:10:05.769315    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/c02fa2f9-7be3-472b-8078-55cfc78a2be7-volume-directive-shadow\") pod \"kube-state-metrics-785778ff74-pwndd\" (UID: \"c02fa2f9-7be3-472b-8078-55cfc78a2be7\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-pwndd"
Jul 16 11:10:05.769462 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:10:05.769421    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/92d26de8-4fb0-4807-917c-bbad2af89377-node-exporter-textfile\") pod \"node-exporter-45594\" (UID: \"92d26de8-4fb0-4807-917c-bbad2af89377\") " pod="openshift-monitoring/node-exporter-45594"
Jul 16 11:10:05.769670 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:10:05.769660    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/92d26de8-4fb0-4807-917c-bbad2af89377-node-exporter-accelerators-collector-config\") pod \"node-exporter-45594\" (UID: \"92d26de8-4fb0-4807-917c-bbad2af89377\") " pod="openshift-monitoring/node-exporter-45594"
Jul 16 11:10:05.769861 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:10:05.769840    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c02fa2f9-7be3-472b-8078-55cfc78a2be7-metrics-client-ca\") pod \"kube-state-metrics-785778ff74-pwndd\" (UID: \"c02fa2f9-7be3-472b-8078-55cfc78a2be7\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-pwndd"
Jul 16 11:10:05.771098 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:10:05.771073    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c02fa2f9-7be3-472b-8078-55cfc78a2be7-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-785778ff74-pwndd\" (UID: \"c02fa2f9-7be3-472b-8078-55cfc78a2be7\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-pwndd"
Jul 16 11:10:05.771167 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:10:05.771144    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/92d26de8-4fb0-4807-917c-bbad2af89377-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-45594\" (UID: \"92d26de8-4fb0-4807-917c-bbad2af89377\") " pod="openshift-monitoring/node-exporter-45594"
Jul 16 11:10:05.771330 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:10:05.771301    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/92d26de8-4fb0-4807-917c-bbad2af89377-node-exporter-tls\") pod \"node-exporter-45594\" (UID: \"92d26de8-4fb0-4807-917c-bbad2af89377\") " pod="openshift-monitoring/node-exporter-45594"
Jul 16 11:10:05.791222 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:10:05.791189    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lrgkm\" (UniqueName: \"kubernetes.io/projected/92d26de8-4fb0-4807-917c-bbad2af89377-kube-api-access-lrgkm\") pod \"node-exporter-45594\" (UID: \"92d26de8-4fb0-4807-917c-bbad2af89377\") " pod="openshift-monitoring/node-exporter-45594"
Jul 16 11:10:05.795559 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:10:05.795535    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t6f8c\" (UniqueName: \"kubernetes.io/projected/c02fa2f9-7be3-472b-8078-55cfc78a2be7-kube-api-access-t6f8c\") pod \"kube-state-metrics-785778ff74-pwndd\" (UID: \"c02fa2f9-7be3-472b-8078-55cfc78a2be7\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-pwndd"
Jul 16 11:10:05.862006 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:10:05.861970    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-45594"
Jul 16 11:10:05.872372 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:10:05.872341    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod92d26de8_4fb0_4807_917c_bbad2af89377.slice/crio-c7128989b2a80f81d31b13c4a5263c15aa1547e10c52367c593d281f50a6d186 WatchSource:0}: Error finding container c7128989b2a80f81d31b13c4a5263c15aa1547e10c52367c593d281f50a6d186: Status 404 returned error can't find the container with id c7128989b2a80f81d31b13c4a5263c15aa1547e10c52367c593d281f50a6d186
Jul 16 11:10:05.906354 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:10:05.906315    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-45594" event={"ID":"92d26de8-4fb0-4807-917c-bbad2af89377","Type":"ContainerStarted","Data":"c7128989b2a80f81d31b13c4a5263c15aa1547e10c52367c593d281f50a6d186"}
Jul 16 11:10:05.907564 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:10:05.907531    2564 generic.go:356] "Generic (PLEG): container finished" podID="3983837b-b29b-41d3-ab7f-2247c578e01f" containerID="13fb5b613b1e645e64a4c19e87641059dbc0beaed738ed921e20a38e4ad3e089" exitCode=0
Jul 16 11:10:05.907803 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:10:05.907602    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-65978f8f75-jt6p5"
Jul 16 11:10:05.907803 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:10:05.907611    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-65978f8f75-jt6p5" event={"ID":"3983837b-b29b-41d3-ab7f-2247c578e01f","Type":"ContainerDied","Data":"13fb5b613b1e645e64a4c19e87641059dbc0beaed738ed921e20a38e4ad3e089"}
Jul 16 11:10:05.907803 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:10:05.907652    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-65978f8f75-jt6p5" event={"ID":"3983837b-b29b-41d3-ab7f-2247c578e01f","Type":"ContainerDied","Data":"45554b888a2d0038c1147d7175a46960a67ff043323a24f1d4952cd96d04a6f9"}
Jul 16 11:10:05.907803 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:10:05.907676    2564 scope.go:117] "RemoveContainer" containerID="13fb5b613b1e645e64a4c19e87641059dbc0beaed738ed921e20a38e4ad3e089"
Jul 16 11:10:05.915969 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:10:05.915945    2564 scope.go:117] "RemoveContainer" containerID="13fb5b613b1e645e64a4c19e87641059dbc0beaed738ed921e20a38e4ad3e089"
Jul 16 11:10:05.916318 ip-10-0-135-184 kubenswrapper[2564]: E0716 11:10:05.916285    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"13fb5b613b1e645e64a4c19e87641059dbc0beaed738ed921e20a38e4ad3e089\": container with ID starting with 13fb5b613b1e645e64a4c19e87641059dbc0beaed738ed921e20a38e4ad3e089 not found: ID does not exist" containerID="13fb5b613b1e645e64a4c19e87641059dbc0beaed738ed921e20a38e4ad3e089"
Jul 16 11:10:05.916418 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:10:05.916326    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"13fb5b613b1e645e64a4c19e87641059dbc0beaed738ed921e20a38e4ad3e089"} err="failed to get container status \"13fb5b613b1e645e64a4c19e87641059dbc0beaed738ed921e20a38e4ad3e089\": rpc error: code = NotFound desc = could not find container \"13fb5b613b1e645e64a4c19e87641059dbc0beaed738ed921e20a38e4ad3e089\": container with ID starting with 13fb5b613b1e645e64a4c19e87641059dbc0beaed738ed921e20a38e4ad3e089 not found: ID does not exist"
Jul 16 11:10:05.928443 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:10:05.928405    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-65978f8f75-jt6p5"]
Jul 16 11:10:05.931845 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:10:05.931816    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-65978f8f75-jt6p5"]
Jul 16 11:10:06.172887 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:10:06.172758    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/a6d30211-1115-44b6-b751-34ddc73cacbb-openshift-state-metrics-tls\") pod \"openshift-state-metrics-84bd68b896-gmzk4\" (UID: \"a6d30211-1115-44b6-b751-34ddc73cacbb\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-gmzk4"
Jul 16 11:10:06.175234 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:10:06.175209    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/a6d30211-1115-44b6-b751-34ddc73cacbb-openshift-state-metrics-tls\") pod \"openshift-state-metrics-84bd68b896-gmzk4\" (UID: \"a6d30211-1115-44b6-b751-34ddc73cacbb\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-gmzk4"
Jul 16 11:10:06.273518 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:10:06.273473    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/c02fa2f9-7be3-472b-8078-55cfc78a2be7-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-pwndd\" (UID: \"c02fa2f9-7be3-472b-8078-55cfc78a2be7\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-pwndd"
Jul 16 11:10:06.275965 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:10:06.275936    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/c02fa2f9-7be3-472b-8078-55cfc78a2be7-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-pwndd\" (UID: \"c02fa2f9-7be3-472b-8078-55cfc78a2be7\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-pwndd"
Jul 16 11:10:06.300477 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:10:06.300438    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3983837b-b29b-41d3-ab7f-2247c578e01f" path="/var/lib/kubelet/pods/3983837b-b29b-41d3-ab7f-2247c578e01f/volumes"
Jul 16 11:10:06.438825 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:10:06.438692    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-gmzk4"
Jul 16 11:10:06.469947 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:10:06.469903    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-785778ff74-pwndd"
Jul 16 11:10:06.584238 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:10:06.584208    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-84bd68b896-gmzk4"]
Jul 16 11:10:06.587535 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:10:06.587508    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda6d30211_1115_44b6_b751_34ddc73cacbb.slice/crio-6183e6758bd9f20eabc860f2521fbc9d2acdff6edd944cb2bff8985957ea6627 WatchSource:0}: Error finding container 6183e6758bd9f20eabc860f2521fbc9d2acdff6edd944cb2bff8985957ea6627: Status 404 returned error can't find the container with id 6183e6758bd9f20eabc860f2521fbc9d2acdff6edd944cb2bff8985957ea6627
Jul 16 11:10:06.615270 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:10:06.615235    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-785778ff74-pwndd"]
Jul 16 11:10:06.618614 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:10:06.618587    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc02fa2f9_7be3_472b_8078_55cfc78a2be7.slice/crio-31db3bf12fdbdd1b1fbb8bf2ca7543a54b233038aed054ba9f4b6603da2737ad WatchSource:0}: Error finding container 31db3bf12fdbdd1b1fbb8bf2ca7543a54b233038aed054ba9f4b6603da2737ad: Status 404 returned error can't find the container with id 31db3bf12fdbdd1b1fbb8bf2ca7543a54b233038aed054ba9f4b6603da2737ad
Jul 16 11:10:06.914515 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:10:06.914477    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-gmzk4" event={"ID":"a6d30211-1115-44b6-b751-34ddc73cacbb","Type":"ContainerStarted","Data":"7c22e938e8755c13d3df8c0e7bfc1b988ad2a0ead9997465d80b14164dfc32d9"}
Jul 16 11:10:06.915011 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:10:06.914551    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-gmzk4" event={"ID":"a6d30211-1115-44b6-b751-34ddc73cacbb","Type":"ContainerStarted","Data":"96bb4258e455e5fcb01f381381627ac1c724ec64e55a26253a981fea828a97d0"}
Jul 16 11:10:06.915011 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:10:06.914580    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-gmzk4" event={"ID":"a6d30211-1115-44b6-b751-34ddc73cacbb","Type":"ContainerStarted","Data":"6183e6758bd9f20eabc860f2521fbc9d2acdff6edd944cb2bff8985957ea6627"}
Jul 16 11:10:06.916940 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:10:06.916909    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-pwndd" event={"ID":"c02fa2f9-7be3-472b-8078-55cfc78a2be7","Type":"ContainerStarted","Data":"31db3bf12fdbdd1b1fbb8bf2ca7543a54b233038aed054ba9f4b6603da2737ad"}
Jul 16 11:10:07.117075 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:10:07.117036    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:10:07.182465 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:10:07.182423    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:10:07.432632 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:10:07.432595    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-77495844f8-bq7n5"]
Jul 16 11:10:07.439515 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:10:07.439484    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-77495844f8-bq7n5"
Jul 16 11:10:07.441898 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:10:07.441867    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Jul 16 11:10:07.442044 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:10:07.441920    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Jul 16 11:10:07.442112 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:10:07.442062    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Jul 16 11:10:07.442192 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:10:07.442164    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-ckmsl\""
Jul 16 11:10:07.442861 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:10:07.442361    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Jul 16 11:10:07.442861 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:10:07.442566    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-1o1j6cp2rk196\""
Jul 16 11:10:07.443018 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:10:07.442909    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Jul 16 11:10:07.448961 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:10:07.448936    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-77495844f8-bq7n5"]
Jul 16 11:10:07.481488 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:10:07.481450    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/8da55f62-7482-48e9-aeb8-107b1b8cef69-secret-grpc-tls\") pod \"thanos-querier-77495844f8-bq7n5\" (UID: \"8da55f62-7482-48e9-aeb8-107b1b8cef69\") " pod="openshift-monitoring/thanos-querier-77495844f8-bq7n5"
Jul 16 11:10:07.481488 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:10:07.481488    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/8da55f62-7482-48e9-aeb8-107b1b8cef69-secret-thanos-querier-tls\") pod \"thanos-querier-77495844f8-bq7n5\" (UID: \"8da55f62-7482-48e9-aeb8-107b1b8cef69\") " pod="openshift-monitoring/thanos-querier-77495844f8-bq7n5"
Jul 16 11:10:07.481736 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:10:07.481515    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/8da55f62-7482-48e9-aeb8-107b1b8cef69-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-77495844f8-bq7n5\" (UID: \"8da55f62-7482-48e9-aeb8-107b1b8cef69\") " pod="openshift-monitoring/thanos-querier-77495844f8-bq7n5"
Jul 16 11:10:07.481736 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:10:07.481587    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8da55f62-7482-48e9-aeb8-107b1b8cef69-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-77495844f8-bq7n5\" (UID: \"8da55f62-7482-48e9-aeb8-107b1b8cef69\") " pod="openshift-monitoring/thanos-querier-77495844f8-bq7n5"
Jul 16 11:10:07.481736 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:10:07.481644    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8da55f62-7482-48e9-aeb8-107b1b8cef69-metrics-client-ca\") pod \"thanos-querier-77495844f8-bq7n5\" (UID: \"8da55f62-7482-48e9-aeb8-107b1b8cef69\") " pod="openshift-monitoring/thanos-querier-77495844f8-bq7n5"
Jul 16 11:10:07.481736 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:10:07.481716    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8lxk5\" (UniqueName: \"kubernetes.io/projected/8da55f62-7482-48e9-aeb8-107b1b8cef69-kube-api-access-8lxk5\") pod \"thanos-querier-77495844f8-bq7n5\" (UID: \"8da55f62-7482-48e9-aeb8-107b1b8cef69\") " pod="openshift-monitoring/thanos-querier-77495844f8-bq7n5"
Jul 16 11:10:07.482066 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:10:07.481749    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8da55f62-7482-48e9-aeb8-107b1b8cef69-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-77495844f8-bq7n5\" (UID: \"8da55f62-7482-48e9-aeb8-107b1b8cef69\") " pod="openshift-monitoring/thanos-querier-77495844f8-bq7n5"
Jul 16 11:10:07.482066 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:10:07.481796    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/8da55f62-7482-48e9-aeb8-107b1b8cef69-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-77495844f8-bq7n5\" (UID: \"8da55f62-7482-48e9-aeb8-107b1b8cef69\") " pod="openshift-monitoring/thanos-querier-77495844f8-bq7n5"
Jul 16 11:10:07.583086 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:10:07.583048    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/8da55f62-7482-48e9-aeb8-107b1b8cef69-secret-grpc-tls\") pod \"thanos-querier-77495844f8-bq7n5\" (UID: \"8da55f62-7482-48e9-aeb8-107b1b8cef69\") " pod="openshift-monitoring/thanos-querier-77495844f8-bq7n5"
Jul 16 11:10:07.583288 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:10:07.583098    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/8da55f62-7482-48e9-aeb8-107b1b8cef69-secret-thanos-querier-tls\") pod \"thanos-querier-77495844f8-bq7n5\" (UID: \"8da55f62-7482-48e9-aeb8-107b1b8cef69\") " pod="openshift-monitoring/thanos-querier-77495844f8-bq7n5"
Jul 16 11:10:07.583288 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:10:07.583131    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/8da55f62-7482-48e9-aeb8-107b1b8cef69-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-77495844f8-bq7n5\" (UID: \"8da55f62-7482-48e9-aeb8-107b1b8cef69\") " pod="openshift-monitoring/thanos-querier-77495844f8-bq7n5"
Jul 16 11:10:07.583288 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:10:07.583151    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8da55f62-7482-48e9-aeb8-107b1b8cef69-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-77495844f8-bq7n5\" (UID: \"8da55f62-7482-48e9-aeb8-107b1b8cef69\") " pod="openshift-monitoring/thanos-querier-77495844f8-bq7n5"
Jul 16 11:10:07.583288 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:10:07.583173    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8da55f62-7482-48e9-aeb8-107b1b8cef69-metrics-client-ca\") pod \"thanos-querier-77495844f8-bq7n5\" (UID: \"8da55f62-7482-48e9-aeb8-107b1b8cef69\") " pod="openshift-monitoring/thanos-querier-77495844f8-bq7n5"
Jul 16 11:10:07.583288 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:10:07.583217    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8lxk5\" (UniqueName: \"kubernetes.io/projected/8da55f62-7482-48e9-aeb8-107b1b8cef69-kube-api-access-8lxk5\") pod \"thanos-querier-77495844f8-bq7n5\" (UID: \"8da55f62-7482-48e9-aeb8-107b1b8cef69\") " pod="openshift-monitoring/thanos-querier-77495844f8-bq7n5"
Jul 16 11:10:07.583288 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:10:07.583237    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8da55f62-7482-48e9-aeb8-107b1b8cef69-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-77495844f8-bq7n5\" (UID: \"8da55f62-7482-48e9-aeb8-107b1b8cef69\") " pod="openshift-monitoring/thanos-querier-77495844f8-bq7n5"
Jul 16 11:10:07.583288 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:10:07.583265    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/8da55f62-7482-48e9-aeb8-107b1b8cef69-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-77495844f8-bq7n5\" (UID: \"8da55f62-7482-48e9-aeb8-107b1b8cef69\") " pod="openshift-monitoring/thanos-querier-77495844f8-bq7n5"
Jul 16 11:10:07.584219 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:10:07.584153    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8da55f62-7482-48e9-aeb8-107b1b8cef69-metrics-client-ca\") pod \"thanos-querier-77495844f8-bq7n5\" (UID: \"8da55f62-7482-48e9-aeb8-107b1b8cef69\") " pod="openshift-monitoring/thanos-querier-77495844f8-bq7n5"
Jul 16 11:10:07.586402 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:10:07.586344    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/8da55f62-7482-48e9-aeb8-107b1b8cef69-secret-thanos-querier-tls\") pod \"thanos-querier-77495844f8-bq7n5\" (UID: \"8da55f62-7482-48e9-aeb8-107b1b8cef69\") " pod="openshift-monitoring/thanos-querier-77495844f8-bq7n5"
Jul 16 11:10:07.586402 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:10:07.586376    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/8da55f62-7482-48e9-aeb8-107b1b8cef69-secret-grpc-tls\") pod \"thanos-querier-77495844f8-bq7n5\" (UID: \"8da55f62-7482-48e9-aeb8-107b1b8cef69\") " pod="openshift-monitoring/thanos-querier-77495844f8-bq7n5"
Jul 16 11:10:07.586829 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:10:07.586800    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8da55f62-7482-48e9-aeb8-107b1b8cef69-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-77495844f8-bq7n5\" (UID: \"8da55f62-7482-48e9-aeb8-107b1b8cef69\") " pod="openshift-monitoring/thanos-querier-77495844f8-bq7n5"
Jul 16 11:10:07.586933 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:10:07.586886    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/8da55f62-7482-48e9-aeb8-107b1b8cef69-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-77495844f8-bq7n5\" (UID: \"8da55f62-7482-48e9-aeb8-107b1b8cef69\") " pod="openshift-monitoring/thanos-querier-77495844f8-bq7n5"
Jul 16 11:10:07.587020 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:10:07.586994    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/8da55f62-7482-48e9-aeb8-107b1b8cef69-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-77495844f8-bq7n5\" (UID: \"8da55f62-7482-48e9-aeb8-107b1b8cef69\") " pod="openshift-monitoring/thanos-querier-77495844f8-bq7n5"
Jul 16 11:10:07.587131 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:10:07.587116    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8da55f62-7482-48e9-aeb8-107b1b8cef69-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-77495844f8-bq7n5\" (UID: \"8da55f62-7482-48e9-aeb8-107b1b8cef69\") " pod="openshift-monitoring/thanos-querier-77495844f8-bq7n5"
Jul 16 11:10:07.591719 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:10:07.591691    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8lxk5\" (UniqueName: \"kubernetes.io/projected/8da55f62-7482-48e9-aeb8-107b1b8cef69-kube-api-access-8lxk5\") pod \"thanos-querier-77495844f8-bq7n5\" (UID: \"8da55f62-7482-48e9-aeb8-107b1b8cef69\") " pod="openshift-monitoring/thanos-querier-77495844f8-bq7n5"
Jul 16 11:10:07.751723 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:10:07.751678    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-77495844f8-bq7n5"
Jul 16 11:10:07.923812 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:10:07.923757    2564 generic.go:356] "Generic (PLEG): container finished" podID="92d26de8-4fb0-4807-917c-bbad2af89377" containerID="6f195187bff09064188b8da8822bfe7012bf767c0338f1b74d89e92d51be82d2" exitCode=0
Jul 16 11:10:07.924228 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:10:07.923823    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-45594" event={"ID":"92d26de8-4fb0-4807-917c-bbad2af89377","Type":"ContainerDied","Data":"6f195187bff09064188b8da8822bfe7012bf767c0338f1b74d89e92d51be82d2"}
Jul 16 11:10:07.985399 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:10:07.985372    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-77495844f8-bq7n5"]
Jul 16 11:10:07.989603 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:10:07.989574    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8da55f62_7482_48e9_aeb8_107b1b8cef69.slice/crio-3c8ebd1d3c83fafda1a1f3a43712ed41a473a1ea4d8d051a4f9a62bb9610bd21 WatchSource:0}: Error finding container 3c8ebd1d3c83fafda1a1f3a43712ed41a473a1ea4d8d051a4f9a62bb9610bd21: Status 404 returned error can't find the container with id 3c8ebd1d3c83fafda1a1f3a43712ed41a473a1ea4d8d051a4f9a62bb9610bd21
Jul 16 11:10:08.431927 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:10:08.431831    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:10:08.930377 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:10:08.930328    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-77495844f8-bq7n5" event={"ID":"8da55f62-7482-48e9-aeb8-107b1b8cef69","Type":"ContainerStarted","Data":"3c8ebd1d3c83fafda1a1f3a43712ed41a473a1ea4d8d051a4f9a62bb9610bd21"}
Jul 16 11:10:08.933381 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:10:08.933328    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-gmzk4" event={"ID":"a6d30211-1115-44b6-b751-34ddc73cacbb","Type":"ContainerStarted","Data":"3cb05ca83b0d65d1b2b7689e8c27c2f2935a680b5c8fd51784c9d0a395654d45"}
Jul 16 11:10:08.935764 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:10:08.935723    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-45594" event={"ID":"92d26de8-4fb0-4807-917c-bbad2af89377","Type":"ContainerStarted","Data":"0c3c0408322301cbf4d3d85c4f135560064e064a3e19a4f577c691ff75b7d2e6"}
Jul 16 11:10:08.935939 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:10:08.935805    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-45594" event={"ID":"92d26de8-4fb0-4807-917c-bbad2af89377","Type":"ContainerStarted","Data":"e4ad00b3b362627e45dd7840523b5297492307d209d8be3da94dd9a38c1cad69"}
Jul 16 11:10:08.973192 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:10:08.973140    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-gmzk4" podStartSLOduration=2.840947284 podStartE2EDuration="3.973122656s" totalImagesPullingTime="1.132175372s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 11:10:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 11:10:08.972579155 +0000 UTC m=+109.344116190" watchObservedRunningTime="2026-07-16 11:10:08.973122656 +0000 UTC m=+109.344659692"
Jul 16 11:10:08.994290 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:10:08.994228    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-45594" podStartSLOduration=2.555467019 podStartE2EDuration="3.994205288s" totalImagesPullingTime="1.369354341s" totalInitContainerRuntime="69.383928ms" isStatefulPod=true podCreationTimestamp="2026-07-16 11:10:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 11:10:08.992869038 +0000 UTC m=+109.364406098" watchObservedRunningTime="2026-07-16 11:10:08.994205288 +0000 UTC m=+109.365742323"
Jul 16 11:10:09.944948 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:10:09.944912    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-69d8fcdb9b-mwqgc"]
Jul 16 11:10:09.947437 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:10:09.947410    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-69d8fcdb9b-mwqgc"
Jul 16 11:10:09.949841 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:10:09.949814    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
Jul 16 11:10:09.950978 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:10:09.950951    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
Jul 16 11:10:09.951411 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:10:09.951387    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
Jul 16 11:10:09.951544 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:10:09.951474    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-36t0au963ceid\""
Jul 16 11:10:09.951610 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:10:09.951474    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 16 11:10:09.951668 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:10:09.951396    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-sh9zl\""
Jul 16 11:10:09.968969 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:10:09.967331    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-69d8fcdb9b-mwqgc"]
Jul 16 11:10:10.003382 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:10:10.003338    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e5c2f73c-e790-4b49-a742-dc3a5904de50-client-ca-bundle\") pod \"metrics-server-69d8fcdb9b-mwqgc\" (UID: \"e5c2f73c-e790-4b49-a742-dc3a5904de50\") " pod="openshift-monitoring/metrics-server-69d8fcdb9b-mwqgc"
Jul 16 11:10:10.003583 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:10:10.003404    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/e5c2f73c-e790-4b49-a742-dc3a5904de50-audit-log\") pod \"metrics-server-69d8fcdb9b-mwqgc\" (UID: \"e5c2f73c-e790-4b49-a742-dc3a5904de50\") " pod="openshift-monitoring/metrics-server-69d8fcdb9b-mwqgc"
Jul 16 11:10:10.003583 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:10:10.003468    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e5c2f73c-e790-4b49-a742-dc3a5904de50-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-69d8fcdb9b-mwqgc\" (UID: \"e5c2f73c-e790-4b49-a742-dc3a5904de50\") " pod="openshift-monitoring/metrics-server-69d8fcdb9b-mwqgc"
Jul 16 11:10:10.003583 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:10:10.003546    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/e5c2f73c-e790-4b49-a742-dc3a5904de50-secret-metrics-server-tls\") pod \"metrics-server-69d8fcdb9b-mwqgc\" (UID: \"e5c2f73c-e790-4b49-a742-dc3a5904de50\") " pod="openshift-monitoring/metrics-server-69d8fcdb9b-mwqgc"
Jul 16 11:10:10.004046 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:10:10.003758    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/e5c2f73c-e790-4b49-a742-dc3a5904de50-secret-metrics-server-client-certs\") pod \"metrics-server-69d8fcdb9b-mwqgc\" (UID: \"e5c2f73c-e790-4b49-a742-dc3a5904de50\") " pod="openshift-monitoring/metrics-server-69d8fcdb9b-mwqgc"
Jul 16 11:10:10.004046 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:10:10.003958    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/e5c2f73c-e790-4b49-a742-dc3a5904de50-metrics-server-audit-profiles\") pod \"metrics-server-69d8fcdb9b-mwqgc\" (UID: \"e5c2f73c-e790-4b49-a742-dc3a5904de50\") " pod="openshift-monitoring/metrics-server-69d8fcdb9b-mwqgc"
Jul 16 11:10:10.004046 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:10:10.003991    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hs2f2\" (UniqueName: \"kubernetes.io/projected/e5c2f73c-e790-4b49-a742-dc3a5904de50-kube-api-access-hs2f2\") pod \"metrics-server-69d8fcdb9b-mwqgc\" (UID: \"e5c2f73c-e790-4b49-a742-dc3a5904de50\") " pod="openshift-monitoring/metrics-server-69d8fcdb9b-mwqgc"
Jul 16 11:10:10.105001 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:10:10.104962    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/e5c2f73c-e790-4b49-a742-dc3a5904de50-audit-log\") pod \"metrics-server-69d8fcdb9b-mwqgc\" (UID: \"e5c2f73c-e790-4b49-a742-dc3a5904de50\") " pod="openshift-monitoring/metrics-server-69d8fcdb9b-mwqgc"
Jul 16 11:10:10.105189 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:10:10.105011    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e5c2f73c-e790-4b49-a742-dc3a5904de50-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-69d8fcdb9b-mwqgc\" (UID: \"e5c2f73c-e790-4b49-a742-dc3a5904de50\") " pod="openshift-monitoring/metrics-server-69d8fcdb9b-mwqgc"
Jul 16 11:10:10.105189 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:10:10.105052    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/e5c2f73c-e790-4b49-a742-dc3a5904de50-secret-metrics-server-tls\") pod \"metrics-server-69d8fcdb9b-mwqgc\" (UID: \"e5c2f73c-e790-4b49-a742-dc3a5904de50\") " pod="openshift-monitoring/metrics-server-69d8fcdb9b-mwqgc"
Jul 16 11:10:10.105189 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:10:10.105094    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/e5c2f73c-e790-4b49-a742-dc3a5904de50-secret-metrics-server-client-certs\") pod \"metrics-server-69d8fcdb9b-mwqgc\" (UID: \"e5c2f73c-e790-4b49-a742-dc3a5904de50\") " pod="openshift-monitoring/metrics-server-69d8fcdb9b-mwqgc"
Jul 16 11:10:10.105189 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:10:10.105157    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/e5c2f73c-e790-4b49-a742-dc3a5904de50-metrics-server-audit-profiles\") pod \"metrics-server-69d8fcdb9b-mwqgc\" (UID: \"e5c2f73c-e790-4b49-a742-dc3a5904de50\") " pod="openshift-monitoring/metrics-server-69d8fcdb9b-mwqgc"
Jul 16 11:10:10.105189 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:10:10.105187    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hs2f2\" (UniqueName: \"kubernetes.io/projected/e5c2f73c-e790-4b49-a742-dc3a5904de50-kube-api-access-hs2f2\") pod \"metrics-server-69d8fcdb9b-mwqgc\" (UID: \"e5c2f73c-e790-4b49-a742-dc3a5904de50\") " pod="openshift-monitoring/metrics-server-69d8fcdb9b-mwqgc"
Jul 16 11:10:10.105444 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:10:10.105230    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e5c2f73c-e790-4b49-a742-dc3a5904de50-client-ca-bundle\") pod \"metrics-server-69d8fcdb9b-mwqgc\" (UID: \"e5c2f73c-e790-4b49-a742-dc3a5904de50\") " pod="openshift-monitoring/metrics-server-69d8fcdb9b-mwqgc"
Jul 16 11:10:10.105498 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:10:10.105454    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/e5c2f73c-e790-4b49-a742-dc3a5904de50-audit-log\") pod \"metrics-server-69d8fcdb9b-mwqgc\" (UID: \"e5c2f73c-e790-4b49-a742-dc3a5904de50\") " pod="openshift-monitoring/metrics-server-69d8fcdb9b-mwqgc"
Jul 16 11:10:10.105974 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:10:10.105919    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e5c2f73c-e790-4b49-a742-dc3a5904de50-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-69d8fcdb9b-mwqgc\" (UID: \"e5c2f73c-e790-4b49-a742-dc3a5904de50\") " pod="openshift-monitoring/metrics-server-69d8fcdb9b-mwqgc"
Jul 16 11:10:10.106232 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:10:10.106207    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/e5c2f73c-e790-4b49-a742-dc3a5904de50-metrics-server-audit-profiles\") pod \"metrics-server-69d8fcdb9b-mwqgc\" (UID: \"e5c2f73c-e790-4b49-a742-dc3a5904de50\") " pod="openshift-monitoring/metrics-server-69d8fcdb9b-mwqgc"
Jul 16 11:10:10.108064 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:10:10.108031    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/e5c2f73c-e790-4b49-a742-dc3a5904de50-secret-metrics-server-tls\") pod \"metrics-server-69d8fcdb9b-mwqgc\" (UID: \"e5c2f73c-e790-4b49-a742-dc3a5904de50\") " pod="openshift-monitoring/metrics-server-69d8fcdb9b-mwqgc"
Jul 16 11:10:10.108189 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:10:10.108092    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/e5c2f73c-e790-4b49-a742-dc3a5904de50-secret-metrics-server-client-certs\") pod \"metrics-server-69d8fcdb9b-mwqgc\" (UID: \"e5c2f73c-e790-4b49-a742-dc3a5904de50\") " pod="openshift-monitoring/metrics-server-69d8fcdb9b-mwqgc"
Jul 16 11:10:10.108599 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:10:10.108578    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e5c2f73c-e790-4b49-a742-dc3a5904de50-client-ca-bundle\") pod \"metrics-server-69d8fcdb9b-mwqgc\" (UID: \"e5c2f73c-e790-4b49-a742-dc3a5904de50\") " pod="openshift-monitoring/metrics-server-69d8fcdb9b-mwqgc"
Jul 16 11:10:10.114237 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:10:10.114206    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hs2f2\" (UniqueName: \"kubernetes.io/projected/e5c2f73c-e790-4b49-a742-dc3a5904de50-kube-api-access-hs2f2\") pod \"metrics-server-69d8fcdb9b-mwqgc\" (UID: \"e5c2f73c-e790-4b49-a742-dc3a5904de50\") " pod="openshift-monitoring/metrics-server-69d8fcdb9b-mwqgc"
Jul 16 11:10:10.170317 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:10:10.170281    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:10:10.259559 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:10:10.259535    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-5f68df7f58-jp2z8"]
Jul 16 11:10:10.260438 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:10:10.260372    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-69d8fcdb9b-mwqgc"
Jul 16 11:10:10.261891 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:10:10.261865    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-jp2z8"
Jul 16 11:10:10.264048 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:10:10.264018    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Jul 16 11:10:10.264212 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:10:10.264133    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-7wlgk\""
Jul 16 11:10:10.275612 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:10:10.275584    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5f68df7f58-jp2z8"]
Jul 16 11:10:10.306789 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:10:10.306718    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ql72k\" (UniqueName: \"kubernetes.io/projected/cd047922-7440-486d-9239-4d2a05c98761-kube-api-access-ql72k\") pod \"monitoring-plugin-5f68df7f58-jp2z8\" (UID: \"cd047922-7440-486d-9239-4d2a05c98761\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-jp2z8"
Jul 16 11:10:10.307018 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:10:10.306806    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/cd047922-7440-486d-9239-4d2a05c98761-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-jp2z8\" (UID: \"cd047922-7440-486d-9239-4d2a05c98761\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-jp2z8"
Jul 16 11:10:10.402491 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:10:10.402443    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:10:10.407688 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:10:10.407658    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ql72k\" (UniqueName: \"kubernetes.io/projected/cd047922-7440-486d-9239-4d2a05c98761-kube-api-access-ql72k\") pod \"monitoring-plugin-5f68df7f58-jp2z8\" (UID: \"cd047922-7440-486d-9239-4d2a05c98761\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-jp2z8"
Jul 16 11:10:10.407892 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:10:10.407714    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/cd047922-7440-486d-9239-4d2a05c98761-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-jp2z8\" (UID: \"cd047922-7440-486d-9239-4d2a05c98761\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-jp2z8"
Jul 16 11:10:10.407965 ip-10-0-135-184 kubenswrapper[2564]: E0716 11:10:10.407924    2564 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found
Jul 16 11:10:10.408060 ip-10-0-135-184 kubenswrapper[2564]: E0716 11:10:10.408044    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cd047922-7440-486d-9239-4d2a05c98761-monitoring-plugin-cert podName:cd047922-7440-486d-9239-4d2a05c98761 nodeName:}" failed. No retries permitted until 2026-07-16 11:10:10.907999786 +0000 UTC m=+111.279536813 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/cd047922-7440-486d-9239-4d2a05c98761-monitoring-plugin-cert") pod "monitoring-plugin-5f68df7f58-jp2z8" (UID: "cd047922-7440-486d-9239-4d2a05c98761") : secret "monitoring-plugin-cert" not found
Jul 16 11:10:10.437115 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:10:10.437091    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ql72k\" (UniqueName: \"kubernetes.io/projected/cd047922-7440-486d-9239-4d2a05c98761-kube-api-access-ql72k\") pod \"monitoring-plugin-5f68df7f58-jp2z8\" (UID: \"cd047922-7440-486d-9239-4d2a05c98761\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-jp2z8"
Jul 16 11:10:10.487504 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:10:10.487427    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode5c2f73c_e790_4b49_a742_dc3a5904de50.slice/crio-464ed3e308a50e50ca148676d61134f71b01e2e7e0439367b64d10fec6819c76 WatchSource:0}: Error finding container 464ed3e308a50e50ca148676d61134f71b01e2e7e0439367b64d10fec6819c76: Status 404 returned error can't find the container with id 464ed3e308a50e50ca148676d61134f71b01e2e7e0439367b64d10fec6819c76
Jul 16 11:10:10.493610 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:10:10.493500    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-69d8fcdb9b-mwqgc"]
Jul 16 11:10:10.546649 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:10:10.545795    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:10:10.641101 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:10:10.641060    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:10:10.734783 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:10:10.734722    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:10:10.913066 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:10:10.913011    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/cd047922-7440-486d-9239-4d2a05c98761-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-jp2z8\" (UID: \"cd047922-7440-486d-9239-4d2a05c98761\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-jp2z8"
Jul 16 11:10:10.915491 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:10:10.915466    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/cd047922-7440-486d-9239-4d2a05c98761-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-jp2z8\" (UID: \"cd047922-7440-486d-9239-4d2a05c98761\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-jp2z8"
Jul 16 11:10:10.945804 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:10:10.945749    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-69d8fcdb9b-mwqgc" event={"ID":"e5c2f73c-e790-4b49-a742-dc3a5904de50","Type":"ContainerStarted","Data":"464ed3e308a50e50ca148676d61134f71b01e2e7e0439367b64d10fec6819c76"}
Jul 16 11:10:10.948747 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:10:10.948475    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-pwndd" event={"ID":"c02fa2f9-7be3-472b-8078-55cfc78a2be7","Type":"ContainerStarted","Data":"f4a37f48fa90410aebfa9de82191c6770a882d7b58becb7b8c4255926c8cb638"}
Jul 16 11:10:10.948940 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:10:10.948804    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-pwndd" event={"ID":"c02fa2f9-7be3-472b-8078-55cfc78a2be7","Type":"ContainerStarted","Data":"e5483fbf420391d4de6d090883800ba2b6575e310581ab44887a97a570107b3b"}
Jul 16 11:10:10.948940 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:10:10.948835    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-pwndd" event={"ID":"c02fa2f9-7be3-472b-8078-55cfc78a2be7","Type":"ContainerStarted","Data":"1bd4f21ab72c040d4756ec2712d6b3a0bd2133077bb39e5e2ee832d53b3d6508"}
Jul 16 11:10:10.950786 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:10:10.950752    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-77495844f8-bq7n5" event={"ID":"8da55f62-7482-48e9-aeb8-107b1b8cef69","Type":"ContainerStarted","Data":"6dbf677c96a5a38ee79fd9330f98e245f119db6cd9747b0552bd6c185d2d5669"}
Jul 16 11:10:10.950901 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:10:10.950830    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-77495844f8-bq7n5" event={"ID":"8da55f62-7482-48e9-aeb8-107b1b8cef69","Type":"ContainerStarted","Data":"d6dc69804c547d3897eb50ccf3e615f50db922011972ce277f389bfea870241b"}
Jul 16 11:10:10.950901 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:10:10.950856    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-77495844f8-bq7n5" event={"ID":"8da55f62-7482-48e9-aeb8-107b1b8cef69","Type":"ContainerStarted","Data":"3cc67e868670af52185c3bcffdfc45e65bb8cfee6811db6b88d60b83b0f31c6f"}
Jul 16 11:10:10.971448 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:10:10.971386    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-785778ff74-pwndd" podStartSLOduration=2.354056126 podStartE2EDuration="5.971363172s" totalImagesPullingTime="3.617307046s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 11:10:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 11:10:10.970025277 +0000 UTC m=+111.341562313" watchObservedRunningTime="2026-07-16 11:10:10.971363172 +0000 UTC m=+111.342900211"
Jul 16 11:10:11.212094 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:10:11.211998    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-jp2z8"
Jul 16 11:10:11.375828 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:10:11.375792    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5f68df7f58-jp2z8"]
Jul 16 11:10:11.379580 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:10:11.379552    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcd047922_7440_486d_9239_4d2a05c98761.slice/crio-9dc825eee22ad840ecb33051a0b9be50a5efd56ef24599e10058cf5a624fde60 WatchSource:0}: Error finding container 9dc825eee22ad840ecb33051a0b9be50a5efd56ef24599e10058cf5a624fde60: Status 404 returned error can't find the container with id 9dc825eee22ad840ecb33051a0b9be50a5efd56ef24599e10058cf5a624fde60
Jul 16 11:10:11.746831 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:10:11.746691    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:10:11.960292 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:10:11.960247    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-jp2z8" event={"ID":"cd047922-7440-486d-9239-4d2a05c98761","Type":"ContainerStarted","Data":"9dc825eee22ad840ecb33051a0b9be50a5efd56ef24599e10058cf5a624fde60"}
Jul 16 11:10:11.962134 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:10:11.962063    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-69d8fcdb9b-mwqgc" event={"ID":"e5c2f73c-e790-4b49-a742-dc3a5904de50","Type":"ContainerStarted","Data":"c326e0dfde46e96b1f4f3cd88dfe1f9dfaa271b34e0ba41a6a00f56da6b93dc2"}
Jul 16 11:10:11.983672 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:10:11.983595    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-69d8fcdb9b-mwqgc" podStartSLOduration=1.651339139 podStartE2EDuration="2.983570354s" totalImagesPullingTime="1.332231215s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 11:10:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 11:10:11.982541196 +0000 UTC m=+112.354078251" watchObservedRunningTime="2026-07-16 11:10:11.983570354 +0000 UTC m=+112.355107385"
Jul 16 11:10:12.968485 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:10:12.968393    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-jp2z8" event={"ID":"cd047922-7440-486d-9239-4d2a05c98761","Type":"ContainerStarted","Data":"8cf533d8452043534046f75ceb346f35e26a2ec36b26b04f4779c4c380830307"}
Jul 16 11:10:12.968937 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:10:12.968637    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-jp2z8"
Jul 16 11:10:12.975212 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:10:12.975183    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-jp2z8"
Jul 16 11:10:12.984823 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:10:12.984742    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-jp2z8" podStartSLOduration=1.7105129049999999 podStartE2EDuration="2.984717399s" totalImagesPullingTime="1.274204494s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 11:10:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 11:10:12.983928571 +0000 UTC m=+113.355465627" watchObservedRunningTime="2026-07-16 11:10:12.984717399 +0000 UTC m=+113.356254438"
Jul 16 11:10:13.974967 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:10:13.974928    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-77495844f8-bq7n5" event={"ID":"8da55f62-7482-48e9-aeb8-107b1b8cef69","Type":"ContainerStarted","Data":"a2edf3384fd874bc3d2b4e494128dd80ee6e4989d01601032835ae09c1825d20"}
Jul 16 11:10:13.975431 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:10:13.974991    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-77495844f8-bq7n5" event={"ID":"8da55f62-7482-48e9-aeb8-107b1b8cef69","Type":"ContainerStarted","Data":"fcc07219c173c1b53d1c081d86b3ccf8646c660b92aa26ce54244bd7be953901"}
Jul 16 11:10:13.975431 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:10:13.975017    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-77495844f8-bq7n5" event={"ID":"8da55f62-7482-48e9-aeb8-107b1b8cef69","Type":"ContainerStarted","Data":"a090e78515836370c2ef50f0151c177b83ed9c634ca027a1183e97aa52ae93a2"}
Jul 16 11:10:14.006149 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:10:14.006086    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-77495844f8-bq7n5" podStartSLOduration=2.042953146 podStartE2EDuration="7.00606534s" totalImagesPullingTime="4.963112194s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 11:10:07 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 11:10:14.004497748 +0000 UTC m=+114.376034796" watchObservedRunningTime="2026-07-16 11:10:14.00606534 +0000 UTC m=+114.377602376"
Jul 16 11:10:14.978572 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:10:14.978529    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-77495844f8-bq7n5"
Jul 16 11:10:15.158603 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:10:15.158566    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:10:15.453242 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:10:15.453200    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:10:15.719460 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:10:15.719377    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:10:15.813268 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:10:15.813233    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:10:15.988114 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:10:15.988028    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-77495844f8-bq7n5"
Jul 16 11:10:16.176691 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:10:16.176653    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:10:16.247578 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:10:16.247461    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:10:17.990916 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:10:17.990879    2564 generic.go:356] "Generic (PLEG): container finished" podID="bb246ab5-caf3-4eef-b0fe-07e6f3d447b7" containerID="8ede4dbd574d9ffb77221bb309db8862cd0e6eb88c76a5114396da47c2014e29" exitCode=0
Jul 16 11:10:17.991267 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:10:17.990953    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-kmkpn" event={"ID":"bb246ab5-caf3-4eef-b0fe-07e6f3d447b7","Type":"ContainerDied","Data":"8ede4dbd574d9ffb77221bb309db8862cd0e6eb88c76a5114396da47c2014e29"}
Jul 16 11:10:17.991303 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:10:17.991282    2564 scope.go:117] "RemoveContainer" containerID="8ede4dbd574d9ffb77221bb309db8862cd0e6eb88c76a5114396da47c2014e29"
Jul 16 11:10:18.998640 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:10:18.998603    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-kmkpn" event={"ID":"bb246ab5-caf3-4eef-b0fe-07e6f3d447b7","Type":"ContainerStarted","Data":"d3ef163bc403e92131afbdadc3ed82ba577ea4dab73d59e87dd8532d5ad6a513"}
Jul 16 11:10:24.391716 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:10:24.391677    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:10:24.453582 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:10:24.453546    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:10:25.324543 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:10:25.324504    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:10:25.390112 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:10:25.390057    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:10:25.452642 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:10:25.452603    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:10:26.535615 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:10:26.535583    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:10:26.636955 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:10:26.636915    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:10:26.738412 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:10:26.738376    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:10:28.980586 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:10:28.980542    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/28bc7393-164f-4deb-89da-69443b46c55e-metrics-certs\") pod \"network-metrics-daemon-pxp5q\" (UID: \"28bc7393-164f-4deb-89da-69443b46c55e\") " pod="openshift-multus/network-metrics-daemon-pxp5q"
Jul 16 11:10:28.983006 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:10:28.982974    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/28bc7393-164f-4deb-89da-69443b46c55e-metrics-certs\") pod \"network-metrics-daemon-pxp5q\" (UID: \"28bc7393-164f-4deb-89da-69443b46c55e\") " pod="openshift-multus/network-metrics-daemon-pxp5q"
Jul 16 11:10:29.209107 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:10:29.209064    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-hjhcs\""
Jul 16 11:10:29.216386 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:10:29.216354    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pxp5q"
Jul 16 11:10:29.396230 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:10:29.396191    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-pxp5q"]
Jul 16 11:10:29.400459 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:10:29.400432    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod28bc7393_164f_4deb_89da_69443b46c55e.slice/crio-e56f4ddf5d0cff9fb1e2380dff2cbe440b9e4801e858eb4c9d3ebd8dbd9c2f37 WatchSource:0}: Error finding container e56f4ddf5d0cff9fb1e2380dff2cbe440b9e4801e858eb4c9d3ebd8dbd9c2f37: Status 404 returned error can't find the container with id e56f4ddf5d0cff9fb1e2380dff2cbe440b9e4801e858eb4c9d3ebd8dbd9c2f37
Jul 16 11:10:30.040915 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:10:30.040872    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-pxp5q" event={"ID":"28bc7393-164f-4deb-89da-69443b46c55e","Type":"ContainerStarted","Data":"e56f4ddf5d0cff9fb1e2380dff2cbe440b9e4801e858eb4c9d3ebd8dbd9c2f37"}
Jul 16 11:10:30.260550 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:10:30.260504    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-69d8fcdb9b-mwqgc"
Jul 16 11:10:30.260788 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:10:30.260580    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-69d8fcdb9b-mwqgc"
Jul 16 11:10:32.051057 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:10:32.051017    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-pxp5q" event={"ID":"28bc7393-164f-4deb-89da-69443b46c55e","Type":"ContainerStarted","Data":"a26f9fcdfb83aa44cb52f3f9025c41179017ce6559ba1d4f756918b0c579df2b"}
Jul 16 11:10:32.051568 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:10:32.051081    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-pxp5q" event={"ID":"28bc7393-164f-4deb-89da-69443b46c55e","Type":"ContainerStarted","Data":"397acdb257bb2ce50363fcaee5fd41fa648f2f2062f6b2b36cee8c6e3faa7b37"}
Jul 16 11:10:32.068590 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:10:32.068528    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-pxp5q" podStartSLOduration=130.074711965 podStartE2EDuration="2m12.068511676s" totalImagesPullingTime="1.993799711s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 11:08:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 11:10:32.067648223 +0000 UTC m=+132.439185260" watchObservedRunningTime="2026-07-16 11:10:32.068511676 +0000 UTC m=+132.440048711"
Jul 16 11:10:32.175542 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:10:32.175500    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:10:32.237157 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:10:32.237124    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:10:37.928634 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:10:37.928600    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7f4487f9c8-wnk66_13fa2ca5-b90c-46e7-92bc-7a8cb4c036a2/router/0.log"
Jul 16 11:10:37.935339 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:10:37.935308    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-6x8n4_57dd81c5-98a2-455f-bb65-4f35f1979846/serve-healthcheck-canary/0.log"
Jul 16 11:10:39.700837 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:10:39.700799    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:10:39.800648 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:10:39.800604    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:10:48.824966 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:10:48.824916    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:10:48.926604 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:10:48.926563    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:10:50.267400 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:10:50.267368    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-69d8fcdb9b-mwqgc"
Jul 16 11:10:50.272265 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:10:50.272234    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-69d8fcdb9b-mwqgc"
Jul 16 11:11:21.575130 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:11:21.575045    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:11:21.643788 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:11:21.643740    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:11:24.339988 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:11:24.339947    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:11:24.396725 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:11:24.396687    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:11:24.469286 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:11:24.469253    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:11:25.059023 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:11:25.058987    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:11:33.558189 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:11:33.558141    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:11:33.627397 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:11:33.627354    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:11:34.779923 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:11:34.779884    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:11:34.880648 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:11:34.880602    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:11:34.980349 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:11:34.980305    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:11:39.409062 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:11:39.409024    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:11:39.508916 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:11:39.508874    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:11:39.567903 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:11:39.567869    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:11:48.242099 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:11:48.242059    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:11:48.306717 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:11:48.306672    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:12:08.102207 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:12:08.102166    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:12:08.203044 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:12:08.202995    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:12:09.802606 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:12:09.802561    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:12:09.862033 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:12:09.861989    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:12:30.952898 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:12:30.952848    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:12:31.066124 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:12:31.066091    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5cd87596c7-8jp54"]
Jul 16 11:12:31.069558 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:12:31.069536    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5cd87596c7-8jp54"
Jul 16 11:12:31.071563 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:12:31.071537    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\""
Jul 16 11:12:31.071701 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:12:31.071583    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\""
Jul 16 11:12:31.072251 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:12:31.072234    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 16 11:12:31.072338 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:12:31.072249    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\""
Jul 16 11:12:31.072399 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:12:31.072350    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 16 11:12:31.072464 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:12:31.072448    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 16 11:12:31.072516 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:12:31.072470    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\""
Jul 16 11:12:31.083713 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:12:31.083689    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5cd87596c7-8jp54"]
Jul 16 11:12:31.109572 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:12:31.109535    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:12:31.186686 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:12:31.186653    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:12:31.202861 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:12:31.202828    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/656395a7-f0b7-414a-b416-6cdce728607d-hub\") pod \"cluster-proxy-proxy-agent-5cd87596c7-8jp54\" (UID: \"656395a7-f0b7-414a-b416-6cdce728607d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5cd87596c7-8jp54"
Jul 16 11:12:31.203039 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:12:31.202876    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/656395a7-f0b7-414a-b416-6cdce728607d-additional-service-ca\") pod \"cluster-proxy-proxy-agent-5cd87596c7-8jp54\" (UID: \"656395a7-f0b7-414a-b416-6cdce728607d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5cd87596c7-8jp54"
Jul 16 11:12:31.203039 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:12:31.202927    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/656395a7-f0b7-414a-b416-6cdce728607d-ca\") pod \"cluster-proxy-proxy-agent-5cd87596c7-8jp54\" (UID: \"656395a7-f0b7-414a-b416-6cdce728607d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5cd87596c7-8jp54"
Jul 16 11:12:31.203039 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:12:31.202979    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/656395a7-f0b7-414a-b416-6cdce728607d-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-5cd87596c7-8jp54\" (UID: \"656395a7-f0b7-414a-b416-6cdce728607d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5cd87596c7-8jp54"
Jul 16 11:12:31.203146 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:12:31.203042    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7svw2\" (UniqueName: \"kubernetes.io/projected/656395a7-f0b7-414a-b416-6cdce728607d-kube-api-access-7svw2\") pod \"cluster-proxy-proxy-agent-5cd87596c7-8jp54\" (UID: \"656395a7-f0b7-414a-b416-6cdce728607d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5cd87596c7-8jp54"
Jul 16 11:12:31.203146 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:12:31.203082    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/656395a7-f0b7-414a-b416-6cdce728607d-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-5cd87596c7-8jp54\" (UID: \"656395a7-f0b7-414a-b416-6cdce728607d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5cd87596c7-8jp54"
Jul 16 11:12:31.304221 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:12:31.304183    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/656395a7-f0b7-414a-b416-6cdce728607d-hub\") pod \"cluster-proxy-proxy-agent-5cd87596c7-8jp54\" (UID: \"656395a7-f0b7-414a-b416-6cdce728607d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5cd87596c7-8jp54"
Jul 16 11:12:31.304401 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:12:31.304229    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/656395a7-f0b7-414a-b416-6cdce728607d-additional-service-ca\") pod \"cluster-proxy-proxy-agent-5cd87596c7-8jp54\" (UID: \"656395a7-f0b7-414a-b416-6cdce728607d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5cd87596c7-8jp54"
Jul 16 11:12:31.304401 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:12:31.304251    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/656395a7-f0b7-414a-b416-6cdce728607d-ca\") pod \"cluster-proxy-proxy-agent-5cd87596c7-8jp54\" (UID: \"656395a7-f0b7-414a-b416-6cdce728607d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5cd87596c7-8jp54"
Jul 16 11:12:31.304401 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:12:31.304280    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/656395a7-f0b7-414a-b416-6cdce728607d-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-5cd87596c7-8jp54\" (UID: \"656395a7-f0b7-414a-b416-6cdce728607d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5cd87596c7-8jp54"
Jul 16 11:12:31.304401 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:12:31.304348    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7svw2\" (UniqueName: \"kubernetes.io/projected/656395a7-f0b7-414a-b416-6cdce728607d-kube-api-access-7svw2\") pod \"cluster-proxy-proxy-agent-5cd87596c7-8jp54\" (UID: \"656395a7-f0b7-414a-b416-6cdce728607d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5cd87596c7-8jp54"
Jul 16 11:12:31.304401 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:12:31.304375    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/656395a7-f0b7-414a-b416-6cdce728607d-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-5cd87596c7-8jp54\" (UID: \"656395a7-f0b7-414a-b416-6cdce728607d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5cd87596c7-8jp54"
Jul 16 11:12:31.305117 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:12:31.305090    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/656395a7-f0b7-414a-b416-6cdce728607d-additional-service-ca\") pod \"cluster-proxy-proxy-agent-5cd87596c7-8jp54\" (UID: \"656395a7-f0b7-414a-b416-6cdce728607d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5cd87596c7-8jp54"
Jul 16 11:12:31.306815 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:12:31.306792    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/656395a7-f0b7-414a-b416-6cdce728607d-hub\") pod \"cluster-proxy-proxy-agent-5cd87596c7-8jp54\" (UID: \"656395a7-f0b7-414a-b416-6cdce728607d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5cd87596c7-8jp54"
Jul 16 11:12:31.306815 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:12:31.306813    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/656395a7-f0b7-414a-b416-6cdce728607d-ca\") pod \"cluster-proxy-proxy-agent-5cd87596c7-8jp54\" (UID: \"656395a7-f0b7-414a-b416-6cdce728607d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5cd87596c7-8jp54"
Jul 16 11:12:31.307044 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:12:31.307023    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/656395a7-f0b7-414a-b416-6cdce728607d-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-5cd87596c7-8jp54\" (UID: \"656395a7-f0b7-414a-b416-6cdce728607d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5cd87596c7-8jp54"
Jul 16 11:12:31.307108 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:12:31.307095    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/656395a7-f0b7-414a-b416-6cdce728607d-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-5cd87596c7-8jp54\" (UID: \"656395a7-f0b7-414a-b416-6cdce728607d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5cd87596c7-8jp54"
Jul 16 11:12:31.312292 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:12:31.312273    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7svw2\" (UniqueName: \"kubernetes.io/projected/656395a7-f0b7-414a-b416-6cdce728607d-kube-api-access-7svw2\") pod \"cluster-proxy-proxy-agent-5cd87596c7-8jp54\" (UID: \"656395a7-f0b7-414a-b416-6cdce728607d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5cd87596c7-8jp54"
Jul 16 11:12:31.393361 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:12:31.393321    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5cd87596c7-8jp54"
Jul 16 11:12:31.529229 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:12:31.529129    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5cd87596c7-8jp54"]
Jul 16 11:12:31.532350 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:12:31.532277    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod656395a7_f0b7_414a_b416_6cdce728607d.slice/crio-7f963eb869eafb37274e3ca950dec51d701bf2258c7aca97cb2d48babed84dd5 WatchSource:0}: Error finding container 7f963eb869eafb37274e3ca950dec51d701bf2258c7aca97cb2d48babed84dd5: Status 404 returned error can't find the container with id 7f963eb869eafb37274e3ca950dec51d701bf2258c7aca97cb2d48babed84dd5
Jul 16 11:12:32.521812 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:12:32.521757    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5cd87596c7-8jp54" event={"ID":"656395a7-f0b7-414a-b416-6cdce728607d","Type":"ContainerStarted","Data":"7f963eb869eafb37274e3ca950dec51d701bf2258c7aca97cb2d48babed84dd5"}
Jul 16 11:12:35.537574 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:12:35.537542    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5cd87596c7-8jp54" event={"ID":"656395a7-f0b7-414a-b416-6cdce728607d","Type":"ContainerStarted","Data":"3361afba16b36cf425b82d2bd0f85b70365c9d53f1ca539fa9df87a233aa833e"}
Jul 16 11:12:35.537976 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:12:35.537582    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5cd87596c7-8jp54" event={"ID":"656395a7-f0b7-414a-b416-6cdce728607d","Type":"ContainerStarted","Data":"9259526e9bacefce49f9b3d3e7d3c26a26e59df47bfca045a9f351faf7492d9f"}
Jul 16 11:12:35.537976 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:12:35.537600    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5cd87596c7-8jp54" event={"ID":"656395a7-f0b7-414a-b416-6cdce728607d","Type":"ContainerStarted","Data":"5a57c371143b34a938eb1b97ebd6a3ac76cd17b995f58ac0c04f3fb900221637"}
Jul 16 11:12:35.556074 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:12:35.556024    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5cd87596c7-8jp54" podStartSLOduration=1.054410287 podStartE2EDuration="4.556008522s" totalImagesPullingTime="3.501598235s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 11:12:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 11:12:35.554655433 +0000 UTC m=+255.926192469" watchObservedRunningTime="2026-07-16 11:12:35.556008522 +0000 UTC m=+255.927545567"
Jul 16 11:12:50.281090 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:12:50.281047    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:12:50.407470 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:12:50.407429    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:13:05.141389 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:13:05.141340    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:13:17.795977 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:13:17.795941    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:13:18.227343 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:13:18.227249    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:13:20.078705 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:13:20.078676    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-lwmwf_4cb63124-522c-41e2-9d85-c2af29ac8eff/console-operator/1.log"
Jul 16 11:13:20.084486 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:13:20.084454    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-lwmwf_4cb63124-522c-41e2-9d85-c2af29ac8eff/console-operator/1.log"
Jul 16 11:13:20.087135 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:13:20.087104    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fchvw_aee7cbaf-a5e0-4e57-a9c1-504820f7f036/ovn-acl-logging/0.log"
Jul 16 11:13:20.090961 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:13:20.090800    2564 kubelet.go:1648] "Image garbage collection succeeded"
Jul 16 11:13:20.100392 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:13:20.100366    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fchvw_aee7cbaf-a5e0-4e57-a9c1-504820f7f036/ovn-acl-logging/0.log"
Jul 16 11:13:20.358932 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:13:20.358704    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-stjj6"]
Jul 16 11:13:20.361751 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:13:20.361728    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-stjj6"
Jul 16 11:13:20.366157 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:13:20.366116    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\""
Jul 16 11:13:20.366157 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:13:20.366127    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\""
Jul 16 11:13:20.366348 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:13:20.366256    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-phbhc\""
Jul 16 11:13:20.380716 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:13:20.380675    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-stjj6"]
Jul 16 11:13:20.408662 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:13:20.408613    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h29wc\" (UniqueName: \"kubernetes.io/projected/a9f24af7-d3fc-4ee1-a128-a51b11f58f54-kube-api-access-h29wc\") pod \"cert-manager-operator-controller-manager-55c444bf86-stjj6\" (UID: \"a9f24af7-d3fc-4ee1-a128-a51b11f58f54\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-stjj6"
Jul 16 11:13:20.408875 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:13:20.408683    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a9f24af7-d3fc-4ee1-a128-a51b11f58f54-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-stjj6\" (UID: \"a9f24af7-d3fc-4ee1-a128-a51b11f58f54\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-stjj6"
Jul 16 11:13:20.509703 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:13:20.509651    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h29wc\" (UniqueName: \"kubernetes.io/projected/a9f24af7-d3fc-4ee1-a128-a51b11f58f54-kube-api-access-h29wc\") pod \"cert-manager-operator-controller-manager-55c444bf86-stjj6\" (UID: \"a9f24af7-d3fc-4ee1-a128-a51b11f58f54\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-stjj6"
Jul 16 11:13:20.509703 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:13:20.509719    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a9f24af7-d3fc-4ee1-a128-a51b11f58f54-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-stjj6\" (UID: \"a9f24af7-d3fc-4ee1-a128-a51b11f58f54\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-stjj6"
Jul 16 11:13:20.510158 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:13:20.510132    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a9f24af7-d3fc-4ee1-a128-a51b11f58f54-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-stjj6\" (UID: \"a9f24af7-d3fc-4ee1-a128-a51b11f58f54\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-stjj6"
Jul 16 11:13:20.528606 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:13:20.528571    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h29wc\" (UniqueName: \"kubernetes.io/projected/a9f24af7-d3fc-4ee1-a128-a51b11f58f54-kube-api-access-h29wc\") pod \"cert-manager-operator-controller-manager-55c444bf86-stjj6\" (UID: \"a9f24af7-d3fc-4ee1-a128-a51b11f58f54\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-stjj6"
Jul 16 11:13:20.671141 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:13:20.671039    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-stjj6"
Jul 16 11:13:20.834804 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:13:20.834750    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-stjj6"]
Jul 16 11:13:20.838621 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:13:20.838592    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda9f24af7_d3fc_4ee1_a128_a51b11f58f54.slice/crio-ef256b5038f9bb8ebaf1bcdd0f76c813cab7ca6661c7910761608f19e6b248c5 WatchSource:0}: Error finding container ef256b5038f9bb8ebaf1bcdd0f76c813cab7ca6661c7910761608f19e6b248c5: Status 404 returned error can't find the container with id ef256b5038f9bb8ebaf1bcdd0f76c813cab7ca6661c7910761608f19e6b248c5
Jul 16 11:13:21.718792 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:13:21.718682    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-stjj6" event={"ID":"a9f24af7-d3fc-4ee1-a128-a51b11f58f54","Type":"ContainerStarted","Data":"ef256b5038f9bb8ebaf1bcdd0f76c813cab7ca6661c7910761608f19e6b248c5"}
Jul 16 11:13:22.035104 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:13:22.035063    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:13:22.165735 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:13:22.165694    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:13:23.729408 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:13:23.729369    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-stjj6" event={"ID":"a9f24af7-d3fc-4ee1-a128-a51b11f58f54","Type":"ContainerStarted","Data":"cc9db06c581e1c26e2718923660a156220a72039d81f651a25dc69d2ffa29f5b"}
Jul 16 11:13:23.770089 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:13:23.770033    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-stjj6" podStartSLOduration=1.528509881 podStartE2EDuration="3.7700127s" totalImagesPullingTime="2.241502819s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 11:13:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 11:13:23.768010465 +0000 UTC m=+304.139547520" watchObservedRunningTime="2026-07-16 11:13:23.7700127 +0000 UTC m=+304.141549736"
Jul 16 11:13:23.969370 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:13:23.969322    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:13:24.085355 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:13:24.085319    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:13:24.225482 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:13:24.225441    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:13:24.331232 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:13:24.331186    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:13:24.452306 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:13:24.452214    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:13:26.454533 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:13:26.454498    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:13:26.674275 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:13:26.674238    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:13:28.420017 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:13:28.419984    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:13:28.518285 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:13:28.518249    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:13:34.041919 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:13:34.041878    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:13:35.208815 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:13:35.208749    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:13:35.312119 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:13:35.312080    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:13:35.762620 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:13:35.762582    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:13:35.851868 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:13:35.851828    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:13:40.718893 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:13:40.718852    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:13:42.964534 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:13:42.964498    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:13:54.247096 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:13:54.247049    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:13:54.358449 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:13:54.358414    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:13:54.861757 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:13:54.861715    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:13:55.115313 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:13:55.115212    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:13:55.269896 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:13:55.269858    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:13:55.308968 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:13:55.308930    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5f8c4d5c89-v9wk9"]
Jul 16 11:13:55.312842 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:13:55.312812    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5f8c4d5c89-v9wk9"
Jul 16 11:13:55.318163 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:13:55.318133    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 16 11:13:55.318343 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:13:55.318171    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 16 11:13:55.318587 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:13:55.318566    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-8lh67\""
Jul 16 11:13:55.318587 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:13:55.318596    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 16 11:13:55.318917 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:13:55.318886    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 16 11:13:55.354312 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:13:55.354271    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5f8c4d5c89-v9wk9"]
Jul 16 11:13:55.410612 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:13:55.410506    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6f655f01-c2f4-44bc-aa68-f12f145f9839-tmp\") pod \"opendatahub-operator-controller-manager-5f8c4d5c89-v9wk9\" (UID: \"6f655f01-c2f4-44bc-aa68-f12f145f9839\") " pod="opendatahub/opendatahub-operator-controller-manager-5f8c4d5c89-v9wk9"
Jul 16 11:13:55.410612 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:13:55.410565    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/6f655f01-c2f4-44bc-aa68-f12f145f9839-manifests\") pod \"opendatahub-operator-controller-manager-5f8c4d5c89-v9wk9\" (UID: \"6f655f01-c2f4-44bc-aa68-f12f145f9839\") " pod="opendatahub/opendatahub-operator-controller-manager-5f8c4d5c89-v9wk9"
Jul 16 11:13:55.410912 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:13:55.410674    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bnf8m\" (UniqueName: \"kubernetes.io/projected/6f655f01-c2f4-44bc-aa68-f12f145f9839-kube-api-access-bnf8m\") pod \"opendatahub-operator-controller-manager-5f8c4d5c89-v9wk9\" (UID: \"6f655f01-c2f4-44bc-aa68-f12f145f9839\") " pod="opendatahub/opendatahub-operator-controller-manager-5f8c4d5c89-v9wk9"
Jul 16 11:13:55.410912 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:13:55.410748    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6f655f01-c2f4-44bc-aa68-f12f145f9839-webhook-cert\") pod \"opendatahub-operator-controller-manager-5f8c4d5c89-v9wk9\" (UID: \"6f655f01-c2f4-44bc-aa68-f12f145f9839\") " pod="opendatahub/opendatahub-operator-controller-manager-5f8c4d5c89-v9wk9"
Jul 16 11:13:55.410912 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:13:55.410838    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/6f655f01-c2f4-44bc-aa68-f12f145f9839-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5f8c4d5c89-v9wk9\" (UID: \"6f655f01-c2f4-44bc-aa68-f12f145f9839\") " pod="opendatahub/opendatahub-operator-controller-manager-5f8c4d5c89-v9wk9"
Jul 16 11:13:55.511711 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:13:55.511670    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6f655f01-c2f4-44bc-aa68-f12f145f9839-webhook-cert\") pod \"opendatahub-operator-controller-manager-5f8c4d5c89-v9wk9\" (UID: \"6f655f01-c2f4-44bc-aa68-f12f145f9839\") " pod="opendatahub/opendatahub-operator-controller-manager-5f8c4d5c89-v9wk9"
Jul 16 11:13:55.511965 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:13:55.511735    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/6f655f01-c2f4-44bc-aa68-f12f145f9839-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5f8c4d5c89-v9wk9\" (UID: \"6f655f01-c2f4-44bc-aa68-f12f145f9839\") " pod="opendatahub/opendatahub-operator-controller-manager-5f8c4d5c89-v9wk9"
Jul 16 11:13:55.511965 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:13:55.511753    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6f655f01-c2f4-44bc-aa68-f12f145f9839-tmp\") pod \"opendatahub-operator-controller-manager-5f8c4d5c89-v9wk9\" (UID: \"6f655f01-c2f4-44bc-aa68-f12f145f9839\") " pod="opendatahub/opendatahub-operator-controller-manager-5f8c4d5c89-v9wk9"
Jul 16 11:13:55.512075 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:13:55.511981    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/6f655f01-c2f4-44bc-aa68-f12f145f9839-manifests\") pod \"opendatahub-operator-controller-manager-5f8c4d5c89-v9wk9\" (UID: \"6f655f01-c2f4-44bc-aa68-f12f145f9839\") " pod="opendatahub/opendatahub-operator-controller-manager-5f8c4d5c89-v9wk9"
Jul 16 11:13:55.512130 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:13:55.512069    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bnf8m\" (UniqueName: \"kubernetes.io/projected/6f655f01-c2f4-44bc-aa68-f12f145f9839-kube-api-access-bnf8m\") pod \"opendatahub-operator-controller-manager-5f8c4d5c89-v9wk9\" (UID: \"6f655f01-c2f4-44bc-aa68-f12f145f9839\") " pod="opendatahub/opendatahub-operator-controller-manager-5f8c4d5c89-v9wk9"
Jul 16 11:13:55.512378 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:13:55.512349    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/6f655f01-c2f4-44bc-aa68-f12f145f9839-manifests\") pod \"opendatahub-operator-controller-manager-5f8c4d5c89-v9wk9\" (UID: \"6f655f01-c2f4-44bc-aa68-f12f145f9839\") " pod="opendatahub/opendatahub-operator-controller-manager-5f8c4d5c89-v9wk9"
Jul 16 11:13:55.514500 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:13:55.514466    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6f655f01-c2f4-44bc-aa68-f12f145f9839-tmp\") pod \"opendatahub-operator-controller-manager-5f8c4d5c89-v9wk9\" (UID: \"6f655f01-c2f4-44bc-aa68-f12f145f9839\") " pod="opendatahub/opendatahub-operator-controller-manager-5f8c4d5c89-v9wk9"
Jul 16 11:13:55.514629 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:13:55.514518    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6f655f01-c2f4-44bc-aa68-f12f145f9839-webhook-cert\") pod \"opendatahub-operator-controller-manager-5f8c4d5c89-v9wk9\" (UID: \"6f655f01-c2f4-44bc-aa68-f12f145f9839\") " pod="opendatahub/opendatahub-operator-controller-manager-5f8c4d5c89-v9wk9"
Jul 16 11:13:55.514680 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:13:55.514630    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/6f655f01-c2f4-44bc-aa68-f12f145f9839-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5f8c4d5c89-v9wk9\" (UID: \"6f655f01-c2f4-44bc-aa68-f12f145f9839\") " pod="opendatahub/opendatahub-operator-controller-manager-5f8c4d5c89-v9wk9"
Jul 16 11:13:55.524266 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:13:55.524236    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bnf8m\" (UniqueName: \"kubernetes.io/projected/6f655f01-c2f4-44bc-aa68-f12f145f9839-kube-api-access-bnf8m\") pod \"opendatahub-operator-controller-manager-5f8c4d5c89-v9wk9\" (UID: \"6f655f01-c2f4-44bc-aa68-f12f145f9839\") " pod="opendatahub/opendatahub-operator-controller-manager-5f8c4d5c89-v9wk9"
Jul 16 11:13:55.624998 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:13:55.624954    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5f8c4d5c89-v9wk9"
Jul 16 11:13:55.635036 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:13:55.634995    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:13:55.783010 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:13:55.782975    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5f8c4d5c89-v9wk9"]
Jul 16 11:13:55.786861 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:13:55.786821    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6f655f01_c2f4_44bc_aa68_f12f145f9839.slice/crio-0ebda1bf1cb735b0c02da4b93063303fb0aed7fa028e80b81dbe2f6a0733d5c1 WatchSource:0}: Error finding container 0ebda1bf1cb735b0c02da4b93063303fb0aed7fa028e80b81dbe2f6a0733d5c1: Status 404 returned error can't find the container with id 0ebda1bf1cb735b0c02da4b93063303fb0aed7fa028e80b81dbe2f6a0733d5c1
Jul 16 11:13:55.788516 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:13:55.788485    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:13:55.789212 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:13:55.789195    2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 16 11:13:55.866106 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:13:55.866068    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5f8c4d5c89-v9wk9" event={"ID":"6f655f01-c2f4-44bc-aa68-f12f145f9839","Type":"ContainerStarted","Data":"0ebda1bf1cb735b0c02da4b93063303fb0aed7fa028e80b81dbe2f6a0733d5c1"}
Jul 16 11:13:55.911000 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:13:55.910965    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:13:56.010165 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:13:56.010131    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:13:56.114280 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:13:56.114239    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:13:56.212234 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:13:56.212197    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:13:59.886297 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:13:59.886253    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5f8c4d5c89-v9wk9" event={"ID":"6f655f01-c2f4-44bc-aa68-f12f145f9839","Type":"ContainerStarted","Data":"20b5344c90d70a1b1b3b6dc4188f128d2d45f25f208174b575300e37a59758ef"}
Jul 16 11:14:00.892765 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:14:00.892733    2564 generic.go:356] "Generic (PLEG): container finished" podID="6f655f01-c2f4-44bc-aa68-f12f145f9839" containerID="20b5344c90d70a1b1b3b6dc4188f128d2d45f25f208174b575300e37a59758ef" exitCode=0
Jul 16 11:14:00.893200 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:14:00.892829    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5f8c4d5c89-v9wk9" event={"ID":"6f655f01-c2f4-44bc-aa68-f12f145f9839","Type":"ContainerDied","Data":"20b5344c90d70a1b1b3b6dc4188f128d2d45f25f208174b575300e37a59758ef"}
Jul 16 11:14:01.898793 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:14:01.898746    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5f8c4d5c89-v9wk9" event={"ID":"6f655f01-c2f4-44bc-aa68-f12f145f9839","Type":"ContainerStarted","Data":"6c4c79f2176e8331733c1fa6a2e537992d85025204685ea40acd26aaf73c2326"}
Jul 16 11:14:01.899189 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:14:01.898879    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-5f8c4d5c89-v9wk9"
Jul 16 11:14:01.930236 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:14:01.930182    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-5f8c4d5c89-v9wk9" podStartSLOduration=2.25373008 podStartE2EDuration="6.930161817s" totalImagesPullingTime="3.520608658s" totalInitContainerRuntime="1.155823079s" isStatefulPod=false podCreationTimestamp="2026-07-16 11:13:55 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 11:14:01.928166843 +0000 UTC m=+342.299703910" watchObservedRunningTime="2026-07-16 11:14:01.930161817 +0000 UTC m=+342.301698853"
Jul 16 11:14:02.676255 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:14:02.676216    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:14:02.778347 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:14:02.778311    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:14:12.906553 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:14:12.906474    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-5f8c4d5c89-v9wk9"
Jul 16 11:14:15.289931 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:14:15.289897    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:14:15.523055 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:14:15.523014    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:14:15.825397 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:14:15.825356    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:14:15.990619 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:14:15.990583    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-79cdcbc7df-ljvqd"]
Jul 16 11:14:15.994180 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:14:15.994153    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-79cdcbc7df-ljvqd"
Jul 16 11:14:16.001620 ip-10-0-135-184 kubenswrapper[2564]: E0716 11:14:16.001597    2564 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"kube-auth-proxy-tls\" is forbidden: User \"system:node:ip-10-0-135-184.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-135-184.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" type="*v1.Secret"
Jul 16 11:14:16.001620 ip-10-0-135-184 kubenswrapper[2564]: E0716 11:14:16.001597    2564 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"kube-auth-proxy-creds\" is forbidden: User \"system:node:ip-10-0-135-184.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-135-184.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" type="*v1.Secret"
Jul 16 11:14:16.005206 ip-10-0-135-184 kubenswrapper[2564]: E0716 11:14:16.005179    2564 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"kube-auth-proxy-dockercfg-t6w2h\" is forbidden: User \"system:node:ip-10-0-135-184.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-135-184.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-t6w2h\"" type="*v1.Secret"
Jul 16 11:14:16.005206 ip-10-0-135-184 kubenswrapper[2564]: E0716 11:14:16.005179    2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"kube-auth-proxy-79cdcbc7df-ljvqd\" is forbidden: User \"system:node:ip-10-0-135-184.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-135-184.ec2.internal' and this object" podUID="d91bec46-3634-4bd1-a785-7dbc9d97eb0f" pod="openshift-ingress/kube-auth-proxy-79cdcbc7df-ljvqd"
Jul 16 11:14:16.091708 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:14:16.091613    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d91bec46-3634-4bd1-a785-7dbc9d97eb0f-tls-certs\") pod \"kube-auth-proxy-79cdcbc7df-ljvqd\" (UID: \"d91bec46-3634-4bd1-a785-7dbc9d97eb0f\") " pod="openshift-ingress/kube-auth-proxy-79cdcbc7df-ljvqd"
Jul 16 11:14:16.091708 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:14:16.091659    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-skqdc\" (UniqueName: \"kubernetes.io/projected/d91bec46-3634-4bd1-a785-7dbc9d97eb0f-kube-api-access-skqdc\") pod \"kube-auth-proxy-79cdcbc7df-ljvqd\" (UID: \"d91bec46-3634-4bd1-a785-7dbc9d97eb0f\") " pod="openshift-ingress/kube-auth-proxy-79cdcbc7df-ljvqd"
Jul 16 11:14:16.091981 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:14:16.091763    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d91bec46-3634-4bd1-a785-7dbc9d97eb0f-tmp\") pod \"kube-auth-proxy-79cdcbc7df-ljvqd\" (UID: \"d91bec46-3634-4bd1-a785-7dbc9d97eb0f\") " pod="openshift-ingress/kube-auth-proxy-79cdcbc7df-ljvqd"
Jul 16 11:14:16.095141 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:14:16.095112    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-79cdcbc7df-ljvqd"]
Jul 16 11:14:16.193181 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:14:16.193133    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d91bec46-3634-4bd1-a785-7dbc9d97eb0f-tls-certs\") pod \"kube-auth-proxy-79cdcbc7df-ljvqd\" (UID: \"d91bec46-3634-4bd1-a785-7dbc9d97eb0f\") " pod="openshift-ingress/kube-auth-proxy-79cdcbc7df-ljvqd"
Jul 16 11:14:16.193394 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:14:16.193208    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-skqdc\" (UniqueName: \"kubernetes.io/projected/d91bec46-3634-4bd1-a785-7dbc9d97eb0f-kube-api-access-skqdc\") pod \"kube-auth-proxy-79cdcbc7df-ljvqd\" (UID: \"d91bec46-3634-4bd1-a785-7dbc9d97eb0f\") " pod="openshift-ingress/kube-auth-proxy-79cdcbc7df-ljvqd"
Jul 16 11:14:16.193394 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:14:16.193258    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d91bec46-3634-4bd1-a785-7dbc9d97eb0f-tmp\") pod \"kube-auth-proxy-79cdcbc7df-ljvqd\" (UID: \"d91bec46-3634-4bd1-a785-7dbc9d97eb0f\") " pod="openshift-ingress/kube-auth-proxy-79cdcbc7df-ljvqd"
Jul 16 11:14:16.195623 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:14:16.195599    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d91bec46-3634-4bd1-a785-7dbc9d97eb0f-tmp\") pod \"kube-auth-proxy-79cdcbc7df-ljvqd\" (UID: \"d91bec46-3634-4bd1-a785-7dbc9d97eb0f\") " pod="openshift-ingress/kube-auth-proxy-79cdcbc7df-ljvqd"
Jul 16 11:14:16.233538 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:14:16.233503    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-skqdc\" (UniqueName: \"kubernetes.io/projected/d91bec46-3634-4bd1-a785-7dbc9d97eb0f-kube-api-access-skqdc\") pod \"kube-auth-proxy-79cdcbc7df-ljvqd\" (UID: \"d91bec46-3634-4bd1-a785-7dbc9d97eb0f\") " pod="openshift-ingress/kube-auth-proxy-79cdcbc7df-ljvqd"
Jul 16 11:14:16.481399 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:14:16.481305    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:14:16.591152 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:14:16.591114    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-4n8hq"]
Jul 16 11:14:16.594655 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:14:16.594628    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-4n8hq"
Jul 16 11:14:16.607689 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:14:16.607655    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-lgqh6\""
Jul 16 11:14:16.608370 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:14:16.608346    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
Jul 16 11:14:16.627261 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:14:16.627159    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-4n8hq"]
Jul 16 11:14:16.633572 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:14:16.633540    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:14:16.696849 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:14:16.696809    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7abd43ff-29ae-482d-9aae-c56d1df4897e-cert\") pod \"odh-model-controller-7998c67dc4-4n8hq\" (UID: \"7abd43ff-29ae-482d-9aae-c56d1df4897e\") " pod="opendatahub/odh-model-controller-7998c67dc4-4n8hq"
Jul 16 11:14:16.696849 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:14:16.696853    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j6z2b\" (UniqueName: \"kubernetes.io/projected/7abd43ff-29ae-482d-9aae-c56d1df4897e-kube-api-access-j6z2b\") pod \"odh-model-controller-7998c67dc4-4n8hq\" (UID: \"7abd43ff-29ae-482d-9aae-c56d1df4897e\") " pod="opendatahub/odh-model-controller-7998c67dc4-4n8hq"
Jul 16 11:14:16.797735 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:14:16.797688    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7abd43ff-29ae-482d-9aae-c56d1df4897e-cert\") pod \"odh-model-controller-7998c67dc4-4n8hq\" (UID: \"7abd43ff-29ae-482d-9aae-c56d1df4897e\") " pod="opendatahub/odh-model-controller-7998c67dc4-4n8hq"
Jul 16 11:14:16.797735 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:14:16.797733    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j6z2b\" (UniqueName: \"kubernetes.io/projected/7abd43ff-29ae-482d-9aae-c56d1df4897e-kube-api-access-j6z2b\") pod \"odh-model-controller-7998c67dc4-4n8hq\" (UID: \"7abd43ff-29ae-482d-9aae-c56d1df4897e\") " pod="opendatahub/odh-model-controller-7998c67dc4-4n8hq"
Jul 16 11:14:16.798073 ip-10-0-135-184 kubenswrapper[2564]: E0716 11:14:16.798033    2564 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found
Jul 16 11:14:16.798202 ip-10-0-135-184 kubenswrapper[2564]: E0716 11:14:16.798121    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7abd43ff-29ae-482d-9aae-c56d1df4897e-cert podName:7abd43ff-29ae-482d-9aae-c56d1df4897e nodeName:}" failed. No retries permitted until 2026-07-16 11:14:17.298096185 +0000 UTC m=+357.669633205 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/7abd43ff-29ae-482d-9aae-c56d1df4897e-cert") pod "odh-model-controller-7998c67dc4-4n8hq" (UID: "7abd43ff-29ae-482d-9aae-c56d1df4897e") : secret "odh-model-controller-webhook-cert" not found
Jul 16 11:14:16.798652 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:14:16.798591    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:14:16.859365 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:14:16.859327    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j6z2b\" (UniqueName: \"kubernetes.io/projected/7abd43ff-29ae-482d-9aae-c56d1df4897e-kube-api-access-j6z2b\") pod \"odh-model-controller-7998c67dc4-4n8hq\" (UID: \"7abd43ff-29ae-482d-9aae-c56d1df4897e\") " pod="opendatahub/odh-model-controller-7998c67dc4-4n8hq"
Jul 16 11:14:16.972943 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:14:16.972881    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:14:17.125644 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:14:17.125521    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:14:17.131225 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:14:17.131199    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-t6w2h\""
Jul 16 11:14:17.194279 ip-10-0-135-184 kubenswrapper[2564]: E0716 11:14:17.194240    2564 secret.go:189] Couldn't get secret openshift-ingress/kube-auth-proxy-tls: failed to sync secret cache: timed out waiting for the condition
Jul 16 11:14:17.194471 ip-10-0-135-184 kubenswrapper[2564]: E0716 11:14:17.194327    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d91bec46-3634-4bd1-a785-7dbc9d97eb0f-tls-certs podName:d91bec46-3634-4bd1-a785-7dbc9d97eb0f nodeName:}" failed. No retries permitted until 2026-07-16 11:14:17.694306182 +0000 UTC m=+358.065843195 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/d91bec46-3634-4bd1-a785-7dbc9d97eb0f-tls-certs") pod "kube-auth-proxy-79cdcbc7df-ljvqd" (UID: "d91bec46-3634-4bd1-a785-7dbc9d97eb0f") : failed to sync secret cache: timed out waiting for the condition
Jul 16 11:14:17.219681 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:14:17.219651    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 16 11:14:17.273346 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:14:17.273312    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 16 11:14:17.303189 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:14:17.303091    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7abd43ff-29ae-482d-9aae-c56d1df4897e-cert\") pod \"odh-model-controller-7998c67dc4-4n8hq\" (UID: \"7abd43ff-29ae-482d-9aae-c56d1df4897e\") " pod="opendatahub/odh-model-controller-7998c67dc4-4n8hq"
Jul 16 11:14:17.305652 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:14:17.305616    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7abd43ff-29ae-482d-9aae-c56d1df4897e-cert\") pod \"odh-model-controller-7998c67dc4-4n8hq\" (UID: \"7abd43ff-29ae-482d-9aae-c56d1df4897e\") " pod="opendatahub/odh-model-controller-7998c67dc4-4n8hq"
Jul 16 11:14:17.505876 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:14:17.505835    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-4n8hq"
Jul 16 11:14:17.695613 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:14:17.695579    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-4n8hq"]
Jul 16 11:14:17.699790 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:14:17.699745    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7abd43ff_29ae_482d_9aae_c56d1df4897e.slice/crio-fde70c46061be47190fa34ce481ff11da8a61d412ce6a46ba9a02406c6136727 WatchSource:0}: Error finding container fde70c46061be47190fa34ce481ff11da8a61d412ce6a46ba9a02406c6136727: Status 404 returned error can't find the container with id fde70c46061be47190fa34ce481ff11da8a61d412ce6a46ba9a02406c6136727
Jul 16 11:14:17.707178 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:14:17.707146    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d91bec46-3634-4bd1-a785-7dbc9d97eb0f-tls-certs\") pod \"kube-auth-proxy-79cdcbc7df-ljvqd\" (UID: \"d91bec46-3634-4bd1-a785-7dbc9d97eb0f\") " pod="openshift-ingress/kube-auth-proxy-79cdcbc7df-ljvqd"
Jul 16 11:14:17.709830 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:14:17.709800    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d91bec46-3634-4bd1-a785-7dbc9d97eb0f-tls-certs\") pod \"kube-auth-proxy-79cdcbc7df-ljvqd\" (UID: \"d91bec46-3634-4bd1-a785-7dbc9d97eb0f\") " pod="openshift-ingress/kube-auth-proxy-79cdcbc7df-ljvqd"
Jul 16 11:14:17.804406 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:14:17.804308    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-79cdcbc7df-ljvqd"
Jul 16 11:14:17.972422 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:14:17.972390    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-4n8hq" event={"ID":"7abd43ff-29ae-482d-9aae-c56d1df4897e","Type":"ContainerStarted","Data":"fde70c46061be47190fa34ce481ff11da8a61d412ce6a46ba9a02406c6136727"}
Jul 16 11:14:17.988547 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:14:17.988500    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:14:18.039445 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:14:18.039418    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-79cdcbc7df-ljvqd"]
Jul 16 11:14:18.043138 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:14:18.043100    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd91bec46_3634_4bd1_a785_7dbc9d97eb0f.slice/crio-d0b94cea2e71c79e44439786ce579206e823fa5eb157d333cda9a7779b9e629b WatchSource:0}: Error finding container d0b94cea2e71c79e44439786ce579206e823fa5eb157d333cda9a7779b9e629b: Status 404 returned error can't find the container with id d0b94cea2e71c79e44439786ce579206e823fa5eb157d333cda9a7779b9e629b
Jul 16 11:14:18.044059 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:14:18.044035    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-lb4qx"]
Jul 16 11:14:18.048889 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:14:18.048865    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-lb4qx"
Jul 16 11:14:18.059917 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:14:18.059893    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\""
Jul 16 11:14:18.110258 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:14:18.110221    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3f7a7b44-5c27-4db2-9e8b-e98bf35a796c-tls-certs\") pod \"model-serving-api-54d89bd5fc-lb4qx\" (UID: \"3f7a7b44-5c27-4db2-9e8b-e98bf35a796c\") " pod="opendatahub/model-serving-api-54d89bd5fc-lb4qx"
Jul 16 11:14:18.110431 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:14:18.110274    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mjhvr\" (UniqueName: \"kubernetes.io/projected/3f7a7b44-5c27-4db2-9e8b-e98bf35a796c-kube-api-access-mjhvr\") pod \"model-serving-api-54d89bd5fc-lb4qx\" (UID: \"3f7a7b44-5c27-4db2-9e8b-e98bf35a796c\") " pod="opendatahub/model-serving-api-54d89bd5fc-lb4qx"
Jul 16 11:14:18.118554 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:14:18.118519    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-lb4qx"]
Jul 16 11:14:18.211721 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:14:18.211689    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3f7a7b44-5c27-4db2-9e8b-e98bf35a796c-tls-certs\") pod \"model-serving-api-54d89bd5fc-lb4qx\" (UID: \"3f7a7b44-5c27-4db2-9e8b-e98bf35a796c\") " pod="opendatahub/model-serving-api-54d89bd5fc-lb4qx"
Jul 16 11:14:18.211945 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:14:18.211745    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mjhvr\" (UniqueName: \"kubernetes.io/projected/3f7a7b44-5c27-4db2-9e8b-e98bf35a796c-kube-api-access-mjhvr\") pod \"model-serving-api-54d89bd5fc-lb4qx\" (UID: \"3f7a7b44-5c27-4db2-9e8b-e98bf35a796c\") " pod="opendatahub/model-serving-api-54d89bd5fc-lb4qx"
Jul 16 11:14:18.211945 ip-10-0-135-184 kubenswrapper[2564]: E0716 11:14:18.211878    2564 secret.go:189] Couldn't get secret opendatahub/model-serving-api-tls: secret "model-serving-api-tls" not found
Jul 16 11:14:18.212019 ip-10-0-135-184 kubenswrapper[2564]: E0716 11:14:18.211979    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3f7a7b44-5c27-4db2-9e8b-e98bf35a796c-tls-certs podName:3f7a7b44-5c27-4db2-9e8b-e98bf35a796c nodeName:}" failed. No retries permitted until 2026-07-16 11:14:18.711933981 +0000 UTC m=+359.083471002 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/3f7a7b44-5c27-4db2-9e8b-e98bf35a796c-tls-certs") pod "model-serving-api-54d89bd5fc-lb4qx" (UID: "3f7a7b44-5c27-4db2-9e8b-e98bf35a796c") : secret "model-serving-api-tls" not found
Jul 16 11:14:18.295834 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:14:18.295794    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mjhvr\" (UniqueName: \"kubernetes.io/projected/3f7a7b44-5c27-4db2-9e8b-e98bf35a796c-kube-api-access-mjhvr\") pod \"model-serving-api-54d89bd5fc-lb4qx\" (UID: \"3f7a7b44-5c27-4db2-9e8b-e98bf35a796c\") " pod="opendatahub/model-serving-api-54d89bd5fc-lb4qx"
Jul 16 11:14:18.498506 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:14:18.498354    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:14:18.716163 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:14:18.716121    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3f7a7b44-5c27-4db2-9e8b-e98bf35a796c-tls-certs\") pod \"model-serving-api-54d89bd5fc-lb4qx\" (UID: \"3f7a7b44-5c27-4db2-9e8b-e98bf35a796c\") " pod="opendatahub/model-serving-api-54d89bd5fc-lb4qx"
Jul 16 11:14:18.719467 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:14:18.719431    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3f7a7b44-5c27-4db2-9e8b-e98bf35a796c-tls-certs\") pod \"model-serving-api-54d89bd5fc-lb4qx\" (UID: \"3f7a7b44-5c27-4db2-9e8b-e98bf35a796c\") " pod="opendatahub/model-serving-api-54d89bd5fc-lb4qx"
Jul 16 11:14:18.961054 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:14:18.961011    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-lb4qx"
Jul 16 11:14:18.981258 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:14:18.981214    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-79cdcbc7df-ljvqd" event={"ID":"d91bec46-3634-4bd1-a785-7dbc9d97eb0f","Type":"ContainerStarted","Data":"d0b94cea2e71c79e44439786ce579206e823fa5eb157d333cda9a7779b9e629b"}
Jul 16 11:14:19.215846 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:14:19.215728    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-lb4qx"]
Jul 16 11:14:19.220766 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:14:19.220725    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3f7a7b44_5c27_4db2_9e8b_e98bf35a796c.slice/crio-5db7e7fa1543d44f0c58fc54daa77d4a777e280331e782c502bae094f5f87a30 WatchSource:0}: Error finding container 5db7e7fa1543d44f0c58fc54daa77d4a777e280331e782c502bae094f5f87a30: Status 404 returned error can't find the container with id 5db7e7fa1543d44f0c58fc54daa77d4a777e280331e782c502bae094f5f87a30
Jul 16 11:14:19.989928 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:14:19.989887    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-lb4qx" event={"ID":"3f7a7b44-5c27-4db2-9e8b-e98bf35a796c","Type":"ContainerStarted","Data":"5db7e7fa1543d44f0c58fc54daa77d4a777e280331e782c502bae094f5f87a30"}
Jul 16 11:14:21.363920 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:14:21.363894    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 16 11:14:21.740788 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:14:21.740678    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:14:21.836932 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:14:21.836886    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-4vwj5"]
Jul 16 11:14:21.840407 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:14:21.840375    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-4vwj5"
Jul 16 11:14:21.858377 ip-10-0-135-184 kubenswrapper[2564]: E0716 11:14:21.858335    2564 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"istio-kubeconfig\" is forbidden: User \"system:node:ip-10-0-135-184.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-135-184.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" type="*v1.Secret"
Jul 16 11:14:21.862868 ip-10-0-135-184 kubenswrapper[2564]: E0716 11:14:21.862803    2564 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"istiod-openshift-gateway-dockercfg-vgpnp\" is forbidden: User \"system:node:ip-10-0-135-184.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-135-184.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-vgpnp\"" type="*v1.Secret"
Jul 16 11:14:21.865308 ip-10-0-135-184 kubenswrapper[2564]: E0716 11:14:21.865280    2564 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"cacerts\" is forbidden: User \"system:node:ip-10-0-135-184.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-135-184.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-ingress\"/\"cacerts\"" type="*v1.Secret"
Jul 16 11:14:21.865675 ip-10-0-135-184 kubenswrapper[2564]: E0716 11:14:21.865641    2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"istiod-openshift-gateway-7574459656-4vwj5\" is forbidden: User \"system:node:ip-10-0-135-184.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-135-184.ec2.internal' and this object" podUID="0de1cf37-b121-4969-ad8c-f04b7cc77250" pod="openshift-ingress/istiod-openshift-gateway-7574459656-4vwj5"
Jul 16 11:14:21.866076 ip-10-0-135-184 kubenswrapper[2564]: E0716 11:14:21.866049    2564 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"istiod-tls\" is forbidden: User \"system:node:ip-10-0-135-184.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-135-184.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" type="*v1.Secret"
Jul 16 11:14:21.866185 ip-10-0-135-184 kubenswrapper[2564]: E0716 11:14:21.866121    2564 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"openshift-gw-ca-root-cert\" is forbidden: User \"system:node:ip-10-0-135-184.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-135-184.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" type="*v1.ConfigMap"
Jul 16 11:14:21.882722 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:14:21.882680    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:14:21.898000 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:14:21.897965    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-4vwj5"]
Jul 16 11:14:21.947875 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:14:21.947836    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/0de1cf37-b121-4969-ad8c-f04b7cc77250-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-4vwj5\" (UID: \"0de1cf37-b121-4969-ad8c-f04b7cc77250\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-4vwj5"
Jul 16 11:14:21.948044 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:14:21.947900    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/0de1cf37-b121-4969-ad8c-f04b7cc77250-cacerts\") pod \"istiod-openshift-gateway-7574459656-4vwj5\" (UID: \"0de1cf37-b121-4969-ad8c-f04b7cc77250\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-4vwj5"
Jul 16 11:14:21.948044 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:14:21.947932    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/0de1cf37-b121-4969-ad8c-f04b7cc77250-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-4vwj5\" (UID: \"0de1cf37-b121-4969-ad8c-f04b7cc77250\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-4vwj5"
Jul 16 11:14:21.948044 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:14:21.947969    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0de1cf37-b121-4969-ad8c-f04b7cc77250-istio-token\") pod \"istiod-openshift-gateway-7574459656-4vwj5\" (UID: \"0de1cf37-b121-4969-ad8c-f04b7cc77250\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-4vwj5"
Jul 16 11:14:21.948044 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:14:21.948023    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/0de1cf37-b121-4969-ad8c-f04b7cc77250-local-certs\") pod \"istiod-openshift-gateway-7574459656-4vwj5\" (UID: \"0de1cf37-b121-4969-ad8c-f04b7cc77250\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-4vwj5"
Jul 16 11:14:21.948179 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:14:21.948069    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/0de1cf37-b121-4969-ad8c-f04b7cc77250-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-4vwj5\" (UID: \"0de1cf37-b121-4969-ad8c-f04b7cc77250\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-4vwj5"
Jul 16 11:14:21.948179 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:14:21.948095    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bgdkz\" (UniqueName: \"kubernetes.io/projected/0de1cf37-b121-4969-ad8c-f04b7cc77250-kube-api-access-bgdkz\") pod \"istiod-openshift-gateway-7574459656-4vwj5\" (UID: \"0de1cf37-b121-4969-ad8c-f04b7cc77250\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-4vwj5"
Jul 16 11:14:22.002096 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:14:22.002063    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-79cdcbc7df-ljvqd" event={"ID":"d91bec46-3634-4bd1-a785-7dbc9d97eb0f","Type":"ContainerStarted","Data":"8595764b06ee2dc1005bf41f5e0e73c8e816506933ae5562f9d1eb834d5500f3"}
Jul 16 11:14:22.003569 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:14:22.003527    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-4n8hq" event={"ID":"7abd43ff-29ae-482d-9aae-c56d1df4897e","Type":"ContainerStarted","Data":"ed53673f80f4a45344175ad14a1669da1bb74227776d5566ff805e9eaedaca67"}
Jul 16 11:14:22.003702 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:14:22.003613    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-4n8hq"
Jul 16 11:14:22.048873 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:14:22.048831    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/0de1cf37-b121-4969-ad8c-f04b7cc77250-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-4vwj5\" (UID: \"0de1cf37-b121-4969-ad8c-f04b7cc77250\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-4vwj5"
Jul 16 11:14:22.049084 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:14:22.048897    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0de1cf37-b121-4969-ad8c-f04b7cc77250-istio-token\") pod \"istiod-openshift-gateway-7574459656-4vwj5\" (UID: \"0de1cf37-b121-4969-ad8c-f04b7cc77250\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-4vwj5"
Jul 16 11:14:22.049209 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:14:22.049172    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/0de1cf37-b121-4969-ad8c-f04b7cc77250-local-certs\") pod \"istiod-openshift-gateway-7574459656-4vwj5\" (UID: \"0de1cf37-b121-4969-ad8c-f04b7cc77250\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-4vwj5"
Jul 16 11:14:22.049288 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:14:22.049239    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/0de1cf37-b121-4969-ad8c-f04b7cc77250-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-4vwj5\" (UID: \"0de1cf37-b121-4969-ad8c-f04b7cc77250\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-4vwj5"
Jul 16 11:14:22.049288 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:14:22.049272    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bgdkz\" (UniqueName: \"kubernetes.io/projected/0de1cf37-b121-4969-ad8c-f04b7cc77250-kube-api-access-bgdkz\") pod \"istiod-openshift-gateway-7574459656-4vwj5\" (UID: \"0de1cf37-b121-4969-ad8c-f04b7cc77250\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-4vwj5"
Jul 16 11:14:22.049398 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:14:22.049351    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/0de1cf37-b121-4969-ad8c-f04b7cc77250-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-4vwj5\" (UID: \"0de1cf37-b121-4969-ad8c-f04b7cc77250\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-4vwj5"
Jul 16 11:14:22.049454 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:14:22.049399    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/0de1cf37-b121-4969-ad8c-f04b7cc77250-cacerts\") pod \"istiod-openshift-gateway-7574459656-4vwj5\" (UID: \"0de1cf37-b121-4969-ad8c-f04b7cc77250\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-4vwj5"
Jul 16 11:14:22.051788 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:14:22.051741    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/0de1cf37-b121-4969-ad8c-f04b7cc77250-local-certs\") pod \"istiod-openshift-gateway-7574459656-4vwj5\" (UID: \"0de1cf37-b121-4969-ad8c-f04b7cc77250\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-4vwj5"
Jul 16 11:14:22.066620 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:14:22.066469    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0de1cf37-b121-4969-ad8c-f04b7cc77250-istio-token\") pod \"istiod-openshift-gateway-7574459656-4vwj5\" (UID: \"0de1cf37-b121-4969-ad8c-f04b7cc77250\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-4vwj5"
Jul 16 11:14:22.073319 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:14:22.070356    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bgdkz\" (UniqueName: \"kubernetes.io/projected/0de1cf37-b121-4969-ad8c-f04b7cc77250-kube-api-access-bgdkz\") pod \"istiod-openshift-gateway-7574459656-4vwj5\" (UID: \"0de1cf37-b121-4969-ad8c-f04b7cc77250\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-4vwj5"
Jul 16 11:14:22.177620 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:14:22.177558    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-79cdcbc7df-ljvqd" podStartSLOduration=3.863191427 podStartE2EDuration="7.177537504s" totalImagesPullingTime="3.314346077s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 11:14:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 11:14:22.167377755 +0000 UTC m=+362.538914814" watchObservedRunningTime="2026-07-16 11:14:22.177537504 +0000 UTC m=+362.549074582"
Jul 16 11:14:22.220695 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:14:22.220638    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-4n8hq" podStartSLOduration=2.561613898 podStartE2EDuration="6.220619809s" totalImagesPullingTime="3.659005911s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 11:14:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 11:14:22.22033912 +0000 UTC m=+362.591876156" watchObservedRunningTime="2026-07-16 11:14:22.220619809 +0000 UTC m=+362.592156844"
Jul 16 11:14:22.709253 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:14:22.709211    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Jul 16 11:14:22.713109 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:14:22.713074    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/0de1cf37-b121-4969-ad8c-f04b7cc77250-cacerts\") pod \"istiod-openshift-gateway-7574459656-4vwj5\" (UID: \"0de1cf37-b121-4969-ad8c-f04b7cc77250\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-4vwj5"
Jul 16 11:14:22.957176 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:14:22.957137    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-vgpnp\""
Jul 16 11:14:23.003480 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:14:23.003451    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 16 11:14:23.010303 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:14:23.010271    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/0de1cf37-b121-4969-ad8c-f04b7cc77250-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-4vwj5\" (UID: \"0de1cf37-b121-4969-ad8c-f04b7cc77250\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-4vwj5"
Jul 16 11:14:23.049229 ip-10-0-135-184 kubenswrapper[2564]: E0716 11:14:23.049190    2564 secret.go:189] Couldn't get secret openshift-ingress/istiod-tls: failed to sync secret cache: timed out waiting for the condition
Jul 16 11:14:23.049370 ip-10-0-135-184 kubenswrapper[2564]: E0716 11:14:23.049272    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0de1cf37-b121-4969-ad8c-f04b7cc77250-istio-csr-dns-cert podName:0de1cf37-b121-4969-ad8c-f04b7cc77250 nodeName:}" failed. No retries permitted until 2026-07-16 11:14:23.54925168 +0000 UTC m=+363.920788716 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "istio-csr-dns-cert" (UniqueName: "kubernetes.io/secret/0de1cf37-b121-4969-ad8c-f04b7cc77250-istio-csr-dns-cert") pod "istiod-openshift-gateway-7574459656-4vwj5" (UID: "0de1cf37-b121-4969-ad8c-f04b7cc77250") : failed to sync secret cache: timed out waiting for the condition
Jul 16 11:14:23.050293 ip-10-0-135-184 kubenswrapper[2564]: E0716 11:14:23.050276    2564 secret.go:189] Couldn't get secret openshift-ingress/istio-kubeconfig: failed to sync secret cache: timed out waiting for the condition
Jul 16 11:14:23.050390 ip-10-0-135-184 kubenswrapper[2564]: E0716 11:14:23.050328    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0de1cf37-b121-4969-ad8c-f04b7cc77250-istio-kubeconfig podName:0de1cf37-b121-4969-ad8c-f04b7cc77250 nodeName:}" failed. No retries permitted until 2026-07-16 11:14:23.550315312 +0000 UTC m=+363.921852326 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "istio-kubeconfig" (UniqueName: "kubernetes.io/secret/0de1cf37-b121-4969-ad8c-f04b7cc77250-istio-kubeconfig") pod "istiod-openshift-gateway-7574459656-4vwj5" (UID: "0de1cf37-b121-4969-ad8c-f04b7cc77250") : failed to sync secret cache: timed out waiting for the condition
Jul 16 11:14:23.102907 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:14:23.102877    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Jul 16 11:14:23.196924 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:14:23.196893    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Jul 16 11:14:23.565686 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:14:23.565646    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/0de1cf37-b121-4969-ad8c-f04b7cc77250-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-4vwj5\" (UID: \"0de1cf37-b121-4969-ad8c-f04b7cc77250\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-4vwj5"
Jul 16 11:14:23.565895 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:14:23.565705    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/0de1cf37-b121-4969-ad8c-f04b7cc77250-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-4vwj5\" (UID: \"0de1cf37-b121-4969-ad8c-f04b7cc77250\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-4vwj5"
Jul 16 11:14:23.568193 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:14:23.568161    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/0de1cf37-b121-4969-ad8c-f04b7cc77250-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-4vwj5\" (UID: \"0de1cf37-b121-4969-ad8c-f04b7cc77250\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-4vwj5"
Jul 16 11:14:23.568323 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:14:23.568298    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/0de1cf37-b121-4969-ad8c-f04b7cc77250-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-4vwj5\" (UID: \"0de1cf37-b121-4969-ad8c-f04b7cc77250\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-4vwj5"
Jul 16 11:14:23.652230 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:14:23.652187    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-4vwj5"
Jul 16 11:14:23.828988 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:14:23.828933    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0de1cf37_b121_4969_ad8c_f04b7cc77250.slice/crio-34b1edad38b2bd377f40069710730da2dacbef66e17f912843deacdfe7c7c177 WatchSource:0}: Error finding container 34b1edad38b2bd377f40069710730da2dacbef66e17f912843deacdfe7c7c177: Status 404 returned error can't find the container with id 34b1edad38b2bd377f40069710730da2dacbef66e17f912843deacdfe7c7c177
Jul 16 11:14:23.829343 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:14:23.829005    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-4vwj5"]
Jul 16 11:14:24.013419 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:14:24.013376    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-4vwj5" event={"ID":"0de1cf37-b121-4969-ad8c-f04b7cc77250","Type":"ContainerStarted","Data":"34b1edad38b2bd377f40069710730da2dacbef66e17f912843deacdfe7c7c177"}
Jul 16 11:14:24.014896 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:14:24.014864    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-lb4qx" event={"ID":"3f7a7b44-5c27-4db2-9e8b-e98bf35a796c","Type":"ContainerStarted","Data":"32b1dd5a116b20f1be45f429d0b430fe849619daecb2ef165b6d712a80bcf717"}
Jul 16 11:14:24.015048 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:14:24.015019    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-lb4qx"
Jul 16 11:14:24.059889 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:14:24.059822    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-lb4qx" podStartSLOduration=3.254226626 podStartE2EDuration="7.05980287s" totalImagesPullingTime="3.805576244s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 11:14:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 11:14:24.05849347 +0000 UTC m=+364.430030507" watchObservedRunningTime="2026-07-16 11:14:24.05980287 +0000 UTC m=+364.431339905"
Jul 16 11:14:25.196437 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:14:25.196398    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:14:26.556184 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:14:26.556147    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 16 11:14:26.556455 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:14:26.556221    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 16 11:14:27.035117 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:14:27.035080    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-4vwj5" event={"ID":"0de1cf37-b121-4969-ad8c-f04b7cc77250","Type":"ContainerStarted","Data":"304f1377c548f3b3cbb3baa636c053deb4c6e27f1c1d4efede2b7a3340a1d4dd"}
Jul 16 11:14:27.035315 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:14:27.035144    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-4vwj5"
Jul 16 11:14:27.036985 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:14:27.036952    2564 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7574459656-4vwj5 container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 16 11:14:27.037106 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:14:27.037014    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7574459656-4vwj5" podUID="0de1cf37-b121-4969-ad8c-f04b7cc77250" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 16 11:14:27.529545 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:14:27.529407    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:14:27.642308 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:14:27.642260    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:14:28.040320 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:14:28.040285    2564 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7574459656-4vwj5 container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 16 11:14:28.040500 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:14:28.040342    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7574459656-4vwj5" podUID="0de1cf37-b121-4969-ad8c-f04b7cc77250" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 16 11:14:29.408056 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:14:29.407988    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7574459656-4vwj5" podStartSLOduration=5.683261266 podStartE2EDuration="8.407955132s" totalImagesPullingTime="2.724693866s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 11:14:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 11:14:27.14122336 +0000 UTC m=+367.512760398" watchObservedRunningTime="2026-07-16 11:14:29.407955132 +0000 UTC m=+369.779492170"
Jul 16 11:14:29.408842 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:14:29.408815    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xd45c"]
Jul 16 11:14:29.417259 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:14:29.417232    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xd45c"
Jul 16 11:14:29.421595 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:14:29.421572    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-dpgsc\""
Jul 16 11:14:29.440106 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:14:29.440067    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xd45c"]
Jul 16 11:14:29.492575 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:14:29.492539    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:14:29.523457 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:14:29.523421    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7e6b410d-9b78-48d6-ab3e-60e4168a4971-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4xd45c\" (UID: \"7e6b410d-9b78-48d6-ab3e-60e4168a4971\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xd45c"
Jul 16 11:14:29.523643 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:14:29.523471    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7e6b410d-9b78-48d6-ab3e-60e4168a4971-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4xd45c\" (UID: \"7e6b410d-9b78-48d6-ab3e-60e4168a4971\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xd45c"
Jul 16 11:14:29.523643 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:14:29.523500    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qj7k8\" (UniqueName: \"kubernetes.io/projected/7e6b410d-9b78-48d6-ab3e-60e4168a4971-kube-api-access-qj7k8\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4xd45c\" (UID: \"7e6b410d-9b78-48d6-ab3e-60e4168a4971\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xd45c"
Jul 16 11:14:29.523643 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:14:29.523556    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7e6b410d-9b78-48d6-ab3e-60e4168a4971-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4xd45c\" (UID: \"7e6b410d-9b78-48d6-ab3e-60e4168a4971\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xd45c"
Jul 16 11:14:29.523643 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:14:29.523604    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7e6b410d-9b78-48d6-ab3e-60e4168a4971-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4xd45c\" (UID: \"7e6b410d-9b78-48d6-ab3e-60e4168a4971\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xd45c"
Jul 16 11:14:29.523817 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:14:29.523647    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7e6b410d-9b78-48d6-ab3e-60e4168a4971-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4xd45c\" (UID: \"7e6b410d-9b78-48d6-ab3e-60e4168a4971\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xd45c"
Jul 16 11:14:29.523817 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:14:29.523673    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7e6b410d-9b78-48d6-ab3e-60e4168a4971-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4xd45c\" (UID: \"7e6b410d-9b78-48d6-ab3e-60e4168a4971\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xd45c"
Jul 16 11:14:29.523817 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:14:29.523716    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7e6b410d-9b78-48d6-ab3e-60e4168a4971-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4xd45c\" (UID: \"7e6b410d-9b78-48d6-ab3e-60e4168a4971\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xd45c"
Jul 16 11:14:29.523930 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:14:29.523822    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7e6b410d-9b78-48d6-ab3e-60e4168a4971-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4xd45c\" (UID: \"7e6b410d-9b78-48d6-ab3e-60e4168a4971\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xd45c"
Jul 16 11:14:29.624587 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:14:29.624545    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7e6b410d-9b78-48d6-ab3e-60e4168a4971-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4xd45c\" (UID: \"7e6b410d-9b78-48d6-ab3e-60e4168a4971\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xd45c"
Jul 16 11:14:29.624747 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:14:29.624599    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7e6b410d-9b78-48d6-ab3e-60e4168a4971-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4xd45c\" (UID: \"7e6b410d-9b78-48d6-ab3e-60e4168a4971\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xd45c"
Jul 16 11:14:29.624747 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:14:29.624630    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7e6b410d-9b78-48d6-ab3e-60e4168a4971-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4xd45c\" (UID: \"7e6b410d-9b78-48d6-ab3e-60e4168a4971\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xd45c"
Jul 16 11:14:29.624747 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:14:29.624659    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7e6b410d-9b78-48d6-ab3e-60e4168a4971-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4xd45c\" (UID: \"7e6b410d-9b78-48d6-ab3e-60e4168a4971\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xd45c"
Jul 16 11:14:29.624747 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:14:29.624718    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7e6b410d-9b78-48d6-ab3e-60e4168a4971-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4xd45c\" (UID: \"7e6b410d-9b78-48d6-ab3e-60e4168a4971\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xd45c"
Jul 16 11:14:29.624976 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:14:29.624803    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7e6b410d-9b78-48d6-ab3e-60e4168a4971-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4xd45c\" (UID: \"7e6b410d-9b78-48d6-ab3e-60e4168a4971\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xd45c"
Jul 16 11:14:29.624976 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:14:29.624839    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7e6b410d-9b78-48d6-ab3e-60e4168a4971-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4xd45c\" (UID: \"7e6b410d-9b78-48d6-ab3e-60e4168a4971\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xd45c"
Jul 16 11:14:29.624976 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:14:29.624872    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7e6b410d-9b78-48d6-ab3e-60e4168a4971-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4xd45c\" (UID: \"7e6b410d-9b78-48d6-ab3e-60e4168a4971\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xd45c"
Jul 16 11:14:29.624976 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:14:29.624898    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qj7k8\" (UniqueName: \"kubernetes.io/projected/7e6b410d-9b78-48d6-ab3e-60e4168a4971-kube-api-access-qj7k8\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4xd45c\" (UID: \"7e6b410d-9b78-48d6-ab3e-60e4168a4971\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xd45c"
Jul 16 11:14:29.625159 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:14:29.625026    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7e6b410d-9b78-48d6-ab3e-60e4168a4971-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4xd45c\" (UID: \"7e6b410d-9b78-48d6-ab3e-60e4168a4971\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xd45c"
Jul 16 11:14:29.625621 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:14:29.625411    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7e6b410d-9b78-48d6-ab3e-60e4168a4971-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4xd45c\" (UID: \"7e6b410d-9b78-48d6-ab3e-60e4168a4971\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xd45c"
Jul 16 11:14:29.625621 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:14:29.625541    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7e6b410d-9b78-48d6-ab3e-60e4168a4971-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4xd45c\" (UID: \"7e6b410d-9b78-48d6-ab3e-60e4168a4971\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xd45c"
Jul 16 11:14:29.625871 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:14:29.625847    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7e6b410d-9b78-48d6-ab3e-60e4168a4971-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4xd45c\" (UID: \"7e6b410d-9b78-48d6-ab3e-60e4168a4971\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xd45c"
Jul 16 11:14:29.625981 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:14:29.625956    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7e6b410d-9b78-48d6-ab3e-60e4168a4971-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4xd45c\" (UID: \"7e6b410d-9b78-48d6-ab3e-60e4168a4971\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xd45c"
Jul 16 11:14:29.628168 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:14:29.628127    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7e6b410d-9b78-48d6-ab3e-60e4168a4971-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4xd45c\" (UID: \"7e6b410d-9b78-48d6-ab3e-60e4168a4971\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xd45c"
Jul 16 11:14:29.628480 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:14:29.628450    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7e6b410d-9b78-48d6-ab3e-60e4168a4971-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4xd45c\" (UID: \"7e6b410d-9b78-48d6-ab3e-60e4168a4971\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xd45c"
Jul 16 11:14:29.634933 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:14:29.634901    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:14:29.653221 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:14:29.653190    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7e6b410d-9b78-48d6-ab3e-60e4168a4971-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4xd45c\" (UID: \"7e6b410d-9b78-48d6-ab3e-60e4168a4971\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xd45c"
Jul 16 11:14:29.669986 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:14:29.669910    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qj7k8\" (UniqueName: \"kubernetes.io/projected/7e6b410d-9b78-48d6-ab3e-60e4168a4971-kube-api-access-qj7k8\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4xd45c\" (UID: \"7e6b410d-9b78-48d6-ab3e-60e4168a4971\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xd45c"
Jul 16 11:14:29.728831 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:14:29.728760    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xd45c"
Jul 16 11:14:29.992703 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:14:29.992596    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:14:30.005899 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:14:30.005870    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xd45c"]
Jul 16 11:14:30.008268 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:14:30.008233    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7e6b410d_9b78_48d6_ab3e_60e4168a4971.slice/crio-48f4016fe3dc2be224b5f1a14c694c64a1022c5a278ef4d1058909287a95f103 WatchSource:0}: Error finding container 48f4016fe3dc2be224b5f1a14c694c64a1022c5a278ef4d1058909287a95f103: Status 404 returned error can't find the container with id 48f4016fe3dc2be224b5f1a14c694c64a1022c5a278ef4d1058909287a95f103
Jul 16 11:14:30.050313 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:14:30.050281    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xd45c" event={"ID":"7e6b410d-9b78-48d6-ab3e-60e4168a4971","Type":"ContainerStarted","Data":"48f4016fe3dc2be224b5f1a14c694c64a1022c5a278ef4d1058909287a95f103"}
Jul 16 11:14:30.202037 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:14:30.201996    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:14:30.325445 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:14:30.325411    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:14:30.385389 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:14:30.385354    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-555b7"]
Jul 16 11:14:30.388603 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:14:30.388579    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-555b7"
Jul 16 11:14:30.400407 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:14:30.400381    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-dj799\""
Jul 16 11:14:30.400407 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:14:30.400404    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
Jul 16 11:14:30.450843 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:14:30.450810    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-9fxzw"]
Jul 16 11:14:30.453445 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:14:30.453422    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-9fxzw"
Jul 16 11:14:30.481785 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:14:30.481741    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\""
Jul 16 11:14:30.481949 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:14:30.481741    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-mp22w\""
Jul 16 11:14:30.531989 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:14:30.531951    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3b966a79-168a-4aff-94f8-669f33082e69-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-9fxzw\" (UID: \"3b966a79-168a-4aff-94f8-669f33082e69\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-9fxzw"
Jul 16 11:14:30.532191 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:14:30.532016    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7p28d\" (UniqueName: \"kubernetes.io/projected/3b966a79-168a-4aff-94f8-669f33082e69-kube-api-access-7p28d\") pod \"llmisvc-controller-manager-777c6bd7d5-9fxzw\" (UID: \"3b966a79-168a-4aff-94f8-669f33082e69\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-9fxzw"
Jul 16 11:14:30.532191 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:14:30.532070    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bqwrz\" (UniqueName: \"kubernetes.io/projected/e2753d05-dd93-4a8c-a671-8a82b06180de-kube-api-access-bqwrz\") pod \"kserve-controller-manager-d6f4b65b8-555b7\" (UID: \"e2753d05-dd93-4a8c-a671-8a82b06180de\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-555b7"
Jul 16 11:14:30.532191 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:14:30.532121    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e2753d05-dd93-4a8c-a671-8a82b06180de-cert\") pod \"kserve-controller-manager-d6f4b65b8-555b7\" (UID: \"e2753d05-dd93-4a8c-a671-8a82b06180de\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-555b7"
Jul 16 11:14:30.553948 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:14:30.553909    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:14:30.568457 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:14:30.568419    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-555b7"]
Jul 16 11:14:30.613229 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:14:30.613150    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-9fxzw"]
Jul 16 11:14:30.632918 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:14:30.632875    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3b966a79-168a-4aff-94f8-669f33082e69-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-9fxzw\" (UID: \"3b966a79-168a-4aff-94f8-669f33082e69\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-9fxzw"
Jul 16 11:14:30.633099 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:14:30.632975    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7p28d\" (UniqueName: \"kubernetes.io/projected/3b966a79-168a-4aff-94f8-669f33082e69-kube-api-access-7p28d\") pod \"llmisvc-controller-manager-777c6bd7d5-9fxzw\" (UID: \"3b966a79-168a-4aff-94f8-669f33082e69\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-9fxzw"
Jul 16 11:14:30.633099 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:14:30.633018    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bqwrz\" (UniqueName: \"kubernetes.io/projected/e2753d05-dd93-4a8c-a671-8a82b06180de-kube-api-access-bqwrz\") pod \"kserve-controller-manager-d6f4b65b8-555b7\" (UID: \"e2753d05-dd93-4a8c-a671-8a82b06180de\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-555b7"
Jul 16 11:14:30.633099 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:14:30.633073    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e2753d05-dd93-4a8c-a671-8a82b06180de-cert\") pod \"kserve-controller-manager-d6f4b65b8-555b7\" (UID: \"e2753d05-dd93-4a8c-a671-8a82b06180de\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-555b7"
Jul 16 11:14:30.636078 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:14:30.636044    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3b966a79-168a-4aff-94f8-669f33082e69-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-9fxzw\" (UID: \"3b966a79-168a-4aff-94f8-669f33082e69\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-9fxzw"
Jul 16 11:14:30.636233 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:14:30.636044    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e2753d05-dd93-4a8c-a671-8a82b06180de-cert\") pod \"kserve-controller-manager-d6f4b65b8-555b7\" (UID: \"e2753d05-dd93-4a8c-a671-8a82b06180de\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-555b7"
Jul 16 11:14:30.646692 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:14:30.646660    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bqwrz\" (UniqueName: \"kubernetes.io/projected/e2753d05-dd93-4a8c-a671-8a82b06180de-kube-api-access-bqwrz\") pod \"kserve-controller-manager-d6f4b65b8-555b7\" (UID: \"e2753d05-dd93-4a8c-a671-8a82b06180de\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-555b7"
Jul 16 11:14:30.652536 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:14:30.652506    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7p28d\" (UniqueName: \"kubernetes.io/projected/3b966a79-168a-4aff-94f8-669f33082e69-kube-api-access-7p28d\") pod \"llmisvc-controller-manager-777c6bd7d5-9fxzw\" (UID: \"3b966a79-168a-4aff-94f8-669f33082e69\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-9fxzw"
Jul 16 11:14:30.680838 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:14:30.680785    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:14:30.700565 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:14:30.700528    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-555b7"
Jul 16 11:14:30.763459 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:14:30.763422    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-9fxzw"
Jul 16 11:14:30.911174 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:14:30.911146    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-555b7"]
Jul 16 11:14:30.914420 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:14:30.914388    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode2753d05_dd93_4a8c_a671_8a82b06180de.slice/crio-37719157ce8e290dfacd4fde9bd977dd7b9b286fb4dd06a007c844e3f9a4c707 WatchSource:0}: Error finding container 37719157ce8e290dfacd4fde9bd977dd7b9b286fb4dd06a007c844e3f9a4c707: Status 404 returned error can't find the container with id 37719157ce8e290dfacd4fde9bd977dd7b9b286fb4dd06a007c844e3f9a4c707
Jul 16 11:14:30.955664 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:14:30.955571    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-9fxzw"]
Jul 16 11:14:30.958105 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:14:30.958072    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod3b966a79_168a_4aff_94f8_669f33082e69.slice/crio-9ce492af378f0afa4f4d0523f8ed9d7ef7ba5c34e78240dc9e952bf6400fe0d3 WatchSource:0}: Error finding container 9ce492af378f0afa4f4d0523f8ed9d7ef7ba5c34e78240dc9e952bf6400fe0d3: Status 404 returned error can't find the container with id 9ce492af378f0afa4f4d0523f8ed9d7ef7ba5c34e78240dc9e952bf6400fe0d3
Jul 16 11:14:31.040370 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:14:31.040339    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-4vwj5"
Jul 16 11:14:31.057611 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:14:31.057575    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-555b7" event={"ID":"e2753d05-dd93-4a8c-a671-8a82b06180de","Type":"ContainerStarted","Data":"37719157ce8e290dfacd4fde9bd977dd7b9b286fb4dd06a007c844e3f9a4c707"}
Jul 16 11:14:31.059130 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:14:31.059090    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-9fxzw" event={"ID":"3b966a79-168a-4aff-94f8-669f33082e69","Type":"ContainerStarted","Data":"9ce492af378f0afa4f4d0523f8ed9d7ef7ba5c34e78240dc9e952bf6400fe0d3"}
Jul 16 11:14:31.918142 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:14:31.918065    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:14:32.054395 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:14:32.054359    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:14:33.009916 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:14:33.009890    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-4n8hq"
Jul 16 11:14:33.224501 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:14:33.224462    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-4vwj5"]
Jul 16 11:14:33.224706 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:14:33.224682    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7574459656-4vwj5" podUID="0de1cf37-b121-4969-ad8c-f04b7cc77250" containerName="discovery" containerID="cri-o://304f1377c548f3b3cbb3baa636c053deb4c6e27f1c1d4efede2b7a3340a1d4dd" gracePeriod=30
Jul 16 11:14:33.348931 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:14:33.348892    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 16 11:14:33.349016 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:14:33.348972    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 16 11:14:33.349016 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:14:33.349001    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 16 11:14:33.509617 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:14:33.509582    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-4vwj5"
Jul 16 11:14:33.666263 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:14:33.666183    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/0de1cf37-b121-4969-ad8c-f04b7cc77250-istio-kubeconfig\") pod \"0de1cf37-b121-4969-ad8c-f04b7cc77250\" (UID: \"0de1cf37-b121-4969-ad8c-f04b7cc77250\") "
Jul 16 11:14:33.666263 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:14:33.666231    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0de1cf37-b121-4969-ad8c-f04b7cc77250-istio-token\") pod \"0de1cf37-b121-4969-ad8c-f04b7cc77250\" (UID: \"0de1cf37-b121-4969-ad8c-f04b7cc77250\") "
Jul 16 11:14:33.666433 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:14:33.666276    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/0de1cf37-b121-4969-ad8c-f04b7cc77250-local-certs\") pod \"0de1cf37-b121-4969-ad8c-f04b7cc77250\" (UID: \"0de1cf37-b121-4969-ad8c-f04b7cc77250\") "
Jul 16 11:14:33.666433 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:14:33.666354    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/0de1cf37-b121-4969-ad8c-f04b7cc77250-istio-csr-ca-configmap\") pod \"0de1cf37-b121-4969-ad8c-f04b7cc77250\" (UID: \"0de1cf37-b121-4969-ad8c-f04b7cc77250\") "
Jul 16 11:14:33.666433 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:14:33.666410    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/0de1cf37-b121-4969-ad8c-f04b7cc77250-cacerts\") pod \"0de1cf37-b121-4969-ad8c-f04b7cc77250\" (UID: \"0de1cf37-b121-4969-ad8c-f04b7cc77250\") "
Jul 16 11:14:33.666573 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:14:33.666447    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bgdkz\" (UniqueName: \"kubernetes.io/projected/0de1cf37-b121-4969-ad8c-f04b7cc77250-kube-api-access-bgdkz\") pod \"0de1cf37-b121-4969-ad8c-f04b7cc77250\" (UID: \"0de1cf37-b121-4969-ad8c-f04b7cc77250\") "
Jul 16 11:14:33.666573 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:14:33.666491    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/0de1cf37-b121-4969-ad8c-f04b7cc77250-istio-csr-dns-cert\") pod \"0de1cf37-b121-4969-ad8c-f04b7cc77250\" (UID: \"0de1cf37-b121-4969-ad8c-f04b7cc77250\") "
Jul 16 11:14:33.667797 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:14:33.667707    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0de1cf37-b121-4969-ad8c-f04b7cc77250-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "0de1cf37-b121-4969-ad8c-f04b7cc77250" (UID: "0de1cf37-b121-4969-ad8c-f04b7cc77250"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 11:14:33.670732 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:14:33.670646    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0de1cf37-b121-4969-ad8c-f04b7cc77250-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "0de1cf37-b121-4969-ad8c-f04b7cc77250" (UID: "0de1cf37-b121-4969-ad8c-f04b7cc77250"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 11:14:33.671494 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:14:33.671299    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0de1cf37-b121-4969-ad8c-f04b7cc77250-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "0de1cf37-b121-4969-ad8c-f04b7cc77250" (UID: "0de1cf37-b121-4969-ad8c-f04b7cc77250"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 11:14:33.671494 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:14:33.671322    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0de1cf37-b121-4969-ad8c-f04b7cc77250-kube-api-access-bgdkz" (OuterVolumeSpecName: "kube-api-access-bgdkz") pod "0de1cf37-b121-4969-ad8c-f04b7cc77250" (UID: "0de1cf37-b121-4969-ad8c-f04b7cc77250"). InnerVolumeSpecName "kube-api-access-bgdkz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 11:14:33.671699 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:14:33.671620    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0de1cf37-b121-4969-ad8c-f04b7cc77250-cacerts" (OuterVolumeSpecName: "cacerts") pod "0de1cf37-b121-4969-ad8c-f04b7cc77250" (UID: "0de1cf37-b121-4969-ad8c-f04b7cc77250"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 11:14:33.672297 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:14:33.672278    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0de1cf37-b121-4969-ad8c-f04b7cc77250-local-certs" (OuterVolumeSpecName: "local-certs") pod "0de1cf37-b121-4969-ad8c-f04b7cc77250" (UID: "0de1cf37-b121-4969-ad8c-f04b7cc77250"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 11:14:33.672543 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:14:33.672523    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0de1cf37-b121-4969-ad8c-f04b7cc77250-istio-token" (OuterVolumeSpecName: "istio-token") pod "0de1cf37-b121-4969-ad8c-f04b7cc77250" (UID: "0de1cf37-b121-4969-ad8c-f04b7cc77250"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 11:14:33.767467 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:14:33.767420    2564 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/0de1cf37-b121-4969-ad8c-f04b7cc77250-istio-kubeconfig\") on node \"ip-10-0-135-184.ec2.internal\" DevicePath \"\""
Jul 16 11:14:33.767467 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:14:33.767459    2564 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0de1cf37-b121-4969-ad8c-f04b7cc77250-istio-token\") on node \"ip-10-0-135-184.ec2.internal\" DevicePath \"\""
Jul 16 11:14:33.767467 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:14:33.767475    2564 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/0de1cf37-b121-4969-ad8c-f04b7cc77250-local-certs\") on node \"ip-10-0-135-184.ec2.internal\" DevicePath \"\""
Jul 16 11:14:33.767783 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:14:33.767489    2564 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/0de1cf37-b121-4969-ad8c-f04b7cc77250-istio-csr-ca-configmap\") on node \"ip-10-0-135-184.ec2.internal\" DevicePath \"\""
Jul 16 11:14:33.767783 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:14:33.767503    2564 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/0de1cf37-b121-4969-ad8c-f04b7cc77250-cacerts\") on node \"ip-10-0-135-184.ec2.internal\" DevicePath \"\""
Jul 16 11:14:33.767783 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:14:33.767516    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bgdkz\" (UniqueName: \"kubernetes.io/projected/0de1cf37-b121-4969-ad8c-f04b7cc77250-kube-api-access-bgdkz\") on node \"ip-10-0-135-184.ec2.internal\" DevicePath \"\""
Jul 16 11:14:33.767783 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:14:33.767542    2564 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/0de1cf37-b121-4969-ad8c-f04b7cc77250-istio-csr-dns-cert\") on node \"ip-10-0-135-184.ec2.internal\" DevicePath \"\""
Jul 16 11:14:34.082992 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:14:34.082954    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-555b7" event={"ID":"e2753d05-dd93-4a8c-a671-8a82b06180de","Type":"ContainerStarted","Data":"487f2614d65695e5632b86e012916d3022774454f8044ccb0889b23545fe2e95"}
Jul 16 11:14:34.083475 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:14:34.083191    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-555b7"
Jul 16 11:14:34.085064 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:14:34.084539    2564 generic.go:356] "Generic (PLEG): container finished" podID="0de1cf37-b121-4969-ad8c-f04b7cc77250" containerID="304f1377c548f3b3cbb3baa636c053deb4c6e27f1c1d4efede2b7a3340a1d4dd" exitCode=0
Jul 16 11:14:34.085064 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:14:34.084619    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-4vwj5" event={"ID":"0de1cf37-b121-4969-ad8c-f04b7cc77250","Type":"ContainerDied","Data":"304f1377c548f3b3cbb3baa636c053deb4c6e27f1c1d4efede2b7a3340a1d4dd"}
Jul 16 11:14:34.085064 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:14:34.084659    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-4vwj5" event={"ID":"0de1cf37-b121-4969-ad8c-f04b7cc77250","Type":"ContainerDied","Data":"34b1edad38b2bd377f40069710730da2dacbef66e17f912843deacdfe7c7c177"}
Jul 16 11:14:34.085064 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:14:34.084684    2564 scope.go:117] "RemoveContainer" containerID="304f1377c548f3b3cbb3baa636c053deb4c6e27f1c1d4efede2b7a3340a1d4dd"
Jul 16 11:14:34.085064 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:14:34.084869    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-4vwj5"
Jul 16 11:14:34.087413 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:14:34.087384    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xd45c" event={"ID":"7e6b410d-9b78-48d6-ab3e-60e4168a4971","Type":"ContainerStarted","Data":"285946c7507921bf5dc1b9e471d02c799924db269e27b4dd6f6593f347d67814"}
Jul 16 11:14:34.116733 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:14:34.116664    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-555b7" podStartSLOduration=1.6367170899999999 podStartE2EDuration="4.116641546s" totalImagesPullingTime="2.479924456s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 11:14:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 11:14:34.116226721 +0000 UTC m=+374.487763778" watchObservedRunningTime="2026-07-16 11:14:34.116641546 +0000 UTC m=+374.488178562"
Jul 16 11:14:34.143646 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:14:34.143606    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-4vwj5"]
Jul 16 11:14:34.148867 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:14:34.148830    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-4vwj5"]
Jul 16 11:14:34.177534 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:14:34.177470    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xd45c" podStartSLOduration=1.839649144 podStartE2EDuration="5.177446792s" totalImagesPullingTime="3.337797648s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 11:14:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 11:14:34.176998239 +0000 UTC m=+374.548535309" watchObservedRunningTime="2026-07-16 11:14:34.177446792 +0000 UTC m=+374.548983828"
Jul 16 11:14:34.198180 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:14:34.198152    2564 scope.go:117] "RemoveContainer" containerID="304f1377c548f3b3cbb3baa636c053deb4c6e27f1c1d4efede2b7a3340a1d4dd"
Jul 16 11:14:34.198647 ip-10-0-135-184 kubenswrapper[2564]: E0716 11:14:34.198618    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"304f1377c548f3b3cbb3baa636c053deb4c6e27f1c1d4efede2b7a3340a1d4dd\": container with ID starting with 304f1377c548f3b3cbb3baa636c053deb4c6e27f1c1d4efede2b7a3340a1d4dd not found: ID does not exist" containerID="304f1377c548f3b3cbb3baa636c053deb4c6e27f1c1d4efede2b7a3340a1d4dd"
Jul 16 11:14:34.198757 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:14:34.198655    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"304f1377c548f3b3cbb3baa636c053deb4c6e27f1c1d4efede2b7a3340a1d4dd"} err="failed to get container status \"304f1377c548f3b3cbb3baa636c053deb4c6e27f1c1d4efede2b7a3340a1d4dd\": rpc error: code = NotFound desc = could not find container \"304f1377c548f3b3cbb3baa636c053deb4c6e27f1c1d4efede2b7a3340a1d4dd\": container with ID starting with 304f1377c548f3b3cbb3baa636c053deb4c6e27f1c1d4efede2b7a3340a1d4dd not found: ID does not exist"
Jul 16 11:14:34.302072 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:14:34.302032    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0de1cf37-b121-4969-ad8c-f04b7cc77250" path="/var/lib/kubelet/pods/0de1cf37-b121-4969-ad8c-f04b7cc77250/volumes"
Jul 16 11:14:34.729389 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:14:34.729294    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xd45c"
Jul 16 11:14:34.734198 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:14:34.734172    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xd45c"
Jul 16 11:14:35.028587 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:14:35.028561    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-lb4qx"
Jul 16 11:14:35.094649 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:14:35.094620    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xd45c"
Jul 16 11:14:35.095962 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:14:35.095935    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xd45c"
Jul 16 11:14:37.105865 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:14:37.105828    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-9fxzw" event={"ID":"3b966a79-168a-4aff-94f8-669f33082e69","Type":"ContainerStarted","Data":"fade834aefe7c273a45cdd503a3d2d923baa603872a12f15101923757123debb"}
Jul 16 11:14:37.165538 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:14:37.165479    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-9fxzw" podStartSLOduration=1.8879588360000001 podStartE2EDuration="7.16545975s" totalImagesPullingTime="5.277500914s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 11:14:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 11:14:37.162703552 +0000 UTC m=+377.534240588" watchObservedRunningTime="2026-07-16 11:14:37.16545975 +0000 UTC m=+377.536996825"
Jul 16 11:14:38.111167 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:14:38.111138    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-9fxzw"
Jul 16 11:15:05.099704 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:15:05.099672    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-555b7"
Jul 16 11:15:09.118205 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:15:09.118177    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-9fxzw"
Jul 16 11:15:16.735813 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:15:16.735748    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:15:16.832987 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:15:16.832949    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:15:16.861974 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:15:16.861927    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-8tdj6"]
Jul 16 11:15:16.862397 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:15:16.862377    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0de1cf37-b121-4969-ad8c-f04b7cc77250" containerName="discovery"
Jul 16 11:15:16.862487 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:15:16.862399    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="0de1cf37-b121-4969-ad8c-f04b7cc77250" containerName="discovery"
Jul 16 11:15:16.862539 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:15:16.862489    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="0de1cf37-b121-4969-ad8c-f04b7cc77250" containerName="discovery"
Jul 16 11:15:16.865656 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:15:16.865631    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-8tdj6"
Jul 16 11:15:16.867862 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:15:16.867835    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 16 11:15:16.867862 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:15:16.867847    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 16 11:15:16.868270 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:15:16.868251    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-bszn6\""
Jul 16 11:15:16.881526 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:15:16.881498    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-8tdj6"]
Jul 16 11:15:16.910328 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:15:16.910291    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:15:16.956243 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:15:16.956202    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5gvw2\" (UniqueName: \"kubernetes.io/projected/a4c41be6-d923-4925-bf8b-199389857658-kube-api-access-5gvw2\") pod \"kuadrant-operator-catalog-8tdj6\" (UID: \"a4c41be6-d923-4925-bf8b-199389857658\") " pod="kuadrant-system/kuadrant-operator-catalog-8tdj6"
Jul 16 11:15:17.057171 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:15:17.057132    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5gvw2\" (UniqueName: \"kubernetes.io/projected/a4c41be6-d923-4925-bf8b-199389857658-kube-api-access-5gvw2\") pod \"kuadrant-operator-catalog-8tdj6\" (UID: \"a4c41be6-d923-4925-bf8b-199389857658\") " pod="kuadrant-system/kuadrant-operator-catalog-8tdj6"
Jul 16 11:15:17.074179 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:15:17.074145    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5gvw2\" (UniqueName: \"kubernetes.io/projected/a4c41be6-d923-4925-bf8b-199389857658-kube-api-access-5gvw2\") pod \"kuadrant-operator-catalog-8tdj6\" (UID: \"a4c41be6-d923-4925-bf8b-199389857658\") " pod="kuadrant-system/kuadrant-operator-catalog-8tdj6"
Jul 16 11:15:17.176443 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:15:17.176402    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-8tdj6"
Jul 16 11:15:17.229453 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:15:17.226440    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-8tdj6"]
Jul 16 11:15:17.323589 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:15:17.323404    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-8tdj6"]
Jul 16 11:15:17.333452 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:15:17.333420    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda4c41be6_d923_4925_bf8b_199389857658.slice/crio-930ced79de1b8e10bb68903799cf2809e02a46ce11f1322090c39341493f35ca WatchSource:0}: Error finding container 930ced79de1b8e10bb68903799cf2809e02a46ce11f1322090c39341493f35ca: Status 404 returned error can't find the container with id 930ced79de1b8e10bb68903799cf2809e02a46ce11f1322090c39341493f35ca
Jul 16 11:15:17.433209 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:15:17.433172    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-69vj5"]
Jul 16 11:15:17.437671 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:15:17.437651    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-69vj5"
Jul 16 11:15:17.446606 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:15:17.446579    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-69vj5"]
Jul 16 11:15:17.561127 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:15:17.561088    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2jj76\" (UniqueName: \"kubernetes.io/projected/f24c429f-b539-4f92-882b-410db6c83b10-kube-api-access-2jj76\") pod \"kuadrant-operator-catalog-69vj5\" (UID: \"f24c429f-b539-4f92-882b-410db6c83b10\") " pod="kuadrant-system/kuadrant-operator-catalog-69vj5"
Jul 16 11:15:17.661757 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:15:17.661661    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2jj76\" (UniqueName: \"kubernetes.io/projected/f24c429f-b539-4f92-882b-410db6c83b10-kube-api-access-2jj76\") pod \"kuadrant-operator-catalog-69vj5\" (UID: \"f24c429f-b539-4f92-882b-410db6c83b10\") " pod="kuadrant-system/kuadrant-operator-catalog-69vj5"
Jul 16 11:15:17.675994 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:15:17.675963    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2jj76\" (UniqueName: \"kubernetes.io/projected/f24c429f-b539-4f92-882b-410db6c83b10-kube-api-access-2jj76\") pod \"kuadrant-operator-catalog-69vj5\" (UID: \"f24c429f-b539-4f92-882b-410db6c83b10\") " pod="kuadrant-system/kuadrant-operator-catalog-69vj5"
Jul 16 11:15:17.680808 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:15:17.680760    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:15:17.749476 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:15:17.749426    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-69vj5"
Jul 16 11:15:17.870336 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:15:17.870290    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:15:17.896612 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:15:17.896586    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-69vj5"]
Jul 16 11:15:17.930760 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:15:17.930686    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf24c429f_b539_4f92_882b_410db6c83b10.slice/crio-925c8a3f42e7f278f746134634548e3955a407e3e8be76e53a223cdbbb675917 WatchSource:0}: Error finding container 925c8a3f42e7f278f746134634548e3955a407e3e8be76e53a223cdbbb675917: Status 404 returned error can't find the container with id 925c8a3f42e7f278f746134634548e3955a407e3e8be76e53a223cdbbb675917
Jul 16 11:15:18.302655 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:15:18.302614    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-69vj5" event={"ID":"f24c429f-b539-4f92-882b-410db6c83b10","Type":"ContainerStarted","Data":"925c8a3f42e7f278f746134634548e3955a407e3e8be76e53a223cdbbb675917"}
Jul 16 11:15:18.302856 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:15:18.302676    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-8tdj6" event={"ID":"a4c41be6-d923-4925-bf8b-199389857658","Type":"ContainerStarted","Data":"930ced79de1b8e10bb68903799cf2809e02a46ce11f1322090c39341493f35ca"}
Jul 16 11:15:20.313834 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:15:20.313800    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-69vj5" event={"ID":"f24c429f-b539-4f92-882b-410db6c83b10","Type":"ContainerStarted","Data":"2289d863ea06ee885107f0ca28d9c881f6bc06d74b98debeb8fb599a9ee2fc6d"}
Jul 16 11:15:20.315338 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:15:20.315308    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-8tdj6" event={"ID":"a4c41be6-d923-4925-bf8b-199389857658","Type":"ContainerStarted","Data":"065e9fab3e1c612e7f7e2109365637fe3fcd46700219247938877c8beec27c5d"}
Jul 16 11:15:20.315458 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:15:20.315355    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-8tdj6" podUID="a4c41be6-d923-4925-bf8b-199389857658" containerName="registry-server" containerID="cri-o://065e9fab3e1c612e7f7e2109365637fe3fcd46700219247938877c8beec27c5d" gracePeriod=2
Jul 16 11:15:20.330439 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:15:20.330379    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-69vj5" podStartSLOduration=1.875354539 podStartE2EDuration="3.330357692s" totalImagesPullingTime="1.455003153s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 11:15:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 11:15:20.329895979 +0000 UTC m=+420.701433016" watchObservedRunningTime="2026-07-16 11:15:20.330357692 +0000 UTC m=+420.701894729"
Jul 16 11:15:20.347577 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:15:20.347512    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-8tdj6" podStartSLOduration=2.295738428 podStartE2EDuration="4.347491893s" totalImagesPullingTime="2.051753465s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 11:15:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 11:15:20.344427171 +0000 UTC m=+420.715964207" watchObservedRunningTime="2026-07-16 11:15:20.347491893 +0000 UTC m=+420.719028928"
Jul 16 11:15:20.566371 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:15:20.566347    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-8tdj6"
Jul 16 11:15:20.690334 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:15:20.690239    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5gvw2\" (UniqueName: \"kubernetes.io/projected/a4c41be6-d923-4925-bf8b-199389857658-kube-api-access-5gvw2\") pod \"a4c41be6-d923-4925-bf8b-199389857658\" (UID: \"a4c41be6-d923-4925-bf8b-199389857658\") "
Jul 16 11:15:20.692482 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:15:20.692452    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a4c41be6-d923-4925-bf8b-199389857658-kube-api-access-5gvw2" (OuterVolumeSpecName: "kube-api-access-5gvw2") pod "a4c41be6-d923-4925-bf8b-199389857658" (UID: "a4c41be6-d923-4925-bf8b-199389857658"). InnerVolumeSpecName "kube-api-access-5gvw2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 11:15:20.791025 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:15:20.790985    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5gvw2\" (UniqueName: \"kubernetes.io/projected/a4c41be6-d923-4925-bf8b-199389857658-kube-api-access-5gvw2\") on node \"ip-10-0-135-184.ec2.internal\" DevicePath \"\""
Jul 16 11:15:21.194434 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:15:21.194399    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:15:21.321286 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:15:21.321255    2564 generic.go:356] "Generic (PLEG): container finished" podID="a4c41be6-d923-4925-bf8b-199389857658" containerID="065e9fab3e1c612e7f7e2109365637fe3fcd46700219247938877c8beec27c5d" exitCode=0
Jul 16 11:15:21.321286 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:15:21.321292    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-8tdj6"
Jul 16 11:15:21.321727 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:15:21.321343    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-8tdj6" event={"ID":"a4c41be6-d923-4925-bf8b-199389857658","Type":"ContainerDied","Data":"065e9fab3e1c612e7f7e2109365637fe3fcd46700219247938877c8beec27c5d"}
Jul 16 11:15:21.321727 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:15:21.321392    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-8tdj6" event={"ID":"a4c41be6-d923-4925-bf8b-199389857658","Type":"ContainerDied","Data":"930ced79de1b8e10bb68903799cf2809e02a46ce11f1322090c39341493f35ca"}
Jul 16 11:15:21.321727 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:15:21.321421    2564 scope.go:117] "RemoveContainer" containerID="065e9fab3e1c612e7f7e2109365637fe3fcd46700219247938877c8beec27c5d"
Jul 16 11:15:21.331058 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:15:21.331037    2564 scope.go:117] "RemoveContainer" containerID="065e9fab3e1c612e7f7e2109365637fe3fcd46700219247938877c8beec27c5d"
Jul 16 11:15:21.331352 ip-10-0-135-184 kubenswrapper[2564]: E0716 11:15:21.331335    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"065e9fab3e1c612e7f7e2109365637fe3fcd46700219247938877c8beec27c5d\": container with ID starting with 065e9fab3e1c612e7f7e2109365637fe3fcd46700219247938877c8beec27c5d not found: ID does not exist" containerID="065e9fab3e1c612e7f7e2109365637fe3fcd46700219247938877c8beec27c5d"
Jul 16 11:15:21.331390 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:15:21.331364    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"065e9fab3e1c612e7f7e2109365637fe3fcd46700219247938877c8beec27c5d"} err="failed to get container status \"065e9fab3e1c612e7f7e2109365637fe3fcd46700219247938877c8beec27c5d\": rpc error: code = NotFound desc = could not find container \"065e9fab3e1c612e7f7e2109365637fe3fcd46700219247938877c8beec27c5d\": container with ID starting with 065e9fab3e1c612e7f7e2109365637fe3fcd46700219247938877c8beec27c5d not found: ID does not exist"
Jul 16 11:15:21.342236 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:15:21.342206    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-8tdj6"]
Jul 16 11:15:21.346337 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:15:21.346309    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-8tdj6"]
Jul 16 11:15:22.301671 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:15:22.301636    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a4c41be6-d923-4925-bf8b-199389857658" path="/var/lib/kubelet/pods/a4c41be6-d923-4925-bf8b-199389857658/volumes"
Jul 16 11:15:27.749671 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:15:27.749632    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-69vj5"
Jul 16 11:15:27.750135 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:15:27.749738    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-69vj5"
Jul 16 11:15:27.774354 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:15:27.774325    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-69vj5"
Jul 16 11:15:28.377711 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:15:28.377677    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-69vj5"
Jul 16 11:15:31.892740 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:15:31.892705    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:15:31.998175 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:15:31.998145    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:15:32.093722 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:15:32.093684    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:15:45.186656 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:15:45.186622    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:15:48.649710 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:15:48.649672    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:15:50.129291 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:15:50.129258    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mt777"]
Jul 16 11:15:50.129683 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:15:50.129637    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a4c41be6-d923-4925-bf8b-199389857658" containerName="registry-server"
Jul 16 11:15:50.129683 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:15:50.129650    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="a4c41be6-d923-4925-bf8b-199389857658" containerName="registry-server"
Jul 16 11:15:50.129760 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:15:50.129718    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="a4c41be6-d923-4925-bf8b-199389857658" containerName="registry-server"
Jul 16 11:15:50.132704 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:15:50.132685    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mt777"
Jul 16 11:15:50.135808 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:15:50.135758    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-68fj7\""
Jul 16 11:15:50.152794 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:15:50.152741    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mt777"]
Jul 16 11:15:50.213998 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:15:50.213949    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:15:50.250043 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:15:50.249997    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z7v7g\" (UniqueName: \"kubernetes.io/projected/bcd53a20-7766-4112-baf5-67bbef3a5586-kube-api-access-z7v7g\") pod \"kuadrant-operator-controller-manager-8684c9ff49-mt777\" (UID: \"bcd53a20-7766-4112-baf5-67bbef3a5586\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mt777"
Jul 16 11:15:50.250225 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:15:50.250071    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/bcd53a20-7766-4112-baf5-67bbef3a5586-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-mt777\" (UID: \"bcd53a20-7766-4112-baf5-67bbef3a5586\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mt777"
Jul 16 11:15:50.351132 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:15:50.351100    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z7v7g\" (UniqueName: \"kubernetes.io/projected/bcd53a20-7766-4112-baf5-67bbef3a5586-kube-api-access-z7v7g\") pod \"kuadrant-operator-controller-manager-8684c9ff49-mt777\" (UID: \"bcd53a20-7766-4112-baf5-67bbef3a5586\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mt777"
Jul 16 11:15:50.351306 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:15:50.351151    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/bcd53a20-7766-4112-baf5-67bbef3a5586-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-mt777\" (UID: \"bcd53a20-7766-4112-baf5-67bbef3a5586\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mt777"
Jul 16 11:15:50.351519 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:15:50.351501    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/bcd53a20-7766-4112-baf5-67bbef3a5586-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-mt777\" (UID: \"bcd53a20-7766-4112-baf5-67bbef3a5586\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mt777"
Jul 16 11:15:50.360170 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:15:50.360141    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z7v7g\" (UniqueName: \"kubernetes.io/projected/bcd53a20-7766-4112-baf5-67bbef3a5586-kube-api-access-z7v7g\") pod \"kuadrant-operator-controller-manager-8684c9ff49-mt777\" (UID: \"bcd53a20-7766-4112-baf5-67bbef3a5586\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mt777"
Jul 16 11:15:50.443435 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:15:50.443334    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mt777"
Jul 16 11:15:50.622802 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:15:50.622036    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mt777"]
Jul 16 11:15:50.649621 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:15:50.649583    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:15:51.474493 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:15:51.474454    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mt777" event={"ID":"bcd53a20-7766-4112-baf5-67bbef3a5586","Type":"ContainerStarted","Data":"3332a71b282c40acd5ee91df50ea6fba3430469aed031ef080f2ac6424a5273f"}
Jul 16 11:15:51.700423 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:15:51.700384    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:15:51.802310 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:15:51.802275    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:15:52.516272 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:15:52.516233    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-hflvv"]
Jul 16 11:15:52.520218 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:15:52.520188    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-hflvv"
Jul 16 11:15:52.522475 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:15:52.522445    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-4fvqg\""
Jul 16 11:15:52.534695 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:15:52.534616    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-hflvv"]
Jul 16 11:15:52.670235 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:15:52.670200    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nlk5l\" (UniqueName: \"kubernetes.io/projected/720e7931-30ba-4fe0-a497-225b75a6a9b7-kube-api-access-nlk5l\") pod \"authorino-operator-75cc8d5cb7-hflvv\" (UID: \"720e7931-30ba-4fe0-a497-225b75a6a9b7\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-hflvv"
Jul 16 11:15:52.771821 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:15:52.771681    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nlk5l\" (UniqueName: \"kubernetes.io/projected/720e7931-30ba-4fe0-a497-225b75a6a9b7-kube-api-access-nlk5l\") pod \"authorino-operator-75cc8d5cb7-hflvv\" (UID: \"720e7931-30ba-4fe0-a497-225b75a6a9b7\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-hflvv"
Jul 16 11:15:52.788100 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:15:52.788075    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nlk5l\" (UniqueName: \"kubernetes.io/projected/720e7931-30ba-4fe0-a497-225b75a6a9b7-kube-api-access-nlk5l\") pod \"authorino-operator-75cc8d5cb7-hflvv\" (UID: \"720e7931-30ba-4fe0-a497-225b75a6a9b7\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-hflvv"
Jul 16 11:15:52.837073 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:15:52.837036    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-hflvv"
Jul 16 11:15:52.979595 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:15:52.979560    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-hflvv"]
Jul 16 11:15:52.983819 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:15:52.983754    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod720e7931_30ba_4fe0_a497_225b75a6a9b7.slice/crio-3609d629f57919eb758ea05457751d3159e4d87baf66d60e0f9394687c29414d WatchSource:0}: Error finding container 3609d629f57919eb758ea05457751d3159e4d87baf66d60e0f9394687c29414d: Status 404 returned error can't find the container with id 3609d629f57919eb758ea05457751d3159e4d87baf66d60e0f9394687c29414d
Jul 16 11:15:53.190968 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:15:53.190883    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:15:53.489236 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:15:53.489139    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-hflvv" event={"ID":"720e7931-30ba-4fe0-a497-225b75a6a9b7","Type":"ContainerStarted","Data":"3609d629f57919eb758ea05457751d3159e4d87baf66d60e0f9394687c29414d"}
Jul 16 11:15:54.233342 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:15:54.233229    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:15:54.573216 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:15:54.573175    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4vg5m"]
Jul 16 11:15:54.582867 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:15:54.582834    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4vg5m"
Jul 16 11:15:54.586251 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:15:54.586221    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-j24dw\""
Jul 16 11:15:54.593294 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:15:54.593267    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4vg5m"]
Jul 16 11:15:54.697136 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:15:54.697043    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jhhqw\" (UniqueName: \"kubernetes.io/projected/ff0f7af0-ef70-4842-ba23-61d61c6b8d0a-kube-api-access-jhhqw\") pod \"limitador-operator-controller-manager-859d7b78bd-4vg5m\" (UID: \"ff0f7af0-ef70-4842-ba23-61d61c6b8d0a\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4vg5m"
Jul 16 11:15:54.798724 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:15:54.798681    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jhhqw\" (UniqueName: \"kubernetes.io/projected/ff0f7af0-ef70-4842-ba23-61d61c6b8d0a-kube-api-access-jhhqw\") pod \"limitador-operator-controller-manager-859d7b78bd-4vg5m\" (UID: \"ff0f7af0-ef70-4842-ba23-61d61c6b8d0a\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4vg5m"
Jul 16 11:15:54.813148 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:15:54.813081    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jhhqw\" (UniqueName: \"kubernetes.io/projected/ff0f7af0-ef70-4842-ba23-61d61c6b8d0a-kube-api-access-jhhqw\") pod \"limitador-operator-controller-manager-859d7b78bd-4vg5m\" (UID: \"ff0f7af0-ef70-4842-ba23-61d61c6b8d0a\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4vg5m"
Jul 16 11:15:54.899564 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:15:54.899456    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4vg5m"
Jul 16 11:15:55.342534 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:15:55.342506    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4vg5m"]
Jul 16 11:15:55.344613 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:15:55.344587    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podff0f7af0_ef70_4842_ba23_61d61c6b8d0a.slice/crio-ee1d67208b600a5a8b3d77c7279a3a845d5e8d4e86837248f61c78bc0d43cf35 WatchSource:0}: Error finding container ee1d67208b600a5a8b3d77c7279a3a845d5e8d4e86837248f61c78bc0d43cf35: Status 404 returned error can't find the container with id ee1d67208b600a5a8b3d77c7279a3a845d5e8d4e86837248f61c78bc0d43cf35
Jul 16 11:15:55.502459 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:15:55.502421    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4vg5m" event={"ID":"ff0f7af0-ef70-4842-ba23-61d61c6b8d0a","Type":"ContainerStarted","Data":"ee1d67208b600a5a8b3d77c7279a3a845d5e8d4e86837248f61c78bc0d43cf35"}
Jul 16 11:15:55.504351 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:15:55.504317    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-hflvv" event={"ID":"720e7931-30ba-4fe0-a497-225b75a6a9b7","Type":"ContainerStarted","Data":"e69214471965b9cf057a7819242e907424235ba9b91b08fd60a29b601ab7194b"}
Jul 16 11:15:55.504537 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:15:55.504520    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-hflvv"
Jul 16 11:15:55.530110 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:15:55.530025    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-hflvv" podStartSLOduration=1.274213262 podStartE2EDuration="3.530003224s" totalImagesPullingTime="2.255789962s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 11:15:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 11:15:55.529350735 +0000 UTC m=+455.900887767" watchObservedRunningTime="2026-07-16 11:15:55.530003224 +0000 UTC m=+455.901540261"
Jul 16 11:15:55.618939 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:15:55.618865    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:15:56.835411 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:15:56.835355    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:15:57.439171 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:15:57.439133    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-d85nj"]
Jul 16 11:15:57.444143 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:15:57.444113    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-d85nj"
Jul 16 11:15:57.447087 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:15:57.447062    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
Jul 16 11:15:57.447180 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:15:57.447106    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-q6bv5\""
Jul 16 11:15:57.457221 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:15:57.457123    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-d85nj"]
Jul 16 11:15:57.521312 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:15:57.521237    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mt777" event={"ID":"bcd53a20-7766-4112-baf5-67bbef3a5586","Type":"ContainerStarted","Data":"7ed0a33e6a0ee3dff545384bf3b763ab1098d96957876eb8675ef7d9aff94c1e"}
Jul 16 11:15:57.521519 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:15:57.521398    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mt777"
Jul 16 11:15:57.529972 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:15:57.529939    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4w2vj\" (UniqueName: \"kubernetes.io/projected/6cff258f-0591-4972-abb1-b4b13a61918f-kube-api-access-4w2vj\") pod \"dns-operator-controller-manager-864dd78c4c-d85nj\" (UID: \"6cff258f-0591-4972-abb1-b4b13a61918f\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-d85nj"
Jul 16 11:15:57.542242 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:15:57.542183    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mt777" podStartSLOduration=0.942572619 podStartE2EDuration="7.542159134s" totalImagesPullingTime="6.599586515s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 11:15:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 11:15:57.540000678 +0000 UTC m=+457.911537770" watchObservedRunningTime="2026-07-16 11:15:57.542159134 +0000 UTC m=+457.913696170"
Jul 16 11:15:57.631507 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:15:57.631444    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4w2vj\" (UniqueName: \"kubernetes.io/projected/6cff258f-0591-4972-abb1-b4b13a61918f-kube-api-access-4w2vj\") pod \"dns-operator-controller-manager-864dd78c4c-d85nj\" (UID: \"6cff258f-0591-4972-abb1-b4b13a61918f\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-d85nj"
Jul 16 11:15:57.640820 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:15:57.640786    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4w2vj\" (UniqueName: \"kubernetes.io/projected/6cff258f-0591-4972-abb1-b4b13a61918f-kube-api-access-4w2vj\") pod \"dns-operator-controller-manager-864dd78c4c-d85nj\" (UID: \"6cff258f-0591-4972-abb1-b4b13a61918f\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-d85nj"
Jul 16 11:15:57.760066 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:15:57.759994    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-d85nj"
Jul 16 11:15:58.203282 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:15:58.203248    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-d85nj"]
Jul 16 11:15:58.206442 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:15:58.206411    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6cff258f_0591_4972_abb1_b4b13a61918f.slice/crio-12f9d3ce3e834d29601c76cd6d33b6d8d0fca00d04a5fdeccd41516722541d08 WatchSource:0}: Error finding container 12f9d3ce3e834d29601c76cd6d33b6d8d0fca00d04a5fdeccd41516722541d08: Status 404 returned error can't find the container with id 12f9d3ce3e834d29601c76cd6d33b6d8d0fca00d04a5fdeccd41516722541d08
Jul 16 11:15:58.529466 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:15:58.529426    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4vg5m" event={"ID":"ff0f7af0-ef70-4842-ba23-61d61c6b8d0a","Type":"ContainerStarted","Data":"f5bea5b75dd5c51430186d8d5a4df3cb947f47f7dd7634d837d47a2fabc02d35"}
Jul 16 11:15:58.529660 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:15:58.529525    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4vg5m"
Jul 16 11:15:58.531013 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:15:58.530977    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-d85nj" event={"ID":"6cff258f-0591-4972-abb1-b4b13a61918f","Type":"ContainerStarted","Data":"12f9d3ce3e834d29601c76cd6d33b6d8d0fca00d04a5fdeccd41516722541d08"}
Jul 16 11:15:58.550452 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:15:58.550384    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4vg5m" podStartSLOduration=1.80358611 podStartE2EDuration="4.550357411s" totalImagesPullingTime="2.746771301s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 11:15:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 11:15:58.54851012 +0000 UTC m=+458.920047150" watchObservedRunningTime="2026-07-16 11:15:58.550357411 +0000 UTC m=+458.921894450"
Jul 16 11:15:59.408916 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:15:59.408872    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:15:59.510443 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:15:59.510404    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:16:00.543107 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:16:00.543067    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-d85nj" event={"ID":"6cff258f-0591-4972-abb1-b4b13a61918f","Type":"ContainerStarted","Data":"dba6966a062d1f5ac4ac9867b646594202fc35b27249147fdc775e5a4e32cd19"}
Jul 16 11:16:00.543493 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:16:00.543246    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-d85nj"
Jul 16 11:16:00.567182 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:16:00.567130    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-d85nj" podStartSLOduration=1.428191921 podStartE2EDuration="3.567108868s" totalImagesPullingTime="2.138916947s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 11:15:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 11:16:00.565040002 +0000 UTC m=+460.936577040" watchObservedRunningTime="2026-07-16 11:16:00.567108868 +0000 UTC m=+460.938645904"
Jul 16 11:16:00.571820 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:16:00.571787    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:16:01.024282 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:16:01.024244    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:16:06.514291 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:16:06.514263    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-hflvv"
Jul 16 11:16:08.533352 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:16:08.533309    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mt777"
Jul 16 11:16:09.444956 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:16:09.444920    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:16:09.539546 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:16:09.539513    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4vg5m"
Jul 16 11:16:09.548419 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:16:09.548388    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:16:10.256143 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:16:10.256104    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mt777"]
Jul 16 11:16:10.256349 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:16:10.256323    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mt777" podUID="bcd53a20-7766-4112-baf5-67bbef3a5586" containerName="manager" containerID="cri-o://7ed0a33e6a0ee3dff545384bf3b763ab1098d96957876eb8675ef7d9aff94c1e" gracePeriod=2
Jul 16 11:16:10.265716 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:16:10.265690    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mt777"]
Jul 16 11:16:10.280592 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:16:10.280558    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4vg5m"]
Jul 16 11:16:10.280967 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:16:10.280849    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4vg5m" podUID="ff0f7af0-ef70-4842-ba23-61d61c6b8d0a" containerName="manager" containerID="cri-o://f5bea5b75dd5c51430186d8d5a4df3cb947f47f7dd7634d837d47a2fabc02d35" gracePeriod=2
Jul 16 11:16:10.283161 ip-10-0-135-184 kubenswrapper[2564]: E0716 11:16:10.283123    2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-mt777\" is forbidden: User \"system:node:ip-10-0-135-184.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-184.ec2.internal' and this object" podUID="bcd53a20-7766-4112-baf5-67bbef3a5586" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mt777"
Jul 16 11:16:10.284827 ip-10-0-135-184 kubenswrapper[2564]: E0716 11:16:10.284795    2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-4vg5m\" is forbidden: User \"system:node:ip-10-0-135-184.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-184.ec2.internal' and this object" podUID="ff0f7af0-ef70-4842-ba23-61d61c6b8d0a" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4vg5m"
Jul 16 11:16:10.285231 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:16:10.285207    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4vg5m"]
Jul 16 11:16:10.300622 ip-10-0-135-184 kubenswrapper[2564]: E0716 11:16:10.300577    2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-mt777\" is forbidden: User \"system:node:ip-10-0-135-184.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-184.ec2.internal' and this object" podUID="bcd53a20-7766-4112-baf5-67bbef3a5586" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mt777"
Jul 16 11:16:10.302703 ip-10-0-135-184 kubenswrapper[2564]: E0716 11:16:10.302650    2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-4vg5m\" is forbidden: User \"system:node:ip-10-0-135-184.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-184.ec2.internal' and this object" podUID="ff0f7af0-ef70-4842-ba23-61d61c6b8d0a" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4vg5m"
Jul 16 11:16:10.305427 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:16:10.305392    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7nxr4"]
Jul 16 11:16:10.307324 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:16:10.307297    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bcd53a20-7766-4112-baf5-67bbef3a5586" containerName="manager"
Jul 16 11:16:10.309161 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:16:10.309083    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="bcd53a20-7766-4112-baf5-67bbef3a5586" containerName="manager"
Jul 16 11:16:10.309161 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:16:10.309124    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ff0f7af0-ef70-4842-ba23-61d61c6b8d0a" containerName="manager"
Jul 16 11:16:10.309161 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:16:10.309135    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="ff0f7af0-ef70-4842-ba23-61d61c6b8d0a" containerName="manager"
Jul 16 11:16:10.309554 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:16:10.309387    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="ff0f7af0-ef70-4842-ba23-61d61c6b8d0a" containerName="manager"
Jul 16 11:16:10.309554 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:16:10.309404    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="bcd53a20-7766-4112-baf5-67bbef3a5586" containerName="manager"
Jul 16 11:16:10.317972 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:16:10.317479    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7nxr4"
Jul 16 11:16:10.321261 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:16:10.321227    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7nxr4"]
Jul 16 11:16:10.323999 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:16:10.323965    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-x6hww"]
Jul 16 11:16:10.327810 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:16:10.327789    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-x6hww"
Jul 16 11:16:10.341071 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:16:10.340914    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-x6hww"]
Jul 16 11:16:10.352403 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:16:10.352371    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xh9bg\" (UniqueName: \"kubernetes.io/projected/f042e41d-8110-44ca-a69d-2bebe7effe60-kube-api-access-xh9bg\") pod \"limitador-operator-controller-manager-859d7b78bd-x6hww\" (UID: \"f042e41d-8110-44ca-a69d-2bebe7effe60\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-x6hww"
Jul 16 11:16:10.352688 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:16:10.352659    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hzp22\" (UniqueName: \"kubernetes.io/projected/81323f63-0088-4145-abcc-945e69c3f1b7-kube-api-access-hzp22\") pod \"kuadrant-operator-controller-manager-8684c9ff49-7nxr4\" (UID: \"81323f63-0088-4145-abcc-945e69c3f1b7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7nxr4"
Jul 16 11:16:10.352845 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:16:10.352704    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/81323f63-0088-4145-abcc-945e69c3f1b7-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-7nxr4\" (UID: \"81323f63-0088-4145-abcc-945e69c3f1b7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7nxr4"
Jul 16 11:16:10.453366 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:16:10.453305    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/81323f63-0088-4145-abcc-945e69c3f1b7-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-7nxr4\" (UID: \"81323f63-0088-4145-abcc-945e69c3f1b7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7nxr4"
Jul 16 11:16:10.453493 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:16:10.453461    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xh9bg\" (UniqueName: \"kubernetes.io/projected/f042e41d-8110-44ca-a69d-2bebe7effe60-kube-api-access-xh9bg\") pod \"limitador-operator-controller-manager-859d7b78bd-x6hww\" (UID: \"f042e41d-8110-44ca-a69d-2bebe7effe60\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-x6hww"
Jul 16 11:16:10.453553 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:16:10.453517    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hzp22\" (UniqueName: \"kubernetes.io/projected/81323f63-0088-4145-abcc-945e69c3f1b7-kube-api-access-hzp22\") pod \"kuadrant-operator-controller-manager-8684c9ff49-7nxr4\" (UID: \"81323f63-0088-4145-abcc-945e69c3f1b7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7nxr4"
Jul 16 11:16:10.454095 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:16:10.453991    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/81323f63-0088-4145-abcc-945e69c3f1b7-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-7nxr4\" (UID: \"81323f63-0088-4145-abcc-945e69c3f1b7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7nxr4"
Jul 16 11:16:10.469910 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:16:10.466954    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hzp22\" (UniqueName: \"kubernetes.io/projected/81323f63-0088-4145-abcc-945e69c3f1b7-kube-api-access-hzp22\") pod \"kuadrant-operator-controller-manager-8684c9ff49-7nxr4\" (UID: \"81323f63-0088-4145-abcc-945e69c3f1b7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7nxr4"
Jul 16 11:16:10.469910 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:16:10.467417    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xh9bg\" (UniqueName: \"kubernetes.io/projected/f042e41d-8110-44ca-a69d-2bebe7effe60-kube-api-access-xh9bg\") pod \"limitador-operator-controller-manager-859d7b78bd-x6hww\" (UID: \"f042e41d-8110-44ca-a69d-2bebe7effe60\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-x6hww"
Jul 16 11:16:10.525687 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:16:10.525655    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mt777"
Jul 16 11:16:10.536338 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:16:10.536317    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4vg5m"
Jul 16 11:16:10.554893 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:16:10.554856    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/bcd53a20-7766-4112-baf5-67bbef3a5586-extensions-socket-volume\") pod \"bcd53a20-7766-4112-baf5-67bbef3a5586\" (UID: \"bcd53a20-7766-4112-baf5-67bbef3a5586\") "
Jul 16 11:16:10.555339 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:16:10.554908    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z7v7g\" (UniqueName: \"kubernetes.io/projected/bcd53a20-7766-4112-baf5-67bbef3a5586-kube-api-access-z7v7g\") pod \"bcd53a20-7766-4112-baf5-67bbef3a5586\" (UID: \"bcd53a20-7766-4112-baf5-67bbef3a5586\") "
Jul 16 11:16:10.555339 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:16:10.554966    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jhhqw\" (UniqueName: \"kubernetes.io/projected/ff0f7af0-ef70-4842-ba23-61d61c6b8d0a-kube-api-access-jhhqw\") pod \"ff0f7af0-ef70-4842-ba23-61d61c6b8d0a\" (UID: \"ff0f7af0-ef70-4842-ba23-61d61c6b8d0a\") "
Jul 16 11:16:10.555413 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:16:10.555338    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bcd53a20-7766-4112-baf5-67bbef3a5586-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "bcd53a20-7766-4112-baf5-67bbef3a5586" (UID: "bcd53a20-7766-4112-baf5-67bbef3a5586"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 11:16:10.557122 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:16:10.557092    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ff0f7af0-ef70-4842-ba23-61d61c6b8d0a-kube-api-access-jhhqw" (OuterVolumeSpecName: "kube-api-access-jhhqw") pod "ff0f7af0-ef70-4842-ba23-61d61c6b8d0a" (UID: "ff0f7af0-ef70-4842-ba23-61d61c6b8d0a"). InnerVolumeSpecName "kube-api-access-jhhqw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 11:16:10.557226 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:16:10.557202    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bcd53a20-7766-4112-baf5-67bbef3a5586-kube-api-access-z7v7g" (OuterVolumeSpecName: "kube-api-access-z7v7g") pod "bcd53a20-7766-4112-baf5-67bbef3a5586" (UID: "bcd53a20-7766-4112-baf5-67bbef3a5586"). InnerVolumeSpecName "kube-api-access-z7v7g". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 11:16:10.596358 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:16:10.596326    2564 generic.go:356] "Generic (PLEG): container finished" podID="bcd53a20-7766-4112-baf5-67bbef3a5586" containerID="7ed0a33e6a0ee3dff545384bf3b763ab1098d96957876eb8675ef7d9aff94c1e" exitCode=0
Jul 16 11:16:10.596539 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:16:10.596369    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mt777"
Jul 16 11:16:10.596539 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:16:10.596430    2564 scope.go:117] "RemoveContainer" containerID="7ed0a33e6a0ee3dff545384bf3b763ab1098d96957876eb8675ef7d9aff94c1e"
Jul 16 11:16:10.597929 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:16:10.597907    2564 generic.go:356] "Generic (PLEG): container finished" podID="ff0f7af0-ef70-4842-ba23-61d61c6b8d0a" containerID="f5bea5b75dd5c51430186d8d5a4df3cb947f47f7dd7634d837d47a2fabc02d35" exitCode=0
Jul 16 11:16:10.598035 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:16:10.597958    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4vg5m"
Jul 16 11:16:10.606716 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:16:10.606698    2564 scope.go:117] "RemoveContainer" containerID="7ed0a33e6a0ee3dff545384bf3b763ab1098d96957876eb8675ef7d9aff94c1e"
Jul 16 11:16:10.607046 ip-10-0-135-184 kubenswrapper[2564]: E0716 11:16:10.607026    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7ed0a33e6a0ee3dff545384bf3b763ab1098d96957876eb8675ef7d9aff94c1e\": container with ID starting with 7ed0a33e6a0ee3dff545384bf3b763ab1098d96957876eb8675ef7d9aff94c1e not found: ID does not exist" containerID="7ed0a33e6a0ee3dff545384bf3b763ab1098d96957876eb8675ef7d9aff94c1e"
Jul 16 11:16:10.607120 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:16:10.607054    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7ed0a33e6a0ee3dff545384bf3b763ab1098d96957876eb8675ef7d9aff94c1e"} err="failed to get container status \"7ed0a33e6a0ee3dff545384bf3b763ab1098d96957876eb8675ef7d9aff94c1e\": rpc error: code = NotFound desc = could not find container \"7ed0a33e6a0ee3dff545384bf3b763ab1098d96957876eb8675ef7d9aff94c1e\": container with ID starting with 7ed0a33e6a0ee3dff545384bf3b763ab1098d96957876eb8675ef7d9aff94c1e not found: ID does not exist"
Jul 16 11:16:10.607120 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:16:10.607078    2564 scope.go:117] "RemoveContainer" containerID="f5bea5b75dd5c51430186d8d5a4df3cb947f47f7dd7634d837d47a2fabc02d35"
Jul 16 11:16:10.615860 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:16:10.615837    2564 scope.go:117] "RemoveContainer" containerID="f5bea5b75dd5c51430186d8d5a4df3cb947f47f7dd7634d837d47a2fabc02d35"
Jul 16 11:16:10.616192 ip-10-0-135-184 kubenswrapper[2564]: E0716 11:16:10.616170    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f5bea5b75dd5c51430186d8d5a4df3cb947f47f7dd7634d837d47a2fabc02d35\": container with ID starting with f5bea5b75dd5c51430186d8d5a4df3cb947f47f7dd7634d837d47a2fabc02d35 not found: ID does not exist" containerID="f5bea5b75dd5c51430186d8d5a4df3cb947f47f7dd7634d837d47a2fabc02d35"
Jul 16 11:16:10.616251 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:16:10.616200    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f5bea5b75dd5c51430186d8d5a4df3cb947f47f7dd7634d837d47a2fabc02d35"} err="failed to get container status \"f5bea5b75dd5c51430186d8d5a4df3cb947f47f7dd7634d837d47a2fabc02d35\": rpc error: code = NotFound desc = could not find container \"f5bea5b75dd5c51430186d8d5a4df3cb947f47f7dd7634d837d47a2fabc02d35\": container with ID starting with f5bea5b75dd5c51430186d8d5a4df3cb947f47f7dd7634d837d47a2fabc02d35 not found: ID does not exist"
Jul 16 11:16:10.655943 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:16:10.655904    2564 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/bcd53a20-7766-4112-baf5-67bbef3a5586-extensions-socket-volume\") on node \"ip-10-0-135-184.ec2.internal\" DevicePath \"\""
Jul 16 11:16:10.655943 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:16:10.655935    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z7v7g\" (UniqueName: \"kubernetes.io/projected/bcd53a20-7766-4112-baf5-67bbef3a5586-kube-api-access-z7v7g\") on node \"ip-10-0-135-184.ec2.internal\" DevicePath \"\""
Jul 16 11:16:10.655943 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:16:10.655945    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jhhqw\" (UniqueName: \"kubernetes.io/projected/ff0f7af0-ef70-4842-ba23-61d61c6b8d0a-kube-api-access-jhhqw\") on node \"ip-10-0-135-184.ec2.internal\" DevicePath \"\""
Jul 16 11:16:10.692844 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:16:10.692810    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7nxr4"
Jul 16 11:16:10.701399 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:16:10.701374    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-x6hww"
Jul 16 11:16:10.857070 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:16:10.857038    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7nxr4"]
Jul 16 11:16:10.860267 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:16:10.860235    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod81323f63_0088_4145_abcc_945e69c3f1b7.slice/crio-7003628fb92fea7214e17c726628c8b08732ac1409e30c19e9a6997fff9d2b1f WatchSource:0}: Error finding container 7003628fb92fea7214e17c726628c8b08732ac1409e30c19e9a6997fff9d2b1f: Status 404 returned error can't find the container with id 7003628fb92fea7214e17c726628c8b08732ac1409e30c19e9a6997fff9d2b1f
Jul 16 11:16:10.875162 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:16:10.875132    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-x6hww"]
Jul 16 11:16:10.879291 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:16:10.879266    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf042e41d_8110_44ca_a69d_2bebe7effe60.slice/crio-040ec4dc39ccbe396b21b940e4675328438b1b2844f3ce56140c20d6e988f941 WatchSource:0}: Error finding container 040ec4dc39ccbe396b21b940e4675328438b1b2844f3ce56140c20d6e988f941: Status 404 returned error can't find the container with id 040ec4dc39ccbe396b21b940e4675328438b1b2844f3ce56140c20d6e988f941
Jul 16 11:16:11.550908 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:16:11.550819    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-d85nj"
Jul 16 11:16:11.605473 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:16:11.605433    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-x6hww" event={"ID":"f042e41d-8110-44ca-a69d-2bebe7effe60","Type":"ContainerStarted","Data":"566dcf4498cdca62a08ebac87234b500ea6764f94d2be0c19001f71efc85120d"}
Jul 16 11:16:11.605930 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:16:11.605493    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-x6hww" event={"ID":"f042e41d-8110-44ca-a69d-2bebe7effe60","Type":"ContainerStarted","Data":"040ec4dc39ccbe396b21b940e4675328438b1b2844f3ce56140c20d6e988f941"}
Jul 16 11:16:11.605930 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:16:11.605540    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-x6hww"
Jul 16 11:16:11.607852 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:16:11.607828    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7nxr4" event={"ID":"81323f63-0088-4145-abcc-945e69c3f1b7","Type":"ContainerStarted","Data":"73fa5036b13701be7a6585db71b22855fd10816110884c2d74de8a0f50bb4fe5"}
Jul 16 11:16:11.607994 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:16:11.607873    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7nxr4" event={"ID":"81323f63-0088-4145-abcc-945e69c3f1b7","Type":"ContainerStarted","Data":"7003628fb92fea7214e17c726628c8b08732ac1409e30c19e9a6997fff9d2b1f"}
Jul 16 11:16:11.607994 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:16:11.607914    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7nxr4"
Jul 16 11:16:11.640400 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:16:11.640297    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-x6hww" podStartSLOduration=1.640270543 podStartE2EDuration="1.640270543s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 11:16:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 11:16:11.638810837 +0000 UTC m=+472.010347875" watchObservedRunningTime="2026-07-16 11:16:11.640270543 +0000 UTC m=+472.011807580"
Jul 16 11:16:11.667537 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:16:11.667474    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7nxr4" podStartSLOduration=1.667451764 podStartE2EDuration="1.667451764s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 11:16:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 11:16:11.667450994 +0000 UTC m=+472.038988031" watchObservedRunningTime="2026-07-16 11:16:11.667451764 +0000 UTC m=+472.038988805"
Jul 16 11:16:12.302116 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:16:12.302082    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bcd53a20-7766-4112-baf5-67bbef3a5586" path="/var/lib/kubelet/pods/bcd53a20-7766-4112-baf5-67bbef3a5586/volumes"
Jul 16 11:16:12.302425 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:16:12.302412    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ff0f7af0-ef70-4842-ba23-61d61c6b8d0a" path="/var/lib/kubelet/pods/ff0f7af0-ef70-4842-ba23-61d61c6b8d0a/volumes"
Jul 16 11:16:13.222335 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:16:13.222295    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:16:13.346070 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:16:13.346034    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:16:16.808012 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:16:16.807979    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:16:16.913996 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:16:16.913941    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:16:22.005671 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:16:22.005633    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:16:22.062491 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:16:22.062446    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:16:22.615662 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:16:22.615632    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-x6hww"
Jul 16 11:16:22.615877 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:16:22.615697    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7nxr4"
Jul 16 11:16:27.669955 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:16:27.669916    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7nxr4"]
Jul 16 11:16:27.670410 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:16:27.670142    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7nxr4" podUID="81323f63-0088-4145-abcc-945e69c3f1b7" containerName="manager" containerID="cri-o://73fa5036b13701be7a6585db71b22855fd10816110884c2d74de8a0f50bb4fe5" gracePeriod=10
Jul 16 11:16:28.226904 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:16:28.226874    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7nxr4"
Jul 16 11:16:28.313679 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:16:28.313599    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hzp22\" (UniqueName: \"kubernetes.io/projected/81323f63-0088-4145-abcc-945e69c3f1b7-kube-api-access-hzp22\") pod \"81323f63-0088-4145-abcc-945e69c3f1b7\" (UID: \"81323f63-0088-4145-abcc-945e69c3f1b7\") "
Jul 16 11:16:28.313679 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:16:28.313634    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/81323f63-0088-4145-abcc-945e69c3f1b7-extensions-socket-volume\") pod \"81323f63-0088-4145-abcc-945e69c3f1b7\" (UID: \"81323f63-0088-4145-abcc-945e69c3f1b7\") "
Jul 16 11:16:28.314110 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:16:28.314076    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/81323f63-0088-4145-abcc-945e69c3f1b7-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "81323f63-0088-4145-abcc-945e69c3f1b7" (UID: "81323f63-0088-4145-abcc-945e69c3f1b7"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 11:16:28.315808 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:16:28.315759    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/81323f63-0088-4145-abcc-945e69c3f1b7-kube-api-access-hzp22" (OuterVolumeSpecName: "kube-api-access-hzp22") pod "81323f63-0088-4145-abcc-945e69c3f1b7" (UID: "81323f63-0088-4145-abcc-945e69c3f1b7"). InnerVolumeSpecName "kube-api-access-hzp22". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 11:16:28.414581 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:16:28.414546    2564 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/81323f63-0088-4145-abcc-945e69c3f1b7-extensions-socket-volume\") on node \"ip-10-0-135-184.ec2.internal\" DevicePath \"\""
Jul 16 11:16:28.414581 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:16:28.414576    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hzp22\" (UniqueName: \"kubernetes.io/projected/81323f63-0088-4145-abcc-945e69c3f1b7-kube-api-access-hzp22\") on node \"ip-10-0-135-184.ec2.internal\" DevicePath \"\""
Jul 16 11:16:28.695986 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:16:28.695893    2564 generic.go:356] "Generic (PLEG): container finished" podID="81323f63-0088-4145-abcc-945e69c3f1b7" containerID="73fa5036b13701be7a6585db71b22855fd10816110884c2d74de8a0f50bb4fe5" exitCode=0
Jul 16 11:16:28.695986 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:16:28.695937    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7nxr4"
Jul 16 11:16:28.696462 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:16:28.695984    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7nxr4" event={"ID":"81323f63-0088-4145-abcc-945e69c3f1b7","Type":"ContainerDied","Data":"73fa5036b13701be7a6585db71b22855fd10816110884c2d74de8a0f50bb4fe5"}
Jul 16 11:16:28.696462 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:16:28.696034    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7nxr4" event={"ID":"81323f63-0088-4145-abcc-945e69c3f1b7","Type":"ContainerDied","Data":"7003628fb92fea7214e17c726628c8b08732ac1409e30c19e9a6997fff9d2b1f"}
Jul 16 11:16:28.696462 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:16:28.696059    2564 scope.go:117] "RemoveContainer" containerID="73fa5036b13701be7a6585db71b22855fd10816110884c2d74de8a0f50bb4fe5"
Jul 16 11:16:28.705946 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:16:28.705925    2564 scope.go:117] "RemoveContainer" containerID="73fa5036b13701be7a6585db71b22855fd10816110884c2d74de8a0f50bb4fe5"
Jul 16 11:16:28.706227 ip-10-0-135-184 kubenswrapper[2564]: E0716 11:16:28.706210    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"73fa5036b13701be7a6585db71b22855fd10816110884c2d74de8a0f50bb4fe5\": container with ID starting with 73fa5036b13701be7a6585db71b22855fd10816110884c2d74de8a0f50bb4fe5 not found: ID does not exist" containerID="73fa5036b13701be7a6585db71b22855fd10816110884c2d74de8a0f50bb4fe5"
Jul 16 11:16:28.706274 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:16:28.706236    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"73fa5036b13701be7a6585db71b22855fd10816110884c2d74de8a0f50bb4fe5"} err="failed to get container status \"73fa5036b13701be7a6585db71b22855fd10816110884c2d74de8a0f50bb4fe5\": rpc error: code = NotFound desc = could not find container \"73fa5036b13701be7a6585db71b22855fd10816110884c2d74de8a0f50bb4fe5\": container with ID starting with 73fa5036b13701be7a6585db71b22855fd10816110884c2d74de8a0f50bb4fe5 not found: ID does not exist"
Jul 16 11:16:28.718562 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:16:28.718530    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7nxr4"]
Jul 16 11:16:28.726836 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:16:28.726801    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7nxr4"]
Jul 16 11:16:30.301389 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:16:30.301355    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="81323f63-0088-4145-abcc-945e69c3f1b7" path="/var/lib/kubelet/pods/81323f63-0088-4145-abcc-945e69c3f1b7/volumes"
Jul 16 11:16:31.779553 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:16:31.779518    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:16:31.880041 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:16:31.880000    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:16:32.209831 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:16:32.209743    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:16:32.276351 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:16:32.276310    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:16:33.260497 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:16:33.260462    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:16:33.357485 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:16:33.357434    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:16:36.085137 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:16:36.085092    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:16:36.185405 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:16:36.185349    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:16:38.266134 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:16:38.266098    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:16:38.365282 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:16:38.365247    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:16:43.962900 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:16:43.962856    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-57qbg"]
Jul 16 11:16:43.963448 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:16:43.963427    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="81323f63-0088-4145-abcc-945e69c3f1b7" containerName="manager"
Jul 16 11:16:43.963535 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:16:43.963451    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="81323f63-0088-4145-abcc-945e69c3f1b7" containerName="manager"
Jul 16 11:16:43.963598 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:16:43.963579    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="81323f63-0088-4145-abcc-945e69c3f1b7" containerName="manager"
Jul 16 11:16:43.965744 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:16:43.965720    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-57qbg"
Jul 16 11:16:43.967794 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:16:43.967750    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-k7g8w\""
Jul 16 11:16:43.977240 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:16:43.977211    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-57qbg"]
Jul 16 11:16:43.984526 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:16:43.984489    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:16:44.065512 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:16:44.065470    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fae58f40-1477-417a-921a-2ed601fe72aa-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-57qbg\" (UID: \"fae58f40-1477-417a-921a-2ed601fe72aa\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-57qbg"
Jul 16 11:16:44.065749 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:16:44.065528    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fae58f40-1477-417a-921a-2ed601fe72aa-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-57qbg\" (UID: \"fae58f40-1477-417a-921a-2ed601fe72aa\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-57qbg"
Jul 16 11:16:44.065749 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:16:44.065558    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-77b24\" (UniqueName: \"kubernetes.io/projected/fae58f40-1477-417a-921a-2ed601fe72aa-kube-api-access-77b24\") pod \"maas-default-gateway-openshift-default-56654dcf7-57qbg\" (UID: \"fae58f40-1477-417a-921a-2ed601fe72aa\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-57qbg"
Jul 16 11:16:44.065749 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:16:44.065594    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fae58f40-1477-417a-921a-2ed601fe72aa-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-57qbg\" (UID: \"fae58f40-1477-417a-921a-2ed601fe72aa\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-57qbg"
Jul 16 11:16:44.065749 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:16:44.065616    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fae58f40-1477-417a-921a-2ed601fe72aa-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-57qbg\" (UID: \"fae58f40-1477-417a-921a-2ed601fe72aa\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-57qbg"
Jul 16 11:16:44.065749 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:16:44.065673    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fae58f40-1477-417a-921a-2ed601fe72aa-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-57qbg\" (UID: \"fae58f40-1477-417a-921a-2ed601fe72aa\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-57qbg"
Jul 16 11:16:44.065749 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:16:44.065726    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fae58f40-1477-417a-921a-2ed601fe72aa-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-57qbg\" (UID: \"fae58f40-1477-417a-921a-2ed601fe72aa\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-57qbg"
Jul 16 11:16:44.066045 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:16:44.065755    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fae58f40-1477-417a-921a-2ed601fe72aa-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-57qbg\" (UID: \"fae58f40-1477-417a-921a-2ed601fe72aa\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-57qbg"
Jul 16 11:16:44.066045 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:16:44.065879    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fae58f40-1477-417a-921a-2ed601fe72aa-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-57qbg\" (UID: \"fae58f40-1477-417a-921a-2ed601fe72aa\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-57qbg"
Jul 16 11:16:44.167363 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:16:44.167325    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fae58f40-1477-417a-921a-2ed601fe72aa-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-57qbg\" (UID: \"fae58f40-1477-417a-921a-2ed601fe72aa\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-57qbg"
Jul 16 11:16:44.167561 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:16:44.167396    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fae58f40-1477-417a-921a-2ed601fe72aa-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-57qbg\" (UID: \"fae58f40-1477-417a-921a-2ed601fe72aa\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-57qbg"
Jul 16 11:16:44.167561 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:16:44.167417    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fae58f40-1477-417a-921a-2ed601fe72aa-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-57qbg\" (UID: \"fae58f40-1477-417a-921a-2ed601fe72aa\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-57qbg"
Jul 16 11:16:44.167561 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:16:44.167435    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-77b24\" (UniqueName: \"kubernetes.io/projected/fae58f40-1477-417a-921a-2ed601fe72aa-kube-api-access-77b24\") pod \"maas-default-gateway-openshift-default-56654dcf7-57qbg\" (UID: \"fae58f40-1477-417a-921a-2ed601fe72aa\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-57qbg"
Jul 16 11:16:44.167561 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:16:44.167457    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fae58f40-1477-417a-921a-2ed601fe72aa-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-57qbg\" (UID: \"fae58f40-1477-417a-921a-2ed601fe72aa\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-57qbg"
Jul 16 11:16:44.167561 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:16:44.167472    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fae58f40-1477-417a-921a-2ed601fe72aa-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-57qbg\" (UID: \"fae58f40-1477-417a-921a-2ed601fe72aa\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-57qbg"
Jul 16 11:16:44.167561 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:16:44.167490    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fae58f40-1477-417a-921a-2ed601fe72aa-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-57qbg\" (UID: \"fae58f40-1477-417a-921a-2ed601fe72aa\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-57qbg"
Jul 16 11:16:44.167913 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:16:44.167607    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fae58f40-1477-417a-921a-2ed601fe72aa-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-57qbg\" (UID: \"fae58f40-1477-417a-921a-2ed601fe72aa\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-57qbg"
Jul 16 11:16:44.167913 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:16:44.167655    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fae58f40-1477-417a-921a-2ed601fe72aa-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-57qbg\" (UID: \"fae58f40-1477-417a-921a-2ed601fe72aa\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-57qbg"
Jul 16 11:16:44.168082 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:16:44.167905    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fae58f40-1477-417a-921a-2ed601fe72aa-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-57qbg\" (UID: \"fae58f40-1477-417a-921a-2ed601fe72aa\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-57qbg"
Jul 16 11:16:44.168082 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:16:44.167971    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fae58f40-1477-417a-921a-2ed601fe72aa-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-57qbg\" (UID: \"fae58f40-1477-417a-921a-2ed601fe72aa\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-57qbg"
Jul 16 11:16:44.168082 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:16:44.168016    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fae58f40-1477-417a-921a-2ed601fe72aa-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-57qbg\" (UID: \"fae58f40-1477-417a-921a-2ed601fe72aa\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-57qbg"
Jul 16 11:16:44.168260 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:16:44.168231    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fae58f40-1477-417a-921a-2ed601fe72aa-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-57qbg\" (UID: \"fae58f40-1477-417a-921a-2ed601fe72aa\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-57qbg"
Jul 16 11:16:44.168383 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:16:44.168314    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fae58f40-1477-417a-921a-2ed601fe72aa-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-57qbg\" (UID: \"fae58f40-1477-417a-921a-2ed601fe72aa\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-57qbg"
Jul 16 11:16:44.169752 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:16:44.169724    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fae58f40-1477-417a-921a-2ed601fe72aa-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-57qbg\" (UID: \"fae58f40-1477-417a-921a-2ed601fe72aa\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-57qbg"
Jul 16 11:16:44.170196 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:16:44.170179    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fae58f40-1477-417a-921a-2ed601fe72aa-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-57qbg\" (UID: \"fae58f40-1477-417a-921a-2ed601fe72aa\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-57qbg"
Jul 16 11:16:44.176381 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:16:44.176348    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fae58f40-1477-417a-921a-2ed601fe72aa-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-57qbg\" (UID: \"fae58f40-1477-417a-921a-2ed601fe72aa\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-57qbg"
Jul 16 11:16:44.176507 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:16:44.176422    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-77b24\" (UniqueName: \"kubernetes.io/projected/fae58f40-1477-417a-921a-2ed601fe72aa-kube-api-access-77b24\") pod \"maas-default-gateway-openshift-default-56654dcf7-57qbg\" (UID: \"fae58f40-1477-417a-921a-2ed601fe72aa\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-57qbg"
Jul 16 11:16:44.278119 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:16:44.278081    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-57qbg"
Jul 16 11:16:44.369417 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:16:44.369377    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:16:44.428836 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:16:44.428808    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-57qbg"]
Jul 16 11:16:44.431546 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:16:44.431519    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfae58f40_1477_417a_921a_2ed601fe72aa.slice/crio-c3f0e2f01f0116eb00246f8c3e43c7838c044ae5dad254c51d5cf5971284d1db WatchSource:0}: Error finding container c3f0e2f01f0116eb00246f8c3e43c7838c044ae5dad254c51d5cf5971284d1db: Status 404 returned error can't find the container with id c3f0e2f01f0116eb00246f8c3e43c7838c044ae5dad254c51d5cf5971284d1db
Jul 16 11:16:44.433850 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:16:44.433761    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 16 11:16:44.433949 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:16:44.433896    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 16 11:16:44.433949 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:16:44.433925    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 16 11:16:44.778512 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:16:44.778477    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-57qbg" event={"ID":"fae58f40-1477-417a-921a-2ed601fe72aa","Type":"ContainerStarted","Data":"4cc140404ee6b5c4c8279c0ddf45fb4333564501e101be5ebf8db4a0da459de8"}
Jul 16 11:16:44.778731 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:16:44.778546    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-57qbg" event={"ID":"fae58f40-1477-417a-921a-2ed601fe72aa","Type":"ContainerStarted","Data":"c3f0e2f01f0116eb00246f8c3e43c7838c044ae5dad254c51d5cf5971284d1db"}
Jul 16 11:16:44.801332 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:16:44.801275    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-57qbg" podStartSLOduration=1.801257844 podStartE2EDuration="1.801257844s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 11:16:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 11:16:44.798467954 +0000 UTC m=+505.170005013" watchObservedRunningTime="2026-07-16 11:16:44.801257844 +0000 UTC m=+505.172794880"
Jul 16 11:16:45.278316 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:16:45.278276    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-57qbg"
Jul 16 11:16:45.283460 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:16:45.283433    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-57qbg"
Jul 16 11:16:45.784355 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:16:45.784327    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-57qbg"
Jul 16 11:16:45.785572 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:16:45.785550    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-57qbg"
Jul 16 11:16:46.722237 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:16:46.722202    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:16:46.733732 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:16:46.733697    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-l7mpm"]
Jul 16 11:16:46.736558 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:16:46.736537    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-l7mpm"
Jul 16 11:16:46.738571 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:16:46.738551    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 16 11:16:46.738683 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:16:46.738653    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-g7tfn\""
Jul 16 11:16:46.746815 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:16:46.746785    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-l7mpm"]
Jul 16 11:16:46.833071 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:16:46.833036    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-l7mpm"]
Jul 16 11:16:46.849506 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:16:46.849466    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:16:46.894309 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:16:46.894274    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/fe867fd4-ba52-4035-8a1d-b4c0bbb95b01-config-file\") pod \"limitador-limitador-64c94fd64f-l7mpm\" (UID: \"fe867fd4-ba52-4035-8a1d-b4c0bbb95b01\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-l7mpm"
Jul 16 11:16:46.894489 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:16:46.894331    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-45xkx\" (UniqueName: \"kubernetes.io/projected/fe867fd4-ba52-4035-8a1d-b4c0bbb95b01-kube-api-access-45xkx\") pod \"limitador-limitador-64c94fd64f-l7mpm\" (UID: \"fe867fd4-ba52-4035-8a1d-b4c0bbb95b01\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-l7mpm"
Jul 16 11:16:46.908033 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:16:46.908003    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:16:46.995281 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:16:46.995186    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-45xkx\" (UniqueName: \"kubernetes.io/projected/fe867fd4-ba52-4035-8a1d-b4c0bbb95b01-kube-api-access-45xkx\") pod \"limitador-limitador-64c94fd64f-l7mpm\" (UID: \"fe867fd4-ba52-4035-8a1d-b4c0bbb95b01\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-l7mpm"
Jul 16 11:16:46.995436 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:16:46.995327    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/fe867fd4-ba52-4035-8a1d-b4c0bbb95b01-config-file\") pod \"limitador-limitador-64c94fd64f-l7mpm\" (UID: \"fe867fd4-ba52-4035-8a1d-b4c0bbb95b01\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-l7mpm"
Jul 16 11:16:46.996020 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:16:46.996000    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/fe867fd4-ba52-4035-8a1d-b4c0bbb95b01-config-file\") pod \"limitador-limitador-64c94fd64f-l7mpm\" (UID: \"fe867fd4-ba52-4035-8a1d-b4c0bbb95b01\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-l7mpm"
Jul 16 11:16:47.004056 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:16:47.004026    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-45xkx\" (UniqueName: \"kubernetes.io/projected/fe867fd4-ba52-4035-8a1d-b4c0bbb95b01-kube-api-access-45xkx\") pod \"limitador-limitador-64c94fd64f-l7mpm\" (UID: \"fe867fd4-ba52-4035-8a1d-b4c0bbb95b01\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-l7mpm"
Jul 16 11:16:47.050121 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:16:47.050083    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-l7mpm"
Jul 16 11:16:47.203383 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:16:47.203359    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-l7mpm"]
Jul 16 11:16:47.205716 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:16:47.205685    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfe867fd4_ba52_4035_8a1d_b4c0bbb95b01.slice/crio-7ab1fb52dd665d82930da6eb9c90c5b366ccd05b18132d52c85b747a382ed042 WatchSource:0}: Error finding container 7ab1fb52dd665d82930da6eb9c90c5b366ccd05b18132d52c85b747a382ed042: Status 404 returned error can't find the container with id 7ab1fb52dd665d82930da6eb9c90c5b366ccd05b18132d52c85b747a382ed042
Jul 16 11:16:47.577399 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:16:47.577364    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:16:47.658334 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:16:47.658298    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-qnclm"]
Jul 16 11:16:47.661427 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:16:47.661403    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-qnclm"
Jul 16 11:16:47.663715 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:16:47.663690    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-2rgzz\""
Jul 16 11:16:47.669743 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:16:47.669528    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-qnclm"]
Jul 16 11:16:47.673285 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:16:47.673254    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:16:47.795254 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:16:47.795218    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-l7mpm" event={"ID":"fe867fd4-ba52-4035-8a1d-b4c0bbb95b01","Type":"ContainerStarted","Data":"7ab1fb52dd665d82930da6eb9c90c5b366ccd05b18132d52c85b747a382ed042"}
Jul 16 11:16:47.801887 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:16:47.801860    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jwvpd\" (UniqueName: \"kubernetes.io/projected/ed9214c8-20aa-485f-aff5-c8f5ab2e98a8-kube-api-access-jwvpd\") pod \"authorino-75d556bd77-qnclm\" (UID: \"ed9214c8-20aa-485f-aff5-c8f5ab2e98a8\") " pod="kuadrant-system/authorino-75d556bd77-qnclm"
Jul 16 11:16:47.903355 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:16:47.903264    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jwvpd\" (UniqueName: \"kubernetes.io/projected/ed9214c8-20aa-485f-aff5-c8f5ab2e98a8-kube-api-access-jwvpd\") pod \"authorino-75d556bd77-qnclm\" (UID: \"ed9214c8-20aa-485f-aff5-c8f5ab2e98a8\") " pod="kuadrant-system/authorino-75d556bd77-qnclm"
Jul 16 11:16:47.911276 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:16:47.911249    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jwvpd\" (UniqueName: \"kubernetes.io/projected/ed9214c8-20aa-485f-aff5-c8f5ab2e98a8-kube-api-access-jwvpd\") pod \"authorino-75d556bd77-qnclm\" (UID: \"ed9214c8-20aa-485f-aff5-c8f5ab2e98a8\") " pod="kuadrant-system/authorino-75d556bd77-qnclm"
Jul 16 11:16:47.972852 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:16:47.972817    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-qnclm"
Jul 16 11:16:48.119460 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:16:48.119422    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-qnclm"]
Jul 16 11:16:48.123161 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:16:48.123129    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poded9214c8_20aa_485f_aff5_c8f5ab2e98a8.slice/crio-4364485c8a71cb1d1b0209b842625c0b368750a3d8ac839f86ca6a8610d34893 WatchSource:0}: Error finding container 4364485c8a71cb1d1b0209b842625c0b368750a3d8ac839f86ca6a8610d34893: Status 404 returned error can't find the container with id 4364485c8a71cb1d1b0209b842625c0b368750a3d8ac839f86ca6a8610d34893
Jul 16 11:16:48.805599 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:16:48.805559    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-qnclm" event={"ID":"ed9214c8-20aa-485f-aff5-c8f5ab2e98a8","Type":"ContainerStarted","Data":"4364485c8a71cb1d1b0209b842625c0b368750a3d8ac839f86ca6a8610d34893"}
Jul 16 11:16:52.831331 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:16:52.831293    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-qnclm" event={"ID":"ed9214c8-20aa-485f-aff5-c8f5ab2e98a8","Type":"ContainerStarted","Data":"6d6ecdbabb3cb07767a1b23c34fd5692d93673cd3504225fa56e08a02c2f0eaa"}
Jul 16 11:16:52.832876 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:16:52.832854    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-l7mpm" event={"ID":"fe867fd4-ba52-4035-8a1d-b4c0bbb95b01","Type":"ContainerStarted","Data":"d48ae623509d533acdb4f789ccf80d7d773bd2f6aa3616e32f46c98bf1896056"}
Jul 16 11:16:52.833017 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:16:52.832994    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-l7mpm"
Jul 16 11:16:52.847057 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:16:52.847000    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-qnclm" podStartSLOduration=1.6966658940000001 podStartE2EDuration="5.846981941s" totalImagesPullingTime="4.150316047s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 11:16:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 11:16:52.845528151 +0000 UTC m=+513.217065205" watchObservedRunningTime="2026-07-16 11:16:52.846981941 +0000 UTC m=+513.218518979"
Jul 16 11:16:52.863654 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:16:52.863601    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-l7mpm" podStartSLOduration=1.802675452 podStartE2EDuration="6.863580889s" totalImagesPullingTime="5.060905437s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 11:16:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 11:16:52.861628379 +0000 UTC m=+513.233165435" watchObservedRunningTime="2026-07-16 11:16:52.863580889 +0000 UTC m=+513.235117903"
Jul 16 11:17:03.839636 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:17:03.839604    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-l7mpm"
Jul 16 11:17:06.146396 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:17:06.146363    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-l7mpm"]
Jul 16 11:17:06.147034 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:17:06.146650    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-l7mpm" podUID="fe867fd4-ba52-4035-8a1d-b4c0bbb95b01" containerName="limitador" containerID="cri-o://d48ae623509d533acdb4f789ccf80d7d773bd2f6aa3616e32f46c98bf1896056" gracePeriod=30
Jul 16 11:17:06.696315 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:17:06.696288    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-l7mpm"
Jul 16 11:17:06.777002 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:17:06.776963    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-45xkx\" (UniqueName: \"kubernetes.io/projected/fe867fd4-ba52-4035-8a1d-b4c0bbb95b01-kube-api-access-45xkx\") pod \"fe867fd4-ba52-4035-8a1d-b4c0bbb95b01\" (UID: \"fe867fd4-ba52-4035-8a1d-b4c0bbb95b01\") "
Jul 16 11:17:06.777154 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:17:06.777073    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/fe867fd4-ba52-4035-8a1d-b4c0bbb95b01-config-file\") pod \"fe867fd4-ba52-4035-8a1d-b4c0bbb95b01\" (UID: \"fe867fd4-ba52-4035-8a1d-b4c0bbb95b01\") "
Jul 16 11:17:06.777433 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:17:06.777408    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fe867fd4-ba52-4035-8a1d-b4c0bbb95b01-config-file" (OuterVolumeSpecName: "config-file") pod "fe867fd4-ba52-4035-8a1d-b4c0bbb95b01" (UID: "fe867fd4-ba52-4035-8a1d-b4c0bbb95b01"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 11:17:06.779218 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:17:06.779187    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fe867fd4-ba52-4035-8a1d-b4c0bbb95b01-kube-api-access-45xkx" (OuterVolumeSpecName: "kube-api-access-45xkx") pod "fe867fd4-ba52-4035-8a1d-b4c0bbb95b01" (UID: "fe867fd4-ba52-4035-8a1d-b4c0bbb95b01"). InnerVolumeSpecName "kube-api-access-45xkx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 11:17:06.877915 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:17:06.877876    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-45xkx\" (UniqueName: \"kubernetes.io/projected/fe867fd4-ba52-4035-8a1d-b4c0bbb95b01-kube-api-access-45xkx\") on node \"ip-10-0-135-184.ec2.internal\" DevicePath \"\""
Jul 16 11:17:06.877915 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:17:06.877910    2564 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/fe867fd4-ba52-4035-8a1d-b4c0bbb95b01-config-file\") on node \"ip-10-0-135-184.ec2.internal\" DevicePath \"\""
Jul 16 11:17:06.909688 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:17:06.909659    2564 generic.go:356] "Generic (PLEG): container finished" podID="fe867fd4-ba52-4035-8a1d-b4c0bbb95b01" containerID="d48ae623509d533acdb4f789ccf80d7d773bd2f6aa3616e32f46c98bf1896056" exitCode=0
Jul 16 11:17:06.909912 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:17:06.909718    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-l7mpm"
Jul 16 11:17:06.909912 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:17:06.909748    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-l7mpm" event={"ID":"fe867fd4-ba52-4035-8a1d-b4c0bbb95b01","Type":"ContainerDied","Data":"d48ae623509d533acdb4f789ccf80d7d773bd2f6aa3616e32f46c98bf1896056"}
Jul 16 11:17:06.909912 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:17:06.909821    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-l7mpm" event={"ID":"fe867fd4-ba52-4035-8a1d-b4c0bbb95b01","Type":"ContainerDied","Data":"7ab1fb52dd665d82930da6eb9c90c5b366ccd05b18132d52c85b747a382ed042"}
Jul 16 11:17:06.909912 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:17:06.909853    2564 scope.go:117] "RemoveContainer" containerID="d48ae623509d533acdb4f789ccf80d7d773bd2f6aa3616e32f46c98bf1896056"
Jul 16 11:17:06.918965 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:17:06.918944    2564 scope.go:117] "RemoveContainer" containerID="d48ae623509d533acdb4f789ccf80d7d773bd2f6aa3616e32f46c98bf1896056"
Jul 16 11:17:06.919238 ip-10-0-135-184 kubenswrapper[2564]: E0716 11:17:06.919213    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d48ae623509d533acdb4f789ccf80d7d773bd2f6aa3616e32f46c98bf1896056\": container with ID starting with d48ae623509d533acdb4f789ccf80d7d773bd2f6aa3616e32f46c98bf1896056 not found: ID does not exist" containerID="d48ae623509d533acdb4f789ccf80d7d773bd2f6aa3616e32f46c98bf1896056"
Jul 16 11:17:06.919290 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:17:06.919249    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d48ae623509d533acdb4f789ccf80d7d773bd2f6aa3616e32f46c98bf1896056"} err="failed to get container status \"d48ae623509d533acdb4f789ccf80d7d773bd2f6aa3616e32f46c98bf1896056\": rpc error: code = NotFound desc = could not find container \"d48ae623509d533acdb4f789ccf80d7d773bd2f6aa3616e32f46c98bf1896056\": container with ID starting with d48ae623509d533acdb4f789ccf80d7d773bd2f6aa3616e32f46c98bf1896056 not found: ID does not exist"
Jul 16 11:17:06.930160 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:17:06.930121    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-l7mpm"]
Jul 16 11:17:06.932935 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:17:06.932905    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-l7mpm"]
Jul 16 11:17:08.305562 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:17:08.305522    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fe867fd4-ba52-4035-8a1d-b4c0bbb95b01" path="/var/lib/kubelet/pods/fe867fd4-ba52-4035-8a1d-b4c0bbb95b01/volumes"
Jul 16 11:17:12.139641 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:17:12.139474    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:17:12.224878 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:17:12.224838    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:17:12.585421 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:17:12.585392    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-hpnq2"]
Jul 16 11:17:12.585813 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:17:12.585799    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fe867fd4-ba52-4035-8a1d-b4c0bbb95b01" containerName="limitador"
Jul 16 11:17:12.585879 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:17:12.585815    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="fe867fd4-ba52-4035-8a1d-b4c0bbb95b01" containerName="limitador"
Jul 16 11:17:12.585918 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:17:12.585883    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="fe867fd4-ba52-4035-8a1d-b4c0bbb95b01" containerName="limitador"
Jul 16 11:17:12.588072 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:17:12.588055    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-hpnq2"
Jul 16 11:17:12.590381 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:17:12.590356    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 16 11:17:12.590523 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:17:12.590356    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 16 11:17:12.590929 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:17:12.590912    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\""
Jul 16 11:17:12.591018 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:17:12.590913    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-hgjlr\""
Jul 16 11:17:12.597967 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:17:12.597941    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-hpnq2"]
Jul 16 11:17:12.612133 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:17:12.612101    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:17:12.734384 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:17:12.734333    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/3c611fd7-3a6b-405e-a214-9b4acc98a3d7-data\") pod \"postgres-69fb4594cf-hpnq2\" (UID: \"3c611fd7-3a6b-405e-a214-9b4acc98a3d7\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-hpnq2"
Jul 16 11:17:12.734569 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:17:12.734488    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bhjcj\" (UniqueName: \"kubernetes.io/projected/3c611fd7-3a6b-405e-a214-9b4acc98a3d7-kube-api-access-bhjcj\") pod \"postgres-69fb4594cf-hpnq2\" (UID: \"3c611fd7-3a6b-405e-a214-9b4acc98a3d7\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-hpnq2"
Jul 16 11:17:12.835518 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:17:12.835414    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/3c611fd7-3a6b-405e-a214-9b4acc98a3d7-data\") pod \"postgres-69fb4594cf-hpnq2\" (UID: \"3c611fd7-3a6b-405e-a214-9b4acc98a3d7\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-hpnq2"
Jul 16 11:17:12.835710 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:17:12.835542    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bhjcj\" (UniqueName: \"kubernetes.io/projected/3c611fd7-3a6b-405e-a214-9b4acc98a3d7-kube-api-access-bhjcj\") pod \"postgres-69fb4594cf-hpnq2\" (UID: \"3c611fd7-3a6b-405e-a214-9b4acc98a3d7\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-hpnq2"
Jul 16 11:17:12.835897 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:17:12.835875    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/3c611fd7-3a6b-405e-a214-9b4acc98a3d7-data\") pod \"postgres-69fb4594cf-hpnq2\" (UID: \"3c611fd7-3a6b-405e-a214-9b4acc98a3d7\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-hpnq2"
Jul 16 11:17:12.843972 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:17:12.843934    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bhjcj\" (UniqueName: \"kubernetes.io/projected/3c611fd7-3a6b-405e-a214-9b4acc98a3d7-kube-api-access-bhjcj\") pod \"postgres-69fb4594cf-hpnq2\" (UID: \"3c611fd7-3a6b-405e-a214-9b4acc98a3d7\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-hpnq2"
Jul 16 11:17:12.899589 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:17:12.899540    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-hpnq2"
Jul 16 11:17:13.072017 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:17:13.071986    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-hpnq2"]
Jul 16 11:17:13.074878 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:17:13.074843    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3c611fd7_3a6b_405e_a214_9b4acc98a3d7.slice/crio-f13312068bfb7e6a3027c7737652edd55321f6d1b64bbaa12b7b6fece8a23a98 WatchSource:0}: Error finding container f13312068bfb7e6a3027c7737652edd55321f6d1b64bbaa12b7b6fece8a23a98: Status 404 returned error can't find the container with id f13312068bfb7e6a3027c7737652edd55321f6d1b64bbaa12b7b6fece8a23a98
Jul 16 11:17:13.948549 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:17:13.948512    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-hpnq2" event={"ID":"3c611fd7-3a6b-405e-a214-9b4acc98a3d7","Type":"ContainerStarted","Data":"f13312068bfb7e6a3027c7737652edd55321f6d1b64bbaa12b7b6fece8a23a98"}
Jul 16 11:17:18.982102 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:17:18.982059    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-hpnq2" event={"ID":"3c611fd7-3a6b-405e-a214-9b4acc98a3d7","Type":"ContainerStarted","Data":"b87dbfcc34c59002d5f1684a3b52602828df2eed25e72e8284687603599916f9"}
Jul 16 11:17:18.982714 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:17:18.982156    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-hpnq2"
Jul 16 11:17:19.001155 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:17:19.001095    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-hpnq2" podStartSLOduration=1.977051417 podStartE2EDuration="7.001074923s" totalImagesPullingTime="5.024023506s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 11:17:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 11:17:18.999863506 +0000 UTC m=+539.371400550" watchObservedRunningTime="2026-07-16 11:17:19.001074923 +0000 UTC m=+539.372611959"
Jul 16 11:17:25.018358 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:17:25.018322    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-hpnq2"
Jul 16 11:17:25.342088 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:17:25.342008    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:17:25.542596 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:17:25.542556    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-hdnw4"]
Jul 16 11:17:25.627031 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:17:25.626888    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-hdnw4"]
Jul 16 11:17:25.627031 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:17:25.626972    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-hdnw4"
Jul 16 11:17:25.765629 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:17:25.765596    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d92ls\" (UniqueName: \"kubernetes.io/projected/22acdddd-5508-4c1a-ba3d-88c2289ed233-kube-api-access-d92ls\") pod \"authorino-5d4b67c446-hdnw4\" (UID: \"22acdddd-5508-4c1a-ba3d-88c2289ed233\") " pod="kuadrant-system/authorino-5d4b67c446-hdnw4"
Jul 16 11:17:25.771017 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:17:25.770985    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-hdnw4"]
Jul 16 11:17:25.771296 ip-10-0-135-184 kubenswrapper[2564]: E0716 11:17:25.771275    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-d92ls], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-5d4b67c446-hdnw4" podUID="22acdddd-5508-4c1a-ba3d-88c2289ed233"
Jul 16 11:17:25.866351 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:17:25.866313    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d92ls\" (UniqueName: \"kubernetes.io/projected/22acdddd-5508-4c1a-ba3d-88c2289ed233-kube-api-access-d92ls\") pod \"authorino-5d4b67c446-hdnw4\" (UID: \"22acdddd-5508-4c1a-ba3d-88c2289ed233\") " pod="kuadrant-system/authorino-5d4b67c446-hdnw4"
Jul 16 11:17:25.875607 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:17:25.875570    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d92ls\" (UniqueName: \"kubernetes.io/projected/22acdddd-5508-4c1a-ba3d-88c2289ed233-kube-api-access-d92ls\") pod \"authorino-5d4b67c446-hdnw4\" (UID: \"22acdddd-5508-4c1a-ba3d-88c2289ed233\") " pod="kuadrant-system/authorino-5d4b67c446-hdnw4"
Jul 16 11:17:25.956578 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:17:25.956494    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:17:26.018038 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:17:26.018003    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-hdnw4"
Jul 16 11:17:26.038495 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:17:26.038457    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-hdnw4"
Jul 16 11:17:26.168974 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:17:26.168940    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d92ls\" (UniqueName: \"kubernetes.io/projected/22acdddd-5508-4c1a-ba3d-88c2289ed233-kube-api-access-d92ls\") pod \"22acdddd-5508-4c1a-ba3d-88c2289ed233\" (UID: \"22acdddd-5508-4c1a-ba3d-88c2289ed233\") "
Jul 16 11:17:26.171164 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:17:26.171131    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/22acdddd-5508-4c1a-ba3d-88c2289ed233-kube-api-access-d92ls" (OuterVolumeSpecName: "kube-api-access-d92ls") pod "22acdddd-5508-4c1a-ba3d-88c2289ed233" (UID: "22acdddd-5508-4c1a-ba3d-88c2289ed233"). InnerVolumeSpecName "kube-api-access-d92ls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 11:17:26.270592 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:17:26.270550    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d92ls\" (UniqueName: \"kubernetes.io/projected/22acdddd-5508-4c1a-ba3d-88c2289ed233-kube-api-access-d92ls\") on node \"ip-10-0-135-184.ec2.internal\" DevicePath \"\""
Jul 16 11:17:26.430510 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:17:26.430477    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-89c4bb9fd-zkhlg"]
Jul 16 11:17:26.455460 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:17:26.455426    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-89c4bb9fd-zkhlg"]
Jul 16 11:17:26.455645 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:17:26.455530    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-89c4bb9fd-zkhlg"
Jul 16 11:17:26.458472 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:17:26.458441    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Jul 16 11:17:26.573353 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:17:26.573251    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8xsnf\" (UniqueName: \"kubernetes.io/projected/1396e383-9fa3-420a-b53f-bd713f14c3b1-kube-api-access-8xsnf\") pod \"authorino-89c4bb9fd-zkhlg\" (UID: \"1396e383-9fa3-420a-b53f-bd713f14c3b1\") " pod="kuadrant-system/authorino-89c4bb9fd-zkhlg"
Jul 16 11:17:26.573515 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:17:26.573364    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/1396e383-9fa3-420a-b53f-bd713f14c3b1-tls-cert\") pod \"authorino-89c4bb9fd-zkhlg\" (UID: \"1396e383-9fa3-420a-b53f-bd713f14c3b1\") " pod="kuadrant-system/authorino-89c4bb9fd-zkhlg"
Jul 16 11:17:26.674509 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:17:26.674470    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/1396e383-9fa3-420a-b53f-bd713f14c3b1-tls-cert\") pod \"authorino-89c4bb9fd-zkhlg\" (UID: \"1396e383-9fa3-420a-b53f-bd713f14c3b1\") " pod="kuadrant-system/authorino-89c4bb9fd-zkhlg"
Jul 16 11:17:26.674689 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:17:26.674548    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8xsnf\" (UniqueName: \"kubernetes.io/projected/1396e383-9fa3-420a-b53f-bd713f14c3b1-kube-api-access-8xsnf\") pod \"authorino-89c4bb9fd-zkhlg\" (UID: \"1396e383-9fa3-420a-b53f-bd713f14c3b1\") " pod="kuadrant-system/authorino-89c4bb9fd-zkhlg"
Jul 16 11:17:26.677133 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:17:26.677105    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/1396e383-9fa3-420a-b53f-bd713f14c3b1-tls-cert\") pod \"authorino-89c4bb9fd-zkhlg\" (UID: \"1396e383-9fa3-420a-b53f-bd713f14c3b1\") " pod="kuadrant-system/authorino-89c4bb9fd-zkhlg"
Jul 16 11:17:26.683639 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:17:26.683607    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8xsnf\" (UniqueName: \"kubernetes.io/projected/1396e383-9fa3-420a-b53f-bd713f14c3b1-kube-api-access-8xsnf\") pod \"authorino-89c4bb9fd-zkhlg\" (UID: \"1396e383-9fa3-420a-b53f-bd713f14c3b1\") " pod="kuadrant-system/authorino-89c4bb9fd-zkhlg"
Jul 16 11:17:26.765168 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:17:26.765135    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-89c4bb9fd-zkhlg"
Jul 16 11:17:26.927108 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:17:26.927075    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-89c4bb9fd-zkhlg"]
Jul 16 11:17:26.929909 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:17:26.929880    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1396e383_9fa3_420a_b53f_bd713f14c3b1.slice/crio-0b1b66ccc89857e07bcc32969c44d3f92662323ce7da02e2d3c22add946268ba WatchSource:0}: Error finding container 0b1b66ccc89857e07bcc32969c44d3f92662323ce7da02e2d3c22add946268ba: Status 404 returned error can't find the container with id 0b1b66ccc89857e07bcc32969c44d3f92662323ce7da02e2d3c22add946268ba
Jul 16 11:17:27.025080 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:17:27.025041    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-89c4bb9fd-zkhlg" event={"ID":"1396e383-9fa3-420a-b53f-bd713f14c3b1","Type":"ContainerStarted","Data":"0b1b66ccc89857e07bcc32969c44d3f92662323ce7da02e2d3c22add946268ba"}
Jul 16 11:17:27.025080 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:17:27.025071    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-hdnw4"
Jul 16 11:17:27.054017 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:17:27.053985    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-hdnw4"]
Jul 16 11:17:27.058021 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:17:27.057996    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-hdnw4"]
Jul 16 11:17:28.031331 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:17:28.031292    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-89c4bb9fd-zkhlg" event={"ID":"1396e383-9fa3-420a-b53f-bd713f14c3b1","Type":"ContainerStarted","Data":"aad048fba33e9c149227508b754584ec8864abeb0f49777d464961c712699654"}
Jul 16 11:17:28.046884 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:17:28.046823    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-89c4bb9fd-zkhlg" podStartSLOduration=1.7045891420000001 podStartE2EDuration="2.046805412s" totalImagesPullingTime="342.21627ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 11:17:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 11:17:28.045892177 +0000 UTC m=+548.417429212" watchObservedRunningTime="2026-07-16 11:17:28.046805412 +0000 UTC m=+548.418342448"
Jul 16 11:17:28.077306 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:17:28.077270    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-qnclm"]
Jul 16 11:17:28.078083 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:17:28.078046    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-qnclm" podUID="ed9214c8-20aa-485f-aff5-c8f5ab2e98a8" containerName="authorino" containerID="cri-o://6d6ecdbabb3cb07767a1b23c34fd5692d93673cd3504225fa56e08a02c2f0eaa" gracePeriod=30
Jul 16 11:17:28.302678 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:17:28.302586    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="22acdddd-5508-4c1a-ba3d-88c2289ed233" path="/var/lib/kubelet/pods/22acdddd-5508-4c1a-ba3d-88c2289ed233/volumes"
Jul 16 11:17:28.333666 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:17:28.333642    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-qnclm"
Jul 16 11:17:28.492473 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:17:28.492427    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jwvpd\" (UniqueName: \"kubernetes.io/projected/ed9214c8-20aa-485f-aff5-c8f5ab2e98a8-kube-api-access-jwvpd\") pod \"ed9214c8-20aa-485f-aff5-c8f5ab2e98a8\" (UID: \"ed9214c8-20aa-485f-aff5-c8f5ab2e98a8\") "
Jul 16 11:17:28.494564 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:17:28.494528    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ed9214c8-20aa-485f-aff5-c8f5ab2e98a8-kube-api-access-jwvpd" (OuterVolumeSpecName: "kube-api-access-jwvpd") pod "ed9214c8-20aa-485f-aff5-c8f5ab2e98a8" (UID: "ed9214c8-20aa-485f-aff5-c8f5ab2e98a8"). InnerVolumeSpecName "kube-api-access-jwvpd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 11:17:28.593834 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:17:28.593705    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jwvpd\" (UniqueName: \"kubernetes.io/projected/ed9214c8-20aa-485f-aff5-c8f5ab2e98a8-kube-api-access-jwvpd\") on node \"ip-10-0-135-184.ec2.internal\" DevicePath \"\""
Jul 16 11:17:28.721615 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:17:28.721570    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:17:29.037857 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:17:29.037821    2564 generic.go:356] "Generic (PLEG): container finished" podID="ed9214c8-20aa-485f-aff5-c8f5ab2e98a8" containerID="6d6ecdbabb3cb07767a1b23c34fd5692d93673cd3504225fa56e08a02c2f0eaa" exitCode=0
Jul 16 11:17:29.037857 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:17:29.037858    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-qnclm"
Jul 16 11:17:29.038097 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:17:29.037887    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-qnclm" event={"ID":"ed9214c8-20aa-485f-aff5-c8f5ab2e98a8","Type":"ContainerDied","Data":"6d6ecdbabb3cb07767a1b23c34fd5692d93673cd3504225fa56e08a02c2f0eaa"}
Jul 16 11:17:29.038097 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:17:29.037931    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-qnclm" event={"ID":"ed9214c8-20aa-485f-aff5-c8f5ab2e98a8","Type":"ContainerDied","Data":"4364485c8a71cb1d1b0209b842625c0b368750a3d8ac839f86ca6a8610d34893"}
Jul 16 11:17:29.038097 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:17:29.037950    2564 scope.go:117] "RemoveContainer" containerID="6d6ecdbabb3cb07767a1b23c34fd5692d93673cd3504225fa56e08a02c2f0eaa"
Jul 16 11:17:29.046965 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:17:29.046947    2564 scope.go:117] "RemoveContainer" containerID="6d6ecdbabb3cb07767a1b23c34fd5692d93673cd3504225fa56e08a02c2f0eaa"
Jul 16 11:17:29.047238 ip-10-0-135-184 kubenswrapper[2564]: E0716 11:17:29.047222    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6d6ecdbabb3cb07767a1b23c34fd5692d93673cd3504225fa56e08a02c2f0eaa\": container with ID starting with 6d6ecdbabb3cb07767a1b23c34fd5692d93673cd3504225fa56e08a02c2f0eaa not found: ID does not exist" containerID="6d6ecdbabb3cb07767a1b23c34fd5692d93673cd3504225fa56e08a02c2f0eaa"
Jul 16 11:17:29.047281 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:17:29.047246    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6d6ecdbabb3cb07767a1b23c34fd5692d93673cd3504225fa56e08a02c2f0eaa"} err="failed to get container status \"6d6ecdbabb3cb07767a1b23c34fd5692d93673cd3504225fa56e08a02c2f0eaa\": rpc error: code = NotFound desc = could not find container \"6d6ecdbabb3cb07767a1b23c34fd5692d93673cd3504225fa56e08a02c2f0eaa\": container with ID starting with 6d6ecdbabb3cb07767a1b23c34fd5692d93673cd3504225fa56e08a02c2f0eaa not found: ID does not exist"
Jul 16 11:17:29.058787 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:17:29.058745    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-qnclm"]
Jul 16 11:17:29.060548 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:17:29.060520    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-qnclm"]
Jul 16 11:17:30.301397 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:17:30.301360    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ed9214c8-20aa-485f-aff5-c8f5ab2e98a8" path="/var/lib/kubelet/pods/ed9214c8-20aa-485f-aff5-c8f5ab2e98a8/volumes"
Jul 16 11:17:32.679603 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:17:32.679569    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:17:32.680732 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:17:32.680710    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-54b56845c9-ssxsr"]
Jul 16 11:17:32.681164 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:17:32.681151    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ed9214c8-20aa-485f-aff5-c8f5ab2e98a8" containerName="authorino"
Jul 16 11:17:32.681211 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:17:32.681166    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="ed9214c8-20aa-485f-aff5-c8f5ab2e98a8" containerName="authorino"
Jul 16 11:17:32.681249 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:17:32.681242    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="ed9214c8-20aa-485f-aff5-c8f5ab2e98a8" containerName="authorino"
Jul 16 11:17:32.684184 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:17:32.684169    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-54b56845c9-ssxsr"
Jul 16 11:17:32.686920 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:17:32.686900    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 16 11:17:32.687049 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:17:32.686898    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 16 11:17:32.687049 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:17:32.686946    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-7g9zg\""
Jul 16 11:17:32.699060 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:17:32.699027    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-54b56845c9-ssxsr"]
Jul 16 11:17:32.729251 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:17:32.729220    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1d188410-ce36-43c1-af5d-bfbc509cf8ff-webhook-cert\") pod \"maas-controller-54b56845c9-ssxsr\" (UID: \"1d188410-ce36-43c1-af5d-bfbc509cf8ff\") " pod="opendatahub/maas-controller-54b56845c9-ssxsr"
Jul 16 11:17:32.729406 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:17:32.729278    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pfjqc\" (UniqueName: \"kubernetes.io/projected/1d188410-ce36-43c1-af5d-bfbc509cf8ff-kube-api-access-pfjqc\") pod \"maas-controller-54b56845c9-ssxsr\" (UID: \"1d188410-ce36-43c1-af5d-bfbc509cf8ff\") " pod="opendatahub/maas-controller-54b56845c9-ssxsr"
Jul 16 11:17:32.754362 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:17:32.754320    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:17:32.830509 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:17:32.830474    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1d188410-ce36-43c1-af5d-bfbc509cf8ff-webhook-cert\") pod \"maas-controller-54b56845c9-ssxsr\" (UID: \"1d188410-ce36-43c1-af5d-bfbc509cf8ff\") " pod="opendatahub/maas-controller-54b56845c9-ssxsr"
Jul 16 11:17:32.830705 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:17:32.830533    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pfjqc\" (UniqueName: \"kubernetes.io/projected/1d188410-ce36-43c1-af5d-bfbc509cf8ff-kube-api-access-pfjqc\") pod \"maas-controller-54b56845c9-ssxsr\" (UID: \"1d188410-ce36-43c1-af5d-bfbc509cf8ff\") " pod="opendatahub/maas-controller-54b56845c9-ssxsr"
Jul 16 11:17:32.830705 ip-10-0-135-184 kubenswrapper[2564]: E0716 11:17:32.830638    2564 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found
Jul 16 11:17:32.830829 ip-10-0-135-184 kubenswrapper[2564]: E0716 11:17:32.830705    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1d188410-ce36-43c1-af5d-bfbc509cf8ff-webhook-cert podName:1d188410-ce36-43c1-af5d-bfbc509cf8ff nodeName:}" failed. No retries permitted until 2026-07-16 11:17:33.330687473 +0000 UTC m=+553.702224504 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/1d188410-ce36-43c1-af5d-bfbc509cf8ff-webhook-cert") pod "maas-controller-54b56845c9-ssxsr" (UID: "1d188410-ce36-43c1-af5d-bfbc509cf8ff") : secret "maas-controller-webhook-cert" not found
Jul 16 11:17:32.834672 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:17:32.834643    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-54f9b6467-ls4jk"]
Jul 16 11:17:32.837518 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:17:32.837496    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-54f9b6467-ls4jk"
Jul 16 11:17:32.842116 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:17:32.842079    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pfjqc\" (UniqueName: \"kubernetes.io/projected/1d188410-ce36-43c1-af5d-bfbc509cf8ff-kube-api-access-pfjqc\") pod \"maas-controller-54b56845c9-ssxsr\" (UID: \"1d188410-ce36-43c1-af5d-bfbc509cf8ff\") " pod="opendatahub/maas-controller-54b56845c9-ssxsr"
Jul 16 11:17:32.849153 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:17:32.849128    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-54f9b6467-ls4jk"]
Jul 16 11:17:32.931221 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:17:32.931137    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1cb93906-d30d-4d23-a6ff-d5c377ef2dcb-webhook-cert\") pod \"maas-controller-54f9b6467-ls4jk\" (UID: \"1cb93906-d30d-4d23-a6ff-d5c377ef2dcb\") " pod="opendatahub/maas-controller-54f9b6467-ls4jk"
Jul 16 11:17:32.931372 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:17:32.931277    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q9r2n\" (UniqueName: \"kubernetes.io/projected/1cb93906-d30d-4d23-a6ff-d5c377ef2dcb-kube-api-access-q9r2n\") pod \"maas-controller-54f9b6467-ls4jk\" (UID: \"1cb93906-d30d-4d23-a6ff-d5c377ef2dcb\") " pod="opendatahub/maas-controller-54f9b6467-ls4jk"
Jul 16 11:17:32.945278 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:17:32.945235    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:17:33.032130 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:17:33.032077    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q9r2n\" (UniqueName: \"kubernetes.io/projected/1cb93906-d30d-4d23-a6ff-d5c377ef2dcb-kube-api-access-q9r2n\") pod \"maas-controller-54f9b6467-ls4jk\" (UID: \"1cb93906-d30d-4d23-a6ff-d5c377ef2dcb\") " pod="opendatahub/maas-controller-54f9b6467-ls4jk"
Jul 16 11:17:33.032320 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:17:33.032168    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1cb93906-d30d-4d23-a6ff-d5c377ef2dcb-webhook-cert\") pod \"maas-controller-54f9b6467-ls4jk\" (UID: \"1cb93906-d30d-4d23-a6ff-d5c377ef2dcb\") " pod="opendatahub/maas-controller-54f9b6467-ls4jk"
Jul 16 11:17:33.034721 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:17:33.034700    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1cb93906-d30d-4d23-a6ff-d5c377ef2dcb-webhook-cert\") pod \"maas-controller-54f9b6467-ls4jk\" (UID: \"1cb93906-d30d-4d23-a6ff-d5c377ef2dcb\") " pod="opendatahub/maas-controller-54f9b6467-ls4jk"
Jul 16 11:17:33.041124 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:17:33.041089    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q9r2n\" (UniqueName: \"kubernetes.io/projected/1cb93906-d30d-4d23-a6ff-d5c377ef2dcb-kube-api-access-q9r2n\") pod \"maas-controller-54f9b6467-ls4jk\" (UID: \"1cb93906-d30d-4d23-a6ff-d5c377ef2dcb\") " pod="opendatahub/maas-controller-54f9b6467-ls4jk"
Jul 16 11:17:33.158597 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:17:33.158557    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-54f9b6467-ls4jk"
Jul 16 11:17:33.300711 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:17:33.300679    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-54f9b6467-ls4jk"]
Jul 16 11:17:33.304556 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:17:33.304527    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1cb93906_d30d_4d23_a6ff_d5c377ef2dcb.slice/crio-5e27890a6f9cf23bd6b175e06e75a179692db1a8ed4b201e9af285d3ceb26536 WatchSource:0}: Error finding container 5e27890a6f9cf23bd6b175e06e75a179692db1a8ed4b201e9af285d3ceb26536: Status 404 returned error can't find the container with id 5e27890a6f9cf23bd6b175e06e75a179692db1a8ed4b201e9af285d3ceb26536
Jul 16 11:17:33.334568 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:17:33.334527    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1d188410-ce36-43c1-af5d-bfbc509cf8ff-webhook-cert\") pod \"maas-controller-54b56845c9-ssxsr\" (UID: \"1d188410-ce36-43c1-af5d-bfbc509cf8ff\") " pod="opendatahub/maas-controller-54b56845c9-ssxsr"
Jul 16 11:17:33.336970 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:17:33.336941    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1d188410-ce36-43c1-af5d-bfbc509cf8ff-webhook-cert\") pod \"maas-controller-54b56845c9-ssxsr\" (UID: \"1d188410-ce36-43c1-af5d-bfbc509cf8ff\") " pod="opendatahub/maas-controller-54b56845c9-ssxsr"
Jul 16 11:17:33.595344 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:17:33.595313    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-54b56845c9-ssxsr"
Jul 16 11:17:33.733159 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:17:33.733134    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-54b56845c9-ssxsr"]
Jul 16 11:17:33.735943 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:17:33.735916    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1d188410_ce36_43c1_af5d_bfbc509cf8ff.slice/crio-4b70592880e314966ec1e4565a0ca90d039dd63cafbd506434b4975c4d2470ef WatchSource:0}: Error finding container 4b70592880e314966ec1e4565a0ca90d039dd63cafbd506434b4975c4d2470ef: Status 404 returned error can't find the container with id 4b70592880e314966ec1e4565a0ca90d039dd63cafbd506434b4975c4d2470ef
Jul 16 11:17:34.065990 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:17:34.065959    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-54f9b6467-ls4jk" event={"ID":"1cb93906-d30d-4d23-a6ff-d5c377ef2dcb","Type":"ContainerStarted","Data":"5e27890a6f9cf23bd6b175e06e75a179692db1a8ed4b201e9af285d3ceb26536"}
Jul 16 11:17:34.067122 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:17:34.067095    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-54b56845c9-ssxsr" event={"ID":"1d188410-ce36-43c1-af5d-bfbc509cf8ff","Type":"ContainerStarted","Data":"4b70592880e314966ec1e4565a0ca90d039dd63cafbd506434b4975c4d2470ef"}
Jul 16 11:17:37.430782 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:17:37.430687    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:17:37.524076 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:17:37.524036    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:17:38.094297 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:17:38.094264    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-54b56845c9-ssxsr" event={"ID":"1d188410-ce36-43c1-af5d-bfbc509cf8ff","Type":"ContainerStarted","Data":"cfdab014aa8aac30e0646ce1767af165b01f73c5efb355cac62172303686adb1"}
Jul 16 11:17:38.094486 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:17:38.094354    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-54b56845c9-ssxsr"
Jul 16 11:17:38.095838 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:17:38.095811    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-54f9b6467-ls4jk" event={"ID":"1cb93906-d30d-4d23-a6ff-d5c377ef2dcb","Type":"ContainerStarted","Data":"bc4d157c2167a7604c4ca253ce9bba6cdbca5028ec75875e0543d5300e7419fc"}
Jul 16 11:17:38.095964 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:17:38.095883    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-54f9b6467-ls4jk"
Jul 16 11:17:38.114969 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:17:38.114925    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-54b56845c9-ssxsr" podStartSLOduration=2.670860919 podStartE2EDuration="6.114911484s" totalImagesPullingTime="3.444050565s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 11:17:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 11:17:38.113147576 +0000 UTC m=+558.484684641" watchObservedRunningTime="2026-07-16 11:17:38.114911484 +0000 UTC m=+558.486448520"
Jul 16 11:17:38.154177 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:17:38.154112    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-54f9b6467-ls4jk" podStartSLOduration=2.288619116 podStartE2EDuration="6.154089736s" totalImagesPullingTime="3.86547062s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 11:17:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 11:17:38.152462665 +0000 UTC m=+558.523999702" watchObservedRunningTime="2026-07-16 11:17:38.154089736 +0000 UTC m=+558.525626773"
Jul 16 11:17:49.103406 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:17:49.103374    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-54f9b6467-ls4jk"
Jul 16 11:17:49.103901 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:17:49.103449    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-54b56845c9-ssxsr"
Jul 16 11:17:49.173673 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:17:49.173636    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-54b56845c9-ssxsr"]
Jul 16 11:17:49.173968 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:17:49.173896    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-54b56845c9-ssxsr" podUID="1d188410-ce36-43c1-af5d-bfbc509cf8ff" containerName="manager" containerID="cri-o://cfdab014aa8aac30e0646ce1767af165b01f73c5efb355cac62172303686adb1" gracePeriod=30
Jul 16 11:17:49.978047 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:17:49.978020    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-54b56845c9-ssxsr"
Jul 16 11:17:50.084168 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:17:50.084128    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pfjqc\" (UniqueName: \"kubernetes.io/projected/1d188410-ce36-43c1-af5d-bfbc509cf8ff-kube-api-access-pfjqc\") pod \"1d188410-ce36-43c1-af5d-bfbc509cf8ff\" (UID: \"1d188410-ce36-43c1-af5d-bfbc509cf8ff\") "
Jul 16 11:17:50.084355 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:17:50.084180    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1d188410-ce36-43c1-af5d-bfbc509cf8ff-webhook-cert\") pod \"1d188410-ce36-43c1-af5d-bfbc509cf8ff\" (UID: \"1d188410-ce36-43c1-af5d-bfbc509cf8ff\") "
Jul 16 11:17:50.086363 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:17:50.086335    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1d188410-ce36-43c1-af5d-bfbc509cf8ff-kube-api-access-pfjqc" (OuterVolumeSpecName: "kube-api-access-pfjqc") pod "1d188410-ce36-43c1-af5d-bfbc509cf8ff" (UID: "1d188410-ce36-43c1-af5d-bfbc509cf8ff"). InnerVolumeSpecName "kube-api-access-pfjqc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 11:17:50.086363 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:17:50.086351    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1d188410-ce36-43c1-af5d-bfbc509cf8ff-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "1d188410-ce36-43c1-af5d-bfbc509cf8ff" (UID: "1d188410-ce36-43c1-af5d-bfbc509cf8ff"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 11:17:50.158054 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:17:50.158018    2564 generic.go:356] "Generic (PLEG): container finished" podID="1d188410-ce36-43c1-af5d-bfbc509cf8ff" containerID="cfdab014aa8aac30e0646ce1767af165b01f73c5efb355cac62172303686adb1" exitCode=0
Jul 16 11:17:50.158435 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:17:50.158064    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-54b56845c9-ssxsr"
Jul 16 11:17:50.158435 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:17:50.158100    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-54b56845c9-ssxsr" event={"ID":"1d188410-ce36-43c1-af5d-bfbc509cf8ff","Type":"ContainerDied","Data":"cfdab014aa8aac30e0646ce1767af165b01f73c5efb355cac62172303686adb1"}
Jul 16 11:17:50.158435 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:17:50.158157    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-54b56845c9-ssxsr" event={"ID":"1d188410-ce36-43c1-af5d-bfbc509cf8ff","Type":"ContainerDied","Data":"4b70592880e314966ec1e4565a0ca90d039dd63cafbd506434b4975c4d2470ef"}
Jul 16 11:17:50.158435 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:17:50.158180    2564 scope.go:117] "RemoveContainer" containerID="cfdab014aa8aac30e0646ce1767af165b01f73c5efb355cac62172303686adb1"
Jul 16 11:17:50.166873 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:17:50.166854    2564 scope.go:117] "RemoveContainer" containerID="cfdab014aa8aac30e0646ce1767af165b01f73c5efb355cac62172303686adb1"
Jul 16 11:17:50.167140 ip-10-0-135-184 kubenswrapper[2564]: E0716 11:17:50.167119    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cfdab014aa8aac30e0646ce1767af165b01f73c5efb355cac62172303686adb1\": container with ID starting with cfdab014aa8aac30e0646ce1767af165b01f73c5efb355cac62172303686adb1 not found: ID does not exist" containerID="cfdab014aa8aac30e0646ce1767af165b01f73c5efb355cac62172303686adb1"
Jul 16 11:17:50.167206 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:17:50.167153    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cfdab014aa8aac30e0646ce1767af165b01f73c5efb355cac62172303686adb1"} err="failed to get container status \"cfdab014aa8aac30e0646ce1767af165b01f73c5efb355cac62172303686adb1\": rpc error: code = NotFound desc = could not find container \"cfdab014aa8aac30e0646ce1767af165b01f73c5efb355cac62172303686adb1\": container with ID starting with cfdab014aa8aac30e0646ce1767af165b01f73c5efb355cac62172303686adb1 not found: ID does not exist"
Jul 16 11:17:50.179785 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:17:50.179751    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-54b56845c9-ssxsr"]
Jul 16 11:17:50.185129 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:17:50.185104    2564 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1d188410-ce36-43c1-af5d-bfbc509cf8ff-webhook-cert\") on node \"ip-10-0-135-184.ec2.internal\" DevicePath \"\""
Jul 16 11:17:50.185129 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:17:50.185135    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pfjqc\" (UniqueName: \"kubernetes.io/projected/1d188410-ce36-43c1-af5d-bfbc509cf8ff-kube-api-access-pfjqc\") on node \"ip-10-0-135-184.ec2.internal\" DevicePath \"\""
Jul 16 11:17:50.186875 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:17:50.186857    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-54b56845c9-ssxsr"]
Jul 16 11:17:50.301645 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:17:50.301610    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1d188410-ce36-43c1-af5d-bfbc509cf8ff" path="/var/lib/kubelet/pods/1d188410-ce36-43c1-af5d-bfbc509cf8ff/volumes"
Jul 16 11:18:01.929511 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:18:01.929469    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:18:08.052284 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:18:08.052248    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:18:08.164907 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:18:08.164876    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:18:08.659269 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:18:08.659220    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:18:08.737104 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:18:08.737070    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-75db5f846d-4r9fq"]
Jul 16 11:18:08.737515 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:18:08.737502    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1d188410-ce36-43c1-af5d-bfbc509cf8ff" containerName="manager"
Jul 16 11:18:08.737564 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:18:08.737517    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="1d188410-ce36-43c1-af5d-bfbc509cf8ff" containerName="manager"
Jul 16 11:18:08.737600 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:18:08.737574    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="1d188410-ce36-43c1-af5d-bfbc509cf8ff" containerName="manager"
Jul 16 11:18:08.740594 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:18:08.740577    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-75db5f846d-4r9fq"
Jul 16 11:18:08.743639 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:18:08.743612    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-kt2rk\""
Jul 16 11:18:08.743759 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:18:08.743612    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Jul 16 11:18:08.754687 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:18:08.754662    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-75db5f846d-4r9fq"]
Jul 16 11:18:08.851281 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:18:08.851239    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e92def53-e20d-4372-be08-b6e24d963d7d-maas-api-tls\") pod \"maas-api-75db5f846d-4r9fq\" (UID: \"e92def53-e20d-4372-be08-b6e24d963d7d\") " pod="odh-ai-gateway-infra/maas-api-75db5f846d-4r9fq"
Jul 16 11:18:08.851281 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:18:08.851286    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-72nt4\" (UniqueName: \"kubernetes.io/projected/e92def53-e20d-4372-be08-b6e24d963d7d-kube-api-access-72nt4\") pod \"maas-api-75db5f846d-4r9fq\" (UID: \"e92def53-e20d-4372-be08-b6e24d963d7d\") " pod="odh-ai-gateway-infra/maas-api-75db5f846d-4r9fq"
Jul 16 11:18:08.851511 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:18:08.851380    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e92def53-e20d-4372-be08-b6e24d963d7d-openshift-service-ca\") pod \"maas-api-75db5f846d-4r9fq\" (UID: \"e92def53-e20d-4372-be08-b6e24d963d7d\") " pod="odh-ai-gateway-infra/maas-api-75db5f846d-4r9fq"
Jul 16 11:18:08.952579 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:18:08.952482    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e92def53-e20d-4372-be08-b6e24d963d7d-maas-api-tls\") pod \"maas-api-75db5f846d-4r9fq\" (UID: \"e92def53-e20d-4372-be08-b6e24d963d7d\") " pod="odh-ai-gateway-infra/maas-api-75db5f846d-4r9fq"
Jul 16 11:18:08.952579 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:18:08.952566    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-72nt4\" (UniqueName: \"kubernetes.io/projected/e92def53-e20d-4372-be08-b6e24d963d7d-kube-api-access-72nt4\") pod \"maas-api-75db5f846d-4r9fq\" (UID: \"e92def53-e20d-4372-be08-b6e24d963d7d\") " pod="odh-ai-gateway-infra/maas-api-75db5f846d-4r9fq"
Jul 16 11:18:08.952829 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:18:08.952624    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e92def53-e20d-4372-be08-b6e24d963d7d-openshift-service-ca\") pod \"maas-api-75db5f846d-4r9fq\" (UID: \"e92def53-e20d-4372-be08-b6e24d963d7d\") " pod="odh-ai-gateway-infra/maas-api-75db5f846d-4r9fq"
Jul 16 11:18:08.953268 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:18:08.953244    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e92def53-e20d-4372-be08-b6e24d963d7d-openshift-service-ca\") pod \"maas-api-75db5f846d-4r9fq\" (UID: \"e92def53-e20d-4372-be08-b6e24d963d7d\") " pod="odh-ai-gateway-infra/maas-api-75db5f846d-4r9fq"
Jul 16 11:18:08.955170 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:18:08.955147    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e92def53-e20d-4372-be08-b6e24d963d7d-maas-api-tls\") pod \"maas-api-75db5f846d-4r9fq\" (UID: \"e92def53-e20d-4372-be08-b6e24d963d7d\") " pod="odh-ai-gateway-infra/maas-api-75db5f846d-4r9fq"
Jul 16 11:18:08.961836 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:18:08.961752    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-72nt4\" (UniqueName: \"kubernetes.io/projected/e92def53-e20d-4372-be08-b6e24d963d7d-kube-api-access-72nt4\") pod \"maas-api-75db5f846d-4r9fq\" (UID: \"e92def53-e20d-4372-be08-b6e24d963d7d\") " pod="odh-ai-gateway-infra/maas-api-75db5f846d-4r9fq"
Jul 16 11:18:09.052209 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:18:09.052175    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-75db5f846d-4r9fq"
Jul 16 11:18:09.209133 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:18:09.209102    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-75db5f846d-4r9fq"]
Jul 16 11:18:09.212221 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:18:09.212187    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode92def53_e20d_4372_be08_b6e24d963d7d.slice/crio-eb3aad6b51e2392f72f4ad0d91b35c9d7834ae414567210a5a43a39eebdf7a8d WatchSource:0}: Error finding container eb3aad6b51e2392f72f4ad0d91b35c9d7834ae414567210a5a43a39eebdf7a8d: Status 404 returned error can't find the container with id eb3aad6b51e2392f72f4ad0d91b35c9d7834ae414567210a5a43a39eebdf7a8d
Jul 16 11:18:09.256760 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:18:09.256731    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-75db5f846d-4r9fq" event={"ID":"e92def53-e20d-4372-be08-b6e24d963d7d","Type":"ContainerStarted","Data":"eb3aad6b51e2392f72f4ad0d91b35c9d7834ae414567210a5a43a39eebdf7a8d"}
Jul 16 11:18:09.274825 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:18:09.271753    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-f9b8d9b9b-4hpsd"]
Jul 16 11:18:09.279129 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:18:09.279101    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-f9b8d9b9b-4hpsd"
Jul 16 11:18:09.281238 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:18:09.281215    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-qn2pc\""
Jul 16 11:18:09.281238 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:18:09.281215    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Jul 16 11:18:09.284518 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:18:09.284491    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-f9b8d9b9b-4hpsd"]
Jul 16 11:18:09.329467 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:18:09.329431    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:18:09.356655 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:18:09.356610    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0bd3371c-a617-4407-9eeb-3d7dbf08725c-plugins-config-volume\") pod \"payload-processing-f9b8d9b9b-4hpsd\" (UID: \"0bd3371c-a617-4407-9eeb-3d7dbf08725c\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-4hpsd"
Jul 16 11:18:09.356886 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:18:09.356689    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g4bg2\" (UniqueName: \"kubernetes.io/projected/0bd3371c-a617-4407-9eeb-3d7dbf08725c-kube-api-access-g4bg2\") pod \"payload-processing-f9b8d9b9b-4hpsd\" (UID: \"0bd3371c-a617-4407-9eeb-3d7dbf08725c\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-4hpsd"
Jul 16 11:18:09.457419 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:18:09.457380    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g4bg2\" (UniqueName: \"kubernetes.io/projected/0bd3371c-a617-4407-9eeb-3d7dbf08725c-kube-api-access-g4bg2\") pod \"payload-processing-f9b8d9b9b-4hpsd\" (UID: \"0bd3371c-a617-4407-9eeb-3d7dbf08725c\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-4hpsd"
Jul 16 11:18:09.457588 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:18:09.457476    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0bd3371c-a617-4407-9eeb-3d7dbf08725c-plugins-config-volume\") pod \"payload-processing-f9b8d9b9b-4hpsd\" (UID: \"0bd3371c-a617-4407-9eeb-3d7dbf08725c\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-4hpsd"
Jul 16 11:18:09.458178 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:18:09.458156    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0bd3371c-a617-4407-9eeb-3d7dbf08725c-plugins-config-volume\") pod \"payload-processing-f9b8d9b9b-4hpsd\" (UID: \"0bd3371c-a617-4407-9eeb-3d7dbf08725c\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-4hpsd"
Jul 16 11:18:09.473383 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:18:09.473312    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g4bg2\" (UniqueName: \"kubernetes.io/projected/0bd3371c-a617-4407-9eeb-3d7dbf08725c-kube-api-access-g4bg2\") pod \"payload-processing-f9b8d9b9b-4hpsd\" (UID: \"0bd3371c-a617-4407-9eeb-3d7dbf08725c\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-4hpsd"
Jul 16 11:18:09.594495 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:18:09.594459    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-f9b8d9b9b-4hpsd"
Jul 16 11:18:09.721070 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:18:09.721035    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:18:09.745317 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:18:09.745283    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-f9b8d9b9b-4hpsd"]
Jul 16 11:18:09.747669 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:18:09.747644    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0bd3371c_a617_4407_9eeb_3d7dbf08725c.slice/crio-115b28b54ad98dc273026f12c17fb6cea8ce062c0230b3c83cb83a456bfe731e WatchSource:0}: Error finding container 115b28b54ad98dc273026f12c17fb6cea8ce062c0230b3c83cb83a456bfe731e: Status 404 returned error can't find the container with id 115b28b54ad98dc273026f12c17fb6cea8ce062c0230b3c83cb83a456bfe731e
Jul 16 11:18:10.267706 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:18:10.267659    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-f9b8d9b9b-4hpsd" event={"ID":"0bd3371c-a617-4407-9eeb-3d7dbf08725c","Type":"ContainerStarted","Data":"115b28b54ad98dc273026f12c17fb6cea8ce062c0230b3c83cb83a456bfe731e"}
Jul 16 11:18:12.289372 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:18:12.289330    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-f9b8d9b9b-4hpsd" event={"ID":"0bd3371c-a617-4407-9eeb-3d7dbf08725c","Type":"ContainerStarted","Data":"9a4b1e55ff0a1a610d9ff4b6f6a97d4337163ebb95ece255ed4ad6a729481329"}
Jul 16 11:18:12.289761 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:18:12.289406    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-f9b8d9b9b-4hpsd"
Jul 16 11:18:12.314868 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:18:12.314799    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-f9b8d9b9b-4hpsd" podStartSLOduration=1.676452683 podStartE2EDuration="3.314760584s" totalImagesPullingTime="1.638307901s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 11:18:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 11:18:12.313764713 +0000 UTC m=+592.685301752" watchObservedRunningTime="2026-07-16 11:18:12.314760584 +0000 UTC m=+592.686297620"
Jul 16 11:18:13.071512 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:18:13.071387    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:18:13.296927 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:18:13.296894    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-75db5f846d-4r9fq" event={"ID":"e92def53-e20d-4372-be08-b6e24d963d7d","Type":"ContainerStarted","Data":"499c6b88a44a3fa3782d730fb4382b9bf91b69ebc3081f1cba8fa7493abb216f"}
Jul 16 11:18:13.297369 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:18:13.296977    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-75db5f846d-4r9fq"
Jul 16 11:18:13.318264 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:18:13.318220    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-75db5f846d-4r9fq" podStartSLOduration=1.805801927 podStartE2EDuration="5.318204305s" totalImagesPullingTime="3.512402378s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 11:18:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 11:18:13.316197947 +0000 UTC m=+593.687734983" watchObservedRunningTime="2026-07-16 11:18:13.318204305 +0000 UTC m=+593.689741340"
Jul 16 11:18:16.827000 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:18:16.826950    2564 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-57qbg container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.38:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 16 11:18:16.827410 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:18:16.827024    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-57qbg" podUID="fae58f40-1477-417a-921a-2ed601fe72aa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.38:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 16 11:18:17.328693 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:18:17.328659    2564 generic.go:356] "Generic (PLEG): container finished" podID="fae58f40-1477-417a-921a-2ed601fe72aa" containerID="4cc140404ee6b5c4c8279c0ddf45fb4333564501e101be5ebf8db4a0da459de8" exitCode=0
Jul 16 11:18:17.328937 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:18:17.328724    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-57qbg" event={"ID":"fae58f40-1477-417a-921a-2ed601fe72aa","Type":"ContainerDied","Data":"4cc140404ee6b5c4c8279c0ddf45fb4333564501e101be5ebf8db4a0da459de8"}
Jul 16 11:18:17.329169 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:18:17.329155    2564 scope.go:117] "RemoveContainer" containerID="4cc140404ee6b5c4c8279c0ddf45fb4333564501e101be5ebf8db4a0da459de8"
Jul 16 11:18:17.330266 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:18:17.330235    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 16 11:18:17.330357 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:18:17.330339    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 16 11:18:17.330404 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:18:17.330392    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 16 11:18:18.335601 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:18:18.335560    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-57qbg" event={"ID":"fae58f40-1477-417a-921a-2ed601fe72aa","Type":"ContainerStarted","Data":"b01b487018c6558adde2a209e546571442f119a2299f594a59e8330839e8522f"}
Jul 16 11:18:19.279253 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:18:19.279217    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-57qbg"
Jul 16 11:18:19.279588 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:18:19.279548    2564 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-57qbg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.38:15021/healthz/ready\": dial tcp 10.133.0.38:15021: connect: connection refused" start-of-body=
Jul 16 11:18:19.279712 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:18:19.279626    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-57qbg" podUID="fae58f40-1477-417a-921a-2ed601fe72aa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.38:15021/healthz/ready\": dial tcp 10.133.0.38:15021: connect: connection refused"
Jul 16 11:18:19.314653 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:18:19.314624    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-75db5f846d-4r9fq"
Jul 16 11:18:20.124031 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:18:20.124002    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-lwmwf_4cb63124-522c-41e2-9d85-c2af29ac8eff/console-operator/1.log"
Jul 16 11:18:20.124508 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:18:20.124391    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-lwmwf_4cb63124-522c-41e2-9d85-c2af29ac8eff/console-operator/1.log"
Jul 16 11:18:20.131092 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:18:20.131069    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fchvw_aee7cbaf-a5e0-4e57-a9c1-504820f7f036/ovn-acl-logging/0.log"
Jul 16 11:18:20.131558 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:18:20.131541    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fchvw_aee7cbaf-a5e0-4e57-a9c1-504820f7f036/ovn-acl-logging/0.log"
Jul 16 11:18:20.279413 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:18:20.279369    2564 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-57qbg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.38:15021/healthz/ready\": dial tcp 10.133.0.38:15021: connect: connection refused" start-of-body=
Jul 16 11:18:20.279618 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:18:20.279437    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-57qbg" podUID="fae58f40-1477-417a-921a-2ed601fe72aa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.38:15021/healthz/ready\": dial tcp 10.133.0.38:15021: connect: connection refused"
Jul 16 11:18:20.318232 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:18:20.318181    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:18:20.415799 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:18:20.415687    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:18:21.279292 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:18:21.279245    2564 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-57qbg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.38:15021/healthz/ready\": dial tcp 10.133.0.38:15021: connect: connection refused" start-of-body=
Jul 16 11:18:21.279716 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:18:21.279330    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-57qbg" podUID="fae58f40-1477-417a-921a-2ed601fe72aa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.38:15021/healthz/ready\": dial tcp 10.133.0.38:15021: connect: connection refused"
Jul 16 11:18:22.302427 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:18:22.302400    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-57qbg"
Jul 16 11:18:22.302869 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:18:22.302716    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-57qbg"
Jul 16 11:18:22.303871 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:18:22.303851    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-57qbg"
Jul 16 11:18:23.299831 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:18:23.299802    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-f9b8d9b9b-4hpsd"
Jul 16 11:18:31.986287 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:18:31.986232    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:18:52.011031 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:18:52.011000    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-ndp4d"]
Jul 16 11:18:52.016192 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:18:52.016166    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-ndp4d"
Jul 16 11:18:52.019274 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:18:52.019243    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 16 11:18:52.019408 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:18:52.019316    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 16 11:18:52.019408 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:18:52.019241    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\""
Jul 16 11:18:52.019408 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:18:52.019241    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-7wggx\""
Jul 16 11:18:52.026464 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:18:52.026439    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-ndp4d"]
Jul 16 11:18:52.042250 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:18:52.042222    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:18:52.164680 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:18:52.164646    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4cf1525c-349f-48d3-959c-df7e98ae6e7e-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-ndp4d\" (UID: \"4cf1525c-349f-48d3-959c-df7e98ae6e7e\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-ndp4d"
Jul 16 11:18:52.164680 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:18:52.164682    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4cf1525c-349f-48d3-959c-df7e98ae6e7e-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-ndp4d\" (UID: \"4cf1525c-349f-48d3-959c-df7e98ae6e7e\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-ndp4d"
Jul 16 11:18:52.164922 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:18:52.164705    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4cf1525c-349f-48d3-959c-df7e98ae6e7e-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-ndp4d\" (UID: \"4cf1525c-349f-48d3-959c-df7e98ae6e7e\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-ndp4d"
Jul 16 11:18:52.164922 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:18:52.164752    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4cf1525c-349f-48d3-959c-df7e98ae6e7e-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-ndp4d\" (UID: \"4cf1525c-349f-48d3-959c-df7e98ae6e7e\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-ndp4d"
Jul 16 11:18:52.164922 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:18:52.164883    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vzvtp\" (UniqueName: \"kubernetes.io/projected/4cf1525c-349f-48d3-959c-df7e98ae6e7e-kube-api-access-vzvtp\") pod \"e2e-distinct-simulated-kserve-59975d69f9-ndp4d\" (UID: \"4cf1525c-349f-48d3-959c-df7e98ae6e7e\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-ndp4d"
Jul 16 11:18:52.165023 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:18:52.164929    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4cf1525c-349f-48d3-959c-df7e98ae6e7e-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-ndp4d\" (UID: \"4cf1525c-349f-48d3-959c-df7e98ae6e7e\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-ndp4d"
Jul 16 11:18:52.266081 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:18:52.265990    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4cf1525c-349f-48d3-959c-df7e98ae6e7e-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-ndp4d\" (UID: \"4cf1525c-349f-48d3-959c-df7e98ae6e7e\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-ndp4d"
Jul 16 11:18:52.266081 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:18:52.266065    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4cf1525c-349f-48d3-959c-df7e98ae6e7e-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-ndp4d\" (UID: \"4cf1525c-349f-48d3-959c-df7e98ae6e7e\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-ndp4d"
Jul 16 11:18:52.266314 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:18:52.266085    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4cf1525c-349f-48d3-959c-df7e98ae6e7e-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-ndp4d\" (UID: \"4cf1525c-349f-48d3-959c-df7e98ae6e7e\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-ndp4d"
Jul 16 11:18:52.266314 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:18:52.266113    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4cf1525c-349f-48d3-959c-df7e98ae6e7e-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-ndp4d\" (UID: \"4cf1525c-349f-48d3-959c-df7e98ae6e7e\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-ndp4d"
Jul 16 11:18:52.266314 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:18:52.266131    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4cf1525c-349f-48d3-959c-df7e98ae6e7e-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-ndp4d\" (UID: \"4cf1525c-349f-48d3-959c-df7e98ae6e7e\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-ndp4d"
Jul 16 11:18:52.266314 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:18:52.266290    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vzvtp\" (UniqueName: \"kubernetes.io/projected/4cf1525c-349f-48d3-959c-df7e98ae6e7e-kube-api-access-vzvtp\") pod \"e2e-distinct-simulated-kserve-59975d69f9-ndp4d\" (UID: \"4cf1525c-349f-48d3-959c-df7e98ae6e7e\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-ndp4d"
Jul 16 11:18:52.266547 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:18:52.266495    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4cf1525c-349f-48d3-959c-df7e98ae6e7e-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-ndp4d\" (UID: \"4cf1525c-349f-48d3-959c-df7e98ae6e7e\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-ndp4d"
Jul 16 11:18:52.266547 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:18:52.266512    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4cf1525c-349f-48d3-959c-df7e98ae6e7e-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-ndp4d\" (UID: \"4cf1525c-349f-48d3-959c-df7e98ae6e7e\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-ndp4d"
Jul 16 11:18:52.266681 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:18:52.266600    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4cf1525c-349f-48d3-959c-df7e98ae6e7e-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-ndp4d\" (UID: \"4cf1525c-349f-48d3-959c-df7e98ae6e7e\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-ndp4d"
Jul 16 11:18:52.268443 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:18:52.268422    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4cf1525c-349f-48d3-959c-df7e98ae6e7e-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-ndp4d\" (UID: \"4cf1525c-349f-48d3-959c-df7e98ae6e7e\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-ndp4d"
Jul 16 11:18:52.268807 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:18:52.268762    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4cf1525c-349f-48d3-959c-df7e98ae6e7e-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-ndp4d\" (UID: \"4cf1525c-349f-48d3-959c-df7e98ae6e7e\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-ndp4d"
Jul 16 11:18:52.276850 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:18:52.276761    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vzvtp\" (UniqueName: \"kubernetes.io/projected/4cf1525c-349f-48d3-959c-df7e98ae6e7e-kube-api-access-vzvtp\") pod \"e2e-distinct-simulated-kserve-59975d69f9-ndp4d\" (UID: \"4cf1525c-349f-48d3-959c-df7e98ae6e7e\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-ndp4d"
Jul 16 11:18:52.328140 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:18:52.328104    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-ndp4d"
Jul 16 11:18:52.474493 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:18:52.474468    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-ndp4d"]
Jul 16 11:18:52.476801 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:18:52.476762    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4cf1525c_349f_48d3_959c_df7e98ae6e7e.slice/crio-68e0a8bdca1f80e5e6bd7a7e5e55e919fa6e59cbc593fbdd6abebede45d22bea WatchSource:0}: Error finding container 68e0a8bdca1f80e5e6bd7a7e5e55e919fa6e59cbc593fbdd6abebede45d22bea: Status 404 returned error can't find the container with id 68e0a8bdca1f80e5e6bd7a7e5e55e919fa6e59cbc593fbdd6abebede45d22bea
Jul 16 11:18:52.521827 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:18:52.521720    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-ndp4d" event={"ID":"4cf1525c-349f-48d3-959c-df7e98ae6e7e","Type":"ContainerStarted","Data":"68e0a8bdca1f80e5e6bd7a7e5e55e919fa6e59cbc593fbdd6abebede45d22bea"}
Jul 16 11:18:54.535114 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:18:54.535076    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-ndp4d" event={"ID":"4cf1525c-349f-48d3-959c-df7e98ae6e7e","Type":"ContainerStarted","Data":"7deb75bf24a3843fc44a22104e3d532c9133626032bc3bcb83fc4db44dce2d25"}
Jul 16 11:18:54.553675 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:18:54.553608    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-ndp4d" podStartSLOduration=2.358563044 podStartE2EDuration="3.553584687s" totalImagesPullingTime="1.195021643s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 11:18:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 11:18:54.552924581 +0000 UTC m=+634.924461618" watchObservedRunningTime="2026-07-16 11:18:54.553584687 +0000 UTC m=+634.925121726"
Jul 16 11:19:02.329086 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:19:02.329051    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-ndp4d"
Jul 16 11:19:02.329583 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:19:02.329119    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-ndp4d"
Jul 16 11:19:02.341650 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:19:02.341628    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-ndp4d"
Jul 16 11:19:02.588503 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:19:02.588419    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-ndp4d"
Jul 16 11:19:05.623414 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:19:05.623377    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:19:07.710875 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:19:07.710836    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:19:13.203208 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:19:13.203170    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:19:17.895965 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:19:17.895927    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:19:17.959833 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:19:17.959758    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:19:21.610030 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:19:21.609991    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-cxw99"]
Jul 16 11:19:21.617536 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:19:21.617511    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-cxw99"
Jul 16 11:19:21.619839 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:19:21.619812    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\""
Jul 16 11:19:21.622765 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:19:21.622737    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-cxw99"]
Jul 16 11:19:21.651459 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:19:21.651422    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:19:21.742303 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:19:21.742268    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/205694a9-061f-414d-9496-f65b41a9bc39-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-cxw99\" (UID: \"205694a9-061f-414d-9496-f65b41a9bc39\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-cxw99"
Jul 16 11:19:21.742481 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:19:21.742309    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5qswc\" (UniqueName: \"kubernetes.io/projected/205694a9-061f-414d-9496-f65b41a9bc39-kube-api-access-5qswc\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-cxw99\" (UID: \"205694a9-061f-414d-9496-f65b41a9bc39\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-cxw99"
Jul 16 11:19:21.742481 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:19:21.742385    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/205694a9-061f-414d-9496-f65b41a9bc39-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-cxw99\" (UID: \"205694a9-061f-414d-9496-f65b41a9bc39\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-cxw99"
Jul 16 11:19:21.742481 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:19:21.742462    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/205694a9-061f-414d-9496-f65b41a9bc39-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-cxw99\" (UID: \"205694a9-061f-414d-9496-f65b41a9bc39\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-cxw99"
Jul 16 11:19:21.742587 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:19:21.742505    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/205694a9-061f-414d-9496-f65b41a9bc39-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-cxw99\" (UID: \"205694a9-061f-414d-9496-f65b41a9bc39\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-cxw99"
Jul 16 11:19:21.742587 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:19:21.742531    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/205694a9-061f-414d-9496-f65b41a9bc39-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-cxw99\" (UID: \"205694a9-061f-414d-9496-f65b41a9bc39\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-cxw99"
Jul 16 11:19:21.843330 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:19:21.843295    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/205694a9-061f-414d-9496-f65b41a9bc39-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-cxw99\" (UID: \"205694a9-061f-414d-9496-f65b41a9bc39\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-cxw99"
Jul 16 11:19:21.843523 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:19:21.843363    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/205694a9-061f-414d-9496-f65b41a9bc39-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-cxw99\" (UID: \"205694a9-061f-414d-9496-f65b41a9bc39\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-cxw99"
Jul 16 11:19:21.843523 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:19:21.843421    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/205694a9-061f-414d-9496-f65b41a9bc39-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-cxw99\" (UID: \"205694a9-061f-414d-9496-f65b41a9bc39\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-cxw99"
Jul 16 11:19:21.843523 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:19:21.843450    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/205694a9-061f-414d-9496-f65b41a9bc39-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-cxw99\" (UID: \"205694a9-061f-414d-9496-f65b41a9bc39\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-cxw99"
Jul 16 11:19:21.843662 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:19:21.843611    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/205694a9-061f-414d-9496-f65b41a9bc39-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-cxw99\" (UID: \"205694a9-061f-414d-9496-f65b41a9bc39\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-cxw99"
Jul 16 11:19:21.843717 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:19:21.843665    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5qswc\" (UniqueName: \"kubernetes.io/projected/205694a9-061f-414d-9496-f65b41a9bc39-kube-api-access-5qswc\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-cxw99\" (UID: \"205694a9-061f-414d-9496-f65b41a9bc39\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-cxw99"
Jul 16 11:19:21.843799 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:19:21.843749    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/205694a9-061f-414d-9496-f65b41a9bc39-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-cxw99\" (UID: \"205694a9-061f-414d-9496-f65b41a9bc39\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-cxw99"
Jul 16 11:19:21.843859 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:19:21.843821    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/205694a9-061f-414d-9496-f65b41a9bc39-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-cxw99\" (UID: \"205694a9-061f-414d-9496-f65b41a9bc39\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-cxw99"
Jul 16 11:19:21.843918 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:19:21.843855    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/205694a9-061f-414d-9496-f65b41a9bc39-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-cxw99\" (UID: \"205694a9-061f-414d-9496-f65b41a9bc39\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-cxw99"
Jul 16 11:19:21.845818 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:19:21.845790    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/205694a9-061f-414d-9496-f65b41a9bc39-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-cxw99\" (UID: \"205694a9-061f-414d-9496-f65b41a9bc39\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-cxw99"
Jul 16 11:19:21.846046 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:19:21.846027    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/205694a9-061f-414d-9496-f65b41a9bc39-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-cxw99\" (UID: \"205694a9-061f-414d-9496-f65b41a9bc39\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-cxw99"
Jul 16 11:19:21.851591 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:19:21.851553    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5qswc\" (UniqueName: \"kubernetes.io/projected/205694a9-061f-414d-9496-f65b41a9bc39-kube-api-access-5qswc\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-cxw99\" (UID: \"205694a9-061f-414d-9496-f65b41a9bc39\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-cxw99"
Jul 16 11:19:21.931609 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:19:21.931506    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-cxw99"
Jul 16 11:19:22.076699 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:19:22.076673    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-cxw99"]
Jul 16 11:19:22.079109 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:19:22.079081    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod205694a9_061f_414d_9496_f65b41a9bc39.slice/crio-00d18e84268f1818698c57ce07b899da920bb75c8a00880dfa4ce1322d395efd WatchSource:0}: Error finding container 00d18e84268f1818698c57ce07b899da920bb75c8a00880dfa4ce1322d395efd: Status 404 returned error can't find the container with id 00d18e84268f1818698c57ce07b899da920bb75c8a00880dfa4ce1322d395efd
Jul 16 11:19:22.080565 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:19:22.080544    2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 16 11:19:22.684742 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:19:22.684644    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-cxw99" event={"ID":"205694a9-061f-414d-9496-f65b41a9bc39","Type":"ContainerStarted","Data":"8be7dacbc50ba6bc24cd1a43eb3cfb42d2dee0ff5123e415154d23e9c3f2e188"}
Jul 16 11:19:22.684742 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:19:22.684704    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-cxw99" event={"ID":"205694a9-061f-414d-9496-f65b41a9bc39","Type":"ContainerStarted","Data":"00d18e84268f1818698c57ce07b899da920bb75c8a00880dfa4ce1322d395efd"}
Jul 16 11:19:22.703462 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:19:22.703400    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-cxw99" podStartSLOduration=1.486546136 podStartE2EDuration="1.703377394s" totalImagesPullingTime="216.831258ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 11:19:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 11:19:22.700857288 +0000 UTC m=+663.072394324" watchObservedRunningTime="2026-07-16 11:19:22.703377394 +0000 UTC m=+663.074914431"
Jul 16 11:19:31.932580 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:19:31.932537    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-cxw99"
Jul 16 11:19:31.933241 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:19:31.932622    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-cxw99"
Jul 16 11:19:31.945425 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:19:31.945394    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-cxw99"
Jul 16 11:19:32.755397 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:19:32.755364    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-cxw99"
Jul 16 11:19:36.152171 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:19:36.152135    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:19:47.873215 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:19:47.873175    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:20:15.332672 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:20:15.332562    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:20:15.441469 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:20:15.441433    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:20:42.898864 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:20:42.898818    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:21:39.963162 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:21:39.963128    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:21:40.063914 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:21:40.063873    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:21:40.232755 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:21:40.232620    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:21:40.331686 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:21:40.331650    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:21:40.543304 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:21:40.543247    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-89c4bb9fd-zkhlg"]
Jul 16 11:21:40.543555 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:21:40.543526    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-89c4bb9fd-zkhlg" podUID="1396e383-9fa3-420a-b53f-bd713f14c3b1" containerName="authorino" containerID="cri-o://aad048fba33e9c149227508b754584ec8864abeb0f49777d464961c712699654" gracePeriod=30
Jul 16 11:21:40.812804 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:21:40.812759    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-89c4bb9fd-zkhlg"
Jul 16 11:21:40.899000 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:21:40.898958    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/1396e383-9fa3-420a-b53f-bd713f14c3b1-tls-cert\") pod \"1396e383-9fa3-420a-b53f-bd713f14c3b1\" (UID: \"1396e383-9fa3-420a-b53f-bd713f14c3b1\") "
Jul 16 11:21:40.899171 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:21:40.899149    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8xsnf\" (UniqueName: \"kubernetes.io/projected/1396e383-9fa3-420a-b53f-bd713f14c3b1-kube-api-access-8xsnf\") pod \"1396e383-9fa3-420a-b53f-bd713f14c3b1\" (UID: \"1396e383-9fa3-420a-b53f-bd713f14c3b1\") "
Jul 16 11:21:40.901172 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:21:40.901133    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1396e383-9fa3-420a-b53f-bd713f14c3b1-kube-api-access-8xsnf" (OuterVolumeSpecName: "kube-api-access-8xsnf") pod "1396e383-9fa3-420a-b53f-bd713f14c3b1" (UID: "1396e383-9fa3-420a-b53f-bd713f14c3b1"). InnerVolumeSpecName "kube-api-access-8xsnf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 11:21:40.911035 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:21:40.911001    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1396e383-9fa3-420a-b53f-bd713f14c3b1-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "1396e383-9fa3-420a-b53f-bd713f14c3b1" (UID: "1396e383-9fa3-420a-b53f-bd713f14c3b1"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 11:21:41.000249 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:21:41.000174    2564 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/1396e383-9fa3-420a-b53f-bd713f14c3b1-tls-cert\") on node \"ip-10-0-135-184.ec2.internal\" DevicePath \"\""
Jul 16 11:21:41.000249 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:21:41.000203    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8xsnf\" (UniqueName: \"kubernetes.io/projected/1396e383-9fa3-420a-b53f-bd713f14c3b1-kube-api-access-8xsnf\") on node \"ip-10-0-135-184.ec2.internal\" DevicePath \"\""
Jul 16 11:21:41.451916 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:21:41.451878    2564 generic.go:356] "Generic (PLEG): container finished" podID="1396e383-9fa3-420a-b53f-bd713f14c3b1" containerID="aad048fba33e9c149227508b754584ec8864abeb0f49777d464961c712699654" exitCode=0
Jul 16 11:21:41.452131 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:21:41.451922    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-89c4bb9fd-zkhlg"
Jul 16 11:21:41.452131 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:21:41.451969    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-89c4bb9fd-zkhlg" event={"ID":"1396e383-9fa3-420a-b53f-bd713f14c3b1","Type":"ContainerDied","Data":"aad048fba33e9c149227508b754584ec8864abeb0f49777d464961c712699654"}
Jul 16 11:21:41.452131 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:21:41.452021    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-89c4bb9fd-zkhlg" event={"ID":"1396e383-9fa3-420a-b53f-bd713f14c3b1","Type":"ContainerDied","Data":"0b1b66ccc89857e07bcc32969c44d3f92662323ce7da02e2d3c22add946268ba"}
Jul 16 11:21:41.452131 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:21:41.452045    2564 scope.go:117] "RemoveContainer" containerID="aad048fba33e9c149227508b754584ec8864abeb0f49777d464961c712699654"
Jul 16 11:21:41.462321 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:21:41.462295    2564 scope.go:117] "RemoveContainer" containerID="aad048fba33e9c149227508b754584ec8864abeb0f49777d464961c712699654"
Jul 16 11:21:41.462676 ip-10-0-135-184 kubenswrapper[2564]: E0716 11:21:41.462655    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"aad048fba33e9c149227508b754584ec8864abeb0f49777d464961c712699654\": container with ID starting with aad048fba33e9c149227508b754584ec8864abeb0f49777d464961c712699654 not found: ID does not exist" containerID="aad048fba33e9c149227508b754584ec8864abeb0f49777d464961c712699654"
Jul 16 11:21:41.462728 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:21:41.462687    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aad048fba33e9c149227508b754584ec8864abeb0f49777d464961c712699654"} err="failed to get container status \"aad048fba33e9c149227508b754584ec8864abeb0f49777d464961c712699654\": rpc error: code = NotFound desc = could not find container \"aad048fba33e9c149227508b754584ec8864abeb0f49777d464961c712699654\": container with ID starting with aad048fba33e9c149227508b754584ec8864abeb0f49777d464961c712699654 not found: ID does not exist"
Jul 16 11:21:41.481312 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:21:41.481271    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-89c4bb9fd-zkhlg"]
Jul 16 11:21:41.486572 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:21:41.486548    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-89c4bb9fd-zkhlg"]
Jul 16 11:21:42.302783 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:21:42.302732    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1396e383-9fa3-420a-b53f-bd713f14c3b1" path="/var/lib/kubelet/pods/1396e383-9fa3-420a-b53f-bd713f14c3b1/volumes"
Jul 16 11:23:00.240485 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:23:00.240442    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:23:00.339720 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:23:00.339683    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-54f9b6467-ls4jk"]
Jul 16 11:23:00.339951 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:23:00.339906    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-54f9b6467-ls4jk" podUID="1cb93906-d30d-4d23-a6ff-d5c377ef2dcb" containerName="manager" containerID="cri-o://bc4d157c2167a7604c4ca253ce9bba6cdbca5028ec75875e0543d5300e7419fc" gracePeriod=30
Jul 16 11:23:00.607142 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:23:00.607119    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-54f9b6467-ls4jk"
Jul 16 11:23:00.751926 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:23:00.751888    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q9r2n\" (UniqueName: \"kubernetes.io/projected/1cb93906-d30d-4d23-a6ff-d5c377ef2dcb-kube-api-access-q9r2n\") pod \"1cb93906-d30d-4d23-a6ff-d5c377ef2dcb\" (UID: \"1cb93906-d30d-4d23-a6ff-d5c377ef2dcb\") "
Jul 16 11:23:00.752137 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:23:00.752006    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1cb93906-d30d-4d23-a6ff-d5c377ef2dcb-webhook-cert\") pod \"1cb93906-d30d-4d23-a6ff-d5c377ef2dcb\" (UID: \"1cb93906-d30d-4d23-a6ff-d5c377ef2dcb\") "
Jul 16 11:23:00.754180 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:23:00.754143    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1cb93906-d30d-4d23-a6ff-d5c377ef2dcb-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "1cb93906-d30d-4d23-a6ff-d5c377ef2dcb" (UID: "1cb93906-d30d-4d23-a6ff-d5c377ef2dcb"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 11:23:00.754180 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:23:00.754155    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1cb93906-d30d-4d23-a6ff-d5c377ef2dcb-kube-api-access-q9r2n" (OuterVolumeSpecName: "kube-api-access-q9r2n") pod "1cb93906-d30d-4d23-a6ff-d5c377ef2dcb" (UID: "1cb93906-d30d-4d23-a6ff-d5c377ef2dcb"). InnerVolumeSpecName "kube-api-access-q9r2n". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 11:23:00.853180 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:23:00.853088    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q9r2n\" (UniqueName: \"kubernetes.io/projected/1cb93906-d30d-4d23-a6ff-d5c377ef2dcb-kube-api-access-q9r2n\") on node \"ip-10-0-135-184.ec2.internal\" DevicePath \"\""
Jul 16 11:23:00.853180 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:23:00.853122    2564 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1cb93906-d30d-4d23-a6ff-d5c377ef2dcb-webhook-cert\") on node \"ip-10-0-135-184.ec2.internal\" DevicePath \"\""
Jul 16 11:23:00.864811 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:23:00.864760    2564 generic.go:356] "Generic (PLEG): container finished" podID="1cb93906-d30d-4d23-a6ff-d5c377ef2dcb" containerID="bc4d157c2167a7604c4ca253ce9bba6cdbca5028ec75875e0543d5300e7419fc" exitCode=0
Jul 16 11:23:00.864811 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:23:00.864804    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-54f9b6467-ls4jk" event={"ID":"1cb93906-d30d-4d23-a6ff-d5c377ef2dcb","Type":"ContainerDied","Data":"bc4d157c2167a7604c4ca253ce9bba6cdbca5028ec75875e0543d5300e7419fc"}
Jul 16 11:23:00.865070 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:23:00.864818    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-54f9b6467-ls4jk"
Jul 16 11:23:00.865070 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:23:00.864871    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-54f9b6467-ls4jk" event={"ID":"1cb93906-d30d-4d23-a6ff-d5c377ef2dcb","Type":"ContainerDied","Data":"5e27890a6f9cf23bd6b175e06e75a179692db1a8ed4b201e9af285d3ceb26536"}
Jul 16 11:23:00.865070 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:23:00.864905    2564 scope.go:117] "RemoveContainer" containerID="bc4d157c2167a7604c4ca253ce9bba6cdbca5028ec75875e0543d5300e7419fc"
Jul 16 11:23:00.874643 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:23:00.874625    2564 scope.go:117] "RemoveContainer" containerID="bc4d157c2167a7604c4ca253ce9bba6cdbca5028ec75875e0543d5300e7419fc"
Jul 16 11:23:00.875072 ip-10-0-135-184 kubenswrapper[2564]: E0716 11:23:00.875049    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bc4d157c2167a7604c4ca253ce9bba6cdbca5028ec75875e0543d5300e7419fc\": container with ID starting with bc4d157c2167a7604c4ca253ce9bba6cdbca5028ec75875e0543d5300e7419fc not found: ID does not exist" containerID="bc4d157c2167a7604c4ca253ce9bba6cdbca5028ec75875e0543d5300e7419fc"
Jul 16 11:23:00.875154 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:23:00.875078    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bc4d157c2167a7604c4ca253ce9bba6cdbca5028ec75875e0543d5300e7419fc"} err="failed to get container status \"bc4d157c2167a7604c4ca253ce9bba6cdbca5028ec75875e0543d5300e7419fc\": rpc error: code = NotFound desc = could not find container \"bc4d157c2167a7604c4ca253ce9bba6cdbca5028ec75875e0543d5300e7419fc\": container with ID starting with bc4d157c2167a7604c4ca253ce9bba6cdbca5028ec75875e0543d5300e7419fc not found: ID does not exist"
Jul 16 11:23:00.885941 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:23:00.885910    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-54f9b6467-ls4jk"]
Jul 16 11:23:00.889517 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:23:00.889494    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-54f9b6467-ls4jk"]
Jul 16 11:23:01.631484 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:23:01.631450    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-54f9b6467-txxc6"]
Jul 16 11:23:01.631908 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:23:01.631899    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1396e383-9fa3-420a-b53f-bd713f14c3b1" containerName="authorino"
Jul 16 11:23:01.631952 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:23:01.631912    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="1396e383-9fa3-420a-b53f-bd713f14c3b1" containerName="authorino"
Jul 16 11:23:01.631952 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:23:01.631927    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1cb93906-d30d-4d23-a6ff-d5c377ef2dcb" containerName="manager"
Jul 16 11:23:01.631952 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:23:01.631934    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="1cb93906-d30d-4d23-a6ff-d5c377ef2dcb" containerName="manager"
Jul 16 11:23:01.632053 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:23:01.632013    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="1cb93906-d30d-4d23-a6ff-d5c377ef2dcb" containerName="manager"
Jul 16 11:23:01.632053 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:23:01.632022    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="1396e383-9fa3-420a-b53f-bd713f14c3b1" containerName="authorino"
Jul 16 11:23:01.636392 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:23:01.636368    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-54f9b6467-txxc6"
Jul 16 11:23:01.638971 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:23:01.638940    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 16 11:23:01.638971 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:23:01.638940    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-7g9zg\""
Jul 16 11:23:01.639198 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:23:01.638949    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 16 11:23:01.646150 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:23:01.646122    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-54f9b6467-txxc6"]
Jul 16 11:23:01.762189 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:23:01.762147    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-txtqg\" (UniqueName: \"kubernetes.io/projected/944fff28-f017-400b-b98d-9238292c5c83-kube-api-access-txtqg\") pod \"maas-controller-54f9b6467-txxc6\" (UID: \"944fff28-f017-400b-b98d-9238292c5c83\") " pod="opendatahub/maas-controller-54f9b6467-txxc6"
Jul 16 11:23:01.762374 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:23:01.762201    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/944fff28-f017-400b-b98d-9238292c5c83-webhook-cert\") pod \"maas-controller-54f9b6467-txxc6\" (UID: \"944fff28-f017-400b-b98d-9238292c5c83\") " pod="opendatahub/maas-controller-54f9b6467-txxc6"
Jul 16 11:23:01.863824 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:23:01.863753    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-txtqg\" (UniqueName: \"kubernetes.io/projected/944fff28-f017-400b-b98d-9238292c5c83-kube-api-access-txtqg\") pod \"maas-controller-54f9b6467-txxc6\" (UID: \"944fff28-f017-400b-b98d-9238292c5c83\") " pod="opendatahub/maas-controller-54f9b6467-txxc6"
Jul 16 11:23:01.864042 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:23:01.863852    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/944fff28-f017-400b-b98d-9238292c5c83-webhook-cert\") pod \"maas-controller-54f9b6467-txxc6\" (UID: \"944fff28-f017-400b-b98d-9238292c5c83\") " pod="opendatahub/maas-controller-54f9b6467-txxc6"
Jul 16 11:23:01.866710 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:23:01.866680    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/944fff28-f017-400b-b98d-9238292c5c83-webhook-cert\") pod \"maas-controller-54f9b6467-txxc6\" (UID: \"944fff28-f017-400b-b98d-9238292c5c83\") " pod="opendatahub/maas-controller-54f9b6467-txxc6"
Jul 16 11:23:01.871962 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:23:01.871934    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-txtqg\" (UniqueName: \"kubernetes.io/projected/944fff28-f017-400b-b98d-9238292c5c83-kube-api-access-txtqg\") pod \"maas-controller-54f9b6467-txxc6\" (UID: \"944fff28-f017-400b-b98d-9238292c5c83\") " pod="opendatahub/maas-controller-54f9b6467-txxc6"
Jul 16 11:23:01.949386 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:23:01.949286    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-54f9b6467-txxc6"
Jul 16 11:23:02.097570 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:23:02.097525    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-54f9b6467-txxc6"]
Jul 16 11:23:02.101982 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:23:02.101943    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod944fff28_f017_400b_b98d_9238292c5c83.slice/crio-66a335ae4dbbc639f83c331559a5578b3c0bcbe8b9b7f5871b83afa6b234bb9c WatchSource:0}: Error finding container 66a335ae4dbbc639f83c331559a5578b3c0bcbe8b9b7f5871b83afa6b234bb9c: Status 404 returned error can't find the container with id 66a335ae4dbbc639f83c331559a5578b3c0bcbe8b9b7f5871b83afa6b234bb9c
Jul 16 11:23:02.133418 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:23:02.133385    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:23:02.301808 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:23:02.301739    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1cb93906-d30d-4d23-a6ff-d5c377ef2dcb" path="/var/lib/kubelet/pods/1cb93906-d30d-4d23-a6ff-d5c377ef2dcb/volumes"
Jul 16 11:23:02.879370 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:23:02.879334    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-54f9b6467-txxc6" event={"ID":"944fff28-f017-400b-b98d-9238292c5c83","Type":"ContainerStarted","Data":"66a335ae4dbbc639f83c331559a5578b3c0bcbe8b9b7f5871b83afa6b234bb9c"}
Jul 16 11:23:03.886874 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:23:03.886837    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-54f9b6467-txxc6" event={"ID":"944fff28-f017-400b-b98d-9238292c5c83","Type":"ContainerStarted","Data":"51e2a080b07242ac6a5dc2146c16a60c59567100dce690b5531b4487592450c5"}
Jul 16 11:23:03.887337 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:23:03.887006    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-54f9b6467-txxc6"
Jul 16 11:23:03.908359 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:23:03.908308    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-54f9b6467-txxc6" podStartSLOduration=2.195418116 podStartE2EDuration="2.908288497s" totalImagesPullingTime="712.870381ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 11:23:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 11:23:03.905885751 +0000 UTC m=+884.277422786" watchObservedRunningTime="2026-07-16 11:23:03.908288497 +0000 UTC m=+884.279825532"
Jul 16 11:23:14.895114 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:23:14.895081    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-54f9b6467-txxc6"
Jul 16 11:23:19.920214 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:23:19.920119    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:23:20.022334 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:23:20.022289    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:23:20.167519 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:23:20.167493    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-lwmwf_4cb63124-522c-41e2-9d85-c2af29ac8eff/console-operator/1.log"
Jul 16 11:23:20.167708 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:23:20.167493    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-lwmwf_4cb63124-522c-41e2-9d85-c2af29ac8eff/console-operator/1.log"
Jul 16 11:23:20.175904 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:23:20.175810    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fchvw_aee7cbaf-a5e0-4e57-a9c1-504820f7f036/ovn-acl-logging/0.log"
Jul 16 11:23:20.176078 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:23:20.176040    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fchvw_aee7cbaf-a5e0-4e57-a9c1-504820f7f036/ovn-acl-logging/0.log"
Jul 16 11:23:41.209567 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:23:41.209528    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:23:41.311205 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:23:41.311171    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:23:41.430426 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:23:41.430385    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:23:47.429341 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:23:47.429306    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:23:47.507795 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:23:47.507725    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:23:47.588224 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:23:47.588187    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:23:47.792437 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:23:47.792397    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:23:53.852675 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:23:53.852627    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:23:55.339969 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:23:55.339927    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:26:25.565498 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:26:25.565419    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:27:56.882895 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:27:56.882862    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:28:20.209609 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:28:20.209577    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-lwmwf_4cb63124-522c-41e2-9d85-c2af29ac8eff/console-operator/1.log"
Jul 16 11:28:20.212079 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:28:20.211830    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-lwmwf_4cb63124-522c-41e2-9d85-c2af29ac8eff/console-operator/1.log"
Jul 16 11:28:20.216710 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:28:20.216687    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fchvw_aee7cbaf-a5e0-4e57-a9c1-504820f7f036/ovn-acl-logging/0.log"
Jul 16 11:28:20.218986 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:28:20.218968    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fchvw_aee7cbaf-a5e0-4e57-a9c1-504820f7f036/ovn-acl-logging/0.log"
Jul 16 11:28:47.198093 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:28:47.198057    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:30:00.147936 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:30:00.147907    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29736690-tzf25"]
Jul 16 11:30:00.151584 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:30:00.151569    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29736690-tzf25"
Jul 16 11:30:00.153820 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:30:00.153799    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-4mqwr\""
Jul 16 11:30:00.158438 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:30:00.158417    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29736690-tzf25"]
Jul 16 11:30:00.162584 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:30:00.162564    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29736690-tzf25"
Jul 16 11:30:00.514425 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:30:00.514397    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29736690-tzf25"]
Jul 16 11:30:00.516649 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:30:00.516621    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod28908e6b_e354_416c_8303_36ebdf9f2737.slice/crio-186b7975c70a2021256d4a91851d6601e094cc39fb3bf1bdc07ecb50c08a5ea5 WatchSource:0}: Error finding container 186b7975c70a2021256d4a91851d6601e094cc39fb3bf1bdc07ecb50c08a5ea5: Status 404 returned error can't find the container with id 186b7975c70a2021256d4a91851d6601e094cc39fb3bf1bdc07ecb50c08a5ea5
Jul 16 11:30:00.518527 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:30:00.518513    2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 16 11:30:01.080958 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:30:01.080879    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29736690-tzf25" event={"ID":"28908e6b-e354-416c-8303-36ebdf9f2737","Type":"ContainerStarted","Data":"186b7975c70a2021256d4a91851d6601e094cc39fb3bf1bdc07ecb50c08a5ea5"}
Jul 16 11:30:04.099380 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:30:04.099284    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29736690-tzf25" event={"ID":"28908e6b-e354-416c-8303-36ebdf9f2737","Type":"ContainerStarted","Data":"09e73342f1268bc5e0746983fe43b5f37b3e93d32425942df778ceb0196adc8c"}
Jul 16 11:30:04.117601 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:30:04.117547    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29736690-tzf25" podStartSLOduration=1.187145492 podStartE2EDuration="4.11753178s" totalImagesPullingTime="2.930386288s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 11:30:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 11:30:04.116635717 +0000 UTC m=+1304.488172754" watchObservedRunningTime="2026-07-16 11:30:04.11753178 +0000 UTC m=+1304.489068815"
Jul 16 11:30:05.105529 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:30:05.105493    2564 generic.go:356] "Generic (PLEG): container finished" podID="28908e6b-e354-416c-8303-36ebdf9f2737" containerID="09e73342f1268bc5e0746983fe43b5f37b3e93d32425942df778ceb0196adc8c" exitCode=0
Jul 16 11:30:05.105924 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:30:05.105570    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29736690-tzf25" event={"ID":"28908e6b-e354-416c-8303-36ebdf9f2737","Type":"ContainerDied","Data":"09e73342f1268bc5e0746983fe43b5f37b3e93d32425942df778ceb0196adc8c"}
Jul 16 11:30:06.255420 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:30:06.255397    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29736690-tzf25"
Jul 16 11:30:07.118145 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:30:07.118118    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29736690-tzf25"
Jul 16 11:30:07.118344 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:30:07.118114    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29736690-tzf25" event={"ID":"28908e6b-e354-416c-8303-36ebdf9f2737","Type":"ContainerDied","Data":"186b7975c70a2021256d4a91851d6601e094cc39fb3bf1bdc07ecb50c08a5ea5"}
Jul 16 11:30:07.118344 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:30:07.118272    2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="186b7975c70a2021256d4a91851d6601e094cc39fb3bf1bdc07ecb50c08a5ea5"
Jul 16 11:30:40.051846 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:30:40.051810    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:30:42.517873 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:30:42.517833    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:33:20.248265 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:33:20.248159    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-lwmwf_4cb63124-522c-41e2-9d85-c2af29ac8eff/console-operator/1.log"
Jul 16 11:33:20.252532 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:33:20.252514    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-lwmwf_4cb63124-522c-41e2-9d85-c2af29ac8eff/console-operator/1.log"
Jul 16 11:33:20.255418 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:33:20.255399    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fchvw_aee7cbaf-a5e0-4e57-a9c1-504820f7f036/ovn-acl-logging/0.log"
Jul 16 11:33:20.259470 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:33:20.259455    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fchvw_aee7cbaf-a5e0-4e57-a9c1-504820f7f036/ovn-acl-logging/0.log"
Jul 16 11:33:59.366223 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:33:59.366191    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:34:19.902011 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:34:19.901973    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:34:37.347758 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:34:37.347724    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:34:37.447292 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:34:37.447264    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:34:37.772840 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:34:37.772805    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:34:37.846087 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:34:37.846057    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:34:43.957895 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:34:43.957860    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:34:44.023168 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:34:44.023140    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:34:44.179466 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:34:44.179434    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-20f9d85e-openshift-default-7f955978b9-p8gwl"]
Jul 16 11:34:44.179990 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:34:44.179972    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="28908e6b-e354-416c-8303-36ebdf9f2737" containerName="cleanup"
Jul 16 11:34:44.179990 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:34:44.179990    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="28908e6b-e354-416c-8303-36ebdf9f2737" containerName="cleanup"
Jul 16 11:34:44.180109 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:34:44.180052    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="28908e6b-e354-416c-8303-36ebdf9f2737" containerName="cleanup"
Jul 16 11:34:44.183233 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:34:44.183216    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-20f9d85e-openshift-default-7f955978b9-p8gwl"
Jul 16 11:34:44.186642 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:34:44.186626    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-20f9d85e-openshift-default-dockercfg-t4x24\""
Jul 16 11:34:44.201157 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:34:44.201130    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:34:44.230985 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:34:44.230931    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-20f9d85e-openshift-default-7f955978b9-p8gwl"]
Jul 16 11:34:44.254627 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:34:44.254603    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3a86aa26-010b-463c-9fb8-2ef6973d0d85-istio-envoy\") pod \"e2e-ait-20f9d85e-openshift-default-7f955978b9-p8gwl\" (UID: \"3a86aa26-010b-463c-9fb8-2ef6973d0d85\") " pod="openshift-ingress/e2e-ait-20f9d85e-openshift-default-7f955978b9-p8gwl"
Jul 16 11:34:44.254766 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:34:44.254641    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3a86aa26-010b-463c-9fb8-2ef6973d0d85-credential-socket\") pod \"e2e-ait-20f9d85e-openshift-default-7f955978b9-p8gwl\" (UID: \"3a86aa26-010b-463c-9fb8-2ef6973d0d85\") " pod="openshift-ingress/e2e-ait-20f9d85e-openshift-default-7f955978b9-p8gwl"
Jul 16 11:34:44.254766 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:34:44.254662    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3a86aa26-010b-463c-9fb8-2ef6973d0d85-workload-certs\") pod \"e2e-ait-20f9d85e-openshift-default-7f955978b9-p8gwl\" (UID: \"3a86aa26-010b-463c-9fb8-2ef6973d0d85\") " pod="openshift-ingress/e2e-ait-20f9d85e-openshift-default-7f955978b9-p8gwl"
Jul 16 11:34:44.254906 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:34:44.254754    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pszs2\" (UniqueName: \"kubernetes.io/projected/3a86aa26-010b-463c-9fb8-2ef6973d0d85-kube-api-access-pszs2\") pod \"e2e-ait-20f9d85e-openshift-default-7f955978b9-p8gwl\" (UID: \"3a86aa26-010b-463c-9fb8-2ef6973d0d85\") " pod="openshift-ingress/e2e-ait-20f9d85e-openshift-default-7f955978b9-p8gwl"
Jul 16 11:34:44.254906 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:34:44.254842    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3a86aa26-010b-463c-9fb8-2ef6973d0d85-istiod-ca-cert\") pod \"e2e-ait-20f9d85e-openshift-default-7f955978b9-p8gwl\" (UID: \"3a86aa26-010b-463c-9fb8-2ef6973d0d85\") " pod="openshift-ingress/e2e-ait-20f9d85e-openshift-default-7f955978b9-p8gwl"
Jul 16 11:34:44.254906 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:34:44.254874    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3a86aa26-010b-463c-9fb8-2ef6973d0d85-istio-data\") pod \"e2e-ait-20f9d85e-openshift-default-7f955978b9-p8gwl\" (UID: \"3a86aa26-010b-463c-9fb8-2ef6973d0d85\") " pod="openshift-ingress/e2e-ait-20f9d85e-openshift-default-7f955978b9-p8gwl"
Jul 16 11:34:44.254906 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:34:44.254901    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3a86aa26-010b-463c-9fb8-2ef6973d0d85-workload-socket\") pod \"e2e-ait-20f9d85e-openshift-default-7f955978b9-p8gwl\" (UID: \"3a86aa26-010b-463c-9fb8-2ef6973d0d85\") " pod="openshift-ingress/e2e-ait-20f9d85e-openshift-default-7f955978b9-p8gwl"
Jul 16 11:34:44.255058 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:34:44.254924    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3a86aa26-010b-463c-9fb8-2ef6973d0d85-istio-podinfo\") pod \"e2e-ait-20f9d85e-openshift-default-7f955978b9-p8gwl\" (UID: \"3a86aa26-010b-463c-9fb8-2ef6973d0d85\") " pod="openshift-ingress/e2e-ait-20f9d85e-openshift-default-7f955978b9-p8gwl"
Jul 16 11:34:44.255058 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:34:44.254942    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3a86aa26-010b-463c-9fb8-2ef6973d0d85-istio-token\") pod \"e2e-ait-20f9d85e-openshift-default-7f955978b9-p8gwl\" (UID: \"3a86aa26-010b-463c-9fb8-2ef6973d0d85\") " pod="openshift-ingress/e2e-ait-20f9d85e-openshift-default-7f955978b9-p8gwl"
Jul 16 11:34:44.307862 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:34:44.307832    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:34:44.355678 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:34:44.355638    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3a86aa26-010b-463c-9fb8-2ef6973d0d85-credential-socket\") pod \"e2e-ait-20f9d85e-openshift-default-7f955978b9-p8gwl\" (UID: \"3a86aa26-010b-463c-9fb8-2ef6973d0d85\") " pod="openshift-ingress/e2e-ait-20f9d85e-openshift-default-7f955978b9-p8gwl"
Jul 16 11:34:44.355678 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:34:44.355668    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3a86aa26-010b-463c-9fb8-2ef6973d0d85-workload-certs\") pod \"e2e-ait-20f9d85e-openshift-default-7f955978b9-p8gwl\" (UID: \"3a86aa26-010b-463c-9fb8-2ef6973d0d85\") " pod="openshift-ingress/e2e-ait-20f9d85e-openshift-default-7f955978b9-p8gwl"
Jul 16 11:34:44.355953 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:34:44.355704    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pszs2\" (UniqueName: \"kubernetes.io/projected/3a86aa26-010b-463c-9fb8-2ef6973d0d85-kube-api-access-pszs2\") pod \"e2e-ait-20f9d85e-openshift-default-7f955978b9-p8gwl\" (UID: \"3a86aa26-010b-463c-9fb8-2ef6973d0d85\") " pod="openshift-ingress/e2e-ait-20f9d85e-openshift-default-7f955978b9-p8gwl"
Jul 16 11:34:44.355953 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:34:44.355741    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3a86aa26-010b-463c-9fb8-2ef6973d0d85-istiod-ca-cert\") pod \"e2e-ait-20f9d85e-openshift-default-7f955978b9-p8gwl\" (UID: \"3a86aa26-010b-463c-9fb8-2ef6973d0d85\") " pod="openshift-ingress/e2e-ait-20f9d85e-openshift-default-7f955978b9-p8gwl"
Jul 16 11:34:44.355953 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:34:44.355787    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3a86aa26-010b-463c-9fb8-2ef6973d0d85-istio-data\") pod \"e2e-ait-20f9d85e-openshift-default-7f955978b9-p8gwl\" (UID: \"3a86aa26-010b-463c-9fb8-2ef6973d0d85\") " pod="openshift-ingress/e2e-ait-20f9d85e-openshift-default-7f955978b9-p8gwl"
Jul 16 11:34:44.355953 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:34:44.355818    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3a86aa26-010b-463c-9fb8-2ef6973d0d85-workload-socket\") pod \"e2e-ait-20f9d85e-openshift-default-7f955978b9-p8gwl\" (UID: \"3a86aa26-010b-463c-9fb8-2ef6973d0d85\") " pod="openshift-ingress/e2e-ait-20f9d85e-openshift-default-7f955978b9-p8gwl"
Jul 16 11:34:44.355953 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:34:44.355850    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3a86aa26-010b-463c-9fb8-2ef6973d0d85-istio-podinfo\") pod \"e2e-ait-20f9d85e-openshift-default-7f955978b9-p8gwl\" (UID: \"3a86aa26-010b-463c-9fb8-2ef6973d0d85\") " pod="openshift-ingress/e2e-ait-20f9d85e-openshift-default-7f955978b9-p8gwl"
Jul 16 11:34:44.355953 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:34:44.355876    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3a86aa26-010b-463c-9fb8-2ef6973d0d85-istio-token\") pod \"e2e-ait-20f9d85e-openshift-default-7f955978b9-p8gwl\" (UID: \"3a86aa26-010b-463c-9fb8-2ef6973d0d85\") " pod="openshift-ingress/e2e-ait-20f9d85e-openshift-default-7f955978b9-p8gwl"
Jul 16 11:34:44.356321 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:34:44.355974    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3a86aa26-010b-463c-9fb8-2ef6973d0d85-istio-envoy\") pod \"e2e-ait-20f9d85e-openshift-default-7f955978b9-p8gwl\" (UID: \"3a86aa26-010b-463c-9fb8-2ef6973d0d85\") " pod="openshift-ingress/e2e-ait-20f9d85e-openshift-default-7f955978b9-p8gwl"
Jul 16 11:34:44.356321 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:34:44.356255    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3a86aa26-010b-463c-9fb8-2ef6973d0d85-credential-socket\") pod \"e2e-ait-20f9d85e-openshift-default-7f955978b9-p8gwl\" (UID: \"3a86aa26-010b-463c-9fb8-2ef6973d0d85\") " pod="openshift-ingress/e2e-ait-20f9d85e-openshift-default-7f955978b9-p8gwl"
Jul 16 11:34:44.356439 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:34:44.356365    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3a86aa26-010b-463c-9fb8-2ef6973d0d85-istio-data\") pod \"e2e-ait-20f9d85e-openshift-default-7f955978b9-p8gwl\" (UID: \"3a86aa26-010b-463c-9fb8-2ef6973d0d85\") " pod="openshift-ingress/e2e-ait-20f9d85e-openshift-default-7f955978b9-p8gwl"
Jul 16 11:34:44.356729 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:34:44.356705    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3a86aa26-010b-463c-9fb8-2ef6973d0d85-istiod-ca-cert\") pod \"e2e-ait-20f9d85e-openshift-default-7f955978b9-p8gwl\" (UID: \"3a86aa26-010b-463c-9fb8-2ef6973d0d85\") " pod="openshift-ingress/e2e-ait-20f9d85e-openshift-default-7f955978b9-p8gwl"
Jul 16 11:34:44.356729 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:34:44.356718    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3a86aa26-010b-463c-9fb8-2ef6973d0d85-workload-socket\") pod \"e2e-ait-20f9d85e-openshift-default-7f955978b9-p8gwl\" (UID: \"3a86aa26-010b-463c-9fb8-2ef6973d0d85\") " pod="openshift-ingress/e2e-ait-20f9d85e-openshift-default-7f955978b9-p8gwl"
Jul 16 11:34:44.356992 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:34:44.356968    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3a86aa26-010b-463c-9fb8-2ef6973d0d85-workload-certs\") pod \"e2e-ait-20f9d85e-openshift-default-7f955978b9-p8gwl\" (UID: \"3a86aa26-010b-463c-9fb8-2ef6973d0d85\") " pod="openshift-ingress/e2e-ait-20f9d85e-openshift-default-7f955978b9-p8gwl"
Jul 16 11:34:44.359000 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:34:44.358977    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3a86aa26-010b-463c-9fb8-2ef6973d0d85-istio-envoy\") pod \"e2e-ait-20f9d85e-openshift-default-7f955978b9-p8gwl\" (UID: \"3a86aa26-010b-463c-9fb8-2ef6973d0d85\") " pod="openshift-ingress/e2e-ait-20f9d85e-openshift-default-7f955978b9-p8gwl"
Jul 16 11:34:44.359099 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:34:44.359038    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3a86aa26-010b-463c-9fb8-2ef6973d0d85-istio-podinfo\") pod \"e2e-ait-20f9d85e-openshift-default-7f955978b9-p8gwl\" (UID: \"3a86aa26-010b-463c-9fb8-2ef6973d0d85\") " pod="openshift-ingress/e2e-ait-20f9d85e-openshift-default-7f955978b9-p8gwl"
Jul 16 11:34:44.372847 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:34:44.372812    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pszs2\" (UniqueName: \"kubernetes.io/projected/3a86aa26-010b-463c-9fb8-2ef6973d0d85-kube-api-access-pszs2\") pod \"e2e-ait-20f9d85e-openshift-default-7f955978b9-p8gwl\" (UID: \"3a86aa26-010b-463c-9fb8-2ef6973d0d85\") " pod="openshift-ingress/e2e-ait-20f9d85e-openshift-default-7f955978b9-p8gwl"
Jul 16 11:34:44.372995 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:34:44.372926    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3a86aa26-010b-463c-9fb8-2ef6973d0d85-istio-token\") pod \"e2e-ait-20f9d85e-openshift-default-7f955978b9-p8gwl\" (UID: \"3a86aa26-010b-463c-9fb8-2ef6973d0d85\") " pod="openshift-ingress/e2e-ait-20f9d85e-openshift-default-7f955978b9-p8gwl"
Jul 16 11:34:44.398439 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:34:44.398415    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:34:44.469278 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:34:44.469249    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-20f9d85e-66bfdc6d98-7f5l5"]
Jul 16 11:34:44.473972 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:34:44.473955    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-20f9d85e-66bfdc6d98-7f5l5"
Jul 16 11:34:44.476360 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:34:44.476340    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-20f9d85e-serving-cert\""
Jul 16 11:34:44.484948 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:34:44.484928    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-20f9d85e-66bfdc6d98-7f5l5"]
Jul 16 11:34:44.494383 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:34:44.494360    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-20f9d85e-openshift-default-7f955978b9-p8gwl"
Jul 16 11:34:44.504143 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:34:44.504075    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:34:44.558667 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:34:44.558619    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hbphq\" (UniqueName: \"kubernetes.io/projected/9ca7e8c6-c981-483f-bbed-19898c833415-kube-api-access-hbphq\") pod \"maas-api-e2e-ait-20f9d85e-66bfdc6d98-7f5l5\" (UID: \"9ca7e8c6-c981-483f-bbed-19898c833415\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-20f9d85e-66bfdc6d98-7f5l5"
Jul 16 11:34:44.558990 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:34:44.558683    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9ca7e8c6-c981-483f-bbed-19898c833415-maas-api-tls\") pod \"maas-api-e2e-ait-20f9d85e-66bfdc6d98-7f5l5\" (UID: \"9ca7e8c6-c981-483f-bbed-19898c833415\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-20f9d85e-66bfdc6d98-7f5l5"
Jul 16 11:34:44.558990 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:34:44.558746    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9ca7e8c6-c981-483f-bbed-19898c833415-openshift-service-ca\") pod \"maas-api-e2e-ait-20f9d85e-66bfdc6d98-7f5l5\" (UID: \"9ca7e8c6-c981-483f-bbed-19898c833415\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-20f9d85e-66bfdc6d98-7f5l5"
Jul 16 11:34:44.642547 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:34:44.642523    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-20f9d85e-openshift-default-7f955978b9-p8gwl"]
Jul 16 11:34:44.644878 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:34:44.644851    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3a86aa26_010b_463c_9fb8_2ef6973d0d85.slice/crio-c4db589651ffc29e78e59a20cf887560586ff66643ed82ecebbf025d5abaa327 WatchSource:0}: Error finding container c4db589651ffc29e78e59a20cf887560586ff66643ed82ecebbf025d5abaa327: Status 404 returned error can't find the container with id c4db589651ffc29e78e59a20cf887560586ff66643ed82ecebbf025d5abaa327
Jul 16 11:34:44.647181 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:34:44.647151    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 16 11:34:44.647262 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:34:44.647214    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 16 11:34:44.647301 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:34:44.647267    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 16 11:34:44.660113 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:34:44.660090    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9ca7e8c6-c981-483f-bbed-19898c833415-maas-api-tls\") pod \"maas-api-e2e-ait-20f9d85e-66bfdc6d98-7f5l5\" (UID: \"9ca7e8c6-c981-483f-bbed-19898c833415\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-20f9d85e-66bfdc6d98-7f5l5"
Jul 16 11:34:44.660218 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:34:44.660157    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9ca7e8c6-c981-483f-bbed-19898c833415-openshift-service-ca\") pod \"maas-api-e2e-ait-20f9d85e-66bfdc6d98-7f5l5\" (UID: \"9ca7e8c6-c981-483f-bbed-19898c833415\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-20f9d85e-66bfdc6d98-7f5l5"
Jul 16 11:34:44.660385 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:34:44.660364    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hbphq\" (UniqueName: \"kubernetes.io/projected/9ca7e8c6-c981-483f-bbed-19898c833415-kube-api-access-hbphq\") pod \"maas-api-e2e-ait-20f9d85e-66bfdc6d98-7f5l5\" (UID: \"9ca7e8c6-c981-483f-bbed-19898c833415\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-20f9d85e-66bfdc6d98-7f5l5"
Jul 16 11:34:44.661027 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:34:44.661005    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9ca7e8c6-c981-483f-bbed-19898c833415-openshift-service-ca\") pod \"maas-api-e2e-ait-20f9d85e-66bfdc6d98-7f5l5\" (UID: \"9ca7e8c6-c981-483f-bbed-19898c833415\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-20f9d85e-66bfdc6d98-7f5l5"
Jul 16 11:34:44.663435 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:34:44.663417    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9ca7e8c6-c981-483f-bbed-19898c833415-maas-api-tls\") pod \"maas-api-e2e-ait-20f9d85e-66bfdc6d98-7f5l5\" (UID: \"9ca7e8c6-c981-483f-bbed-19898c833415\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-20f9d85e-66bfdc6d98-7f5l5"
Jul 16 11:34:44.668825 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:34:44.668800    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hbphq\" (UniqueName: \"kubernetes.io/projected/9ca7e8c6-c981-483f-bbed-19898c833415-kube-api-access-hbphq\") pod \"maas-api-e2e-ait-20f9d85e-66bfdc6d98-7f5l5\" (UID: \"9ca7e8c6-c981-483f-bbed-19898c833415\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-20f9d85e-66bfdc6d98-7f5l5"
Jul 16 11:34:44.708202 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:34:44.708178    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:34:44.785882 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:34:44.785856    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-20f9d85e-66bfdc6d98-7f5l5"
Jul 16 11:34:44.934864 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:34:44.934840    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-20f9d85e-66bfdc6d98-7f5l5"]
Jul 16 11:34:44.937703 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:34:44.937679    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9ca7e8c6_c981_483f_bbed_19898c833415.slice/crio-0e7f0a3a72e74a0c369407e82233e94f2fc2c88a357b6a8fca37addbefa4c468 WatchSource:0}: Error finding container 0e7f0a3a72e74a0c369407e82233e94f2fc2c88a357b6a8fca37addbefa4c468: Status 404 returned error can't find the container with id 0e7f0a3a72e74a0c369407e82233e94f2fc2c88a357b6a8fca37addbefa4c468
Jul 16 11:34:45.066607 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:34:45.066520    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:34:45.166382 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:34:45.166345    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:34:45.544176 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:34:45.544151    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-20f9d85e-openshift-default-7f955978b9-p8gwl" event={"ID":"3a86aa26-010b-463c-9fb8-2ef6973d0d85","Type":"ContainerStarted","Data":"6f65fb63ae14e17045f0af34e42a42b76e06a24cc477e58d76079f54612c558d"}
Jul 16 11:34:45.544302 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:34:45.544207    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-20f9d85e-openshift-default-7f955978b9-p8gwl" event={"ID":"3a86aa26-010b-463c-9fb8-2ef6973d0d85","Type":"ContainerStarted","Data":"c4db589651ffc29e78e59a20cf887560586ff66643ed82ecebbf025d5abaa327"}
Jul 16 11:34:45.545656 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:34:45.545629    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-20f9d85e-66bfdc6d98-7f5l5" event={"ID":"9ca7e8c6-c981-483f-bbed-19898c833415","Type":"ContainerStarted","Data":"17bd83f59f0744ddd66678dc2fe5cf23a20d124536434dcabd98fbc6513a3569"}
Jul 16 11:34:45.545750 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:34:45.545673    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-20f9d85e-66bfdc6d98-7f5l5" event={"ID":"9ca7e8c6-c981-483f-bbed-19898c833415","Type":"ContainerStarted","Data":"0e7f0a3a72e74a0c369407e82233e94f2fc2c88a357b6a8fca37addbefa4c468"}
Jul 16 11:34:45.545750 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:34:45.545696    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-20f9d85e-66bfdc6d98-7f5l5"
Jul 16 11:34:45.566260 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:34:45.566213    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-20f9d85e-openshift-default-7f955978b9-p8gwl" podStartSLOduration=1.5661997680000002 podStartE2EDuration="1.566199768s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 11:34:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 11:34:45.563357164 +0000 UTC m=+1585.934894200" watchObservedRunningTime="2026-07-16 11:34:45.566199768 +0000 UTC m=+1585.937736803"
Jul 16 11:34:45.582592 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:34:45.582553    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-20f9d85e-66bfdc6d98-7f5l5" podStartSLOduration=1.0935363439999999 podStartE2EDuration="1.582538645s" totalImagesPullingTime="489.002301ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 11:34:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 11:34:45.579735822 +0000 UTC m=+1585.951272857" watchObservedRunningTime="2026-07-16 11:34:45.582538645 +0000 UTC m=+1585.954075680"
Jul 16 11:34:46.494908 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:34:46.494863    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-20f9d85e-openshift-default-7f955978b9-p8gwl"
Jul 16 11:34:46.499832 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:34:46.499812    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-20f9d85e-openshift-default-7f955978b9-p8gwl"
Jul 16 11:34:46.561024 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:34:46.560979    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-20f9d85e-openshift-default-7f955978b9-p8gwl"
Jul 16 11:34:46.561571 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:34:46.561553    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-20f9d85e-openshift-default-7f955978b9-p8gwl"
Jul 16 11:34:48.362977 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:34:48.362949    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:34:50.436821 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:34:50.436789    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-20f9d85e-openshift-default-7f955978b9-p8gwl"]
Jul 16 11:34:50.437264 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:34:50.437011    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-20f9d85e-openshift-default-7f955978b9-p8gwl" podUID="3a86aa26-010b-463c-9fb8-2ef6973d0d85" containerName="istio-proxy" containerID="cri-o://6f65fb63ae14e17045f0af34e42a42b76e06a24cc477e58d76079f54612c558d" gracePeriod=30
Jul 16 11:34:50.464958 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:34:50.464928    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:34:50.565396 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:34:50.565367    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:34:51.574055 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:34:51.574023    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-20f9d85e-66bfdc6d98-7f5l5"
Jul 16 11:34:51.977837 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:34:51.970549    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:34:55.961934 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:34:55.961897    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-20f9d85e-66bfdc6d98-7f5l5"]
Jul 16 11:34:55.962747 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:34:55.962694    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-20f9d85e-66bfdc6d98-7f5l5" podUID="9ca7e8c6-c981-483f-bbed-19898c833415" containerName="maas-api" containerID="cri-o://17bd83f59f0744ddd66678dc2fe5cf23a20d124536434dcabd98fbc6513a3569" gracePeriod=30
Jul 16 11:34:55.997185 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:34:55.997162    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:34:56.225468 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:34:56.225412    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-20f9d85e-66bfdc6d98-7f5l5"
Jul 16 11:34:56.373146 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:34:56.373115    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9ca7e8c6-c981-483f-bbed-19898c833415-maas-api-tls\") pod \"9ca7e8c6-c981-483f-bbed-19898c833415\" (UID: \"9ca7e8c6-c981-483f-bbed-19898c833415\") "
Jul 16 11:34:56.373317 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:34:56.373173    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9ca7e8c6-c981-483f-bbed-19898c833415-openshift-service-ca\") pod \"9ca7e8c6-c981-483f-bbed-19898c833415\" (UID: \"9ca7e8c6-c981-483f-bbed-19898c833415\") "
Jul 16 11:34:56.373317 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:34:56.373289    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hbphq\" (UniqueName: \"kubernetes.io/projected/9ca7e8c6-c981-483f-bbed-19898c833415-kube-api-access-hbphq\") pod \"9ca7e8c6-c981-483f-bbed-19898c833415\" (UID: \"9ca7e8c6-c981-483f-bbed-19898c833415\") "
Jul 16 11:34:56.373604 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:34:56.373579    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9ca7e8c6-c981-483f-bbed-19898c833415-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "9ca7e8c6-c981-483f-bbed-19898c833415" (UID: "9ca7e8c6-c981-483f-bbed-19898c833415"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 11:34:56.373728 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:34:56.373712    2564 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9ca7e8c6-c981-483f-bbed-19898c833415-openshift-service-ca\") on node \"ip-10-0-135-184.ec2.internal\" DevicePath \"\""
Jul 16 11:34:56.375329 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:34:56.375311    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9ca7e8c6-c981-483f-bbed-19898c833415-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "9ca7e8c6-c981-483f-bbed-19898c833415" (UID: "9ca7e8c6-c981-483f-bbed-19898c833415"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 11:34:56.375406 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:34:56.375385    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9ca7e8c6-c981-483f-bbed-19898c833415-kube-api-access-hbphq" (OuterVolumeSpecName: "kube-api-access-hbphq") pod "9ca7e8c6-c981-483f-bbed-19898c833415" (UID: "9ca7e8c6-c981-483f-bbed-19898c833415"). InnerVolumeSpecName "kube-api-access-hbphq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 11:34:56.475211 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:34:56.475181    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hbphq\" (UniqueName: \"kubernetes.io/projected/9ca7e8c6-c981-483f-bbed-19898c833415-kube-api-access-hbphq\") on node \"ip-10-0-135-184.ec2.internal\" DevicePath \"\""
Jul 16 11:34:56.475211 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:34:56.475212    2564 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9ca7e8c6-c981-483f-bbed-19898c833415-maas-api-tls\") on node \"ip-10-0-135-184.ec2.internal\" DevicePath \"\""
Jul 16 11:34:56.616598 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:34:56.616560    2564 generic.go:356] "Generic (PLEG): container finished" podID="9ca7e8c6-c981-483f-bbed-19898c833415" containerID="17bd83f59f0744ddd66678dc2fe5cf23a20d124536434dcabd98fbc6513a3569" exitCode=0
Jul 16 11:34:56.616598 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:34:56.616596    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-20f9d85e-66bfdc6d98-7f5l5"
Jul 16 11:34:56.616844 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:34:56.616637    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-20f9d85e-66bfdc6d98-7f5l5" event={"ID":"9ca7e8c6-c981-483f-bbed-19898c833415","Type":"ContainerDied","Data":"17bd83f59f0744ddd66678dc2fe5cf23a20d124536434dcabd98fbc6513a3569"}
Jul 16 11:34:56.616844 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:34:56.616686    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-20f9d85e-66bfdc6d98-7f5l5" event={"ID":"9ca7e8c6-c981-483f-bbed-19898c833415","Type":"ContainerDied","Data":"0e7f0a3a72e74a0c369407e82233e94f2fc2c88a357b6a8fca37addbefa4c468"}
Jul 16 11:34:56.616844 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:34:56.616708    2564 scope.go:117] "RemoveContainer" containerID="17bd83f59f0744ddd66678dc2fe5cf23a20d124536434dcabd98fbc6513a3569"
Jul 16 11:34:56.626907 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:34:56.626890    2564 scope.go:117] "RemoveContainer" containerID="17bd83f59f0744ddd66678dc2fe5cf23a20d124536434dcabd98fbc6513a3569"
Jul 16 11:34:56.627147 ip-10-0-135-184 kubenswrapper[2564]: E0716 11:34:56.627129    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"17bd83f59f0744ddd66678dc2fe5cf23a20d124536434dcabd98fbc6513a3569\": container with ID starting with 17bd83f59f0744ddd66678dc2fe5cf23a20d124536434dcabd98fbc6513a3569 not found: ID does not exist" containerID="17bd83f59f0744ddd66678dc2fe5cf23a20d124536434dcabd98fbc6513a3569"
Jul 16 11:34:56.627204 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:34:56.627154    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"17bd83f59f0744ddd66678dc2fe5cf23a20d124536434dcabd98fbc6513a3569"} err="failed to get container status \"17bd83f59f0744ddd66678dc2fe5cf23a20d124536434dcabd98fbc6513a3569\": rpc error: code = NotFound desc = could not find container \"17bd83f59f0744ddd66678dc2fe5cf23a20d124536434dcabd98fbc6513a3569\": container with ID starting with 17bd83f59f0744ddd66678dc2fe5cf23a20d124536434dcabd98fbc6513a3569 not found: ID does not exist"
Jul 16 11:34:56.638611 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:34:56.638588    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-20f9d85e-66bfdc6d98-7f5l5"]
Jul 16 11:34:56.642632 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:34:56.642614    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-20f9d85e-66bfdc6d98-7f5l5"]
Jul 16 11:34:56.948545 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:34:56.948478    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:34:57.091826 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:34:57.091807    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-20f9d85e-openshift-default-7f955978b9-p8gwl"
Jul 16 11:34:57.182398 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:34:57.182371    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3a86aa26-010b-463c-9fb8-2ef6973d0d85-istio-data\") pod \"3a86aa26-010b-463c-9fb8-2ef6973d0d85\" (UID: \"3a86aa26-010b-463c-9fb8-2ef6973d0d85\") "
Jul 16 11:34:57.182559 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:34:57.182418    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3a86aa26-010b-463c-9fb8-2ef6973d0d85-istio-podinfo\") pod \"3a86aa26-010b-463c-9fb8-2ef6973d0d85\" (UID: \"3a86aa26-010b-463c-9fb8-2ef6973d0d85\") "
Jul 16 11:34:57.182559 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:34:57.182443    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3a86aa26-010b-463c-9fb8-2ef6973d0d85-istio-token\") pod \"3a86aa26-010b-463c-9fb8-2ef6973d0d85\" (UID: \"3a86aa26-010b-463c-9fb8-2ef6973d0d85\") "
Jul 16 11:34:57.182559 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:34:57.182477    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3a86aa26-010b-463c-9fb8-2ef6973d0d85-istio-envoy\") pod \"3a86aa26-010b-463c-9fb8-2ef6973d0d85\" (UID: \"3a86aa26-010b-463c-9fb8-2ef6973d0d85\") "
Jul 16 11:34:57.182559 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:34:57.182515    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3a86aa26-010b-463c-9fb8-2ef6973d0d85-workload-certs\") pod \"3a86aa26-010b-463c-9fb8-2ef6973d0d85\" (UID: \"3a86aa26-010b-463c-9fb8-2ef6973d0d85\") "
Jul 16 11:34:57.182559 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:34:57.182540    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pszs2\" (UniqueName: \"kubernetes.io/projected/3a86aa26-010b-463c-9fb8-2ef6973d0d85-kube-api-access-pszs2\") pod \"3a86aa26-010b-463c-9fb8-2ef6973d0d85\" (UID: \"3a86aa26-010b-463c-9fb8-2ef6973d0d85\") "
Jul 16 11:34:57.182860 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:34:57.182576    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3a86aa26-010b-463c-9fb8-2ef6973d0d85-workload-socket\") pod \"3a86aa26-010b-463c-9fb8-2ef6973d0d85\" (UID: \"3a86aa26-010b-463c-9fb8-2ef6973d0d85\") "
Jul 16 11:34:57.182860 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:34:57.182661    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3a86aa26-010b-463c-9fb8-2ef6973d0d85-credential-socket\") pod \"3a86aa26-010b-463c-9fb8-2ef6973d0d85\" (UID: \"3a86aa26-010b-463c-9fb8-2ef6973d0d85\") "
Jul 16 11:34:57.182860 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:34:57.182697    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3a86aa26-010b-463c-9fb8-2ef6973d0d85-istiod-ca-cert\") pod \"3a86aa26-010b-463c-9fb8-2ef6973d0d85\" (UID: \"3a86aa26-010b-463c-9fb8-2ef6973d0d85\") "
Jul 16 11:34:57.183035 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:34:57.183007    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3a86aa26-010b-463c-9fb8-2ef6973d0d85-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "3a86aa26-010b-463c-9fb8-2ef6973d0d85" (UID: "3a86aa26-010b-463c-9fb8-2ef6973d0d85"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 11:34:57.183128 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:34:57.183106    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3a86aa26-010b-463c-9fb8-2ef6973d0d85-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "3a86aa26-010b-463c-9fb8-2ef6973d0d85" (UID: "3a86aa26-010b-463c-9fb8-2ef6973d0d85"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 11:34:57.183315 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:34:57.183262    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3a86aa26-010b-463c-9fb8-2ef6973d0d85-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "3a86aa26-010b-463c-9fb8-2ef6973d0d85" (UID: "3a86aa26-010b-463c-9fb8-2ef6973d0d85"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 11:34:57.183430 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:34:57.183340    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3a86aa26-010b-463c-9fb8-2ef6973d0d85-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "3a86aa26-010b-463c-9fb8-2ef6973d0d85" (UID: "3a86aa26-010b-463c-9fb8-2ef6973d0d85"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 11:34:57.183430 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:34:57.183371    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3a86aa26-010b-463c-9fb8-2ef6973d0d85-istio-data" (OuterVolumeSpecName: "istio-data") pod "3a86aa26-010b-463c-9fb8-2ef6973d0d85" (UID: "3a86aa26-010b-463c-9fb8-2ef6973d0d85"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 11:34:57.184828 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:34:57.184799    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/3a86aa26-010b-463c-9fb8-2ef6973d0d85-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "3a86aa26-010b-463c-9fb8-2ef6973d0d85" (UID: "3a86aa26-010b-463c-9fb8-2ef6973d0d85"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 16 11:34:57.184928 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:34:57.184821    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3a86aa26-010b-463c-9fb8-2ef6973d0d85-kube-api-access-pszs2" (OuterVolumeSpecName: "kube-api-access-pszs2") pod "3a86aa26-010b-463c-9fb8-2ef6973d0d85" (UID: "3a86aa26-010b-463c-9fb8-2ef6973d0d85"). InnerVolumeSpecName "kube-api-access-pszs2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 11:34:57.185067 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:34:57.185044    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3a86aa26-010b-463c-9fb8-2ef6973d0d85-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "3a86aa26-010b-463c-9fb8-2ef6973d0d85" (UID: "3a86aa26-010b-463c-9fb8-2ef6973d0d85"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 11:34:57.185147 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:34:57.185046    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3a86aa26-010b-463c-9fb8-2ef6973d0d85-istio-token" (OuterVolumeSpecName: "istio-token") pod "3a86aa26-010b-463c-9fb8-2ef6973d0d85" (UID: "3a86aa26-010b-463c-9fb8-2ef6973d0d85"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 11:34:57.283589 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:34:57.283568    2564 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3a86aa26-010b-463c-9fb8-2ef6973d0d85-credential-socket\") on node \"ip-10-0-135-184.ec2.internal\" DevicePath \"\""
Jul 16 11:34:57.283589 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:34:57.283590    2564 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3a86aa26-010b-463c-9fb8-2ef6973d0d85-istiod-ca-cert\") on node \"ip-10-0-135-184.ec2.internal\" DevicePath \"\""
Jul 16 11:34:57.283724 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:34:57.283598    2564 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3a86aa26-010b-463c-9fb8-2ef6973d0d85-istio-data\") on node \"ip-10-0-135-184.ec2.internal\" DevicePath \"\""
Jul 16 11:34:57.283724 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:34:57.283606    2564 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3a86aa26-010b-463c-9fb8-2ef6973d0d85-istio-podinfo\") on node \"ip-10-0-135-184.ec2.internal\" DevicePath \"\""
Jul 16 11:34:57.283724 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:34:57.283614    2564 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3a86aa26-010b-463c-9fb8-2ef6973d0d85-istio-token\") on node \"ip-10-0-135-184.ec2.internal\" DevicePath \"\""
Jul 16 11:34:57.283724 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:34:57.283622    2564 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3a86aa26-010b-463c-9fb8-2ef6973d0d85-istio-envoy\") on node \"ip-10-0-135-184.ec2.internal\" DevicePath \"\""
Jul 16 11:34:57.283724 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:34:57.283629    2564 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3a86aa26-010b-463c-9fb8-2ef6973d0d85-workload-certs\") on node \"ip-10-0-135-184.ec2.internal\" DevicePath \"\""
Jul 16 11:34:57.283724 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:34:57.283636    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pszs2\" (UniqueName: \"kubernetes.io/projected/3a86aa26-010b-463c-9fb8-2ef6973d0d85-kube-api-access-pszs2\") on node \"ip-10-0-135-184.ec2.internal\" DevicePath \"\""
Jul 16 11:34:57.283724 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:34:57.283644    2564 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3a86aa26-010b-463c-9fb8-2ef6973d0d85-workload-socket\") on node \"ip-10-0-135-184.ec2.internal\" DevicePath \"\""
Jul 16 11:34:57.624248 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:34:57.624159    2564 generic.go:356] "Generic (PLEG): container finished" podID="3a86aa26-010b-463c-9fb8-2ef6973d0d85" containerID="6f65fb63ae14e17045f0af34e42a42b76e06a24cc477e58d76079f54612c558d" exitCode=0
Jul 16 11:34:57.624248 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:34:57.624221    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-20f9d85e-openshift-default-7f955978b9-p8gwl"
Jul 16 11:34:57.624457 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:34:57.624251    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-20f9d85e-openshift-default-7f955978b9-p8gwl" event={"ID":"3a86aa26-010b-463c-9fb8-2ef6973d0d85","Type":"ContainerDied","Data":"6f65fb63ae14e17045f0af34e42a42b76e06a24cc477e58d76079f54612c558d"}
Jul 16 11:34:57.624457 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:34:57.624311    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-20f9d85e-openshift-default-7f955978b9-p8gwl" event={"ID":"3a86aa26-010b-463c-9fb8-2ef6973d0d85","Type":"ContainerDied","Data":"c4db589651ffc29e78e59a20cf887560586ff66643ed82ecebbf025d5abaa327"}
Jul 16 11:34:57.624457 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:34:57.624341    2564 scope.go:117] "RemoveContainer" containerID="6f65fb63ae14e17045f0af34e42a42b76e06a24cc477e58d76079f54612c558d"
Jul 16 11:34:57.634298 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:34:57.634282    2564 scope.go:117] "RemoveContainer" containerID="6f65fb63ae14e17045f0af34e42a42b76e06a24cc477e58d76079f54612c558d"
Jul 16 11:34:57.634560 ip-10-0-135-184 kubenswrapper[2564]: E0716 11:34:57.634535    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6f65fb63ae14e17045f0af34e42a42b76e06a24cc477e58d76079f54612c558d\": container with ID starting with 6f65fb63ae14e17045f0af34e42a42b76e06a24cc477e58d76079f54612c558d not found: ID does not exist" containerID="6f65fb63ae14e17045f0af34e42a42b76e06a24cc477e58d76079f54612c558d"
Jul 16 11:34:57.634632 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:34:57.634572    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6f65fb63ae14e17045f0af34e42a42b76e06a24cc477e58d76079f54612c558d"} err="failed to get container status \"6f65fb63ae14e17045f0af34e42a42b76e06a24cc477e58d76079f54612c558d\": rpc error: code = NotFound desc = could not find container \"6f65fb63ae14e17045f0af34e42a42b76e06a24cc477e58d76079f54612c558d\": container with ID starting with 6f65fb63ae14e17045f0af34e42a42b76e06a24cc477e58d76079f54612c558d not found: ID does not exist"
Jul 16 11:34:57.646208 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:34:57.646183    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-20f9d85e-openshift-default-7f955978b9-p8gwl"]
Jul 16 11:34:57.653502 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:34:57.653484    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-20f9d85e-openshift-default-7f955978b9-p8gwl"]
Jul 16 11:34:58.303748 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:34:58.303717    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3a86aa26-010b-463c-9fb8-2ef6973d0d85" path="/var/lib/kubelet/pods/3a86aa26-010b-463c-9fb8-2ef6973d0d85/volumes"
Jul 16 11:34:58.304128 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:34:58.304113    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9ca7e8c6-c981-483f-bbed-19898c833415" path="/var/lib/kubelet/pods/9ca7e8c6-c981-483f-bbed-19898c833415/volumes"
Jul 16 11:35:02.780387 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:35:02.780357    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:35:02.880343 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:35:02.880315    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:35:03.088830 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:35:03.088752    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:35:03.185374 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:35:03.185334    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:35:03.277938 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:35:03.277912    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-migrate-f83b698a-gw-openshift-default-79cdd84f5f-xxtp8"]
Jul 16 11:35:03.278338 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:35:03.278322    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9ca7e8c6-c981-483f-bbed-19898c833415" containerName="maas-api"
Jul 16 11:35:03.278390 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:35:03.278340    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="9ca7e8c6-c981-483f-bbed-19898c833415" containerName="maas-api"
Jul 16 11:35:03.278390 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:35:03.278362    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3a86aa26-010b-463c-9fb8-2ef6973d0d85" containerName="istio-proxy"
Jul 16 11:35:03.278390 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:35:03.278367    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="3a86aa26-010b-463c-9fb8-2ef6973d0d85" containerName="istio-proxy"
Jul 16 11:35:03.278480 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:35:03.278433    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="9ca7e8c6-c981-483f-bbed-19898c833415" containerName="maas-api"
Jul 16 11:35:03.278480 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:35:03.278445    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="3a86aa26-010b-463c-9fb8-2ef6973d0d85" containerName="istio-proxy"
Jul 16 11:35:03.283201 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:35:03.283180    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-f83b698a-gw-openshift-default-79cdd84f5f-xxtp8"
Jul 16 11:35:03.285835 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:35:03.285810    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-migrate-f83b698a-gw-openshift-default-dockercfg-tpgts\""
Jul 16 11:35:03.297970 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:35:03.297945    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-f83b698a-gw-openshift-default-79cdd84f5f-xxtp8"]
Jul 16 11:35:03.325169 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:35:03.325146    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:35:03.422541 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:35:03.422464    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:35:03.438699 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:35:03.438669    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/95e2f621-dd1b-41cd-95a5-17a5daf2908d-workload-certs\") pod \"e2e-migrate-f83b698a-gw-openshift-default-79cdd84f5f-xxtp8\" (UID: \"95e2f621-dd1b-41cd-95a5-17a5daf2908d\") " pod="openshift-ingress/e2e-migrate-f83b698a-gw-openshift-default-79cdd84f5f-xxtp8"
Jul 16 11:35:03.438699 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:35:03.438699    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/95e2f621-dd1b-41cd-95a5-17a5daf2908d-istio-podinfo\") pod \"e2e-migrate-f83b698a-gw-openshift-default-79cdd84f5f-xxtp8\" (UID: \"95e2f621-dd1b-41cd-95a5-17a5daf2908d\") " pod="openshift-ingress/e2e-migrate-f83b698a-gw-openshift-default-79cdd84f5f-xxtp8"
Jul 16 11:35:03.438905 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:35:03.438719    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/95e2f621-dd1b-41cd-95a5-17a5daf2908d-istio-envoy\") pod \"e2e-migrate-f83b698a-gw-openshift-default-79cdd84f5f-xxtp8\" (UID: \"95e2f621-dd1b-41cd-95a5-17a5daf2908d\") " pod="openshift-ingress/e2e-migrate-f83b698a-gw-openshift-default-79cdd84f5f-xxtp8"
Jul 16 11:35:03.438905 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:35:03.438736    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/95e2f621-dd1b-41cd-95a5-17a5daf2908d-istio-data\") pod \"e2e-migrate-f83b698a-gw-openshift-default-79cdd84f5f-xxtp8\" (UID: \"95e2f621-dd1b-41cd-95a5-17a5daf2908d\") " pod="openshift-ingress/e2e-migrate-f83b698a-gw-openshift-default-79cdd84f5f-xxtp8"
Jul 16 11:35:03.438905 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:35:03.438876    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/95e2f621-dd1b-41cd-95a5-17a5daf2908d-istiod-ca-cert\") pod \"e2e-migrate-f83b698a-gw-openshift-default-79cdd84f5f-xxtp8\" (UID: \"95e2f621-dd1b-41cd-95a5-17a5daf2908d\") " pod="openshift-ingress/e2e-migrate-f83b698a-gw-openshift-default-79cdd84f5f-xxtp8"
Jul 16 11:35:03.438905 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:35:03.438903    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tnln2\" (UniqueName: \"kubernetes.io/projected/95e2f621-dd1b-41cd-95a5-17a5daf2908d-kube-api-access-tnln2\") pod \"e2e-migrate-f83b698a-gw-openshift-default-79cdd84f5f-xxtp8\" (UID: \"95e2f621-dd1b-41cd-95a5-17a5daf2908d\") " pod="openshift-ingress/e2e-migrate-f83b698a-gw-openshift-default-79cdd84f5f-xxtp8"
Jul 16 11:35:03.439099 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:35:03.438926    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/95e2f621-dd1b-41cd-95a5-17a5daf2908d-workload-socket\") pod \"e2e-migrate-f83b698a-gw-openshift-default-79cdd84f5f-xxtp8\" (UID: \"95e2f621-dd1b-41cd-95a5-17a5daf2908d\") " pod="openshift-ingress/e2e-migrate-f83b698a-gw-openshift-default-79cdd84f5f-xxtp8"
Jul 16 11:35:03.439099 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:35:03.438955    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/95e2f621-dd1b-41cd-95a5-17a5daf2908d-istio-token\") pod \"e2e-migrate-f83b698a-gw-openshift-default-79cdd84f5f-xxtp8\" (UID: \"95e2f621-dd1b-41cd-95a5-17a5daf2908d\") " pod="openshift-ingress/e2e-migrate-f83b698a-gw-openshift-default-79cdd84f5f-xxtp8"
Jul 16 11:35:03.439099 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:35:03.439012    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/95e2f621-dd1b-41cd-95a5-17a5daf2908d-credential-socket\") pod \"e2e-migrate-f83b698a-gw-openshift-default-79cdd84f5f-xxtp8\" (UID: \"95e2f621-dd1b-41cd-95a5-17a5daf2908d\") " pod="openshift-ingress/e2e-migrate-f83b698a-gw-openshift-default-79cdd84f5f-xxtp8"
Jul 16 11:35:03.539967 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:35:03.539939    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/95e2f621-dd1b-41cd-95a5-17a5daf2908d-workload-certs\") pod \"e2e-migrate-f83b698a-gw-openshift-default-79cdd84f5f-xxtp8\" (UID: \"95e2f621-dd1b-41cd-95a5-17a5daf2908d\") " pod="openshift-ingress/e2e-migrate-f83b698a-gw-openshift-default-79cdd84f5f-xxtp8"
Jul 16 11:35:03.539967 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:35:03.539970    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/95e2f621-dd1b-41cd-95a5-17a5daf2908d-istio-podinfo\") pod \"e2e-migrate-f83b698a-gw-openshift-default-79cdd84f5f-xxtp8\" (UID: \"95e2f621-dd1b-41cd-95a5-17a5daf2908d\") " pod="openshift-ingress/e2e-migrate-f83b698a-gw-openshift-default-79cdd84f5f-xxtp8"
Jul 16 11:35:03.540179 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:35:03.539990    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/95e2f621-dd1b-41cd-95a5-17a5daf2908d-istio-envoy\") pod \"e2e-migrate-f83b698a-gw-openshift-default-79cdd84f5f-xxtp8\" (UID: \"95e2f621-dd1b-41cd-95a5-17a5daf2908d\") " pod="openshift-ingress/e2e-migrate-f83b698a-gw-openshift-default-79cdd84f5f-xxtp8"
Jul 16 11:35:03.540179 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:35:03.540016    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/95e2f621-dd1b-41cd-95a5-17a5daf2908d-istio-data\") pod \"e2e-migrate-f83b698a-gw-openshift-default-79cdd84f5f-xxtp8\" (UID: \"95e2f621-dd1b-41cd-95a5-17a5daf2908d\") " pod="openshift-ingress/e2e-migrate-f83b698a-gw-openshift-default-79cdd84f5f-xxtp8"
Jul 16 11:35:03.540179 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:35:03.540074    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/95e2f621-dd1b-41cd-95a5-17a5daf2908d-istiod-ca-cert\") pod \"e2e-migrate-f83b698a-gw-openshift-default-79cdd84f5f-xxtp8\" (UID: \"95e2f621-dd1b-41cd-95a5-17a5daf2908d\") " pod="openshift-ingress/e2e-migrate-f83b698a-gw-openshift-default-79cdd84f5f-xxtp8"
Jul 16 11:35:03.540179 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:35:03.540092    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tnln2\" (UniqueName: \"kubernetes.io/projected/95e2f621-dd1b-41cd-95a5-17a5daf2908d-kube-api-access-tnln2\") pod \"e2e-migrate-f83b698a-gw-openshift-default-79cdd84f5f-xxtp8\" (UID: \"95e2f621-dd1b-41cd-95a5-17a5daf2908d\") " pod="openshift-ingress/e2e-migrate-f83b698a-gw-openshift-default-79cdd84f5f-xxtp8"
Jul 16 11:35:03.540179 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:35:03.540117    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/95e2f621-dd1b-41cd-95a5-17a5daf2908d-workload-socket\") pod \"e2e-migrate-f83b698a-gw-openshift-default-79cdd84f5f-xxtp8\" (UID: \"95e2f621-dd1b-41cd-95a5-17a5daf2908d\") " pod="openshift-ingress/e2e-migrate-f83b698a-gw-openshift-default-79cdd84f5f-xxtp8"
Jul 16 11:35:03.540179 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:35:03.540164    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/95e2f621-dd1b-41cd-95a5-17a5daf2908d-istio-token\") pod \"e2e-migrate-f83b698a-gw-openshift-default-79cdd84f5f-xxtp8\" (UID: \"95e2f621-dd1b-41cd-95a5-17a5daf2908d\") " pod="openshift-ingress/e2e-migrate-f83b698a-gw-openshift-default-79cdd84f5f-xxtp8"
Jul 16 11:35:03.540482 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:35:03.540193    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/95e2f621-dd1b-41cd-95a5-17a5daf2908d-credential-socket\") pod \"e2e-migrate-f83b698a-gw-openshift-default-79cdd84f5f-xxtp8\" (UID: \"95e2f621-dd1b-41cd-95a5-17a5daf2908d\") " pod="openshift-ingress/e2e-migrate-f83b698a-gw-openshift-default-79cdd84f5f-xxtp8"
Jul 16 11:35:03.540482 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:35:03.540407    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/95e2f621-dd1b-41cd-95a5-17a5daf2908d-workload-certs\") pod \"e2e-migrate-f83b698a-gw-openshift-default-79cdd84f5f-xxtp8\" (UID: \"95e2f621-dd1b-41cd-95a5-17a5daf2908d\") " pod="openshift-ingress/e2e-migrate-f83b698a-gw-openshift-default-79cdd84f5f-xxtp8"
Jul 16 11:35:03.540594 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:35:03.540574    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/95e2f621-dd1b-41cd-95a5-17a5daf2908d-istio-data\") pod \"e2e-migrate-f83b698a-gw-openshift-default-79cdd84f5f-xxtp8\" (UID: \"95e2f621-dd1b-41cd-95a5-17a5daf2908d\") " pod="openshift-ingress/e2e-migrate-f83b698a-gw-openshift-default-79cdd84f5f-xxtp8"
Jul 16 11:35:03.540678 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:35:03.540653    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/95e2f621-dd1b-41cd-95a5-17a5daf2908d-credential-socket\") pod \"e2e-migrate-f83b698a-gw-openshift-default-79cdd84f5f-xxtp8\" (UID: \"95e2f621-dd1b-41cd-95a5-17a5daf2908d\") " pod="openshift-ingress/e2e-migrate-f83b698a-gw-openshift-default-79cdd84f5f-xxtp8"
Jul 16 11:35:03.540766 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:35:03.540743    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/95e2f621-dd1b-41cd-95a5-17a5daf2908d-workload-socket\") pod \"e2e-migrate-f83b698a-gw-openshift-default-79cdd84f5f-xxtp8\" (UID: \"95e2f621-dd1b-41cd-95a5-17a5daf2908d\") " pod="openshift-ingress/e2e-migrate-f83b698a-gw-openshift-default-79cdd84f5f-xxtp8"
Jul 16 11:35:03.541017 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:35:03.541001    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/95e2f621-dd1b-41cd-95a5-17a5daf2908d-istiod-ca-cert\") pod \"e2e-migrate-f83b698a-gw-openshift-default-79cdd84f5f-xxtp8\" (UID: \"95e2f621-dd1b-41cd-95a5-17a5daf2908d\") " pod="openshift-ingress/e2e-migrate-f83b698a-gw-openshift-default-79cdd84f5f-xxtp8"
Jul 16 11:35:03.542408 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:35:03.542386    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/95e2f621-dd1b-41cd-95a5-17a5daf2908d-istio-envoy\") pod \"e2e-migrate-f83b698a-gw-openshift-default-79cdd84f5f-xxtp8\" (UID: \"95e2f621-dd1b-41cd-95a5-17a5daf2908d\") " pod="openshift-ingress/e2e-migrate-f83b698a-gw-openshift-default-79cdd84f5f-xxtp8"
Jul 16 11:35:03.542900 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:35:03.542879    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/95e2f621-dd1b-41cd-95a5-17a5daf2908d-istio-podinfo\") pod \"e2e-migrate-f83b698a-gw-openshift-default-79cdd84f5f-xxtp8\" (UID: \"95e2f621-dd1b-41cd-95a5-17a5daf2908d\") " pod="openshift-ingress/e2e-migrate-f83b698a-gw-openshift-default-79cdd84f5f-xxtp8"
Jul 16 11:35:03.548449 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:35:03.548428    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/95e2f621-dd1b-41cd-95a5-17a5daf2908d-istio-token\") pod \"e2e-migrate-f83b698a-gw-openshift-default-79cdd84f5f-xxtp8\" (UID: \"95e2f621-dd1b-41cd-95a5-17a5daf2908d\") " pod="openshift-ingress/e2e-migrate-f83b698a-gw-openshift-default-79cdd84f5f-xxtp8"
Jul 16 11:35:03.548795 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:35:03.548754    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tnln2\" (UniqueName: \"kubernetes.io/projected/95e2f621-dd1b-41cd-95a5-17a5daf2908d-kube-api-access-tnln2\") pod \"e2e-migrate-f83b698a-gw-openshift-default-79cdd84f5f-xxtp8\" (UID: \"95e2f621-dd1b-41cd-95a5-17a5daf2908d\") " pod="openshift-ingress/e2e-migrate-f83b698a-gw-openshift-default-79cdd84f5f-xxtp8"
Jul 16 11:35:03.568738 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:35:03.568707    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:35:03.595432 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:35:03.595410    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-f83b698a-gw-openshift-default-79cdd84f5f-xxtp8"
Jul 16 11:35:03.741898 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:35:03.741873    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-f83b698a-gw-openshift-default-79cdd84f5f-xxtp8"]
Jul 16 11:35:03.744016 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:35:03.743992    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod95e2f621_dd1b_41cd_95a5_17a5daf2908d.slice/crio-599682b28c05faa003d971b6bb20194bd717087446a95d529ed4ac55d99af6d4 WatchSource:0}: Error finding container 599682b28c05faa003d971b6bb20194bd717087446a95d529ed4ac55d99af6d4: Status 404 returned error can't find the container with id 599682b28c05faa003d971b6bb20194bd717087446a95d529ed4ac55d99af6d4
Jul 16 11:35:03.746271 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:35:03.746233    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 16 11:35:03.746340 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:35:03.746323    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 16 11:35:03.746395 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:35:03.746377    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 16 11:35:03.819507 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:35:03.819476    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-f83b698a-7d86579467-9wdxr"]
Jul 16 11:35:03.823851 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:35:03.823824    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-f83b698a-7d86579467-9wdxr"
Jul 16 11:35:03.825890 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:35:03.825826    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-migrate-f83b698a-serving-cert\""
Jul 16 11:35:03.833722 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:35:03.833450    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-f83b698a-7d86579467-9wdxr"]
Jul 16 11:35:03.852141 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:35:03.852110    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:35:03.943838 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:35:03.943748    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qvkbw\" (UniqueName: \"kubernetes.io/projected/c3378ea4-eae2-481d-8418-51dcc11045ba-kube-api-access-qvkbw\") pod \"maas-api-e2e-migrate-f83b698a-7d86579467-9wdxr\" (UID: \"c3378ea4-eae2-481d-8418-51dcc11045ba\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-f83b698a-7d86579467-9wdxr"
Jul 16 11:35:03.943838 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:35:03.943800    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c3378ea4-eae2-481d-8418-51dcc11045ba-openshift-service-ca\") pod \"maas-api-e2e-migrate-f83b698a-7d86579467-9wdxr\" (UID: \"c3378ea4-eae2-481d-8418-51dcc11045ba\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-f83b698a-7d86579467-9wdxr"
Jul 16 11:35:03.944055 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:35:03.943866    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c3378ea4-eae2-481d-8418-51dcc11045ba-maas-api-tls\") pod \"maas-api-e2e-migrate-f83b698a-7d86579467-9wdxr\" (UID: \"c3378ea4-eae2-481d-8418-51dcc11045ba\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-f83b698a-7d86579467-9wdxr"
Jul 16 11:35:04.045171 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:35:04.045135    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c3378ea4-eae2-481d-8418-51dcc11045ba-maas-api-tls\") pod \"maas-api-e2e-migrate-f83b698a-7d86579467-9wdxr\" (UID: \"c3378ea4-eae2-481d-8418-51dcc11045ba\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-f83b698a-7d86579467-9wdxr"
Jul 16 11:35:04.045352 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:35:04.045254    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qvkbw\" (UniqueName: \"kubernetes.io/projected/c3378ea4-eae2-481d-8418-51dcc11045ba-kube-api-access-qvkbw\") pod \"maas-api-e2e-migrate-f83b698a-7d86579467-9wdxr\" (UID: \"c3378ea4-eae2-481d-8418-51dcc11045ba\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-f83b698a-7d86579467-9wdxr"
Jul 16 11:35:04.045352 ip-10-0-135-184 kubenswrapper[2564]: E0716 11:35:04.045278    2564 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-migrate-f83b698a-serving-cert: secret "maas-api-e2e-migrate-f83b698a-serving-cert" not found
Jul 16 11:35:04.045352 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:35:04.045286    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c3378ea4-eae2-481d-8418-51dcc11045ba-openshift-service-ca\") pod \"maas-api-e2e-migrate-f83b698a-7d86579467-9wdxr\" (UID: \"c3378ea4-eae2-481d-8418-51dcc11045ba\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-f83b698a-7d86579467-9wdxr"
Jul 16 11:35:04.045352 ip-10-0-135-184 kubenswrapper[2564]: E0716 11:35:04.045339    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c3378ea4-eae2-481d-8418-51dcc11045ba-maas-api-tls podName:c3378ea4-eae2-481d-8418-51dcc11045ba nodeName:}" failed. No retries permitted until 2026-07-16 11:35:04.545323898 +0000 UTC m=+1604.916860916 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/c3378ea4-eae2-481d-8418-51dcc11045ba-maas-api-tls") pod "maas-api-e2e-migrate-f83b698a-7d86579467-9wdxr" (UID: "c3378ea4-eae2-481d-8418-51dcc11045ba") : secret "maas-api-e2e-migrate-f83b698a-serving-cert" not found
Jul 16 11:35:04.045979 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:35:04.045958    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c3378ea4-eae2-481d-8418-51dcc11045ba-openshift-service-ca\") pod \"maas-api-e2e-migrate-f83b698a-7d86579467-9wdxr\" (UID: \"c3378ea4-eae2-481d-8418-51dcc11045ba\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-f83b698a-7d86579467-9wdxr"
Jul 16 11:35:04.054385 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:35:04.054364    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qvkbw\" (UniqueName: \"kubernetes.io/projected/c3378ea4-eae2-481d-8418-51dcc11045ba-kube-api-access-qvkbw\") pod \"maas-api-e2e-migrate-f83b698a-7d86579467-9wdxr\" (UID: \"c3378ea4-eae2-481d-8418-51dcc11045ba\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-f83b698a-7d86579467-9wdxr"
Jul 16 11:35:04.323197 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:35:04.323161    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:35:04.423340 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:35:04.423312    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:35:04.549738 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:35:04.549708    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c3378ea4-eae2-481d-8418-51dcc11045ba-maas-api-tls\") pod \"maas-api-e2e-migrate-f83b698a-7d86579467-9wdxr\" (UID: \"c3378ea4-eae2-481d-8418-51dcc11045ba\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-f83b698a-7d86579467-9wdxr"
Jul 16 11:35:04.549920 ip-10-0-135-184 kubenswrapper[2564]: E0716 11:35:04.549898    2564 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-migrate-f83b698a-serving-cert: secret "maas-api-e2e-migrate-f83b698a-serving-cert" not found
Jul 16 11:35:04.549995 ip-10-0-135-184 kubenswrapper[2564]: E0716 11:35:04.549984    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c3378ea4-eae2-481d-8418-51dcc11045ba-maas-api-tls podName:c3378ea4-eae2-481d-8418-51dcc11045ba nodeName:}" failed. No retries permitted until 2026-07-16 11:35:05.54996222 +0000 UTC m=+1605.921499251 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/c3378ea4-eae2-481d-8418-51dcc11045ba-maas-api-tls") pod "maas-api-e2e-migrate-f83b698a-7d86579467-9wdxr" (UID: "c3378ea4-eae2-481d-8418-51dcc11045ba") : secret "maas-api-e2e-migrate-f83b698a-serving-cert" not found
Jul 16 11:35:04.669092 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:35:04.669013    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-f83b698a-gw-openshift-default-79cdd84f5f-xxtp8" event={"ID":"95e2f621-dd1b-41cd-95a5-17a5daf2908d","Type":"ContainerStarted","Data":"7629385c4111d79ee422cea580ed5787c7d5f839a19cd515a120615347cb5452"}
Jul 16 11:35:04.669092 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:35:04.669068    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-f83b698a-gw-openshift-default-79cdd84f5f-xxtp8" event={"ID":"95e2f621-dd1b-41cd-95a5-17a5daf2908d","Type":"ContainerStarted","Data":"599682b28c05faa003d971b6bb20194bd717087446a95d529ed4ac55d99af6d4"}
Jul 16 11:35:04.691066 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:35:04.691016    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-migrate-f83b698a-gw-openshift-default-79cdd84f5f-xxtp8" podStartSLOduration=1.691000481 podStartE2EDuration="1.691000481s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 11:35:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 11:35:04.689275504 +0000 UTC m=+1605.060812541" watchObservedRunningTime="2026-07-16 11:35:04.691000481 +0000 UTC m=+1605.062537516"
Jul 16 11:35:05.096437 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:35:05.096407    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:35:05.560324 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:35:05.560297    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c3378ea4-eae2-481d-8418-51dcc11045ba-maas-api-tls\") pod \"maas-api-e2e-migrate-f83b698a-7d86579467-9wdxr\" (UID: \"c3378ea4-eae2-481d-8418-51dcc11045ba\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-f83b698a-7d86579467-9wdxr"
Jul 16 11:35:05.562672 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:35:05.562646    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c3378ea4-eae2-481d-8418-51dcc11045ba-maas-api-tls\") pod \"maas-api-e2e-migrate-f83b698a-7d86579467-9wdxr\" (UID: \"c3378ea4-eae2-481d-8418-51dcc11045ba\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-f83b698a-7d86579467-9wdxr"
Jul 16 11:35:05.595626 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:35:05.595603    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-f83b698a-gw-openshift-default-79cdd84f5f-xxtp8"
Jul 16 11:35:05.600610 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:35:05.600592    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-f83b698a-gw-openshift-default-79cdd84f5f-xxtp8"
Jul 16 11:35:05.638787 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:35:05.638752    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-f83b698a-7d86579467-9wdxr"
Jul 16 11:35:05.674282 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:35:05.674238    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-f83b698a-gw-openshift-default-79cdd84f5f-xxtp8"
Jul 16 11:35:05.675276 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:35:05.675256    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-f83b698a-gw-openshift-default-79cdd84f5f-xxtp8"
Jul 16 11:35:05.799070 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:35:05.799046    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-f83b698a-7d86579467-9wdxr"]
Jul 16 11:35:05.801173 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:35:05.801150    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc3378ea4_eae2_481d_8418_51dcc11045ba.slice/crio-590b2b80c6dea72c30643cf8714852dcc3cfe5c30f9a1a45d243e78f0a0d1af1 WatchSource:0}: Error finding container 590b2b80c6dea72c30643cf8714852dcc3cfe5c30f9a1a45d243e78f0a0d1af1: Status 404 returned error can't find the container with id 590b2b80c6dea72c30643cf8714852dcc3cfe5c30f9a1a45d243e78f0a0d1af1
Jul 16 11:35:05.802966 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:35:05.802951    2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 16 11:35:06.681069 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:35:06.680974    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-f83b698a-7d86579467-9wdxr" event={"ID":"c3378ea4-eae2-481d-8418-51dcc11045ba","Type":"ContainerStarted","Data":"e7f2312c16ebcb7fc6da31c3c3419a50dfd7460e702a5db2e07af49c882105cf"}
Jul 16 11:35:06.681069 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:35:06.681038    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-f83b698a-7d86579467-9wdxr" event={"ID":"c3378ea4-eae2-481d-8418-51dcc11045ba","Type":"ContainerStarted","Data":"590b2b80c6dea72c30643cf8714852dcc3cfe5c30f9a1a45d243e78f0a0d1af1"}
Jul 16 11:35:06.700614 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:35:06.700570    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-f83b698a-7d86579467-9wdxr" podStartSLOduration=3.213818503 podStartE2EDuration="3.700555036s" totalImagesPullingTime="486.736533ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 11:35:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 11:35:06.698753403 +0000 UTC m=+1607.070290455" watchObservedRunningTime="2026-07-16 11:35:06.700555036 +0000 UTC m=+1607.072092125"
Jul 16 11:35:06.704594 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:35:06.704567    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:35:07.686545 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:35:07.686511    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-f83b698a-7d86579467-9wdxr"
Jul 16 11:35:09.114887 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:35:09.114853    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-f83b698a-gw-openshift-default-79cdd84f5f-xxtp8"]
Jul 16 11:35:09.115374 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:35:09.115026    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-migrate-f83b698a-gw-openshift-default-79cdd84f5f-xxtp8" podUID="95e2f621-dd1b-41cd-95a5-17a5daf2908d" containerName="istio-proxy" containerID="cri-o://7629385c4111d79ee422cea580ed5787c7d5f839a19cd515a120615347cb5452" gracePeriod=30
Jul 16 11:35:09.139885 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:35:09.139860    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:35:09.237394 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:35:09.237365    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:35:11.019531 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:35:11.019499    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:35:13.698348 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:35:13.698323    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-f83b698a-7d86579467-9wdxr"
Jul 16 11:35:15.126678 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:35:15.126636    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-f83b698a-7d86579467-9wdxr"]
Jul 16 11:35:15.127164 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:35:15.126866    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-f83b698a-7d86579467-9wdxr" podUID="c3378ea4-eae2-481d-8418-51dcc11045ba" containerName="maas-api" containerID="cri-o://e7f2312c16ebcb7fc6da31c3c3419a50dfd7460e702a5db2e07af49c882105cf" gracePeriod=30
Jul 16 11:35:15.148763 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:35:15.148728    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:35:15.383971 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:35:15.383918    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-f83b698a-7d86579467-9wdxr"
Jul 16 11:35:15.448070 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:35:15.448042    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c3378ea4-eae2-481d-8418-51dcc11045ba-openshift-service-ca\") pod \"c3378ea4-eae2-481d-8418-51dcc11045ba\" (UID: \"c3378ea4-eae2-481d-8418-51dcc11045ba\") "
Jul 16 11:35:15.448224 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:35:15.448110    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qvkbw\" (UniqueName: \"kubernetes.io/projected/c3378ea4-eae2-481d-8418-51dcc11045ba-kube-api-access-qvkbw\") pod \"c3378ea4-eae2-481d-8418-51dcc11045ba\" (UID: \"c3378ea4-eae2-481d-8418-51dcc11045ba\") "
Jul 16 11:35:15.448224 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:35:15.448154    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c3378ea4-eae2-481d-8418-51dcc11045ba-maas-api-tls\") pod \"c3378ea4-eae2-481d-8418-51dcc11045ba\" (UID: \"c3378ea4-eae2-481d-8418-51dcc11045ba\") "
Jul 16 11:35:15.448436 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:35:15.448408    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c3378ea4-eae2-481d-8418-51dcc11045ba-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "c3378ea4-eae2-481d-8418-51dcc11045ba" (UID: "c3378ea4-eae2-481d-8418-51dcc11045ba"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 11:35:15.450184 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:35:15.450162    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c3378ea4-eae2-481d-8418-51dcc11045ba-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "c3378ea4-eae2-481d-8418-51dcc11045ba" (UID: "c3378ea4-eae2-481d-8418-51dcc11045ba"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 11:35:15.450256 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:35:15.450228    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c3378ea4-eae2-481d-8418-51dcc11045ba-kube-api-access-qvkbw" (OuterVolumeSpecName: "kube-api-access-qvkbw") pod "c3378ea4-eae2-481d-8418-51dcc11045ba" (UID: "c3378ea4-eae2-481d-8418-51dcc11045ba"). InnerVolumeSpecName "kube-api-access-qvkbw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 11:35:15.549872 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:35:15.549840    2564 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c3378ea4-eae2-481d-8418-51dcc11045ba-maas-api-tls\") on node \"ip-10-0-135-184.ec2.internal\" DevicePath \"\""
Jul 16 11:35:15.549872 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:35:15.549871    2564 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c3378ea4-eae2-481d-8418-51dcc11045ba-openshift-service-ca\") on node \"ip-10-0-135-184.ec2.internal\" DevicePath \"\""
Jul 16 11:35:15.550041 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:35:15.549889    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qvkbw\" (UniqueName: \"kubernetes.io/projected/c3378ea4-eae2-481d-8418-51dcc11045ba-kube-api-access-qvkbw\") on node \"ip-10-0-135-184.ec2.internal\" DevicePath \"\""
Jul 16 11:35:15.595161 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:35:15.595133    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:35:15.736047 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:35:15.736014    2564 generic.go:356] "Generic (PLEG): container finished" podID="c3378ea4-eae2-481d-8418-51dcc11045ba" containerID="e7f2312c16ebcb7fc6da31c3c3419a50dfd7460e702a5db2e07af49c882105cf" exitCode=0
Jul 16 11:35:15.737255 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:35:15.736055    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-f83b698a-7d86579467-9wdxr" event={"ID":"c3378ea4-eae2-481d-8418-51dcc11045ba","Type":"ContainerDied","Data":"e7f2312c16ebcb7fc6da31c3c3419a50dfd7460e702a5db2e07af49c882105cf"}
Jul 16 11:35:15.737255 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:35:15.736119    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-f83b698a-7d86579467-9wdxr" event={"ID":"c3378ea4-eae2-481d-8418-51dcc11045ba","Type":"ContainerDied","Data":"590b2b80c6dea72c30643cf8714852dcc3cfe5c30f9a1a45d243e78f0a0d1af1"}
Jul 16 11:35:15.737255 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:35:15.736061    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-f83b698a-7d86579467-9wdxr"
Jul 16 11:35:15.737255 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:35:15.736149    2564 scope.go:117] "RemoveContainer" containerID="e7f2312c16ebcb7fc6da31c3c3419a50dfd7460e702a5db2e07af49c882105cf"
Jul 16 11:35:15.747656 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:35:15.747637    2564 scope.go:117] "RemoveContainer" containerID="e7f2312c16ebcb7fc6da31c3c3419a50dfd7460e702a5db2e07af49c882105cf"
Jul 16 11:35:15.747965 ip-10-0-135-184 kubenswrapper[2564]: E0716 11:35:15.747940    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e7f2312c16ebcb7fc6da31c3c3419a50dfd7460e702a5db2e07af49c882105cf\": container with ID starting with e7f2312c16ebcb7fc6da31c3c3419a50dfd7460e702a5db2e07af49c882105cf not found: ID does not exist" containerID="e7f2312c16ebcb7fc6da31c3c3419a50dfd7460e702a5db2e07af49c882105cf"
Jul 16 11:35:15.748056 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:35:15.747973    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e7f2312c16ebcb7fc6da31c3c3419a50dfd7460e702a5db2e07af49c882105cf"} err="failed to get container status \"e7f2312c16ebcb7fc6da31c3c3419a50dfd7460e702a5db2e07af49c882105cf\": rpc error: code = NotFound desc = could not find container \"e7f2312c16ebcb7fc6da31c3c3419a50dfd7460e702a5db2e07af49c882105cf\": container with ID starting with e7f2312c16ebcb7fc6da31c3c3419a50dfd7460e702a5db2e07af49c882105cf not found: ID does not exist"
Jul 16 11:35:15.757755 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:35:15.757735    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-f83b698a-7d86579467-9wdxr"]
Jul 16 11:35:15.762047 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:35:15.762027    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-f83b698a-7d86579467-9wdxr"]
Jul 16 11:35:15.947393 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:35:15.947367    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-f83b698a-gw-openshift-default-79cdd84f5f-xxtp8"
Jul 16 11:35:15.952390 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:35:15.952370    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/95e2f621-dd1b-41cd-95a5-17a5daf2908d-workload-socket\") pod \"95e2f621-dd1b-41cd-95a5-17a5daf2908d\" (UID: \"95e2f621-dd1b-41cd-95a5-17a5daf2908d\") "
Jul 16 11:35:15.952524 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:35:15.952408    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/95e2f621-dd1b-41cd-95a5-17a5daf2908d-istio-token\") pod \"95e2f621-dd1b-41cd-95a5-17a5daf2908d\" (UID: \"95e2f621-dd1b-41cd-95a5-17a5daf2908d\") "
Jul 16 11:35:15.952524 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:35:15.952475    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tnln2\" (UniqueName: \"kubernetes.io/projected/95e2f621-dd1b-41cd-95a5-17a5daf2908d-kube-api-access-tnln2\") pod \"95e2f621-dd1b-41cd-95a5-17a5daf2908d\" (UID: \"95e2f621-dd1b-41cd-95a5-17a5daf2908d\") "
Jul 16 11:35:15.952644 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:35:15.952605    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/95e2f621-dd1b-41cd-95a5-17a5daf2908d-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "95e2f621-dd1b-41cd-95a5-17a5daf2908d" (UID: "95e2f621-dd1b-41cd-95a5-17a5daf2908d"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 11:35:15.952702 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:35:15.952641    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/95e2f621-dd1b-41cd-95a5-17a5daf2908d-istio-envoy\") pod \"95e2f621-dd1b-41cd-95a5-17a5daf2908d\" (UID: \"95e2f621-dd1b-41cd-95a5-17a5daf2908d\") "
Jul 16 11:35:15.952702 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:35:15.952690    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/95e2f621-dd1b-41cd-95a5-17a5daf2908d-istio-podinfo\") pod \"95e2f621-dd1b-41cd-95a5-17a5daf2908d\" (UID: \"95e2f621-dd1b-41cd-95a5-17a5daf2908d\") "
Jul 16 11:35:15.952846 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:35:15.952743    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/95e2f621-dd1b-41cd-95a5-17a5daf2908d-workload-certs\") pod \"95e2f621-dd1b-41cd-95a5-17a5daf2908d\" (UID: \"95e2f621-dd1b-41cd-95a5-17a5daf2908d\") "
Jul 16 11:35:15.952846 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:35:15.952792    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/95e2f621-dd1b-41cd-95a5-17a5daf2908d-credential-socket\") pod \"95e2f621-dd1b-41cd-95a5-17a5daf2908d\" (UID: \"95e2f621-dd1b-41cd-95a5-17a5daf2908d\") "
Jul 16 11:35:15.952846 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:35:15.952830    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/95e2f621-dd1b-41cd-95a5-17a5daf2908d-istio-data\") pod \"95e2f621-dd1b-41cd-95a5-17a5daf2908d\" (UID: \"95e2f621-dd1b-41cd-95a5-17a5daf2908d\") "
Jul 16 11:35:15.952996 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:35:15.952855    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/95e2f621-dd1b-41cd-95a5-17a5daf2908d-istiod-ca-cert\") pod \"95e2f621-dd1b-41cd-95a5-17a5daf2908d\" (UID: \"95e2f621-dd1b-41cd-95a5-17a5daf2908d\") "
Jul 16 11:35:15.953051 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:35:15.952990    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/95e2f621-dd1b-41cd-95a5-17a5daf2908d-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "95e2f621-dd1b-41cd-95a5-17a5daf2908d" (UID: "95e2f621-dd1b-41cd-95a5-17a5daf2908d"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 11:35:15.953051 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:35:15.953007    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/95e2f621-dd1b-41cd-95a5-17a5daf2908d-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "95e2f621-dd1b-41cd-95a5-17a5daf2908d" (UID: "95e2f621-dd1b-41cd-95a5-17a5daf2908d"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 11:35:15.953276 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:35:15.953255    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/95e2f621-dd1b-41cd-95a5-17a5daf2908d-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "95e2f621-dd1b-41cd-95a5-17a5daf2908d" (UID: "95e2f621-dd1b-41cd-95a5-17a5daf2908d"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 11:35:15.953352 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:35:15.953306    2564 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/95e2f621-dd1b-41cd-95a5-17a5daf2908d-workload-certs\") on node \"ip-10-0-135-184.ec2.internal\" DevicePath \"\""
Jul 16 11:35:15.953352 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:35:15.953321    2564 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/95e2f621-dd1b-41cd-95a5-17a5daf2908d-credential-socket\") on node \"ip-10-0-135-184.ec2.internal\" DevicePath \"\""
Jul 16 11:35:15.953352 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:35:15.953336    2564 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/95e2f621-dd1b-41cd-95a5-17a5daf2908d-workload-socket\") on node \"ip-10-0-135-184.ec2.internal\" DevicePath \"\""
Jul 16 11:35:15.953917 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:35:15.953883    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/95e2f621-dd1b-41cd-95a5-17a5daf2908d-istio-data" (OuterVolumeSpecName: "istio-data") pod "95e2f621-dd1b-41cd-95a5-17a5daf2908d" (UID: "95e2f621-dd1b-41cd-95a5-17a5daf2908d"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 11:35:15.954724 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:35:15.954696    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/95e2f621-dd1b-41cd-95a5-17a5daf2908d-kube-api-access-tnln2" (OuterVolumeSpecName: "kube-api-access-tnln2") pod "95e2f621-dd1b-41cd-95a5-17a5daf2908d" (UID: "95e2f621-dd1b-41cd-95a5-17a5daf2908d"). InnerVolumeSpecName "kube-api-access-tnln2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 11:35:15.955020 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:35:15.954995    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/95e2f621-dd1b-41cd-95a5-17a5daf2908d-istio-token" (OuterVolumeSpecName: "istio-token") pod "95e2f621-dd1b-41cd-95a5-17a5daf2908d" (UID: "95e2f621-dd1b-41cd-95a5-17a5daf2908d"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 11:35:15.955020 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:35:15.954997    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/95e2f621-dd1b-41cd-95a5-17a5daf2908d-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "95e2f621-dd1b-41cd-95a5-17a5daf2908d" (UID: "95e2f621-dd1b-41cd-95a5-17a5daf2908d"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 11:35:15.955117 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:35:15.955000    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/95e2f621-dd1b-41cd-95a5-17a5daf2908d-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "95e2f621-dd1b-41cd-95a5-17a5daf2908d" (UID: "95e2f621-dd1b-41cd-95a5-17a5daf2908d"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 16 11:35:16.054654 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:35:16.054618    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tnln2\" (UniqueName: \"kubernetes.io/projected/95e2f621-dd1b-41cd-95a5-17a5daf2908d-kube-api-access-tnln2\") on node \"ip-10-0-135-184.ec2.internal\" DevicePath \"\""
Jul 16 11:35:16.054654 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:35:16.054655    2564 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/95e2f621-dd1b-41cd-95a5-17a5daf2908d-istio-envoy\") on node \"ip-10-0-135-184.ec2.internal\" DevicePath \"\""
Jul 16 11:35:16.054900 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:35:16.054669    2564 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/95e2f621-dd1b-41cd-95a5-17a5daf2908d-istio-podinfo\") on node \"ip-10-0-135-184.ec2.internal\" DevicePath \"\""
Jul 16 11:35:16.054900 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:35:16.054677    2564 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/95e2f621-dd1b-41cd-95a5-17a5daf2908d-istio-data\") on node \"ip-10-0-135-184.ec2.internal\" DevicePath \"\""
Jul 16 11:35:16.054900 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:35:16.054687    2564 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/95e2f621-dd1b-41cd-95a5-17a5daf2908d-istiod-ca-cert\") on node \"ip-10-0-135-184.ec2.internal\" DevicePath \"\""
Jul 16 11:35:16.054900 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:35:16.054694    2564 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/95e2f621-dd1b-41cd-95a5-17a5daf2908d-istio-token\") on node \"ip-10-0-135-184.ec2.internal\" DevicePath \"\""
Jul 16 11:35:16.302559 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:35:16.302529    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c3378ea4-eae2-481d-8418-51dcc11045ba" path="/var/lib/kubelet/pods/c3378ea4-eae2-481d-8418-51dcc11045ba/volumes"
Jul 16 11:35:16.742334 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:35:16.742254    2564 generic.go:356] "Generic (PLEG): container finished" podID="95e2f621-dd1b-41cd-95a5-17a5daf2908d" containerID="7629385c4111d79ee422cea580ed5787c7d5f839a19cd515a120615347cb5452" exitCode=0
Jul 16 11:35:16.742334 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:35:16.742305    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-f83b698a-gw-openshift-default-79cdd84f5f-xxtp8"
Jul 16 11:35:16.742521 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:35:16.742346    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-f83b698a-gw-openshift-default-79cdd84f5f-xxtp8" event={"ID":"95e2f621-dd1b-41cd-95a5-17a5daf2908d","Type":"ContainerDied","Data":"7629385c4111d79ee422cea580ed5787c7d5f839a19cd515a120615347cb5452"}
Jul 16 11:35:16.742521 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:35:16.742399    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-f83b698a-gw-openshift-default-79cdd84f5f-xxtp8" event={"ID":"95e2f621-dd1b-41cd-95a5-17a5daf2908d","Type":"ContainerDied","Data":"599682b28c05faa003d971b6bb20194bd717087446a95d529ed4ac55d99af6d4"}
Jul 16 11:35:16.742521 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:35:16.742425    2564 scope.go:117] "RemoveContainer" containerID="7629385c4111d79ee422cea580ed5787c7d5f839a19cd515a120615347cb5452"
Jul 16 11:35:16.751800 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:35:16.751785    2564 scope.go:117] "RemoveContainer" containerID="7629385c4111d79ee422cea580ed5787c7d5f839a19cd515a120615347cb5452"
Jul 16 11:35:16.752059 ip-10-0-135-184 kubenswrapper[2564]: E0716 11:35:16.752030    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7629385c4111d79ee422cea580ed5787c7d5f839a19cd515a120615347cb5452\": container with ID starting with 7629385c4111d79ee422cea580ed5787c7d5f839a19cd515a120615347cb5452 not found: ID does not exist" containerID="7629385c4111d79ee422cea580ed5787c7d5f839a19cd515a120615347cb5452"
Jul 16 11:35:16.752115 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:35:16.752059    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7629385c4111d79ee422cea580ed5787c7d5f839a19cd515a120615347cb5452"} err="failed to get container status \"7629385c4111d79ee422cea580ed5787c7d5f839a19cd515a120615347cb5452\": rpc error: code = NotFound desc = could not find container \"7629385c4111d79ee422cea580ed5787c7d5f839a19cd515a120615347cb5452\": container with ID starting with 7629385c4111d79ee422cea580ed5787c7d5f839a19cd515a120615347cb5452 not found: ID does not exist"
Jul 16 11:35:16.758930 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:35:16.758909    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-f83b698a-gw-openshift-default-79cdd84f5f-xxtp8"]
Jul 16 11:35:16.762837 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:35:16.762817    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-migrate-f83b698a-gw-openshift-default-79cdd84f5f-xxtp8"]
Jul 16 11:35:18.302283 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:35:18.302251    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="95e2f621-dd1b-41cd-95a5-17a5daf2908d" path="/var/lib/kubelet/pods/95e2f621-dd1b-41cd-95a5-17a5daf2908d/volumes"
Jul 16 11:35:21.638285 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:35:21.638255    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:35:21.710550 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:35:21.710519    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:35:21.830184 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:35:21.830155    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-29a4483c-openshift-default-794b45599f-pz4vw"]
Jul 16 11:35:21.830826 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:35:21.830810    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="95e2f621-dd1b-41cd-95a5-17a5daf2908d" containerName="istio-proxy"
Jul 16 11:35:21.830880 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:35:21.830829    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="95e2f621-dd1b-41cd-95a5-17a5daf2908d" containerName="istio-proxy"
Jul 16 11:35:21.830880 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:35:21.830853    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c3378ea4-eae2-481d-8418-51dcc11045ba" containerName="maas-api"
Jul 16 11:35:21.830880 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:35:21.830862    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="c3378ea4-eae2-481d-8418-51dcc11045ba" containerName="maas-api"
Jul 16 11:35:21.830982 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:35:21.830971    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="c3378ea4-eae2-481d-8418-51dcc11045ba" containerName="maas-api"
Jul 16 11:35:21.831017 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:35:21.830987    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="95e2f621-dd1b-41cd-95a5-17a5daf2908d" containerName="istio-proxy"
Jul 16 11:35:21.834318 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:35:21.834297    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-29a4483c-openshift-default-794b45599f-pz4vw"
Jul 16 11:35:21.837888 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:35:21.837871    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-29a4483c-openshift-default-dockercfg-dd27s\""
Jul 16 11:35:21.851517 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:35:21.851495    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-29a4483c-openshift-default-794b45599f-pz4vw"]
Jul 16 11:35:21.865890 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:35:21.865868    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:35:21.903172 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:35:21.903110    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/54cc0043-edc2-4091-bc6d-6af2bafdf430-credential-socket\") pod \"e2e-derive-29a4483c-openshift-default-794b45599f-pz4vw\" (UID: \"54cc0043-edc2-4091-bc6d-6af2bafdf430\") " pod="openshift-ingress/e2e-derive-29a4483c-openshift-default-794b45599f-pz4vw"
Jul 16 11:35:21.903172 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:35:21.903142    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/54cc0043-edc2-4091-bc6d-6af2bafdf430-istiod-ca-cert\") pod \"e2e-derive-29a4483c-openshift-default-794b45599f-pz4vw\" (UID: \"54cc0043-edc2-4091-bc6d-6af2bafdf430\") " pod="openshift-ingress/e2e-derive-29a4483c-openshift-default-794b45599f-pz4vw"
Jul 16 11:35:21.903172 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:35:21.903171    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/54cc0043-edc2-4091-bc6d-6af2bafdf430-workload-socket\") pod \"e2e-derive-29a4483c-openshift-default-794b45599f-pz4vw\" (UID: \"54cc0043-edc2-4091-bc6d-6af2bafdf430\") " pod="openshift-ingress/e2e-derive-29a4483c-openshift-default-794b45599f-pz4vw"
Jul 16 11:35:21.903393 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:35:21.903221    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/54cc0043-edc2-4091-bc6d-6af2bafdf430-workload-certs\") pod \"e2e-derive-29a4483c-openshift-default-794b45599f-pz4vw\" (UID: \"54cc0043-edc2-4091-bc6d-6af2bafdf430\") " pod="openshift-ingress/e2e-derive-29a4483c-openshift-default-794b45599f-pz4vw"
Jul 16 11:35:21.903393 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:35:21.903262    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/54cc0043-edc2-4091-bc6d-6af2bafdf430-istio-envoy\") pod \"e2e-derive-29a4483c-openshift-default-794b45599f-pz4vw\" (UID: \"54cc0043-edc2-4091-bc6d-6af2bafdf430\") " pod="openshift-ingress/e2e-derive-29a4483c-openshift-default-794b45599f-pz4vw"
Jul 16 11:35:21.903393 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:35:21.903305    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xpfnh\" (UniqueName: \"kubernetes.io/projected/54cc0043-edc2-4091-bc6d-6af2bafdf430-kube-api-access-xpfnh\") pod \"e2e-derive-29a4483c-openshift-default-794b45599f-pz4vw\" (UID: \"54cc0043-edc2-4091-bc6d-6af2bafdf430\") " pod="openshift-ingress/e2e-derive-29a4483c-openshift-default-794b45599f-pz4vw"
Jul 16 11:35:21.903393 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:35:21.903389    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/54cc0043-edc2-4091-bc6d-6af2bafdf430-istio-token\") pod \"e2e-derive-29a4483c-openshift-default-794b45599f-pz4vw\" (UID: \"54cc0043-edc2-4091-bc6d-6af2bafdf430\") " pod="openshift-ingress/e2e-derive-29a4483c-openshift-default-794b45599f-pz4vw"
Jul 16 11:35:21.903596 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:35:21.903415    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/54cc0043-edc2-4091-bc6d-6af2bafdf430-istio-data\") pod \"e2e-derive-29a4483c-openshift-default-794b45599f-pz4vw\" (UID: \"54cc0043-edc2-4091-bc6d-6af2bafdf430\") " pod="openshift-ingress/e2e-derive-29a4483c-openshift-default-794b45599f-pz4vw"
Jul 16 11:35:21.903596 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:35:21.903462    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/54cc0043-edc2-4091-bc6d-6af2bafdf430-istio-podinfo\") pod \"e2e-derive-29a4483c-openshift-default-794b45599f-pz4vw\" (UID: \"54cc0043-edc2-4091-bc6d-6af2bafdf430\") " pod="openshift-ingress/e2e-derive-29a4483c-openshift-default-794b45599f-pz4vw"
Jul 16 11:35:21.973954 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:35:21.973911    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:35:22.004557 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:35:22.004525    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/54cc0043-edc2-4091-bc6d-6af2bafdf430-workload-socket\") pod \"e2e-derive-29a4483c-openshift-default-794b45599f-pz4vw\" (UID: \"54cc0043-edc2-4091-bc6d-6af2bafdf430\") " pod="openshift-ingress/e2e-derive-29a4483c-openshift-default-794b45599f-pz4vw"
Jul 16 11:35:22.004758 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:35:22.004582    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/54cc0043-edc2-4091-bc6d-6af2bafdf430-workload-certs\") pod \"e2e-derive-29a4483c-openshift-default-794b45599f-pz4vw\" (UID: \"54cc0043-edc2-4091-bc6d-6af2bafdf430\") " pod="openshift-ingress/e2e-derive-29a4483c-openshift-default-794b45599f-pz4vw"
Jul 16 11:35:22.004758 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:35:22.004632    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/54cc0043-edc2-4091-bc6d-6af2bafdf430-istio-envoy\") pod \"e2e-derive-29a4483c-openshift-default-794b45599f-pz4vw\" (UID: \"54cc0043-edc2-4091-bc6d-6af2bafdf430\") " pod="openshift-ingress/e2e-derive-29a4483c-openshift-default-794b45599f-pz4vw"
Jul 16 11:35:22.004758 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:35:22.004677    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xpfnh\" (UniqueName: \"kubernetes.io/projected/54cc0043-edc2-4091-bc6d-6af2bafdf430-kube-api-access-xpfnh\") pod \"e2e-derive-29a4483c-openshift-default-794b45599f-pz4vw\" (UID: \"54cc0043-edc2-4091-bc6d-6af2bafdf430\") " pod="openshift-ingress/e2e-derive-29a4483c-openshift-default-794b45599f-pz4vw"
Jul 16 11:35:22.004758 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:35:22.004750    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/54cc0043-edc2-4091-bc6d-6af2bafdf430-istio-token\") pod \"e2e-derive-29a4483c-openshift-default-794b45599f-pz4vw\" (UID: \"54cc0043-edc2-4091-bc6d-6af2bafdf430\") " pod="openshift-ingress/e2e-derive-29a4483c-openshift-default-794b45599f-pz4vw"
Jul 16 11:35:22.005028 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:35:22.004812    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/54cc0043-edc2-4091-bc6d-6af2bafdf430-istio-data\") pod \"e2e-derive-29a4483c-openshift-default-794b45599f-pz4vw\" (UID: \"54cc0043-edc2-4091-bc6d-6af2bafdf430\") " pod="openshift-ingress/e2e-derive-29a4483c-openshift-default-794b45599f-pz4vw"
Jul 16 11:35:22.005028 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:35:22.004860    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/54cc0043-edc2-4091-bc6d-6af2bafdf430-istio-podinfo\") pod \"e2e-derive-29a4483c-openshift-default-794b45599f-pz4vw\" (UID: \"54cc0043-edc2-4091-bc6d-6af2bafdf430\") " pod="openshift-ingress/e2e-derive-29a4483c-openshift-default-794b45599f-pz4vw"
Jul 16 11:35:22.005028 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:35:22.004900    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/54cc0043-edc2-4091-bc6d-6af2bafdf430-credential-socket\") pod \"e2e-derive-29a4483c-openshift-default-794b45599f-pz4vw\" (UID: \"54cc0043-edc2-4091-bc6d-6af2bafdf430\") " pod="openshift-ingress/e2e-derive-29a4483c-openshift-default-794b45599f-pz4vw"
Jul 16 11:35:22.005028 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:35:22.004938    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/54cc0043-edc2-4091-bc6d-6af2bafdf430-istiod-ca-cert\") pod \"e2e-derive-29a4483c-openshift-default-794b45599f-pz4vw\" (UID: \"54cc0043-edc2-4091-bc6d-6af2bafdf430\") " pod="openshift-ingress/e2e-derive-29a4483c-openshift-default-794b45599f-pz4vw"
Jul 16 11:35:22.005028 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:35:22.004979    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/54cc0043-edc2-4091-bc6d-6af2bafdf430-workload-socket\") pod \"e2e-derive-29a4483c-openshift-default-794b45599f-pz4vw\" (UID: \"54cc0043-edc2-4091-bc6d-6af2bafdf430\") " pod="openshift-ingress/e2e-derive-29a4483c-openshift-default-794b45599f-pz4vw"
Jul 16 11:35:22.005292 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:35:22.005237    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/54cc0043-edc2-4091-bc6d-6af2bafdf430-workload-certs\") pod \"e2e-derive-29a4483c-openshift-default-794b45599f-pz4vw\" (UID: \"54cc0043-edc2-4091-bc6d-6af2bafdf430\") " pod="openshift-ingress/e2e-derive-29a4483c-openshift-default-794b45599f-pz4vw"
Jul 16 11:35:22.005723 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:35:22.005690    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/54cc0043-edc2-4091-bc6d-6af2bafdf430-istio-data\") pod \"e2e-derive-29a4483c-openshift-default-794b45599f-pz4vw\" (UID: \"54cc0043-edc2-4091-bc6d-6af2bafdf430\") " pod="openshift-ingress/e2e-derive-29a4483c-openshift-default-794b45599f-pz4vw"
Jul 16 11:35:22.005916 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:35:22.005722    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/54cc0043-edc2-4091-bc6d-6af2bafdf430-istiod-ca-cert\") pod \"e2e-derive-29a4483c-openshift-default-794b45599f-pz4vw\" (UID: \"54cc0043-edc2-4091-bc6d-6af2bafdf430\") " pod="openshift-ingress/e2e-derive-29a4483c-openshift-default-794b45599f-pz4vw"
Jul 16 11:35:22.006015 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:35:22.005861    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/54cc0043-edc2-4091-bc6d-6af2bafdf430-credential-socket\") pod \"e2e-derive-29a4483c-openshift-default-794b45599f-pz4vw\" (UID: \"54cc0043-edc2-4091-bc6d-6af2bafdf430\") " pod="openshift-ingress/e2e-derive-29a4483c-openshift-default-794b45599f-pz4vw"
Jul 16 11:35:22.007889 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:35:22.007868    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/54cc0043-edc2-4091-bc6d-6af2bafdf430-istio-envoy\") pod \"e2e-derive-29a4483c-openshift-default-794b45599f-pz4vw\" (UID: \"54cc0043-edc2-4091-bc6d-6af2bafdf430\") " pod="openshift-ingress/e2e-derive-29a4483c-openshift-default-794b45599f-pz4vw"
Jul 16 11:35:22.008085 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:35:22.008070    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/54cc0043-edc2-4091-bc6d-6af2bafdf430-istio-podinfo\") pod \"e2e-derive-29a4483c-openshift-default-794b45599f-pz4vw\" (UID: \"54cc0043-edc2-4091-bc6d-6af2bafdf430\") " pod="openshift-ingress/e2e-derive-29a4483c-openshift-default-794b45599f-pz4vw"
Jul 16 11:35:22.017136 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:35:22.017116    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/54cc0043-edc2-4091-bc6d-6af2bafdf430-istio-token\") pod \"e2e-derive-29a4483c-openshift-default-794b45599f-pz4vw\" (UID: \"54cc0043-edc2-4091-bc6d-6af2bafdf430\") " pod="openshift-ingress/e2e-derive-29a4483c-openshift-default-794b45599f-pz4vw"
Jul 16 11:35:22.017635 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:35:22.017609    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xpfnh\" (UniqueName: \"kubernetes.io/projected/54cc0043-edc2-4091-bc6d-6af2bafdf430-kube-api-access-xpfnh\") pod \"e2e-derive-29a4483c-openshift-default-794b45599f-pz4vw\" (UID: \"54cc0043-edc2-4091-bc6d-6af2bafdf430\") " pod="openshift-ingress/e2e-derive-29a4483c-openshift-default-794b45599f-pz4vw"
Jul 16 11:35:22.071147 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:35:22.071118    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:35:22.141324 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:35:22.141289    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:35:22.145169 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:35:22.145145    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-29a4483c-openshift-default-794b45599f-pz4vw"
Jul 16 11:35:22.303823 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:35:22.303800    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-29a4483c-openshift-default-794b45599f-pz4vw"]
Jul 16 11:35:22.306315 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:35:22.306284    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod54cc0043_edc2_4091_bc6d_6af2bafdf430.slice/crio-391be15ab1153e97c3059c72d64e88c71c62e8847fb904c6e7d21a63d55a6729 WatchSource:0}: Error finding container 391be15ab1153e97c3059c72d64e88c71c62e8847fb904c6e7d21a63d55a6729: Status 404 returned error can't find the container with id 391be15ab1153e97c3059c72d64e88c71c62e8847fb904c6e7d21a63d55a6729
Jul 16 11:35:22.306910 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:35:22.306889    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:35:22.308440 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:35:22.308411    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 16 11:35:22.308497 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:35:22.308475    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 16 11:35:22.308540 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:35:22.308503    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 16 11:35:22.778386 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:35:22.778339    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:35:22.779441 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:35:22.779406    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-29a4483c-openshift-default-794b45599f-pz4vw" event={"ID":"54cc0043-edc2-4091-bc6d-6af2bafdf430","Type":"ContainerStarted","Data":"5fc24fdf681aebd9c9f53710b515f1a7e442cdd840b83b8d6edb7da6e51ad33c"}
Jul 16 11:35:22.779570 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:35:22.779460    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-29a4483c-openshift-default-794b45599f-pz4vw" event={"ID":"54cc0043-edc2-4091-bc6d-6af2bafdf430","Type":"ContainerStarted","Data":"391be15ab1153e97c3059c72d64e88c71c62e8847fb904c6e7d21a63d55a6729"}
Jul 16 11:35:22.802961 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:35:22.802923    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-29a4483c-openshift-default-794b45599f-pz4vw" podStartSLOduration=1.802908529 podStartE2EDuration="1.802908529s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 11:35:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 11:35:22.801023583 +0000 UTC m=+1623.172560619" watchObservedRunningTime="2026-07-16 11:35:22.802908529 +0000 UTC m=+1623.174445564"
Jul 16 11:35:22.879510 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:35:22.879482    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:35:23.146057 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:35:23.145985    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-29a4483c-openshift-default-794b45599f-pz4vw"
Jul 16 11:35:23.147564 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:35:23.147538    2564 patch_prober.go:28] interesting pod/e2e-derive-29a4483c-openshift-default-794b45599f-pz4vw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused" start-of-body=
Jul 16 11:35:23.147694 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:35:23.147584    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-29a4483c-openshift-default-794b45599f-pz4vw" podUID="54cc0043-edc2-4091-bc6d-6af2bafdf430" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused"
Jul 16 11:35:24.149412 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:35:24.149386    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-29a4483c-openshift-default-794b45599f-pz4vw"
Jul 16 11:35:24.789901 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:35:24.789872    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-29a4483c-openshift-default-794b45599f-pz4vw"
Jul 16 11:35:24.790820 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:35:24.790795    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-29a4483c-openshift-default-794b45599f-pz4vw"
Jul 16 11:35:25.050721 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:35:25.050641    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:35:27.486690 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:35:27.486652    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-29a4483c-openshift-default-794b45599f-pz4vw"]
Jul 16 11:35:27.510032 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:35:27.509997    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:35:27.618943 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:35:27.618894    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:35:27.804063 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:35:27.804027    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-29a4483c-openshift-default-794b45599f-pz4vw" podUID="54cc0043-edc2-4091-bc6d-6af2bafdf430" containerName="istio-proxy" containerID="cri-o://5fc24fdf681aebd9c9f53710b515f1a7e442cdd840b83b8d6edb7da6e51ad33c" gracePeriod=30
Jul 16 11:35:28.834270 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:35:28.834240    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:35:33.063323 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:35:33.063301    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-29a4483c-openshift-default-794b45599f-pz4vw"
Jul 16 11:35:33.109712 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:35:33.109656    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/54cc0043-edc2-4091-bc6d-6af2bafdf430-workload-socket\") pod \"54cc0043-edc2-4091-bc6d-6af2bafdf430\" (UID: \"54cc0043-edc2-4091-bc6d-6af2bafdf430\") "
Jul 16 11:35:33.109712 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:35:33.109685    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/54cc0043-edc2-4091-bc6d-6af2bafdf430-istio-envoy\") pod \"54cc0043-edc2-4091-bc6d-6af2bafdf430\" (UID: \"54cc0043-edc2-4091-bc6d-6af2bafdf430\") "
Jul 16 11:35:33.109712 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:35:33.109707    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/54cc0043-edc2-4091-bc6d-6af2bafdf430-workload-certs\") pod \"54cc0043-edc2-4091-bc6d-6af2bafdf430\" (UID: \"54cc0043-edc2-4091-bc6d-6af2bafdf430\") "
Jul 16 11:35:33.109985 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:35:33.109730    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/54cc0043-edc2-4091-bc6d-6af2bafdf430-istio-podinfo\") pod \"54cc0043-edc2-4091-bc6d-6af2bafdf430\" (UID: \"54cc0043-edc2-4091-bc6d-6af2bafdf430\") "
Jul 16 11:35:33.109985 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:35:33.109821    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/54cc0043-edc2-4091-bc6d-6af2bafdf430-istiod-ca-cert\") pod \"54cc0043-edc2-4091-bc6d-6af2bafdf430\" (UID: \"54cc0043-edc2-4091-bc6d-6af2bafdf430\") "
Jul 16 11:35:33.109985 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:35:33.109854    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/54cc0043-edc2-4091-bc6d-6af2bafdf430-istio-data\") pod \"54cc0043-edc2-4091-bc6d-6af2bafdf430\" (UID: \"54cc0043-edc2-4091-bc6d-6af2bafdf430\") "
Jul 16 11:35:33.109985 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:35:33.109882    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/54cc0043-edc2-4091-bc6d-6af2bafdf430-credential-socket\") pod \"54cc0043-edc2-4091-bc6d-6af2bafdf430\" (UID: \"54cc0043-edc2-4091-bc6d-6af2bafdf430\") "
Jul 16 11:35:33.109985 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:35:33.109933    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xpfnh\" (UniqueName: \"kubernetes.io/projected/54cc0043-edc2-4091-bc6d-6af2bafdf430-kube-api-access-xpfnh\") pod \"54cc0043-edc2-4091-bc6d-6af2bafdf430\" (UID: \"54cc0043-edc2-4091-bc6d-6af2bafdf430\") "
Jul 16 11:35:33.109985 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:35:33.109946    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/54cc0043-edc2-4091-bc6d-6af2bafdf430-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "54cc0043-edc2-4091-bc6d-6af2bafdf430" (UID: "54cc0043-edc2-4091-bc6d-6af2bafdf430"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 11:35:33.109985 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:35:33.109957    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/54cc0043-edc2-4091-bc6d-6af2bafdf430-istio-token\") pod \"54cc0043-edc2-4091-bc6d-6af2bafdf430\" (UID: \"54cc0043-edc2-4091-bc6d-6af2bafdf430\") "
Jul 16 11:35:33.110342 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:35:33.110100    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/54cc0043-edc2-4091-bc6d-6af2bafdf430-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "54cc0043-edc2-4091-bc6d-6af2bafdf430" (UID: "54cc0043-edc2-4091-bc6d-6af2bafdf430"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 11:35:33.110578 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:35:33.110472    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/54cc0043-edc2-4091-bc6d-6af2bafdf430-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "54cc0043-edc2-4091-bc6d-6af2bafdf430" (UID: "54cc0043-edc2-4091-bc6d-6af2bafdf430"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 11:35:33.110578 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:35:33.110491    2564 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/54cc0043-edc2-4091-bc6d-6af2bafdf430-workload-socket\") on node \"ip-10-0-135-184.ec2.internal\" DevicePath \"\""
Jul 16 11:35:33.110578 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:35:33.110552    2564 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/54cc0043-edc2-4091-bc6d-6af2bafdf430-credential-socket\") on node \"ip-10-0-135-184.ec2.internal\" DevicePath \"\""
Jul 16 11:35:33.110834 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:35:33.110594    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/54cc0043-edc2-4091-bc6d-6af2bafdf430-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "54cc0043-edc2-4091-bc6d-6af2bafdf430" (UID: "54cc0043-edc2-4091-bc6d-6af2bafdf430"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 11:35:33.110834 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:35:33.110593    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/54cc0043-edc2-4091-bc6d-6af2bafdf430-istio-data" (OuterVolumeSpecName: "istio-data") pod "54cc0043-edc2-4091-bc6d-6af2bafdf430" (UID: "54cc0043-edc2-4091-bc6d-6af2bafdf430"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 11:35:33.112286 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:35:33.112260    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/54cc0043-edc2-4091-bc6d-6af2bafdf430-kube-api-access-xpfnh" (OuterVolumeSpecName: "kube-api-access-xpfnh") pod "54cc0043-edc2-4091-bc6d-6af2bafdf430" (UID: "54cc0043-edc2-4091-bc6d-6af2bafdf430"). InnerVolumeSpecName "kube-api-access-xpfnh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 11:35:33.112368 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:35:33.112289    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/54cc0043-edc2-4091-bc6d-6af2bafdf430-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "54cc0043-edc2-4091-bc6d-6af2bafdf430" (UID: "54cc0043-edc2-4091-bc6d-6af2bafdf430"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 11:35:33.112368 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:35:33.112305    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/54cc0043-edc2-4091-bc6d-6af2bafdf430-istio-token" (OuterVolumeSpecName: "istio-token") pod "54cc0043-edc2-4091-bc6d-6af2bafdf430" (UID: "54cc0043-edc2-4091-bc6d-6af2bafdf430"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 11:35:33.112494 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:35:33.112478    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/54cc0043-edc2-4091-bc6d-6af2bafdf430-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "54cc0043-edc2-4091-bc6d-6af2bafdf430" (UID: "54cc0043-edc2-4091-bc6d-6af2bafdf430"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 16 11:35:33.211247 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:35:33.211225    2564 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/54cc0043-edc2-4091-bc6d-6af2bafdf430-istio-envoy\") on node \"ip-10-0-135-184.ec2.internal\" DevicePath \"\""
Jul 16 11:35:33.211247 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:35:33.211245    2564 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/54cc0043-edc2-4091-bc6d-6af2bafdf430-workload-certs\") on node \"ip-10-0-135-184.ec2.internal\" DevicePath \"\""
Jul 16 11:35:33.211370 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:35:33.211254    2564 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/54cc0043-edc2-4091-bc6d-6af2bafdf430-istio-podinfo\") on node \"ip-10-0-135-184.ec2.internal\" DevicePath \"\""
Jul 16 11:35:33.211370 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:35:33.211261    2564 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/54cc0043-edc2-4091-bc6d-6af2bafdf430-istiod-ca-cert\") on node \"ip-10-0-135-184.ec2.internal\" DevicePath \"\""
Jul 16 11:35:33.211370 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:35:33.211269    2564 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/54cc0043-edc2-4091-bc6d-6af2bafdf430-istio-data\") on node \"ip-10-0-135-184.ec2.internal\" DevicePath \"\""
Jul 16 11:35:33.211370 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:35:33.211277    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xpfnh\" (UniqueName: \"kubernetes.io/projected/54cc0043-edc2-4091-bc6d-6af2bafdf430-kube-api-access-xpfnh\") on node \"ip-10-0-135-184.ec2.internal\" DevicePath \"\""
Jul 16 11:35:33.211370 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:35:33.211285    2564 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/54cc0043-edc2-4091-bc6d-6af2bafdf430-istio-token\") on node \"ip-10-0-135-184.ec2.internal\" DevicePath \"\""
Jul 16 11:35:33.518125 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:35:33.518090    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:35:33.809372 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:35:33.809295    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:35:33.836010 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:35:33.835978    2564 generic.go:356] "Generic (PLEG): container finished" podID="54cc0043-edc2-4091-bc6d-6af2bafdf430" containerID="5fc24fdf681aebd9c9f53710b515f1a7e442cdd840b83b8d6edb7da6e51ad33c" exitCode=0
Jul 16 11:35:33.836139 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:35:33.836029    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-29a4483c-openshift-default-794b45599f-pz4vw"
Jul 16 11:35:33.836139 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:35:33.836062    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-29a4483c-openshift-default-794b45599f-pz4vw" event={"ID":"54cc0043-edc2-4091-bc6d-6af2bafdf430","Type":"ContainerDied","Data":"5fc24fdf681aebd9c9f53710b515f1a7e442cdd840b83b8d6edb7da6e51ad33c"}
Jul 16 11:35:33.836139 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:35:33.836115    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-29a4483c-openshift-default-794b45599f-pz4vw" event={"ID":"54cc0043-edc2-4091-bc6d-6af2bafdf430","Type":"ContainerDied","Data":"391be15ab1153e97c3059c72d64e88c71c62e8847fb904c6e7d21a63d55a6729"}
Jul 16 11:35:33.836253 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:35:33.836140    2564 scope.go:117] "RemoveContainer" containerID="5fc24fdf681aebd9c9f53710b515f1a7e442cdd840b83b8d6edb7da6e51ad33c"
Jul 16 11:35:33.845564 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:35:33.845546    2564 scope.go:117] "RemoveContainer" containerID="5fc24fdf681aebd9c9f53710b515f1a7e442cdd840b83b8d6edb7da6e51ad33c"
Jul 16 11:35:33.845834 ip-10-0-135-184 kubenswrapper[2564]: E0716 11:35:33.845816    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5fc24fdf681aebd9c9f53710b515f1a7e442cdd840b83b8d6edb7da6e51ad33c\": container with ID starting with 5fc24fdf681aebd9c9f53710b515f1a7e442cdd840b83b8d6edb7da6e51ad33c not found: ID does not exist" containerID="5fc24fdf681aebd9c9f53710b515f1a7e442cdd840b83b8d6edb7da6e51ad33c"
Jul 16 11:35:33.845914 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:35:33.845841    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5fc24fdf681aebd9c9f53710b515f1a7e442cdd840b83b8d6edb7da6e51ad33c"} err="failed to get container status \"5fc24fdf681aebd9c9f53710b515f1a7e442cdd840b83b8d6edb7da6e51ad33c\": rpc error: code = NotFound desc = could not find container \"5fc24fdf681aebd9c9f53710b515f1a7e442cdd840b83b8d6edb7da6e51ad33c\": container with ID starting with 5fc24fdf681aebd9c9f53710b515f1a7e442cdd840b83b8d6edb7da6e51ad33c not found: ID does not exist"
Jul 16 11:35:33.857380 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:35:33.857360    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-29a4483c-openshift-default-794b45599f-pz4vw"]
Jul 16 11:35:33.861573 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:35:33.861552    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-29a4483c-openshift-default-794b45599f-pz4vw"]
Jul 16 11:35:34.301440 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:35:34.301406    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="54cc0043-edc2-4091-bc6d-6af2bafdf430" path="/var/lib/kubelet/pods/54cc0043-edc2-4091-bc6d-6af2bafdf430/volumes"
Jul 16 11:35:39.648793 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:35:39.648749    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:35:39.704083 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:35:39.704049    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:35:40.129637 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:35:40.129570    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:35:40.229566 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:35:40.229525    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:35:40.328331 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:35:40.328304    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:35:41.686616 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:35:41.686585    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:35:47.619081 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:35:47.619051    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:35:48.684267 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:35:48.684233    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:36:14.270781 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:36:14.270750    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:36:20.709539 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:36:20.709447    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:36:20.817934 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:36:20.817903    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:36:20.910647 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:36:20.910620    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:36:36.822087 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:36:36.822050    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:36:43.344238 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:36:43.344200    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:36:43.407300 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:36:43.407270    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:36:43.516516 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:36:43.516488    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:36:43.616334 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:36:43.616259    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:36:54.075872 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:36:54.075840    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:36:54.875843 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:36:54.875815    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:37:00.898165 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:37:00.898115    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:37:00.999155 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:37:00.999120    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:37:01.097883 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:37:01.097845    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:37:01.197683 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:37:01.197614    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:37:01.936183 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:37:01.936152    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:37:02.035405 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:37:02.035371    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:37:02.135116 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:37:02.135073    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:37:05.052033 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:37:05.052002    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:37:09.762287 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:37:09.762244    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:37:09.855012 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:37:09.854986    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:37:10.442922 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:37:10.442885    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:37:16.304874 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:37:16.304844    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:37:16.366301 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:37:16.366252    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:37:16.537200 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:37:16.537170    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:37:16.819168 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:37:16.819136    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-41466a73-openshift-default-75c98666c9-s6dfm"]
Jul 16 11:37:16.819648 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:37:16.819631    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="54cc0043-edc2-4091-bc6d-6af2bafdf430" containerName="istio-proxy"
Jul 16 11:37:16.819753 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:37:16.819650    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="54cc0043-edc2-4091-bc6d-6af2bafdf430" containerName="istio-proxy"
Jul 16 11:37:16.819832 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:37:16.819807    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="54cc0043-edc2-4091-bc6d-6af2bafdf430" containerName="istio-proxy"
Jul 16 11:37:16.822974 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:37:16.822955    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-41466a73-openshift-default-75c98666c9-s6dfm"
Jul 16 11:37:16.824921 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:37:16.824900    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-41466a73-openshift-default-dockercfg-zpx87\""
Jul 16 11:37:16.839397 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:37:16.839376    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:37:16.841259 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:37:16.841239    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-41466a73-openshift-default-75c98666c9-s6dfm"]
Jul 16 11:37:16.877311 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:37:16.877291    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/44d16024-1df9-40b0-9b95-ba31ee7b552c-workload-certs\") pod \"e2e-mt-41466a73-openshift-default-75c98666c9-s6dfm\" (UID: \"44d16024-1df9-40b0-9b95-ba31ee7b552c\") " pod="openshift-ingress/e2e-mt-41466a73-openshift-default-75c98666c9-s6dfm"
Jul 16 11:37:16.877426 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:37:16.877324    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/44d16024-1df9-40b0-9b95-ba31ee7b552c-istiod-ca-cert\") pod \"e2e-mt-41466a73-openshift-default-75c98666c9-s6dfm\" (UID: \"44d16024-1df9-40b0-9b95-ba31ee7b552c\") " pod="openshift-ingress/e2e-mt-41466a73-openshift-default-75c98666c9-s6dfm"
Jul 16 11:37:16.877426 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:37:16.877346    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/44d16024-1df9-40b0-9b95-ba31ee7b552c-credential-socket\") pod \"e2e-mt-41466a73-openshift-default-75c98666c9-s6dfm\" (UID: \"44d16024-1df9-40b0-9b95-ba31ee7b552c\") " pod="openshift-ingress/e2e-mt-41466a73-openshift-default-75c98666c9-s6dfm"
Jul 16 11:37:16.877426 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:37:16.877386    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/44d16024-1df9-40b0-9b95-ba31ee7b552c-istio-envoy\") pod \"e2e-mt-41466a73-openshift-default-75c98666c9-s6dfm\" (UID: \"44d16024-1df9-40b0-9b95-ba31ee7b552c\") " pod="openshift-ingress/e2e-mt-41466a73-openshift-default-75c98666c9-s6dfm"
Jul 16 11:37:16.877531 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:37:16.877441    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-686km\" (UniqueName: \"kubernetes.io/projected/44d16024-1df9-40b0-9b95-ba31ee7b552c-kube-api-access-686km\") pod \"e2e-mt-41466a73-openshift-default-75c98666c9-s6dfm\" (UID: \"44d16024-1df9-40b0-9b95-ba31ee7b552c\") " pod="openshift-ingress/e2e-mt-41466a73-openshift-default-75c98666c9-s6dfm"
Jul 16 11:37:16.877531 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:37:16.877472    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/44d16024-1df9-40b0-9b95-ba31ee7b552c-workload-socket\") pod \"e2e-mt-41466a73-openshift-default-75c98666c9-s6dfm\" (UID: \"44d16024-1df9-40b0-9b95-ba31ee7b552c\") " pod="openshift-ingress/e2e-mt-41466a73-openshift-default-75c98666c9-s6dfm"
Jul 16 11:37:16.877531 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:37:16.877490    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/44d16024-1df9-40b0-9b95-ba31ee7b552c-istio-data\") pod \"e2e-mt-41466a73-openshift-default-75c98666c9-s6dfm\" (UID: \"44d16024-1df9-40b0-9b95-ba31ee7b552c\") " pod="openshift-ingress/e2e-mt-41466a73-openshift-default-75c98666c9-s6dfm"
Jul 16 11:37:16.877531 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:37:16.877517    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/44d16024-1df9-40b0-9b95-ba31ee7b552c-istio-token\") pod \"e2e-mt-41466a73-openshift-default-75c98666c9-s6dfm\" (UID: \"44d16024-1df9-40b0-9b95-ba31ee7b552c\") " pod="openshift-ingress/e2e-mt-41466a73-openshift-default-75c98666c9-s6dfm"
Jul 16 11:37:16.877655 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:37:16.877559    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/44d16024-1df9-40b0-9b95-ba31ee7b552c-istio-podinfo\") pod \"e2e-mt-41466a73-openshift-default-75c98666c9-s6dfm\" (UID: \"44d16024-1df9-40b0-9b95-ba31ee7b552c\") " pod="openshift-ingress/e2e-mt-41466a73-openshift-default-75c98666c9-s6dfm"
Jul 16 11:37:16.978973 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:37:16.978940    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/44d16024-1df9-40b0-9b95-ba31ee7b552c-istiod-ca-cert\") pod \"e2e-mt-41466a73-openshift-default-75c98666c9-s6dfm\" (UID: \"44d16024-1df9-40b0-9b95-ba31ee7b552c\") " pod="openshift-ingress/e2e-mt-41466a73-openshift-default-75c98666c9-s6dfm"
Jul 16 11:37:16.978973 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:37:16.978975    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/44d16024-1df9-40b0-9b95-ba31ee7b552c-credential-socket\") pod \"e2e-mt-41466a73-openshift-default-75c98666c9-s6dfm\" (UID: \"44d16024-1df9-40b0-9b95-ba31ee7b552c\") " pod="openshift-ingress/e2e-mt-41466a73-openshift-default-75c98666c9-s6dfm"
Jul 16 11:37:16.979181 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:37:16.978997    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/44d16024-1df9-40b0-9b95-ba31ee7b552c-istio-envoy\") pod \"e2e-mt-41466a73-openshift-default-75c98666c9-s6dfm\" (UID: \"44d16024-1df9-40b0-9b95-ba31ee7b552c\") " pod="openshift-ingress/e2e-mt-41466a73-openshift-default-75c98666c9-s6dfm"
Jul 16 11:37:16.979181 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:37:16.979046    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-686km\" (UniqueName: \"kubernetes.io/projected/44d16024-1df9-40b0-9b95-ba31ee7b552c-kube-api-access-686km\") pod \"e2e-mt-41466a73-openshift-default-75c98666c9-s6dfm\" (UID: \"44d16024-1df9-40b0-9b95-ba31ee7b552c\") " pod="openshift-ingress/e2e-mt-41466a73-openshift-default-75c98666c9-s6dfm"
Jul 16 11:37:16.979181 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:37:16.979076    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/44d16024-1df9-40b0-9b95-ba31ee7b552c-workload-socket\") pod \"e2e-mt-41466a73-openshift-default-75c98666c9-s6dfm\" (UID: \"44d16024-1df9-40b0-9b95-ba31ee7b552c\") " pod="openshift-ingress/e2e-mt-41466a73-openshift-default-75c98666c9-s6dfm"
Jul 16 11:37:16.979181 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:37:16.979100    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/44d16024-1df9-40b0-9b95-ba31ee7b552c-istio-data\") pod \"e2e-mt-41466a73-openshift-default-75c98666c9-s6dfm\" (UID: \"44d16024-1df9-40b0-9b95-ba31ee7b552c\") " pod="openshift-ingress/e2e-mt-41466a73-openshift-default-75c98666c9-s6dfm"
Jul 16 11:37:16.979181 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:37:16.979142    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/44d16024-1df9-40b0-9b95-ba31ee7b552c-istio-token\") pod \"e2e-mt-41466a73-openshift-default-75c98666c9-s6dfm\" (UID: \"44d16024-1df9-40b0-9b95-ba31ee7b552c\") " pod="openshift-ingress/e2e-mt-41466a73-openshift-default-75c98666c9-s6dfm"
Jul 16 11:37:16.979181 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:37:16.979181    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/44d16024-1df9-40b0-9b95-ba31ee7b552c-istio-podinfo\") pod \"e2e-mt-41466a73-openshift-default-75c98666c9-s6dfm\" (UID: \"44d16024-1df9-40b0-9b95-ba31ee7b552c\") " pod="openshift-ingress/e2e-mt-41466a73-openshift-default-75c98666c9-s6dfm"
Jul 16 11:37:16.979490 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:37:16.979252    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/44d16024-1df9-40b0-9b95-ba31ee7b552c-workload-certs\") pod \"e2e-mt-41466a73-openshift-default-75c98666c9-s6dfm\" (UID: \"44d16024-1df9-40b0-9b95-ba31ee7b552c\") " pod="openshift-ingress/e2e-mt-41466a73-openshift-default-75c98666c9-s6dfm"
Jul 16 11:37:16.979490 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:37:16.979389    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/44d16024-1df9-40b0-9b95-ba31ee7b552c-credential-socket\") pod \"e2e-mt-41466a73-openshift-default-75c98666c9-s6dfm\" (UID: \"44d16024-1df9-40b0-9b95-ba31ee7b552c\") " pod="openshift-ingress/e2e-mt-41466a73-openshift-default-75c98666c9-s6dfm"
Jul 16 11:37:16.979490 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:37:16.979473    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/44d16024-1df9-40b0-9b95-ba31ee7b552c-workload-socket\") pod \"e2e-mt-41466a73-openshift-default-75c98666c9-s6dfm\" (UID: \"44d16024-1df9-40b0-9b95-ba31ee7b552c\") " pod="openshift-ingress/e2e-mt-41466a73-openshift-default-75c98666c9-s6dfm"
Jul 16 11:37:16.979636 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:37:16.979623    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/44d16024-1df9-40b0-9b95-ba31ee7b552c-workload-certs\") pod \"e2e-mt-41466a73-openshift-default-75c98666c9-s6dfm\" (UID: \"44d16024-1df9-40b0-9b95-ba31ee7b552c\") " pod="openshift-ingress/e2e-mt-41466a73-openshift-default-75c98666c9-s6dfm"
Jul 16 11:37:16.979764 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:37:16.979745    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/44d16024-1df9-40b0-9b95-ba31ee7b552c-istiod-ca-cert\") pod \"e2e-mt-41466a73-openshift-default-75c98666c9-s6dfm\" (UID: \"44d16024-1df9-40b0-9b95-ba31ee7b552c\") " pod="openshift-ingress/e2e-mt-41466a73-openshift-default-75c98666c9-s6dfm"
Jul 16 11:37:16.979873 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:37:16.979814    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/44d16024-1df9-40b0-9b95-ba31ee7b552c-istio-data\") pod \"e2e-mt-41466a73-openshift-default-75c98666c9-s6dfm\" (UID: \"44d16024-1df9-40b0-9b95-ba31ee7b552c\") " pod="openshift-ingress/e2e-mt-41466a73-openshift-default-75c98666c9-s6dfm"
Jul 16 11:37:16.981305 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:37:16.981280    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/44d16024-1df9-40b0-9b95-ba31ee7b552c-istio-envoy\") pod \"e2e-mt-41466a73-openshift-default-75c98666c9-s6dfm\" (UID: \"44d16024-1df9-40b0-9b95-ba31ee7b552c\") " pod="openshift-ingress/e2e-mt-41466a73-openshift-default-75c98666c9-s6dfm"
Jul 16 11:37:16.981573 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:37:16.981557    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/44d16024-1df9-40b0-9b95-ba31ee7b552c-istio-podinfo\") pod \"e2e-mt-41466a73-openshift-default-75c98666c9-s6dfm\" (UID: \"44d16024-1df9-40b0-9b95-ba31ee7b552c\") " pod="openshift-ingress/e2e-mt-41466a73-openshift-default-75c98666c9-s6dfm"
Jul 16 11:37:16.987884 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:37:16.987863    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/44d16024-1df9-40b0-9b95-ba31ee7b552c-istio-token\") pod \"e2e-mt-41466a73-openshift-default-75c98666c9-s6dfm\" (UID: \"44d16024-1df9-40b0-9b95-ba31ee7b552c\") " pod="openshift-ingress/e2e-mt-41466a73-openshift-default-75c98666c9-s6dfm"
Jul 16 11:37:16.987978 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:37:16.987946    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-686km\" (UniqueName: \"kubernetes.io/projected/44d16024-1df9-40b0-9b95-ba31ee7b552c-kube-api-access-686km\") pod \"e2e-mt-41466a73-openshift-default-75c98666c9-s6dfm\" (UID: \"44d16024-1df9-40b0-9b95-ba31ee7b552c\") " pod="openshift-ingress/e2e-mt-41466a73-openshift-default-75c98666c9-s6dfm"
Jul 16 11:37:17.133312 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:37:17.133259    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-41466a73-openshift-default-75c98666c9-s6dfm"
Jul 16 11:37:17.273213 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:37:17.273191    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-41466a73-openshift-default-75c98666c9-s6dfm"]
Jul 16 11:37:17.275234 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:37:17.275208    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod44d16024_1df9_40b0_9b95_ba31ee7b552c.slice/crio-c89c4ec5d63603b9427fb4c251d14d21a6c50f5f9046c9d6f4dfb02ce775656f WatchSource:0}: Error finding container c89c4ec5d63603b9427fb4c251d14d21a6c50f5f9046c9d6f4dfb02ce775656f: Status 404 returned error can't find the container with id c89c4ec5d63603b9427fb4c251d14d21a6c50f5f9046c9d6f4dfb02ce775656f
Jul 16 11:37:17.277385 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:37:17.277354    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 16 11:37:17.277499 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:37:17.277427    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 16 11:37:17.277499 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:37:17.277476    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 16 11:37:17.381489 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:37:17.381446    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-41466a73-openshift-default-75c98666c9-s6dfm" event={"ID":"44d16024-1df9-40b0-9b95-ba31ee7b552c","Type":"ContainerStarted","Data":"26119537f69c300ac7f81fbd89b53edc3efbeb654813ba0f71529a8a7035854a"}
Jul 16 11:37:17.381884 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:37:17.381516    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-41466a73-openshift-default-75c98666c9-s6dfm" event={"ID":"44d16024-1df9-40b0-9b95-ba31ee7b552c","Type":"ContainerStarted","Data":"c89c4ec5d63603b9427fb4c251d14d21a6c50f5f9046c9d6f4dfb02ce775656f"}
Jul 16 11:37:17.402399 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:37:17.402282    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-41466a73-openshift-default-75c98666c9-s6dfm" podStartSLOduration=1.402264403 podStartE2EDuration="1.402264403s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 11:37:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 11:37:17.401656576 +0000 UTC m=+1737.773193624" watchObservedRunningTime="2026-07-16 11:37:17.402264403 +0000 UTC m=+1737.773801440"
Jul 16 11:37:17.442504 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:37:17.442473    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:37:18.134062 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:37:18.134030    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-41466a73-openshift-default-75c98666c9-s6dfm"
Jul 16 11:37:18.138711 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:37:18.138687    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-41466a73-openshift-default-75c98666c9-s6dfm"
Jul 16 11:37:18.386760 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:37:18.386682    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-41466a73-openshift-default-75c98666c9-s6dfm"
Jul 16 11:37:18.387545 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:37:18.387530    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-41466a73-openshift-default-75c98666c9-s6dfm"
Jul 16 11:37:18.664360 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:37:18.664270    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:37:18.768678 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:37:18.768647    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:37:18.946974 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:37:18.946896    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:37:19.237035 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:37:19.236952    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:37:19.524872 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:37:19.524842    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:37:19.608742 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:37:19.608688    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:37:24.194325 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:37:24.194289    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:37:24.870554 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:37:24.870521    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:37:24.970819 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:37:24.970767    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:37:25.342024 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:37:25.341995    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:37:31.249979 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:37:31.249948    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:37:31.318734 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:37:31.318706    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:37:31.975229 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:37:31.975202    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:37:34.427971 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:37:34.427913    2564 patch_prober.go:28] interesting pod/e2e-mt-41466a73-openshift-default-75c98666c9-s6dfm container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.57:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 16 11:37:34.428360 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:37:34.428010    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-41466a73-openshift-default-75c98666c9-s6dfm" podUID="44d16024-1df9-40b0-9b95-ba31ee7b552c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.57:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 16 11:37:35.476277 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:37:35.476248    2564 generic.go:356] "Generic (PLEG): container finished" podID="44d16024-1df9-40b0-9b95-ba31ee7b552c" containerID="26119537f69c300ac7f81fbd89b53edc3efbeb654813ba0f71529a8a7035854a" exitCode=0
Jul 16 11:37:35.476691 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:37:35.476292    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-41466a73-openshift-default-75c98666c9-s6dfm" event={"ID":"44d16024-1df9-40b0-9b95-ba31ee7b552c","Type":"ContainerDied","Data":"26119537f69c300ac7f81fbd89b53edc3efbeb654813ba0f71529a8a7035854a"}
Jul 16 11:37:35.476691 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:37:35.476685    2564 scope.go:117] "RemoveContainer" containerID="26119537f69c300ac7f81fbd89b53edc3efbeb654813ba0f71529a8a7035854a"
Jul 16 11:37:35.477754 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:37:35.477724    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 16 11:37:35.477856 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:37:35.477815    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 16 11:37:35.477856 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:37:35.477849    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 16 11:37:36.484152 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:37:36.484120    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-41466a73-openshift-default-75c98666c9-s6dfm" event={"ID":"44d16024-1df9-40b0-9b95-ba31ee7b552c","Type":"ContainerStarted","Data":"4c22ef9fb3c2e4c951f93b6771a775dd634db097c8e91b5cc10b0b175451d34f"}
Jul 16 11:37:37.133926 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:37:37.133887    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-41466a73-openshift-default-75c98666c9-s6dfm"
Jul 16 11:37:37.134150 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:37:37.134128    2564 patch_prober.go:28] interesting pod/e2e-mt-41466a73-openshift-default-75c98666c9-s6dfm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused" start-of-body=
Jul 16 11:37:37.134232 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:37:37.134184    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-41466a73-openshift-default-75c98666c9-s6dfm" podUID="44d16024-1df9-40b0-9b95-ba31ee7b552c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused"
Jul 16 11:37:37.365022 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:37:37.364988    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:37:38.134161 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:37:38.134127    2564 patch_prober.go:28] interesting pod/e2e-mt-41466a73-openshift-default-75c98666c9-s6dfm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused" start-of-body=
Jul 16 11:37:38.134529 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:37:38.134187    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-41466a73-openshift-default-75c98666c9-s6dfm" podUID="44d16024-1df9-40b0-9b95-ba31ee7b552c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused"
Jul 16 11:37:38.240879 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:37:38.240850    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:37:39.134482 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:37:39.134453    2564 patch_prober.go:28] interesting pod/e2e-mt-41466a73-openshift-default-75c98666c9-s6dfm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused" start-of-body=
Jul 16 11:37:39.134874 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:37:39.134500    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-41466a73-openshift-default-75c98666c9-s6dfm" podUID="44d16024-1df9-40b0-9b95-ba31ee7b552c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused"
Jul 16 11:37:40.133966 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:37:40.133933    2564 patch_prober.go:28] interesting pod/e2e-mt-41466a73-openshift-default-75c98666c9-s6dfm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused" start-of-body=
Jul 16 11:37:40.134139 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:37:40.133983    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-41466a73-openshift-default-75c98666c9-s6dfm" podUID="44d16024-1df9-40b0-9b95-ba31ee7b552c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused"
Jul 16 11:37:41.137587 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:37:41.137562    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-41466a73-openshift-default-75c98666c9-s6dfm"
Jul 16 11:37:41.137997 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:37:41.137802    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-41466a73-openshift-default-75c98666c9-s6dfm"
Jul 16 11:37:41.138577 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:37:41.138555    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-41466a73-openshift-default-75c98666c9-s6dfm"
Jul 16 11:37:43.957602 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:37:43.957572    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:37:44.017376 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:37:44.017347    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:37:44.209635 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:37:44.209546    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-41466a73-openshift-default-75c98666c9-s6dfm"]
Jul 16 11:37:44.209843 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:37:44.209816    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-41466a73-openshift-default-75c98666c9-s6dfm" podUID="44d16024-1df9-40b0-9b95-ba31ee7b552c" containerName="istio-proxy" containerID="cri-o://4c22ef9fb3c2e4c951f93b6771a775dd634db097c8e91b5cc10b0b175451d34f" gracePeriod=30
Jul 16 11:37:44.232421 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:37:44.232397    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:37:44.462289 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:37:44.462217    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:37:44.587221 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:37:44.587193    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:37:44.683558 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:37:44.683530    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:37:44.822503 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:37:44.822477    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:37:49.465242 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:37:49.465217    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-41466a73-openshift-default-75c98666c9-s6dfm"
Jul 16 11:37:49.551188 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:37:49.551163    2564 generic.go:356] "Generic (PLEG): container finished" podID="44d16024-1df9-40b0-9b95-ba31ee7b552c" containerID="4c22ef9fb3c2e4c951f93b6771a775dd634db097c8e91b5cc10b0b175451d34f" exitCode=0
Jul 16 11:37:49.551319 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:37:49.551212    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-41466a73-openshift-default-75c98666c9-s6dfm"
Jul 16 11:37:49.551319 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:37:49.551210    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-41466a73-openshift-default-75c98666c9-s6dfm" event={"ID":"44d16024-1df9-40b0-9b95-ba31ee7b552c","Type":"ContainerDied","Data":"4c22ef9fb3c2e4c951f93b6771a775dd634db097c8e91b5cc10b0b175451d34f"}
Jul 16 11:37:49.551423 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:37:49.551332    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-41466a73-openshift-default-75c98666c9-s6dfm" event={"ID":"44d16024-1df9-40b0-9b95-ba31ee7b552c","Type":"ContainerDied","Data":"c89c4ec5d63603b9427fb4c251d14d21a6c50f5f9046c9d6f4dfb02ce775656f"}
Jul 16 11:37:49.552237 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:37:49.551359    2564 scope.go:117] "RemoveContainer" containerID="4c22ef9fb3c2e4c951f93b6771a775dd634db097c8e91b5cc10b0b175451d34f"
Jul 16 11:37:49.561026 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:37:49.561006    2564 scope.go:117] "RemoveContainer" containerID="26119537f69c300ac7f81fbd89b53edc3efbeb654813ba0f71529a8a7035854a"
Jul 16 11:37:49.569113 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:37:49.569099    2564 scope.go:117] "RemoveContainer" containerID="4c22ef9fb3c2e4c951f93b6771a775dd634db097c8e91b5cc10b0b175451d34f"
Jul 16 11:37:49.569371 ip-10-0-135-184 kubenswrapper[2564]: E0716 11:37:49.569350    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4c22ef9fb3c2e4c951f93b6771a775dd634db097c8e91b5cc10b0b175451d34f\": container with ID starting with 4c22ef9fb3c2e4c951f93b6771a775dd634db097c8e91b5cc10b0b175451d34f not found: ID does not exist" containerID="4c22ef9fb3c2e4c951f93b6771a775dd634db097c8e91b5cc10b0b175451d34f"
Jul 16 11:37:49.569414 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:37:49.569372    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4c22ef9fb3c2e4c951f93b6771a775dd634db097c8e91b5cc10b0b175451d34f"} err="failed to get container status \"4c22ef9fb3c2e4c951f93b6771a775dd634db097c8e91b5cc10b0b175451d34f\": rpc error: code = NotFound desc = could not find container \"4c22ef9fb3c2e4c951f93b6771a775dd634db097c8e91b5cc10b0b175451d34f\": container with ID starting with 4c22ef9fb3c2e4c951f93b6771a775dd634db097c8e91b5cc10b0b175451d34f not found: ID does not exist"
Jul 16 11:37:49.569414 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:37:49.569388    2564 scope.go:117] "RemoveContainer" containerID="26119537f69c300ac7f81fbd89b53edc3efbeb654813ba0f71529a8a7035854a"
Jul 16 11:37:49.569639 ip-10-0-135-184 kubenswrapper[2564]: E0716 11:37:49.569622    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"26119537f69c300ac7f81fbd89b53edc3efbeb654813ba0f71529a8a7035854a\": container with ID starting with 26119537f69c300ac7f81fbd89b53edc3efbeb654813ba0f71529a8a7035854a not found: ID does not exist" containerID="26119537f69c300ac7f81fbd89b53edc3efbeb654813ba0f71529a8a7035854a"
Jul 16 11:37:49.569693 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:37:49.569648    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"26119537f69c300ac7f81fbd89b53edc3efbeb654813ba0f71529a8a7035854a"} err="failed to get container status \"26119537f69c300ac7f81fbd89b53edc3efbeb654813ba0f71529a8a7035854a\": rpc error: code = NotFound desc = could not find container \"26119537f69c300ac7f81fbd89b53edc3efbeb654813ba0f71529a8a7035854a\": container with ID starting with 26119537f69c300ac7f81fbd89b53edc3efbeb654813ba0f71529a8a7035854a not found: ID does not exist"
Jul 16 11:37:49.593909 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:37:49.593889    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/44d16024-1df9-40b0-9b95-ba31ee7b552c-istio-envoy\") pod \"44d16024-1df9-40b0-9b95-ba31ee7b552c\" (UID: \"44d16024-1df9-40b0-9b95-ba31ee7b552c\") "
Jul 16 11:37:49.593993 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:37:49.593916    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-686km\" (UniqueName: \"kubernetes.io/projected/44d16024-1df9-40b0-9b95-ba31ee7b552c-kube-api-access-686km\") pod \"44d16024-1df9-40b0-9b95-ba31ee7b552c\" (UID: \"44d16024-1df9-40b0-9b95-ba31ee7b552c\") "
Jul 16 11:37:49.593993 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:37:49.593938    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/44d16024-1df9-40b0-9b95-ba31ee7b552c-istio-data\") pod \"44d16024-1df9-40b0-9b95-ba31ee7b552c\" (UID: \"44d16024-1df9-40b0-9b95-ba31ee7b552c\") "
Jul 16 11:37:49.593993 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:37:49.593964    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/44d16024-1df9-40b0-9b95-ba31ee7b552c-credential-socket\") pod \"44d16024-1df9-40b0-9b95-ba31ee7b552c\" (UID: \"44d16024-1df9-40b0-9b95-ba31ee7b552c\") "
Jul 16 11:37:49.594156 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:37:49.594086    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/44d16024-1df9-40b0-9b95-ba31ee7b552c-istiod-ca-cert\") pod \"44d16024-1df9-40b0-9b95-ba31ee7b552c\" (UID: \"44d16024-1df9-40b0-9b95-ba31ee7b552c\") "
Jul 16 11:37:49.594156 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:37:49.594117    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/44d16024-1df9-40b0-9b95-ba31ee7b552c-workload-socket\") pod \"44d16024-1df9-40b0-9b95-ba31ee7b552c\" (UID: \"44d16024-1df9-40b0-9b95-ba31ee7b552c\") "
Jul 16 11:37:49.594265 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:37:49.594244    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/44d16024-1df9-40b0-9b95-ba31ee7b552c-istio-podinfo\") pod \"44d16024-1df9-40b0-9b95-ba31ee7b552c\" (UID: \"44d16024-1df9-40b0-9b95-ba31ee7b552c\") "
Jul 16 11:37:49.594265 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:37:49.594250    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/44d16024-1df9-40b0-9b95-ba31ee7b552c-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "44d16024-1df9-40b0-9b95-ba31ee7b552c" (UID: "44d16024-1df9-40b0-9b95-ba31ee7b552c"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 11:37:49.594383 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:37:49.594297    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/44d16024-1df9-40b0-9b95-ba31ee7b552c-workload-certs\") pod \"44d16024-1df9-40b0-9b95-ba31ee7b552c\" (UID: \"44d16024-1df9-40b0-9b95-ba31ee7b552c\") "
Jul 16 11:37:49.594440 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:37:49.594379    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/44d16024-1df9-40b0-9b95-ba31ee7b552c-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "44d16024-1df9-40b0-9b95-ba31ee7b552c" (UID: "44d16024-1df9-40b0-9b95-ba31ee7b552c"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 11:37:49.594440 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:37:49.594386    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/44d16024-1df9-40b0-9b95-ba31ee7b552c-istio-token\") pod \"44d16024-1df9-40b0-9b95-ba31ee7b552c\" (UID: \"44d16024-1df9-40b0-9b95-ba31ee7b552c\") "
Jul 16 11:37:49.594548 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:37:49.594471    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/44d16024-1df9-40b0-9b95-ba31ee7b552c-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "44d16024-1df9-40b0-9b95-ba31ee7b552c" (UID: "44d16024-1df9-40b0-9b95-ba31ee7b552c"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 11:37:49.594751 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:37:49.594725    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/44d16024-1df9-40b0-9b95-ba31ee7b552c-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "44d16024-1df9-40b0-9b95-ba31ee7b552c" (UID: "44d16024-1df9-40b0-9b95-ba31ee7b552c"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 11:37:49.594885 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:37:49.594752    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/44d16024-1df9-40b0-9b95-ba31ee7b552c-istio-data" (OuterVolumeSpecName: "istio-data") pod "44d16024-1df9-40b0-9b95-ba31ee7b552c" (UID: "44d16024-1df9-40b0-9b95-ba31ee7b552c"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 11:37:49.595036 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:37:49.595016    2564 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/44d16024-1df9-40b0-9b95-ba31ee7b552c-istiod-ca-cert\") on node \"ip-10-0-135-184.ec2.internal\" DevicePath \"\""
Jul 16 11:37:49.595107 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:37:49.595040    2564 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/44d16024-1df9-40b0-9b95-ba31ee7b552c-workload-socket\") on node \"ip-10-0-135-184.ec2.internal\" DevicePath \"\""
Jul 16 11:37:49.595107 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:37:49.595055    2564 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/44d16024-1df9-40b0-9b95-ba31ee7b552c-workload-certs\") on node \"ip-10-0-135-184.ec2.internal\" DevicePath \"\""
Jul 16 11:37:49.595107 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:37:49.595070    2564 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/44d16024-1df9-40b0-9b95-ba31ee7b552c-istio-data\") on node \"ip-10-0-135-184.ec2.internal\" DevicePath \"\""
Jul 16 11:37:49.595107 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:37:49.595083    2564 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/44d16024-1df9-40b0-9b95-ba31ee7b552c-credential-socket\") on node \"ip-10-0-135-184.ec2.internal\" DevicePath \"\""
Jul 16 11:37:49.596127 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:37:49.596108    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/44d16024-1df9-40b0-9b95-ba31ee7b552c-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "44d16024-1df9-40b0-9b95-ba31ee7b552c" (UID: "44d16024-1df9-40b0-9b95-ba31ee7b552c"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 11:37:49.596338 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:37:49.596318    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/44d16024-1df9-40b0-9b95-ba31ee7b552c-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "44d16024-1df9-40b0-9b95-ba31ee7b552c" (UID: "44d16024-1df9-40b0-9b95-ba31ee7b552c"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 16 11:37:49.596490 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:37:49.596476    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/44d16024-1df9-40b0-9b95-ba31ee7b552c-kube-api-access-686km" (OuterVolumeSpecName: "kube-api-access-686km") pod "44d16024-1df9-40b0-9b95-ba31ee7b552c" (UID: "44d16024-1df9-40b0-9b95-ba31ee7b552c"). InnerVolumeSpecName "kube-api-access-686km". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 11:37:49.596575 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:37:49.596557    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/44d16024-1df9-40b0-9b95-ba31ee7b552c-istio-token" (OuterVolumeSpecName: "istio-token") pod "44d16024-1df9-40b0-9b95-ba31ee7b552c" (UID: "44d16024-1df9-40b0-9b95-ba31ee7b552c"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 11:37:49.696098 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:37:49.696073    2564 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/44d16024-1df9-40b0-9b95-ba31ee7b552c-istio-token\") on node \"ip-10-0-135-184.ec2.internal\" DevicePath \"\""
Jul 16 11:37:49.696098 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:37:49.696098    2564 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/44d16024-1df9-40b0-9b95-ba31ee7b552c-istio-envoy\") on node \"ip-10-0-135-184.ec2.internal\" DevicePath \"\""
Jul 16 11:37:49.696283 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:37:49.696111    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-686km\" (UniqueName: \"kubernetes.io/projected/44d16024-1df9-40b0-9b95-ba31ee7b552c-kube-api-access-686km\") on node \"ip-10-0-135-184.ec2.internal\" DevicePath \"\""
Jul 16 11:37:49.696283 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:37:49.696124    2564 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/44d16024-1df9-40b0-9b95-ba31ee7b552c-istio-podinfo\") on node \"ip-10-0-135-184.ec2.internal\" DevicePath \"\""
Jul 16 11:37:49.875547 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:37:49.875519    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-41466a73-openshift-default-75c98666c9-s6dfm"]
Jul 16 11:37:49.880800 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:37:49.880746    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-41466a73-openshift-default-75c98666c9-s6dfm"]
Jul 16 11:37:50.302659 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:37:50.302628    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="44d16024-1df9-40b0-9b95-ba31ee7b552c" path="/var/lib/kubelet/pods/44d16024-1df9-40b0-9b95-ba31ee7b552c/volumes"
Jul 16 11:37:50.716826 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:37:50.716679    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:37:50.835464 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:37:50.835400    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:37:50.918591 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:37:50.918566    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:37:51.078241 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:37:51.078208    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:37:57.133727 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:37:57.133693    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:37:57.194173 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:37:57.194144    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:38:04.813925 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:38:04.813892    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:38:04.914033 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:38:04.914003    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:38:05.013201 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:38:05.013175    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:38:05.732219 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:38:05.732164    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:38:05.829388 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:38:05.829343    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:38:05.929339 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:38:05.929311    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:38:07.346911 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:38:07.346881    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:38:13.207310 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:38:13.207232    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:38:13.265859 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:38:13.265832    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:38:13.866062 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:38:13.866029    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:38:20.078428 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:38:20.078398    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:38:20.190965 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:38:20.190929    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:38:20.278811 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:38:20.278759    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:38:20.281098 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:38:20.281075    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-lwmwf_4cb63124-522c-41e2-9d85-c2af29ac8eff/console-operator/1.log"
Jul 16 11:38:20.286507 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:38:20.286490    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-lwmwf_4cb63124-522c-41e2-9d85-c2af29ac8eff/console-operator/1.log"
Jul 16 11:38:20.288235 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:38:20.288219    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fchvw_aee7cbaf-a5e0-4e57-a9c1-504820f7f036/ovn-acl-logging/0.log"
Jul 16 11:38:20.293467 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:38:20.293452    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fchvw_aee7cbaf-a5e0-4e57-a9c1-504820f7f036/ovn-acl-logging/0.log"
Jul 16 11:38:23.625755 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:38:23.625727    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:38:23.725865 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:38:23.725833    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:38:30.830383 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:38:30.830348    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:38:31.121980 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:38:31.121903    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:38:52.395835 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:38:52.395802    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:38:58.146756 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:38:58.146717    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:38:58.215028 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:38:58.214996    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:38:58.716687 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:38:58.716659    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:38:59.003712 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:38:59.003685    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-a0660d-openshift-default-67db5b6559-pvx76"]
Jul 16 11:38:59.004155 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:38:59.004141    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="44d16024-1df9-40b0-9b95-ba31ee7b552c" containerName="istio-proxy"
Jul 16 11:38:59.004206 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:38:59.004156    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="44d16024-1df9-40b0-9b95-ba31ee7b552c" containerName="istio-proxy"
Jul 16 11:38:59.004206 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:38:59.004179    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="44d16024-1df9-40b0-9b95-ba31ee7b552c" containerName="istio-proxy"
Jul 16 11:38:59.004206 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:38:59.004184    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="44d16024-1df9-40b0-9b95-ba31ee7b552c" containerName="istio-proxy"
Jul 16 11:38:59.004302 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:38:59.004246    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="44d16024-1df9-40b0-9b95-ba31ee7b552c" containerName="istio-proxy"
Jul 16 11:38:59.004302 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:38:59.004256    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="44d16024-1df9-40b0-9b95-ba31ee7b552c" containerName="istio-proxy"
Jul 16 11:38:59.007352 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:38:59.007337    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-a0660d-openshift-default-67db5b6559-pvx76"
Jul 16 11:38:59.010236 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:38:59.010216    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-a0660d-openshift-default-dockercfg-552xv\""
Jul 16 11:38:59.023011 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:38:59.022989    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-a0660d-openshift-default-67db5b6559-pvx76"]
Jul 16 11:38:59.028912 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:38:59.028880    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:38:59.096263 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:38:59.096232    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3cdbc8e9-869a-470e-bedd-ba5c17074681-istiod-ca-cert\") pod \"e2e-inf-a-a0660d-openshift-default-67db5b6559-pvx76\" (UID: \"3cdbc8e9-869a-470e-bedd-ba5c17074681\") " pod="openshift-ingress/e2e-inf-a-a0660d-openshift-default-67db5b6559-pvx76"
Jul 16 11:38:59.096408 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:38:59.096269    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3cdbc8e9-869a-470e-bedd-ba5c17074681-workload-certs\") pod \"e2e-inf-a-a0660d-openshift-default-67db5b6559-pvx76\" (UID: \"3cdbc8e9-869a-470e-bedd-ba5c17074681\") " pod="openshift-ingress/e2e-inf-a-a0660d-openshift-default-67db5b6559-pvx76"
Jul 16 11:38:59.096408 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:38:59.096291    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3cdbc8e9-869a-470e-bedd-ba5c17074681-istio-envoy\") pod \"e2e-inf-a-a0660d-openshift-default-67db5b6559-pvx76\" (UID: \"3cdbc8e9-869a-470e-bedd-ba5c17074681\") " pod="openshift-ingress/e2e-inf-a-a0660d-openshift-default-67db5b6559-pvx76"
Jul 16 11:38:59.096408 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:38:59.096376    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3cdbc8e9-869a-470e-bedd-ba5c17074681-credential-socket\") pod \"e2e-inf-a-a0660d-openshift-default-67db5b6559-pvx76\" (UID: \"3cdbc8e9-869a-470e-bedd-ba5c17074681\") " pod="openshift-ingress/e2e-inf-a-a0660d-openshift-default-67db5b6559-pvx76"
Jul 16 11:38:59.096540 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:38:59.096420    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3cdbc8e9-869a-470e-bedd-ba5c17074681-workload-socket\") pod \"e2e-inf-a-a0660d-openshift-default-67db5b6559-pvx76\" (UID: \"3cdbc8e9-869a-470e-bedd-ba5c17074681\") " pod="openshift-ingress/e2e-inf-a-a0660d-openshift-default-67db5b6559-pvx76"
Jul 16 11:38:59.096540 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:38:59.096448    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3cdbc8e9-869a-470e-bedd-ba5c17074681-istio-data\") pod \"e2e-inf-a-a0660d-openshift-default-67db5b6559-pvx76\" (UID: \"3cdbc8e9-869a-470e-bedd-ba5c17074681\") " pod="openshift-ingress/e2e-inf-a-a0660d-openshift-default-67db5b6559-pvx76"
Jul 16 11:38:59.096540 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:38:59.096515    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3cdbc8e9-869a-470e-bedd-ba5c17074681-istio-token\") pod \"e2e-inf-a-a0660d-openshift-default-67db5b6559-pvx76\" (UID: \"3cdbc8e9-869a-470e-bedd-ba5c17074681\") " pod="openshift-ingress/e2e-inf-a-a0660d-openshift-default-67db5b6559-pvx76"
Jul 16 11:38:59.096695 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:38:59.096554    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3cdbc8e9-869a-470e-bedd-ba5c17074681-istio-podinfo\") pod \"e2e-inf-a-a0660d-openshift-default-67db5b6559-pvx76\" (UID: \"3cdbc8e9-869a-470e-bedd-ba5c17074681\") " pod="openshift-ingress/e2e-inf-a-a0660d-openshift-default-67db5b6559-pvx76"
Jul 16 11:38:59.096695 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:38:59.096578    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sb72c\" (UniqueName: \"kubernetes.io/projected/3cdbc8e9-869a-470e-bedd-ba5c17074681-kube-api-access-sb72c\") pod \"e2e-inf-a-a0660d-openshift-default-67db5b6559-pvx76\" (UID: \"3cdbc8e9-869a-470e-bedd-ba5c17074681\") " pod="openshift-ingress/e2e-inf-a-a0660d-openshift-default-67db5b6559-pvx76"
Jul 16 11:38:59.197380 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:38:59.197346    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3cdbc8e9-869a-470e-bedd-ba5c17074681-workload-socket\") pod \"e2e-inf-a-a0660d-openshift-default-67db5b6559-pvx76\" (UID: \"3cdbc8e9-869a-470e-bedd-ba5c17074681\") " pod="openshift-ingress/e2e-inf-a-a0660d-openshift-default-67db5b6559-pvx76"
Jul 16 11:38:59.197380 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:38:59.197383    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3cdbc8e9-869a-470e-bedd-ba5c17074681-istio-data\") pod \"e2e-inf-a-a0660d-openshift-default-67db5b6559-pvx76\" (UID: \"3cdbc8e9-869a-470e-bedd-ba5c17074681\") " pod="openshift-ingress/e2e-inf-a-a0660d-openshift-default-67db5b6559-pvx76"
Jul 16 11:38:59.197896 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:38:59.197427    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3cdbc8e9-869a-470e-bedd-ba5c17074681-istio-token\") pod \"e2e-inf-a-a0660d-openshift-default-67db5b6559-pvx76\" (UID: \"3cdbc8e9-869a-470e-bedd-ba5c17074681\") " pod="openshift-ingress/e2e-inf-a-a0660d-openshift-default-67db5b6559-pvx76"
Jul 16 11:38:59.197896 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:38:59.197489    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3cdbc8e9-869a-470e-bedd-ba5c17074681-istio-podinfo\") pod \"e2e-inf-a-a0660d-openshift-default-67db5b6559-pvx76\" (UID: \"3cdbc8e9-869a-470e-bedd-ba5c17074681\") " pod="openshift-ingress/e2e-inf-a-a0660d-openshift-default-67db5b6559-pvx76"
Jul 16 11:38:59.197896 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:38:59.197530    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sb72c\" (UniqueName: \"kubernetes.io/projected/3cdbc8e9-869a-470e-bedd-ba5c17074681-kube-api-access-sb72c\") pod \"e2e-inf-a-a0660d-openshift-default-67db5b6559-pvx76\" (UID: \"3cdbc8e9-869a-470e-bedd-ba5c17074681\") " pod="openshift-ingress/e2e-inf-a-a0660d-openshift-default-67db5b6559-pvx76"
Jul 16 11:38:59.197896 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:38:59.197602    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3cdbc8e9-869a-470e-bedd-ba5c17074681-istiod-ca-cert\") pod \"e2e-inf-a-a0660d-openshift-default-67db5b6559-pvx76\" (UID: \"3cdbc8e9-869a-470e-bedd-ba5c17074681\") " pod="openshift-ingress/e2e-inf-a-a0660d-openshift-default-67db5b6559-pvx76"
Jul 16 11:38:59.197896 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:38:59.197733    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3cdbc8e9-869a-470e-bedd-ba5c17074681-workload-socket\") pod \"e2e-inf-a-a0660d-openshift-default-67db5b6559-pvx76\" (UID: \"3cdbc8e9-869a-470e-bedd-ba5c17074681\") " pod="openshift-ingress/e2e-inf-a-a0660d-openshift-default-67db5b6559-pvx76"
Jul 16 11:38:59.197896 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:38:59.197731    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3cdbc8e9-869a-470e-bedd-ba5c17074681-workload-certs\") pod \"e2e-inf-a-a0660d-openshift-default-67db5b6559-pvx76\" (UID: \"3cdbc8e9-869a-470e-bedd-ba5c17074681\") " pod="openshift-ingress/e2e-inf-a-a0660d-openshift-default-67db5b6559-pvx76"
Jul 16 11:38:59.197896 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:38:59.197815    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3cdbc8e9-869a-470e-bedd-ba5c17074681-istio-envoy\") pod \"e2e-inf-a-a0660d-openshift-default-67db5b6559-pvx76\" (UID: \"3cdbc8e9-869a-470e-bedd-ba5c17074681\") " pod="openshift-ingress/e2e-inf-a-a0660d-openshift-default-67db5b6559-pvx76"
Jul 16 11:38:59.197896 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:38:59.197876    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3cdbc8e9-869a-470e-bedd-ba5c17074681-credential-socket\") pod \"e2e-inf-a-a0660d-openshift-default-67db5b6559-pvx76\" (UID: \"3cdbc8e9-869a-470e-bedd-ba5c17074681\") " pod="openshift-ingress/e2e-inf-a-a0660d-openshift-default-67db5b6559-pvx76"
Jul 16 11:38:59.198256 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:38:59.197952    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3cdbc8e9-869a-470e-bedd-ba5c17074681-istio-data\") pod \"e2e-inf-a-a0660d-openshift-default-67db5b6559-pvx76\" (UID: \"3cdbc8e9-869a-470e-bedd-ba5c17074681\") " pod="openshift-ingress/e2e-inf-a-a0660d-openshift-default-67db5b6559-pvx76"
Jul 16 11:38:59.198256 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:38:59.198012    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3cdbc8e9-869a-470e-bedd-ba5c17074681-workload-certs\") pod \"e2e-inf-a-a0660d-openshift-default-67db5b6559-pvx76\" (UID: \"3cdbc8e9-869a-470e-bedd-ba5c17074681\") " pod="openshift-ingress/e2e-inf-a-a0660d-openshift-default-67db5b6559-pvx76"
Jul 16 11:38:59.198256 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:38:59.198152    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3cdbc8e9-869a-470e-bedd-ba5c17074681-credential-socket\") pod \"e2e-inf-a-a0660d-openshift-default-67db5b6559-pvx76\" (UID: \"3cdbc8e9-869a-470e-bedd-ba5c17074681\") " pod="openshift-ingress/e2e-inf-a-a0660d-openshift-default-67db5b6559-pvx76"
Jul 16 11:38:59.198413 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:38:59.198308    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3cdbc8e9-869a-470e-bedd-ba5c17074681-istiod-ca-cert\") pod \"e2e-inf-a-a0660d-openshift-default-67db5b6559-pvx76\" (UID: \"3cdbc8e9-869a-470e-bedd-ba5c17074681\") " pod="openshift-ingress/e2e-inf-a-a0660d-openshift-default-67db5b6559-pvx76"
Jul 16 11:38:59.199957 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:38:59.199933    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3cdbc8e9-869a-470e-bedd-ba5c17074681-istio-envoy\") pod \"e2e-inf-a-a0660d-openshift-default-67db5b6559-pvx76\" (UID: \"3cdbc8e9-869a-470e-bedd-ba5c17074681\") " pod="openshift-ingress/e2e-inf-a-a0660d-openshift-default-67db5b6559-pvx76"
Jul 16 11:38:59.200124 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:38:59.200109    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3cdbc8e9-869a-470e-bedd-ba5c17074681-istio-podinfo\") pod \"e2e-inf-a-a0660d-openshift-default-67db5b6559-pvx76\" (UID: \"3cdbc8e9-869a-470e-bedd-ba5c17074681\") " pod="openshift-ingress/e2e-inf-a-a0660d-openshift-default-67db5b6559-pvx76"
Jul 16 11:38:59.205073 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:38:59.205055    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3cdbc8e9-869a-470e-bedd-ba5c17074681-istio-token\") pod \"e2e-inf-a-a0660d-openshift-default-67db5b6559-pvx76\" (UID: \"3cdbc8e9-869a-470e-bedd-ba5c17074681\") " pod="openshift-ingress/e2e-inf-a-a0660d-openshift-default-67db5b6559-pvx76"
Jul 16 11:38:59.205486 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:38:59.205466    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sb72c\" (UniqueName: \"kubernetes.io/projected/3cdbc8e9-869a-470e-bedd-ba5c17074681-kube-api-access-sb72c\") pod \"e2e-inf-a-a0660d-openshift-default-67db5b6559-pvx76\" (UID: \"3cdbc8e9-869a-470e-bedd-ba5c17074681\") " pod="openshift-ingress/e2e-inf-a-a0660d-openshift-default-67db5b6559-pvx76"
Jul 16 11:38:59.317967 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:38:59.317885    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-a0660d-openshift-default-67db5b6559-pvx76"
Jul 16 11:38:59.360843 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:38:59.360762    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:38:59.461557 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:38:59.461531    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-a0660d-openshift-default-67db5b6559-pvx76"]
Jul 16 11:38:59.463383 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:38:59.463349    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3cdbc8e9_869a_470e_bedd_ba5c17074681.slice/crio-e0d224ae03b3fd2f4ec0b11d1a49d26b6d7ff50709c200e05fc8395fc058ee91 WatchSource:0}: Error finding container e0d224ae03b3fd2f4ec0b11d1a49d26b6d7ff50709c200e05fc8395fc058ee91: Status 404 returned error can't find the container with id e0d224ae03b3fd2f4ec0b11d1a49d26b6d7ff50709c200e05fc8395fc058ee91
Jul 16 11:38:59.465559 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:38:59.465527    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 16 11:38:59.465623 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:38:59.465590    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 16 11:38:59.465623 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:38:59.465617    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 16 11:38:59.912042 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:38:59.912010    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-a0660d-openshift-default-67db5b6559-pvx76" event={"ID":"3cdbc8e9-869a-470e-bedd-ba5c17074681","Type":"ContainerStarted","Data":"44843015aac1e1eb8d51675cb1780ee674e122915cd05b71dcadffb5624c6a6c"}
Jul 16 11:38:59.912211 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:38:59.912065    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-a0660d-openshift-default-67db5b6559-pvx76" event={"ID":"3cdbc8e9-869a-470e-bedd-ba5c17074681","Type":"ContainerStarted","Data":"e0d224ae03b3fd2f4ec0b11d1a49d26b6d7ff50709c200e05fc8395fc058ee91"}
Jul 16 11:38:59.933725 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:38:59.933677    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-a0660d-openshift-default-67db5b6559-pvx76" podStartSLOduration=1.933660873 podStartE2EDuration="1.933660873s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 11:38:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 11:38:59.932249008 +0000 UTC m=+1840.303786044" watchObservedRunningTime="2026-07-16 11:38:59.933660873 +0000 UTC m=+1840.305197908"
Jul 16 11:39:00.318390 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:39:00.318360    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-a0660d-openshift-default-67db5b6559-pvx76"
Jul 16 11:39:00.323295 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:39:00.323274    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-a0660d-openshift-default-67db5b6559-pvx76"
Jul 16 11:39:00.890923 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:39:00.890880    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:39:00.918273 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:39:00.918250    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-a0660d-openshift-default-67db5b6559-pvx76"
Jul 16 11:39:00.919288 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:39:00.919271    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-a0660d-openshift-default-67db5b6559-pvx76"
Jul 16 11:39:00.958108 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:39:00.958076    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:39:01.263906 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:39:01.263874    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:39:01.438608 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:39:01.438560    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:39:01.970999 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:39:01.970971    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:39:02.070399 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:39:02.070367    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:39:06.360471 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:39:06.360442    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:39:06.720138 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:39:06.720058    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:39:06.971286 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:39:06.971207    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-ca07b2-openshift-default-7c6464b649-548ft"]
Jul 16 11:39:06.976171 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:39:06.976149    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-ca07b2-openshift-default-7c6464b649-548ft"
Jul 16 11:39:06.978396 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:39:06.978378    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-ca07b2-openshift-default-dockercfg-nqhq8\""
Jul 16 11:39:06.989345 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:39:06.989323    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-ca07b2-openshift-default-7c6464b649-548ft"]
Jul 16 11:39:07.007941 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:39:07.007919    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:39:07.071192 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:39:07.071162    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cc430a13-3b55-48d6-9948-06b603571fc4-istio-data\") pod \"e2e-inf-b-ca07b2-openshift-default-7c6464b649-548ft\" (UID: \"cc430a13-3b55-48d6-9948-06b603571fc4\") " pod="openshift-ingress/e2e-inf-b-ca07b2-openshift-default-7c6464b649-548ft"
Jul 16 11:39:07.071368 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:39:07.071216    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cc430a13-3b55-48d6-9948-06b603571fc4-istio-envoy\") pod \"e2e-inf-b-ca07b2-openshift-default-7c6464b649-548ft\" (UID: \"cc430a13-3b55-48d6-9948-06b603571fc4\") " pod="openshift-ingress/e2e-inf-b-ca07b2-openshift-default-7c6464b649-548ft"
Jul 16 11:39:07.071368 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:39:07.071246    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cc430a13-3b55-48d6-9948-06b603571fc4-istiod-ca-cert\") pod \"e2e-inf-b-ca07b2-openshift-default-7c6464b649-548ft\" (UID: \"cc430a13-3b55-48d6-9948-06b603571fc4\") " pod="openshift-ingress/e2e-inf-b-ca07b2-openshift-default-7c6464b649-548ft"
Jul 16 11:39:07.071368 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:39:07.071303    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xzrr9\" (UniqueName: \"kubernetes.io/projected/cc430a13-3b55-48d6-9948-06b603571fc4-kube-api-access-xzrr9\") pod \"e2e-inf-b-ca07b2-openshift-default-7c6464b649-548ft\" (UID: \"cc430a13-3b55-48d6-9948-06b603571fc4\") " pod="openshift-ingress/e2e-inf-b-ca07b2-openshift-default-7c6464b649-548ft"
Jul 16 11:39:07.071368 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:39:07.071353    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cc430a13-3b55-48d6-9948-06b603571fc4-workload-socket\") pod \"e2e-inf-b-ca07b2-openshift-default-7c6464b649-548ft\" (UID: \"cc430a13-3b55-48d6-9948-06b603571fc4\") " pod="openshift-ingress/e2e-inf-b-ca07b2-openshift-default-7c6464b649-548ft"
Jul 16 11:39:07.071607 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:39:07.071382    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cc430a13-3b55-48d6-9948-06b603571fc4-istio-podinfo\") pod \"e2e-inf-b-ca07b2-openshift-default-7c6464b649-548ft\" (UID: \"cc430a13-3b55-48d6-9948-06b603571fc4\") " pod="openshift-ingress/e2e-inf-b-ca07b2-openshift-default-7c6464b649-548ft"
Jul 16 11:39:07.071607 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:39:07.071412    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cc430a13-3b55-48d6-9948-06b603571fc4-credential-socket\") pod \"e2e-inf-b-ca07b2-openshift-default-7c6464b649-548ft\" (UID: \"cc430a13-3b55-48d6-9948-06b603571fc4\") " pod="openshift-ingress/e2e-inf-b-ca07b2-openshift-default-7c6464b649-548ft"
Jul 16 11:39:07.071607 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:39:07.071441    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cc430a13-3b55-48d6-9948-06b603571fc4-istio-token\") pod \"e2e-inf-b-ca07b2-openshift-default-7c6464b649-548ft\" (UID: \"cc430a13-3b55-48d6-9948-06b603571fc4\") " pod="openshift-ingress/e2e-inf-b-ca07b2-openshift-default-7c6464b649-548ft"
Jul 16 11:39:07.071607 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:39:07.071479    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cc430a13-3b55-48d6-9948-06b603571fc4-workload-certs\") pod \"e2e-inf-b-ca07b2-openshift-default-7c6464b649-548ft\" (UID: \"cc430a13-3b55-48d6-9948-06b603571fc4\") " pod="openshift-ingress/e2e-inf-b-ca07b2-openshift-default-7c6464b649-548ft"
Jul 16 11:39:07.172701 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:39:07.172672    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cc430a13-3b55-48d6-9948-06b603571fc4-istio-data\") pod \"e2e-inf-b-ca07b2-openshift-default-7c6464b649-548ft\" (UID: \"cc430a13-3b55-48d6-9948-06b603571fc4\") " pod="openshift-ingress/e2e-inf-b-ca07b2-openshift-default-7c6464b649-548ft"
Jul 16 11:39:07.172884 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:39:07.172726    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cc430a13-3b55-48d6-9948-06b603571fc4-istio-envoy\") pod \"e2e-inf-b-ca07b2-openshift-default-7c6464b649-548ft\" (UID: \"cc430a13-3b55-48d6-9948-06b603571fc4\") " pod="openshift-ingress/e2e-inf-b-ca07b2-openshift-default-7c6464b649-548ft"
Jul 16 11:39:07.172884 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:39:07.172757    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cc430a13-3b55-48d6-9948-06b603571fc4-istiod-ca-cert\") pod \"e2e-inf-b-ca07b2-openshift-default-7c6464b649-548ft\" (UID: \"cc430a13-3b55-48d6-9948-06b603571fc4\") " pod="openshift-ingress/e2e-inf-b-ca07b2-openshift-default-7c6464b649-548ft"
Jul 16 11:39:07.172884 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:39:07.172840    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xzrr9\" (UniqueName: \"kubernetes.io/projected/cc430a13-3b55-48d6-9948-06b603571fc4-kube-api-access-xzrr9\") pod \"e2e-inf-b-ca07b2-openshift-default-7c6464b649-548ft\" (UID: \"cc430a13-3b55-48d6-9948-06b603571fc4\") " pod="openshift-ingress/e2e-inf-b-ca07b2-openshift-default-7c6464b649-548ft"
Jul 16 11:39:07.173046 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:39:07.172899    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cc430a13-3b55-48d6-9948-06b603571fc4-workload-socket\") pod \"e2e-inf-b-ca07b2-openshift-default-7c6464b649-548ft\" (UID: \"cc430a13-3b55-48d6-9948-06b603571fc4\") " pod="openshift-ingress/e2e-inf-b-ca07b2-openshift-default-7c6464b649-548ft"
Jul 16 11:39:07.173046 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:39:07.172931    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cc430a13-3b55-48d6-9948-06b603571fc4-istio-podinfo\") pod \"e2e-inf-b-ca07b2-openshift-default-7c6464b649-548ft\" (UID: \"cc430a13-3b55-48d6-9948-06b603571fc4\") " pod="openshift-ingress/e2e-inf-b-ca07b2-openshift-default-7c6464b649-548ft"
Jul 16 11:39:07.173046 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:39:07.172958    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cc430a13-3b55-48d6-9948-06b603571fc4-credential-socket\") pod \"e2e-inf-b-ca07b2-openshift-default-7c6464b649-548ft\" (UID: \"cc430a13-3b55-48d6-9948-06b603571fc4\") " pod="openshift-ingress/e2e-inf-b-ca07b2-openshift-default-7c6464b649-548ft"
Jul 16 11:39:07.173046 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:39:07.172985    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cc430a13-3b55-48d6-9948-06b603571fc4-istio-token\") pod \"e2e-inf-b-ca07b2-openshift-default-7c6464b649-548ft\" (UID: \"cc430a13-3b55-48d6-9948-06b603571fc4\") " pod="openshift-ingress/e2e-inf-b-ca07b2-openshift-default-7c6464b649-548ft"
Jul 16 11:39:07.173247 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:39:07.173205    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cc430a13-3b55-48d6-9948-06b603571fc4-workload-certs\") pod \"e2e-inf-b-ca07b2-openshift-default-7c6464b649-548ft\" (UID: \"cc430a13-3b55-48d6-9948-06b603571fc4\") " pod="openshift-ingress/e2e-inf-b-ca07b2-openshift-default-7c6464b649-548ft"
Jul 16 11:39:07.173299 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:39:07.173238    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cc430a13-3b55-48d6-9948-06b603571fc4-workload-socket\") pod \"e2e-inf-b-ca07b2-openshift-default-7c6464b649-548ft\" (UID: \"cc430a13-3b55-48d6-9948-06b603571fc4\") " pod="openshift-ingress/e2e-inf-b-ca07b2-openshift-default-7c6464b649-548ft"
Jul 16 11:39:07.173355 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:39:07.173315    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cc430a13-3b55-48d6-9948-06b603571fc4-credential-socket\") pod \"e2e-inf-b-ca07b2-openshift-default-7c6464b649-548ft\" (UID: \"cc430a13-3b55-48d6-9948-06b603571fc4\") " pod="openshift-ingress/e2e-inf-b-ca07b2-openshift-default-7c6464b649-548ft"
Jul 16 11:39:07.173438 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:39:07.173414    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cc430a13-3b55-48d6-9948-06b603571fc4-istio-data\") pod \"e2e-inf-b-ca07b2-openshift-default-7c6464b649-548ft\" (UID: \"cc430a13-3b55-48d6-9948-06b603571fc4\") " pod="openshift-ingress/e2e-inf-b-ca07b2-openshift-default-7c6464b649-548ft"
Jul 16 11:39:07.173545 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:39:07.173517    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cc430a13-3b55-48d6-9948-06b603571fc4-istiod-ca-cert\") pod \"e2e-inf-b-ca07b2-openshift-default-7c6464b649-548ft\" (UID: \"cc430a13-3b55-48d6-9948-06b603571fc4\") " pod="openshift-ingress/e2e-inf-b-ca07b2-openshift-default-7c6464b649-548ft"
Jul 16 11:39:07.173545 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:39:07.173536    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cc430a13-3b55-48d6-9948-06b603571fc4-workload-certs\") pod \"e2e-inf-b-ca07b2-openshift-default-7c6464b649-548ft\" (UID: \"cc430a13-3b55-48d6-9948-06b603571fc4\") " pod="openshift-ingress/e2e-inf-b-ca07b2-openshift-default-7c6464b649-548ft"
Jul 16 11:39:07.175062 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:39:07.175045    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cc430a13-3b55-48d6-9948-06b603571fc4-istio-envoy\") pod \"e2e-inf-b-ca07b2-openshift-default-7c6464b649-548ft\" (UID: \"cc430a13-3b55-48d6-9948-06b603571fc4\") " pod="openshift-ingress/e2e-inf-b-ca07b2-openshift-default-7c6464b649-548ft"
Jul 16 11:39:07.175388 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:39:07.175366    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cc430a13-3b55-48d6-9948-06b603571fc4-istio-podinfo\") pod \"e2e-inf-b-ca07b2-openshift-default-7c6464b649-548ft\" (UID: \"cc430a13-3b55-48d6-9948-06b603571fc4\") " pod="openshift-ingress/e2e-inf-b-ca07b2-openshift-default-7c6464b649-548ft"
Jul 16 11:39:07.180621 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:39:07.180596    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xzrr9\" (UniqueName: \"kubernetes.io/projected/cc430a13-3b55-48d6-9948-06b603571fc4-kube-api-access-xzrr9\") pod \"e2e-inf-b-ca07b2-openshift-default-7c6464b649-548ft\" (UID: \"cc430a13-3b55-48d6-9948-06b603571fc4\") " pod="openshift-ingress/e2e-inf-b-ca07b2-openshift-default-7c6464b649-548ft"
Jul 16 11:39:07.180805 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:39:07.180785    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cc430a13-3b55-48d6-9948-06b603571fc4-istio-token\") pod \"e2e-inf-b-ca07b2-openshift-default-7c6464b649-548ft\" (UID: \"cc430a13-3b55-48d6-9948-06b603571fc4\") " pod="openshift-ingress/e2e-inf-b-ca07b2-openshift-default-7c6464b649-548ft"
Jul 16 11:39:07.289159 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:39:07.289133    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-ca07b2-openshift-default-7c6464b649-548ft"
Jul 16 11:39:07.327291 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:39:07.327261    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:39:07.439204 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:39:07.439178    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-ca07b2-openshift-default-7c6464b649-548ft"]
Jul 16 11:39:07.441094 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:39:07.441059    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcc430a13_3b55_48d6_9948_06b603571fc4.slice/crio-b683acb8790adc159c361bbc6e97d33a92065e475efa15d01af0f65caf5712d5 WatchSource:0}: Error finding container b683acb8790adc159c361bbc6e97d33a92065e475efa15d01af0f65caf5712d5: Status 404 returned error can't find the container with id b683acb8790adc159c361bbc6e97d33a92065e475efa15d01af0f65caf5712d5
Jul 16 11:39:07.443330 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:39:07.443291    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 16 11:39:07.443423 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:39:07.443366    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 16 11:39:07.443423 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:39:07.443393    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 16 11:39:07.956252 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:39:07.956219    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-ca07b2-openshift-default-7c6464b649-548ft" event={"ID":"cc430a13-3b55-48d6-9948-06b603571fc4","Type":"ContainerStarted","Data":"703d110702bfb9556a63e36776a9028c66c07e293adf2722c537c437baa7e2e6"}
Jul 16 11:39:07.956420 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:39:07.956278    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-ca07b2-openshift-default-7c6464b649-548ft" event={"ID":"cc430a13-3b55-48d6-9948-06b603571fc4","Type":"ContainerStarted","Data":"b683acb8790adc159c361bbc6e97d33a92065e475efa15d01af0f65caf5712d5"}
Jul 16 11:39:07.976587 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:39:07.976540    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-ca07b2-openshift-default-7c6464b649-548ft" podStartSLOduration=1.976525456 podStartE2EDuration="1.976525456s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 11:39:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 11:39:07.975558824 +0000 UTC m=+1848.347095873" watchObservedRunningTime="2026-07-16 11:39:07.976525456 +0000 UTC m=+1848.348062495"
Jul 16 11:39:08.289998 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:39:08.289967    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-ca07b2-openshift-default-7c6464b649-548ft"
Jul 16 11:39:08.294816 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:39:08.294794    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-ca07b2-openshift-default-7c6464b649-548ft"
Jul 16 11:39:08.878108 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:39:08.878077    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:39:08.961555 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:39:08.961521    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-ca07b2-openshift-default-7c6464b649-548ft"
Jul 16 11:39:08.962558 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:39:08.962535    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-ca07b2-openshift-default-7c6464b649-548ft"
Jul 16 11:39:09.173797 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:39:09.173707    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:39:09.283062 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:39:09.283030    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:39:09.726178 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:39:09.726146    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:39:09.826576 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:39:09.826549    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:39:09.927216 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:39:09.927186    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:39:14.376071 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:39:14.376033    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:39:16.959023 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:39:16.958977    2564 patch_prober.go:28] interesting pod/e2e-inf-a-a0660d-openshift-default-67db5b6559-pvx76 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.58:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 16 11:39:16.959521 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:39:16.959061    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-a0660d-openshift-default-67db5b6559-pvx76" podUID="3cdbc8e9-869a-470e-bedd-ba5c17074681" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.58:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 16 11:39:19.020250 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:39:19.020219    2564 generic.go:356] "Generic (PLEG): container finished" podID="3cdbc8e9-869a-470e-bedd-ba5c17074681" containerID="44843015aac1e1eb8d51675cb1780ee674e122915cd05b71dcadffb5624c6a6c" exitCode=0
Jul 16 11:39:19.020804 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:39:19.020296    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-a0660d-openshift-default-67db5b6559-pvx76" event={"ID":"3cdbc8e9-869a-470e-bedd-ba5c17074681","Type":"ContainerDied","Data":"44843015aac1e1eb8d51675cb1780ee674e122915cd05b71dcadffb5624c6a6c"}
Jul 16 11:39:19.020906 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:39:19.020887    2564 scope.go:117] "RemoveContainer" containerID="44843015aac1e1eb8d51675cb1780ee674e122915cd05b71dcadffb5624c6a6c"
Jul 16 11:39:19.021967 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:39:19.021939    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 16 11:39:19.022070 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:39:19.022010    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 16 11:39:19.022070 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:39:19.022041    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 16 11:39:20.027644 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:39:20.027603    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-a0660d-openshift-default-67db5b6559-pvx76" event={"ID":"3cdbc8e9-869a-470e-bedd-ba5c17074681","Type":"ContainerStarted","Data":"4489edfd38010eccfe9a8ea2551b56b534f50aca06c7c340f33e004bf41a3b64"}
Jul 16 11:39:20.319057 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:39:20.318981    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-a0660d-openshift-default-67db5b6559-pvx76"
Jul 16 11:39:20.319209 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:39:20.319189    2564 patch_prober.go:28] interesting pod/e2e-inf-a-a0660d-openshift-default-67db5b6559-pvx76 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused" start-of-body=
Jul 16 11:39:20.319274 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:39:20.319257    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-a0660d-openshift-default-67db5b6559-pvx76" podUID="3cdbc8e9-869a-470e-bedd-ba5c17074681" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused"
Jul 16 11:39:21.319124 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:39:21.319043    2564 patch_prober.go:28] interesting pod/e2e-inf-a-a0660d-openshift-default-67db5b6559-pvx76 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused" start-of-body=
Jul 16 11:39:21.319124 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:39:21.319105    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-a0660d-openshift-default-67db5b6559-pvx76" podUID="3cdbc8e9-869a-470e-bedd-ba5c17074681" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused"
Jul 16 11:39:22.318748 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:39:22.318716    2564 patch_prober.go:28] interesting pod/e2e-inf-a-a0660d-openshift-default-67db5b6559-pvx76 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused" start-of-body=
Jul 16 11:39:22.318951 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:39:22.318799    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-a0660d-openshift-default-67db5b6559-pvx76" podUID="3cdbc8e9-869a-470e-bedd-ba5c17074681" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused"
Jul 16 11:39:22.946830 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:39:22.946798    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:39:23.047410 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:39:23.047384    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:39:23.318640 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:39:23.318605    2564 patch_prober.go:28] interesting pod/e2e-inf-a-a0660d-openshift-default-67db5b6559-pvx76 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused" start-of-body=
Jul 16 11:39:23.318840 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:39:23.318668    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-a0660d-openshift-default-67db5b6559-pvx76" podUID="3cdbc8e9-869a-470e-bedd-ba5c17074681" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused"
Jul 16 11:39:24.319305 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:39:24.319253    2564 patch_prober.go:28] interesting pod/e2e-inf-a-a0660d-openshift-default-67db5b6559-pvx76 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused" start-of-body=
Jul 16 11:39:24.319695 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:39:24.319349    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-a0660d-openshift-default-67db5b6559-pvx76" podUID="3cdbc8e9-869a-470e-bedd-ba5c17074681" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused"
Jul 16 11:39:24.598685 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:39:24.597859    2564 patch_prober.go:28] interesting pod/e2e-inf-b-ca07b2-openshift-default-7c6464b649-548ft container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.59:15021/healthz/ready\": read tcp 10.133.0.2:45282->10.133.0.59:15021: read: connection reset by peer" start-of-body=
Jul 16 11:39:24.598685 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:39:24.597922    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-ca07b2-openshift-default-7c6464b649-548ft" podUID="cc430a13-3b55-48d6-9948-06b603571fc4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.59:15021/healthz/ready\": read tcp 10.133.0.2:45282->10.133.0.59:15021: read: connection reset by peer"
Jul 16 11:39:25.055506 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:39:25.055471    2564 generic.go:356] "Generic (PLEG): container finished" podID="cc430a13-3b55-48d6-9948-06b603571fc4" containerID="703d110702bfb9556a63e36776a9028c66c07e293adf2722c537c437baa7e2e6" exitCode=0
Jul 16 11:39:25.055674 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:39:25.055529    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-ca07b2-openshift-default-7c6464b649-548ft" event={"ID":"cc430a13-3b55-48d6-9948-06b603571fc4","Type":"ContainerDied","Data":"703d110702bfb9556a63e36776a9028c66c07e293adf2722c537c437baa7e2e6"}
Jul 16 11:39:25.056081 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:39:25.056062    2564 scope.go:117] "RemoveContainer" containerID="703d110702bfb9556a63e36776a9028c66c07e293adf2722c537c437baa7e2e6"
Jul 16 11:39:25.057202 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:39:25.057172    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 16 11:39:25.057273 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:39:25.057255    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 16 11:39:25.057311 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:39:25.057299    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 16 11:39:25.322298 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:39:25.322227    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-a0660d-openshift-default-67db5b6559-pvx76"
Jul 16 11:39:25.322665 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:39:25.322516    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-a0660d-openshift-default-67db5b6559-pvx76"
Jul 16 11:39:25.323195 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:39:25.323177    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-a0660d-openshift-default-67db5b6559-pvx76"
Jul 16 11:39:26.070656 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:39:26.070565    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-ca07b2-openshift-default-7c6464b649-548ft" event={"ID":"cc430a13-3b55-48d6-9948-06b603571fc4","Type":"ContainerStarted","Data":"0fba8580481d6dbb8813b6c3fb23a6932397c5fc353fdd114d73198475995a10"}
Jul 16 11:39:26.290274 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:39:26.290244    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-ca07b2-openshift-default-7c6464b649-548ft"
Jul 16 11:39:26.290456 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:39:26.290434    2564 patch_prober.go:28] interesting pod/e2e-inf-b-ca07b2-openshift-default-7c6464b649-548ft container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused" start-of-body=
Jul 16 11:39:26.290501 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:39:26.290481    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-ca07b2-openshift-default-7c6464b649-548ft" podUID="cc430a13-3b55-48d6-9948-06b603571fc4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused"
Jul 16 11:39:27.290152 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:39:27.290118    2564 patch_prober.go:28] interesting pod/e2e-inf-b-ca07b2-openshift-default-7c6464b649-548ft container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused" start-of-body=
Jul 16 11:39:27.290558 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:39:27.290174    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-ca07b2-openshift-default-7c6464b649-548ft" podUID="cc430a13-3b55-48d6-9948-06b603571fc4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused"
Jul 16 11:39:28.289913 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:39:28.289875    2564 patch_prober.go:28] interesting pod/e2e-inf-b-ca07b2-openshift-default-7c6464b649-548ft container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused" start-of-body=
Jul 16 11:39:28.290128 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:39:28.289931    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-ca07b2-openshift-default-7c6464b649-548ft" podUID="cc430a13-3b55-48d6-9948-06b603571fc4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused"
Jul 16 11:39:29.290249 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:39:29.290216    2564 patch_prober.go:28] interesting pod/e2e-inf-b-ca07b2-openshift-default-7c6464b649-548ft container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused" start-of-body=
Jul 16 11:39:29.290630 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:39:29.290270    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-ca07b2-openshift-default-7c6464b649-548ft" podUID="cc430a13-3b55-48d6-9948-06b603571fc4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused"
Jul 16 11:39:29.870795 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:39:29.868602    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:39:30.293562 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:39:30.293538    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-ca07b2-openshift-default-7c6464b649-548ft"
Jul 16 11:39:30.293997 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:39:30.293885    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-ca07b2-openshift-default-7c6464b649-548ft"
Jul 16 11:39:30.294491 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:39:30.294474    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-ca07b2-openshift-default-7c6464b649-548ft"
Jul 16 11:39:30.711443 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:39:30.711373    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:39:30.812767 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:39:30.812739    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:39:56.657804 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:39:56.657750    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:39:58.940174 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:39:58.940138    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:39:59.040549 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:39:59.040518    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:40:17.911013 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:40:17.910981    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:40:18.837921 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:40:18.837891    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:40:19.290924 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:40:19.290890    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:40:20.683040 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:40:20.683010    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:40:21.254135 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:40:21.254102    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:40:24.459834 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:40:24.459802    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:41:00.791007 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:41:00.790967    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:41:01.890289 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:41:01.890261    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-a0660d-openshift-default-67db5b6559-pvx76"]
Jul 16 11:41:01.890715 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:41:01.890476    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-a0660d-openshift-default-67db5b6559-pvx76" podUID="3cdbc8e9-869a-470e-bedd-ba5c17074681" containerName="istio-proxy" containerID="cri-o://4489edfd38010eccfe9a8ea2551b56b534f50aca06c7c340f33e004bf41a3b64" gracePeriod=30
Jul 16 11:41:03.109078 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:41:03.109044    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:41:07.149066 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:41:07.149006    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-a0660d-openshift-default-67db5b6559-pvx76"
Jul 16 11:41:07.190570 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:41:07.190540    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3cdbc8e9-869a-470e-bedd-ba5c17074681-istio-data\") pod \"3cdbc8e9-869a-470e-bedd-ba5c17074681\" (UID: \"3cdbc8e9-869a-470e-bedd-ba5c17074681\") "
Jul 16 11:41:07.190703 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:41:07.190595    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3cdbc8e9-869a-470e-bedd-ba5c17074681-istio-envoy\") pod \"3cdbc8e9-869a-470e-bedd-ba5c17074681\" (UID: \"3cdbc8e9-869a-470e-bedd-ba5c17074681\") "
Jul 16 11:41:07.190703 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:41:07.190629    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sb72c\" (UniqueName: \"kubernetes.io/projected/3cdbc8e9-869a-470e-bedd-ba5c17074681-kube-api-access-sb72c\") pod \"3cdbc8e9-869a-470e-bedd-ba5c17074681\" (UID: \"3cdbc8e9-869a-470e-bedd-ba5c17074681\") "
Jul 16 11:41:07.190703 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:41:07.190687    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3cdbc8e9-869a-470e-bedd-ba5c17074681-istiod-ca-cert\") pod \"3cdbc8e9-869a-470e-bedd-ba5c17074681\" (UID: \"3cdbc8e9-869a-470e-bedd-ba5c17074681\") "
Jul 16 11:41:07.190882 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:41:07.190727    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3cdbc8e9-869a-470e-bedd-ba5c17074681-istio-podinfo\") pod \"3cdbc8e9-869a-470e-bedd-ba5c17074681\" (UID: \"3cdbc8e9-869a-470e-bedd-ba5c17074681\") "
Jul 16 11:41:07.190882 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:41:07.190820    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3cdbc8e9-869a-470e-bedd-ba5c17074681-istio-token\") pod \"3cdbc8e9-869a-470e-bedd-ba5c17074681\" (UID: \"3cdbc8e9-869a-470e-bedd-ba5c17074681\") "
Jul 16 11:41:07.190882 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:41:07.190860    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3cdbc8e9-869a-470e-bedd-ba5c17074681-credential-socket\") pod \"3cdbc8e9-869a-470e-bedd-ba5c17074681\" (UID: \"3cdbc8e9-869a-470e-bedd-ba5c17074681\") "
Jul 16 11:41:07.191032 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:41:07.190897    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3cdbc8e9-869a-470e-bedd-ba5c17074681-workload-certs\") pod \"3cdbc8e9-869a-470e-bedd-ba5c17074681\" (UID: \"3cdbc8e9-869a-470e-bedd-ba5c17074681\") "
Jul 16 11:41:07.191032 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:41:07.190925    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3cdbc8e9-869a-470e-bedd-ba5c17074681-workload-socket\") pod \"3cdbc8e9-869a-470e-bedd-ba5c17074681\" (UID: \"3cdbc8e9-869a-470e-bedd-ba5c17074681\") "
Jul 16 11:41:07.191237 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:41:07.191208    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3cdbc8e9-869a-470e-bedd-ba5c17074681-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "3cdbc8e9-869a-470e-bedd-ba5c17074681" (UID: "3cdbc8e9-869a-470e-bedd-ba5c17074681"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 11:41:07.191495 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:41:07.191375    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3cdbc8e9-869a-470e-bedd-ba5c17074681-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "3cdbc8e9-869a-470e-bedd-ba5c17074681" (UID: "3cdbc8e9-869a-470e-bedd-ba5c17074681"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 11:41:07.191598 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:41:07.191563    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3cdbc8e9-869a-470e-bedd-ba5c17074681-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "3cdbc8e9-869a-470e-bedd-ba5c17074681" (UID: "3cdbc8e9-869a-470e-bedd-ba5c17074681"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 11:41:07.191711 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:41:07.191595    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3cdbc8e9-869a-470e-bedd-ba5c17074681-istio-data" (OuterVolumeSpecName: "istio-data") pod "3cdbc8e9-869a-470e-bedd-ba5c17074681" (UID: "3cdbc8e9-869a-470e-bedd-ba5c17074681"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 11:41:07.191842 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:41:07.191490    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3cdbc8e9-869a-470e-bedd-ba5c17074681-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "3cdbc8e9-869a-470e-bedd-ba5c17074681" (UID: "3cdbc8e9-869a-470e-bedd-ba5c17074681"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 11:41:07.193318 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:41:07.193283    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3cdbc8e9-869a-470e-bedd-ba5c17074681-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "3cdbc8e9-869a-470e-bedd-ba5c17074681" (UID: "3cdbc8e9-869a-470e-bedd-ba5c17074681"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 11:41:07.193423 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:41:07.193381    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3cdbc8e9-869a-470e-bedd-ba5c17074681-istio-token" (OuterVolumeSpecName: "istio-token") pod "3cdbc8e9-869a-470e-bedd-ba5c17074681" (UID: "3cdbc8e9-869a-470e-bedd-ba5c17074681"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 11:41:07.193423 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:41:07.193406    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/3cdbc8e9-869a-470e-bedd-ba5c17074681-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "3cdbc8e9-869a-470e-bedd-ba5c17074681" (UID: "3cdbc8e9-869a-470e-bedd-ba5c17074681"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 16 11:41:07.193559 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:41:07.193471    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3cdbc8e9-869a-470e-bedd-ba5c17074681-kube-api-access-sb72c" (OuterVolumeSpecName: "kube-api-access-sb72c") pod "3cdbc8e9-869a-470e-bedd-ba5c17074681" (UID: "3cdbc8e9-869a-470e-bedd-ba5c17074681"). InnerVolumeSpecName "kube-api-access-sb72c". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 11:41:07.291952 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:41:07.291919    2564 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3cdbc8e9-869a-470e-bedd-ba5c17074681-istiod-ca-cert\") on node \"ip-10-0-135-184.ec2.internal\" DevicePath \"\""
Jul 16 11:41:07.291952 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:41:07.291946    2564 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3cdbc8e9-869a-470e-bedd-ba5c17074681-istio-podinfo\") on node \"ip-10-0-135-184.ec2.internal\" DevicePath \"\""
Jul 16 11:41:07.291952 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:41:07.291955    2564 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3cdbc8e9-869a-470e-bedd-ba5c17074681-istio-token\") on node \"ip-10-0-135-184.ec2.internal\" DevicePath \"\""
Jul 16 11:41:07.292170 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:41:07.291963    2564 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3cdbc8e9-869a-470e-bedd-ba5c17074681-credential-socket\") on node \"ip-10-0-135-184.ec2.internal\" DevicePath \"\""
Jul 16 11:41:07.292170 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:41:07.291973    2564 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3cdbc8e9-869a-470e-bedd-ba5c17074681-workload-certs\") on node \"ip-10-0-135-184.ec2.internal\" DevicePath \"\""
Jul 16 11:41:07.292170 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:41:07.291981    2564 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3cdbc8e9-869a-470e-bedd-ba5c17074681-workload-socket\") on node \"ip-10-0-135-184.ec2.internal\" DevicePath \"\""
Jul 16 11:41:07.292170 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:41:07.291989    2564 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3cdbc8e9-869a-470e-bedd-ba5c17074681-istio-data\") on node \"ip-10-0-135-184.ec2.internal\" DevicePath \"\""
Jul 16 11:41:07.292170 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:41:07.291997    2564 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3cdbc8e9-869a-470e-bedd-ba5c17074681-istio-envoy\") on node \"ip-10-0-135-184.ec2.internal\" DevicePath \"\""
Jul 16 11:41:07.292170 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:41:07.292004    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sb72c\" (UniqueName: \"kubernetes.io/projected/3cdbc8e9-869a-470e-bedd-ba5c17074681-kube-api-access-sb72c\") on node \"ip-10-0-135-184.ec2.internal\" DevicePath \"\""
Jul 16 11:41:07.626459 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:41:07.626424    2564 generic.go:356] "Generic (PLEG): container finished" podID="3cdbc8e9-869a-470e-bedd-ba5c17074681" containerID="4489edfd38010eccfe9a8ea2551b56b534f50aca06c7c340f33e004bf41a3b64" exitCode=0
Jul 16 11:41:07.626637 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:41:07.626471    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-a0660d-openshift-default-67db5b6559-pvx76"
Jul 16 11:41:07.626637 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:41:07.626508    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-a0660d-openshift-default-67db5b6559-pvx76" event={"ID":"3cdbc8e9-869a-470e-bedd-ba5c17074681","Type":"ContainerDied","Data":"4489edfd38010eccfe9a8ea2551b56b534f50aca06c7c340f33e004bf41a3b64"}
Jul 16 11:41:07.626637 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:41:07.626560    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-a0660d-openshift-default-67db5b6559-pvx76" event={"ID":"3cdbc8e9-869a-470e-bedd-ba5c17074681","Type":"ContainerDied","Data":"e0d224ae03b3fd2f4ec0b11d1a49d26b6d7ff50709c200e05fc8395fc058ee91"}
Jul 16 11:41:07.626637 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:41:07.626582    2564 scope.go:117] "RemoveContainer" containerID="4489edfd38010eccfe9a8ea2551b56b534f50aca06c7c340f33e004bf41a3b64"
Jul 16 11:41:07.636656 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:41:07.636638    2564 scope.go:117] "RemoveContainer" containerID="44843015aac1e1eb8d51675cb1780ee674e122915cd05b71dcadffb5624c6a6c"
Jul 16 11:41:07.644499 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:41:07.644478    2564 scope.go:117] "RemoveContainer" containerID="4489edfd38010eccfe9a8ea2551b56b534f50aca06c7c340f33e004bf41a3b64"
Jul 16 11:41:07.644741 ip-10-0-135-184 kubenswrapper[2564]: E0716 11:41:07.644723    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4489edfd38010eccfe9a8ea2551b56b534f50aca06c7c340f33e004bf41a3b64\": container with ID starting with 4489edfd38010eccfe9a8ea2551b56b534f50aca06c7c340f33e004bf41a3b64 not found: ID does not exist" containerID="4489edfd38010eccfe9a8ea2551b56b534f50aca06c7c340f33e004bf41a3b64"
Jul 16 11:41:07.644836 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:41:07.644756    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4489edfd38010eccfe9a8ea2551b56b534f50aca06c7c340f33e004bf41a3b64"} err="failed to get container status \"4489edfd38010eccfe9a8ea2551b56b534f50aca06c7c340f33e004bf41a3b64\": rpc error: code = NotFound desc = could not find container \"4489edfd38010eccfe9a8ea2551b56b534f50aca06c7c340f33e004bf41a3b64\": container with ID starting with 4489edfd38010eccfe9a8ea2551b56b534f50aca06c7c340f33e004bf41a3b64 not found: ID does not exist"
Jul 16 11:41:07.644836 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:41:07.644793    2564 scope.go:117] "RemoveContainer" containerID="44843015aac1e1eb8d51675cb1780ee674e122915cd05b71dcadffb5624c6a6c"
Jul 16 11:41:07.645054 ip-10-0-135-184 kubenswrapper[2564]: E0716 11:41:07.645037    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"44843015aac1e1eb8d51675cb1780ee674e122915cd05b71dcadffb5624c6a6c\": container with ID starting with 44843015aac1e1eb8d51675cb1780ee674e122915cd05b71dcadffb5624c6a6c not found: ID does not exist" containerID="44843015aac1e1eb8d51675cb1780ee674e122915cd05b71dcadffb5624c6a6c"
Jul 16 11:41:07.645100 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:41:07.645059    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"44843015aac1e1eb8d51675cb1780ee674e122915cd05b71dcadffb5624c6a6c"} err="failed to get container status \"44843015aac1e1eb8d51675cb1780ee674e122915cd05b71dcadffb5624c6a6c\": rpc error: code = NotFound desc = could not find container \"44843015aac1e1eb8d51675cb1780ee674e122915cd05b71dcadffb5624c6a6c\": container with ID starting with 44843015aac1e1eb8d51675cb1780ee674e122915cd05b71dcadffb5624c6a6c not found: ID does not exist"
Jul 16 11:41:07.649409 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:41:07.649387    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-a0660d-openshift-default-67db5b6559-pvx76"]
Jul 16 11:41:07.655260 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:41:07.655235    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-a0660d-openshift-default-67db5b6559-pvx76"]
Jul 16 11:41:07.870059 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:41:07.870012    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:41:08.302075 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:41:08.302041    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3cdbc8e9-869a-470e-bedd-ba5c17074681" path="/var/lib/kubelet/pods/3cdbc8e9-869a-470e-bedd-ba5c17074681/volumes"
Jul 16 11:41:08.596551 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:41:08.596463    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:41:14.325975 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:41:14.325894    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:41:14.385259 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:41:14.385230    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:41:14.600276 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:41:14.600198    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-ca07b2-openshift-default-7c6464b649-548ft"]
Jul 16 11:41:14.600426 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:41:14.600405    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-ca07b2-openshift-default-7c6464b649-548ft" podUID="cc430a13-3b55-48d6-9948-06b603571fc4" containerName="istio-proxy" containerID="cri-o://0fba8580481d6dbb8813b6c3fb23a6932397c5fc353fdd114d73198475995a10" gracePeriod=30
Jul 16 11:41:14.616022 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:41:14.615990    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:41:14.901781 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:41:14.901682    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:41:15.170516 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:41:15.170441    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:41:15.296390 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:41:15.296357    2564 patch_prober.go:28] interesting pod/e2e-inf-b-ca07b2-openshift-default-7c6464b649-548ft container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 16 11:41:15.296527 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:41:15.296418    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-ca07b2-openshift-default-7c6464b649-548ft" podUID="cc430a13-3b55-48d6-9948-06b603571fc4" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 16 11:41:15.430198 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:41:15.430126    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-959ed9-openshift-default-544655d677-gcvbj"]
Jul 16 11:41:15.430552 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:41:15.430540    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3cdbc8e9-869a-470e-bedd-ba5c17074681" containerName="istio-proxy"
Jul 16 11:41:15.430552 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:41:15.430553    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="3cdbc8e9-869a-470e-bedd-ba5c17074681" containerName="istio-proxy"
Jul 16 11:41:15.430622 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:41:15.430575    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3cdbc8e9-869a-470e-bedd-ba5c17074681" containerName="istio-proxy"
Jul 16 11:41:15.430622 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:41:15.430581    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="3cdbc8e9-869a-470e-bedd-ba5c17074681" containerName="istio-proxy"
Jul 16 11:41:15.430684 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:41:15.430655    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="3cdbc8e9-869a-470e-bedd-ba5c17074681" containerName="istio-proxy"
Jul 16 11:41:15.430684 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:41:15.430666    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="3cdbc8e9-869a-470e-bedd-ba5c17074681" containerName="istio-proxy"
Jul 16 11:41:15.435314 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:41:15.435295    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-959ed9-openshift-default-544655d677-gcvbj"
Jul 16 11:41:15.437483 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:41:15.437466    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-959ed9-openshift-default-dockercfg-wz5mw\""
Jul 16 11:41:15.447410 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:41:15.447393    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-959ed9-openshift-default-544655d677-gcvbj"]
Jul 16 11:41:15.464438 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:41:15.464403    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8c42ced8-e23d-4083-95e8-dea6bc944903-istio-data\") pod \"e2e-api-a-959ed9-openshift-default-544655d677-gcvbj\" (UID: \"8c42ced8-e23d-4083-95e8-dea6bc944903\") " pod="openshift-ingress/e2e-api-a-959ed9-openshift-default-544655d677-gcvbj"
Jul 16 11:41:15.464538 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:41:15.464444    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8c42ced8-e23d-4083-95e8-dea6bc944903-istio-podinfo\") pod \"e2e-api-a-959ed9-openshift-default-544655d677-gcvbj\" (UID: \"8c42ced8-e23d-4083-95e8-dea6bc944903\") " pod="openshift-ingress/e2e-api-a-959ed9-openshift-default-544655d677-gcvbj"
Jul 16 11:41:15.464538 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:41:15.464484    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8c42ced8-e23d-4083-95e8-dea6bc944903-istio-token\") pod \"e2e-api-a-959ed9-openshift-default-544655d677-gcvbj\" (UID: \"8c42ced8-e23d-4083-95e8-dea6bc944903\") " pod="openshift-ingress/e2e-api-a-959ed9-openshift-default-544655d677-gcvbj"
Jul 16 11:41:15.464538 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:41:15.464510    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8c42ced8-e23d-4083-95e8-dea6bc944903-workload-socket\") pod \"e2e-api-a-959ed9-openshift-default-544655d677-gcvbj\" (UID: \"8c42ced8-e23d-4083-95e8-dea6bc944903\") " pod="openshift-ingress/e2e-api-a-959ed9-openshift-default-544655d677-gcvbj"
Jul 16 11:41:15.464684 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:41:15.464538    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8c42ced8-e23d-4083-95e8-dea6bc944903-credential-socket\") pod \"e2e-api-a-959ed9-openshift-default-544655d677-gcvbj\" (UID: \"8c42ced8-e23d-4083-95e8-dea6bc944903\") " pod="openshift-ingress/e2e-api-a-959ed9-openshift-default-544655d677-gcvbj"
Jul 16 11:41:15.464684 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:41:15.464575    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8c42ced8-e23d-4083-95e8-dea6bc944903-istio-envoy\") pod \"e2e-api-a-959ed9-openshift-default-544655d677-gcvbj\" (UID: \"8c42ced8-e23d-4083-95e8-dea6bc944903\") " pod="openshift-ingress/e2e-api-a-959ed9-openshift-default-544655d677-gcvbj"
Jul 16 11:41:15.464684 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:41:15.464605    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8c42ced8-e23d-4083-95e8-dea6bc944903-workload-certs\") pod \"e2e-api-a-959ed9-openshift-default-544655d677-gcvbj\" (UID: \"8c42ced8-e23d-4083-95e8-dea6bc944903\") " pod="openshift-ingress/e2e-api-a-959ed9-openshift-default-544655d677-gcvbj"
Jul 16 11:41:15.464684 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:41:15.464668    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8c42ced8-e23d-4083-95e8-dea6bc944903-istiod-ca-cert\") pod \"e2e-api-a-959ed9-openshift-default-544655d677-gcvbj\" (UID: \"8c42ced8-e23d-4083-95e8-dea6bc944903\") " pod="openshift-ingress/e2e-api-a-959ed9-openshift-default-544655d677-gcvbj"
Jul 16 11:41:15.464927 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:41:15.464703    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-chzlr\" (UniqueName: \"kubernetes.io/projected/8c42ced8-e23d-4083-95e8-dea6bc944903-kube-api-access-chzlr\") pod \"e2e-api-a-959ed9-openshift-default-544655d677-gcvbj\" (UID: \"8c42ced8-e23d-4083-95e8-dea6bc944903\") " pod="openshift-ingress/e2e-api-a-959ed9-openshift-default-544655d677-gcvbj"
Jul 16 11:41:15.565657 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:41:15.565629    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8c42ced8-e23d-4083-95e8-dea6bc944903-istiod-ca-cert\") pod \"e2e-api-a-959ed9-openshift-default-544655d677-gcvbj\" (UID: \"8c42ced8-e23d-4083-95e8-dea6bc944903\") " pod="openshift-ingress/e2e-api-a-959ed9-openshift-default-544655d677-gcvbj"
Jul 16 11:41:15.565865 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:41:15.565664    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-chzlr\" (UniqueName: \"kubernetes.io/projected/8c42ced8-e23d-4083-95e8-dea6bc944903-kube-api-access-chzlr\") pod \"e2e-api-a-959ed9-openshift-default-544655d677-gcvbj\" (UID: \"8c42ced8-e23d-4083-95e8-dea6bc944903\") " pod="openshift-ingress/e2e-api-a-959ed9-openshift-default-544655d677-gcvbj"
Jul 16 11:41:15.565865 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:41:15.565724    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8c42ced8-e23d-4083-95e8-dea6bc944903-istio-data\") pod \"e2e-api-a-959ed9-openshift-default-544655d677-gcvbj\" (UID: \"8c42ced8-e23d-4083-95e8-dea6bc944903\") " pod="openshift-ingress/e2e-api-a-959ed9-openshift-default-544655d677-gcvbj"
Jul 16 11:41:15.565865 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:41:15.565752    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8c42ced8-e23d-4083-95e8-dea6bc944903-istio-podinfo\") pod \"e2e-api-a-959ed9-openshift-default-544655d677-gcvbj\" (UID: \"8c42ced8-e23d-4083-95e8-dea6bc944903\") " pod="openshift-ingress/e2e-api-a-959ed9-openshift-default-544655d677-gcvbj"
Jul 16 11:41:15.565865 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:41:15.565822    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8c42ced8-e23d-4083-95e8-dea6bc944903-istio-token\") pod \"e2e-api-a-959ed9-openshift-default-544655d677-gcvbj\" (UID: \"8c42ced8-e23d-4083-95e8-dea6bc944903\") " pod="openshift-ingress/e2e-api-a-959ed9-openshift-default-544655d677-gcvbj"
Jul 16 11:41:15.565865 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:41:15.565852    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8c42ced8-e23d-4083-95e8-dea6bc944903-workload-socket\") pod \"e2e-api-a-959ed9-openshift-default-544655d677-gcvbj\" (UID: \"8c42ced8-e23d-4083-95e8-dea6bc944903\") " pod="openshift-ingress/e2e-api-a-959ed9-openshift-default-544655d677-gcvbj"
Jul 16 11:41:15.566136 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:41:15.565885    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8c42ced8-e23d-4083-95e8-dea6bc944903-credential-socket\") pod \"e2e-api-a-959ed9-openshift-default-544655d677-gcvbj\" (UID: \"8c42ced8-e23d-4083-95e8-dea6bc944903\") " pod="openshift-ingress/e2e-api-a-959ed9-openshift-default-544655d677-gcvbj"
Jul 16 11:41:15.566136 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:41:15.566079    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8c42ced8-e23d-4083-95e8-dea6bc944903-istio-envoy\") pod \"e2e-api-a-959ed9-openshift-default-544655d677-gcvbj\" (UID: \"8c42ced8-e23d-4083-95e8-dea6bc944903\") " pod="openshift-ingress/e2e-api-a-959ed9-openshift-default-544655d677-gcvbj"
Jul 16 11:41:15.566136 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:41:15.566127    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8c42ced8-e23d-4083-95e8-dea6bc944903-workload-certs\") pod \"e2e-api-a-959ed9-openshift-default-544655d677-gcvbj\" (UID: \"8c42ced8-e23d-4083-95e8-dea6bc944903\") " pod="openshift-ingress/e2e-api-a-959ed9-openshift-default-544655d677-gcvbj"
Jul 16 11:41:15.566280 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:41:15.566211    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8c42ced8-e23d-4083-95e8-dea6bc944903-istio-data\") pod \"e2e-api-a-959ed9-openshift-default-544655d677-gcvbj\" (UID: \"8c42ced8-e23d-4083-95e8-dea6bc944903\") " pod="openshift-ingress/e2e-api-a-959ed9-openshift-default-544655d677-gcvbj"
Jul 16 11:41:15.566280 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:41:15.566233    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8c42ced8-e23d-4083-95e8-dea6bc944903-credential-socket\") pod \"e2e-api-a-959ed9-openshift-default-544655d677-gcvbj\" (UID: \"8c42ced8-e23d-4083-95e8-dea6bc944903\") " pod="openshift-ingress/e2e-api-a-959ed9-openshift-default-544655d677-gcvbj"
Jul 16 11:41:15.566526 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:41:15.566497    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8c42ced8-e23d-4083-95e8-dea6bc944903-istiod-ca-cert\") pod \"e2e-api-a-959ed9-openshift-default-544655d677-gcvbj\" (UID: \"8c42ced8-e23d-4083-95e8-dea6bc944903\") " pod="openshift-ingress/e2e-api-a-959ed9-openshift-default-544655d677-gcvbj"
Jul 16 11:41:15.566627 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:41:15.566519    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8c42ced8-e23d-4083-95e8-dea6bc944903-workload-socket\") pod \"e2e-api-a-959ed9-openshift-default-544655d677-gcvbj\" (UID: \"8c42ced8-e23d-4083-95e8-dea6bc944903\") " pod="openshift-ingress/e2e-api-a-959ed9-openshift-default-544655d677-gcvbj"
Jul 16 11:41:15.566627 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:41:15.566503    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8c42ced8-e23d-4083-95e8-dea6bc944903-workload-certs\") pod \"e2e-api-a-959ed9-openshift-default-544655d677-gcvbj\" (UID: \"8c42ced8-e23d-4083-95e8-dea6bc944903\") " pod="openshift-ingress/e2e-api-a-959ed9-openshift-default-544655d677-gcvbj"
Jul 16 11:41:15.568259 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:41:15.568232    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8c42ced8-e23d-4083-95e8-dea6bc944903-istio-envoy\") pod \"e2e-api-a-959ed9-openshift-default-544655d677-gcvbj\" (UID: \"8c42ced8-e23d-4083-95e8-dea6bc944903\") " pod="openshift-ingress/e2e-api-a-959ed9-openshift-default-544655d677-gcvbj"
Jul 16 11:41:15.568362 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:41:15.568332    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8c42ced8-e23d-4083-95e8-dea6bc944903-istio-podinfo\") pod \"e2e-api-a-959ed9-openshift-default-544655d677-gcvbj\" (UID: \"8c42ced8-e23d-4083-95e8-dea6bc944903\") " pod="openshift-ingress/e2e-api-a-959ed9-openshift-default-544655d677-gcvbj"
Jul 16 11:41:15.574483 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:41:15.574455    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8c42ced8-e23d-4083-95e8-dea6bc944903-istio-token\") pod \"e2e-api-a-959ed9-openshift-default-544655d677-gcvbj\" (UID: \"8c42ced8-e23d-4083-95e8-dea6bc944903\") " pod="openshift-ingress/e2e-api-a-959ed9-openshift-default-544655d677-gcvbj"
Jul 16 11:41:15.574579 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:41:15.574556    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-chzlr\" (UniqueName: \"kubernetes.io/projected/8c42ced8-e23d-4083-95e8-dea6bc944903-kube-api-access-chzlr\") pod \"e2e-api-a-959ed9-openshift-default-544655d677-gcvbj\" (UID: \"8c42ced8-e23d-4083-95e8-dea6bc944903\") " pod="openshift-ingress/e2e-api-a-959ed9-openshift-default-544655d677-gcvbj"
Jul 16 11:41:15.746707 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:41:15.746637    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-959ed9-openshift-default-544655d677-gcvbj"
Jul 16 11:41:15.892057 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:41:15.892029    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-959ed9-openshift-default-544655d677-gcvbj"]
Jul 16 11:41:15.894233 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:41:15.894209    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8c42ced8_e23d_4083_95e8_dea6bc944903.slice/crio-0838d0c355f9b1e670b460d9f98109e0951005b64de1d970756d4ba3c2c5faca WatchSource:0}: Error finding container 0838d0c355f9b1e670b460d9f98109e0951005b64de1d970756d4ba3c2c5faca: Status 404 returned error can't find the container with id 0838d0c355f9b1e670b460d9f98109e0951005b64de1d970756d4ba3c2c5faca
Jul 16 11:41:15.896875 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:41:15.896845    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 16 11:41:15.896962 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:41:15.896909    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 16 11:41:15.896962 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:41:15.896940    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 16 11:41:16.359465 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:41:16.359412    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:41:16.420299 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:41:16.420267    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:41:16.677469 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:41:16.677389    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-959ed9-openshift-default-544655d677-gcvbj" event={"ID":"8c42ced8-e23d-4083-95e8-dea6bc944903","Type":"ContainerStarted","Data":"dc048f7e6f7389201a5a3e1d574c4c5249c410347af92dc4cd13cc959c123e9d"}
Jul 16 11:41:16.677469 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:41:16.677444    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-959ed9-openshift-default-544655d677-gcvbj" event={"ID":"8c42ced8-e23d-4083-95e8-dea6bc944903","Type":"ContainerStarted","Data":"0838d0c355f9b1e670b460d9f98109e0951005b64de1d970756d4ba3c2c5faca"}
Jul 16 11:41:16.698950 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:41:16.698909    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-959ed9-openshift-default-544655d677-gcvbj" podStartSLOduration=1.698891387 podStartE2EDuration="1.698891387s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 11:41:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 11:41:16.697499185 +0000 UTC m=+1977.069036225" watchObservedRunningTime="2026-07-16 11:41:16.698891387 +0000 UTC m=+1977.070428424"
Jul 16 11:41:16.746834 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:41:16.746802    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-959ed9-openshift-default-544655d677-gcvbj"
Jul 16 11:41:16.751622 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:41:16.751599    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-959ed9-openshift-default-544655d677-gcvbj"
Jul 16 11:41:17.682700 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:41:17.682665    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-959ed9-openshift-default-544655d677-gcvbj"
Jul 16 11:41:17.683795 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:41:17.683757    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-959ed9-openshift-default-544655d677-gcvbj"
Jul 16 11:41:17.696243 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:41:17.696200    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:41:17.798551 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:41:17.798523    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:41:17.978378 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:41:17.978284    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:41:18.080101 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:41:18.080074    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:41:18.539915 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:41:18.539884    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:41:18.641462 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:41:18.641430    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:41:19.853841 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:41:19.853814    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-ca07b2-openshift-default-7c6464b649-548ft"
Jul 16 11:41:19.906267 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:41:19.906197    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xzrr9\" (UniqueName: \"kubernetes.io/projected/cc430a13-3b55-48d6-9948-06b603571fc4-kube-api-access-xzrr9\") pod \"cc430a13-3b55-48d6-9948-06b603571fc4\" (UID: \"cc430a13-3b55-48d6-9948-06b603571fc4\") "
Jul 16 11:41:19.906267 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:41:19.906242    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cc430a13-3b55-48d6-9948-06b603571fc4-istio-token\") pod \"cc430a13-3b55-48d6-9948-06b603571fc4\" (UID: \"cc430a13-3b55-48d6-9948-06b603571fc4\") "
Jul 16 11:41:19.906267 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:41:19.906267    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cc430a13-3b55-48d6-9948-06b603571fc4-istio-data\") pod \"cc430a13-3b55-48d6-9948-06b603571fc4\" (UID: \"cc430a13-3b55-48d6-9948-06b603571fc4\") "
Jul 16 11:41:19.906488 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:41:19.906309    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cc430a13-3b55-48d6-9948-06b603571fc4-istio-podinfo\") pod \"cc430a13-3b55-48d6-9948-06b603571fc4\" (UID: \"cc430a13-3b55-48d6-9948-06b603571fc4\") "
Jul 16 11:41:19.906488 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:41:19.906367    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cc430a13-3b55-48d6-9948-06b603571fc4-istiod-ca-cert\") pod \"cc430a13-3b55-48d6-9948-06b603571fc4\" (UID: \"cc430a13-3b55-48d6-9948-06b603571fc4\") "
Jul 16 11:41:19.906488 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:41:19.906395    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cc430a13-3b55-48d6-9948-06b603571fc4-istio-envoy\") pod \"cc430a13-3b55-48d6-9948-06b603571fc4\" (UID: \"cc430a13-3b55-48d6-9948-06b603571fc4\") "
Jul 16 11:41:19.906488 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:41:19.906427    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cc430a13-3b55-48d6-9948-06b603571fc4-credential-socket\") pod \"cc430a13-3b55-48d6-9948-06b603571fc4\" (UID: \"cc430a13-3b55-48d6-9948-06b603571fc4\") "
Jul 16 11:41:19.906488 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:41:19.906459    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cc430a13-3b55-48d6-9948-06b603571fc4-workload-socket\") pod \"cc430a13-3b55-48d6-9948-06b603571fc4\" (UID: \"cc430a13-3b55-48d6-9948-06b603571fc4\") "
Jul 16 11:41:19.906740 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:41:19.906507    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cc430a13-3b55-48d6-9948-06b603571fc4-workload-certs\") pod \"cc430a13-3b55-48d6-9948-06b603571fc4\" (UID: \"cc430a13-3b55-48d6-9948-06b603571fc4\") "
Jul 16 11:41:19.906841 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:41:19.906814    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cc430a13-3b55-48d6-9948-06b603571fc4-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "cc430a13-3b55-48d6-9948-06b603571fc4" (UID: "cc430a13-3b55-48d6-9948-06b603571fc4"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 11:41:19.906903 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:41:19.906857    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cc430a13-3b55-48d6-9948-06b603571fc4-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "cc430a13-3b55-48d6-9948-06b603571fc4" (UID: "cc430a13-3b55-48d6-9948-06b603571fc4"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 11:41:19.907222 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:41:19.907017    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cc430a13-3b55-48d6-9948-06b603571fc4-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "cc430a13-3b55-48d6-9948-06b603571fc4" (UID: "cc430a13-3b55-48d6-9948-06b603571fc4"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 11:41:19.907222 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:41:19.907060    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cc430a13-3b55-48d6-9948-06b603571fc4-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "cc430a13-3b55-48d6-9948-06b603571fc4" (UID: "cc430a13-3b55-48d6-9948-06b603571fc4"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 11:41:19.907356 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:41:19.907220    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cc430a13-3b55-48d6-9948-06b603571fc4-istio-data" (OuterVolumeSpecName: "istio-data") pod "cc430a13-3b55-48d6-9948-06b603571fc4" (UID: "cc430a13-3b55-48d6-9948-06b603571fc4"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 11:41:19.908506 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:41:19.908480    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cc430a13-3b55-48d6-9948-06b603571fc4-istio-token" (OuterVolumeSpecName: "istio-token") pod "cc430a13-3b55-48d6-9948-06b603571fc4" (UID: "cc430a13-3b55-48d6-9948-06b603571fc4"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 11:41:19.908852 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:41:19.908836    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cc430a13-3b55-48d6-9948-06b603571fc4-kube-api-access-xzrr9" (OuterVolumeSpecName: "kube-api-access-xzrr9") pod "cc430a13-3b55-48d6-9948-06b603571fc4" (UID: "cc430a13-3b55-48d6-9948-06b603571fc4"). InnerVolumeSpecName "kube-api-access-xzrr9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 11:41:19.909257 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:41:19.909238    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/cc430a13-3b55-48d6-9948-06b603571fc4-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "cc430a13-3b55-48d6-9948-06b603571fc4" (UID: "cc430a13-3b55-48d6-9948-06b603571fc4"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 16 11:41:19.909325 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:41:19.909254    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cc430a13-3b55-48d6-9948-06b603571fc4-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "cc430a13-3b55-48d6-9948-06b603571fc4" (UID: "cc430a13-3b55-48d6-9948-06b603571fc4"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 11:41:20.008122 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:41:20.008089    2564 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cc430a13-3b55-48d6-9948-06b603571fc4-istio-data\") on node \"ip-10-0-135-184.ec2.internal\" DevicePath \"\""
Jul 16 11:41:20.008122 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:41:20.008119    2564 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cc430a13-3b55-48d6-9948-06b603571fc4-istio-podinfo\") on node \"ip-10-0-135-184.ec2.internal\" DevicePath \"\""
Jul 16 11:41:20.008323 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:41:20.008131    2564 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cc430a13-3b55-48d6-9948-06b603571fc4-istiod-ca-cert\") on node \"ip-10-0-135-184.ec2.internal\" DevicePath \"\""
Jul 16 11:41:20.008323 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:41:20.008144    2564 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cc430a13-3b55-48d6-9948-06b603571fc4-istio-envoy\") on node \"ip-10-0-135-184.ec2.internal\" DevicePath \"\""
Jul 16 11:41:20.008323 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:41:20.008155    2564 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cc430a13-3b55-48d6-9948-06b603571fc4-credential-socket\") on node \"ip-10-0-135-184.ec2.internal\" DevicePath \"\""
Jul 16 11:41:20.008323 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:41:20.008167    2564 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cc430a13-3b55-48d6-9948-06b603571fc4-workload-socket\") on node \"ip-10-0-135-184.ec2.internal\" DevicePath \"\""
Jul 16 11:41:20.008323 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:41:20.008179    2564 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cc430a13-3b55-48d6-9948-06b603571fc4-workload-certs\") on node \"ip-10-0-135-184.ec2.internal\" DevicePath \"\""
Jul 16 11:41:20.008323 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:41:20.008191    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xzrr9\" (UniqueName: \"kubernetes.io/projected/cc430a13-3b55-48d6-9948-06b603571fc4-kube-api-access-xzrr9\") on node \"ip-10-0-135-184.ec2.internal\" DevicePath \"\""
Jul 16 11:41:20.008323 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:41:20.008202    2564 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cc430a13-3b55-48d6-9948-06b603571fc4-istio-token\") on node \"ip-10-0-135-184.ec2.internal\" DevicePath \"\""
Jul 16 11:41:20.698960 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:41:20.698874    2564 generic.go:356] "Generic (PLEG): container finished" podID="cc430a13-3b55-48d6-9948-06b603571fc4" containerID="0fba8580481d6dbb8813b6c3fb23a6932397c5fc353fdd114d73198475995a10" exitCode=0
Jul 16 11:41:20.698960 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:41:20.698920    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-ca07b2-openshift-default-7c6464b649-548ft"
Jul 16 11:41:20.699149 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:41:20.698963    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-ca07b2-openshift-default-7c6464b649-548ft" event={"ID":"cc430a13-3b55-48d6-9948-06b603571fc4","Type":"ContainerDied","Data":"0fba8580481d6dbb8813b6c3fb23a6932397c5fc353fdd114d73198475995a10"}
Jul 16 11:41:20.699149 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:41:20.699014    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-ca07b2-openshift-default-7c6464b649-548ft" event={"ID":"cc430a13-3b55-48d6-9948-06b603571fc4","Type":"ContainerDied","Data":"b683acb8790adc159c361bbc6e97d33a92065e475efa15d01af0f65caf5712d5"}
Jul 16 11:41:20.699149 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:41:20.699038    2564 scope.go:117] "RemoveContainer" containerID="0fba8580481d6dbb8813b6c3fb23a6932397c5fc353fdd114d73198475995a10"
Jul 16 11:41:20.708050 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:41:20.708034    2564 scope.go:117] "RemoveContainer" containerID="703d110702bfb9556a63e36776a9028c66c07e293adf2722c537c437baa7e2e6"
Jul 16 11:41:20.716191 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:41:20.716173    2564 scope.go:117] "RemoveContainer" containerID="0fba8580481d6dbb8813b6c3fb23a6932397c5fc353fdd114d73198475995a10"
Jul 16 11:41:20.716436 ip-10-0-135-184 kubenswrapper[2564]: E0716 11:41:20.716418    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0fba8580481d6dbb8813b6c3fb23a6932397c5fc353fdd114d73198475995a10\": container with ID starting with 0fba8580481d6dbb8813b6c3fb23a6932397c5fc353fdd114d73198475995a10 not found: ID does not exist" containerID="0fba8580481d6dbb8813b6c3fb23a6932397c5fc353fdd114d73198475995a10"
Jul 16 11:41:20.716504 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:41:20.716448    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0fba8580481d6dbb8813b6c3fb23a6932397c5fc353fdd114d73198475995a10"} err="failed to get container status \"0fba8580481d6dbb8813b6c3fb23a6932397c5fc353fdd114d73198475995a10\": rpc error: code = NotFound desc = could not find container \"0fba8580481d6dbb8813b6c3fb23a6932397c5fc353fdd114d73198475995a10\": container with ID starting with 0fba8580481d6dbb8813b6c3fb23a6932397c5fc353fdd114d73198475995a10 not found: ID does not exist"
Jul 16 11:41:20.716504 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:41:20.716471    2564 scope.go:117] "RemoveContainer" containerID="703d110702bfb9556a63e36776a9028c66c07e293adf2722c537c437baa7e2e6"
Jul 16 11:41:20.716701 ip-10-0-135-184 kubenswrapper[2564]: E0716 11:41:20.716686    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"703d110702bfb9556a63e36776a9028c66c07e293adf2722c537c437baa7e2e6\": container with ID starting with 703d110702bfb9556a63e36776a9028c66c07e293adf2722c537c437baa7e2e6 not found: ID does not exist" containerID="703d110702bfb9556a63e36776a9028c66c07e293adf2722c537c437baa7e2e6"
Jul 16 11:41:20.716755 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:41:20.716712    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"703d110702bfb9556a63e36776a9028c66c07e293adf2722c537c437baa7e2e6"} err="failed to get container status \"703d110702bfb9556a63e36776a9028c66c07e293adf2722c537c437baa7e2e6\": rpc error: code = NotFound desc = could not find container \"703d110702bfb9556a63e36776a9028c66c07e293adf2722c537c437baa7e2e6\": container with ID starting with 703d110702bfb9556a63e36776a9028c66c07e293adf2722c537c437baa7e2e6 not found: ID does not exist"
Jul 16 11:41:20.716890 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:41:20.716873    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-ca07b2-openshift-default-7c6464b649-548ft"]
Jul 16 11:41:20.722191 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:41:20.722168    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-ca07b2-openshift-default-7c6464b649-548ft"]
Jul 16 11:41:22.303247 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:41:22.303213    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cc430a13-3b55-48d6-9948-06b603571fc4" path="/var/lib/kubelet/pods/cc430a13-3b55-48d6-9948-06b603571fc4/volumes"
Jul 16 11:41:23.202665 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:41:23.202630    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:41:23.669583 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:41:23.669543    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:41:23.951851 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:41:23.951613    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-e7dc57-openshift-default-68d67f7859-v69mk"]
Jul 16 11:41:23.955796 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:41:23.952296    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cc430a13-3b55-48d6-9948-06b603571fc4" containerName="istio-proxy"
Jul 16 11:41:23.955796 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:41:23.952320    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="cc430a13-3b55-48d6-9948-06b603571fc4" containerName="istio-proxy"
Jul 16 11:41:23.955796 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:41:23.952350    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cc430a13-3b55-48d6-9948-06b603571fc4" containerName="istio-proxy"
Jul 16 11:41:23.955796 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:41:23.952359    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="cc430a13-3b55-48d6-9948-06b603571fc4" containerName="istio-proxy"
Jul 16 11:41:23.955796 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:41:23.952452    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="cc430a13-3b55-48d6-9948-06b603571fc4" containerName="istio-proxy"
Jul 16 11:41:23.955796 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:41:23.952467    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="cc430a13-3b55-48d6-9948-06b603571fc4" containerName="istio-proxy"
Jul 16 11:41:23.969808 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:41:23.969759    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-e7dc57-openshift-default-68d67f7859-v69mk"
Jul 16 11:41:23.983861 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:41:23.978837    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-e7dc57-openshift-default-dockercfg-s2vhx\""
Jul 16 11:41:23.985845 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:41:23.985532    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-e7dc57-openshift-default-68d67f7859-v69mk"]
Jul 16 11:41:23.998106 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:41:23.998069    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:41:24.054802 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:41:24.050856    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/19d293c4-87a2-4b84-b01d-52409b481f2f-istio-envoy\") pod \"e2e-api-b-e7dc57-openshift-default-68d67f7859-v69mk\" (UID: \"19d293c4-87a2-4b84-b01d-52409b481f2f\") " pod="openshift-ingress/e2e-api-b-e7dc57-openshift-default-68d67f7859-v69mk"
Jul 16 11:41:24.064799 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:41:24.056143    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/19d293c4-87a2-4b84-b01d-52409b481f2f-istio-data\") pod \"e2e-api-b-e7dc57-openshift-default-68d67f7859-v69mk\" (UID: \"19d293c4-87a2-4b84-b01d-52409b481f2f\") " pod="openshift-ingress/e2e-api-b-e7dc57-openshift-default-68d67f7859-v69mk"
Jul 16 11:41:24.065143 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:41:24.065111    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/19d293c4-87a2-4b84-b01d-52409b481f2f-istio-token\") pod \"e2e-api-b-e7dc57-openshift-default-68d67f7859-v69mk\" (UID: \"19d293c4-87a2-4b84-b01d-52409b481f2f\") " pod="openshift-ingress/e2e-api-b-e7dc57-openshift-default-68d67f7859-v69mk"
Jul 16 11:41:24.065307 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:41:24.065290    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/19d293c4-87a2-4b84-b01d-52409b481f2f-workload-socket\") pod \"e2e-api-b-e7dc57-openshift-default-68d67f7859-v69mk\" (UID: \"19d293c4-87a2-4b84-b01d-52409b481f2f\") " pod="openshift-ingress/e2e-api-b-e7dc57-openshift-default-68d67f7859-v69mk"
Jul 16 11:41:24.065444 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:41:24.065427    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/19d293c4-87a2-4b84-b01d-52409b481f2f-credential-socket\") pod \"e2e-api-b-e7dc57-openshift-default-68d67f7859-v69mk\" (UID: \"19d293c4-87a2-4b84-b01d-52409b481f2f\") " pod="openshift-ingress/e2e-api-b-e7dc57-openshift-default-68d67f7859-v69mk"
Jul 16 11:41:24.065546 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:41:24.065533    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/19d293c4-87a2-4b84-b01d-52409b481f2f-istiod-ca-cert\") pod \"e2e-api-b-e7dc57-openshift-default-68d67f7859-v69mk\" (UID: \"19d293c4-87a2-4b84-b01d-52409b481f2f\") " pod="openshift-ingress/e2e-api-b-e7dc57-openshift-default-68d67f7859-v69mk"
Jul 16 11:41:24.065668 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:41:24.065654    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fqxkd\" (UniqueName: \"kubernetes.io/projected/19d293c4-87a2-4b84-b01d-52409b481f2f-kube-api-access-fqxkd\") pod \"e2e-api-b-e7dc57-openshift-default-68d67f7859-v69mk\" (UID: \"19d293c4-87a2-4b84-b01d-52409b481f2f\") " pod="openshift-ingress/e2e-api-b-e7dc57-openshift-default-68d67f7859-v69mk"
Jul 16 11:41:24.065833 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:41:24.065816    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/19d293c4-87a2-4b84-b01d-52409b481f2f-workload-certs\") pod \"e2e-api-b-e7dc57-openshift-default-68d67f7859-v69mk\" (UID: \"19d293c4-87a2-4b84-b01d-52409b481f2f\") " pod="openshift-ingress/e2e-api-b-e7dc57-openshift-default-68d67f7859-v69mk"
Jul 16 11:41:24.066030 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:41:24.066015    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/19d293c4-87a2-4b84-b01d-52409b481f2f-istio-podinfo\") pod \"e2e-api-b-e7dc57-openshift-default-68d67f7859-v69mk\" (UID: \"19d293c4-87a2-4b84-b01d-52409b481f2f\") " pod="openshift-ingress/e2e-api-b-e7dc57-openshift-default-68d67f7859-v69mk"
Jul 16 11:41:24.167038 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:41:24.166997    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/19d293c4-87a2-4b84-b01d-52409b481f2f-workload-certs\") pod \"e2e-api-b-e7dc57-openshift-default-68d67f7859-v69mk\" (UID: \"19d293c4-87a2-4b84-b01d-52409b481f2f\") " pod="openshift-ingress/e2e-api-b-e7dc57-openshift-default-68d67f7859-v69mk"
Jul 16 11:41:24.167964 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:41:24.167935    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/19d293c4-87a2-4b84-b01d-52409b481f2f-istio-podinfo\") pod \"e2e-api-b-e7dc57-openshift-default-68d67f7859-v69mk\" (UID: \"19d293c4-87a2-4b84-b01d-52409b481f2f\") " pod="openshift-ingress/e2e-api-b-e7dc57-openshift-default-68d67f7859-v69mk"
Jul 16 11:41:24.168681 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:41:24.168659    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/19d293c4-87a2-4b84-b01d-52409b481f2f-istio-envoy\") pod \"e2e-api-b-e7dc57-openshift-default-68d67f7859-v69mk\" (UID: \"19d293c4-87a2-4b84-b01d-52409b481f2f\") " pod="openshift-ingress/e2e-api-b-e7dc57-openshift-default-68d67f7859-v69mk"
Jul 16 11:41:24.169312 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:41:24.169287    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/19d293c4-87a2-4b84-b01d-52409b481f2f-istio-data\") pod \"e2e-api-b-e7dc57-openshift-default-68d67f7859-v69mk\" (UID: \"19d293c4-87a2-4b84-b01d-52409b481f2f\") " pod="openshift-ingress/e2e-api-b-e7dc57-openshift-default-68d67f7859-v69mk"
Jul 16 11:41:24.169488 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:41:24.169470    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/19d293c4-87a2-4b84-b01d-52409b481f2f-istio-token\") pod \"e2e-api-b-e7dc57-openshift-default-68d67f7859-v69mk\" (UID: \"19d293c4-87a2-4b84-b01d-52409b481f2f\") " pod="openshift-ingress/e2e-api-b-e7dc57-openshift-default-68d67f7859-v69mk"
Jul 16 11:41:24.169634 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:41:24.169618    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/19d293c4-87a2-4b84-b01d-52409b481f2f-workload-socket\") pod \"e2e-api-b-e7dc57-openshift-default-68d67f7859-v69mk\" (UID: \"19d293c4-87a2-4b84-b01d-52409b481f2f\") " pod="openshift-ingress/e2e-api-b-e7dc57-openshift-default-68d67f7859-v69mk"
Jul 16 11:41:24.169802 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:41:24.169761    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/19d293c4-87a2-4b84-b01d-52409b481f2f-credential-socket\") pod \"e2e-api-b-e7dc57-openshift-default-68d67f7859-v69mk\" (UID: \"19d293c4-87a2-4b84-b01d-52409b481f2f\") " pod="openshift-ingress/e2e-api-b-e7dc57-openshift-default-68d67f7859-v69mk"
Jul 16 11:41:24.169945 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:41:24.169931    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/19d293c4-87a2-4b84-b01d-52409b481f2f-istiod-ca-cert\") pod \"e2e-api-b-e7dc57-openshift-default-68d67f7859-v69mk\" (UID: \"19d293c4-87a2-4b84-b01d-52409b481f2f\") " pod="openshift-ingress/e2e-api-b-e7dc57-openshift-default-68d67f7859-v69mk"
Jul 16 11:41:24.170123 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:41:24.170092    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fqxkd\" (UniqueName: \"kubernetes.io/projected/19d293c4-87a2-4b84-b01d-52409b481f2f-kube-api-access-fqxkd\") pod \"e2e-api-b-e7dc57-openshift-default-68d67f7859-v69mk\" (UID: \"19d293c4-87a2-4b84-b01d-52409b481f2f\") " pod="openshift-ingress/e2e-api-b-e7dc57-openshift-default-68d67f7859-v69mk"
Jul 16 11:41:24.170813 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:41:24.167765    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/19d293c4-87a2-4b84-b01d-52409b481f2f-workload-certs\") pod \"e2e-api-b-e7dc57-openshift-default-68d67f7859-v69mk\" (UID: \"19d293c4-87a2-4b84-b01d-52409b481f2f\") " pod="openshift-ingress/e2e-api-b-e7dc57-openshift-default-68d67f7859-v69mk"
Jul 16 11:41:24.171314 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:41:24.171283    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/19d293c4-87a2-4b84-b01d-52409b481f2f-istio-data\") pod \"e2e-api-b-e7dc57-openshift-default-68d67f7859-v69mk\" (UID: \"19d293c4-87a2-4b84-b01d-52409b481f2f\") " pod="openshift-ingress/e2e-api-b-e7dc57-openshift-default-68d67f7859-v69mk"
Jul 16 11:41:24.172124 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:41:24.172106    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/19d293c4-87a2-4b84-b01d-52409b481f2f-workload-socket\") pod \"e2e-api-b-e7dc57-openshift-default-68d67f7859-v69mk\" (UID: \"19d293c4-87a2-4b84-b01d-52409b481f2f\") " pod="openshift-ingress/e2e-api-b-e7dc57-openshift-default-68d67f7859-v69mk"
Jul 16 11:41:24.172323 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:41:24.172300    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/19d293c4-87a2-4b84-b01d-52409b481f2f-istio-envoy\") pod \"e2e-api-b-e7dc57-openshift-default-68d67f7859-v69mk\" (UID: \"19d293c4-87a2-4b84-b01d-52409b481f2f\") " pod="openshift-ingress/e2e-api-b-e7dc57-openshift-default-68d67f7859-v69mk"
Jul 16 11:41:24.172735 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:41:24.172707    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/19d293c4-87a2-4b84-b01d-52409b481f2f-credential-socket\") pod \"e2e-api-b-e7dc57-openshift-default-68d67f7859-v69mk\" (UID: \"19d293c4-87a2-4b84-b01d-52409b481f2f\") " pod="openshift-ingress/e2e-api-b-e7dc57-openshift-default-68d67f7859-v69mk"
Jul 16 11:41:24.173062 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:41:24.173041    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/19d293c4-87a2-4b84-b01d-52409b481f2f-istiod-ca-cert\") pod \"e2e-api-b-e7dc57-openshift-default-68d67f7859-v69mk\" (UID: \"19d293c4-87a2-4b84-b01d-52409b481f2f\") " pod="openshift-ingress/e2e-api-b-e7dc57-openshift-default-68d67f7859-v69mk"
Jul 16 11:41:24.176273 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:41:24.176242    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/19d293c4-87a2-4b84-b01d-52409b481f2f-istio-podinfo\") pod \"e2e-api-b-e7dc57-openshift-default-68d67f7859-v69mk\" (UID: \"19d293c4-87a2-4b84-b01d-52409b481f2f\") " pod="openshift-ingress/e2e-api-b-e7dc57-openshift-default-68d67f7859-v69mk"
Jul 16 11:41:24.181105 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:41:24.181024    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:41:24.181105 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:41:24.181077    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/19d293c4-87a2-4b84-b01d-52409b481f2f-istio-token\") pod \"e2e-api-b-e7dc57-openshift-default-68d67f7859-v69mk\" (UID: \"19d293c4-87a2-4b84-b01d-52409b481f2f\") " pod="openshift-ingress/e2e-api-b-e7dc57-openshift-default-68d67f7859-v69mk"
Jul 16 11:41:24.181683 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:41:24.181644    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fqxkd\" (UniqueName: \"kubernetes.io/projected/19d293c4-87a2-4b84-b01d-52409b481f2f-kube-api-access-fqxkd\") pod \"e2e-api-b-e7dc57-openshift-default-68d67f7859-v69mk\" (UID: \"19d293c4-87a2-4b84-b01d-52409b481f2f\") " pod="openshift-ingress/e2e-api-b-e7dc57-openshift-default-68d67f7859-v69mk"
Jul 16 11:41:24.295272 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:41:24.295233    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-e7dc57-openshift-default-68d67f7859-v69mk"
Jul 16 11:41:24.479664 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:41:24.479628    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-e7dc57-openshift-default-68d67f7859-v69mk"]
Jul 16 11:41:24.481337 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:41:24.481297    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod19d293c4_87a2_4b84_b01d_52409b481f2f.slice/crio-2d82eff017dc85fb453ca67e9bc0632130901c54f4297d169e92bb4b005506be WatchSource:0}: Error finding container 2d82eff017dc85fb453ca67e9bc0632130901c54f4297d169e92bb4b005506be: Status 404 returned error can't find the container with id 2d82eff017dc85fb453ca67e9bc0632130901c54f4297d169e92bb4b005506be
Jul 16 11:41:24.483690 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:41:24.483647    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 16 11:41:24.483827 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:41:24.483808    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 16 11:41:24.483917 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:41:24.483846    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 16 11:41:24.726566 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:41:24.726534    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-e7dc57-openshift-default-68d67f7859-v69mk" event={"ID":"19d293c4-87a2-4b84-b01d-52409b481f2f","Type":"ContainerStarted","Data":"6ce478d551d226e5a63dda2fdcea3abf0fc81b52f02557661c242959eeea2c39"}
Jul 16 11:41:24.727072 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:41:24.726591    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-e7dc57-openshift-default-68d67f7859-v69mk" event={"ID":"19d293c4-87a2-4b84-b01d-52409b481f2f","Type":"ContainerStarted","Data":"2d82eff017dc85fb453ca67e9bc0632130901c54f4297d169e92bb4b005506be"}
Jul 16 11:41:24.773197 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:41:24.773129    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-e7dc57-openshift-default-68d67f7859-v69mk" podStartSLOduration=1.7731037330000001 podStartE2EDuration="1.773103733s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 11:41:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 11:41:24.771499983 +0000 UTC m=+1985.143037065" watchObservedRunningTime="2026-07-16 11:41:24.773103733 +0000 UTC m=+1985.144640774"
Jul 16 11:41:25.295864 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:41:25.295808    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-e7dc57-openshift-default-68d67f7859-v69mk"
Jul 16 11:41:25.301099 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:41:25.301063    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-e7dc57-openshift-default-68d67f7859-v69mk"
Jul 16 11:41:25.667863 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:41:25.665749    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:41:25.732455 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:41:25.732426    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-e7dc57-openshift-default-68d67f7859-v69mk"
Jul 16 11:41:25.733430 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:41:25.733412    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-e7dc57-openshift-default-68d67f7859-v69mk"
Jul 16 11:41:25.761860 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:41:25.761819    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:41:25.883914 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:41:25.883650    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:41:26.204563 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:41:26.204525    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:41:26.400698 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:41:26.400637    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:41:26.501822 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:41:26.501784    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:41:31.141520 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:41:31.141486    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:41:31.775703 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:41:31.775661    2564 generic.go:356] "Generic (PLEG): container finished" podID="8c42ced8-e23d-4083-95e8-dea6bc944903" containerID="dc048f7e6f7389201a5a3e1d574c4c5249c410347af92dc4cd13cc959c123e9d" exitCode=0
Jul 16 11:41:31.775978 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:41:31.775737    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-959ed9-openshift-default-544655d677-gcvbj" event={"ID":"8c42ced8-e23d-4083-95e8-dea6bc944903","Type":"ContainerDied","Data":"dc048f7e6f7389201a5a3e1d574c4c5249c410347af92dc4cd13cc959c123e9d"}
Jul 16 11:41:31.776241 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:41:31.776225    2564 scope.go:117] "RemoveContainer" containerID="dc048f7e6f7389201a5a3e1d574c4c5249c410347af92dc4cd13cc959c123e9d"
Jul 16 11:41:31.777359 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:41:31.777326    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 16 11:41:31.777463 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:41:31.777416    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 16 11:41:31.777529 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:41:31.777462    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 16 11:41:32.683355 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:41:32.683308    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-959ed9-openshift-default-544655d677-gcvbj"
Jul 16 11:41:32.783930 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:41:32.783895    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-959ed9-openshift-default-544655d677-gcvbj" event={"ID":"8c42ced8-e23d-4083-95e8-dea6bc944903","Type":"ContainerStarted","Data":"ec96d3091195c01606e131aee17a18ef42a10a8e956cb88288827571f0f3cfbe"}
Jul 16 11:41:33.747051 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:41:33.747012    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-959ed9-openshift-default-544655d677-gcvbj"
Jul 16 11:41:33.748446 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:41:33.748418    2564 patch_prober.go:28] interesting pod/e2e-api-a-959ed9-openshift-default-544655d677-gcvbj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused" start-of-body=
Jul 16 11:41:33.748576 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:41:33.748471    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-959ed9-openshift-default-544655d677-gcvbj" podUID="8c42ced8-e23d-4083-95e8-dea6bc944903" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused"
Jul 16 11:41:34.747977 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:41:34.747940    2564 patch_prober.go:28] interesting pod/e2e-api-a-959ed9-openshift-default-544655d677-gcvbj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused" start-of-body=
Jul 16 11:41:34.748374 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:41:34.747999    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-959ed9-openshift-default-544655d677-gcvbj" podUID="8c42ced8-e23d-4083-95e8-dea6bc944903" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused"
Jul 16 11:41:35.747171 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:41:35.747130    2564 patch_prober.go:28] interesting pod/e2e-api-a-959ed9-openshift-default-544655d677-gcvbj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused" start-of-body=
Jul 16 11:41:35.747369 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:41:35.747188    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-959ed9-openshift-default-544655d677-gcvbj" podUID="8c42ced8-e23d-4083-95e8-dea6bc944903" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused"
Jul 16 11:41:36.746917 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:41:36.746882    2564 patch_prober.go:28] interesting pod/e2e-api-a-959ed9-openshift-default-544655d677-gcvbj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused" start-of-body=
Jul 16 11:41:36.747318 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:41:36.746938    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-959ed9-openshift-default-544655d677-gcvbj" podUID="8c42ced8-e23d-4083-95e8-dea6bc944903" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused"
Jul 16 11:41:37.753396 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:41:37.753358    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-959ed9-openshift-default-544655d677-gcvbj"
Jul 16 11:41:37.754752 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:41:37.754712    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-959ed9-openshift-default-544655d677-gcvbj"
Jul 16 11:41:37.766147 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:41:37.766042    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-959ed9-openshift-default-544655d677-gcvbj"
Jul 16 11:41:39.331388 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:41:39.331356    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:41:40.007858 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:41:40.007812    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:41:40.077616 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:41:40.077580    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:41:41.775903 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:41:41.775868    2564 patch_prober.go:28] interesting pod/e2e-api-b-e7dc57-openshift-default-68d67f7859-v69mk container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.61:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 16 11:41:41.776318 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:41:41.775934    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-b-e7dc57-openshift-default-68d67f7859-v69mk" podUID="19d293c4-87a2-4b84-b01d-52409b481f2f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.61:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 16 11:41:42.277077 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:41:42.277042    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:41:43.853053 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:41:43.853021    2564 generic.go:356] "Generic (PLEG): container finished" podID="19d293c4-87a2-4b84-b01d-52409b481f2f" containerID="6ce478d551d226e5a63dda2fdcea3abf0fc81b52f02557661c242959eeea2c39" exitCode=0
Jul 16 11:41:43.853496 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:41:43.853094    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-e7dc57-openshift-default-68d67f7859-v69mk" event={"ID":"19d293c4-87a2-4b84-b01d-52409b481f2f","Type":"ContainerDied","Data":"6ce478d551d226e5a63dda2fdcea3abf0fc81b52f02557661c242959eeea2c39"}
Jul 16 11:41:43.853542 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:41:43.853513    2564 scope.go:117] "RemoveContainer" containerID="6ce478d551d226e5a63dda2fdcea3abf0fc81b52f02557661c242959eeea2c39"
Jul 16 11:41:43.854584 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:41:43.854554    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 16 11:41:43.854694 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:41:43.854623    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 16 11:41:43.854694 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:41:43.854655    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 16 11:41:44.523103 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:41:44.523059    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:41:44.865860 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:41:44.865697    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-e7dc57-openshift-default-68d67f7859-v69mk" event={"ID":"19d293c4-87a2-4b84-b01d-52409b481f2f","Type":"ContainerStarted","Data":"0c54ee71f469eaca5e107a3f69d973f9fccdb59fd7d5fed95e2b7a0e6aeebf80"}
Jul 16 11:41:45.296010 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:41:45.295972    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-e7dc57-openshift-default-68d67f7859-v69mk"
Jul 16 11:41:45.296253 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:41:45.296231    2564 patch_prober.go:28] interesting pod/e2e-api-b-e7dc57-openshift-default-68d67f7859-v69mk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused" start-of-body=
Jul 16 11:41:45.296317 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:41:45.296298    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-e7dc57-openshift-default-68d67f7859-v69mk" podUID="19d293c4-87a2-4b84-b01d-52409b481f2f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused"
Jul 16 11:41:45.692103 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:41:45.692007    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:41:46.295737 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:41:46.295686    2564 patch_prober.go:28] interesting pod/e2e-api-b-e7dc57-openshift-default-68d67f7859-v69mk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused" start-of-body=
Jul 16 11:41:46.296211 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:41:46.295805    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-e7dc57-openshift-default-68d67f7859-v69mk" podUID="19d293c4-87a2-4b84-b01d-52409b481f2f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused"
Jul 16 11:41:47.296293 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:41:47.296251    2564 patch_prober.go:28] interesting pod/e2e-api-b-e7dc57-openshift-default-68d67f7859-v69mk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused" start-of-body=
Jul 16 11:41:47.296719 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:41:47.296316    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-e7dc57-openshift-default-68d67f7859-v69mk" podUID="19d293c4-87a2-4b84-b01d-52409b481f2f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused"
Jul 16 11:41:47.426006 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:41:47.425971    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:41:47.656230 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:41:47.656109    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:41:48.295735 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:41:48.295689    2564 patch_prober.go:28] interesting pod/e2e-api-b-e7dc57-openshift-default-68d67f7859-v69mk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused" start-of-body=
Jul 16 11:41:48.295956 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:41:48.295804    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-e7dc57-openshift-default-68d67f7859-v69mk" podUID="19d293c4-87a2-4b84-b01d-52409b481f2f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused"
Jul 16 11:41:49.299343 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:41:49.299312    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-e7dc57-openshift-default-68d67f7859-v69mk"
Jul 16 11:41:49.299784 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:41:49.299594    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-e7dc57-openshift-default-68d67f7859-v69mk"
Jul 16 11:41:49.300329 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:41:49.300309    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-e7dc57-openshift-default-68d67f7859-v69mk"
Jul 16 11:41:51.758791 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:41:51.758738    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:41:51.860454 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:41:51.860415    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:41:51.977518 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:41:51.977482    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-959ed9-openshift-default-544655d677-gcvbj"]
Jul 16 11:41:51.977720 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:41:51.977696    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-959ed9-openshift-default-544655d677-gcvbj" podUID="8c42ced8-e23d-4083-95e8-dea6bc944903" containerName="istio-proxy" containerID="cri-o://ec96d3091195c01606e131aee17a18ef42a10a8e956cb88288827571f0f3cfbe" gracePeriod=30
Jul 16 11:41:52.002601 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:41:52.002566    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:41:52.217221 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:41:52.217130    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:41:52.654028 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:41:52.653990    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:41:52.757385 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:41:52.757348    2564 patch_prober.go:28] interesting pod/e2e-api-a-959ed9-openshift-default-544655d677-gcvbj container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 16 11:41:52.757551 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:41:52.757407    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-959ed9-openshift-default-544655d677-gcvbj" podUID="8c42ced8-e23d-4083-95e8-dea6bc944903" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 16 11:41:57.266228 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:41:57.266192    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-959ed9-openshift-default-544655d677-gcvbj"
Jul 16 11:41:57.436980 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:41:57.436940    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8c42ced8-e23d-4083-95e8-dea6bc944903-istio-envoy\") pod \"8c42ced8-e23d-4083-95e8-dea6bc944903\" (UID: \"8c42ced8-e23d-4083-95e8-dea6bc944903\") "
Jul 16 11:41:57.436980 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:41:57.436977    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8c42ced8-e23d-4083-95e8-dea6bc944903-istio-data\") pod \"8c42ced8-e23d-4083-95e8-dea6bc944903\" (UID: \"8c42ced8-e23d-4083-95e8-dea6bc944903\") "
Jul 16 11:41:57.437293 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:41:57.437018    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8c42ced8-e23d-4083-95e8-dea6bc944903-istio-podinfo\") pod \"8c42ced8-e23d-4083-95e8-dea6bc944903\" (UID: \"8c42ced8-e23d-4083-95e8-dea6bc944903\") "
Jul 16 11:41:57.437293 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:41:57.437036    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8c42ced8-e23d-4083-95e8-dea6bc944903-credential-socket\") pod \"8c42ced8-e23d-4083-95e8-dea6bc944903\" (UID: \"8c42ced8-e23d-4083-95e8-dea6bc944903\") "
Jul 16 11:41:57.437293 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:41:57.437067    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8c42ced8-e23d-4083-95e8-dea6bc944903-workload-certs\") pod \"8c42ced8-e23d-4083-95e8-dea6bc944903\" (UID: \"8c42ced8-e23d-4083-95e8-dea6bc944903\") "
Jul 16 11:41:57.437293 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:41:57.437100    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8c42ced8-e23d-4083-95e8-dea6bc944903-istiod-ca-cert\") pod \"8c42ced8-e23d-4083-95e8-dea6bc944903\" (UID: \"8c42ced8-e23d-4083-95e8-dea6bc944903\") "
Jul 16 11:41:57.437293 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:41:57.437166    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8c42ced8-e23d-4083-95e8-dea6bc944903-workload-socket\") pod \"8c42ced8-e23d-4083-95e8-dea6bc944903\" (UID: \"8c42ced8-e23d-4083-95e8-dea6bc944903\") "
Jul 16 11:41:57.437293 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:41:57.437223    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8c42ced8-e23d-4083-95e8-dea6bc944903-istio-token\") pod \"8c42ced8-e23d-4083-95e8-dea6bc944903\" (UID: \"8c42ced8-e23d-4083-95e8-dea6bc944903\") "
Jul 16 11:41:57.437293 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:41:57.437254    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-chzlr\" (UniqueName: \"kubernetes.io/projected/8c42ced8-e23d-4083-95e8-dea6bc944903-kube-api-access-chzlr\") pod \"8c42ced8-e23d-4083-95e8-dea6bc944903\" (UID: \"8c42ced8-e23d-4083-95e8-dea6bc944903\") "
Jul 16 11:41:57.437658 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:41:57.437458    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8c42ced8-e23d-4083-95e8-dea6bc944903-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "8c42ced8-e23d-4083-95e8-dea6bc944903" (UID: "8c42ced8-e23d-4083-95e8-dea6bc944903"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 11:41:57.437658 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:41:57.437474    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8c42ced8-e23d-4083-95e8-dea6bc944903-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "8c42ced8-e23d-4083-95e8-dea6bc944903" (UID: "8c42ced8-e23d-4083-95e8-dea6bc944903"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 11:41:57.437658 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:41:57.437456    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8c42ced8-e23d-4083-95e8-dea6bc944903-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "8c42ced8-e23d-4083-95e8-dea6bc944903" (UID: "8c42ced8-e23d-4083-95e8-dea6bc944903"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 11:41:57.437878 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:41:57.437848    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8c42ced8-e23d-4083-95e8-dea6bc944903-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "8c42ced8-e23d-4083-95e8-dea6bc944903" (UID: "8c42ced8-e23d-4083-95e8-dea6bc944903"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 11:41:57.438112 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:41:57.438089    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8c42ced8-e23d-4083-95e8-dea6bc944903-istio-data" (OuterVolumeSpecName: "istio-data") pod "8c42ced8-e23d-4083-95e8-dea6bc944903" (UID: "8c42ced8-e23d-4083-95e8-dea6bc944903"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 11:41:57.439379 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:41:57.439353    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/8c42ced8-e23d-4083-95e8-dea6bc944903-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "8c42ced8-e23d-4083-95e8-dea6bc944903" (UID: "8c42ced8-e23d-4083-95e8-dea6bc944903"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 16 11:41:57.439661 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:41:57.439645    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8c42ced8-e23d-4083-95e8-dea6bc944903-kube-api-access-chzlr" (OuterVolumeSpecName: "kube-api-access-chzlr") pod "8c42ced8-e23d-4083-95e8-dea6bc944903" (UID: "8c42ced8-e23d-4083-95e8-dea6bc944903"). InnerVolumeSpecName "kube-api-access-chzlr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 11:41:57.439945 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:41:57.439918    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8c42ced8-e23d-4083-95e8-dea6bc944903-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "8c42ced8-e23d-4083-95e8-dea6bc944903" (UID: "8c42ced8-e23d-4083-95e8-dea6bc944903"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 11:41:57.440028 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:41:57.439924    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8c42ced8-e23d-4083-95e8-dea6bc944903-istio-token" (OuterVolumeSpecName: "istio-token") pod "8c42ced8-e23d-4083-95e8-dea6bc944903" (UID: "8c42ced8-e23d-4083-95e8-dea6bc944903"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 11:41:57.538647 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:41:57.538608    2564 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8c42ced8-e23d-4083-95e8-dea6bc944903-workload-certs\") on node \"ip-10-0-135-184.ec2.internal\" DevicePath \"\""
Jul 16 11:41:57.538647 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:41:57.538641    2564 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8c42ced8-e23d-4083-95e8-dea6bc944903-istiod-ca-cert\") on node \"ip-10-0-135-184.ec2.internal\" DevicePath \"\""
Jul 16 11:41:57.538926 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:41:57.538657    2564 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8c42ced8-e23d-4083-95e8-dea6bc944903-workload-socket\") on node \"ip-10-0-135-184.ec2.internal\" DevicePath \"\""
Jul 16 11:41:57.538926 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:41:57.538671    2564 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8c42ced8-e23d-4083-95e8-dea6bc944903-istio-token\") on node \"ip-10-0-135-184.ec2.internal\" DevicePath \"\""
Jul 16 11:41:57.538926 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:41:57.538683    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-chzlr\" (UniqueName: \"kubernetes.io/projected/8c42ced8-e23d-4083-95e8-dea6bc944903-kube-api-access-chzlr\") on node \"ip-10-0-135-184.ec2.internal\" DevicePath \"\""
Jul 16 11:41:57.538926 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:41:57.538694    2564 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8c42ced8-e23d-4083-95e8-dea6bc944903-istio-envoy\") on node \"ip-10-0-135-184.ec2.internal\" DevicePath \"\""
Jul 16 11:41:57.538926 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:41:57.538705    2564 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8c42ced8-e23d-4083-95e8-dea6bc944903-istio-data\") on node \"ip-10-0-135-184.ec2.internal\" DevicePath \"\""
Jul 16 11:41:57.538926 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:41:57.538715    2564 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8c42ced8-e23d-4083-95e8-dea6bc944903-istio-podinfo\") on node \"ip-10-0-135-184.ec2.internal\" DevicePath \"\""
Jul 16 11:41:57.538926 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:41:57.538725    2564 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8c42ced8-e23d-4083-95e8-dea6bc944903-credential-socket\") on node \"ip-10-0-135-184.ec2.internal\" DevicePath \"\""
Jul 16 11:41:57.888573 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:41:57.888482    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:41:57.950148 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:41:57.950113    2564 generic.go:356] "Generic (PLEG): container finished" podID="8c42ced8-e23d-4083-95e8-dea6bc944903" containerID="ec96d3091195c01606e131aee17a18ef42a10a8e956cb88288827571f0f3cfbe" exitCode=0
Jul 16 11:41:57.950325 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:41:57.950173    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-959ed9-openshift-default-544655d677-gcvbj" event={"ID":"8c42ced8-e23d-4083-95e8-dea6bc944903","Type":"ContainerDied","Data":"ec96d3091195c01606e131aee17a18ef42a10a8e956cb88288827571f0f3cfbe"}
Jul 16 11:41:57.950325 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:41:57.950222    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-959ed9-openshift-default-544655d677-gcvbj" event={"ID":"8c42ced8-e23d-4083-95e8-dea6bc944903","Type":"ContainerDied","Data":"0838d0c355f9b1e670b460d9f98109e0951005b64de1d970756d4ba3c2c5faca"}
Jul 16 11:41:57.950325 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:41:57.950247    2564 scope.go:117] "RemoveContainer" containerID="ec96d3091195c01606e131aee17a18ef42a10a8e956cb88288827571f0f3cfbe"
Jul 16 11:41:57.950325 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:41:57.950173    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-959ed9-openshift-default-544655d677-gcvbj"
Jul 16 11:41:57.961262 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:41:57.961240    2564 scope.go:117] "RemoveContainer" containerID="dc048f7e6f7389201a5a3e1d574c4c5249c410347af92dc4cd13cc959c123e9d"
Jul 16 11:41:57.970947 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:41:57.970925    2564 scope.go:117] "RemoveContainer" containerID="ec96d3091195c01606e131aee17a18ef42a10a8e956cb88288827571f0f3cfbe"
Jul 16 11:41:57.971294 ip-10-0-135-184 kubenswrapper[2564]: E0716 11:41:57.971273    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ec96d3091195c01606e131aee17a18ef42a10a8e956cb88288827571f0f3cfbe\": container with ID starting with ec96d3091195c01606e131aee17a18ef42a10a8e956cb88288827571f0f3cfbe not found: ID does not exist" containerID="ec96d3091195c01606e131aee17a18ef42a10a8e956cb88288827571f0f3cfbe"
Jul 16 11:41:57.971372 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:41:57.971311    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ec96d3091195c01606e131aee17a18ef42a10a8e956cb88288827571f0f3cfbe"} err="failed to get container status \"ec96d3091195c01606e131aee17a18ef42a10a8e956cb88288827571f0f3cfbe\": rpc error: code = NotFound desc = could not find container \"ec96d3091195c01606e131aee17a18ef42a10a8e956cb88288827571f0f3cfbe\": container with ID starting with ec96d3091195c01606e131aee17a18ef42a10a8e956cb88288827571f0f3cfbe not found: ID does not exist"
Jul 16 11:41:57.971372 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:41:57.971340    2564 scope.go:117] "RemoveContainer" containerID="dc048f7e6f7389201a5a3e1d574c4c5249c410347af92dc4cd13cc959c123e9d"
Jul 16 11:41:57.971740 ip-10-0-135-184 kubenswrapper[2564]: E0716 11:41:57.971708    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dc048f7e6f7389201a5a3e1d574c4c5249c410347af92dc4cd13cc959c123e9d\": container with ID starting with dc048f7e6f7389201a5a3e1d574c4c5249c410347af92dc4cd13cc959c123e9d not found: ID does not exist" containerID="dc048f7e6f7389201a5a3e1d574c4c5249c410347af92dc4cd13cc959c123e9d"
Jul 16 11:41:57.971888 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:41:57.971752    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dc048f7e6f7389201a5a3e1d574c4c5249c410347af92dc4cd13cc959c123e9d"} err="failed to get container status \"dc048f7e6f7389201a5a3e1d574c4c5249c410347af92dc4cd13cc959c123e9d\": rpc error: code = NotFound desc = could not find container \"dc048f7e6f7389201a5a3e1d574c4c5249c410347af92dc4cd13cc959c123e9d\": container with ID starting with dc048f7e6f7389201a5a3e1d574c4c5249c410347af92dc4cd13cc959c123e9d not found: ID does not exist"
Jul 16 11:41:57.974601 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:41:57.974570    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-959ed9-openshift-default-544655d677-gcvbj"]
Jul 16 11:41:57.978049 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:41:57.978018    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-959ed9-openshift-default-544655d677-gcvbj"]
Jul 16 11:41:58.302917 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:41:58.302875    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8c42ced8-e23d-4083-95e8-dea6bc944903" path="/var/lib/kubelet/pods/8c42ced8-e23d-4083-95e8-dea6bc944903/volumes"
Jul 16 11:41:58.960061 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:41:58.960030    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:42:04.936058 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:42:04.936026    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:42:05.036420 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:42:05.036384    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:42:05.197762 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:42:05.197670    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-e7dc57-openshift-default-68d67f7859-v69mk"]
Jul 16 11:42:05.197949 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:42:05.197931    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-e7dc57-openshift-default-68d67f7859-v69mk" podUID="19d293c4-87a2-4b84-b01d-52409b481f2f" containerName="istio-proxy" containerID="cri-o://0c54ee71f469eaca5e107a3f69d973f9fccdb59fd7d5fed95e2b7a0e6aeebf80" gracePeriod=30
Jul 16 11:42:05.216625 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:42:05.216578    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:42:05.464137 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:42:05.464044    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:42:06.087245 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:42:06.087209    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-bfa604-openshift-default-ff9cbd879-ckds8"]
Jul 16 11:42:06.088031 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:42:06.088007    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8c42ced8-e23d-4083-95e8-dea6bc944903" containerName="istio-proxy"
Jul 16 11:42:06.088031 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:42:06.088031    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="8c42ced8-e23d-4083-95e8-dea6bc944903" containerName="istio-proxy"
Jul 16 11:42:06.088199 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:42:06.088047    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8c42ced8-e23d-4083-95e8-dea6bc944903" containerName="istio-proxy"
Jul 16 11:42:06.088199 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:42:06.088054    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="8c42ced8-e23d-4083-95e8-dea6bc944903" containerName="istio-proxy"
Jul 16 11:42:06.088199 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:42:06.088165    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="8c42ced8-e23d-4083-95e8-dea6bc944903" containerName="istio-proxy"
Jul 16 11:42:06.088199 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:42:06.088178    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="8c42ced8-e23d-4083-95e8-dea6bc944903" containerName="istio-proxy"
Jul 16 11:42:06.093039 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:42:06.093009    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-bfa604-openshift-default-ff9cbd879-ckds8"
Jul 16 11:42:06.095264 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:42:06.095241    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-bfa604-openshift-default-dockercfg-tcnzp\""
Jul 16 11:42:06.102846 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:42:06.102813    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-bfa604-openshift-default-ff9cbd879-ckds8"]
Jul 16 11:42:06.121874 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:42:06.121834    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/210973ab-ee81-4502-92c9-7e76da6f92ee-credential-socket\") pod \"e2e-shared-a-bfa604-openshift-default-ff9cbd879-ckds8\" (UID: \"210973ab-ee81-4502-92c9-7e76da6f92ee\") " pod="openshift-ingress/e2e-shared-a-bfa604-openshift-default-ff9cbd879-ckds8"
Jul 16 11:42:06.122073 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:42:06.121900    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/210973ab-ee81-4502-92c9-7e76da6f92ee-istiod-ca-cert\") pod \"e2e-shared-a-bfa604-openshift-default-ff9cbd879-ckds8\" (UID: \"210973ab-ee81-4502-92c9-7e76da6f92ee\") " pod="openshift-ingress/e2e-shared-a-bfa604-openshift-default-ff9cbd879-ckds8"
Jul 16 11:42:06.122073 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:42:06.121926    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v67bv\" (UniqueName: \"kubernetes.io/projected/210973ab-ee81-4502-92c9-7e76da6f92ee-kube-api-access-v67bv\") pod \"e2e-shared-a-bfa604-openshift-default-ff9cbd879-ckds8\" (UID: \"210973ab-ee81-4502-92c9-7e76da6f92ee\") " pod="openshift-ingress/e2e-shared-a-bfa604-openshift-default-ff9cbd879-ckds8"
Jul 16 11:42:06.122073 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:42:06.121953    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/210973ab-ee81-4502-92c9-7e76da6f92ee-workload-socket\") pod \"e2e-shared-a-bfa604-openshift-default-ff9cbd879-ckds8\" (UID: \"210973ab-ee81-4502-92c9-7e76da6f92ee\") " pod="openshift-ingress/e2e-shared-a-bfa604-openshift-default-ff9cbd879-ckds8"
Jul 16 11:42:06.122073 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:42:06.122065    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/210973ab-ee81-4502-92c9-7e76da6f92ee-istio-podinfo\") pod \"e2e-shared-a-bfa604-openshift-default-ff9cbd879-ckds8\" (UID: \"210973ab-ee81-4502-92c9-7e76da6f92ee\") " pod="openshift-ingress/e2e-shared-a-bfa604-openshift-default-ff9cbd879-ckds8"
Jul 16 11:42:06.122215 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:42:06.122097    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/210973ab-ee81-4502-92c9-7e76da6f92ee-workload-certs\") pod \"e2e-shared-a-bfa604-openshift-default-ff9cbd879-ckds8\" (UID: \"210973ab-ee81-4502-92c9-7e76da6f92ee\") " pod="openshift-ingress/e2e-shared-a-bfa604-openshift-default-ff9cbd879-ckds8"
Jul 16 11:42:06.122215 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:42:06.122118    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/210973ab-ee81-4502-92c9-7e76da6f92ee-istio-token\") pod \"e2e-shared-a-bfa604-openshift-default-ff9cbd879-ckds8\" (UID: \"210973ab-ee81-4502-92c9-7e76da6f92ee\") " pod="openshift-ingress/e2e-shared-a-bfa604-openshift-default-ff9cbd879-ckds8"
Jul 16 11:42:06.122215 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:42:06.122170    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/210973ab-ee81-4502-92c9-7e76da6f92ee-istio-data\") pod \"e2e-shared-a-bfa604-openshift-default-ff9cbd879-ckds8\" (UID: \"210973ab-ee81-4502-92c9-7e76da6f92ee\") " pod="openshift-ingress/e2e-shared-a-bfa604-openshift-default-ff9cbd879-ckds8"
Jul 16 11:42:06.122311 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:42:06.122221    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/210973ab-ee81-4502-92c9-7e76da6f92ee-istio-envoy\") pod \"e2e-shared-a-bfa604-openshift-default-ff9cbd879-ckds8\" (UID: \"210973ab-ee81-4502-92c9-7e76da6f92ee\") " pod="openshift-ingress/e2e-shared-a-bfa604-openshift-default-ff9cbd879-ckds8"
Jul 16 11:42:06.223474 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:42:06.223433    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/210973ab-ee81-4502-92c9-7e76da6f92ee-istio-envoy\") pod \"e2e-shared-a-bfa604-openshift-default-ff9cbd879-ckds8\" (UID: \"210973ab-ee81-4502-92c9-7e76da6f92ee\") " pod="openshift-ingress/e2e-shared-a-bfa604-openshift-default-ff9cbd879-ckds8"
Jul 16 11:42:06.223474 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:42:06.223483    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/210973ab-ee81-4502-92c9-7e76da6f92ee-credential-socket\") pod \"e2e-shared-a-bfa604-openshift-default-ff9cbd879-ckds8\" (UID: \"210973ab-ee81-4502-92c9-7e76da6f92ee\") " pod="openshift-ingress/e2e-shared-a-bfa604-openshift-default-ff9cbd879-ckds8"
Jul 16 11:42:06.223759 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:42:06.223521    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/210973ab-ee81-4502-92c9-7e76da6f92ee-istiod-ca-cert\") pod \"e2e-shared-a-bfa604-openshift-default-ff9cbd879-ckds8\" (UID: \"210973ab-ee81-4502-92c9-7e76da6f92ee\") " pod="openshift-ingress/e2e-shared-a-bfa604-openshift-default-ff9cbd879-ckds8"
Jul 16 11:42:06.223759 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:42:06.223538    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v67bv\" (UniqueName: \"kubernetes.io/projected/210973ab-ee81-4502-92c9-7e76da6f92ee-kube-api-access-v67bv\") pod \"e2e-shared-a-bfa604-openshift-default-ff9cbd879-ckds8\" (UID: \"210973ab-ee81-4502-92c9-7e76da6f92ee\") " pod="openshift-ingress/e2e-shared-a-bfa604-openshift-default-ff9cbd879-ckds8"
Jul 16 11:42:06.223759 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:42:06.223560    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/210973ab-ee81-4502-92c9-7e76da6f92ee-workload-socket\") pod \"e2e-shared-a-bfa604-openshift-default-ff9cbd879-ckds8\" (UID: \"210973ab-ee81-4502-92c9-7e76da6f92ee\") " pod="openshift-ingress/e2e-shared-a-bfa604-openshift-default-ff9cbd879-ckds8"
Jul 16 11:42:06.223759 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:42:06.223602    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/210973ab-ee81-4502-92c9-7e76da6f92ee-istio-podinfo\") pod \"e2e-shared-a-bfa604-openshift-default-ff9cbd879-ckds8\" (UID: \"210973ab-ee81-4502-92c9-7e76da6f92ee\") " pod="openshift-ingress/e2e-shared-a-bfa604-openshift-default-ff9cbd879-ckds8"
Jul 16 11:42:06.223985 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:42:06.223839    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/210973ab-ee81-4502-92c9-7e76da6f92ee-workload-certs\") pod \"e2e-shared-a-bfa604-openshift-default-ff9cbd879-ckds8\" (UID: \"210973ab-ee81-4502-92c9-7e76da6f92ee\") " pod="openshift-ingress/e2e-shared-a-bfa604-openshift-default-ff9cbd879-ckds8"
Jul 16 11:42:06.223985 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:42:06.223880    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/210973ab-ee81-4502-92c9-7e76da6f92ee-istio-token\") pod \"e2e-shared-a-bfa604-openshift-default-ff9cbd879-ckds8\" (UID: \"210973ab-ee81-4502-92c9-7e76da6f92ee\") " pod="openshift-ingress/e2e-shared-a-bfa604-openshift-default-ff9cbd879-ckds8"
Jul 16 11:42:06.223985 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:42:06.223918    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/210973ab-ee81-4502-92c9-7e76da6f92ee-istio-data\") pod \"e2e-shared-a-bfa604-openshift-default-ff9cbd879-ckds8\" (UID: \"210973ab-ee81-4502-92c9-7e76da6f92ee\") " pod="openshift-ingress/e2e-shared-a-bfa604-openshift-default-ff9cbd879-ckds8"
Jul 16 11:42:06.224143 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:42:06.224039    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/210973ab-ee81-4502-92c9-7e76da6f92ee-credential-socket\") pod \"e2e-shared-a-bfa604-openshift-default-ff9cbd879-ckds8\" (UID: \"210973ab-ee81-4502-92c9-7e76da6f92ee\") " pod="openshift-ingress/e2e-shared-a-bfa604-openshift-default-ff9cbd879-ckds8"
Jul 16 11:42:06.224250 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:42:06.224225    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/210973ab-ee81-4502-92c9-7e76da6f92ee-workload-certs\") pod \"e2e-shared-a-bfa604-openshift-default-ff9cbd879-ckds8\" (UID: \"210973ab-ee81-4502-92c9-7e76da6f92ee\") " pod="openshift-ingress/e2e-shared-a-bfa604-openshift-default-ff9cbd879-ckds8"
Jul 16 11:42:06.224304 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:42:06.224248    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/210973ab-ee81-4502-92c9-7e76da6f92ee-istio-data\") pod \"e2e-shared-a-bfa604-openshift-default-ff9cbd879-ckds8\" (UID: \"210973ab-ee81-4502-92c9-7e76da6f92ee\") " pod="openshift-ingress/e2e-shared-a-bfa604-openshift-default-ff9cbd879-ckds8"
Jul 16 11:42:06.224340 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:42:06.224303    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/210973ab-ee81-4502-92c9-7e76da6f92ee-workload-socket\") pod \"e2e-shared-a-bfa604-openshift-default-ff9cbd879-ckds8\" (UID: \"210973ab-ee81-4502-92c9-7e76da6f92ee\") " pod="openshift-ingress/e2e-shared-a-bfa604-openshift-default-ff9cbd879-ckds8"
Jul 16 11:42:06.224900 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:42:06.224868    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/210973ab-ee81-4502-92c9-7e76da6f92ee-istiod-ca-cert\") pod \"e2e-shared-a-bfa604-openshift-default-ff9cbd879-ckds8\" (UID: \"210973ab-ee81-4502-92c9-7e76da6f92ee\") " pod="openshift-ingress/e2e-shared-a-bfa604-openshift-default-ff9cbd879-ckds8"
Jul 16 11:42:06.226482 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:42:06.226448    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/210973ab-ee81-4502-92c9-7e76da6f92ee-istio-envoy\") pod \"e2e-shared-a-bfa604-openshift-default-ff9cbd879-ckds8\" (UID: \"210973ab-ee81-4502-92c9-7e76da6f92ee\") " pod="openshift-ingress/e2e-shared-a-bfa604-openshift-default-ff9cbd879-ckds8"
Jul 16 11:42:06.227588 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:42:06.227554    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/210973ab-ee81-4502-92c9-7e76da6f92ee-istio-podinfo\") pod \"e2e-shared-a-bfa604-openshift-default-ff9cbd879-ckds8\" (UID: \"210973ab-ee81-4502-92c9-7e76da6f92ee\") " pod="openshift-ingress/e2e-shared-a-bfa604-openshift-default-ff9cbd879-ckds8"
Jul 16 11:42:06.232840 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:42:06.232799    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/210973ab-ee81-4502-92c9-7e76da6f92ee-istio-token\") pod \"e2e-shared-a-bfa604-openshift-default-ff9cbd879-ckds8\" (UID: \"210973ab-ee81-4502-92c9-7e76da6f92ee\") " pod="openshift-ingress/e2e-shared-a-bfa604-openshift-default-ff9cbd879-ckds8"
Jul 16 11:42:06.235960 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:42:06.235917    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v67bv\" (UniqueName: \"kubernetes.io/projected/210973ab-ee81-4502-92c9-7e76da6f92ee-kube-api-access-v67bv\") pod \"e2e-shared-a-bfa604-openshift-default-ff9cbd879-ckds8\" (UID: \"210973ab-ee81-4502-92c9-7e76da6f92ee\") " pod="openshift-ingress/e2e-shared-a-bfa604-openshift-default-ff9cbd879-ckds8"
Jul 16 11:42:06.385385 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:42:06.385296    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:42:06.406309 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:42:06.406267    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-bfa604-openshift-default-ff9cbd879-ckds8"
Jul 16 11:42:06.484355 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:42:06.484323    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:42:06.569290 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:42:06.569216    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-bfa604-openshift-default-ff9cbd879-ckds8"]
Jul 16 11:42:06.572646 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:42:06.572619    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod210973ab_ee81_4502_92c9_7e76da6f92ee.slice/crio-f64033626fa4d5aa4441c0bbb179d8b741fb3ce7622bb03964b04ea8c6e98f22 WatchSource:0}: Error finding container f64033626fa4d5aa4441c0bbb179d8b741fb3ce7622bb03964b04ea8c6e98f22: Status 404 returned error can't find the container with id f64033626fa4d5aa4441c0bbb179d8b741fb3ce7622bb03964b04ea8c6e98f22
Jul 16 11:42:06.575035 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:42:06.574993    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 16 11:42:06.575163 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:42:06.575086    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 16 11:42:06.575163 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:42:06.575132    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 16 11:42:07.004757 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:42:07.004719    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-bfa604-openshift-default-ff9cbd879-ckds8" event={"ID":"210973ab-ee81-4502-92c9-7e76da6f92ee","Type":"ContainerStarted","Data":"2f07558957dc74b9e9525304c3c984c676e70a5921ba88bd3fea0842cb8a59b0"}
Jul 16 11:42:07.005010 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:42:07.004811    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-bfa604-openshift-default-ff9cbd879-ckds8" event={"ID":"210973ab-ee81-4502-92c9-7e76da6f92ee","Type":"ContainerStarted","Data":"f64033626fa4d5aa4441c0bbb179d8b741fb3ce7622bb03964b04ea8c6e98f22"}
Jul 16 11:42:07.029295 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:42:07.029242    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-bfa604-openshift-default-ff9cbd879-ckds8" podStartSLOduration=1.029222598 podStartE2EDuration="1.029222598s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 11:42:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 11:42:07.025603618 +0000 UTC m=+2027.397140654" watchObservedRunningTime="2026-07-16 11:42:07.029222598 +0000 UTC m=+2027.400759633"
Jul 16 11:42:07.406826 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:42:07.406683    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-bfa604-openshift-default-ff9cbd879-ckds8"
Jul 16 11:42:07.412656 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:42:07.412601    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-bfa604-openshift-default-ff9cbd879-ckds8"
Jul 16 11:42:07.938161 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:42:07.938125    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:42:08.010693 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:42:08.010659    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-bfa604-openshift-default-ff9cbd879-ckds8"
Jul 16 11:42:08.011671 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:42:08.011649    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-bfa604-openshift-default-ff9cbd879-ckds8"
Jul 16 11:42:09.272306 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:42:09.272263    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:42:09.368726 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:42:09.368692    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:42:10.483415 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:42:10.483385    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-e7dc57-openshift-default-68d67f7859-v69mk"
Jul 16 11:42:10.570326 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:42:10.570286    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/19d293c4-87a2-4b84-b01d-52409b481f2f-istio-podinfo\") pod \"19d293c4-87a2-4b84-b01d-52409b481f2f\" (UID: \"19d293c4-87a2-4b84-b01d-52409b481f2f\") "
Jul 16 11:42:10.570326 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:42:10.570333    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/19d293c4-87a2-4b84-b01d-52409b481f2f-credential-socket\") pod \"19d293c4-87a2-4b84-b01d-52409b481f2f\" (UID: \"19d293c4-87a2-4b84-b01d-52409b481f2f\") "
Jul 16 11:42:10.570646 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:42:10.570387    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/19d293c4-87a2-4b84-b01d-52409b481f2f-istio-envoy\") pod \"19d293c4-87a2-4b84-b01d-52409b481f2f\" (UID: \"19d293c4-87a2-4b84-b01d-52409b481f2f\") "
Jul 16 11:42:10.570646 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:42:10.570405    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/19d293c4-87a2-4b84-b01d-52409b481f2f-istio-token\") pod \"19d293c4-87a2-4b84-b01d-52409b481f2f\" (UID: \"19d293c4-87a2-4b84-b01d-52409b481f2f\") "
Jul 16 11:42:10.570646 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:42:10.570421    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/19d293c4-87a2-4b84-b01d-52409b481f2f-istiod-ca-cert\") pod \"19d293c4-87a2-4b84-b01d-52409b481f2f\" (UID: \"19d293c4-87a2-4b84-b01d-52409b481f2f\") "
Jul 16 11:42:10.570646 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:42:10.570444    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/19d293c4-87a2-4b84-b01d-52409b481f2f-workload-socket\") pod \"19d293c4-87a2-4b84-b01d-52409b481f2f\" (UID: \"19d293c4-87a2-4b84-b01d-52409b481f2f\") "
Jul 16 11:42:10.570646 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:42:10.570473    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/19d293c4-87a2-4b84-b01d-52409b481f2f-istio-data\") pod \"19d293c4-87a2-4b84-b01d-52409b481f2f\" (UID: \"19d293c4-87a2-4b84-b01d-52409b481f2f\") "
Jul 16 11:42:10.570646 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:42:10.570504    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/19d293c4-87a2-4b84-b01d-52409b481f2f-workload-certs\") pod \"19d293c4-87a2-4b84-b01d-52409b481f2f\" (UID: \"19d293c4-87a2-4b84-b01d-52409b481f2f\") "
Jul 16 11:42:10.570646 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:42:10.570566    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fqxkd\" (UniqueName: \"kubernetes.io/projected/19d293c4-87a2-4b84-b01d-52409b481f2f-kube-api-access-fqxkd\") pod \"19d293c4-87a2-4b84-b01d-52409b481f2f\" (UID: \"19d293c4-87a2-4b84-b01d-52409b481f2f\") "
Jul 16 11:42:10.571097 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:42:10.570711    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/19d293c4-87a2-4b84-b01d-52409b481f2f-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "19d293c4-87a2-4b84-b01d-52409b481f2f" (UID: "19d293c4-87a2-4b84-b01d-52409b481f2f"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 11:42:10.571097 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:42:10.570926    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/19d293c4-87a2-4b84-b01d-52409b481f2f-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "19d293c4-87a2-4b84-b01d-52409b481f2f" (UID: "19d293c4-87a2-4b84-b01d-52409b481f2f"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 11:42:10.571097 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:42:10.571052    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/19d293c4-87a2-4b84-b01d-52409b481f2f-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "19d293c4-87a2-4b84-b01d-52409b481f2f" (UID: "19d293c4-87a2-4b84-b01d-52409b481f2f"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 11:42:10.571241 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:42:10.571108    2564 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/19d293c4-87a2-4b84-b01d-52409b481f2f-credential-socket\") on node \"ip-10-0-135-184.ec2.internal\" DevicePath \"\""
Jul 16 11:42:10.571241 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:42:10.571129    2564 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/19d293c4-87a2-4b84-b01d-52409b481f2f-workload-socket\") on node \"ip-10-0-135-184.ec2.internal\" DevicePath \"\""
Jul 16 11:42:10.571241 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:42:10.571140    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/19d293c4-87a2-4b84-b01d-52409b481f2f-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "19d293c4-87a2-4b84-b01d-52409b481f2f" (UID: "19d293c4-87a2-4b84-b01d-52409b481f2f"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 11:42:10.571649 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:42:10.571619    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/19d293c4-87a2-4b84-b01d-52409b481f2f-istio-data" (OuterVolumeSpecName: "istio-data") pod "19d293c4-87a2-4b84-b01d-52409b481f2f" (UID: "19d293c4-87a2-4b84-b01d-52409b481f2f"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 11:42:10.572971 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:42:10.572942    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/19d293c4-87a2-4b84-b01d-52409b481f2f-istio-token" (OuterVolumeSpecName: "istio-token") pod "19d293c4-87a2-4b84-b01d-52409b481f2f" (UID: "19d293c4-87a2-4b84-b01d-52409b481f2f"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 11:42:10.573114 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:42:10.573094    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/19d293c4-87a2-4b84-b01d-52409b481f2f-kube-api-access-fqxkd" (OuterVolumeSpecName: "kube-api-access-fqxkd") pod "19d293c4-87a2-4b84-b01d-52409b481f2f" (UID: "19d293c4-87a2-4b84-b01d-52409b481f2f"). InnerVolumeSpecName "kube-api-access-fqxkd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 11:42:10.573161 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:42:10.573147    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/19d293c4-87a2-4b84-b01d-52409b481f2f-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "19d293c4-87a2-4b84-b01d-52409b481f2f" (UID: "19d293c4-87a2-4b84-b01d-52409b481f2f"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 16 11:42:10.573255 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:42:10.573232    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/19d293c4-87a2-4b84-b01d-52409b481f2f-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "19d293c4-87a2-4b84-b01d-52409b481f2f" (UID: "19d293c4-87a2-4b84-b01d-52409b481f2f"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 11:42:10.672363 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:42:10.672324    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fqxkd\" (UniqueName: \"kubernetes.io/projected/19d293c4-87a2-4b84-b01d-52409b481f2f-kube-api-access-fqxkd\") on node \"ip-10-0-135-184.ec2.internal\" DevicePath \"\""
Jul 16 11:42:10.672363 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:42:10.672356    2564 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/19d293c4-87a2-4b84-b01d-52409b481f2f-istio-podinfo\") on node \"ip-10-0-135-184.ec2.internal\" DevicePath \"\""
Jul 16 11:42:10.672363 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:42:10.672368    2564 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/19d293c4-87a2-4b84-b01d-52409b481f2f-istio-envoy\") on node \"ip-10-0-135-184.ec2.internal\" DevicePath \"\""
Jul 16 11:42:10.672363 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:42:10.672376    2564 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/19d293c4-87a2-4b84-b01d-52409b481f2f-istio-token\") on node \"ip-10-0-135-184.ec2.internal\" DevicePath \"\""
Jul 16 11:42:10.672646 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:42:10.672385    2564 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/19d293c4-87a2-4b84-b01d-52409b481f2f-istiod-ca-cert\") on node \"ip-10-0-135-184.ec2.internal\" DevicePath \"\""
Jul 16 11:42:10.672646 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:42:10.672395    2564 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/19d293c4-87a2-4b84-b01d-52409b481f2f-istio-data\") on node \"ip-10-0-135-184.ec2.internal\" DevicePath \"\""
Jul 16 11:42:10.672646 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:42:10.672402    2564 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/19d293c4-87a2-4b84-b01d-52409b481f2f-workload-certs\") on node \"ip-10-0-135-184.ec2.internal\" DevicePath \"\""
Jul 16 11:42:11.031718 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:42:11.031667    2564 generic.go:356] "Generic (PLEG): container finished" podID="19d293c4-87a2-4b84-b01d-52409b481f2f" containerID="0c54ee71f469eaca5e107a3f69d973f9fccdb59fd7d5fed95e2b7a0e6aeebf80" exitCode=0
Jul 16 11:42:11.031943 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:42:11.031810    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-e7dc57-openshift-default-68d67f7859-v69mk" event={"ID":"19d293c4-87a2-4b84-b01d-52409b481f2f","Type":"ContainerDied","Data":"0c54ee71f469eaca5e107a3f69d973f9fccdb59fd7d5fed95e2b7a0e6aeebf80"}
Jul 16 11:42:11.031943 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:42:11.031816    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-e7dc57-openshift-default-68d67f7859-v69mk"
Jul 16 11:42:11.031943 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:42:11.031890    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-e7dc57-openshift-default-68d67f7859-v69mk" event={"ID":"19d293c4-87a2-4b84-b01d-52409b481f2f","Type":"ContainerDied","Data":"2d82eff017dc85fb453ca67e9bc0632130901c54f4297d169e92bb4b005506be"}
Jul 16 11:42:11.031943 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:42:11.031914    2564 scope.go:117] "RemoveContainer" containerID="0c54ee71f469eaca5e107a3f69d973f9fccdb59fd7d5fed95e2b7a0e6aeebf80"
Jul 16 11:42:11.043026 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:42:11.043003    2564 scope.go:117] "RemoveContainer" containerID="6ce478d551d226e5a63dda2fdcea3abf0fc81b52f02557661c242959eeea2c39"
Jul 16 11:42:11.053604 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:42:11.053360    2564 scope.go:117] "RemoveContainer" containerID="0c54ee71f469eaca5e107a3f69d973f9fccdb59fd7d5fed95e2b7a0e6aeebf80"
Jul 16 11:42:11.053829 ip-10-0-135-184 kubenswrapper[2564]: E0716 11:42:11.053792    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0c54ee71f469eaca5e107a3f69d973f9fccdb59fd7d5fed95e2b7a0e6aeebf80\": container with ID starting with 0c54ee71f469eaca5e107a3f69d973f9fccdb59fd7d5fed95e2b7a0e6aeebf80 not found: ID does not exist" containerID="0c54ee71f469eaca5e107a3f69d973f9fccdb59fd7d5fed95e2b7a0e6aeebf80"
Jul 16 11:42:11.054008 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:42:11.053838    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0c54ee71f469eaca5e107a3f69d973f9fccdb59fd7d5fed95e2b7a0e6aeebf80"} err="failed to get container status \"0c54ee71f469eaca5e107a3f69d973f9fccdb59fd7d5fed95e2b7a0e6aeebf80\": rpc error: code = NotFound desc = could not find container \"0c54ee71f469eaca5e107a3f69d973f9fccdb59fd7d5fed95e2b7a0e6aeebf80\": container with ID starting with 0c54ee71f469eaca5e107a3f69d973f9fccdb59fd7d5fed95e2b7a0e6aeebf80 not found: ID does not exist"
Jul 16 11:42:11.054008 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:42:11.053859    2564 scope.go:117] "RemoveContainer" containerID="6ce478d551d226e5a63dda2fdcea3abf0fc81b52f02557661c242959eeea2c39"
Jul 16 11:42:11.054177 ip-10-0-135-184 kubenswrapper[2564]: E0716 11:42:11.054157    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6ce478d551d226e5a63dda2fdcea3abf0fc81b52f02557661c242959eeea2c39\": container with ID starting with 6ce478d551d226e5a63dda2fdcea3abf0fc81b52f02557661c242959eeea2c39 not found: ID does not exist" containerID="6ce478d551d226e5a63dda2fdcea3abf0fc81b52f02557661c242959eeea2c39"
Jul 16 11:42:11.054232 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:42:11.054186    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6ce478d551d226e5a63dda2fdcea3abf0fc81b52f02557661c242959eeea2c39"} err="failed to get container status \"6ce478d551d226e5a63dda2fdcea3abf0fc81b52f02557661c242959eeea2c39\": rpc error: code = NotFound desc = could not find container \"6ce478d551d226e5a63dda2fdcea3abf0fc81b52f02557661c242959eeea2c39\": container with ID starting with 6ce478d551d226e5a63dda2fdcea3abf0fc81b52f02557661c242959eeea2c39 not found: ID does not exist"
Jul 16 11:42:11.055943 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:42:11.055910    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-e7dc57-openshift-default-68d67f7859-v69mk"]
Jul 16 11:42:11.058737 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:42:11.058700    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-e7dc57-openshift-default-68d67f7859-v69mk"]
Jul 16 11:42:12.303631 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:42:12.303588    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="19d293c4-87a2-4b84-b01d-52409b481f2f" path="/var/lib/kubelet/pods/19d293c4-87a2-4b84-b01d-52409b481f2f/volumes"
Jul 16 11:42:13.467128 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:42:13.467047    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:42:13.807075 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:42:13.807042    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:42:14.102682 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:42:14.102579    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-f05981-openshift-default-7b68786d67-lx9fd"]
Jul 16 11:42:14.103186 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:42:14.103165    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="19d293c4-87a2-4b84-b01d-52409b481f2f" containerName="istio-proxy"
Jul 16 11:42:14.103186 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:42:14.103189    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="19d293c4-87a2-4b84-b01d-52409b481f2f" containerName="istio-proxy"
Jul 16 11:42:14.103361 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:42:14.103212    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="19d293c4-87a2-4b84-b01d-52409b481f2f" containerName="istio-proxy"
Jul 16 11:42:14.103361 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:42:14.103220    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="19d293c4-87a2-4b84-b01d-52409b481f2f" containerName="istio-proxy"
Jul 16 11:42:14.103361 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:42:14.103324    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="19d293c4-87a2-4b84-b01d-52409b481f2f" containerName="istio-proxy"
Jul 16 11:42:14.108267 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:42:14.108234    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-f05981-openshift-default-7b68786d67-lx9fd"
Jul 16 11:42:14.110384 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:42:14.110361    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-f05981-openshift-default-dockercfg-mbnfv\""
Jul 16 11:42:14.117521 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:42:14.117316    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-f05981-openshift-default-7b68786d67-lx9fd"]
Jul 16 11:42:14.122974 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:42:14.122944    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:42:14.190464 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:42:14.190429    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:42:14.209743 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:42:14.209708    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c0d90834-efd5-4aab-a8f1-5ba65c6b359f-istio-podinfo\") pod \"e2e-shared-b-f05981-openshift-default-7b68786d67-lx9fd\" (UID: \"c0d90834-efd5-4aab-a8f1-5ba65c6b359f\") " pod="openshift-ingress/e2e-shared-b-f05981-openshift-default-7b68786d67-lx9fd"
Jul 16 11:42:14.209913 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:42:14.209761    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c0d90834-efd5-4aab-a8f1-5ba65c6b359f-workload-certs\") pod \"e2e-shared-b-f05981-openshift-default-7b68786d67-lx9fd\" (UID: \"c0d90834-efd5-4aab-a8f1-5ba65c6b359f\") " pod="openshift-ingress/e2e-shared-b-f05981-openshift-default-7b68786d67-lx9fd"
Jul 16 11:42:14.209913 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:42:14.209812    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c0d90834-efd5-4aab-a8f1-5ba65c6b359f-istio-token\") pod \"e2e-shared-b-f05981-openshift-default-7b68786d67-lx9fd\" (UID: \"c0d90834-efd5-4aab-a8f1-5ba65c6b359f\") " pod="openshift-ingress/e2e-shared-b-f05981-openshift-default-7b68786d67-lx9fd"
Jul 16 11:42:14.210008 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:42:14.209917    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c0d90834-efd5-4aab-a8f1-5ba65c6b359f-workload-socket\") pod \"e2e-shared-b-f05981-openshift-default-7b68786d67-lx9fd\" (UID: \"c0d90834-efd5-4aab-a8f1-5ba65c6b359f\") " pod="openshift-ingress/e2e-shared-b-f05981-openshift-default-7b68786d67-lx9fd"
Jul 16 11:42:14.210008 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:42:14.209939    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c0d90834-efd5-4aab-a8f1-5ba65c6b359f-istio-data\") pod \"e2e-shared-b-f05981-openshift-default-7b68786d67-lx9fd\" (UID: \"c0d90834-efd5-4aab-a8f1-5ba65c6b359f\") " pod="openshift-ingress/e2e-shared-b-f05981-openshift-default-7b68786d67-lx9fd"
Jul 16 11:42:14.210008 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:42:14.209956    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c0d90834-efd5-4aab-a8f1-5ba65c6b359f-credential-socket\") pod \"e2e-shared-b-f05981-openshift-default-7b68786d67-lx9fd\" (UID: \"c0d90834-efd5-4aab-a8f1-5ba65c6b359f\") " pod="openshift-ingress/e2e-shared-b-f05981-openshift-default-7b68786d67-lx9fd"
Jul 16 11:42:14.210008 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:42:14.209976    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ncsvl\" (UniqueName: \"kubernetes.io/projected/c0d90834-efd5-4aab-a8f1-5ba65c6b359f-kube-api-access-ncsvl\") pod \"e2e-shared-b-f05981-openshift-default-7b68786d67-lx9fd\" (UID: \"c0d90834-efd5-4aab-a8f1-5ba65c6b359f\") " pod="openshift-ingress/e2e-shared-b-f05981-openshift-default-7b68786d67-lx9fd"
Jul 16 11:42:14.210139 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:42:14.210067    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c0d90834-efd5-4aab-a8f1-5ba65c6b359f-istiod-ca-cert\") pod \"e2e-shared-b-f05981-openshift-default-7b68786d67-lx9fd\" (UID: \"c0d90834-efd5-4aab-a8f1-5ba65c6b359f\") " pod="openshift-ingress/e2e-shared-b-f05981-openshift-default-7b68786d67-lx9fd"
Jul 16 11:42:14.210139 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:42:14.210101    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c0d90834-efd5-4aab-a8f1-5ba65c6b359f-istio-envoy\") pod \"e2e-shared-b-f05981-openshift-default-7b68786d67-lx9fd\" (UID: \"c0d90834-efd5-4aab-a8f1-5ba65c6b359f\") " pod="openshift-ingress/e2e-shared-b-f05981-openshift-default-7b68786d67-lx9fd"
Jul 16 11:42:14.310734 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:42:14.310703    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c0d90834-efd5-4aab-a8f1-5ba65c6b359f-workload-socket\") pod \"e2e-shared-b-f05981-openshift-default-7b68786d67-lx9fd\" (UID: \"c0d90834-efd5-4aab-a8f1-5ba65c6b359f\") " pod="openshift-ingress/e2e-shared-b-f05981-openshift-default-7b68786d67-lx9fd"
Jul 16 11:42:14.310734 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:42:14.310738    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c0d90834-efd5-4aab-a8f1-5ba65c6b359f-istio-data\") pod \"e2e-shared-b-f05981-openshift-default-7b68786d67-lx9fd\" (UID: \"c0d90834-efd5-4aab-a8f1-5ba65c6b359f\") " pod="openshift-ingress/e2e-shared-b-f05981-openshift-default-7b68786d67-lx9fd"
Jul 16 11:42:14.311011 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:42:14.310760    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c0d90834-efd5-4aab-a8f1-5ba65c6b359f-credential-socket\") pod \"e2e-shared-b-f05981-openshift-default-7b68786d67-lx9fd\" (UID: \"c0d90834-efd5-4aab-a8f1-5ba65c6b359f\") " pod="openshift-ingress/e2e-shared-b-f05981-openshift-default-7b68786d67-lx9fd"
Jul 16 11:42:14.311011 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:42:14.310802    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ncsvl\" (UniqueName: \"kubernetes.io/projected/c0d90834-efd5-4aab-a8f1-5ba65c6b359f-kube-api-access-ncsvl\") pod \"e2e-shared-b-f05981-openshift-default-7b68786d67-lx9fd\" (UID: \"c0d90834-efd5-4aab-a8f1-5ba65c6b359f\") " pod="openshift-ingress/e2e-shared-b-f05981-openshift-default-7b68786d67-lx9fd"
Jul 16 11:42:14.311011 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:42:14.310834    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c0d90834-efd5-4aab-a8f1-5ba65c6b359f-istiod-ca-cert\") pod \"e2e-shared-b-f05981-openshift-default-7b68786d67-lx9fd\" (UID: \"c0d90834-efd5-4aab-a8f1-5ba65c6b359f\") " pod="openshift-ingress/e2e-shared-b-f05981-openshift-default-7b68786d67-lx9fd"
Jul 16 11:42:14.311143 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:42:14.311091    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c0d90834-efd5-4aab-a8f1-5ba65c6b359f-istio-envoy\") pod \"e2e-shared-b-f05981-openshift-default-7b68786d67-lx9fd\" (UID: \"c0d90834-efd5-4aab-a8f1-5ba65c6b359f\") " pod="openshift-ingress/e2e-shared-b-f05981-openshift-default-7b68786d67-lx9fd"
Jul 16 11:42:14.311206 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:42:14.311188    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c0d90834-efd5-4aab-a8f1-5ba65c6b359f-istio-podinfo\") pod \"e2e-shared-b-f05981-openshift-default-7b68786d67-lx9fd\" (UID: \"c0d90834-efd5-4aab-a8f1-5ba65c6b359f\") " pod="openshift-ingress/e2e-shared-b-f05981-openshift-default-7b68786d67-lx9fd"
Jul 16 11:42:14.311289 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:42:14.311267    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c0d90834-efd5-4aab-a8f1-5ba65c6b359f-workload-certs\") pod \"e2e-shared-b-f05981-openshift-default-7b68786d67-lx9fd\" (UID: \"c0d90834-efd5-4aab-a8f1-5ba65c6b359f\") " pod="openshift-ingress/e2e-shared-b-f05981-openshift-default-7b68786d67-lx9fd"
Jul 16 11:42:14.311352 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:42:14.311301    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c0d90834-efd5-4aab-a8f1-5ba65c6b359f-istio-token\") pod \"e2e-shared-b-f05981-openshift-default-7b68786d67-lx9fd\" (UID: \"c0d90834-efd5-4aab-a8f1-5ba65c6b359f\") " pod="openshift-ingress/e2e-shared-b-f05981-openshift-default-7b68786d67-lx9fd"
Jul 16 11:42:14.311406 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:42:14.311350    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c0d90834-efd5-4aab-a8f1-5ba65c6b359f-credential-socket\") pod \"e2e-shared-b-f05981-openshift-default-7b68786d67-lx9fd\" (UID: \"c0d90834-efd5-4aab-a8f1-5ba65c6b359f\") " pod="openshift-ingress/e2e-shared-b-f05981-openshift-default-7b68786d67-lx9fd"
Jul 16 11:42:14.311460 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:42:14.311442    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c0d90834-efd5-4aab-a8f1-5ba65c6b359f-istio-data\") pod \"e2e-shared-b-f05981-openshift-default-7b68786d67-lx9fd\" (UID: \"c0d90834-efd5-4aab-a8f1-5ba65c6b359f\") " pod="openshift-ingress/e2e-shared-b-f05981-openshift-default-7b68786d67-lx9fd"
Jul 16 11:42:14.311642 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:42:14.311600    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c0d90834-efd5-4aab-a8f1-5ba65c6b359f-workload-certs\") pod \"e2e-shared-b-f05981-openshift-default-7b68786d67-lx9fd\" (UID: \"c0d90834-efd5-4aab-a8f1-5ba65c6b359f\") " pod="openshift-ingress/e2e-shared-b-f05981-openshift-default-7b68786d67-lx9fd"
Jul 16 11:42:14.311819 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:42:14.311645    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c0d90834-efd5-4aab-a8f1-5ba65c6b359f-istiod-ca-cert\") pod \"e2e-shared-b-f05981-openshift-default-7b68786d67-lx9fd\" (UID: \"c0d90834-efd5-4aab-a8f1-5ba65c6b359f\") " pod="openshift-ingress/e2e-shared-b-f05981-openshift-default-7b68786d67-lx9fd"
Jul 16 11:42:14.311819 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:42:14.311798    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c0d90834-efd5-4aab-a8f1-5ba65c6b359f-workload-socket\") pod \"e2e-shared-b-f05981-openshift-default-7b68786d67-lx9fd\" (UID: \"c0d90834-efd5-4aab-a8f1-5ba65c6b359f\") " pod="openshift-ingress/e2e-shared-b-f05981-openshift-default-7b68786d67-lx9fd"
Jul 16 11:42:14.313590 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:42:14.313565    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c0d90834-efd5-4aab-a8f1-5ba65c6b359f-istio-envoy\") pod \"e2e-shared-b-f05981-openshift-default-7b68786d67-lx9fd\" (UID: \"c0d90834-efd5-4aab-a8f1-5ba65c6b359f\") " pod="openshift-ingress/e2e-shared-b-f05981-openshift-default-7b68786d67-lx9fd"
Jul 16 11:42:14.313937 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:42:14.313915    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c0d90834-efd5-4aab-a8f1-5ba65c6b359f-istio-podinfo\") pod \"e2e-shared-b-f05981-openshift-default-7b68786d67-lx9fd\" (UID: \"c0d90834-efd5-4aab-a8f1-5ba65c6b359f\") " pod="openshift-ingress/e2e-shared-b-f05981-openshift-default-7b68786d67-lx9fd"
Jul 16 11:42:14.318977 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:42:14.318945    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c0d90834-efd5-4aab-a8f1-5ba65c6b359f-istio-token\") pod \"e2e-shared-b-f05981-openshift-default-7b68786d67-lx9fd\" (UID: \"c0d90834-efd5-4aab-a8f1-5ba65c6b359f\") " pod="openshift-ingress/e2e-shared-b-f05981-openshift-default-7b68786d67-lx9fd"
Jul 16 11:42:14.319126 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:42:14.319020    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ncsvl\" (UniqueName: \"kubernetes.io/projected/c0d90834-efd5-4aab-a8f1-5ba65c6b359f-kube-api-access-ncsvl\") pod \"e2e-shared-b-f05981-openshift-default-7b68786d67-lx9fd\" (UID: \"c0d90834-efd5-4aab-a8f1-5ba65c6b359f\") " pod="openshift-ingress/e2e-shared-b-f05981-openshift-default-7b68786d67-lx9fd"
Jul 16 11:42:14.422813 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:42:14.422670    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-f05981-openshift-default-7b68786d67-lx9fd"
Jul 16 11:42:14.628763 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:42:14.628734    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-f05981-openshift-default-7b68786d67-lx9fd"]
Jul 16 11:42:14.631311 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:42:14.631281    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc0d90834_efd5_4aab_a8f1_5ba65c6b359f.slice/crio-652455457c8adcea6b0f119eb1fda96a1f23068c4d39e2d284a7d573d5420d3c WatchSource:0}: Error finding container 652455457c8adcea6b0f119eb1fda96a1f23068c4d39e2d284a7d573d5420d3c: Status 404 returned error can't find the container with id 652455457c8adcea6b0f119eb1fda96a1f23068c4d39e2d284a7d573d5420d3c
Jul 16 11:42:14.633530 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:42:14.633495    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 16 11:42:14.633630 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:42:14.633568    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 16 11:42:14.633630 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:42:14.633600    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 16 11:42:15.089043 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:42:15.088986    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-f05981-openshift-default-7b68786d67-lx9fd" event={"ID":"c0d90834-efd5-4aab-a8f1-5ba65c6b359f","Type":"ContainerStarted","Data":"589299a4a5c15e0b90a9218d0747941ac11b10be28e05b6f799c91bc3272282e"}
Jul 16 11:42:15.089264 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:42:15.089119    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-f05981-openshift-default-7b68786d67-lx9fd" event={"ID":"c0d90834-efd5-4aab-a8f1-5ba65c6b359f","Type":"ContainerStarted","Data":"652455457c8adcea6b0f119eb1fda96a1f23068c4d39e2d284a7d573d5420d3c"}
Jul 16 11:42:15.113600 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:42:15.113541    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-f05981-openshift-default-7b68786d67-lx9fd" podStartSLOduration=1.113521614 podStartE2EDuration="1.113521614s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 11:42:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 11:42:15.111524993 +0000 UTC m=+2035.483062033" watchObservedRunningTime="2026-07-16 11:42:15.113521614 +0000 UTC m=+2035.485058650"
Jul 16 11:42:15.423138 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:42:15.423034    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-f05981-openshift-default-7b68786d67-lx9fd"
Jul 16 11:42:15.429199 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:42:15.429171    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-f05981-openshift-default-7b68786d67-lx9fd"
Jul 16 11:42:16.009885 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:42:16.009832    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:42:16.095444 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:42:16.095417    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-f05981-openshift-default-7b68786d67-lx9fd"
Jul 16 11:42:16.096471 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:42:16.096446    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-f05981-openshift-default-7b68786d67-lx9fd"
Jul 16 11:42:16.107482 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:42:16.107440    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:42:16.349087 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:42:16.348998    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:42:16.938830 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:42:16.938758    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:42:17.040869 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:42:17.040734    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:42:17.701377 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:42:17.701321    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:42:19.116471 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:42:19.116435    2564 generic.go:356] "Generic (PLEG): container finished" podID="210973ab-ee81-4502-92c9-7e76da6f92ee" containerID="2f07558957dc74b9e9525304c3c984c676e70a5921ba88bd3fea0842cb8a59b0" exitCode=0
Jul 16 11:42:19.117035 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:42:19.116479    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-bfa604-openshift-default-ff9cbd879-ckds8" event={"ID":"210973ab-ee81-4502-92c9-7e76da6f92ee","Type":"ContainerDied","Data":"2f07558957dc74b9e9525304c3c984c676e70a5921ba88bd3fea0842cb8a59b0"}
Jul 16 11:42:19.117106 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:42:19.117041    2564 scope.go:117] "RemoveContainer" containerID="2f07558957dc74b9e9525304c3c984c676e70a5921ba88bd3fea0842cb8a59b0"
Jul 16 11:42:19.118285 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:42:19.118254    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 16 11:42:19.118358 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:42:19.118338    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 16 11:42:19.118395 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:42:19.118378    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 16 11:42:20.124201 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:42:20.124169    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-bfa604-openshift-default-ff9cbd879-ckds8" event={"ID":"210973ab-ee81-4502-92c9-7e76da6f92ee","Type":"ContainerStarted","Data":"8368ff4d916c13414878f80fce82d1eb4a04ff7af96040f23725a9ec13946efc"}
Jul 16 11:42:20.407377 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:42:20.407286    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-bfa604-openshift-default-ff9cbd879-ckds8"
Jul 16 11:42:20.408542 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:42:20.408516    2564 patch_prober.go:28] interesting pod/e2e-shared-a-bfa604-openshift-default-ff9cbd879-ckds8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused" start-of-body=
Jul 16 11:42:20.408623 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:42:20.408591    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-bfa604-openshift-default-ff9cbd879-ckds8" podUID="210973ab-ee81-4502-92c9-7e76da6f92ee" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused"
Jul 16 11:42:21.407064 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:42:21.407022    2564 patch_prober.go:28] interesting pod/e2e-shared-a-bfa604-openshift-default-ff9cbd879-ckds8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused" start-of-body=
Jul 16 11:42:21.407462 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:42:21.407093    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-bfa604-openshift-default-ff9cbd879-ckds8" podUID="210973ab-ee81-4502-92c9-7e76da6f92ee" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused"
Jul 16 11:42:21.530318 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:42:21.530275    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:42:22.407486 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:42:22.407447    2564 patch_prober.go:28] interesting pod/e2e-shared-a-bfa604-openshift-default-ff9cbd879-ckds8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused" start-of-body=
Jul 16 11:42:22.407915 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:42:22.407508    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-bfa604-openshift-default-ff9cbd879-ckds8" podUID="210973ab-ee81-4502-92c9-7e76da6f92ee" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused"
Jul 16 11:42:23.011311 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:42:23.011279    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-bfa604-openshift-default-ff9cbd879-ckds8"
Jul 16 11:42:23.407183 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:42:23.407085    2564 patch_prober.go:28] interesting pod/e2e-shared-a-bfa604-openshift-default-ff9cbd879-ckds8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused" start-of-body=
Jul 16 11:42:23.407183 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:42:23.407148    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-bfa604-openshift-default-ff9cbd879-ckds8" podUID="210973ab-ee81-4502-92c9-7e76da6f92ee" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused"
Jul 16 11:42:24.407443 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:42:24.407400    2564 patch_prober.go:28] interesting pod/e2e-shared-a-bfa604-openshift-default-ff9cbd879-ckds8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused" start-of-body=
Jul 16 11:42:24.407898 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:42:24.407464    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-bfa604-openshift-default-ff9cbd879-ckds8" podUID="210973ab-ee81-4502-92c9-7e76da6f92ee" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused"
Jul 16 11:42:25.407206 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:42:25.407167    2564 patch_prober.go:28] interesting pod/e2e-shared-a-bfa604-openshift-default-ff9cbd879-ckds8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused" start-of-body=
Jul 16 11:42:25.407437 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:42:25.407234    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-bfa604-openshift-default-ff9cbd879-ckds8" podUID="210973ab-ee81-4502-92c9-7e76da6f92ee" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused"
Jul 16 11:42:26.411711 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:42:26.411668    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-bfa604-openshift-default-ff9cbd879-ckds8"
Jul 16 11:42:26.413080 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:42:26.413056    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-bfa604-openshift-default-ff9cbd879-ckds8"
Jul 16 11:42:29.776302 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:42:29.776171    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:42:29.912434 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:42:29.912388    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:42:32.137012 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:42:32.136959    2564 patch_prober.go:28] interesting pod/e2e-shared-b-f05981-openshift-default-7b68786d67-lx9fd container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.63:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 16 11:42:32.137432 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:42:32.137068    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-f05981-openshift-default-7b68786d67-lx9fd" podUID="c0d90834-efd5-4aab-a8f1-5ba65c6b359f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.63:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 16 11:42:35.227938 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:42:35.227902    2564 generic.go:356] "Generic (PLEG): container finished" podID="c0d90834-efd5-4aab-a8f1-5ba65c6b359f" containerID="589299a4a5c15e0b90a9218d0747941ac11b10be28e05b6f799c91bc3272282e" exitCode=0
Jul 16 11:42:35.228398 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:42:35.227976    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-f05981-openshift-default-7b68786d67-lx9fd" event={"ID":"c0d90834-efd5-4aab-a8f1-5ba65c6b359f","Type":"ContainerDied","Data":"589299a4a5c15e0b90a9218d0747941ac11b10be28e05b6f799c91bc3272282e"}
Jul 16 11:42:35.228515 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:42:35.228495    2564 scope.go:117] "RemoveContainer" containerID="589299a4a5c15e0b90a9218d0747941ac11b10be28e05b6f799c91bc3272282e"
Jul 16 11:42:35.229758 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:42:35.229730    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 16 11:42:35.229857 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:42:35.229823    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 16 11:42:35.229898 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:42:35.229855    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 16 11:42:36.236301 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:42:36.236263    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-f05981-openshift-default-7b68786d67-lx9fd" event={"ID":"c0d90834-efd5-4aab-a8f1-5ba65c6b359f","Type":"ContainerStarted","Data":"18ec645810e8e8f788b38fd73156eec0d86170ef0d43b96949f552fa45e6e08f"}
Jul 16 11:42:36.422894 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:42:36.422851    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-f05981-openshift-default-7b68786d67-lx9fd"
Jul 16 11:42:36.423164 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:42:36.423140    2564 patch_prober.go:28] interesting pod/e2e-shared-b-f05981-openshift-default-7b68786d67-lx9fd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused" start-of-body=
Jul 16 11:42:36.423216 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:42:36.423190    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-f05981-openshift-default-7b68786d67-lx9fd" podUID="c0d90834-efd5-4aab-a8f1-5ba65c6b359f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused"
Jul 16 11:42:37.423324 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:42:37.423284    2564 patch_prober.go:28] interesting pod/e2e-shared-b-f05981-openshift-default-7b68786d67-lx9fd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused" start-of-body=
Jul 16 11:42:37.423743 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:42:37.423360    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-f05981-openshift-default-7b68786d67-lx9fd" podUID="c0d90834-efd5-4aab-a8f1-5ba65c6b359f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused"
Jul 16 11:42:37.795926 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:42:37.795890    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:42:37.894580 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:42:37.894543    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:42:38.423646 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:42:38.423602    2564 patch_prober.go:28] interesting pod/e2e-shared-b-f05981-openshift-default-7b68786d67-lx9fd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused" start-of-body=
Jul 16 11:42:38.424099 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:42:38.423677    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-f05981-openshift-default-7b68786d67-lx9fd" podUID="c0d90834-efd5-4aab-a8f1-5ba65c6b359f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused"
Jul 16 11:42:39.424056 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:42:39.424016    2564 patch_prober.go:28] interesting pod/e2e-shared-b-f05981-openshift-default-7b68786d67-lx9fd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused" start-of-body=
Jul 16 11:42:39.424464 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:42:39.424088    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-f05981-openshift-default-7b68786d67-lx9fd" podUID="c0d90834-efd5-4aab-a8f1-5ba65c6b359f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused"
Jul 16 11:42:40.427047 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:42:40.427013    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-f05981-openshift-default-7b68786d67-lx9fd"
Jul 16 11:42:40.427488 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:42:40.427433    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-f05981-openshift-default-7b68786d67-lx9fd"
Jul 16 11:42:40.428523 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:42:40.428497    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-f05981-openshift-default-7b68786d67-lx9fd"
Jul 16 11:42:47.148610 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:42:47.148567    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:42:50.278990 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:42:50.278948    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:43:03.910297 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:43:03.910257    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:43:20.317920 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:43:20.317892    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-lwmwf_4cb63124-522c-41e2-9d85-c2af29ac8eff/console-operator/1.log"
Jul 16 11:43:20.323140 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:43:20.323112    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-lwmwf_4cb63124-522c-41e2-9d85-c2af29ac8eff/console-operator/1.log"
Jul 16 11:43:20.325651 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:43:20.325622    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fchvw_aee7cbaf-a5e0-4e57-a9c1-504820f7f036/ovn-acl-logging/0.log"
Jul 16 11:43:20.330528 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:43:20.330503    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fchvw_aee7cbaf-a5e0-4e57-a9c1-504820f7f036/ovn-acl-logging/0.log"
Jul 16 11:43:24.521620 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:43:24.521581    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:43:24.621682 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:43:24.621651    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:43:49.933132 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:43:49.933092    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:45:00.154927 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:45:00.154886    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-bfa604-29736705-vqv62"]
Jul 16 11:45:00.155471 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:45:00.155456    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="19d293c4-87a2-4b84-b01d-52409b481f2f" containerName="istio-proxy"
Jul 16 11:45:00.157621 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:45:00.157602    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-bfa604-29736705-vqv62"
Jul 16 11:45:00.159946 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:45:00.159921    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-4mqwr\""
Jul 16 11:45:00.168734 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:45:00.168711    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-bfa604-29736705-vqv62"
Jul 16 11:45:00.179287 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:45:00.179243    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-bfa604-29736705-vqv62"]
Jul 16 11:45:00.335445 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:45:00.335233    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-bfa604-29736705-vqv62"]
Jul 16 11:45:00.338550 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:45:00.338512    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4df7bbbe_e785_4ce8_b7c7_4353b43fb972.slice/crio-2851834aa31cd9bd3026d322698be8a1d25f21d5d073c1e4c908dd0d725b9e32 WatchSource:0}: Error finding container 2851834aa31cd9bd3026d322698be8a1d25f21d5d073c1e4c908dd0d725b9e32: Status 404 returned error can't find the container with id 2851834aa31cd9bd3026d322698be8a1d25f21d5d073c1e4c908dd0d725b9e32
Jul 16 11:45:01.053928 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:45:01.053877    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-bfa604-29736705-vqv62" event={"ID":"4df7bbbe-e785-4ce8-b7c7-4353b43fb972","Type":"ContainerStarted","Data":"f3977a3dddd46849a8e054dd4cb045390e9bd43d39694e40a18b3dd996cf7a83"}
Jul 16 11:45:01.054137 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:45:01.053982    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-bfa604-29736705-vqv62" event={"ID":"4df7bbbe-e785-4ce8-b7c7-4353b43fb972","Type":"ContainerStarted","Data":"2851834aa31cd9bd3026d322698be8a1d25f21d5d073c1e4c908dd0d725b9e32"}
Jul 16 11:45:01.071850 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:45:01.071764    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-bfa604-29736705-vqv62" podStartSLOduration=1.071746493 podStartE2EDuration="1.071746493s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 11:45:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 11:45:01.06967861 +0000 UTC m=+2201.441215647" watchObservedRunningTime="2026-07-16 11:45:01.071746493 +0000 UTC m=+2201.443283528"
Jul 16 11:45:02.061729 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:45:02.061694    2564 generic.go:356] "Generic (PLEG): container finished" podID="4df7bbbe-e785-4ce8-b7c7-4353b43fb972" containerID="f3977a3dddd46849a8e054dd4cb045390e9bd43d39694e40a18b3dd996cf7a83" exitCode=0
Jul 16 11:45:02.062172 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:45:02.061800    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-bfa604-29736705-vqv62" event={"ID":"4df7bbbe-e785-4ce8-b7c7-4353b43fb972","Type":"ContainerDied","Data":"f3977a3dddd46849a8e054dd4cb045390e9bd43d39694e40a18b3dd996cf7a83"}
Jul 16 11:45:03.220945 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:45:03.220918    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-bfa604-29736705-vqv62"
Jul 16 11:45:04.075013 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:45:04.074985    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-bfa604-29736705-vqv62"
Jul 16 11:45:04.075196 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:45:04.075018    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-bfa604-29736705-vqv62" event={"ID":"4df7bbbe-e785-4ce8-b7c7-4353b43fb972","Type":"ContainerDied","Data":"2851834aa31cd9bd3026d322698be8a1d25f21d5d073c1e4c908dd0d725b9e32"}
Jul 16 11:45:04.075196 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:45:04.075068    2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2851834aa31cd9bd3026d322698be8a1d25f21d5d073c1e4c908dd0d725b9e32"
Jul 16 11:45:14.421412 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:45:14.421366    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:45:15.333766 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:45:15.333734    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:45:21.238841 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:45:21.238800    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:45:56.169201 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:45:56.169144    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:46:35.749724 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:46:35.749684    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:46:37.120011 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:46:37.119972    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:47:03.630056 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:47:03.630012    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:47:21.748381 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:47:21.748302    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:47:21.810747 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:47:21.810714    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:47:30.602364 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:47:30.602325    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:47:30.702610 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:47:30.702562    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:47:34.005290 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:47:34.005239    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:47:38.887223 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:47:38.887176    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:47:38.987602 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:47:38.987563    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:47:42.463998 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:47:42.463964    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:47:42.565443 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:47:42.565411    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:48:20.356142 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:48:20.356113    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-lwmwf_4cb63124-522c-41e2-9d85-c2af29ac8eff/console-operator/1.log"
Jul 16 11:48:20.362454 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:48:20.362420    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-lwmwf_4cb63124-522c-41e2-9d85-c2af29ac8eff/console-operator/1.log"
Jul 16 11:48:20.364369 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:48:20.364344    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fchvw_aee7cbaf-a5e0-4e57-a9c1-504820f7f036/ovn-acl-logging/0.log"
Jul 16 11:48:20.370090 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:48:20.370069    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fchvw_aee7cbaf-a5e0-4e57-a9c1-504820f7f036/ovn-acl-logging/0.log"
Jul 16 11:48:20.447556 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:48:20.447526    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:48:21.366440 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:48:21.366404    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:48:22.302992 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:48:22.302961    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7375-139995120736048"]
Jul 16 11:48:22.303427 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:48:22.303411    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4df7bbbe-e785-4ce8-b7c7-4353b43fb972" containerName="cleanup"
Jul 16 11:48:22.303427 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:48:22.303426    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="4df7bbbe-e785-4ce8-b7c7-4353b43fb972" containerName="cleanup"
Jul 16 11:48:22.303567 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:48:22.303499    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="4df7bbbe-e785-4ce8-b7c7-4353b43fb972" containerName="cleanup"
Jul 16 11:48:22.306981 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:48:22.306955    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7375-139995120736048"
Jul 16 11:48:22.309267 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:48:22.309241    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-x5wjq\""
Jul 16 11:48:22.311584 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:48:22.311553    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7375-139995120736048"]
Jul 16 11:48:22.450329 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:48:22.450283    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nbs6x\" (UniqueName: \"kubernetes.io/projected/8d74a692-1f01-46ea-8b82-73f622585aef-kube-api-access-nbs6x\") pod \"test-curl-7375-139995120736048\" (UID: \"8d74a692-1f01-46ea-8b82-73f622585aef\") " pod="opendatahub/test-curl-7375-139995120736048"
Jul 16 11:48:22.551655 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:48:22.551608    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nbs6x\" (UniqueName: \"kubernetes.io/projected/8d74a692-1f01-46ea-8b82-73f622585aef-kube-api-access-nbs6x\") pod \"test-curl-7375-139995120736048\" (UID: \"8d74a692-1f01-46ea-8b82-73f622585aef\") " pod="opendatahub/test-curl-7375-139995120736048"
Jul 16 11:48:22.560958 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:48:22.560884    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nbs6x\" (UniqueName: \"kubernetes.io/projected/8d74a692-1f01-46ea-8b82-73f622585aef-kube-api-access-nbs6x\") pod \"test-curl-7375-139995120736048\" (UID: \"8d74a692-1f01-46ea-8b82-73f622585aef\") " pod="opendatahub/test-curl-7375-139995120736048"
Jul 16 11:48:22.618962 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:48:22.618925    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7375-139995120736048"
Jul 16 11:48:22.778981 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:48:22.778931    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7375-139995120736048"]
Jul 16 11:48:22.781509 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:48:22.781477    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8d74a692_1f01_46ea_8b82_73f622585aef.slice/crio-488e4a21fc432a0ca99630b5683f9d2e451d7948f2c606090bb4bc91b86df860 WatchSource:0}: Error finding container 488e4a21fc432a0ca99630b5683f9d2e451d7948f2c606090bb4bc91b86df860: Status 404 returned error can't find the container with id 488e4a21fc432a0ca99630b5683f9d2e451d7948f2c606090bb4bc91b86df860
Jul 16 11:48:22.782888 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:48:22.782869    2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 16 11:48:23.227556 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:48:23.227478    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7375-139995120736048" event={"ID":"8d74a692-1f01-46ea-8b82-73f622585aef","Type":"ContainerStarted","Data":"488e4a21fc432a0ca99630b5683f9d2e451d7948f2c606090bb4bc91b86df860"}
Jul 16 11:48:24.234218 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:48:24.234186    2564 generic.go:356] "Generic (PLEG): container finished" podID="8d74a692-1f01-46ea-8b82-73f622585aef" containerID="2f0b7992233239eb8c0171e3d427c40f2a677f6ad8f1fd2db5dbdbc777875377" exitCode=0
Jul 16 11:48:24.234627 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:48:24.234288    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7375-139995120736048" event={"ID":"8d74a692-1f01-46ea-8b82-73f622585aef","Type":"ContainerDied","Data":"2f0b7992233239eb8c0171e3d427c40f2a677f6ad8f1fd2db5dbdbc777875377"}
Jul 16 11:48:25.389334 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:48:25.389302    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7375-139995120736048"
Jul 16 11:48:25.410909 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:48:25.410877    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7375-139995120736048_8d74a692-1f01-46ea-8b82-73f622585aef/test-curl-7375-139995120736048/0.log"
Jul 16 11:48:25.432203 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:48:25.432167    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7375-139995120736048"]
Jul 16 11:48:25.435168 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:48:25.435132    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7375-139995120736048"]
Jul 16 11:48:25.523970 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:48:25.523932    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:48:25.555327 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:48:25.555294    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7375-139995120751792"]
Jul 16 11:48:25.555802 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:48:25.555786    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8d74a692-1f01-46ea-8b82-73f622585aef" containerName="test-curl-7375-139995120736048"
Jul 16 11:48:25.555855 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:48:25.555804    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="8d74a692-1f01-46ea-8b82-73f622585aef" containerName="test-curl-7375-139995120736048"
Jul 16 11:48:25.555903 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:48:25.555892    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="8d74a692-1f01-46ea-8b82-73f622585aef" containerName="test-curl-7375-139995120736048"
Jul 16 11:48:25.559042 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:48:25.559021    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7375-139995120751792"
Jul 16 11:48:25.565888 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:48:25.565857    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7375-139995120751792"]
Jul 16 11:48:25.586663 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:48:25.586629    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nbs6x\" (UniqueName: \"kubernetes.io/projected/8d74a692-1f01-46ea-8b82-73f622585aef-kube-api-access-nbs6x\") pod \"8d74a692-1f01-46ea-8b82-73f622585aef\" (UID: \"8d74a692-1f01-46ea-8b82-73f622585aef\") "
Jul 16 11:48:25.586903 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:48:25.586883    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-44jdf\" (UniqueName: \"kubernetes.io/projected/6f708c40-4a17-4cac-93b0-cb3f60df7832-kube-api-access-44jdf\") pod \"test-curl-7375-139995120751792\" (UID: \"6f708c40-4a17-4cac-93b0-cb3f60df7832\") " pod="opendatahub/test-curl-7375-139995120751792"
Jul 16 11:48:25.588902 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:48:25.588867    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8d74a692-1f01-46ea-8b82-73f622585aef-kube-api-access-nbs6x" (OuterVolumeSpecName: "kube-api-access-nbs6x") pod "8d74a692-1f01-46ea-8b82-73f622585aef" (UID: "8d74a692-1f01-46ea-8b82-73f622585aef"). InnerVolumeSpecName "kube-api-access-nbs6x". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 11:48:25.627022 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:48:25.626974    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:48:25.688295 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:48:25.688256    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-44jdf\" (UniqueName: \"kubernetes.io/projected/6f708c40-4a17-4cac-93b0-cb3f60df7832-kube-api-access-44jdf\") pod \"test-curl-7375-139995120751792\" (UID: \"6f708c40-4a17-4cac-93b0-cb3f60df7832\") " pod="opendatahub/test-curl-7375-139995120751792"
Jul 16 11:48:25.688519 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:48:25.688363    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nbs6x\" (UniqueName: \"kubernetes.io/projected/8d74a692-1f01-46ea-8b82-73f622585aef-kube-api-access-nbs6x\") on node \"ip-10-0-135-184.ec2.internal\" DevicePath \"\""
Jul 16 11:48:25.696376 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:48:25.696326    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-44jdf\" (UniqueName: \"kubernetes.io/projected/6f708c40-4a17-4cac-93b0-cb3f60df7832-kube-api-access-44jdf\") pod \"test-curl-7375-139995120751792\" (UID: \"6f708c40-4a17-4cac-93b0-cb3f60df7832\") " pod="opendatahub/test-curl-7375-139995120751792"
Jul 16 11:48:25.870618 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:48:25.870521    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7375-139995120751792"
Jul 16 11:48:26.022507 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:48:26.022477    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7375-139995120751792"]
Jul 16 11:48:26.024721 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:48:26.024690    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6f708c40_4a17_4cac_93b0_cb3f60df7832.slice/crio-954c393c7d628a8637796f3fac8a69e00cf2403d50aa7834804679708db3b08b WatchSource:0}: Error finding container 954c393c7d628a8637796f3fac8a69e00cf2403d50aa7834804679708db3b08b: Status 404 returned error can't find the container with id 954c393c7d628a8637796f3fac8a69e00cf2403d50aa7834804679708db3b08b
Jul 16 11:48:26.247275 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:48:26.247192    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7375-139995120736048"
Jul 16 11:48:26.247275 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:48:26.247239    2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="488e4a21fc432a0ca99630b5683f9d2e451d7948f2c606090bb4bc91b86df860"
Jul 16 11:48:26.248511 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:48:26.248486    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7375-139995120751792" event={"ID":"6f708c40-4a17-4cac-93b0-cb3f60df7832","Type":"ContainerStarted","Data":"954c393c7d628a8637796f3fac8a69e00cf2403d50aa7834804679708db3b08b"}
Jul 16 11:48:26.258359 ip-10-0-135-184 kubenswrapper[2564]: E0716 11:48:26.258325    2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7375-139995120736048\" is forbidden: User \"system:node:ip-10-0-135-184.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-135-184.ec2.internal' and this object" podUID="8d74a692-1f01-46ea-8b82-73f622585aef" pod="opendatahub/test-curl-7375-139995120736048"
Jul 16 11:48:26.302669 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:48:26.302634    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8d74a692-1f01-46ea-8b82-73f622585aef" path="/var/lib/kubelet/pods/8d74a692-1f01-46ea-8b82-73f622585aef/volumes"
Jul 16 11:48:27.255576 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:48:27.255545    2564 generic.go:356] "Generic (PLEG): container finished" podID="6f708c40-4a17-4cac-93b0-cb3f60df7832" containerID="fc67b54c0678fab06f0954d4c421d31f2fc73c4269806f3ad0722f00569bb931" exitCode=0
Jul 16 11:48:27.256033 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:48:27.255594    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7375-139995120751792" event={"ID":"6f708c40-4a17-4cac-93b0-cb3f60df7832","Type":"ContainerDied","Data":"fc67b54c0678fab06f0954d4c421d31f2fc73c4269806f3ad0722f00569bb931"}
Jul 16 11:48:28.413316 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:48:28.413284    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7375-139995120751792"
Jul 16 11:48:28.432605 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:48:28.432575    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7375-139995120751792_6f708c40-4a17-4cac-93b0-cb3f60df7832/test-curl-7375-139995120751792/0.log"
Jul 16 11:48:28.454341 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:48:28.454305    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7375-139995120751792"]
Jul 16 11:48:28.460456 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:48:28.460419    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7375-139995120751792"]
Jul 16 11:48:28.510152 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:48:28.510098    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-44jdf\" (UniqueName: \"kubernetes.io/projected/6f708c40-4a17-4cac-93b0-cb3f60df7832-kube-api-access-44jdf\") pod \"6f708c40-4a17-4cac-93b0-cb3f60df7832\" (UID: \"6f708c40-4a17-4cac-93b0-cb3f60df7832\") "
Jul 16 11:48:28.512352 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:48:28.512293    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6f708c40-4a17-4cac-93b0-cb3f60df7832-kube-api-access-44jdf" (OuterVolumeSpecName: "kube-api-access-44jdf") pod "6f708c40-4a17-4cac-93b0-cb3f60df7832" (UID: "6f708c40-4a17-4cac-93b0-cb3f60df7832"). InnerVolumeSpecName "kube-api-access-44jdf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 11:48:28.610903 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:48:28.610868    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-44jdf\" (UniqueName: \"kubernetes.io/projected/6f708c40-4a17-4cac-93b0-cb3f60df7832-kube-api-access-44jdf\") on node \"ip-10-0-135-184.ec2.internal\" DevicePath \"\""
Jul 16 11:48:28.611808 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:48:28.611765    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7375-139995120268176"]
Jul 16 11:48:28.612254 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:48:28.612240    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6f708c40-4a17-4cac-93b0-cb3f60df7832" containerName="test-curl-7375-139995120751792"
Jul 16 11:48:28.612295 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:48:28.612255    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="6f708c40-4a17-4cac-93b0-cb3f60df7832" containerName="test-curl-7375-139995120751792"
Jul 16 11:48:28.612340 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:48:28.612331    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="6f708c40-4a17-4cac-93b0-cb3f60df7832" containerName="test-curl-7375-139995120751792"
Jul 16 11:48:28.615377 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:48:28.615358    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7375-139995120268176"
Jul 16 11:48:28.621494 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:48:28.621457    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7375-139995120268176"]
Jul 16 11:48:28.711755 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:48:28.711715    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bpv5g\" (UniqueName: \"kubernetes.io/projected/cc7847f5-d4b9-46ef-bb53-3d90c225f060-kube-api-access-bpv5g\") pod \"test-curl-7375-139995120268176\" (UID: \"cc7847f5-d4b9-46ef-bb53-3d90c225f060\") " pod="opendatahub/test-curl-7375-139995120268176"
Jul 16 11:48:28.812751 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:48:28.812645    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bpv5g\" (UniqueName: \"kubernetes.io/projected/cc7847f5-d4b9-46ef-bb53-3d90c225f060-kube-api-access-bpv5g\") pod \"test-curl-7375-139995120268176\" (UID: \"cc7847f5-d4b9-46ef-bb53-3d90c225f060\") " pod="opendatahub/test-curl-7375-139995120268176"
Jul 16 11:48:28.820995 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:48:28.820970    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bpv5g\" (UniqueName: \"kubernetes.io/projected/cc7847f5-d4b9-46ef-bb53-3d90c225f060-kube-api-access-bpv5g\") pod \"test-curl-7375-139995120268176\" (UID: \"cc7847f5-d4b9-46ef-bb53-3d90c225f060\") " pod="opendatahub/test-curl-7375-139995120268176"
Jul 16 11:48:28.926731 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:48:28.926675    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7375-139995120268176"
Jul 16 11:48:29.083723 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:48:29.083695    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7375-139995120268176"]
Jul 16 11:48:29.085824 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:48:29.085791    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podcc7847f5_d4b9_46ef_bb53_3d90c225f060.slice/crio-b472cc92171f7e9c5d76771990b9f064fcb19d2cebbdbe0618a3f7762ead88c3 WatchSource:0}: Error finding container b472cc92171f7e9c5d76771990b9f064fcb19d2cebbdbe0618a3f7762ead88c3: Status 404 returned error can't find the container with id b472cc92171f7e9c5d76771990b9f064fcb19d2cebbdbe0618a3f7762ead88c3
Jul 16 11:48:29.268008 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:48:29.267966    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7375-139995120268176" event={"ID":"cc7847f5-d4b9-46ef-bb53-3d90c225f060","Type":"ContainerStarted","Data":"b472cc92171f7e9c5d76771990b9f064fcb19d2cebbdbe0618a3f7762ead88c3"}
Jul 16 11:48:29.269318 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:48:29.269297    2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="954c393c7d628a8637796f3fac8a69e00cf2403d50aa7834804679708db3b08b"
Jul 16 11:48:29.269465 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:48:29.269344    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7375-139995120751792"
Jul 16 11:48:29.279622 ip-10-0-135-184 kubenswrapper[2564]: E0716 11:48:29.279589    2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7375-139995120751792\" is forbidden: User \"system:node:ip-10-0-135-184.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-135-184.ec2.internal' and this object" podUID="6f708c40-4a17-4cac-93b0-cb3f60df7832" pod="opendatahub/test-curl-7375-139995120751792"
Jul 16 11:48:30.277486 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:48:30.277448    2564 generic.go:356] "Generic (PLEG): container finished" podID="cc7847f5-d4b9-46ef-bb53-3d90c225f060" containerID="8f772cb376a2a1a5e5e69ffcde6cf470e9ae2711d3697740b683bc1b60f5151f" exitCode=0
Jul 16 11:48:30.277928 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:48:30.277498    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7375-139995120268176" event={"ID":"cc7847f5-d4b9-46ef-bb53-3d90c225f060","Type":"ContainerDied","Data":"8f772cb376a2a1a5e5e69ffcde6cf470e9ae2711d3697740b683bc1b60f5151f"}
Jul 16 11:48:30.279454 ip-10-0-135-184 kubenswrapper[2564]: E0716 11:48:30.279428    2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7375-139995120751792\" is forbidden: User \"system:node:ip-10-0-135-184.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-135-184.ec2.internal' and this object" podUID="6f708c40-4a17-4cac-93b0-cb3f60df7832" pod="opendatahub/test-curl-7375-139995120751792"
Jul 16 11:48:30.302423 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:48:30.302382    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6f708c40-4a17-4cac-93b0-cb3f60df7832" path="/var/lib/kubelet/pods/6f708c40-4a17-4cac-93b0-cb3f60df7832/volumes"
Jul 16 11:48:30.302589 ip-10-0-135-184 kubenswrapper[2564]: E0716 11:48:30.302424    2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7375-139995120751792\" is forbidden: User \"system:node:ip-10-0-135-184.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-135-184.ec2.internal' and this object" podUID="6f708c40-4a17-4cac-93b0-cb3f60df7832" pod="opendatahub/test-curl-7375-139995120751792"
Jul 16 11:48:31.436475 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:48:31.436446    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7375-139995120268176"
Jul 16 11:48:31.457202 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:48:31.457172    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7375-139995120268176_cc7847f5-d4b9-46ef-bb53-3d90c225f060/test-curl-7375-139995120268176/0.log"
Jul 16 11:48:31.480900 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:48:31.480868    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7375-139995120268176"]
Jul 16 11:48:31.484692 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:48:31.484660    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7375-139995120268176"]
Jul 16 11:48:31.539248 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:48:31.539156    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bpv5g\" (UniqueName: \"kubernetes.io/projected/cc7847f5-d4b9-46ef-bb53-3d90c225f060-kube-api-access-bpv5g\") pod \"cc7847f5-d4b9-46ef-bb53-3d90c225f060\" (UID: \"cc7847f5-d4b9-46ef-bb53-3d90c225f060\") "
Jul 16 11:48:31.541265 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:48:31.541239    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cc7847f5-d4b9-46ef-bb53-3d90c225f060-kube-api-access-bpv5g" (OuterVolumeSpecName: "kube-api-access-bpv5g") pod "cc7847f5-d4b9-46ef-bb53-3d90c225f060" (UID: "cc7847f5-d4b9-46ef-bb53-3d90c225f060"). InnerVolumeSpecName "kube-api-access-bpv5g". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 11:48:31.608951 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:48:31.608917    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7375-139995120268176"]
Jul 16 11:48:31.609396 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:48:31.609383    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cc7847f5-d4b9-46ef-bb53-3d90c225f060" containerName="test-curl-7375-139995120268176"
Jul 16 11:48:31.609436 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:48:31.609397    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="cc7847f5-d4b9-46ef-bb53-3d90c225f060" containerName="test-curl-7375-139995120268176"
Jul 16 11:48:31.609478 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:48:31.609469    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="cc7847f5-d4b9-46ef-bb53-3d90c225f060" containerName="test-curl-7375-139995120268176"
Jul 16 11:48:31.612560 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:48:31.612538    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7375-139995120268176"
Jul 16 11:48:31.619371 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:48:31.619342    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7375-139995120268176"]
Jul 16 11:48:31.640956 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:48:31.640915    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qgh8j\" (UniqueName: \"kubernetes.io/projected/2fd02e44-900c-4ec6-a6ac-266f9a03b02a-kube-api-access-qgh8j\") pod \"test-curl-7375-139995120268176\" (UID: \"2fd02e44-900c-4ec6-a6ac-266f9a03b02a\") " pod="opendatahub/test-curl-7375-139995120268176"
Jul 16 11:48:31.641189 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:48:31.641019    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bpv5g\" (UniqueName: \"kubernetes.io/projected/cc7847f5-d4b9-46ef-bb53-3d90c225f060-kube-api-access-bpv5g\") on node \"ip-10-0-135-184.ec2.internal\" DevicePath \"\""
Jul 16 11:48:31.742848 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:48:31.742554    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qgh8j\" (UniqueName: \"kubernetes.io/projected/2fd02e44-900c-4ec6-a6ac-266f9a03b02a-kube-api-access-qgh8j\") pod \"test-curl-7375-139995120268176\" (UID: \"2fd02e44-900c-4ec6-a6ac-266f9a03b02a\") " pod="opendatahub/test-curl-7375-139995120268176"
Jul 16 11:48:31.750710 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:48:31.750677    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qgh8j\" (UniqueName: \"kubernetes.io/projected/2fd02e44-900c-4ec6-a6ac-266f9a03b02a-kube-api-access-qgh8j\") pod \"test-curl-7375-139995120268176\" (UID: \"2fd02e44-900c-4ec6-a6ac-266f9a03b02a\") " pod="opendatahub/test-curl-7375-139995120268176"
Jul 16 11:48:31.924193 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:48:31.924103    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7375-139995120268176"
Jul 16 11:48:32.078331 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:48:32.078302    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7375-139995120268176"]
Jul 16 11:48:32.081024 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:48:32.080993    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2fd02e44_900c_4ec6_a6ac_266f9a03b02a.slice/crio-6936e3d3ed46e12fd3fbccc60aaa5e3fb47b5ac4cf5dbf51d5d3318ecd53178a WatchSource:0}: Error finding container 6936e3d3ed46e12fd3fbccc60aaa5e3fb47b5ac4cf5dbf51d5d3318ecd53178a: Status 404 returned error can't find the container with id 6936e3d3ed46e12fd3fbccc60aaa5e3fb47b5ac4cf5dbf51d5d3318ecd53178a
Jul 16 11:48:32.291563 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:48:32.291530    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7375-139995120268176" event={"ID":"2fd02e44-900c-4ec6-a6ac-266f9a03b02a","Type":"ContainerStarted","Data":"6936e3d3ed46e12fd3fbccc60aaa5e3fb47b5ac4cf5dbf51d5d3318ecd53178a"}
Jul 16 11:48:32.293034 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:48:32.293013    2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b472cc92171f7e9c5d76771990b9f064fcb19d2cebbdbe0618a3f7762ead88c3"
Jul 16 11:48:32.293191 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:48:32.293047    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7375-139995120268176"
Jul 16 11:48:32.302941 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:48:32.302913    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cc7847f5-d4b9-46ef-bb53-3d90c225f060" path="/var/lib/kubelet/pods/cc7847f5-d4b9-46ef-bb53-3d90c225f060/volumes"
Jul 16 11:48:32.305168 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:48:32.305136    2564 status_manager.go:1027] "Pod was deleted and then recreated, skipping status update" pod="opendatahub/test-curl-7375-139995120268176" oldPodUID="cc7847f5-d4b9-46ef-bb53-3d90c225f060" podUID="2fd02e44-900c-4ec6-a6ac-266f9a03b02a"
Jul 16 11:48:33.301144 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:48:33.301111    2564 generic.go:356] "Generic (PLEG): container finished" podID="2fd02e44-900c-4ec6-a6ac-266f9a03b02a" containerID="a4c9d18bb47674ed36a605eba2d23d52a60e2f6d6a466d8dae06e2396c78fd3f" exitCode=0
Jul 16 11:48:33.301552 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:48:33.301200    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7375-139995120268176" event={"ID":"2fd02e44-900c-4ec6-a6ac-266f9a03b02a","Type":"ContainerDied","Data":"a4c9d18bb47674ed36a605eba2d23d52a60e2f6d6a466d8dae06e2396c78fd3f"}
Jul 16 11:48:34.462651 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:48:34.462616    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7375-139995120268176"
Jul 16 11:48:34.482047 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:48:34.482021    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7375-139995120268176_2fd02e44-900c-4ec6-a6ac-266f9a03b02a/test-curl-7375-139995120268176/0.log"
Jul 16 11:48:34.507580 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:48:34.507544    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7375-139995120268176"]
Jul 16 11:48:34.511231 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:48:34.511196    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7375-139995120268176"]
Jul 16 11:48:34.570549 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:48:34.570446    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qgh8j\" (UniqueName: \"kubernetes.io/projected/2fd02e44-900c-4ec6-a6ac-266f9a03b02a-kube-api-access-qgh8j\") pod \"2fd02e44-900c-4ec6-a6ac-266f9a03b02a\" (UID: \"2fd02e44-900c-4ec6-a6ac-266f9a03b02a\") "
Jul 16 11:48:34.572579 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:48:34.572549    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2fd02e44-900c-4ec6-a6ac-266f9a03b02a-kube-api-access-qgh8j" (OuterVolumeSpecName: "kube-api-access-qgh8j") pod "2fd02e44-900c-4ec6-a6ac-266f9a03b02a" (UID: "2fd02e44-900c-4ec6-a6ac-266f9a03b02a"). InnerVolumeSpecName "kube-api-access-qgh8j". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 11:48:34.625710 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:48:34.625671    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7375-139995116098160"]
Jul 16 11:48:34.626187 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:48:34.626171    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2fd02e44-900c-4ec6-a6ac-266f9a03b02a" containerName="test-curl-7375-139995120268176"
Jul 16 11:48:34.626228 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:48:34.626189    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="2fd02e44-900c-4ec6-a6ac-266f9a03b02a" containerName="test-curl-7375-139995120268176"
Jul 16 11:48:34.626278 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:48:34.626271    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="2fd02e44-900c-4ec6-a6ac-266f9a03b02a" containerName="test-curl-7375-139995120268176"
Jul 16 11:48:34.629444 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:48:34.629425    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7375-139995116098160"
Jul 16 11:48:34.634261 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:48:34.634233    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7375-139995116098160"]
Jul 16 11:48:34.672352 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:48:34.672317    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8vc9k\" (UniqueName: \"kubernetes.io/projected/26b7813f-5667-497b-a591-881f39450d5b-kube-api-access-8vc9k\") pod \"test-curl-7375-139995116098160\" (UID: \"26b7813f-5667-497b-a591-881f39450d5b\") " pod="opendatahub/test-curl-7375-139995116098160"
Jul 16 11:48:34.672516 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:48:34.672371    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qgh8j\" (UniqueName: \"kubernetes.io/projected/2fd02e44-900c-4ec6-a6ac-266f9a03b02a-kube-api-access-qgh8j\") on node \"ip-10-0-135-184.ec2.internal\" DevicePath \"\""
Jul 16 11:48:34.773710 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:48:34.773672    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8vc9k\" (UniqueName: \"kubernetes.io/projected/26b7813f-5667-497b-a591-881f39450d5b-kube-api-access-8vc9k\") pod \"test-curl-7375-139995116098160\" (UID: \"26b7813f-5667-497b-a591-881f39450d5b\") " pod="opendatahub/test-curl-7375-139995116098160"
Jul 16 11:48:34.782364 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:48:34.782328    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8vc9k\" (UniqueName: \"kubernetes.io/projected/26b7813f-5667-497b-a591-881f39450d5b-kube-api-access-8vc9k\") pod \"test-curl-7375-139995116098160\" (UID: \"26b7813f-5667-497b-a591-881f39450d5b\") " pod="opendatahub/test-curl-7375-139995116098160"
Jul 16 11:48:34.940530 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:48:34.940441    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7375-139995116098160"
Jul 16 11:48:35.092391 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:48:35.092360    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7375-139995116098160"]
Jul 16 11:48:35.095955 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:48:35.095910    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod26b7813f_5667_497b_a591_881f39450d5b.slice/crio-f7091cdfc925e30a24de7628157757473acd8af05ac03665506491049e500ed4 WatchSource:0}: Error finding container f7091cdfc925e30a24de7628157757473acd8af05ac03665506491049e500ed4: Status 404 returned error can't find the container with id f7091cdfc925e30a24de7628157757473acd8af05ac03665506491049e500ed4
Jul 16 11:48:35.318508 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:48:35.318479    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7375-139995120268176"
Jul 16 11:48:35.318700 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:48:35.318513    2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6936e3d3ed46e12fd3fbccc60aaa5e3fb47b5ac4cf5dbf51d5d3318ecd53178a"
Jul 16 11:48:35.319934 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:48:35.319905    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7375-139995116098160" event={"ID":"26b7813f-5667-497b-a591-881f39450d5b","Type":"ContainerStarted","Data":"f7091cdfc925e30a24de7628157757473acd8af05ac03665506491049e500ed4"}
Jul 16 11:48:35.329031 ip-10-0-135-184 kubenswrapper[2564]: E0716 11:48:35.328996    2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7375-139995120268176\" is forbidden: User \"system:node:ip-10-0-135-184.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-135-184.ec2.internal' and this object" podUID="2fd02e44-900c-4ec6-a6ac-266f9a03b02a" pod="opendatahub/test-curl-7375-139995120268176"
Jul 16 11:48:36.303761 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:48:36.303722    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2fd02e44-900c-4ec6-a6ac-266f9a03b02a" path="/var/lib/kubelet/pods/2fd02e44-900c-4ec6-a6ac-266f9a03b02a/volumes"
Jul 16 11:48:36.327505 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:48:36.327468    2564 generic.go:356] "Generic (PLEG): container finished" podID="26b7813f-5667-497b-a591-881f39450d5b" containerID="c7bfd5c029c2c9a4d397696f47aa7ae09108e663e21dbdcb3f68b8e8fb81662f" exitCode=0
Jul 16 11:48:36.327707 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:48:36.327559    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7375-139995116098160" event={"ID":"26b7813f-5667-497b-a591-881f39450d5b","Type":"ContainerDied","Data":"c7bfd5c029c2c9a4d397696f47aa7ae09108e663e21dbdcb3f68b8e8fb81662f"}
Jul 16 11:48:37.492384 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:48:37.492356    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7375-139995116098160"
Jul 16 11:48:37.513802 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:48:37.513760    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7375-139995116098160_26b7813f-5667-497b-a591-881f39450d5b/test-curl-7375-139995116098160/0.log"
Jul 16 11:48:37.536925 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:48:37.536877    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7375-139995116098160"]
Jul 16 11:48:37.540991 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:48:37.540955    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7375-139995116098160"]
Jul 16 11:48:37.606049 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:48:37.605953    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8vc9k\" (UniqueName: \"kubernetes.io/projected/26b7813f-5667-497b-a591-881f39450d5b-kube-api-access-8vc9k\") pod \"26b7813f-5667-497b-a591-881f39450d5b\" (UID: \"26b7813f-5667-497b-a591-881f39450d5b\") "
Jul 16 11:48:37.608080 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:48:37.608051    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/26b7813f-5667-497b-a591-881f39450d5b-kube-api-access-8vc9k" (OuterVolumeSpecName: "kube-api-access-8vc9k") pod "26b7813f-5667-497b-a591-881f39450d5b" (UID: "26b7813f-5667-497b-a591-881f39450d5b"). InnerVolumeSpecName "kube-api-access-8vc9k". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 11:48:37.707606 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:48:37.707569    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8vc9k\" (UniqueName: \"kubernetes.io/projected/26b7813f-5667-497b-a591-881f39450d5b-kube-api-access-8vc9k\") on node \"ip-10-0-135-184.ec2.internal\" DevicePath \"\""
Jul 16 11:48:38.303203 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:48:38.303169    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="26b7813f-5667-497b-a591-881f39450d5b" path="/var/lib/kubelet/pods/26b7813f-5667-497b-a591-881f39450d5b/volumes"
Jul 16 11:48:38.340241 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:48:38.340210    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7375-139995116098160"
Jul 16 11:48:38.340241 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:48:38.340242    2564 scope.go:117] "RemoveContainer" containerID="c7bfd5c029c2c9a4d397696f47aa7ae09108e663e21dbdcb3f68b8e8fb81662f"
Jul 16 11:48:41.181282 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:48:41.181196    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:48:47.054565 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:48:47.054526    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:48:47.062787 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:48:47.062740    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-bfa604-29736705-vqv62"]
Jul 16 11:48:47.066413 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:48:47.066377    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-bfa604-29736705-vqv62"]
Jul 16 11:48:47.181823 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:48:47.181764    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:48:48.302410 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:48:48.302361    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4df7bbbe-e785-4ce8-b7c7-4353b43fb972" path="/var/lib/kubelet/pods/4df7bbbe-e785-4ce8-b7c7-4353b43fb972/volumes"
Jul 16 11:48:53.195551 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:48:53.195514    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:48:53.271471 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:48:53.271438    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:48:53.463357 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:48:53.463255    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:48:53.465154 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:48:53.465130    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-bfa604-openshift-default-ff9cbd879-ckds8"]
Jul 16 11:48:53.465387 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:48:53.465364    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-bfa604-openshift-default-ff9cbd879-ckds8" podUID="210973ab-ee81-4502-92c9-7e76da6f92ee" containerName="istio-proxy" containerID="cri-o://8368ff4d916c13414878f80fce82d1eb4a04ff7af96040f23725a9ec13946efc" gracePeriod=30
Jul 16 11:48:53.702485 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:48:53.702455    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:48:54.169690 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:48:54.169659    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:48:56.414868 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:48:56.414825    2564 patch_prober.go:28] interesting pod/e2e-shared-a-bfa604-openshift-default-ff9cbd879-ckds8 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 16 11:48:56.415249 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:48:56.414889    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-bfa604-openshift-default-ff9cbd879-ckds8" podUID="210973ab-ee81-4502-92c9-7e76da6f92ee" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 16 11:48:58.734441 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:48:58.734368    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-bfa604-openshift-default-ff9cbd879-ckds8"
Jul 16 11:48:58.823536 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:48:58.823496    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/210973ab-ee81-4502-92c9-7e76da6f92ee-workload-certs\") pod \"210973ab-ee81-4502-92c9-7e76da6f92ee\" (UID: \"210973ab-ee81-4502-92c9-7e76da6f92ee\") "
Jul 16 11:48:58.823736 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:48:58.823548    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/210973ab-ee81-4502-92c9-7e76da6f92ee-workload-socket\") pod \"210973ab-ee81-4502-92c9-7e76da6f92ee\" (UID: \"210973ab-ee81-4502-92c9-7e76da6f92ee\") "
Jul 16 11:48:58.823736 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:48:58.823589    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/210973ab-ee81-4502-92c9-7e76da6f92ee-istiod-ca-cert\") pod \"210973ab-ee81-4502-92c9-7e76da6f92ee\" (UID: \"210973ab-ee81-4502-92c9-7e76da6f92ee\") "
Jul 16 11:48:58.823736 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:48:58.823611    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v67bv\" (UniqueName: \"kubernetes.io/projected/210973ab-ee81-4502-92c9-7e76da6f92ee-kube-api-access-v67bv\") pod \"210973ab-ee81-4502-92c9-7e76da6f92ee\" (UID: \"210973ab-ee81-4502-92c9-7e76da6f92ee\") "
Jul 16 11:48:58.823736 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:48:58.823653    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/210973ab-ee81-4502-92c9-7e76da6f92ee-istio-podinfo\") pod \"210973ab-ee81-4502-92c9-7e76da6f92ee\" (UID: \"210973ab-ee81-4502-92c9-7e76da6f92ee\") "
Jul 16 11:48:58.823968 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:48:58.823841    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/210973ab-ee81-4502-92c9-7e76da6f92ee-istio-envoy\") pod \"210973ab-ee81-4502-92c9-7e76da6f92ee\" (UID: \"210973ab-ee81-4502-92c9-7e76da6f92ee\") "
Jul 16 11:48:58.823968 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:48:58.823875    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/210973ab-ee81-4502-92c9-7e76da6f92ee-istio-data\") pod \"210973ab-ee81-4502-92c9-7e76da6f92ee\" (UID: \"210973ab-ee81-4502-92c9-7e76da6f92ee\") "
Jul 16 11:48:58.823968 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:48:58.823871    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/210973ab-ee81-4502-92c9-7e76da6f92ee-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "210973ab-ee81-4502-92c9-7e76da6f92ee" (UID: "210973ab-ee81-4502-92c9-7e76da6f92ee"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 11:48:58.823968 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:48:58.823918    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/210973ab-ee81-4502-92c9-7e76da6f92ee-credential-socket\") pod \"210973ab-ee81-4502-92c9-7e76da6f92ee\" (UID: \"210973ab-ee81-4502-92c9-7e76da6f92ee\") "
Jul 16 11:48:58.823968 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:48:58.823944    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/210973ab-ee81-4502-92c9-7e76da6f92ee-istio-token\") pod \"210973ab-ee81-4502-92c9-7e76da6f92ee\" (UID: \"210973ab-ee81-4502-92c9-7e76da6f92ee\") "
Jul 16 11:48:58.824226 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:48:58.823977    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/210973ab-ee81-4502-92c9-7e76da6f92ee-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "210973ab-ee81-4502-92c9-7e76da6f92ee" (UID: "210973ab-ee81-4502-92c9-7e76da6f92ee"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 11:48:58.824226 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:48:58.824162    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/210973ab-ee81-4502-92c9-7e76da6f92ee-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "210973ab-ee81-4502-92c9-7e76da6f92ee" (UID: "210973ab-ee81-4502-92c9-7e76da6f92ee"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 11:48:58.824226 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:48:58.824178    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/210973ab-ee81-4502-92c9-7e76da6f92ee-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "210973ab-ee81-4502-92c9-7e76da6f92ee" (UID: "210973ab-ee81-4502-92c9-7e76da6f92ee"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 11:48:58.824401 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:48:58.824386    2564 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/210973ab-ee81-4502-92c9-7e76da6f92ee-istiod-ca-cert\") on node \"ip-10-0-135-184.ec2.internal\" DevicePath \"\""
Jul 16 11:48:58.824461 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:48:58.824402    2564 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/210973ab-ee81-4502-92c9-7e76da6f92ee-credential-socket\") on node \"ip-10-0-135-184.ec2.internal\" DevicePath \"\""
Jul 16 11:48:58.824461 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:48:58.824413    2564 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/210973ab-ee81-4502-92c9-7e76da6f92ee-workload-certs\") on node \"ip-10-0-135-184.ec2.internal\" DevicePath \"\""
Jul 16 11:48:58.824461 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:48:58.824421    2564 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/210973ab-ee81-4502-92c9-7e76da6f92ee-workload-socket\") on node \"ip-10-0-135-184.ec2.internal\" DevicePath \"\""
Jul 16 11:48:58.824936 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:48:58.824904    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/210973ab-ee81-4502-92c9-7e76da6f92ee-istio-data" (OuterVolumeSpecName: "istio-data") pod "210973ab-ee81-4502-92c9-7e76da6f92ee" (UID: "210973ab-ee81-4502-92c9-7e76da6f92ee"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 11:48:58.826083 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:48:58.826048    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/210973ab-ee81-4502-92c9-7e76da6f92ee-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "210973ab-ee81-4502-92c9-7e76da6f92ee" (UID: "210973ab-ee81-4502-92c9-7e76da6f92ee"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 11:48:58.826083 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:48:58.826074    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/210973ab-ee81-4502-92c9-7e76da6f92ee-kube-api-access-v67bv" (OuterVolumeSpecName: "kube-api-access-v67bv") pod "210973ab-ee81-4502-92c9-7e76da6f92ee" (UID: "210973ab-ee81-4502-92c9-7e76da6f92ee"). InnerVolumeSpecName "kube-api-access-v67bv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 11:48:58.826224 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:48:58.826112    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/210973ab-ee81-4502-92c9-7e76da6f92ee-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "210973ab-ee81-4502-92c9-7e76da6f92ee" (UID: "210973ab-ee81-4502-92c9-7e76da6f92ee"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 16 11:48:58.826224 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:48:58.826178    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/210973ab-ee81-4502-92c9-7e76da6f92ee-istio-token" (OuterVolumeSpecName: "istio-token") pod "210973ab-ee81-4502-92c9-7e76da6f92ee" (UID: "210973ab-ee81-4502-92c9-7e76da6f92ee"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 11:48:58.925693 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:48:58.925652    2564 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/210973ab-ee81-4502-92c9-7e76da6f92ee-istio-podinfo\") on node \"ip-10-0-135-184.ec2.internal\" DevicePath \"\""
Jul 16 11:48:58.925693 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:48:58.925684    2564 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/210973ab-ee81-4502-92c9-7e76da6f92ee-istio-envoy\") on node \"ip-10-0-135-184.ec2.internal\" DevicePath \"\""
Jul 16 11:48:58.925693 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:48:58.925693    2564 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/210973ab-ee81-4502-92c9-7e76da6f92ee-istio-data\") on node \"ip-10-0-135-184.ec2.internal\" DevicePath \"\""
Jul 16 11:48:58.925693 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:48:58.925701    2564 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/210973ab-ee81-4502-92c9-7e76da6f92ee-istio-token\") on node \"ip-10-0-135-184.ec2.internal\" DevicePath \"\""
Jul 16 11:48:58.926010 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:48:58.925709    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v67bv\" (UniqueName: \"kubernetes.io/projected/210973ab-ee81-4502-92c9-7e76da6f92ee-kube-api-access-v67bv\") on node \"ip-10-0-135-184.ec2.internal\" DevicePath \"\""
Jul 16 11:48:59.470043 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:48:59.470002    2564 generic.go:356] "Generic (PLEG): container finished" podID="210973ab-ee81-4502-92c9-7e76da6f92ee" containerID="8368ff4d916c13414878f80fce82d1eb4a04ff7af96040f23725a9ec13946efc" exitCode=0
Jul 16 11:48:59.470227 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:48:59.470061    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-bfa604-openshift-default-ff9cbd879-ckds8"
Jul 16 11:48:59.470227 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:48:59.470088    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-bfa604-openshift-default-ff9cbd879-ckds8" event={"ID":"210973ab-ee81-4502-92c9-7e76da6f92ee","Type":"ContainerDied","Data":"8368ff4d916c13414878f80fce82d1eb4a04ff7af96040f23725a9ec13946efc"}
Jul 16 11:48:59.470227 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:48:59.470146    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-bfa604-openshift-default-ff9cbd879-ckds8" event={"ID":"210973ab-ee81-4502-92c9-7e76da6f92ee","Type":"ContainerDied","Data":"f64033626fa4d5aa4441c0bbb179d8b741fb3ce7622bb03964b04ea8c6e98f22"}
Jul 16 11:48:59.470227 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:48:59.470172    2564 scope.go:117] "RemoveContainer" containerID="8368ff4d916c13414878f80fce82d1eb4a04ff7af96040f23725a9ec13946efc"
Jul 16 11:48:59.480883 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:48:59.480858    2564 scope.go:117] "RemoveContainer" containerID="2f07558957dc74b9e9525304c3c984c676e70a5921ba88bd3fea0842cb8a59b0"
Jul 16 11:48:59.490787 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:48:59.490731    2564 scope.go:117] "RemoveContainer" containerID="8368ff4d916c13414878f80fce82d1eb4a04ff7af96040f23725a9ec13946efc"
Jul 16 11:48:59.491196 ip-10-0-135-184 kubenswrapper[2564]: E0716 11:48:59.491169    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8368ff4d916c13414878f80fce82d1eb4a04ff7af96040f23725a9ec13946efc\": container with ID starting with 8368ff4d916c13414878f80fce82d1eb4a04ff7af96040f23725a9ec13946efc not found: ID does not exist" containerID="8368ff4d916c13414878f80fce82d1eb4a04ff7af96040f23725a9ec13946efc"
Jul 16 11:48:59.491267 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:48:59.491212    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8368ff4d916c13414878f80fce82d1eb4a04ff7af96040f23725a9ec13946efc"} err="failed to get container status \"8368ff4d916c13414878f80fce82d1eb4a04ff7af96040f23725a9ec13946efc\": rpc error: code = NotFound desc = could not find container \"8368ff4d916c13414878f80fce82d1eb4a04ff7af96040f23725a9ec13946efc\": container with ID starting with 8368ff4d916c13414878f80fce82d1eb4a04ff7af96040f23725a9ec13946efc not found: ID does not exist"
Jul 16 11:48:59.491267 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:48:59.491240    2564 scope.go:117] "RemoveContainer" containerID="2f07558957dc74b9e9525304c3c984c676e70a5921ba88bd3fea0842cb8a59b0"
Jul 16 11:48:59.491582 ip-10-0-135-184 kubenswrapper[2564]: E0716 11:48:59.491545    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2f07558957dc74b9e9525304c3c984c676e70a5921ba88bd3fea0842cb8a59b0\": container with ID starting with 2f07558957dc74b9e9525304c3c984c676e70a5921ba88bd3fea0842cb8a59b0 not found: ID does not exist" containerID="2f07558957dc74b9e9525304c3c984c676e70a5921ba88bd3fea0842cb8a59b0"
Jul 16 11:48:59.491702 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:48:59.491581    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2f07558957dc74b9e9525304c3c984c676e70a5921ba88bd3fea0842cb8a59b0"} err="failed to get container status \"2f07558957dc74b9e9525304c3c984c676e70a5921ba88bd3fea0842cb8a59b0\": rpc error: code = NotFound desc = could not find container \"2f07558957dc74b9e9525304c3c984c676e70a5921ba88bd3fea0842cb8a59b0\": container with ID starting with 2f07558957dc74b9e9525304c3c984c676e70a5921ba88bd3fea0842cb8a59b0 not found: ID does not exist"
Jul 16 11:48:59.493157 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:48:59.493128    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-bfa604-openshift-default-ff9cbd879-ckds8"]
Jul 16 11:48:59.497038 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:48:59.497010    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-bfa604-openshift-default-ff9cbd879-ckds8"]
Jul 16 11:49:00.193505 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:49:00.193467    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:49:00.305743 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:49:00.305701    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="210973ab-ee81-4502-92c9-7e76da6f92ee" path="/var/lib/kubelet/pods/210973ab-ee81-4502-92c9-7e76da6f92ee/volumes"
Jul 16 11:49:00.461043 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:49:00.460941    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:49:06.223460 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:49:06.223421    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:49:06.288901 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:49:06.288868    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:49:06.488308 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:49:06.488216    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-f05981-openshift-default-7b68786d67-lx9fd"]
Jul 16 11:49:06.488516 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:49:06.488489    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-f05981-openshift-default-7b68786d67-lx9fd" podUID="c0d90834-efd5-4aab-a8f1-5ba65c6b359f" containerName="istio-proxy" containerID="cri-o://18ec645810e8e8f788b38fd73156eec0d86170ef0d43b96949f552fa45e6e08f" gracePeriod=30
Jul 16 11:49:06.509544 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:49:06.509512    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:49:06.734066 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:49:06.734035    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:49:08.218626 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:49:08.218589    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:49:08.280364 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:49:08.280325    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:49:10.429865 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:49:10.429752    2564 patch_prober.go:28] interesting pod/e2e-shared-b-f05981-openshift-default-7b68786d67-lx9fd container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 16 11:49:10.430226 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:49:10.429851    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-f05981-openshift-default-7b68786d67-lx9fd" podUID="c0d90834-efd5-4aab-a8f1-5ba65c6b359f" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 16 11:49:11.763399 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:49:11.763363    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-f05981-openshift-default-7b68786d67-lx9fd"
Jul 16 11:49:11.847547 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:49:11.847505    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c0d90834-efd5-4aab-a8f1-5ba65c6b359f-istio-envoy\") pod \"c0d90834-efd5-4aab-a8f1-5ba65c6b359f\" (UID: \"c0d90834-efd5-4aab-a8f1-5ba65c6b359f\") "
Jul 16 11:49:11.847547 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:49:11.847554    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c0d90834-efd5-4aab-a8f1-5ba65c6b359f-workload-socket\") pod \"c0d90834-efd5-4aab-a8f1-5ba65c6b359f\" (UID: \"c0d90834-efd5-4aab-a8f1-5ba65c6b359f\") "
Jul 16 11:49:11.847852 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:49:11.847616    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c0d90834-efd5-4aab-a8f1-5ba65c6b359f-istio-podinfo\") pod \"c0d90834-efd5-4aab-a8f1-5ba65c6b359f\" (UID: \"c0d90834-efd5-4aab-a8f1-5ba65c6b359f\") "
Jul 16 11:49:11.847852 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:49:11.847657    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c0d90834-efd5-4aab-a8f1-5ba65c6b359f-istiod-ca-cert\") pod \"c0d90834-efd5-4aab-a8f1-5ba65c6b359f\" (UID: \"c0d90834-efd5-4aab-a8f1-5ba65c6b359f\") "
Jul 16 11:49:11.847852 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:49:11.847690    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c0d90834-efd5-4aab-a8f1-5ba65c6b359f-credential-socket\") pod \"c0d90834-efd5-4aab-a8f1-5ba65c6b359f\" (UID: \"c0d90834-efd5-4aab-a8f1-5ba65c6b359f\") "
Jul 16 11:49:11.847852 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:49:11.847789    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ncsvl\" (UniqueName: \"kubernetes.io/projected/c0d90834-efd5-4aab-a8f1-5ba65c6b359f-kube-api-access-ncsvl\") pod \"c0d90834-efd5-4aab-a8f1-5ba65c6b359f\" (UID: \"c0d90834-efd5-4aab-a8f1-5ba65c6b359f\") "
Jul 16 11:49:11.847852 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:49:11.847821    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c0d90834-efd5-4aab-a8f1-5ba65c6b359f-istio-token\") pod \"c0d90834-efd5-4aab-a8f1-5ba65c6b359f\" (UID: \"c0d90834-efd5-4aab-a8f1-5ba65c6b359f\") "
Jul 16 11:49:11.847852 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:49:11.847847    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c0d90834-efd5-4aab-a8f1-5ba65c6b359f-istio-data\") pod \"c0d90834-efd5-4aab-a8f1-5ba65c6b359f\" (UID: \"c0d90834-efd5-4aab-a8f1-5ba65c6b359f\") "
Jul 16 11:49:11.848154 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:49:11.847874    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c0d90834-efd5-4aab-a8f1-5ba65c6b359f-workload-certs\") pod \"c0d90834-efd5-4aab-a8f1-5ba65c6b359f\" (UID: \"c0d90834-efd5-4aab-a8f1-5ba65c6b359f\") "
Jul 16 11:49:11.848154 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:49:11.847880    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c0d90834-efd5-4aab-a8f1-5ba65c6b359f-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "c0d90834-efd5-4aab-a8f1-5ba65c6b359f" (UID: "c0d90834-efd5-4aab-a8f1-5ba65c6b359f"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 11:49:11.848154 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:49:11.848145    2564 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c0d90834-efd5-4aab-a8f1-5ba65c6b359f-workload-socket\") on node \"ip-10-0-135-184.ec2.internal\" DevicePath \"\""
Jul 16 11:49:11.848315 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:49:11.848140    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c0d90834-efd5-4aab-a8f1-5ba65c6b359f-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "c0d90834-efd5-4aab-a8f1-5ba65c6b359f" (UID: "c0d90834-efd5-4aab-a8f1-5ba65c6b359f"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 11:49:11.848402 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:49:11.848374    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c0d90834-efd5-4aab-a8f1-5ba65c6b359f-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "c0d90834-efd5-4aab-a8f1-5ba65c6b359f" (UID: "c0d90834-efd5-4aab-a8f1-5ba65c6b359f"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 11:49:11.848523 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:49:11.848497    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c0d90834-efd5-4aab-a8f1-5ba65c6b359f-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "c0d90834-efd5-4aab-a8f1-5ba65c6b359f" (UID: "c0d90834-efd5-4aab-a8f1-5ba65c6b359f"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 11:49:11.848956 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:49:11.848921    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c0d90834-efd5-4aab-a8f1-5ba65c6b359f-istio-data" (OuterVolumeSpecName: "istio-data") pod "c0d90834-efd5-4aab-a8f1-5ba65c6b359f" (UID: "c0d90834-efd5-4aab-a8f1-5ba65c6b359f"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 11:49:11.849944 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:49:11.849919    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/c0d90834-efd5-4aab-a8f1-5ba65c6b359f-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "c0d90834-efd5-4aab-a8f1-5ba65c6b359f" (UID: "c0d90834-efd5-4aab-a8f1-5ba65c6b359f"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 16 11:49:11.850045 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:49:11.849948    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c0d90834-efd5-4aab-a8f1-5ba65c6b359f-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "c0d90834-efd5-4aab-a8f1-5ba65c6b359f" (UID: "c0d90834-efd5-4aab-a8f1-5ba65c6b359f"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 11:49:11.850154 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:49:11.850136    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c0d90834-efd5-4aab-a8f1-5ba65c6b359f-istio-token" (OuterVolumeSpecName: "istio-token") pod "c0d90834-efd5-4aab-a8f1-5ba65c6b359f" (UID: "c0d90834-efd5-4aab-a8f1-5ba65c6b359f"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 11:49:11.850254 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:49:11.850237    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c0d90834-efd5-4aab-a8f1-5ba65c6b359f-kube-api-access-ncsvl" (OuterVolumeSpecName: "kube-api-access-ncsvl") pod "c0d90834-efd5-4aab-a8f1-5ba65c6b359f" (UID: "c0d90834-efd5-4aab-a8f1-5ba65c6b359f"). InnerVolumeSpecName "kube-api-access-ncsvl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 11:49:11.949537 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:49:11.949495    2564 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c0d90834-efd5-4aab-a8f1-5ba65c6b359f-istio-podinfo\") on node \"ip-10-0-135-184.ec2.internal\" DevicePath \"\""
Jul 16 11:49:11.949537 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:49:11.949525    2564 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c0d90834-efd5-4aab-a8f1-5ba65c6b359f-istiod-ca-cert\") on node \"ip-10-0-135-184.ec2.internal\" DevicePath \"\""
Jul 16 11:49:11.949537 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:49:11.949538    2564 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c0d90834-efd5-4aab-a8f1-5ba65c6b359f-credential-socket\") on node \"ip-10-0-135-184.ec2.internal\" DevicePath \"\""
Jul 16 11:49:11.949537 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:49:11.949547    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ncsvl\" (UniqueName: \"kubernetes.io/projected/c0d90834-efd5-4aab-a8f1-5ba65c6b359f-kube-api-access-ncsvl\") on node \"ip-10-0-135-184.ec2.internal\" DevicePath \"\""
Jul 16 11:49:11.949855 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:49:11.949556    2564 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c0d90834-efd5-4aab-a8f1-5ba65c6b359f-istio-token\") on node \"ip-10-0-135-184.ec2.internal\" DevicePath \"\""
Jul 16 11:49:11.949855 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:49:11.949565    2564 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c0d90834-efd5-4aab-a8f1-5ba65c6b359f-istio-data\") on node \"ip-10-0-135-184.ec2.internal\" DevicePath \"\""
Jul 16 11:49:11.949855 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:49:11.949577    2564 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c0d90834-efd5-4aab-a8f1-5ba65c6b359f-workload-certs\") on node \"ip-10-0-135-184.ec2.internal\" DevicePath \"\""
Jul 16 11:49:11.949855 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:49:11.949585    2564 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c0d90834-efd5-4aab-a8f1-5ba65c6b359f-istio-envoy\") on node \"ip-10-0-135-184.ec2.internal\" DevicePath \"\""
Jul 16 11:49:12.451449 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:49:12.451421    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-555b7_e2753d05-dd93-4a8c-a671-8a82b06180de/manager/0.log"
Jul 16 11:49:12.548446 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:49:12.548412    2564 generic.go:356] "Generic (PLEG): container finished" podID="c0d90834-efd5-4aab-a8f1-5ba65c6b359f" containerID="18ec645810e8e8f788b38fd73156eec0d86170ef0d43b96949f552fa45e6e08f" exitCode=0
Jul 16 11:49:12.548617 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:49:12.548470    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-f05981-openshift-default-7b68786d67-lx9fd"
Jul 16 11:49:12.548617 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:49:12.548497    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-f05981-openshift-default-7b68786d67-lx9fd" event={"ID":"c0d90834-efd5-4aab-a8f1-5ba65c6b359f","Type":"ContainerDied","Data":"18ec645810e8e8f788b38fd73156eec0d86170ef0d43b96949f552fa45e6e08f"}
Jul 16 11:49:12.548617 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:49:12.548554    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-f05981-openshift-default-7b68786d67-lx9fd" event={"ID":"c0d90834-efd5-4aab-a8f1-5ba65c6b359f","Type":"ContainerDied","Data":"652455457c8adcea6b0f119eb1fda96a1f23068c4d39e2d284a7d573d5420d3c"}
Jul 16 11:49:12.548617 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:49:12.548578    2564 scope.go:117] "RemoveContainer" containerID="18ec645810e8e8f788b38fd73156eec0d86170ef0d43b96949f552fa45e6e08f"
Jul 16 11:49:12.558825 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:49:12.558805    2564 scope.go:117] "RemoveContainer" containerID="589299a4a5c15e0b90a9218d0747941ac11b10be28e05b6f799c91bc3272282e"
Jul 16 11:49:12.569054 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:49:12.569032    2564 scope.go:117] "RemoveContainer" containerID="18ec645810e8e8f788b38fd73156eec0d86170ef0d43b96949f552fa45e6e08f"
Jul 16 11:49:12.569166 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:49:12.569075    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-f05981-openshift-default-7b68786d67-lx9fd"]
Jul 16 11:49:12.569391 ip-10-0-135-184 kubenswrapper[2564]: E0716 11:49:12.569371    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"18ec645810e8e8f788b38fd73156eec0d86170ef0d43b96949f552fa45e6e08f\": container with ID starting with 18ec645810e8e8f788b38fd73156eec0d86170ef0d43b96949f552fa45e6e08f not found: ID does not exist" containerID="18ec645810e8e8f788b38fd73156eec0d86170ef0d43b96949f552fa45e6e08f"
Jul 16 11:49:12.569521 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:49:12.569408    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"18ec645810e8e8f788b38fd73156eec0d86170ef0d43b96949f552fa45e6e08f"} err="failed to get container status \"18ec645810e8e8f788b38fd73156eec0d86170ef0d43b96949f552fa45e6e08f\": rpc error: code = NotFound desc = could not find container \"18ec645810e8e8f788b38fd73156eec0d86170ef0d43b96949f552fa45e6e08f\": container with ID starting with 18ec645810e8e8f788b38fd73156eec0d86170ef0d43b96949f552fa45e6e08f not found: ID does not exist"
Jul 16 11:49:12.569521 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:49:12.569434    2564 scope.go:117] "RemoveContainer" containerID="589299a4a5c15e0b90a9218d0747941ac11b10be28e05b6f799c91bc3272282e"
Jul 16 11:49:12.569913 ip-10-0-135-184 kubenswrapper[2564]: E0716 11:49:12.569881    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"589299a4a5c15e0b90a9218d0747941ac11b10be28e05b6f799c91bc3272282e\": container with ID starting with 589299a4a5c15e0b90a9218d0747941ac11b10be28e05b6f799c91bc3272282e not found: ID does not exist" containerID="589299a4a5c15e0b90a9218d0747941ac11b10be28e05b6f799c91bc3272282e"
Jul 16 11:49:12.570000 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:49:12.569918    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"589299a4a5c15e0b90a9218d0747941ac11b10be28e05b6f799c91bc3272282e"} err="failed to get container status \"589299a4a5c15e0b90a9218d0747941ac11b10be28e05b6f799c91bc3272282e\": rpc error: code = NotFound desc = could not find container \"589299a4a5c15e0b90a9218d0747941ac11b10be28e05b6f799c91bc3272282e\": container with ID starting with 589299a4a5c15e0b90a9218d0747941ac11b10be28e05b6f799c91bc3272282e not found: ID does not exist"
Jul 16 11:49:12.572955 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:49:12.572929    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-f05981-openshift-default-7b68786d67-lx9fd"]
Jul 16 11:49:12.574517 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:49:12.574497    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-9fxzw_3b966a79-168a-4aff-94f8-669f33082e69/manager/0.log"
Jul 16 11:49:12.684561 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:49:12.684529    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-54f9b6467-txxc6_944fff28-f017-400b-b98d-9238292c5c83/manager/0.log"
Jul 16 11:49:12.796920 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:49:12.796897    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-lb4qx_3f7a7b44-5c27-4db2-9e8b-e98bf35a796c/server/0.log"
Jul 16 11:49:12.907582 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:49:12.907504    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-4n8hq_7abd43ff-29ae-482d-9aae-c56d1df4897e/manager/0.log"
Jul 16 11:49:13.274644 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:49:13.274615    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5f8c4d5c89-v9wk9_6f655f01-c2f4-44bc-aa68-f12f145f9839/copy-manifests/0.log"
Jul 16 11:49:13.281365 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:49:13.281342    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5f8c4d5c89-v9wk9_6f655f01-c2f4-44bc-aa68-f12f145f9839/manager/0.log"
Jul 16 11:49:13.621987 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:49:13.621902    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-75db5f846d-4r9fq_e92def53-e20d-4372-be08-b6e24d963d7d/maas-api/0.log"
Jul 16 11:49:13.733909 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:49:13.733881    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29736690-tzf25_28908e6b-e354-416c-8303-36ebdf9f2737/cleanup/0.log"
Jul 16 11:49:13.962054 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:49:13.961972    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-69fb4594cf-hpnq2_3c611fd7-3a6b-405e-a214-9b4acc98a3d7/postgres/0.log"
Jul 16 11:49:14.309447 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:49:14.305653    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c0d90834-efd5-4aab-a8f1-5ba65c6b359f" path="/var/lib/kubelet/pods/c0d90834-efd5-4aab-a8f1-5ba65c6b359f/volumes"
Jul 16 11:49:15.329572 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:49:15.329536    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-hflvv_720e7931-30ba-4fe0-a497-225b75a6a9b7/manager/0.log"
Jul 16 11:49:15.434361 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:49:15.434332    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-d85nj_6cff258f-0591-4972-abb1-b4b13a61918f/manager/0.log"
Jul 16 11:49:15.670840 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:49:15.670752    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-69vj5_f24c429f-b539-4f92-882b-410db6c83b10/registry-server/0.log"
Jul 16 11:49:16.016903 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:49:16.016869    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-x6hww_f042e41d-8110-44ca-a69d-2bebe7effe60/manager/0.log"
Jul 16 11:49:16.364712 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:49:16.364632    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4xd45c_7e6b410d-9b78-48d6-ab3e-60e4168a4971/istio-proxy/0.log"
Jul 16 11:49:16.613348 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:49:16.613321    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-79cdcbc7df-ljvqd_d91bec46-3634-4bd1-a785-7dbc9d97eb0f/kube-auth-proxy/0.log"
Jul 16 11:49:16.842651 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:49:16.842622    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-57qbg_fae58f40-1477-417a-921a-2ed601fe72aa/istio-proxy/1.log"
Jul 16 11:49:17.082996 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:49:17.082964    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-f9b8d9b9b-4hpsd_0bd3371c-a617-4407-9eeb-3d7dbf08725c/payload-processing/0.log"
Jul 16 11:49:17.194514 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:49:17.194437    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7f4487f9c8-wnk66_13fa2ca5-b90c-46e7-92bc-7a8cb4c036a2/router/0.log"
Jul 16 11:49:17.667157 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:49:17.667129    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-ndp4d_4cf1525c-349f-48d3-959c-df7e98ae6e7e/main/0.log"
Jul 16 11:49:18.004147 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:49:18.004120    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-cxw99_205694a9-061f-414d-9496-f65b41a9bc39/main/0.log"
Jul 16 11:49:23.336292 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:49:23.336249    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-8p4bp/must-gather-9rqfh"]
Jul 16 11:49:23.336913 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:49:23.336892    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="210973ab-ee81-4502-92c9-7e76da6f92ee" containerName="istio-proxy"
Jul 16 11:49:23.337012 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:49:23.336915    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="210973ab-ee81-4502-92c9-7e76da6f92ee" containerName="istio-proxy"
Jul 16 11:49:23.337012 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:49:23.336937    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="26b7813f-5667-497b-a591-881f39450d5b" containerName="test-curl-7375-139995116098160"
Jul 16 11:49:23.337012 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:49:23.336947    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="26b7813f-5667-497b-a591-881f39450d5b" containerName="test-curl-7375-139995116098160"
Jul 16 11:49:23.337012 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:49:23.336997    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c0d90834-efd5-4aab-a8f1-5ba65c6b359f" containerName="istio-proxy"
Jul 16 11:49:23.337012 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:49:23.337007    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="c0d90834-efd5-4aab-a8f1-5ba65c6b359f" containerName="istio-proxy"
Jul 16 11:49:23.337259 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:49:23.337038    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="210973ab-ee81-4502-92c9-7e76da6f92ee" containerName="istio-proxy"
Jul 16 11:49:23.337259 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:49:23.337047    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="210973ab-ee81-4502-92c9-7e76da6f92ee" containerName="istio-proxy"
Jul 16 11:49:23.337259 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:49:23.337190    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="210973ab-ee81-4502-92c9-7e76da6f92ee" containerName="istio-proxy"
Jul 16 11:49:23.337259 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:49:23.337205    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="c0d90834-efd5-4aab-a8f1-5ba65c6b359f" containerName="istio-proxy"
Jul 16 11:49:23.337259 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:49:23.337217    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="26b7813f-5667-497b-a591-881f39450d5b" containerName="test-curl-7375-139995116098160"
Jul 16 11:49:23.337516 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:49:23.337357    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c0d90834-efd5-4aab-a8f1-5ba65c6b359f" containerName="istio-proxy"
Jul 16 11:49:23.337516 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:49:23.337368    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="c0d90834-efd5-4aab-a8f1-5ba65c6b359f" containerName="istio-proxy"
Jul 16 11:49:23.337516 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:49:23.337492    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="c0d90834-efd5-4aab-a8f1-5ba65c6b359f" containerName="istio-proxy"
Jul 16 11:49:23.337666 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:49:23.337517    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="210973ab-ee81-4502-92c9-7e76da6f92ee" containerName="istio-proxy"
Jul 16 11:49:23.342816 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:49:23.342764    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-8p4bp/must-gather-9rqfh"
Jul 16 11:49:23.345213 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:49:23.345173    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-8p4bp\"/\"kube-root-ca.crt\""
Jul 16 11:49:23.345213 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:49:23.345215    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:49:23.345471 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:49:23.345321    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-8p4bp\"/\"default-dockercfg-8p8z5\""
Jul 16 11:49:23.345684 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:49:23.345667    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-8p4bp\"/\"openshift-service-ca.crt\""
Jul 16 11:49:23.350928 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:49:23.350899    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-8p4bp/must-gather-9rqfh"]
Jul 16 11:49:23.409993 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:49:23.409955    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log" limit=1024
Jul 16 11:49:23.466112 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:49:23.466074    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7cwqt\" (UniqueName: \"kubernetes.io/projected/f00c9c2f-3c84-4394-b9bd-251792b00df3-kube-api-access-7cwqt\") pod \"must-gather-9rqfh\" (UID: \"f00c9c2f-3c84-4394-b9bd-251792b00df3\") " pod="openshift-must-gather-8p4bp/must-gather-9rqfh"
Jul 16 11:49:23.466291 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:49:23.466183    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/f00c9c2f-3c84-4394-b9bd-251792b00df3-must-gather-output\") pod \"must-gather-9rqfh\" (UID: \"f00c9c2f-3c84-4394-b9bd-251792b00df3\") " pod="openshift-must-gather-8p4bp/must-gather-9rqfh"
Jul 16 11:49:23.566895 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:49:23.566848    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/f00c9c2f-3c84-4394-b9bd-251792b00df3-must-gather-output\") pod \"must-gather-9rqfh\" (UID: \"f00c9c2f-3c84-4394-b9bd-251792b00df3\") " pod="openshift-must-gather-8p4bp/must-gather-9rqfh"
Jul 16 11:49:23.567071 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:49:23.566950    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7cwqt\" (UniqueName: \"kubernetes.io/projected/f00c9c2f-3c84-4394-b9bd-251792b00df3-kube-api-access-7cwqt\") pod \"must-gather-9rqfh\" (UID: \"f00c9c2f-3c84-4394-b9bd-251792b00df3\") " pod="openshift-must-gather-8p4bp/must-gather-9rqfh"
Jul 16 11:49:23.567178 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:49:23.567158    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/f00c9c2f-3c84-4394-b9bd-251792b00df3-must-gather-output\") pod \"must-gather-9rqfh\" (UID: \"f00c9c2f-3c84-4394-b9bd-251792b00df3\") " pod="openshift-must-gather-8p4bp/must-gather-9rqfh"
Jul 16 11:49:23.574588 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:49:23.574560    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7cwqt\" (UniqueName: \"kubernetes.io/projected/f00c9c2f-3c84-4394-b9bd-251792b00df3-kube-api-access-7cwqt\") pod \"must-gather-9rqfh\" (UID: \"f00c9c2f-3c84-4394-b9bd-251792b00df3\") " pod="openshift-must-gather-8p4bp/must-gather-9rqfh"
Jul 16 11:49:23.654101 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:49:23.654015    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-8p4bp/must-gather-9rqfh"
Jul 16 11:49:23.818485 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:49:23.818458    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-8p4bp/must-gather-9rqfh"]
Jul 16 11:49:23.820867 ip-10-0-135-184 kubenswrapper[2564]: W0716 11:49:23.820820    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf00c9c2f_3c84_4394_b9bd_251792b00df3.slice/crio-7aa73b786caa1d32fb16caa3db863b4a1e24ba4fb6f3d1955c33d53f6bafff6e WatchSource:0}: Error finding container 7aa73b786caa1d32fb16caa3db863b4a1e24ba4fb6f3d1955c33d53f6bafff6e: Status 404 returned error can't find the container with id 7aa73b786caa1d32fb16caa3db863b4a1e24ba4fb6f3d1955c33d53f6bafff6e
Jul 16 11:49:24.617278 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:49:24.617241    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-8p4bp/must-gather-9rqfh" event={"ID":"f00c9c2f-3c84-4394-b9bd-251792b00df3","Type":"ContainerStarted","Data":"7aa73b786caa1d32fb16caa3db863b4a1e24ba4fb6f3d1955c33d53f6bafff6e"}
Jul 16 11:49:25.629430 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:49:25.628539    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-8p4bp/must-gather-9rqfh" event={"ID":"f00c9c2f-3c84-4394-b9bd-251792b00df3","Type":"ContainerStarted","Data":"fd98fbdad69b49e3d257d0dfcc1e49d20f59804bf2f222f790f8e8d9ed1aa9d4"}
Jul 16 11:49:25.629430 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:49:25.628596    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-8p4bp/must-gather-9rqfh" event={"ID":"f00c9c2f-3c84-4394-b9bd-251792b00df3","Type":"ContainerStarted","Data":"4560d546c1b9dc763a03a955003f150a9333bf298c98f16be8b99cf91f88a48c"}
Jul 16 11:49:25.644494 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:49:25.644316    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-8p4bp/must-gather-9rqfh" podStartSLOduration=1.566787473 podStartE2EDuration="2.64429244s" totalImagesPullingTime="1.077504967s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 11:49:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 11:49:25.644003821 +0000 UTC m=+2466.015540876" watchObservedRunningTime="2026-07-16 11:49:25.64429244 +0000 UTC m=+2466.015829476"
Jul 16 11:49:26.637955 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:49:26.637923    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-pzsf4_55506f12-a9f6-4576-b250-576b091deb19/global-pull-secret-syncer/0.log"
Jul 16 11:49:26.687059 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:49:26.687021    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-hbhws_1654c4da-b013-4bca-a0a8-5efe36c38fee/konnectivity-agent/0.log"
Jul 16 11:49:26.814922 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:49:26.814891    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-135-184.ec2.internal_5e44ce4b9dc5eed0a3686382d6febba7/haproxy/0.log"
Jul 16 11:49:32.691262 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:49:32.691186    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-hflvv_720e7931-30ba-4fe0-a497-225b75a6a9b7/manager/0.log"
Jul 16 11:49:32.728840 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:49:32.728806    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-d85nj_6cff258f-0591-4972-abb1-b4b13a61918f/manager/0.log"
Jul 16 11:49:32.819024 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:49:32.818986    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-69vj5_f24c429f-b539-4f92-882b-410db6c83b10/registry-server/0.log"
Jul 16 11:49:33.059533 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:49:33.059460    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-x6hww_f042e41d-8110-44ca-a69d-2bebe7effe60/manager/0.log"
Jul 16 11:49:35.101140 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:49:35.101101    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-785778ff74-pwndd_c02fa2f9-7be3-472b-8078-55cfc78a2be7/kube-state-metrics/0.log"
Jul 16 11:49:35.131982 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:49:35.131925    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-785778ff74-pwndd_c02fa2f9-7be3-472b-8078-55cfc78a2be7/kube-rbac-proxy-main/0.log"
Jul 16 11:49:35.156717 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:49:35.156685    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-785778ff74-pwndd_c02fa2f9-7be3-472b-8078-55cfc78a2be7/kube-rbac-proxy-self/0.log"
Jul 16 11:49:35.189826 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:49:35.189795    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-69d8fcdb9b-mwqgc_e5c2f73c-e790-4b49-a742-dc3a5904de50/metrics-server/0.log"
Jul 16 11:49:35.219641 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:49:35.219590    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-5f68df7f58-jp2z8_cd047922-7440-486d-9239-4d2a05c98761/monitoring-plugin/0.log"
Jul 16 11:49:35.254747 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:49:35.254715    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-45594_92d26de8-4fb0-4807-917c-bbad2af89377/node-exporter/0.log"
Jul 16 11:49:35.284666 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:49:35.284632    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-45594_92d26de8-4fb0-4807-917c-bbad2af89377/kube-rbac-proxy/0.log"
Jul 16 11:49:35.321627 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:49:35.321592    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-45594_92d26de8-4fb0-4807-917c-bbad2af89377/init-textfile/0.log"
Jul 16 11:49:35.593030 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:49:35.592997    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-84bd68b896-gmzk4_a6d30211-1115-44b6-b751-34ddc73cacbb/kube-rbac-proxy-main/0.log"
Jul 16 11:49:35.620141 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:49:35.620097    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-84bd68b896-gmzk4_a6d30211-1115-44b6-b751-34ddc73cacbb/kube-rbac-proxy-self/0.log"
Jul 16 11:49:35.645448 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:49:35.645420    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-84bd68b896-gmzk4_a6d30211-1115-44b6-b751-34ddc73cacbb/openshift-state-metrics/0.log"
Jul 16 11:49:36.259546 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:49:36.259519    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-77495844f8-bq7n5_8da55f62-7482-48e9-aeb8-107b1b8cef69/thanos-query/0.log"
Jul 16 11:49:36.284310 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:49:36.284269    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-77495844f8-bq7n5_8da55f62-7482-48e9-aeb8-107b1b8cef69/kube-rbac-proxy-web/0.log"
Jul 16 11:49:36.309525 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:49:36.309500    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-77495844f8-bq7n5_8da55f62-7482-48e9-aeb8-107b1b8cef69/kube-rbac-proxy/0.log"
Jul 16 11:49:36.332080 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:49:36.332052    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-77495844f8-bq7n5_8da55f62-7482-48e9-aeb8-107b1b8cef69/prom-label-proxy/0.log"
Jul 16 11:49:36.354826 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:49:36.354790    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-77495844f8-bq7n5_8da55f62-7482-48e9-aeb8-107b1b8cef69/kube-rbac-proxy-rules/0.log"
Jul 16 11:49:36.381890 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:49:36.381840    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-77495844f8-bq7n5_8da55f62-7482-48e9-aeb8-107b1b8cef69/kube-rbac-proxy-metrics/0.log"
Jul 16 11:49:37.081275 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:49:37.081221    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-8p4bp/perf-node-gather-daemonset-djgkz"]
Jul 16 11:49:37.091114 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:49:37.091073    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-8p4bp/perf-node-gather-daemonset-djgkz"
Jul 16 11:49:37.094391 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:49:37.094358    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-8p4bp/perf-node-gather-daemonset-djgkz"]
Jul 16 11:49:37.222593 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:49:37.222559    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/05e0a7ce-d302-493e-954d-6ccf4ea74053-lib-modules\") pod \"perf-node-gather-daemonset-djgkz\" (UID: \"05e0a7ce-d302-493e-954d-6ccf4ea74053\") " pod="openshift-must-gather-8p4bp/perf-node-gather-daemonset-djgkz"
Jul 16 11:49:37.222823 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:49:37.222617    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/05e0a7ce-d302-493e-954d-6ccf4ea74053-podres\") pod \"perf-node-gather-daemonset-djgkz\" (UID: \"05e0a7ce-d302-493e-954d-6ccf4ea74053\") " pod="openshift-must-gather-8p4bp/perf-node-gather-daemonset-djgkz"
Jul 16 11:49:37.222823 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:49:37.222686    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/05e0a7ce-d302-493e-954d-6ccf4ea74053-proc\") pod \"perf-node-gather-daemonset-djgkz\" (UID: \"05e0a7ce-d302-493e-954d-6ccf4ea74053\") " pod="openshift-must-gather-8p4bp/perf-node-gather-daemonset-djgkz"
Jul 16 11:49:37.222823 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:49:37.222797    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/05e0a7ce-d302-493e-954d-6ccf4ea74053-sys\") pod \"perf-node-gather-daemonset-djgkz\" (UID: \"05e0a7ce-d302-493e-954d-6ccf4ea74053\") " pod="openshift-must-gather-8p4bp/perf-node-gather-daemonset-djgkz"
Jul 16 11:49:37.223011 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:49:37.222861    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pd995\" (UniqueName: \"kubernetes.io/projected/05e0a7ce-d302-493e-954d-6ccf4ea74053-kube-api-access-pd995\") pod \"perf-node-gather-daemonset-djgkz\" (UID: \"05e0a7ce-d302-493e-954d-6ccf4ea74053\") " pod="openshift-must-gather-8p4bp/perf-node-gather-daemonset-djgkz"
Jul 16 11:49:37.324341 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:49:37.324297    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/05e0a7ce-d302-493e-954d-6ccf4ea74053-sys\") pod \"perf-node-gather-daemonset-djgkz\" (UID: \"05e0a7ce-d302-493e-954d-6ccf4ea74053\") " pod="openshift-must-gather-8p4bp/perf-node-gather-daemonset-djgkz"
Jul 16 11:49:37.324874 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:49:37.324363    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pd995\" (UniqueName: \"kubernetes.io/projected/05e0a7ce-d302-493e-954d-6ccf4ea74053-kube-api-access-pd995\") pod \"perf-node-gather-daemonset-djgkz\" (UID: \"05e0a7ce-d302-493e-954d-6ccf4ea74053\") " pod="openshift-must-gather-8p4bp/perf-node-gather-daemonset-djgkz"
Jul 16 11:49:37.324874 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:49:37.324431    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/05e0a7ce-d302-493e-954d-6ccf4ea74053-lib-modules\") pod \"perf-node-gather-daemonset-djgkz\" (UID: \"05e0a7ce-d302-493e-954d-6ccf4ea74053\") " pod="openshift-must-gather-8p4bp/perf-node-gather-daemonset-djgkz"
Jul 16 11:49:37.324874 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:49:37.324449    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/05e0a7ce-d302-493e-954d-6ccf4ea74053-sys\") pod \"perf-node-gather-daemonset-djgkz\" (UID: \"05e0a7ce-d302-493e-954d-6ccf4ea74053\") " pod="openshift-must-gather-8p4bp/perf-node-gather-daemonset-djgkz"
Jul 16 11:49:37.324874 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:49:37.324480    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/05e0a7ce-d302-493e-954d-6ccf4ea74053-podres\") pod \"perf-node-gather-daemonset-djgkz\" (UID: \"05e0a7ce-d302-493e-954d-6ccf4ea74053\") " pod="openshift-must-gather-8p4bp/perf-node-gather-daemonset-djgkz"
Jul 16 11:49:37.324874 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:49:37.324516    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/05e0a7ce-d302-493e-954d-6ccf4ea74053-proc\") pod \"perf-node-gather-daemonset-djgkz\" (UID: \"05e0a7ce-d302-493e-954d-6ccf4ea74053\") " pod="openshift-must-gather-8p4bp/perf-node-gather-daemonset-djgkz"
Jul 16 11:49:37.324874 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:49:37.324592    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/05e0a7ce-d302-493e-954d-6ccf4ea74053-proc\") pod \"perf-node-gather-daemonset-djgkz\" (UID: \"05e0a7ce-d302-493e-954d-6ccf4ea74053\") " pod="openshift-must-gather-8p4bp/perf-node-gather-daemonset-djgkz"
Jul 16 11:49:37.324874 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:49:37.324637    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/05e0a7ce-d302-493e-954d-6ccf4ea74053-lib-modules\") pod \"perf-node-gather-daemonset-djgkz\" (UID: \"05e0a7ce-d302-493e-954d-6ccf4ea74053\") " pod="openshift-must-gather-8p4bp/perf-node-gather-daemonset-djgkz"
Jul 16 11:49:37.324874 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:49:37.324673    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/05e0a7ce-d302-493e-954d-6ccf4ea74053-podres\") pod \"perf-node-gather-daemonset-djgkz\" (UID: \"05e0a7ce-d302-493e-954d-6ccf4ea74053\") " pod="openshift-must-gather-8p4bp/perf-node-gather-daemonset-djgkz"
Jul 16 11:49:37.334844 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:49:37.333420    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pd995\" (UniqueName: \"kubernetes.io/projected/05e0a7ce-d302-493e-954d-6ccf4ea74053-kube-api-access-pd995\") pod \"perf-node-gather-daemonset-djgkz\" (UID: \"05e0a7ce-d302-493e-954d-6ccf4ea74053\") " pod="openshift-must-gather-8p4bp/perf-node-gather-daemonset-djgkz"
Jul 16 11:49:37.420965 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:49:37.420928    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-8p4bp/perf-node-gather-daemonset-djgkz"
Jul 16 11:49:37.600175 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:49:37.599920    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-6cf856758c-shdrh_9cc04542-5f65-43d8-b15f-5647477c2927/networking-console-plugin/0.log"
Jul 16 11:49:37.617819 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:49:37.617701    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-8p4bp/perf-node-gather-daemonset-djgkz"]
Jul 16 11:49:37.739164 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:49:37.739123    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-8p4bp/perf-node-gather-daemonset-djgkz" event={"ID":"05e0a7ce-d302-493e-954d-6ccf4ea74053","Type":"ContainerStarted","Data":"a6110d4856869d752e7849bfe902b2a8a4e45246198bcb9b4bab0bd3cc4a1a25"}
Jul 16 11:49:38.161383 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:49:38.161354    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-lwmwf_4cb63124-522c-41e2-9d85-c2af29ac8eff/console-operator/1.log"
Jul 16 11:49:38.167361 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:49:38.167332    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-lwmwf_4cb63124-522c-41e2-9d85-c2af29ac8eff/console-operator/2.log"
Jul 16 11:49:38.746760 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:49:38.746727    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-8p4bp/perf-node-gather-daemonset-djgkz" event={"ID":"05e0a7ce-d302-493e-954d-6ccf4ea74053","Type":"ContainerStarted","Data":"7564492312c61533c70bd85c521c61af760be46fd36ae9a5be323bc55bc686a7"}
Jul 16 11:49:38.747258 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:49:38.746810    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-8p4bp/perf-node-gather-daemonset-djgkz"
Jul 16 11:49:38.763203 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:49:38.763151    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-8p4bp/perf-node-gather-daemonset-djgkz" podStartSLOduration=1.763132291 podStartE2EDuration="1.763132291s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 11:49:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 11:49:38.761454577 +0000 UTC m=+2479.132991624" watchObservedRunningTime="2026-07-16 11:49:38.763132291 +0000 UTC m=+2479.134669327"
Jul 16 11:49:40.431378 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:49:40.431349    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-k69kw_a87056cf-7dba-4395-b644-4aeb45e9b8e7/dns/0.log"
Jul 16 11:49:40.463690 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:49:40.463650    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-k69kw_a87056cf-7dba-4395-b644-4aeb45e9b8e7/kube-rbac-proxy/0.log"
Jul 16 11:49:40.596042 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:49:40.596013    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-44kqf_e335433b-f42b-4f52-b88e-02f36ff33f83/dns-node-resolver/0.log"
Jul 16 11:49:41.235506 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:49:41.235468    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-2frcp_47ecd32d-7f31-43d9-9828-d2621113d37c/node-ca/0.log"
Jul 16 11:49:42.270789 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:49:42.270751    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4xd45c_7e6b410d-9b78-48d6-ab3e-60e4168a4971/istio-proxy/0.log"
Jul 16 11:49:42.472356 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:49:42.472328    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-79cdcbc7df-ljvqd_d91bec46-3634-4bd1-a785-7dbc9d97eb0f/kube-auth-proxy/0.log"
Jul 16 11:49:42.529191 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:49:42.529091    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-57qbg_fae58f40-1477-417a-921a-2ed601fe72aa/istio-proxy/0.log"
Jul 16 11:49:42.569066 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:49:42.569036    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-57qbg_fae58f40-1477-417a-921a-2ed601fe72aa/istio-proxy/1.log"
Jul 16 11:49:42.642718 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:49:42.642681    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-f9b8d9b9b-4hpsd_0bd3371c-a617-4407-9eeb-3d7dbf08725c/payload-processing/0.log"
Jul 16 11:49:42.684388 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:49:42.684355    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7f4487f9c8-wnk66_13fa2ca5-b90c-46e7-92bc-7a8cb4c036a2/router/0.log"
Jul 16 11:49:43.390517 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:49:43.390483    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-6x8n4_57dd81c5-98a2-455f-bb65-4f35f1979846/serve-healthcheck-canary/0.log"
Jul 16 11:49:43.949502 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:49:43.949471    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-fd9q7_8cb7db93-eb1a-4540-b167-9d6efbe4b524/kube-rbac-proxy/0.log"
Jul 16 11:49:43.973284 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:49:43.973248    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-fd9q7_8cb7db93-eb1a-4540-b167-9d6efbe4b524/exporter/0.log"
Jul 16 11:49:43.996988 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:49:43.996957    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-fd9q7_8cb7db93-eb1a-4540-b167-9d6efbe4b524/extractor/0.log"
Jul 16 11:49:44.767265 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:49:44.767238    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-8p4bp/perf-node-gather-daemonset-djgkz"
Jul 16 11:49:46.664443 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:49:46.664413    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-555b7_e2753d05-dd93-4a8c-a671-8a82b06180de/manager/0.log"
Jul 16 11:49:46.837522 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:49:46.837488    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-9fxzw_3b966a79-168a-4aff-94f8-669f33082e69/manager/0.log"
Jul 16 11:49:46.953680 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:49:46.953651    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-54f9b6467-txxc6_944fff28-f017-400b-b98d-9238292c5c83/manager/0.log"
Jul 16 11:49:46.976059 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:49:46.976036    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-lb4qx_3f7a7b44-5c27-4db2-9e8b-e98bf35a796c/server/0.log"
Jul 16 11:49:47.058672 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:49:47.058641    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-4n8hq_7abd43ff-29ae-482d-9aae-c56d1df4897e/manager/0.log"
Jul 16 11:49:47.235542 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:49:47.235502    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5f8c4d5c89-v9wk9_6f655f01-c2f4-44bc-aa68-f12f145f9839/manager/0.log"
Jul 16 11:49:47.258291 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:49:47.258260    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5f8c4d5c89-v9wk9_6f655f01-c2f4-44bc-aa68-f12f145f9839/copy-manifests/0.log"
Jul 16 11:49:48.463364 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:49:48.463316    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4xd45c_7e6b410d-9b78-48d6-ab3e-60e4168a4971/istio-proxy/0.log"
Jul 16 11:49:48.643032 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:49:48.643002    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-79cdcbc7df-ljvqd_d91bec46-3634-4bd1-a785-7dbc9d97eb0f/kube-auth-proxy/0.log"
Jul 16 11:49:48.692237 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:49:48.692205    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-57qbg_fae58f40-1477-417a-921a-2ed601fe72aa/istio-proxy/0.log"
Jul 16 11:49:48.737818 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:49:48.737721    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-57qbg_fae58f40-1477-417a-921a-2ed601fe72aa/istio-proxy/1.log"
Jul 16 11:49:48.786113 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:49:48.786074    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-f9b8d9b9b-4hpsd_0bd3371c-a617-4407-9eeb-3d7dbf08725c/payload-processing/0.log"
Jul 16 11:49:48.805119 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:49:48.805086    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7f4487f9c8-wnk66_13fa2ca5-b90c-46e7-92bc-7a8cb4c036a2/router/0.log"
Jul 16 11:49:49.951561 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:49:49.951484    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4xd45c_7e6b410d-9b78-48d6-ab3e-60e4168a4971/istio-proxy/0.log"
Jul 16 11:49:50.137659 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:49:50.137626    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-79cdcbc7df-ljvqd_d91bec46-3634-4bd1-a785-7dbc9d97eb0f/kube-auth-proxy/0.log"
Jul 16 11:49:50.176932 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:49:50.176890    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-57qbg_fae58f40-1477-417a-921a-2ed601fe72aa/istio-proxy/0.log"
Jul 16 11:49:50.218318 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:49:50.218237    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-57qbg_fae58f40-1477-417a-921a-2ed601fe72aa/istio-proxy/1.log"
Jul 16 11:49:50.284425 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:49:50.284396    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-f9b8d9b9b-4hpsd_0bd3371c-a617-4407-9eeb-3d7dbf08725c/payload-processing/0.log"
Jul 16 11:49:50.303326 ip-10-0-135-184 kubenswrapper[2564]: I0716 11:49:50.303297    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7f4487f9c8-wnk66_13fa2ca5-b90c-46e7-92bc-7a8cb4c036a2/router/0.log"